2023-12-05T09:25:41.458 INFO:root:teuthology version: 0.0.1.dev214+gf2de108 2023-12-05T09:25:41.458 DEBUG:teuthology.run:Teuthology command: teuthology --name mchangir-2023-12-05_08:35:01-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi --archive /home/teuthworker/archive/mchangir-2023-12-05_08:35:01-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7477483 --owner mchangir --verbose --description fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/mchangir-2023-12-05_08:35:01-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7477483/orig.config.yaml 2023-12-05T09:25:41.511 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T09:25:41.590 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/mchangir-2023-12-05_08:35:01-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7477483 branch: wip-mchangir-testing-20231205.064351 description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: mchangir@redhat.com first_in_suite: false job_id: '7477483' kernel: flavor: default kdb: true sha1: 9471594ae3a4c6992c4327df9a789df8f2b6aeae last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/quincy ' name: mchangir-2023-12-05_08:35:01-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 8.stream overrides: admin_socket: branch: wip-mchangir-testing-20231205.064351 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-mchangir-testing-20231205.064351 sha1: 3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 owner: mchangir priority: 1000 repo: https://git.ceph.com/ceph-ci.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 9770 sha1: 3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 sleep_before_teardown: 0 subset: 782/1024 suite: fs suite_branch: wip-mchangir-testing-20231205.064351 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_3fe8d441c2f973bfe963ba4dd30ba8eac9f36227/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 targets: smithi100.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOnDFLD6mfgkHSo032210axjMA2n2OAfChZh321hYUSWNY79tGAdn+aZA1YR+K8Y1aFzcHWAIgTeElAXgCjKEdE= smithi150.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHZXMznv4Nn4bcUpUz/yt77hOePWZBTuKw/Z/yGhe1pfD4yshqvLSdGeSsWyXONoYdFJsTxbGIajnCx91yNBmHA= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools --allowerasing --nobest - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - install: branch: quincy exclude_packages: - ceph-volume - print: '**** done install task...' - cephadm: cephadm_branch: quincy cephadm_git_url: https://github.com/ceph/ceph conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:quincy roleless: true - print: '**** done end installing quincy cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 1 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay false - cephadm.shell: host.a: - ceph fs set cephfs inline_data false - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - kclient: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: - /cephfs/home/mchangir/src/git.ceph.com_ceph-c_wip-mchangir-testing-20231205.064351/qa/suites/fs/upgrade/mds_upgrade_sequence/tasks/3-upgrade-mgr-staggered.yaml meta: {} postmerge: [] variables: fail_fs: false teuthology_branch: main teuthology_sha1: f2de108beb0a6dde7f3e6c96039071828a1f6269 timestamp: 2023-12-05_08:35:01 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs false || true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: mchangir verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2023-12-05T09:25:41.591 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_3fe8d441c2f973bfe963ba4dd30ba8eac9f36227/qa; will attempt to use it 2023-12-05T09:25:41.592 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_3fe8d441c2f973bfe963ba4dd30ba8eac9f36227/qa/tasks 2023-12-05T09:25:41.592 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-12-05T09:25:41.593 INFO:teuthology.task.internal:Checking packages... 2023-12-05T09:25:41.617 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '3fe8d441c2f973bfe963ba4dd30ba8eac9f36227' 2023-12-05T09:25:41.617 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-05T09:25:41.618 INFO:teuthology.packaging:ref: None 2023-12-05T09:25:41.618 INFO:teuthology.packaging:tag: None 2023-12-05T09:25:41.618 INFO:teuthology.packaging:branch: wip-mchangir-testing-20231205.064351 2023-12-05T09:25:41.618 INFO:teuthology.packaging:sha1: 3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 2023-12-05T09:25:41.618 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-mchangir-testing-20231205.064351 2023-12-05T09:25:41.840 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-11.g3fe8d441 2023-12-05T09:25:41.840 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-12-05T09:25:41.846 INFO:teuthology.task.internal:no buildpackages task found 2023-12-05T09:25:41.846 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-12-05T09:25:41.860 INFO:teuthology.task.internal:Saving configuration 2023-12-05T09:25:41.879 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-12-05T09:25:41.886 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-05T09:25:41.913 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi100.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-12-05_08:35:01-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7477483', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-05 09:20:27.020804', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOnDFLD6mfgkHSo032210axjMA2n2OAfChZh321hYUSWNY79tGAdn+aZA1YR+K8Y1aFzcHWAIgTeElAXgCjKEdE='} 2023-12-05T09:25:41.933 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi150.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-12-05_08:35:01-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7477483', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-05 09:20:27.022175', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHZXMznv4Nn4bcUpUz/yt77hOePWZBTuKw/Z/yGhe1pfD4yshqvLSdGeSsWyXONoYdFJsTxbGIajnCx91yNBmHA='} 2023-12-05T09:25:41.933 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-12-05T09:25:41.939 INFO:teuthology.task.internal:roles: ubuntu@smithi100.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2023-12-05T09:25:41.940 INFO:teuthology.task.internal:roles: ubuntu@smithi150.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2023-12-05T09:25:41.940 INFO:teuthology.run_tasks:Running task console_log... 2023-12-05T09:25:42.010 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe531081a60>, signals=[15]) 2023-12-05T09:25:42.010 INFO:teuthology.run_tasks:Running task internal.connect... 2023-12-05T09:25:42.016 INFO:teuthology.task.internal:Opening connections... 2023-12-05T09:25:42.017 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi100.front.sepia.ceph.com 2023-12-05T09:25:42.018 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T09:25:42.086 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi150.front.sepia.ceph.com 2023-12-05T09:25:42.087 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T09:25:42.156 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-12-05T09:25:42.163 DEBUG:teuthology.orchestra.run.smithi100:> uname -m 2023-12-05T09:25:42.185 INFO:teuthology.orchestra.run.smithi100.stdout:x86_64 2023-12-05T09:25:42.185 DEBUG:teuthology.orchestra.run.smithi100:> cat /etc/os-release 2023-12-05T09:25:42.247 INFO:teuthology.orchestra.run.smithi100.stdout:NAME="CentOS Stream" 2023-12-05T09:25:42.247 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION="8" 2023-12-05T09:25:42.247 INFO:teuthology.orchestra.run.smithi100.stdout:ID="centos" 2023-12-05T09:25:42.247 INFO:teuthology.orchestra.run.smithi100.stdout:ID_LIKE="rhel fedora" 2023-12-05T09:25:42.247 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_ID="8" 2023-12-05T09:25:42.247 INFO:teuthology.orchestra.run.smithi100.stdout:PLATFORM_ID="platform:el8" 2023-12-05T09:25:42.247 INFO:teuthology.orchestra.run.smithi100.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-05T09:25:42.248 INFO:teuthology.orchestra.run.smithi100.stdout:ANSI_COLOR="0;31" 2023-12-05T09:25:42.248 INFO:teuthology.orchestra.run.smithi100.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-05T09:25:42.248 INFO:teuthology.orchestra.run.smithi100.stdout:HOME_URL="https://centos.org/" 2023-12-05T09:25:42.248 INFO:teuthology.orchestra.run.smithi100.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-05T09:25:42.248 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-05T09:25:42.248 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-05T09:25:42.248 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server 2023-12-05T09:25:42.269 DEBUG:teuthology.orchestra.run.smithi150:> uname -m 2023-12-05T09:25:42.291 INFO:teuthology.orchestra.run.smithi150.stdout:x86_64 2023-12-05T09:25:42.291 DEBUG:teuthology.orchestra.run.smithi150:> cat /etc/os-release 2023-12-05T09:25:42.352 INFO:teuthology.orchestra.run.smithi150.stdout:NAME="CentOS Stream" 2023-12-05T09:25:42.352 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION="8" 2023-12-05T09:25:42.352 INFO:teuthology.orchestra.run.smithi150.stdout:ID="centos" 2023-12-05T09:25:42.352 INFO:teuthology.orchestra.run.smithi150.stdout:ID_LIKE="rhel fedora" 2023-12-05T09:25:42.352 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_ID="8" 2023-12-05T09:25:42.352 INFO:teuthology.orchestra.run.smithi150.stdout:PLATFORM_ID="platform:el8" 2023-12-05T09:25:42.352 INFO:teuthology.orchestra.run.smithi150.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-05T09:25:42.352 INFO:teuthology.orchestra.run.smithi150.stdout:ANSI_COLOR="0;31" 2023-12-05T09:25:42.352 INFO:teuthology.orchestra.run.smithi150.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-05T09:25:42.352 INFO:teuthology.orchestra.run.smithi150.stdout:HOME_URL="https://centos.org/" 2023-12-05T09:25:42.352 INFO:teuthology.orchestra.run.smithi150.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-05T09:25:42.352 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-05T09:25:42.352 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-05T09:25:42.353 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server 2023-12-05T09:25:42.377 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-12-05T09:25:42.386 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-12-05T09:25:42.392 INFO:teuthology.task.internal:Checking for old test directory... 2023-12-05T09:25:42.392 DEBUG:teuthology.orchestra.run.smithi100:> test '!' -e /home/ubuntu/cephtest 2023-12-05T09:25:42.395 DEBUG:teuthology.orchestra.run.smithi150:> test '!' -e /home/ubuntu/cephtest 2023-12-05T09:25:42.416 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-12-05T09:25:42.423 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-12-05T09:25:42.423 DEBUG:teuthology.orchestra.run.smithi100:> test -z $(ls -A /var/lib/ceph) 2023-12-05T09:25:42.456 DEBUG:teuthology.orchestra.run.smithi150:> test -z $(ls -A /var/lib/ceph) 2023-12-05T09:25:42.484 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-12-05T09:25:42.539 INFO:teuthology.run_tasks:Running task kernel... 2023-12-05T09:25:42.556 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': '9471594ae3a4c6992c4327df9a789df8f2b6aeae'} 2023-12-05T09:25:42.556 INFO:teuthology.task.kernel:config {'host.a': {'flavor': 'default', 'kdb': True, 'sha1': '9471594ae3a4c6992c4327df9a789df8f2b6aeae'}, 'host.b': {'flavor': 'default', 'kdb': True, 'sha1': '9471594ae3a4c6992c4327df9a789df8f2b6aeae'}}, timeout 300 2023-12-05T09:25:42.556 DEBUG:teuthology.orchestra.run.smithi100:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-05T09:25:42.557 DEBUG:teuthology.orchestra.run.smithi150:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-05T09:25:42.577 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-05T09:25:42.578 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-05T09:25:42.578 DEBUG:teuthology.task.kernel:sha1 for host.b is 9471594ae3a4c6992c4327df9a789df8f2b6aeae 2023-12-05T09:25:42.579 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "9471594ae3a4c6992c4327df9a789df8f2b6aeae"... 2023-12-05T09:25:42.579 DEBUG:teuthology.orchestra.run.smithi150:> uname -r 2023-12-05T09:25:42.579 DEBUG:teuthology.task.kernel:sha1 for host.a is 9471594ae3a4c6992c4327df9a789df8f2b6aeae 2023-12-05T09:25:42.579 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "9471594ae3a4c6992c4327df9a789df8f2b6aeae"... 2023-12-05T09:25:42.579 DEBUG:teuthology.orchestra.run.smithi100:> uname -r 2023-12-05T09:25:42.640 INFO:teuthology.orchestra.run.smithi150.stdout:4.18.0-489.el8.x86_64 2023-12-05T09:25:42.640 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-489.el8.x86_64 vs 9471594ae3a4c6992c4327df9a789df8f2b6aeae 2023-12-05T09:25:42.640 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-12-05T09:25:42.641 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=9471594ae3a4c6992c4327df9a789df8f2b6aeae 2023-12-05T09:25:42.644 INFO:teuthology.orchestra.run.smithi100.stdout:4.18.0-489.el8.x86_64 2023-12-05T09:25:42.644 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-489.el8.x86_64 vs 9471594ae3a4c6992c4327df9a789df8f2b6aeae 2023-12-05T09:25:42.644 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-12-05T09:25:42.645 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=9471594ae3a4c6992c4327df9a789df8f2b6aeae 2023-12-05T09:25:42.786 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum upgrade -y linux-firmware 2023-12-05T09:25:42.858 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum upgrade -y linux-firmware 2023-12-05T09:25:47.411 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 8 - AppStream 17 MB/s | 34 MB 00:01 2023-12-05T09:25:50.464 INFO:teuthology.orchestra.run.smithi150.stdout:CentOS Stream 8 - AppStream 6.8 MB/s | 34 MB 00:04 2023-12-05T09:25:55.461 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 8 - BaseOS 31 MB/s | 55 MB 00:01 2023-12-05T09:25:58.456 INFO:teuthology.orchestra.run.smithi150.stdout:CentOS Stream 8 - BaseOS 33 MB/s | 55 MB 00:01 2023-12-05T09:26:03.569 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 8 - Extras 66 kB/s | 18 kB 00:00 2023-12-05T09:26:03.878 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 8 - Extras common packages 54 kB/s | 6.9 kB 00:00 2023-12-05T09:26:04.180 INFO:teuthology.orchestra.run.smithi100.stdout:Copr repo for python3-asyncssh owned by ceph 23 kB/s | 3.5 kB 00:00 2023-12-05T09:26:05.839 INFO:teuthology.orchestra.run.smithi100.stdout:Extra Packages for Enterprise Linux 11 MB/s | 16 MB 00:01 2023-12-05T09:26:06.464 INFO:teuthology.orchestra.run.smithi150.stdout:CentOS Stream 8 - Extras 86 kB/s | 18 kB 00:00 2023-12-05T09:26:06.773 INFO:teuthology.orchestra.run.smithi150.stdout:CentOS Stream 8 - Extras common packages 54 kB/s | 6.9 kB 00:00 2023-12-05T09:26:07.058 INFO:teuthology.orchestra.run.smithi150.stdout:Copr repo for python3-asyncssh owned by ceph 26 kB/s | 3.5 kB 00:00 2023-12-05T09:26:09.067 INFO:teuthology.orchestra.run.smithi150.stdout:Extra Packages for Enterprise Linux 8.6 MB/s | 16 MB 00:01 2023-12-05T09:26:09.656 INFO:teuthology.orchestra.run.smithi100.stdout:lab-extras 364 kB/s | 24 kB 00:00 2023-12-05T09:26:12.934 INFO:teuthology.orchestra.run.smithi150.stdout:lab-extras 419 kB/s | 24 kB 00:00 2023-12-05T09:26:13.566 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2023-12-05T09:26:13.567 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2023-12-05T09:26:13.567 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repo Size 2023-12-05T09:26:13.567 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2023-12-05T09:26:13.567 INFO:teuthology.orchestra.run.smithi100.stdout:Upgrading: 2023-12-05T09:26:13.567 INFO:teuthology.orchestra.run.smithi100.stdout: linux-firmware noarch 20230824-118.git0e048b06.el8 baseos 286 M 2023-12-05T09:26:13.567 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:26:13.567 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2023-12-05T09:26:13.567 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2023-12-05T09:26:13.568 INFO:teuthology.orchestra.run.smithi100.stdout:Upgrade 1 Package 2023-12-05T09:26:13.568 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:26:13.568 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 286 M 2023-12-05T09:26:13.568 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2023-12-05T09:26:16.975 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2023-12-05T09:26:16.975 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2023-12-05T09:26:16.975 INFO:teuthology.orchestra.run.smithi150.stdout: Package Arch Version Repo Size 2023-12-05T09:26:16.975 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2023-12-05T09:26:16.976 INFO:teuthology.orchestra.run.smithi150.stdout:Upgrading: 2023-12-05T09:26:16.976 INFO:teuthology.orchestra.run.smithi150.stdout: linux-firmware noarch 20230824-118.git0e048b06.el8 baseos 286 M 2023-12-05T09:26:16.976 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:26:16.976 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction Summary 2023-12-05T09:26:16.976 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2023-12-05T09:26:16.976 INFO:teuthology.orchestra.run.smithi150.stdout:Upgrade 1 Package 2023-12-05T09:26:16.976 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:26:16.976 INFO:teuthology.orchestra.run.smithi150.stdout:Total download size: 286 M 2023-12-05T09:26:16.976 INFO:teuthology.orchestra.run.smithi150.stdout:Downloading Packages: 2023-12-05T09:26:49.303 INFO:teuthology.orchestra.run.smithi100.stdout:linux-firmware-20230824-118.git0e048b06.el8.noa 8.0 MB/s | 286 MB 00:35 2023-12-05T09:26:49.303 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2023-12-05T09:26:49.303 INFO:teuthology.orchestra.run.smithi100.stdout:Total 8.0 MB/s | 286 MB 00:35 2023-12-05T09:26:51.003 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2023-12-05T09:26:51.078 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2023-12-05T09:26:51.078 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2023-12-05T09:26:52.499 INFO:teuthology.orchestra.run.smithi150.stdout:linux-firmware-20230824-118.git0e048b06.el8.noa 8.1 MB/s | 286 MB 00:35 2023-12-05T09:26:52.499 INFO:teuthology.orchestra.run.smithi150.stdout:-------------------------------------------------------------------------------- 2023-12-05T09:26:52.499 INFO:teuthology.orchestra.run.smithi150.stdout:Total 8.1 MB/s | 286 MB 00:35 2023-12-05T09:26:52.863 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2023-12-05T09:26:52.888 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2023-12-05T09:26:54.197 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction check 2023-12-05T09:26:54.262 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction check succeeded. 2023-12-05T09:26:54.263 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction test 2023-12-05T09:26:56.045 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction test succeeded. 2023-12-05T09:26:56.075 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction 2023-12-05T09:27:11.906 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2023-12-05T09:27:12.246 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : linux-firmware-20230824-118.git0e048b06.el8.noarch 1/2 2023-12-05T09:27:12.465 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-12-05T09:27:12.691 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-12-05T09:27:12.691 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : linux-firmware-20230824-118.git0e048b06.el8.noarch 1/2 2023-12-05T09:27:13.540 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-12-05T09:27:13.540 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:27:13.540 INFO:teuthology.orchestra.run.smithi100.stdout:Upgraded: 2023-12-05T09:27:13.540 INFO:teuthology.orchestra.run.smithi100.stdout: linux-firmware-20230824-118.git0e048b06.el8.noarch 2023-12-05T09:27:13.540 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:27:13.540 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2023-12-05T09:27:13.728 INFO:teuthology.task.kernel:Downloading kernel 9471594ae3a4c6992c4327df9a789df8f2b6aeae on host.a... 2023-12-05T09:27:13.728 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=9471594ae3a4c6992c4327df9a789df8f2b6aeae 2023-12-05T09:27:14.063 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/9471594ae3a4c6992c4327df9a789df8f2b6aeae/centos/8/flavors/default/x86_64/ 2023-12-05T09:27:14.064 DEBUG:teuthology.orchestra.run.smithi100:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_g9471594ae3a4-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/9471594ae3a4c6992c4327df9a789df8f2b6aeae/centos/8/flavors/default/x86_64/ --input-file=- 2023-12-05T09:27:14.066 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi100.front.sepia.ceph.com to complete... 2023-12-05T09:27:14.885 INFO:teuthology.orchestra.run.smithi150.stdout: Preparing : 1/1 2023-12-05T09:27:15.246 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : linux-firmware-20230824-118.git0e048b06.el8.noarch 1/2 2023-12-05T09:27:15.490 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-12-05T09:27:15.735 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-12-05T09:27:15.735 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : linux-firmware-20230824-118.git0e048b06.el8.noarch 1/2 2023-12-05T09:27:16.628 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-12-05T09:27:16.628 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:27:16.628 INFO:teuthology.orchestra.run.smithi150.stdout:Upgraded: 2023-12-05T09:27:16.628 INFO:teuthology.orchestra.run.smithi150.stdout: linux-firmware-20230824-118.git0e048b06.el8.noarch 2023-12-05T09:27:16.628 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:27:16.628 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2023-12-05T09:27:16.834 INFO:teuthology.task.kernel:Downloading kernel 9471594ae3a4c6992c4327df9a789df8f2b6aeae on host.b... 2023-12-05T09:27:16.835 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=9471594ae3a4c6992c4327df9a789df8f2b6aeae 2023-12-05T09:27:17.132 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/9471594ae3a4c6992c4327df9a789df8f2b6aeae/centos/8/flavors/default/x86_64/ 2023-12-05T09:27:17.132 DEBUG:teuthology.orchestra.run.smithi150:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_g9471594ae3a4-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/9471594ae3a4c6992c4327df9a789df8f2b6aeae/centos/8/flavors/default/x86_64/ --input-file=- 2023-12-05T09:27:17.135 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi150.front.sepia.ceph.com to complete... 2023-12-05T09:27:36.116 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05 09:27:36 URL:https://2.chacra.ceph.com/r/kernel/testing/9471594ae3a4c6992c4327df9a789df8f2b6aeae/centos/8/flavors/default/x86_64/kernel-6.6.0_g9471594ae3a4-1.x86_64.rpm [383178600/383178600] -> "/tmp/kernel.x86_64.rpm" [1] 2023-12-05T09:27:36.116 INFO:teuthology.orchestra.run.smithi100.stderr:FINISHED --2023-12-05 09:27:36-- 2023-12-05T09:27:36.116 INFO:teuthology.orchestra.run.smithi100.stderr:Total wall clock time: 22s 2023-12-05T09:27:36.116 INFO:teuthology.orchestra.run.smithi100.stderr:Downloaded: 1 files, 365M in 22s (16.8 MB/s) 2023-12-05T09:27:36.117 INFO:teuthology.task.kernel:Installing kernel 9471594ae3a4c6992c4327df9a789df8f2b6aeae on host.a... 2023-12-05T09:27:36.117 DEBUG:teuthology.orchestra.run.smithi100:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-12-05T09:27:37.794 INFO:teuthology.orchestra.run.smithi100.stdout:Verifying... ######################################## 2023-12-05T09:27:37.837 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing... ######################################## 2023-12-05T09:27:37.946 INFO:teuthology.orchestra.run.smithi100.stdout:Updating / installing... 2023-12-05T09:28:16.110 INFO:teuthology.orchestra.run.smithi100.stdout:kernel-6.6.0_g9471594ae3a4-1 ######################################## 2023-12-05T09:28:19.087 INFO:teuthology.orchestra.run.smithi100.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-12-05T09:28:38.337 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi100.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-12-05T09:28:38.338 DEBUG:teuthology.orchestra.run.smithi100:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-12-05T09:28:38.436 INFO:teuthology.orchestra.run.smithi100.stdout:/boot/System.map-6.6.0-g9471594ae3a4 2023-12-05T09:28:38.437 INFO:teuthology.orchestra.run.smithi100.stdout:/boot/config-6.6.0-g9471594ae3a4 2023-12-05T09:28:38.437 INFO:teuthology.orchestra.run.smithi100.stdout:/boot/vmlinuz-6.6.0-g9471594ae3a4 2023-12-05T09:28:38.437 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4 2023-12-05T09:28:38.437 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel 2023-12-05T09:28:38.437 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch 2023-12-05T09:28:38.437 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86 2023-12-05T09:28:38.437 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto 2023-12-05T09:28:38.437 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-12-05T09:28:38.437 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-12-05T09:28:38.437 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-12-05T09:28:38.437 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-12-05T09:28:38.437 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-12-05T09:28:38.437 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-12-05T09:28:38.437 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-12-05T09:28:38.438 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/crc32c-intel.ko 2023-12-05T09:28:38.438 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-12-05T09:28:38.438 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-12-05T09:28:38.438 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-12-05T09:28:38.438 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-12-05T09:28:38.438 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/serpent-avx2.ko 2023-12-05T09:28:38.438 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-12-05T09:28:38.438 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-12-05T09:28:38.438 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-12-05T09:28:38.438 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-12-05T09:28:38.438 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-12-05T09:28:38.438 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-12-05T09:28:38.438 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-12-05T09:28:38.438 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/kernel 2023-12-05T09:28:38.439 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/kernel/cpu 2023-12-05T09:28:38.439 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/kernel/cpu/mce 2023-12-05T09:28:38.439 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-12-05T09:28:38.439 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/kvm 2023-12-05T09:28:38.439 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/kvm/kvm-amd.ko 2023-12-05T09:28:38.439 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/kvm/kvm-intel.ko 2023-12-05T09:28:38.439 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/kvm/kvm.ko 2023-12-05T09:28:38.439 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto 2023-12-05T09:28:38.439 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/ansi_cprng.ko 2023-12-05T09:28:38.439 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/anubis.ko 2023-12-05T09:28:38.439 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/arc4.ko 2023-12-05T09:28:38.439 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/async_tx 2023-12-05T09:28:38.439 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/async_tx/async_memcpy.ko 2023-12-05T09:28:38.439 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/async_tx/async_pq.ko 2023-12-05T09:28:38.439 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/async_tx/async_raid6_recov.ko 2023-12-05T09:28:38.440 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/async_tx/async_tx.ko 2023-12-05T09:28:38.440 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/async_tx/async_xor.ko 2023-12-05T09:28:38.440 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/async_tx/raid6test.ko 2023-12-05T09:28:38.440 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/authenc.ko 2023-12-05T09:28:38.440 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/authencesn.ko 2023-12-05T09:28:38.440 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/blake2b_generic.ko 2023-12-05T09:28:38.440 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/blowfish_common.ko 2023-12-05T09:28:38.440 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/blowfish_generic.ko 2023-12-05T09:28:38.440 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/camellia_generic.ko 2023-12-05T09:28:38.440 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/cast5_generic.ko 2023-12-05T09:28:38.440 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/cast6_generic.ko 2023-12-05T09:28:38.440 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/cast_common.ko 2023-12-05T09:28:38.440 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/ccm.ko 2023-12-05T09:28:38.440 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/cmac.ko 2023-12-05T09:28:38.440 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/crc32_generic.ko 2023-12-05T09:28:38.441 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/crypto_engine.ko 2023-12-05T09:28:38.441 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/crypto_user.ko 2023-12-05T09:28:38.441 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/cts.ko 2023-12-05T09:28:38.441 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/des_generic.ko 2023-12-05T09:28:38.441 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/dh_generic.ko 2023-12-05T09:28:38.441 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/echainiv.ko 2023-12-05T09:28:38.441 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/essiv.ko 2023-12-05T09:28:38.441 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/fcrypt.ko 2023-12-05T09:28:38.441 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/khazad.ko 2023-12-05T09:28:38.441 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/lz4.ko 2023-12-05T09:28:38.441 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/lz4hc.ko 2023-12-05T09:28:38.441 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/md4.ko 2023-12-05T09:28:38.441 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/michael_mic.ko 2023-12-05T09:28:38.441 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/pcbc.ko 2023-12-05T09:28:38.441 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/pcrypt.ko 2023-12-05T09:28:38.441 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/rmd160.ko 2023-12-05T09:28:38.442 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/seed.ko 2023-12-05T09:28:38.442 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/serpent_generic.ko 2023-12-05T09:28:38.442 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/tcrypt.ko 2023-12-05T09:28:38.442 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/tea.ko 2023-12-05T09:28:38.442 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/twofish_common.ko 2023-12-05T09:28:38.442 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/twofish_generic.ko 2023-12-05T09:28:38.442 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/vmac.ko 2023-12-05T09:28:38.442 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/wp512.ko 2023-12-05T09:28:38.442 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/xcbc.ko 2023-12-05T09:28:38.442 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/xor.ko 2023-12-05T09:28:38.442 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/xxhash_generic.ko 2023-12-05T09:28:38.442 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers 2023-12-05T09:28:38.442 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/acpi 2023-12-05T09:28:38.442 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/acpi/acpi_ipmi.ko 2023-12-05T09:28:38.442 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/acpi/acpi_pad.ko 2023-12-05T09:28:38.443 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/acpi/custom_method.ko 2023-12-05T09:28:38.443 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/acpi/ec_sys.ko 2023-12-05T09:28:38.443 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/acpi/platform_profile.ko 2023-12-05T09:28:38.443 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/acpi/sbs.ko 2023-12-05T09:28:38.443 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/acpi/sbshc.ko 2023-12-05T09:28:38.443 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/acpi/video.ko 2023-12-05T09:28:38.443 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata 2023-12-05T09:28:38.443 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/acard-ahci.ko 2023-12-05T09:28:38.443 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/ahci_platform.ko 2023-12-05T09:28:38.443 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/ata_generic.ko 2023-12-05T09:28:38.443 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/libahci_platform.ko 2023-12-05T09:28:38.443 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_acpi.ko 2023-12-05T09:28:38.443 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_ali.ko 2023-12-05T09:28:38.443 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_amd.ko 2023-12-05T09:28:38.443 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_artop.ko 2023-12-05T09:28:38.444 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_atiixp.ko 2023-12-05T09:28:38.444 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_atp867x.ko 2023-12-05T09:28:38.444 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_cmd640.ko 2023-12-05T09:28:38.444 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_cmd64x.ko 2023-12-05T09:28:38.444 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_cypress.ko 2023-12-05T09:28:38.444 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_efar.ko 2023-12-05T09:28:38.444 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_hpt366.ko 2023-12-05T09:28:38.444 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_hpt37x.ko 2023-12-05T09:28:38.444 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_hpt3x2n.ko 2023-12-05T09:28:38.444 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_hpt3x3.ko 2023-12-05T09:28:38.444 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_it8213.ko 2023-12-05T09:28:38.444 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_it821x.ko 2023-12-05T09:28:38.444 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_jmicron.ko 2023-12-05T09:28:38.444 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_marvell.ko 2023-12-05T09:28:38.444 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_mpiix.ko 2023-12-05T09:28:38.444 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_netcell.ko 2023-12-05T09:28:38.445 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_ninja32.ko 2023-12-05T09:28:38.445 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_ns87410.ko 2023-12-05T09:28:38.445 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_ns87415.ko 2023-12-05T09:28:38.445 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_oldpiix.ko 2023-12-05T09:28:38.445 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_opti.ko 2023-12-05T09:28:38.445 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_optidma.ko 2023-12-05T09:28:38.445 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_pcmcia.ko 2023-12-05T09:28:38.445 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_pdc2027x.ko 2023-12-05T09:28:38.445 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-12-05T09:28:38.445 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_piccolo.ko 2023-12-05T09:28:38.445 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_rdc.ko 2023-12-05T09:28:38.445 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_sch.ko 2023-12-05T09:28:38.445 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_serverworks.ko 2023-12-05T09:28:38.445 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_sil680.ko 2023-12-05T09:28:38.445 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_sis.ko 2023-12-05T09:28:38.446 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_sl82c105.ko 2023-12-05T09:28:38.446 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_triflex.ko 2023-12-05T09:28:38.446 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_via.ko 2023-12-05T09:28:38.446 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pdc_adma.ko 2023-12-05T09:28:38.446 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_inic162x.ko 2023-12-05T09:28:38.446 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_mv.ko 2023-12-05T09:28:38.446 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_nv.ko 2023-12-05T09:28:38.446 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_promise.ko 2023-12-05T09:28:38.446 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_qstor.ko 2023-12-05T09:28:38.446 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_sil.ko 2023-12-05T09:28:38.446 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_sil24.ko 2023-12-05T09:28:38.446 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_sis.ko 2023-12-05T09:28:38.446 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_svw.ko 2023-12-05T09:28:38.446 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_sx4.ko 2023-12-05T09:28:38.447 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_uli.ko 2023-12-05T09:28:38.447 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_via.ko 2023-12-05T09:28:38.447 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_vsc.ko 2023-12-05T09:28:38.447 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/auxdisplay 2023-12-05T09:28:38.447 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/auxdisplay/ks0108.ko 2023-12-05T09:28:38.447 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/base 2023-12-05T09:28:38.447 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/base/regmap 2023-12-05T09:28:38.447 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/base/regmap/regmap-i2c.ko 2023-12-05T09:28:38.447 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/base/regmap/regmap-mmio.ko 2023-12-05T09:28:38.447 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/bcma 2023-12-05T09:28:38.447 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/bcma/bcma.ko 2023-12-05T09:28:38.447 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block 2023-12-05T09:28:38.447 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/aoe 2023-12-05T09:28:38.447 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/aoe/aoe.ko 2023-12-05T09:28:38.447 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/brd.ko 2023-12-05T09:28:38.448 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/drbd 2023-12-05T09:28:38.448 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/drbd/drbd.ko 2023-12-05T09:28:38.448 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/floppy.ko 2023-12-05T09:28:38.448 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/loop.ko 2023-12-05T09:28:38.448 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/mtip32xx 2023-12-05T09:28:38.448 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-12-05T09:28:38.448 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/nbd.ko 2023-12-05T09:28:38.448 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/null_blk 2023-12-05T09:28:38.448 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/null_blk/null_blk.ko 2023-12-05T09:28:38.448 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/pktcdvd.ko 2023-12-05T09:28:38.448 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/rbd.ko 2023-12-05T09:28:38.448 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/virtio_blk.ko 2023-12-05T09:28:38.448 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/xen-blkback 2023-12-05T09:28:38.448 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-12-05T09:28:38.448 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/xen-blkfront.ko 2023-12-05T09:28:38.449 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/zram 2023-12-05T09:28:38.449 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/zram/zram.ko 2023-12-05T09:28:38.449 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char 2023-12-05T09:28:38.449 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/hangcheck-timer.ko 2023-12-05T09:28:38.449 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/hw_random 2023-12-05T09:28:38.449 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/hw_random/amd-rng.ko 2023-12-05T09:28:38.449 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/hw_random/intel-rng.ko 2023-12-05T09:28:38.449 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-12-05T09:28:38.449 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/hw_random/via-rng.ko 2023-12-05T09:28:38.449 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/hw_random/virtio-rng.ko 2023-12-05T09:28:38.449 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/ipmi 2023-12-05T09:28:38.449 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-12-05T09:28:38.449 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-12-05T09:28:38.449 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-12-05T09:28:38.449 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/ipmi/ipmi_si.ko 2023-12-05T09:28:38.450 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-12-05T09:28:38.450 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-12-05T09:28:38.450 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/lp.ko 2023-12-05T09:28:38.450 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/mwave 2023-12-05T09:28:38.450 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/mwave/mwave.ko 2023-12-05T09:28:38.450 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/ppdev.ko 2023-12-05T09:28:38.450 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/tlclk.ko 2023-12-05T09:28:38.450 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/tpm 2023-12-05T09:28:38.450 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/tpm/tpm.ko 2023-12-05T09:28:38.450 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/tpm/tpm_atmel.ko 2023-12-05T09:28:38.450 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/tpm/tpm_infineon.ko 2023-12-05T09:28:38.450 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/tpm/tpm_nsc.ko 2023-12-05T09:28:38.450 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/tpm/tpm_tis.ko 2023-12-05T09:28:38.450 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-12-05T09:28:38.451 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/uv_mmtimer.ko 2023-12-05T09:28:38.451 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/virtio_console.ko 2023-12-05T09:28:38.451 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/cpufreq 2023-12-05T09:28:38.451 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-12-05T09:28:38.451 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-12-05T09:28:38.451 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/cpufreq/p4-clockmod.ko 2023-12-05T09:28:38.451 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-12-05T09:28:38.451 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/cpufreq/powernow-k8.ko 2023-12-05T09:28:38.451 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/cpufreq/speedstep-lib.ko 2023-12-05T09:28:38.451 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto 2023-12-05T09:28:38.451 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/ccp 2023-12-05T09:28:38.451 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-12-05T09:28:38.451 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/ccp/ccp.ko 2023-12-05T09:28:38.451 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/intel 2023-12-05T09:28:38.451 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/intel/qat 2023-12-05T09:28:38.452 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/intel/qat/qat_common 2023-12-05T09:28:38.452 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-12-05T09:28:38.452 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-12-05T09:28:38.452 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-12-05T09:28:38.452 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/padlock-aes.ko 2023-12-05T09:28:38.452 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/padlock-sha.ko 2023-12-05T09:28:38.452 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/virtio 2023-12-05T09:28:38.452 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-12-05T09:28:38.452 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/dca 2023-12-05T09:28:38.452 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/dca/dca.ko 2023-12-05T09:28:38.452 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/devfreq 2023-12-05T09:28:38.452 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-12-05T09:28:38.452 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/dma 2023-12-05T09:28:38.452 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/dma/dw 2023-12-05T09:28:38.452 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/dma/dw/dw_dmac.ko 2023-12-05T09:28:38.453 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/dma/ioat 2023-12-05T09:28:38.453 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/dma/ioat/ioatdma.ko 2023-12-05T09:28:38.453 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac 2023-12-05T09:28:38.453 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/amd64_edac.ko 2023-12-05T09:28:38.453 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/e752x_edac.ko 2023-12-05T09:28:38.453 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/edac_mce_amd.ko 2023-12-05T09:28:38.453 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/i3000_edac.ko 2023-12-05T09:28:38.453 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/i3200_edac.ko 2023-12-05T09:28:38.453 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/i5100_edac.ko 2023-12-05T09:28:38.453 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/i5400_edac.ko 2023-12-05T09:28:38.453 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/i7300_edac.ko 2023-12-05T09:28:38.453 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/i7core_edac.ko 2023-12-05T09:28:38.453 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/i82975x_edac.ko 2023-12-05T09:28:38.453 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/ie31200_edac.ko 2023-12-05T09:28:38.453 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/sb_edac.ko 2023-12-05T09:28:38.454 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/x38_edac.ko 2023-12-05T09:28:38.454 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/firmware 2023-12-05T09:28:38.454 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/firmware/edd.ko 2023-12-05T09:28:38.454 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/firmware/iscsi_ibft.ko 2023-12-05T09:28:38.454 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/gpio 2023-12-05T09:28:38.454 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/gpio/gpio-ich.ko 2023-12-05T09:28:38.454 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/gpio/gpio-viperboard.ko 2023-12-05T09:28:38.454 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid 2023-12-05T09:28:38.454 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-appleir.ko 2023-12-05T09:28:38.454 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-aureal.ko 2023-12-05T09:28:38.454 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-axff.ko 2023-12-05T09:28:38.454 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-dr.ko 2023-12-05T09:28:38.454 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-elecom.ko 2023-12-05T09:28:38.454 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-elo.ko 2023-12-05T09:28:38.455 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-emsff.ko 2023-12-05T09:28:38.455 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-gaff.ko 2023-12-05T09:28:38.455 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-gt683r.ko 2023-12-05T09:28:38.455 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-gyration.ko 2023-12-05T09:28:38.455 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-holtek-kbd.ko 2023-12-05T09:28:38.455 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-holtek-mouse.ko 2023-12-05T09:28:38.455 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-holtekff.ko 2023-12-05T09:28:38.455 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-hyperv.ko 2023-12-05T09:28:38.455 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-icade.ko 2023-12-05T09:28:38.455 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-keytouch.ko 2023-12-05T09:28:38.455 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-kye.ko 2023-12-05T09:28:38.455 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-lcpower.ko 2023-12-05T09:28:38.455 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-led.ko 2023-12-05T09:28:38.455 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-lenovo.ko 2023-12-05T09:28:38.455 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-logitech-dj.ko 2023-12-05T09:28:38.455 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-12-05T09:28:38.456 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-multitouch.ko 2023-12-05T09:28:38.456 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-ortek.ko 2023-12-05T09:28:38.456 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-penmount.ko 2023-12-05T09:28:38.456 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-petalynx.ko 2023-12-05T09:28:38.456 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-picolcd.ko 2023-12-05T09:28:38.456 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-pl.ko 2023-12-05T09:28:38.456 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-plantronics.ko 2023-12-05T09:28:38.456 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-primax.ko 2023-12-05T09:28:38.456 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-rmi.ko 2023-12-05T09:28:38.456 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-roccat-arvo.ko 2023-12-05T09:28:38.456 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-roccat-common.ko 2023-12-05T09:28:38.456 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-roccat-isku.ko 2023-12-05T09:28:38.456 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-roccat-kone.ko 2023-12-05T09:28:38.456 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-12-05T09:28:38.456 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-roccat-konepure.ko 2023-12-05T09:28:38.456 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-12-05T09:28:38.457 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-roccat-lua.ko 2023-12-05T09:28:38.457 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-roccat-pyra.ko 2023-12-05T09:28:38.457 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-roccat-ryos.ko 2023-12-05T09:28:38.457 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-roccat-savu.ko 2023-12-05T09:28:38.457 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-roccat.ko 2023-12-05T09:28:38.457 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-saitek.ko 2023-12-05T09:28:38.457 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-samsung.ko 2023-12-05T09:28:38.457 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-sensor-hub.ko 2023-12-05T09:28:38.457 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-sjoy.ko 2023-12-05T09:28:38.457 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-sony.ko 2023-12-05T09:28:38.457 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-speedlink.ko 2023-12-05T09:28:38.457 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-steelseries.ko 2023-12-05T09:28:38.457 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-sunplus.ko 2023-12-05T09:28:38.457 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-thrustmaster.ko 2023-12-05T09:28:38.458 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-tivo.ko 2023-12-05T09:28:38.458 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-tmff.ko 2023-12-05T09:28:38.458 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-topseed.ko 2023-12-05T09:28:38.458 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-twinhan.ko 2023-12-05T09:28:38.458 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-uclogic.ko 2023-12-05T09:28:38.458 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-waltop.ko 2023-12-05T09:28:38.458 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-wiimote.ko 2023-12-05T09:28:38.458 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-xinmo.ko 2023-12-05T09:28:38.458 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-zpff.ko 2023-12-05T09:28:38.458 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-zydacron.ko 2023-12-05T09:28:38.458 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/uhid.ko 2023-12-05T09:28:38.458 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/wacom.ko 2023-12-05T09:28:38.458 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hv 2023-12-05T09:28:38.458 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hv/hv_balloon.ko 2023-12-05T09:28:38.458 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hv/hv_utils.ko 2023-12-05T09:28:38.459 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hv/hv_vmbus.ko 2023-12-05T09:28:38.459 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon 2023-12-05T09:28:38.459 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/abituguru.ko 2023-12-05T09:28:38.459 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/abituguru3.ko 2023-12-05T09:28:38.459 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/acpi_power_meter.ko 2023-12-05T09:28:38.459 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ad7414.ko 2023-12-05T09:28:38.459 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ad7418.ko 2023-12-05T09:28:38.459 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/adc128d818.ko 2023-12-05T09:28:38.459 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/adm1025.ko 2023-12-05T09:28:38.459 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/adm1026.ko 2023-12-05T09:28:38.459 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/adm1029.ko 2023-12-05T09:28:38.459 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/adm1031.ko 2023-12-05T09:28:38.459 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/adm9240.ko 2023-12-05T09:28:38.459 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ads7828.ko 2023-12-05T09:28:38.460 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/adt7410.ko 2023-12-05T09:28:38.460 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/adt7411.ko 2023-12-05T09:28:38.460 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/adt7462.ko 2023-12-05T09:28:38.460 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/adt7470.ko 2023-12-05T09:28:38.460 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/adt7475.ko 2023-12-05T09:28:38.460 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/adt7x10.ko 2023-12-05T09:28:38.460 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/amc6821.ko 2023-12-05T09:28:38.460 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/applesmc.ko 2023-12-05T09:28:38.460 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/asb100.ko 2023-12-05T09:28:38.460 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/asc7621.ko 2023-12-05T09:28:38.460 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/asus_atk0110.ko 2023-12-05T09:28:38.460 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/atxp1.ko 2023-12-05T09:28:38.460 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/coretemp.ko 2023-12-05T09:28:38.460 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-12-05T09:28:38.460 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/dme1737.ko 2023-12-05T09:28:38.461 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ds1621.ko 2023-12-05T09:28:38.461 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ds620.ko 2023-12-05T09:28:38.461 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/emc1403.ko 2023-12-05T09:28:38.461 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/emc6w201.ko 2023-12-05T09:28:38.461 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/f71805f.ko 2023-12-05T09:28:38.461 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/f71882fg.ko 2023-12-05T09:28:38.461 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/f75375s.ko 2023-12-05T09:28:38.461 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/fam15h_power.ko 2023-12-05T09:28:38.461 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/fschmd.ko 2023-12-05T09:28:38.461 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/g760a.ko 2023-12-05T09:28:38.461 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/g762.ko 2023-12-05T09:28:38.461 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/gl518sm.ko 2023-12-05T09:28:38.461 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/gl520sm.ko 2023-12-05T09:28:38.461 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/hwmon-vid.ko 2023-12-05T09:28:38.461 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/i5500_temp.ko 2023-12-05T09:28:38.461 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/i5k_amb.ko 2023-12-05T09:28:38.462 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ibmaem.ko 2023-12-05T09:28:38.462 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ibmpex.ko 2023-12-05T09:28:38.462 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ina209.ko 2023-12-05T09:28:38.462 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ina2xx.ko 2023-12-05T09:28:38.462 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/it87.ko 2023-12-05T09:28:38.462 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/k10temp.ko 2023-12-05T09:28:38.462 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/k8temp.ko 2023-12-05T09:28:38.462 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lineage-pem.ko 2023-12-05T09:28:38.462 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm63.ko 2023-12-05T09:28:38.462 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm73.ko 2023-12-05T09:28:38.462 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm75.ko 2023-12-05T09:28:38.462 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm77.ko 2023-12-05T09:28:38.462 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm78.ko 2023-12-05T09:28:38.463 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm80.ko 2023-12-05T09:28:38.463 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm83.ko 2023-12-05T09:28:38.463 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm85.ko 2023-12-05T09:28:38.463 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm87.ko 2023-12-05T09:28:38.463 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm90.ko 2023-12-05T09:28:38.463 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm92.ko 2023-12-05T09:28:38.463 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm93.ko 2023-12-05T09:28:38.463 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm95234.ko 2023-12-05T09:28:38.463 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm95241.ko 2023-12-05T09:28:38.463 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm95245.ko 2023-12-05T09:28:38.463 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ltc2945.ko 2023-12-05T09:28:38.463 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ltc4151.ko 2023-12-05T09:28:38.463 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ltc4215.ko 2023-12-05T09:28:38.463 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ltc4222.ko 2023-12-05T09:28:38.464 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ltc4245.ko 2023-12-05T09:28:38.464 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ltc4260.ko 2023-12-05T09:28:38.464 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ltc4261.ko 2023-12-05T09:28:38.464 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/max16065.ko 2023-12-05T09:28:38.464 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/max1619.ko 2023-12-05T09:28:38.464 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/max1668.ko 2023-12-05T09:28:38.464 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/max197.ko 2023-12-05T09:28:38.464 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/max6639.ko 2023-12-05T09:28:38.464 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/max6650.ko 2023-12-05T09:28:38.464 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/max6697.ko 2023-12-05T09:28:38.464 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/mcp3021.ko 2023-12-05T09:28:38.464 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/nct6683.ko 2023-12-05T09:28:38.464 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/nct6775-core.ko 2023-12-05T09:28:38.464 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/nct6775.ko 2023-12-05T09:28:38.464 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/nct7802.ko 2023-12-05T09:28:38.464 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pc87360.ko 2023-12-05T09:28:38.465 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pc87427.ko 2023-12-05T09:28:38.465 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pcf8591.ko 2023-12-05T09:28:38.465 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus 2023-12-05T09:28:38.465 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-12-05T09:28:38.465 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-12-05T09:28:38.465 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-12-05T09:28:38.465 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus/max16064.ko 2023-12-05T09:28:38.465 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus/max34440.ko 2023-12-05T09:28:38.465 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus/max8688.ko 2023-12-05T09:28:38.465 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-12-05T09:28:38.465 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-12-05T09:28:38.465 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-12-05T09:28:38.465 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-12-05T09:28:38.465 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-12-05T09:28:38.465 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-12-05T09:28:38.466 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/powr1220.ko 2023-12-05T09:28:38.466 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/sch5627.ko 2023-12-05T09:28:38.466 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/sch5636.ko 2023-12-05T09:28:38.466 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/sch56xx-common.ko 2023-12-05T09:28:38.466 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/sht15.ko 2023-12-05T09:28:38.466 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/sht21.ko 2023-12-05T09:28:38.466 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/shtc1.ko 2023-12-05T09:28:38.466 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/sis5595.ko 2023-12-05T09:28:38.466 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/smsc47b397.ko 2023-12-05T09:28:38.466 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/smsc47m1.ko 2023-12-05T09:28:38.466 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/smsc47m192.ko 2023-12-05T09:28:38.466 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/thmc50.ko 2023-12-05T09:28:38.466 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/tmp102.ko 2023-12-05T09:28:38.466 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/tmp103.ko 2023-12-05T09:28:38.466 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/tmp401.ko 2023-12-05T09:28:38.466 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/tmp421.ko 2023-12-05T09:28:38.467 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/via-cputemp.ko 2023-12-05T09:28:38.467 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/via686a.ko 2023-12-05T09:28:38.467 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/vt1211.ko 2023-12-05T09:28:38.467 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/vt8231.ko 2023-12-05T09:28:38.467 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/w83627ehf.ko 2023-12-05T09:28:38.467 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/w83627hf.ko 2023-12-05T09:28:38.467 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/w83781d.ko 2023-12-05T09:28:38.467 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/w83791d.ko 2023-12-05T09:28:38.467 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/w83792d.ko 2023-12-05T09:28:38.467 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/w83793.ko 2023-12-05T09:28:38.467 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/w83795.ko 2023-12-05T09:28:38.467 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/w83l785ts.ko 2023-12-05T09:28:38.467 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/w83l786ng.ko 2023-12-05T09:28:38.467 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c 2023-12-05T09:28:38.468 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/algos 2023-12-05T09:28:38.468 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-12-05T09:28:38.468 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-12-05T09:28:38.468 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses 2023-12-05T09:28:38.468 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-12-05T09:28:38.468 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-12-05T09:28:38.468 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-12-05T09:28:38.468 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-12-05T09:28:38.468 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-12-05T09:28:38.468 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-12-05T09:28:38.468 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-12-05T09:28:38.468 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-12-05T09:28:38.468 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-i801.ko 2023-12-05T09:28:38.468 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-isch.ko 2023-12-05T09:28:38.468 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-12-05T09:28:38.469 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-12-05T09:28:38.469 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-12-05T09:28:38.469 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-parport.ko 2023-12-05T09:28:38.469 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-12-05T09:28:38.469 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-12-05T09:28:38.469 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-12-05T09:28:38.469 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-12-05T09:28:38.469 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-12-05T09:28:38.469 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-12-05T09:28:38.469 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-via.ko 2023-12-05T09:28:38.469 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-12-05T09:28:38.469 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-12-05T09:28:38.469 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/i2c-dev.ko 2023-12-05T09:28:38.469 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/i2c-mux.ko 2023-12-05T09:28:38.469 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-12-05T09:28:38.469 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/i2c-smbus.ko 2023-12-05T09:28:38.470 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/i2c-stub.ko 2023-12-05T09:28:38.470 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband 2023-12-05T09:28:38.470 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/core 2023-12-05T09:28:38.470 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/core/ib_cm.ko 2023-12-05T09:28:38.470 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/core/ib_core.ko 2023-12-05T09:28:38.470 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/core/ib_umad.ko 2023-12-05T09:28:38.470 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-12-05T09:28:38.470 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/core/iw_cm.ko 2023-12-05T09:28:38.470 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/core/rdma_cm.ko 2023-12-05T09:28:38.470 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-12-05T09:28:38.470 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/hw 2023-12-05T09:28:38.470 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/hw/cxgb4 2023-12-05T09:28:38.470 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-12-05T09:28:38.470 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/hw/mlx4 2023-12-05T09:28:38.471 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-12-05T09:28:38.471 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/hw/mlx5 2023-12-05T09:28:38.471 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-12-05T09:28:38.471 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/hw/mthca 2023-12-05T09:28:38.471 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-12-05T09:28:38.471 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/ulp 2023-12-05T09:28:38.471 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/ulp/ipoib 2023-12-05T09:28:38.471 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-12-05T09:28:38.471 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/ulp/iser 2023-12-05T09:28:38.471 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-12-05T09:28:38.471 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/ulp/isert 2023-12-05T09:28:38.471 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-12-05T09:28:38.471 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/ulp/srp 2023-12-05T09:28:38.471 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-12-05T09:28:38.471 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/ulp/srpt 2023-12-05T09:28:38.472 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-12-05T09:28:38.472 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input 2023-12-05T09:28:38.472 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/gameport 2023-12-05T09:28:38.472 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-12-05T09:28:38.472 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/gameport/fm801-gp.ko 2023-12-05T09:28:38.472 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/gameport/gameport.ko 2023-12-05T09:28:38.472 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/joydev.ko 2023-12-05T09:28:38.472 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/keyboard 2023-12-05T09:28:38.472 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/keyboard/gpio_keys.ko 2023-12-05T09:28:38.472 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/mouse 2023-12-05T09:28:38.472 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/mouse/appletouch.ko 2023-12-05T09:28:38.472 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/mouse/bcm5974.ko 2023-12-05T09:28:38.472 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/mouse/cyapatp.ko 2023-12-05T09:28:38.472 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/mouse/elan_i2c.ko 2023-12-05T09:28:38.472 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/mouse/sermouse.ko 2023-12-05T09:28:38.473 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-12-05T09:28:38.473 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/mouse/synaptics_usb.ko 2023-12-05T09:28:38.473 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/mouse/vsxxxaa.ko 2023-12-05T09:28:38.473 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/rmi4 2023-12-05T09:28:38.473 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/rmi4/rmi_core.ko 2023-12-05T09:28:38.473 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/serio 2023-12-05T09:28:38.473 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/serio/altera_ps2.ko 2023-12-05T09:28:38.473 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/serio/arc_ps2.ko 2023-12-05T09:28:38.473 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-12-05T09:28:38.473 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/serio/serio_raw.ko 2023-12-05T09:28:38.473 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/sparse-keymap.ko 2023-12-05T09:28:38.473 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/iommu 2023-12-05T09:28:38.473 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/iommu/amd 2023-12-05T09:28:38.473 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/iommu/amd/iommu_v2.ko 2023-12-05T09:28:38.473 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds 2023-12-05T09:28:38.473 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/leds-blinkm.ko 2023-12-05T09:28:38.474 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/leds-lm3530.ko 2023-12-05T09:28:38.474 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/leds-lp3944.ko 2023-12-05T09:28:38.474 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/leds-ss4200.ko 2023-12-05T09:28:38.474 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/trigger 2023-12-05T09:28:38.474 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-12-05T09:28:38.474 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-12-05T09:28:38.474 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-12-05T09:28:38.474 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-12-05T09:28:38.474 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-12-05T09:28:38.474 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-12-05T09:28:38.474 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-12-05T09:28:38.474 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-12-05T09:28:38.474 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md 2023-12-05T09:28:38.474 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/bcache 2023-12-05T09:28:38.474 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/bcache/bcache.ko 2023-12-05T09:28:38.475 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-bio-prison.ko 2023-12-05T09:28:38.475 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-cache-smq.ko 2023-12-05T09:28:38.475 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-cache.ko 2023-12-05T09:28:38.475 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-crypt.ko 2023-12-05T09:28:38.475 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-delay.ko 2023-12-05T09:28:38.475 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-flakey.ko 2023-12-05T09:28:38.475 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-log-userspace.ko 2023-12-05T09:28:38.475 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-multipath.ko 2023-12-05T09:28:38.475 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-queue-length.ko 2023-12-05T09:28:38.475 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-raid.ko 2023-12-05T09:28:38.475 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-round-robin.ko 2023-12-05T09:28:38.475 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-service-time.ko 2023-12-05T09:28:38.475 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-switch.ko 2023-12-05T09:28:38.475 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-thin-pool.ko 2023-12-05T09:28:38.475 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-verity.ko 2023-12-05T09:28:38.476 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/faulty.ko 2023-12-05T09:28:38.476 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/linear.ko 2023-12-05T09:28:38.476 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/multipath.ko 2023-12-05T09:28:38.476 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/persistent-data 2023-12-05T09:28:38.476 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-12-05T09:28:38.476 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/raid0.ko 2023-12-05T09:28:38.476 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/raid1.ko 2023-12-05T09:28:38.476 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/raid10.ko 2023-12-05T09:28:38.476 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/raid456.ko 2023-12-05T09:28:38.476 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/message 2023-12-05T09:28:38.476 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/message/fusion 2023-12-05T09:28:38.476 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/message/fusion/mptbase.ko 2023-12-05T09:28:38.476 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/message/fusion/mptctl.ko 2023-12-05T09:28:38.476 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/message/fusion/mptfc.ko 2023-12-05T09:28:38.476 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/message/fusion/mptlan.ko 2023-12-05T09:28:38.476 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/message/fusion/mptsas.ko 2023-12-05T09:28:38.477 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/message/fusion/mptscsih.ko 2023-12-05T09:28:38.477 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/message/fusion/mptspi.ko 2023-12-05T09:28:38.477 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd 2023-12-05T09:28:38.477 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/lpc_ich.ko 2023-12-05T09:28:38.477 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/lpc_sch.ko 2023-12-05T09:28:38.477 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/mfd-core.ko 2023-12-05T09:28:38.477 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/sm501.ko 2023-12-05T09:28:38.477 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/viperboard.ko 2023-12-05T09:28:38.477 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/vx855.ko 2023-12-05T09:28:38.477 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/wl1273-core.ko 2023-12-05T09:28:38.477 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc 2023-12-05T09:28:38.477 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/altera-stapl 2023-12-05T09:28:38.477 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-12-05T09:28:38.477 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/apds9802als.ko 2023-12-05T09:28:38.477 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/apds990x.ko 2023-12-05T09:28:38.477 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/bh1770glc.ko 2023-12-05T09:28:38.478 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/cb710 2023-12-05T09:28:38.478 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/cb710/cb710.ko 2023-12-05T09:28:38.478 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/eeprom 2023-12-05T09:28:38.478 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/eeprom/at24.ko 2023-12-05T09:28:38.478 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/eeprom/eeprom.ko 2023-12-05T09:28:38.478 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-12-05T09:28:38.478 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/eeprom/max6875.ko 2023-12-05T09:28:38.478 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/enclosure.ko 2023-12-05T09:28:38.478 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/hpilo.ko 2023-12-05T09:28:38.478 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/isl29003.ko 2023-12-05T09:28:38.478 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/isl29020.ko 2023-12-05T09:28:38.478 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/lis3lv02d 2023-12-05T09:28:38.478 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-12-05T09:28:38.478 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-12-05T09:28:38.479 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/mei 2023-12-05T09:28:38.479 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/mei/mei-me.ko 2023-12-05T09:28:38.479 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/mei/mei-txe.ko 2023-12-05T09:28:38.479 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/mei/mei.ko 2023-12-05T09:28:38.479 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/sgi-gru 2023-12-05T09:28:38.479 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/sgi-gru/gru.ko 2023-12-05T09:28:38.479 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/sgi-xp 2023-12-05T09:28:38.479 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/sgi-xp/xp.ko 2023-12-05T09:28:38.479 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/sgi-xp/xpc.ko 2023-12-05T09:28:38.479 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-12-05T09:28:38.479 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/tifm_7xx1.ko 2023-12-05T09:28:38.479 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/tifm_core.ko 2023-12-05T09:28:38.479 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/tsl2550.ko 2023-12-05T09:28:38.479 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/vmw_balloon.ko 2023-12-05T09:28:38.479 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/vmw_vmci 2023-12-05T09:28:38.480 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-12-05T09:28:38.480 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net 2023-12-05T09:28:38.480 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/bonding 2023-12-05T09:28:38.480 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/bonding/bonding.ko 2023-12-05T09:28:38.480 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/dsa 2023-12-05T09:28:38.480 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/dsa/b53 2023-12-05T09:28:38.480 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/dsa/b53/b53_common.ko 2023-12-05T09:28:38.480 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/dsa/bcm-sf2.ko 2023-12-05T09:28:38.480 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/dsa/mv88e6060.ko 2023-12-05T09:28:38.480 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/dsa/mv88e6xxx 2023-12-05T09:28:38.480 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-12-05T09:28:38.480 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/dummy.ko 2023-12-05T09:28:38.480 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/eql.ko 2023-12-05T09:28:38.480 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet 2023-12-05T09:28:38.480 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/3com 2023-12-05T09:28:38.480 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-12-05T09:28:38.481 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-12-05T09:28:38.481 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-12-05T09:28:38.481 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-12-05T09:28:38.481 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/8390 2023-12-05T09:28:38.481 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/8390/8390.ko 2023-12-05T09:28:38.481 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-12-05T09:28:38.481 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-12-05T09:28:38.481 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-12-05T09:28:38.481 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/adaptec 2023-12-05T09:28:38.481 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-12-05T09:28:38.481 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/agere 2023-12-05T09:28:38.481 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/agere/et131x.ko 2023-12-05T09:28:38.481 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/alteon 2023-12-05T09:28:38.481 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-12-05T09:28:38.481 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/altera 2023-12-05T09:28:38.482 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-12-05T09:28:38.482 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/amd 2023-12-05T09:28:38.482 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-12-05T09:28:38.482 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-12-05T09:28:38.482 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-12-05T09:28:38.482 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/atheros 2023-12-05T09:28:38.482 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/atheros/alx 2023-12-05T09:28:38.482 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-12-05T09:28:38.482 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/atheros/atl1c 2023-12-05T09:28:38.482 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-12-05T09:28:38.482 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/atheros/atl1e 2023-12-05T09:28:38.482 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-12-05T09:28:38.482 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/atheros/atlx 2023-12-05T09:28:38.482 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-12-05T09:28:38.482 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-12-05T09:28:38.483 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/broadcom 2023-12-05T09:28:38.483 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-12-05T09:28:38.483 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-12-05T09:28:38.483 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-12-05T09:28:38.483 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-12-05T09:28:38.483 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-12-05T09:28:38.483 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/broadcom/genet 2023-12-05T09:28:38.483 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-12-05T09:28:38.483 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-12-05T09:28:38.483 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/brocade 2023-12-05T09:28:38.483 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/brocade/bna 2023-12-05T09:28:38.483 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-12-05T09:28:38.483 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/chelsio 2023-12-05T09:28:38.483 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/chelsio/cxgb 2023-12-05T09:28:38.483 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-12-05T09:28:38.484 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-12-05T09:28:38.484 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-12-05T09:28:38.484 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-12-05T09:28:38.484 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-12-05T09:28:38.484 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-12-05T09:28:38.484 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-12-05T09:28:38.484 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-12-05T09:28:38.484 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-12-05T09:28:38.484 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/cisco 2023-12-05T09:28:38.484 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/cisco/enic 2023-12-05T09:28:38.484 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-12-05T09:28:38.484 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/dec 2023-12-05T09:28:38.484 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/dec/tulip 2023-12-05T09:28:38.484 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-12-05T09:28:38.484 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-12-05T09:28:38.484 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-12-05T09:28:38.485 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-12-05T09:28:38.485 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-12-05T09:28:38.485 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-12-05T09:28:38.485 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/dlink 2023-12-05T09:28:38.485 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-12-05T09:28:38.485 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-12-05T09:28:38.485 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/dnet.ko 2023-12-05T09:28:38.485 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/emulex 2023-12-05T09:28:38.485 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/emulex/benet 2023-12-05T09:28:38.485 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-12-05T09:28:38.485 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/ethoc.ko 2023-12-05T09:28:38.485 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/fealnx.ko 2023-12-05T09:28:38.485 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel 2023-12-05T09:28:38.485 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/e100.ko 2023-12-05T09:28:38.485 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/e1000 2023-12-05T09:28:38.486 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-12-05T09:28:38.486 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/e1000e 2023-12-05T09:28:38.486 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-12-05T09:28:38.486 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/fm10k 2023-12-05T09:28:38.486 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-12-05T09:28:38.486 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/i40e 2023-12-05T09:28:38.486 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-12-05T09:28:38.486 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/iavf 2023-12-05T09:28:38.486 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-12-05T09:28:38.486 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/igb 2023-12-05T09:28:38.486 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-12-05T09:28:38.486 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/igbvf 2023-12-05T09:28:38.486 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-12-05T09:28:38.486 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/ixgbe 2023-12-05T09:28:38.487 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-12-05T09:28:38.487 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/ixgbevf 2023-12-05T09:28:38.487 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-12-05T09:28:38.487 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/jme.ko 2023-12-05T09:28:38.487 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/marvell 2023-12-05T09:28:38.487 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-12-05T09:28:38.487 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/marvell/skge.ko 2023-12-05T09:28:38.487 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-12-05T09:28:38.487 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/mellanox 2023-12-05T09:28:38.487 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/mellanox/mlx4 2023-12-05T09:28:38.487 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-12-05T09:28:38.487 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-12-05T09:28:38.487 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/mellanox/mlx5 2023-12-05T09:28:38.487 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-12-05T09:28:38.487 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-12-05T09:28:38.487 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/micrel 2023-12-05T09:28:38.488 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-12-05T09:28:38.488 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/myricom 2023-12-05T09:28:38.488 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/myricom/myri10ge 2023-12-05T09:28:38.488 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-12-05T09:28:38.488 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/natsemi 2023-12-05T09:28:38.488 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-12-05T09:28:38.488 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-12-05T09:28:38.488 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/neterion 2023-12-05T09:28:38.488 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-12-05T09:28:38.488 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/nvidia 2023-12-05T09:28:38.488 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-12-05T09:28:38.488 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/packetengines 2023-12-05T09:28:38.488 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-12-05T09:28:38.488 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-12-05T09:28:38.488 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/qlogic 2023-12-05T09:28:38.489 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/qlogic/netxen 2023-12-05T09:28:38.489 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-12-05T09:28:38.489 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-12-05T09:28:38.489 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-12-05T09:28:38.489 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-12-05T09:28:38.489 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/rdc 2023-12-05T09:28:38.489 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-12-05T09:28:38.489 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/realtek 2023-12-05T09:28:38.489 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-12-05T09:28:38.489 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-12-05T09:28:38.489 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/realtek/atp.ko 2023-12-05T09:28:38.489 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-12-05T09:28:38.489 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/rocker 2023-12-05T09:28:38.489 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-12-05T09:28:38.489 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/sfc 2023-12-05T09:28:38.490 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-12-05T09:28:38.490 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/silan 2023-12-05T09:28:38.490 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-12-05T09:28:38.490 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/sis 2023-12-05T09:28:38.490 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/sis/sis190.ko 2023-12-05T09:28:38.490 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/sis/sis900.ko 2023-12-05T09:28:38.490 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/smsc 2023-12-05T09:28:38.490 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-12-05T09:28:38.490 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-12-05T09:28:38.490 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-12-05T09:28:38.490 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-12-05T09:28:38.490 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/stmicro 2023-12-05T09:28:38.490 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/stmicro/stmmac 2023-12-05T09:28:38.490 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-12-05T09:28:38.490 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-12-05T09:28:38.490 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/sun 2023-12-05T09:28:38.491 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/sun/cassini.ko 2023-12-05T09:28:38.491 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/sun/niu.ko 2023-12-05T09:28:38.491 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/sun/sungem.ko 2023-12-05T09:28:38.491 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-12-05T09:28:38.491 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/tehuti 2023-12-05T09:28:38.491 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-12-05T09:28:38.491 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/ti 2023-12-05T09:28:38.491 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/ti/tlan.ko 2023-12-05T09:28:38.491 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/via 2023-12-05T09:28:38.491 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-12-05T09:28:38.491 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-12-05T09:28:38.491 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/wiznet 2023-12-05T09:28:38.491 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-12-05T09:28:38.491 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-12-05T09:28:38.491 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/xircom 2023-12-05T09:28:38.492 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-12-05T09:28:38.492 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/geneve.ko 2023-12-05T09:28:38.492 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/hyperv 2023-12-05T09:28:38.492 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-12-05T09:28:38.492 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ieee802154 2023-12-05T09:28:38.492 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ieee802154/fakelb.ko 2023-12-05T09:28:38.492 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ifb.ko 2023-12-05T09:28:38.492 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ipvlan 2023-12-05T09:28:38.492 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ipvlan/ipvlan.ko 2023-12-05T09:28:38.492 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/macvlan.ko 2023-12-05T09:28:38.492 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/macvtap.ko 2023-12-05T09:28:38.492 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/mdio 2023-12-05T09:28:38.492 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/mdio.ko 2023-12-05T09:28:38.492 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-12-05T09:28:38.492 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-12-05T09:28:38.493 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/mdio/mdio-regmap.ko 2023-12-05T09:28:38.493 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/mii.ko 2023-12-05T09:28:38.493 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/net_failover.ko 2023-12-05T09:28:38.493 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/netconsole.ko 2023-12-05T09:28:38.493 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/nlmon.ko 2023-12-05T09:28:38.493 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/pcs 2023-12-05T09:28:38.493 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/pcs/pcs-lynx.ko 2023-12-05T09:28:38.493 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-12-05T09:28:38.493 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy 2023-12-05T09:28:38.493 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/amd.ko 2023-12-05T09:28:38.493 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-12-05T09:28:38.493 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-12-05T09:28:38.493 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/bcm7xxx.ko 2023-12-05T09:28:38.493 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/bcm87xx.ko 2023-12-05T09:28:38.493 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/broadcom.ko 2023-12-05T09:28:38.494 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/cicada.ko 2023-12-05T09:28:38.494 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/davicom.ko 2023-12-05T09:28:38.494 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/dp83640.ko 2023-12-05T09:28:38.494 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/et1011c.ko 2023-12-05T09:28:38.494 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/icplus.ko 2023-12-05T09:28:38.494 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/lxt.ko 2023-12-05T09:28:38.494 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/marvell.ko 2023-12-05T09:28:38.494 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/micrel.ko 2023-12-05T09:28:38.494 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/national.ko 2023-12-05T09:28:38.494 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/phylink.ko 2023-12-05T09:28:38.494 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/qsemi.ko 2023-12-05T09:28:38.494 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/realtek.ko 2023-12-05T09:28:38.494 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/smsc.ko 2023-12-05T09:28:38.494 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/ste10Xp.ko 2023-12-05T09:28:38.494 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/vitesse.ko 2023-12-05T09:28:38.495 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ppp 2023-12-05T09:28:38.495 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ppp/bsd_comp.ko 2023-12-05T09:28:38.495 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ppp/ppp_async.ko 2023-12-05T09:28:38.495 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ppp/ppp_deflate.ko 2023-12-05T09:28:38.495 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ppp/ppp_generic.ko 2023-12-05T09:28:38.495 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ppp/ppp_mppe.ko 2023-12-05T09:28:38.495 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ppp/ppp_synctty.ko 2023-12-05T09:28:38.495 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ppp/pppoe.ko 2023-12-05T09:28:38.495 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ppp/pppox.ko 2023-12-05T09:28:38.495 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ppp/pptp.ko 2023-12-05T09:28:38.495 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/slip 2023-12-05T09:28:38.495 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/slip/slhc.ko 2023-12-05T09:28:38.495 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/slip/slip.ko 2023-12-05T09:28:38.495 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/sungem_phy.ko 2023-12-05T09:28:38.495 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/tap.ko 2023-12-05T09:28:38.495 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/team 2023-12-05T09:28:38.496 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/team/team.ko 2023-12-05T09:28:38.496 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/team/team_mode_activebackup.ko 2023-12-05T09:28:38.496 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/team/team_mode_broadcast.ko 2023-12-05T09:28:38.496 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-12-05T09:28:38.496 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/team/team_mode_random.ko 2023-12-05T09:28:38.496 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-12-05T09:28:38.496 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/tun.ko 2023-12-05T09:28:38.496 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/veth.ko 2023-12-05T09:28:38.496 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/virtio_net.ko 2023-12-05T09:28:38.496 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/vmxnet3 2023-12-05T09:28:38.496 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-12-05T09:28:38.496 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/vxlan 2023-12-05T09:28:38.496 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/vxlan/vxlan.ko 2023-12-05T09:28:38.496 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/xen-netback 2023-12-05T09:28:38.496 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/xen-netback/xen-netback.ko 2023-12-05T09:28:38.497 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/xen-netfront.ko 2023-12-05T09:28:38.497 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ntb 2023-12-05T09:28:38.497 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ntb/ntb.ko 2023-12-05T09:28:38.497 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/nvme 2023-12-05T09:28:38.497 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/nvme/host 2023-12-05T09:28:38.497 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/nvme/host/nvme-core.ko 2023-12-05T09:28:38.497 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/nvme/host/nvme.ko 2023-12-05T09:28:38.497 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/parport 2023-12-05T09:28:38.497 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/parport/parport.ko 2023-12-05T09:28:38.497 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/parport/parport_cs.ko 2023-12-05T09:28:38.497 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/parport/parport_pc.ko 2023-12-05T09:28:38.497 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/parport/parport_serial.ko 2023-12-05T09:28:38.497 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pci 2023-12-05T09:28:38.497 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pci/hotplug 2023-12-05T09:28:38.498 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-12-05T09:28:38.498 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pci/pcie 2023-12-05T09:28:38.498 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pci/pcie/aer_inject.ko 2023-12-05T09:28:38.498 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pci/xen-pcifront.ko 2023-12-05T09:28:38.498 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pcmcia 2023-12-05T09:28:38.498 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pcmcia/i82092.ko 2023-12-05T09:28:38.498 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pcmcia/pd6729.ko 2023-12-05T09:28:38.498 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pcmcia/yenta_socket.ko 2023-12-05T09:28:38.498 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pinctrl 2023-12-05T09:28:38.498 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pinctrl/intel 2023-12-05T09:28:38.498 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-12-05T09:28:38.498 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform 2023-12-05T09:28:38.498 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86 2023-12-05T09:28:38.498 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/acer-wmi.ko 2023-12-05T09:28:38.498 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/acerhdf.ko 2023-12-05T09:28:38.499 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/apple-gmux.ko 2023-12-05T09:28:38.499 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/asus-laptop.ko 2023-12-05T09:28:38.499 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-12-05T09:28:38.499 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/asus-wmi.ko 2023-12-05T09:28:38.499 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/classmate-laptop.ko 2023-12-05T09:28:38.499 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-12-05T09:28:38.499 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-12-05T09:28:38.499 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-12-05T09:28:38.499 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-12-05T09:28:38.499 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/hdaps.ko 2023-12-05T09:28:38.499 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/intel 2023-12-05T09:28:38.499 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-12-05T09:28:38.499 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/intel_ips.ko 2023-12-05T09:28:38.499 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/msi-wmi.ko 2023-12-05T09:28:38.499 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/mxm-wmi.ko 2023-12-05T09:28:38.499 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-12-05T09:28:38.500 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/samsung-laptop.ko 2023-12-05T09:28:38.500 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/samsung-q10.ko 2023-12-05T09:28:38.500 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/topstar-laptop.ko 2023-12-05T09:28:38.500 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-12-05T09:28:38.500 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/toshiba_haps.ko 2023-12-05T09:28:38.500 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/wmi-bmof.ko 2023-12-05T09:28:38.500 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/wmi.ko 2023-12-05T09:28:38.500 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/powercap 2023-12-05T09:28:38.500 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/powercap/intel_rapl_common.ko 2023-12-05T09:28:38.500 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/powercap/intel_rapl_msr.ko 2023-12-05T09:28:38.500 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pps 2023-12-05T09:28:38.500 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pps/clients 2023-12-05T09:28:38.500 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pps/clients/pps-gpio.ko 2023-12-05T09:28:38.500 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pps/clients/pps-ldisc.ko 2023-12-05T09:28:38.501 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pps/clients/pps_parport.ko 2023-12-05T09:28:38.501 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pps/pps_core.ko 2023-12-05T09:28:38.501 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ptp 2023-12-05T09:28:38.501 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ptp/ptp.ko 2023-12-05T09:28:38.501 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ptp/ptp_kvm.ko 2023-12-05T09:28:38.501 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc 2023-12-05T09:28:38.501 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-bq32k.ko 2023-12-05T09:28:38.501 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-ds1286.ko 2023-12-05T09:28:38.501 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-ds1307.ko 2023-12-05T09:28:38.501 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-ds1374.ko 2023-12-05T09:28:38.501 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-ds1511.ko 2023-12-05T09:28:38.501 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-ds1553.ko 2023-12-05T09:28:38.501 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-ds1672.ko 2023-12-05T09:28:38.501 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-ds1742.ko 2023-12-05T09:28:38.501 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-ds2404.ko 2023-12-05T09:28:38.502 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-ds3232.ko 2023-12-05T09:28:38.502 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-em3027.ko 2023-12-05T09:28:38.502 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-fm3130.ko 2023-12-05T09:28:38.502 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-isl12022.ko 2023-12-05T09:28:38.502 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-isl1208.ko 2023-12-05T09:28:38.502 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-m41t80.ko 2023-12-05T09:28:38.502 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-m48t35.ko 2023-12-05T09:28:38.502 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-m48t59.ko 2023-12-05T09:28:38.502 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-max6900.ko 2023-12-05T09:28:38.502 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-msm6242.ko 2023-12-05T09:28:38.502 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-pcf2127.ko 2023-12-05T09:28:38.502 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-pcf85063.ko 2023-12-05T09:28:38.502 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-pcf8523.ko 2023-12-05T09:28:38.502 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-pcf8563.ko 2023-12-05T09:28:38.503 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-pcf8583.ko 2023-12-05T09:28:38.503 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-rp5c01.ko 2023-12-05T09:28:38.503 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-rs5c372.ko 2023-12-05T09:28:38.503 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-12-05T09:28:38.503 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-rx8025.ko 2023-12-05T09:28:38.503 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-rx8581.ko 2023-12-05T09:28:38.503 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-12-05T09:28:38.503 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-x1205.ko 2023-12-05T09:28:38.503 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi 2023-12-05T09:28:38.503 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/3w-9xxx.ko 2023-12-05T09:28:38.503 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/3w-sas.ko 2023-12-05T09:28:38.503 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/3w-xxxx.ko 2023-12-05T09:28:38.503 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/BusLogic.ko 2023-12-05T09:28:38.503 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/a100u2w.ko 2023-12-05T09:28:38.503 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/aacraid 2023-12-05T09:28:38.504 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/aacraid/aacraid.ko 2023-12-05T09:28:38.504 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/advansys.ko 2023-12-05T09:28:38.504 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/aic7xxx 2023-12-05T09:28:38.504 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-12-05T09:28:38.504 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-12-05T09:28:38.504 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/am53c974.ko 2023-12-05T09:28:38.504 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/arcmsr 2023-12-05T09:28:38.504 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-12-05T09:28:38.504 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/atp870u.ko 2023-12-05T09:28:38.504 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/be2iscsi 2023-12-05T09:28:38.504 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-12-05T09:28:38.504 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/bfa 2023-12-05T09:28:38.504 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/bfa/bfa.ko 2023-12-05T09:28:38.504 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/bnx2fc 2023-12-05T09:28:38.505 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-12-05T09:28:38.505 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/bnx2i 2023-12-05T09:28:38.505 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-12-05T09:28:38.505 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/ch.ko 2023-12-05T09:28:38.505 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/csiostor 2023-12-05T09:28:38.505 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/csiostor/csiostor.ko 2023-12-05T09:28:38.505 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/cxgbi 2023-12-05T09:28:38.505 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/cxgbi/cxgb3i 2023-12-05T09:28:38.505 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-12-05T09:28:38.505 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/cxgbi/cxgb4i 2023-12-05T09:28:38.505 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-12-05T09:28:38.505 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-12-05T09:28:38.505 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/dc395x.ko 2023-12-05T09:28:38.505 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/device_handler 2023-12-05T09:28:38.505 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-12-05T09:28:38.505 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-12-05T09:28:38.506 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-12-05T09:28:38.506 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-12-05T09:28:38.506 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/dmx3191d.ko 2023-12-05T09:28:38.506 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/esas2r 2023-12-05T09:28:38.506 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/esas2r/esas2r.ko 2023-12-05T09:28:38.506 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/esp_scsi.ko 2023-12-05T09:28:38.506 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/fcoe 2023-12-05T09:28:38.506 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/fcoe/fcoe.ko 2023-12-05T09:28:38.506 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-12-05T09:28:38.506 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/fnic 2023-12-05T09:28:38.506 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/fnic/fnic.ko 2023-12-05T09:28:38.506 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/hpsa.ko 2023-12-05T09:28:38.506 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/hptiop.ko 2023-12-05T09:28:38.506 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/hv_storvsc.ko 2023-12-05T09:28:38.506 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/initio.ko 2023-12-05T09:28:38.507 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/ipr.ko 2023-12-05T09:28:38.507 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/ips.ko 2023-12-05T09:28:38.507 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/isci 2023-12-05T09:28:38.507 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/isci/isci.ko 2023-12-05T09:28:38.507 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-12-05T09:28:38.507 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/iscsi_tcp.ko 2023-12-05T09:28:38.507 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/libfc 2023-12-05T09:28:38.507 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/libfc/libfc.ko 2023-12-05T09:28:38.507 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/libiscsi.ko 2023-12-05T09:28:38.507 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/libiscsi_tcp.ko 2023-12-05T09:28:38.507 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/libsas 2023-12-05T09:28:38.507 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/libsas/libsas.ko 2023-12-05T09:28:38.507 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/lpfc 2023-12-05T09:28:38.507 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/lpfc/lpfc.ko 2023-12-05T09:28:38.507 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/megaraid 2023-12-05T09:28:38.507 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/megaraid.ko 2023-12-05T09:28:38.508 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-12-05T09:28:38.508 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-12-05T09:28:38.508 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-12-05T09:28:38.508 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/mpt3sas 2023-12-05T09:28:38.508 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-12-05T09:28:38.508 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/mvsas 2023-12-05T09:28:38.508 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/mvsas/mvsas.ko 2023-12-05T09:28:38.508 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/mvumi.ko 2023-12-05T09:28:38.508 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/pm8001 2023-12-05T09:28:38.508 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-12-05T09:28:38.508 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/pmcraid.ko 2023-12-05T09:28:38.508 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/qla1280.ko 2023-12-05T09:28:38.508 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/qla2xxx 2023-12-05T09:28:38.508 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-12-05T09:28:38.508 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-12-05T09:28:38.508 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/qla4xxx 2023-12-05T09:28:38.509 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-12-05T09:28:38.509 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/raid_class.ko 2023-12-05T09:28:38.509 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/scsi_debug.ko 2023-12-05T09:28:38.509 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/scsi_transport_fc.ko 2023-12-05T09:28:38.509 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-12-05T09:28:38.509 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/scsi_transport_sas.ko 2023-12-05T09:28:38.509 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/scsi_transport_spi.ko 2023-12-05T09:28:38.509 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/scsi_transport_srp.ko 2023-12-05T09:28:38.509 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/ses.ko 2023-12-05T09:28:38.509 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/st.ko 2023-12-05T09:28:38.509 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/stex.ko 2023-12-05T09:28:38.509 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/sym53c8xx_2 2023-12-05T09:28:38.509 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-12-05T09:28:38.510 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/virtio_scsi.ko 2023-12-05T09:28:38.510 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/vmw_pvscsi.ko 2023-12-05T09:28:38.510 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/wd719x.ko 2023-12-05T09:28:38.510 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ssb 2023-12-05T09:28:38.510 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ssb/ssb.ko 2023-12-05T09:28:38.510 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/target 2023-12-05T09:28:38.510 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/target/iscsi 2023-12-05T09:28:38.510 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-12-05T09:28:38.510 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/target/loopback 2023-12-05T09:28:38.510 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/target/loopback/tcm_loop.ko 2023-12-05T09:28:38.510 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/target/target_core_file.ko 2023-12-05T09:28:38.510 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/target/target_core_iblock.ko 2023-12-05T09:28:38.510 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/target/target_core_mod.ko 2023-12-05T09:28:38.510 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/target/target_core_pscsi.ko 2023-12-05T09:28:38.510 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/target/target_core_user.ko 2023-12-05T09:28:38.511 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/target/tcm_fc 2023-12-05T09:28:38.511 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-12-05T09:28:38.511 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal 2023-12-05T09:28:38.511 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel 2023-12-05T09:28:38.511 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal 2023-12-05T09:28:38.511 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-12-05T09:28:38.511 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-12-05T09:28:38.511 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-12-05T09:28:38.511 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-12-05T09:28:38.511 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-12-05T09:28:38.511 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-12-05T09:28:38.511 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-12-05T09:28:38.511 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-12-05T09:28:38.511 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-12-05T09:28:38.511 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-12-05T09:28:38.512 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-12-05T09:28:38.512 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-12-05T09:28:38.512 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-12-05T09:28:38.512 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-12-05T09:28:38.512 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-12-05T09:28:38.512 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty 2023-12-05T09:28:38.512 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/ipwireless 2023-12-05T09:28:38.512 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-12-05T09:28:38.512 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/n_gsm.ko 2023-12-05T09:28:38.512 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/n_hdlc.ko 2023-12-05T09:28:38.512 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/nozomi.ko 2023-12-05T09:28:38.512 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/serial 2023-12-05T09:28:38.512 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/serial/8250 2023-12-05T09:28:38.512 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-12-05T09:28:38.512 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/serial/arc_uart.ko 2023-12-05T09:28:38.512 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/serial/jsm 2023-12-05T09:28:38.513 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/serial/jsm/jsm.ko 2023-12-05T09:28:38.513 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ufs 2023-12-05T09:28:38.513 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ufs/core 2023-12-05T09:28:38.513 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ufs/core/ufshcd-core.ko 2023-12-05T09:28:38.513 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ufs/host 2023-12-05T09:28:38.513 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-12-05T09:28:38.513 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/uio 2023-12-05T09:28:38.513 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/uio/uio.ko 2023-12-05T09:28:38.513 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/uio/uio_aec.ko 2023-12-05T09:28:38.513 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/uio/uio_cif.ko 2023-12-05T09:28:38.513 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/uio/uio_pci_generic.ko 2023-12-05T09:28:38.513 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/uio/uio_sercos3.ko 2023-12-05T09:28:38.513 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb 2023-12-05T09:28:38.513 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/class 2023-12-05T09:28:38.513 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/class/cdc-acm.ko 2023-12-05T09:28:38.513 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/class/cdc-wdm.ko 2023-12-05T09:28:38.514 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/class/usblp.ko 2023-12-05T09:28:38.514 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/class/usbtmc.ko 2023-12-05T09:28:38.514 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/host 2023-12-05T09:28:38.514 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/host/sl811-hcd.ko 2023-12-05T09:28:38.514 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/image 2023-12-05T09:28:38.514 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/image/mdc800.ko 2023-12-05T09:28:38.514 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/image/microtek.ko 2023-12-05T09:28:38.514 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc 2023-12-05T09:28:38.514 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/adutux.ko 2023-12-05T09:28:38.514 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/appledisplay.ko 2023-12-05T09:28:38.514 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/emi26.ko 2023-12-05T09:28:38.514 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/emi62.ko 2023-12-05T09:28:38.514 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/ezusb.ko 2023-12-05T09:28:38.514 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/idmouse.ko 2023-12-05T09:28:38.514 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/iowarrior.ko 2023-12-05T09:28:38.515 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/isight_firmware.ko 2023-12-05T09:28:38.515 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/ldusb.ko 2023-12-05T09:28:38.515 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/legousbtower.ko 2023-12-05T09:28:38.515 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/sisusbvga 2023-12-05T09:28:38.515 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-12-05T09:28:38.515 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/trancevibrator.ko 2023-12-05T09:28:38.515 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/usb3503.ko 2023-12-05T09:28:38.515 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/usblcd.ko 2023-12-05T09:28:38.515 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/usbsevseg.ko 2023-12-05T09:28:38.515 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/uss720.ko 2023-12-05T09:28:38.515 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/yurex.ko 2023-12-05T09:28:38.515 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/phy 2023-12-05T09:28:38.515 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/phy/phy-generic.ko 2023-12-05T09:28:38.515 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial 2023-12-05T09:28:38.515 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/aircable.ko 2023-12-05T09:28:38.516 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/ark3116.ko 2023-12-05T09:28:38.516 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/belkin_sa.ko 2023-12-05T09:28:38.516 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/ch341.ko 2023-12-05T09:28:38.516 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/cp210x.ko 2023-12-05T09:28:38.516 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/cyberjack.ko 2023-12-05T09:28:38.516 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/cypress_m8.ko 2023-12-05T09:28:38.516 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/digi_acceleport.ko 2023-12-05T09:28:38.516 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/empeg.ko 2023-12-05T09:28:38.516 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/ftdi_sio.ko 2023-12-05T09:28:38.516 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/garmin_gps.ko 2023-12-05T09:28:38.516 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/io_edgeport.ko 2023-12-05T09:28:38.516 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/io_ti.ko 2023-12-05T09:28:38.516 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/ipaq.ko 2023-12-05T09:28:38.516 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/ipw.ko 2023-12-05T09:28:38.517 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/ir-usb.ko 2023-12-05T09:28:38.517 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-12-05T09:28:38.517 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/keyspan.ko 2023-12-05T09:28:38.517 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/keyspan_pda.ko 2023-12-05T09:28:38.517 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/kl5kusb105.ko 2023-12-05T09:28:38.517 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/kobil_sct.ko 2023-12-05T09:28:38.517 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/mct_u232.ko 2023-12-05T09:28:38.517 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/mos7720.ko 2023-12-05T09:28:38.517 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/mos7840.ko 2023-12-05T09:28:38.517 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/navman.ko 2023-12-05T09:28:38.517 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/omninet.ko 2023-12-05T09:28:38.517 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/opticon.ko 2023-12-05T09:28:38.517 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/option.ko 2023-12-05T09:28:38.517 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/oti6858.ko 2023-12-05T09:28:38.517 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/pl2303.ko 2023-12-05T09:28:38.518 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/qcaux.ko 2023-12-05T09:28:38.518 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/qcserial.ko 2023-12-05T09:28:38.518 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/quatech2.ko 2023-12-05T09:28:38.518 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/safe_serial.ko 2023-12-05T09:28:38.518 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/sierra.ko 2023-12-05T09:28:38.518 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/spcp8x5.ko 2023-12-05T09:28:38.518 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/ssu100.ko 2023-12-05T09:28:38.518 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/symbolserial.ko 2023-12-05T09:28:38.518 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-12-05T09:28:38.518 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-12-05T09:28:38.518 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/usb_debug.ko 2023-12-05T09:28:38.518 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/usb_wwan.ko 2023-12-05T09:28:38.518 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/visor.ko 2023-12-05T09:28:38.518 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/whiteheat.ko 2023-12-05T09:28:38.518 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/xsens_mt.ko 2023-12-05T09:28:38.519 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage 2023-12-05T09:28:38.519 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/uas.ko 2023-12-05T09:28:38.519 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-alauda.ko 2023-12-05T09:28:38.519 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-cypress.ko 2023-12-05T09:28:38.519 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-datafab.ko 2023-12-05T09:28:38.519 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-12-05T09:28:38.519 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-freecom.ko 2023-12-05T09:28:38.519 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-isd200.ko 2023-12-05T09:28:38.519 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-12-05T09:28:38.519 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-karma.ko 2023-12-05T09:28:38.519 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-onetouch.ko 2023-12-05T09:28:38.519 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-realtek.ko 2023-12-05T09:28:38.519 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-sddr09.ko 2023-12-05T09:28:38.519 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-sddr55.ko 2023-12-05T09:28:38.519 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-usbat.ko 2023-12-05T09:28:38.519 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/usb-storage.ko 2023-12-05T09:28:38.520 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/usbip 2023-12-05T09:28:38.520 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/usbip/usbip-core.ko 2023-12-05T09:28:38.520 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/usbip/usbip-host.ko 2023-12-05T09:28:38.520 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-12-05T09:28:38.520 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/vfio 2023-12-05T09:28:38.520 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/vfio/pci 2023-12-05T09:28:38.520 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-12-05T09:28:38.520 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/vfio/pci/vfio-pci.ko 2023-12-05T09:28:38.520 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/vfio/vfio.ko 2023-12-05T09:28:38.520 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-12-05T09:28:38.520 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/vhost 2023-12-05T09:28:38.520 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/vhost/vhost.ko 2023-12-05T09:28:38.520 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/vhost/vhost_iotlb.ko 2023-12-05T09:28:38.520 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/vhost/vhost_net.ko 2023-12-05T09:28:38.520 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/vhost/vhost_scsi.ko 2023-12-05T09:28:38.520 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/video 2023-12-05T09:28:38.521 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/video/backlight 2023-12-05T09:28:38.521 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/video/backlight/apple_bl.ko 2023-12-05T09:28:38.521 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/video/backlight/lcd.ko 2023-12-05T09:28:38.521 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/video/backlight/platform_lcd.ko 2023-12-05T09:28:38.521 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/virtio 2023-12-05T09:28:38.521 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/virtio/virtio.ko 2023-12-05T09:28:38.521 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/virtio/virtio_balloon.ko 2023-12-05T09:28:38.521 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/virtio/virtio_mmio.ko 2023-12-05T09:28:38.521 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/virtio/virtio_pci.ko 2023-12-05T09:28:38.521 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-12-05T09:28:38.521 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-12-05T09:28:38.521 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/virtio/virtio_ring.ko 2023-12-05T09:28:38.521 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1 2023-12-05T09:28:38.521 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/masters 2023-12-05T09:28:38.521 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/masters/ds2482.ko 2023-12-05T09:28:38.522 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/masters/ds2490.ko 2023-12-05T09:28:38.522 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/slaves 2023-12-05T09:28:38.522 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-12-05T09:28:38.522 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-12-05T09:28:38.522 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-12-05T09:28:38.522 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-12-05T09:28:38.522 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-12-05T09:28:38.522 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-12-05T09:28:38.522 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-12-05T09:28:38.522 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-12-05T09:28:38.522 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-12-05T09:28:38.522 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/slaves/w1_smem.ko 2023-12-05T09:28:38.522 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/slaves/w1_therm.ko 2023-12-05T09:28:38.522 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/wire.ko 2023-12-05T09:28:38.522 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog 2023-12-05T09:28:38.522 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/alim1535_wdt.ko 2023-12-05T09:28:38.523 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/alim7101_wdt.ko 2023-12-05T09:28:38.523 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/f71808e_wdt.ko 2023-12-05T09:28:38.523 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/hpwdt.ko 2023-12-05T09:28:38.523 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/i6300esb.ko 2023-12-05T09:28:38.523 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-12-05T09:28:38.523 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/iTCO_wdt.ko 2023-12-05T09:28:38.523 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/ib700wdt.ko 2023-12-05T09:28:38.523 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/ibmasr.ko 2023-12-05T09:28:38.523 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-12-05T09:28:38.523 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/it8712f_wdt.ko 2023-12-05T09:28:38.523 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/it87_wdt.ko 2023-12-05T09:28:38.523 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/machzwd.ko 2023-12-05T09:28:38.523 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/nv_tco.ko 2023-12-05T09:28:38.523 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/pcwd_pci.ko 2023-12-05T09:28:38.523 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/pcwd_usb.ko 2023-12-05T09:28:38.524 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-12-05T09:28:38.524 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/sch311x_wdt.ko 2023-12-05T09:28:38.524 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/softdog.ko 2023-12-05T09:28:38.524 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/sp5100_tco.ko 2023-12-05T09:28:38.524 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/via_wdt.ko 2023-12-05T09:28:38.524 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-12-05T09:28:38.524 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/w83877f_wdt.ko 2023-12-05T09:28:38.524 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/w83977f_wdt.ko 2023-12-05T09:28:38.524 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/wdt_pci.ko 2023-12-05T09:28:38.524 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/xen_wdt.ko 2023-12-05T09:28:38.524 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/xen 2023-12-05T09:28:38.524 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/xen/xen-acpi-processor.ko 2023-12-05T09:28:38.524 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/xen/xen-evtchn.ko 2023-12-05T09:28:38.524 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/xen/xen-gntalloc.ko 2023-12-05T09:28:38.525 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/xen/xen-gntdev.ko 2023-12-05T09:28:38.525 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/xen/xen-pciback 2023-12-05T09:28:38.525 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-12-05T09:28:38.525 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/xen/xen-privcmd.ko 2023-12-05T09:28:38.525 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/xen/xenfs 2023-12-05T09:28:38.525 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/xen/xenfs/xenfs.ko 2023-12-05T09:28:38.525 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs 2023-12-05T09:28:38.525 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/9p 2023-12-05T09:28:38.525 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/9p/9p.ko 2023-12-05T09:28:38.525 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/affs 2023-12-05T09:28:38.525 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/affs/affs.ko 2023-12-05T09:28:38.525 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/befs 2023-12-05T09:28:38.525 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/befs/befs.ko 2023-12-05T09:28:38.525 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/binfmt_misc.ko 2023-12-05T09:28:38.525 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/btrfs 2023-12-05T09:28:38.525 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/btrfs/btrfs.ko 2023-12-05T09:28:38.526 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/cachefiles 2023-12-05T09:28:38.526 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/cachefiles/cachefiles.ko 2023-12-05T09:28:38.526 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ceph 2023-12-05T09:28:38.526 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ceph/ceph.ko 2023-12-05T09:28:38.526 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/coda 2023-12-05T09:28:38.526 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/coda/coda.ko 2023-12-05T09:28:38.526 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/cramfs 2023-12-05T09:28:38.526 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/cramfs/cramfs.ko 2023-12-05T09:28:38.526 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/dlm 2023-12-05T09:28:38.526 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/dlm/dlm.ko 2023-12-05T09:28:38.526 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ecryptfs 2023-12-05T09:28:38.526 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ecryptfs/ecryptfs.ko 2023-12-05T09:28:38.526 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/f2fs 2023-12-05T09:28:38.526 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/f2fs/f2fs.ko 2023-12-05T09:28:38.526 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/fat 2023-12-05T09:28:38.527 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/fat/fat.ko 2023-12-05T09:28:38.527 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/fat/msdos.ko 2023-12-05T09:28:38.527 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/fat/vfat.ko 2023-12-05T09:28:38.527 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/fscache 2023-12-05T09:28:38.527 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/fscache/fscache.ko 2023-12-05T09:28:38.527 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/fuse 2023-12-05T09:28:38.527 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/fuse/cuse.ko 2023-12-05T09:28:38.527 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/fuse/fuse.ko 2023-12-05T09:28:38.527 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/gfs2 2023-12-05T09:28:38.527 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/gfs2/gfs2.ko 2023-12-05T09:28:38.527 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/hfs 2023-12-05T09:28:38.527 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/hfs/hfs.ko 2023-12-05T09:28:38.527 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/hfsplus 2023-12-05T09:28:38.527 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/hfsplus/hfsplus.ko 2023-12-05T09:28:38.527 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/isofs 2023-12-05T09:28:38.527 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/isofs/isofs.ko 2023-12-05T09:28:38.528 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/jfs 2023-12-05T09:28:38.528 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/jfs/jfs.ko 2023-12-05T09:28:38.528 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/lockd 2023-12-05T09:28:38.528 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/lockd/lockd.ko 2023-12-05T09:28:38.528 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/minix 2023-12-05T09:28:38.528 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/minix/minix.ko 2023-12-05T09:28:38.528 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/netfs 2023-12-05T09:28:38.528 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/netfs/netfs.ko 2023-12-05T09:28:38.528 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs 2023-12-05T09:28:38.528 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs/blocklayout 2023-12-05T09:28:38.528 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-12-05T09:28:38.528 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs/filelayout 2023-12-05T09:28:38.528 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-12-05T09:28:38.528 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs/flexfilelayout 2023-12-05T09:28:38.528 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-12-05T09:28:38.529 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs/nfs.ko 2023-12-05T09:28:38.529 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs/nfsv3.ko 2023-12-05T09:28:38.529 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs/nfsv4.ko 2023-12-05T09:28:38.529 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs_common 2023-12-05T09:28:38.529 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs_common/grace.ko 2023-12-05T09:28:38.529 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs_common/nfs_acl.ko 2023-12-05T09:28:38.529 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfsd 2023-12-05T09:28:38.529 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfsd/nfsd.ko 2023-12-05T09:28:38.529 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nilfs2 2023-12-05T09:28:38.529 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nilfs2/nilfs2.ko 2023-12-05T09:28:38.529 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls 2023-12-05T09:28:38.529 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/mac-celtic.ko 2023-12-05T09:28:38.529 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/mac-centeuro.ko 2023-12-05T09:28:38.529 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/mac-croatian.ko 2023-12-05T09:28:38.529 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/mac-cyrillic.ko 2023-12-05T09:28:38.530 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/mac-gaelic.ko 2023-12-05T09:28:38.530 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/mac-greek.ko 2023-12-05T09:28:38.530 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/mac-iceland.ko 2023-12-05T09:28:38.530 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/mac-inuit.ko 2023-12-05T09:28:38.530 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/mac-roman.ko 2023-12-05T09:28:38.530 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/mac-romanian.ko 2023-12-05T09:28:38.530 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/mac-turkish.ko 2023-12-05T09:28:38.530 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp1250.ko 2023-12-05T09:28:38.530 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp1251.ko 2023-12-05T09:28:38.530 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp1255.ko 2023-12-05T09:28:38.530 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp737.ko 2023-12-05T09:28:38.530 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp775.ko 2023-12-05T09:28:38.530 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp850.ko 2023-12-05T09:28:38.530 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp852.ko 2023-12-05T09:28:38.531 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp855.ko 2023-12-05T09:28:38.531 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp857.ko 2023-12-05T09:28:38.531 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp860.ko 2023-12-05T09:28:38.531 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp861.ko 2023-12-05T09:28:38.531 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp862.ko 2023-12-05T09:28:38.531 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp863.ko 2023-12-05T09:28:38.531 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp864.ko 2023-12-05T09:28:38.531 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp865.ko 2023-12-05T09:28:38.531 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp866.ko 2023-12-05T09:28:38.531 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp869.ko 2023-12-05T09:28:38.531 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp874.ko 2023-12-05T09:28:38.531 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp932.ko 2023-12-05T09:28:38.531 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp936.ko 2023-12-05T09:28:38.531 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp949.ko 2023-12-05T09:28:38.531 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp950.ko 2023-12-05T09:28:38.531 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_euc-jp.ko 2023-12-05T09:28:38.532 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_iso8859-1.ko 2023-12-05T09:28:38.532 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_iso8859-13.ko 2023-12-05T09:28:38.532 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_iso8859-14.ko 2023-12-05T09:28:38.532 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_iso8859-15.ko 2023-12-05T09:28:38.532 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_iso8859-2.ko 2023-12-05T09:28:38.532 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_iso8859-3.ko 2023-12-05T09:28:38.532 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_iso8859-4.ko 2023-12-05T09:28:38.532 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_iso8859-5.ko 2023-12-05T09:28:38.532 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_iso8859-6.ko 2023-12-05T09:28:38.532 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_iso8859-7.ko 2023-12-05T09:28:38.532 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_iso8859-9.ko 2023-12-05T09:28:38.532 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_koi8-r.ko 2023-12-05T09:28:38.532 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_koi8-ru.ko 2023-12-05T09:28:38.532 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_koi8-u.ko 2023-12-05T09:28:38.532 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_ucs2_utils.ko 2023-12-05T09:28:38.533 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_utf8.ko 2023-12-05T09:28:38.533 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ocfs2 2023-12-05T09:28:38.533 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ocfs2/cluster 2023-12-05T09:28:38.533 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-12-05T09:28:38.533 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ocfs2/dlm 2023-12-05T09:28:38.533 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-12-05T09:28:38.533 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ocfs2/dlmfs 2023-12-05T09:28:38.533 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-12-05T09:28:38.533 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ocfs2/ocfs2.ko 2023-12-05T09:28:38.533 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-12-05T09:28:38.533 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-12-05T09:28:38.533 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-12-05T09:28:38.533 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/overlayfs 2023-12-05T09:28:38.533 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/overlayfs/overlay.ko 2023-12-05T09:28:38.533 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/pstore 2023-12-05T09:28:38.534 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/pstore/ramoops.ko 2023-12-05T09:28:38.534 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/reiserfs 2023-12-05T09:28:38.534 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/reiserfs/reiserfs.ko 2023-12-05T09:28:38.534 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/romfs 2023-12-05T09:28:38.534 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/romfs/romfs.ko 2023-12-05T09:28:38.534 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/smb 2023-12-05T09:28:38.534 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/smb/client 2023-12-05T09:28:38.534 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/smb/client/cifs.ko 2023-12-05T09:28:38.534 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/smb/common 2023-12-05T09:28:38.534 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/smb/common/cifs_arc4.ko 2023-12-05T09:28:38.534 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/smb/common/cifs_md4.ko 2023-12-05T09:28:38.534 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/squashfs 2023-12-05T09:28:38.534 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/squashfs/squashfs.ko 2023-12-05T09:28:38.534 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/sysv 2023-12-05T09:28:38.535 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/sysv/sysv.ko 2023-12-05T09:28:38.535 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/udf 2023-12-05T09:28:38.535 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/udf/udf.ko 2023-12-05T09:28:38.535 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ufs 2023-12-05T09:28:38.535 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ufs/ufs.ko 2023-12-05T09:28:38.535 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/xfs 2023-12-05T09:28:38.535 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/xfs/xfs.ko 2023-12-05T09:28:38.535 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/kernel 2023-12-05T09:28:38.535 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/kernel/rcu 2023-12-05T09:28:38.535 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/kernel/rcu/rcutorture.ko 2023-12-05T09:28:38.535 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/kernel/torture.ko 2023-12-05T09:28:38.535 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/kernel/trace 2023-12-05T09:28:38.535 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-12-05T09:28:38.535 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib 2023-12-05T09:28:38.535 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/asn1_encoder.ko 2023-12-05T09:28:38.535 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/crc-itu-t.ko 2023-12-05T09:28:38.536 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/crc8.ko 2023-12-05T09:28:38.536 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/crypto 2023-12-05T09:28:38.536 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/crypto/libarc4.ko 2023-12-05T09:28:38.536 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/crypto/libdes.ko 2023-12-05T09:28:38.536 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/libcrc32c.ko 2023-12-05T09:28:38.536 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/lru_cache.ko 2023-12-05T09:28:38.536 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/lz4 2023-12-05T09:28:38.536 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/lz4/lz4_compress.ko 2023-12-05T09:28:38.536 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/lz4/lz4hc_compress.ko 2023-12-05T09:28:38.536 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/math 2023-12-05T09:28:38.536 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/math/cordic.ko 2023-12-05T09:28:38.536 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/raid6 2023-12-05T09:28:38.536 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/raid6/raid6_pq.ko 2023-12-05T09:28:38.536 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/reed_solomon 2023-12-05T09:28:38.536 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/reed_solomon/reed_solomon.ko 2023-12-05T09:28:38.537 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/ts_bm.ko 2023-12-05T09:28:38.537 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/ts_fsm.ko 2023-12-05T09:28:38.537 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/ts_kmp.ko 2023-12-05T09:28:38.537 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/zstd 2023-12-05T09:28:38.537 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/zstd/zstd_compress.ko 2023-12-05T09:28:38.537 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/mm 2023-12-05T09:28:38.537 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/mm/hwpoison-inject.ko 2023-12-05T09:28:38.537 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net 2023-12-05T09:28:38.537 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/6lowpan 2023-12-05T09:28:38.537 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/6lowpan/6lowpan.ko 2023-12-05T09:28:38.537 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/6lowpan/nhc_dest.ko 2023-12-05T09:28:38.537 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/6lowpan/nhc_fragment.ko 2023-12-05T09:28:38.537 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/6lowpan/nhc_hop.ko 2023-12-05T09:28:38.537 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/6lowpan/nhc_ipv6.ko 2023-12-05T09:28:38.537 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/6lowpan/nhc_mobility.ko 2023-12-05T09:28:38.537 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/6lowpan/nhc_routing.ko 2023-12-05T09:28:38.538 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/6lowpan/nhc_udp.ko 2023-12-05T09:28:38.538 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/802 2023-12-05T09:28:38.538 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/802/garp.ko 2023-12-05T09:28:38.538 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/802/mrp.ko 2023-12-05T09:28:38.538 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/802/p8022.ko 2023-12-05T09:28:38.538 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/802/psnap.ko 2023-12-05T09:28:38.538 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/802/stp.ko 2023-12-05T09:28:38.538 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/8021q 2023-12-05T09:28:38.538 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/8021q/8021q.ko 2023-12-05T09:28:38.538 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/9p 2023-12-05T09:28:38.538 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/9p/9pnet.ko 2023-12-05T09:28:38.538 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/9p/9pnet_fd.ko 2023-12-05T09:28:38.538 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/9p/9pnet_rdma.ko 2023-12-05T09:28:38.538 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/9p/9pnet_virtio.ko 2023-12-05T09:28:38.538 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/batman-adv 2023-12-05T09:28:38.539 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/batman-adv/batman-adv.ko 2023-12-05T09:28:38.539 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge 2023-12-05T09:28:38.539 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/br_netfilter.ko 2023-12-05T09:28:38.539 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/bridge.ko 2023-12-05T09:28:38.539 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter 2023-12-05T09:28:38.539 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-12-05T09:28:38.539 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_among.ko 2023-12-05T09:28:38.539 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_arp.ko 2023-12-05T09:28:38.539 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-12-05T09:28:38.539 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-12-05T09:28:38.539 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_ip.ko 2023-12-05T09:28:38.539 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-12-05T09:28:38.539 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_limit.ko 2023-12-05T09:28:38.539 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_log.ko 2023-12-05T09:28:38.539 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_mark.ko 2023-12-05T09:28:38.540 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-12-05T09:28:38.540 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-12-05T09:28:38.540 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-12-05T09:28:38.540 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-12-05T09:28:38.540 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_snat.ko 2023-12-05T09:28:38.540 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_stp.ko 2023-12-05T09:28:38.540 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-12-05T09:28:38.540 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-12-05T09:28:38.540 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-12-05T09:28:38.540 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-12-05T09:28:38.540 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebtables.ko 2023-12-05T09:28:38.540 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-12-05T09:28:38.540 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-12-05T09:28:38.540 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-12-05T09:28:38.540 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ceph 2023-12-05T09:28:38.541 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ceph/libceph.ko 2023-12-05T09:28:38.541 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/core 2023-12-05T09:28:38.541 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/core/failover.ko 2023-12-05T09:28:38.541 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/core/pktgen.ko 2023-12-05T09:28:38.541 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/dccp 2023-12-05T09:28:38.541 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/dccp/dccp.ko 2023-12-05T09:28:38.541 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/dccp/dccp_diag.ko 2023-12-05T09:28:38.541 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/dccp/dccp_ipv4.ko 2023-12-05T09:28:38.541 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/dccp/dccp_ipv6.ko 2023-12-05T09:28:38.541 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/dns_resolver 2023-12-05T09:28:38.541 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/dns_resolver/dns_resolver.ko 2023-12-05T09:28:38.541 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/dsa 2023-12-05T09:28:38.541 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/dsa/dsa_core.ko 2023-12-05T09:28:38.541 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/dsa/tag_brcm.ko 2023-12-05T09:28:38.542 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/dsa/tag_dsa.ko 2023-12-05T09:28:38.542 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/dsa/tag_none.ko 2023-12-05T09:28:38.542 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/dsa/tag_trailer.ko 2023-12-05T09:28:38.542 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ieee802154 2023-12-05T09:28:38.542 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ieee802154/6lowpan 2023-12-05T09:28:38.542 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-12-05T09:28:38.542 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ieee802154/ieee802154.ko 2023-12-05T09:28:38.542 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ieee802154/ieee802154_socket.ko 2023-12-05T09:28:38.542 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4 2023-12-05T09:28:38.542 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/ah4.ko 2023-12-05T09:28:38.542 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/esp4.ko 2023-12-05T09:28:38.542 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/fou.ko 2023-12-05T09:28:38.542 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/gre.ko 2023-12-05T09:28:38.542 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/inet_diag.ko 2023-12-05T09:28:38.543 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/ip_gre.ko 2023-12-05T09:28:38.543 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/ip_tunnel.ko 2023-12-05T09:28:38.543 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/ip_vti.ko 2023-12-05T09:28:38.543 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/ipcomp.ko 2023-12-05T09:28:38.543 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/ipip.ko 2023-12-05T09:28:38.543 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter 2023-12-05T09:28:38.543 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/arp_tables.ko 2023-12-05T09:28:38.543 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-12-05T09:28:38.543 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-12-05T09:28:38.543 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-12-05T09:28:38.543 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-12-05T09:28:38.543 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-12-05T09:28:38.543 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-12-05T09:28:38.543 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-12-05T09:28:38.543 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-12-05T09:28:38.543 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-12-05T09:28:38.544 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/iptable_security.ko 2023-12-05T09:28:38.544 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-12-05T09:28:38.544 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-12-05T09:28:38.544 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-12-05T09:28:38.544 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-12-05T09:28:38.544 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-12-05T09:28:38.544 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-12-05T09:28:38.544 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-12-05T09:28:38.544 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-12-05T09:28:38.544 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-12-05T09:28:38.544 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-12-05T09:28:38.544 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_bic.ko 2023-12-05T09:28:38.544 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_dctcp.ko 2023-12-05T09:28:38.544 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_diag.ko 2023-12-05T09:28:38.545 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_highspeed.ko 2023-12-05T09:28:38.545 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_htcp.ko 2023-12-05T09:28:38.545 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_hybla.ko 2023-12-05T09:28:38.545 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_illinois.ko 2023-12-05T09:28:38.545 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_lp.ko 2023-12-05T09:28:38.545 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_scalable.ko 2023-12-05T09:28:38.545 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_vegas.ko 2023-12-05T09:28:38.545 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_veno.ko 2023-12-05T09:28:38.545 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_westwood.ko 2023-12-05T09:28:38.545 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_yeah.ko 2023-12-05T09:28:38.545 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tunnel4.ko 2023-12-05T09:28:38.545 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/udp_diag.ko 2023-12-05T09:28:38.545 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/udp_tunnel.ko 2023-12-05T09:28:38.545 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/xfrm4_tunnel.ko 2023-12-05T09:28:38.545 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6 2023-12-05T09:28:38.545 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/ah6.ko 2023-12-05T09:28:38.546 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/esp6.ko 2023-12-05T09:28:38.546 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/fou6.ko 2023-12-05T09:28:38.546 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/ip6_tunnel.ko 2023-12-05T09:28:38.546 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-12-05T09:28:38.546 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/ip6_vti.ko 2023-12-05T09:28:38.546 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/ipcomp6.ko 2023-12-05T09:28:38.546 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter 2023-12-05T09:28:38.546 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-12-05T09:28:38.546 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-12-05T09:28:38.546 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-12-05T09:28:38.546 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-12-05T09:28:38.546 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-12-05T09:28:38.546 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-12-05T09:28:38.546 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-12-05T09:28:38.546 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-12-05T09:28:38.547 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-12-05T09:28:38.547 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-12-05T09:28:38.547 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-12-05T09:28:38.547 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-12-05T09:28:38.547 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-12-05T09:28:38.547 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-12-05T09:28:38.547 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-12-05T09:28:38.547 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-12-05T09:28:38.547 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-12-05T09:28:38.547 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-12-05T09:28:38.547 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-12-05T09:28:38.547 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-12-05T09:28:38.547 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-12-05T09:28:38.547 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-12-05T09:28:38.547 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-12-05T09:28:38.547 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-12-05T09:28:38.548 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/sit.ko 2023-12-05T09:28:38.548 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/tunnel6.ko 2023-12-05T09:28:38.548 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/xfrm6_tunnel.ko 2023-12-05T09:28:38.548 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/key 2023-12-05T09:28:38.548 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/key/af_key.ko 2023-12-05T09:28:38.548 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/l2tp 2023-12-05T09:28:38.548 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/l2tp/l2tp_core.ko 2023-12-05T09:28:38.548 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/l2tp/l2tp_debugfs.ko 2023-12-05T09:28:38.548 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/l2tp/l2tp_eth.ko 2023-12-05T09:28:38.548 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/l2tp/l2tp_ip.ko 2023-12-05T09:28:38.548 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/l2tp/l2tp_ip6.ko 2023-12-05T09:28:38.548 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/l2tp/l2tp_netlink.ko 2023-12-05T09:28:38.548 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/l2tp/l2tp_ppp.ko 2023-12-05T09:28:38.548 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/llc 2023-12-05T09:28:38.548 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/llc/llc.ko 2023-12-05T09:28:38.549 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/mac802154 2023-12-05T09:28:38.549 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/mac802154/mac802154.ko 2023-12-05T09:28:38.549 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/mpls 2023-12-05T09:28:38.549 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/mpls/mpls_gso.ko 2023-12-05T09:28:38.549 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter 2023-12-05T09:28:38.549 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset 2023-12-05T09:28:38.549 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set.ko 2023-12-05T09:28:38.549 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-12-05T09:28:38.549 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-12-05T09:28:38.549 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-12-05T09:28:38.549 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-12-05T09:28:38.549 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-12-05T09:28:38.549 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-12-05T09:28:38.549 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-12-05T09:28:38.549 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-12-05T09:28:38.550 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-12-05T09:28:38.550 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-12-05T09:28:38.550 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-12-05T09:28:38.550 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-12-05T09:28:38.550 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-12-05T09:28:38.550 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-12-05T09:28:38.550 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-12-05T09:28:38.550 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs 2023-12-05T09:28:38.550 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs.ko 2023-12-05T09:28:38.550 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-12-05T09:28:38.550 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-12-05T09:28:38.550 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-12-05T09:28:38.550 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-12-05T09:28:38.550 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-12-05T09:28:38.551 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-12-05T09:28:38.551 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-12-05T09:28:38.551 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-12-05T09:28:38.551 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-12-05T09:28:38.551 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-12-05T09:28:38.551 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-12-05T09:28:38.551 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-12-05T09:28:38.551 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-12-05T09:28:38.551 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conncount.ko 2023-12-05T09:28:38.551 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack.ko 2023-12-05T09:28:38.551 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-12-05T09:28:38.551 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-12-05T09:28:38.551 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-12-05T09:28:38.551 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack_h323.ko 2023-12-05T09:28:38.551 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack_irc.ko 2023-12-05T09:28:38.552 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-12-05T09:28:38.552 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-12-05T09:28:38.552 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-12-05T09:28:38.552 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack_sane.ko 2023-12-05T09:28:38.552 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack_sip.ko 2023-12-05T09:28:38.552 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-12-05T09:28:38.552 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-12-05T09:28:38.552 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_dup_netdev.ko 2023-12-05T09:28:38.552 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_flow_table.ko 2023-12-05T09:28:38.552 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_flow_table_inet.ko 2023-12-05T09:28:38.552 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_log_syslog.ko 2023-12-05T09:28:38.552 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_nat.ko 2023-12-05T09:28:38.552 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_nat_amanda.ko 2023-12-05T09:28:38.552 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_nat_ftp.ko 2023-12-05T09:28:38.552 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_nat_irc.ko 2023-12-05T09:28:38.553 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_nat_sip.ko 2023-12-05T09:28:38.553 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_nat_tftp.ko 2023-12-05T09:28:38.553 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_synproxy_core.ko 2023-12-05T09:28:38.553 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_tables.ko 2023-12-05T09:28:38.553 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nfnetlink.ko 2023-12-05T09:28:38.553 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nfnetlink_acct.ko 2023-12-05T09:28:38.553 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nfnetlink_log.ko 2023-12-05T09:28:38.553 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nfnetlink_osf.ko 2023-12-05T09:28:38.553 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nfnetlink_queue.ko 2023-12-05T09:28:38.553 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_chain_nat.ko 2023-12-05T09:28:38.553 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_compat.ko 2023-12-05T09:28:38.553 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_ct.ko 2023-12-05T09:28:38.553 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_dup_netdev.ko 2023-12-05T09:28:38.553 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_fib.ko 2023-12-05T09:28:38.553 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_fwd_netdev.ko 2023-12-05T09:28:38.553 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_hash.ko 2023-12-05T09:28:38.554 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_limit.ko 2023-12-05T09:28:38.554 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_log.ko 2023-12-05T09:28:38.554 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_masq.ko 2023-12-05T09:28:38.554 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_nat.ko 2023-12-05T09:28:38.554 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_numgen.ko 2023-12-05T09:28:38.554 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_queue.ko 2023-12-05T09:28:38.554 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_quota.ko 2023-12-05T09:28:38.554 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_redir.ko 2023-12-05T09:28:38.554 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_reject.ko 2023-12-05T09:28:38.554 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_reject_inet.ko 2023-12-05T09:28:38.554 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_socket.ko 2023-12-05T09:28:38.554 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_tunnel.ko 2023-12-05T09:28:38.554 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_AUDIT.ko 2023-12-05T09:28:38.554 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_CHECKSUM.ko 2023-12-05T09:28:38.555 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_CLASSIFY.ko 2023-12-05T09:28:38.555 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-12-05T09:28:38.555 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_CT.ko 2023-12-05T09:28:38.555 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_DSCP.ko 2023-12-05T09:28:38.555 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_HL.ko 2023-12-05T09:28:38.555 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_HMARK.ko 2023-12-05T09:28:38.555 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_IDLETIMER.ko 2023-12-05T09:28:38.555 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_LED.ko 2023-12-05T09:28:38.555 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_LOG.ko 2023-12-05T09:28:38.555 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_MASQUERADE.ko 2023-12-05T09:28:38.555 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_NETMAP.ko 2023-12-05T09:28:38.555 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_NFLOG.ko 2023-12-05T09:28:38.555 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_NFQUEUE.ko 2023-12-05T09:28:38.555 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_RATEEST.ko 2023-12-05T09:28:38.555 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_REDIRECT.ko 2023-12-05T09:28:38.555 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_SECMARK.ko 2023-12-05T09:28:38.556 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_TCPMSS.ko 2023-12-05T09:28:38.556 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-12-05T09:28:38.556 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_TEE.ko 2023-12-05T09:28:38.556 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_TPROXY.ko 2023-12-05T09:28:38.556 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_TRACE.ko 2023-12-05T09:28:38.556 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_addrtype.ko 2023-12-05T09:28:38.556 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_bpf.ko 2023-12-05T09:28:38.556 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_cgroup.ko 2023-12-05T09:28:38.556 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_cluster.ko 2023-12-05T09:28:38.556 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_comment.ko 2023-12-05T09:28:38.556 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_connbytes.ko 2023-12-05T09:28:38.556 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_connlabel.ko 2023-12-05T09:28:38.556 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_connlimit.ko 2023-12-05T09:28:38.556 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_connmark.ko 2023-12-05T09:28:38.556 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_conntrack.ko 2023-12-05T09:28:38.556 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_cpu.ko 2023-12-05T09:28:38.557 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_dccp.ko 2023-12-05T09:28:38.557 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_devgroup.ko 2023-12-05T09:28:38.557 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_dscp.ko 2023-12-05T09:28:38.557 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_ecn.ko 2023-12-05T09:28:38.557 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_esp.ko 2023-12-05T09:28:38.557 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_hashlimit.ko 2023-12-05T09:28:38.557 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_helper.ko 2023-12-05T09:28:38.557 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_hl.ko 2023-12-05T09:28:38.557 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_ipcomp.ko 2023-12-05T09:28:38.557 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_iprange.ko 2023-12-05T09:28:38.557 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_ipvs.ko 2023-12-05T09:28:38.557 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_l2tp.ko 2023-12-05T09:28:38.557 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_length.ko 2023-12-05T09:28:38.557 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_limit.ko 2023-12-05T09:28:38.557 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_mac.ko 2023-12-05T09:28:38.558 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_mark.ko 2023-12-05T09:28:38.558 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_multiport.ko 2023-12-05T09:28:38.558 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_nat.ko 2023-12-05T09:28:38.558 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_nfacct.ko 2023-12-05T09:28:38.558 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_osf.ko 2023-12-05T09:28:38.558 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_owner.ko 2023-12-05T09:28:38.558 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_physdev.ko 2023-12-05T09:28:38.558 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_pkttype.ko 2023-12-05T09:28:38.558 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_policy.ko 2023-12-05T09:28:38.558 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_quota.ko 2023-12-05T09:28:38.558 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_rateest.ko 2023-12-05T09:28:38.558 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_realm.ko 2023-12-05T09:28:38.558 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_recent.ko 2023-12-05T09:28:38.558 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_sctp.ko 2023-12-05T09:28:38.558 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_set.ko 2023-12-05T09:28:38.559 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_socket.ko 2023-12-05T09:28:38.559 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_state.ko 2023-12-05T09:28:38.559 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_statistic.ko 2023-12-05T09:28:38.559 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_string.ko 2023-12-05T09:28:38.559 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_tcpmss.ko 2023-12-05T09:28:38.559 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_time.ko 2023-12-05T09:28:38.559 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_u32.ko 2023-12-05T09:28:38.559 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netlink 2023-12-05T09:28:38.559 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netlink/netlink_diag.ko 2023-12-05T09:28:38.559 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/nsh 2023-12-05T09:28:38.559 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/nsh/nsh.ko 2023-12-05T09:28:38.559 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/openvswitch 2023-12-05T09:28:38.559 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/openvswitch/openvswitch.ko 2023-12-05T09:28:38.559 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/openvswitch/vport-geneve.ko 2023-12-05T09:28:38.559 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/openvswitch/vport-gre.ko 2023-12-05T09:28:38.560 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/openvswitch/vport-vxlan.ko 2023-12-05T09:28:38.560 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/packet 2023-12-05T09:28:38.560 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/packet/af_packet_diag.ko 2023-12-05T09:28:38.560 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/rds 2023-12-05T09:28:38.560 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/rds/rds.ko 2023-12-05T09:28:38.560 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/rds/rds_rdma.ko 2023-12-05T09:28:38.560 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/rds/rds_tcp.ko 2023-12-05T09:28:38.560 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched 2023-12-05T09:28:38.560 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/act_csum.ko 2023-12-05T09:28:38.560 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/act_gact.ko 2023-12-05T09:28:38.560 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/act_ipt.ko 2023-12-05T09:28:38.560 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/act_mirred.ko 2023-12-05T09:28:38.560 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/act_nat.ko 2023-12-05T09:28:38.560 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/act_pedit.ko 2023-12-05T09:28:38.560 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/act_police.ko 2023-12-05T09:28:38.560 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/act_simple.ko 2023-12-05T09:28:38.561 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/act_skbedit.ko 2023-12-05T09:28:38.561 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/act_vlan.ko 2023-12-05T09:28:38.561 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/cls_basic.ko 2023-12-05T09:28:38.561 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/cls_bpf.ko 2023-12-05T09:28:38.561 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/cls_flow.ko 2023-12-05T09:28:38.561 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/cls_fw.ko 2023-12-05T09:28:38.561 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/cls_route.ko 2023-12-05T09:28:38.561 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/cls_u32.ko 2023-12-05T09:28:38.561 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/em_cmp.ko 2023-12-05T09:28:38.561 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/em_ipset.ko 2023-12-05T09:28:38.561 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/em_meta.ko 2023-12-05T09:28:38.561 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/em_nbyte.ko 2023-12-05T09:28:38.561 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/em_text.ko 2023-12-05T09:28:38.561 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/em_u32.ko 2023-12-05T09:28:38.562 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_choke.ko 2023-12-05T09:28:38.562 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_codel.ko 2023-12-05T09:28:38.562 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_drr.ko 2023-12-05T09:28:38.562 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_fq.ko 2023-12-05T09:28:38.562 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_gred.ko 2023-12-05T09:28:38.562 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_hfsc.ko 2023-12-05T09:28:38.562 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_hhf.ko 2023-12-05T09:28:38.562 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_htb.ko 2023-12-05T09:28:38.562 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_ingress.ko 2023-12-05T09:28:38.562 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_mqprio.ko 2023-12-05T09:28:38.562 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_mqprio_lib.ko 2023-12-05T09:28:38.562 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_multiq.ko 2023-12-05T09:28:38.562 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_netem.ko 2023-12-05T09:28:38.566 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_pie.ko 2023-12-05T09:28:38.566 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_plug.ko 2023-12-05T09:28:38.566 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_prio.ko 2023-12-05T09:28:38.566 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_qfq.ko 2023-12-05T09:28:38.566 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_red.ko 2023-12-05T09:28:38.566 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_sfb.ko 2023-12-05T09:28:38.566 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_sfq.ko 2023-12-05T09:28:38.566 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_tbf.ko 2023-12-05T09:28:38.567 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_teql.ko 2023-12-05T09:28:38.567 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sctp 2023-12-05T09:28:38.567 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sctp/sctp.ko 2023-12-05T09:28:38.567 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sctp/sctp_diag.ko 2023-12-05T09:28:38.567 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sunrpc 2023-12-05T09:28:38.567 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sunrpc/auth_gss 2023-12-05T09:28:38.567 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-12-05T09:28:38.567 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-12-05T09:28:38.567 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sunrpc/sunrpc.ko 2023-12-05T09:28:38.567 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sunrpc/xprtrdma 2023-12-05T09:28:38.567 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-12-05T09:28:38.567 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/tipc 2023-12-05T09:28:38.567 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/tipc/diag.ko 2023-12-05T09:28:38.567 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/tipc/tipc.ko 2023-12-05T09:28:38.567 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/unix 2023-12-05T09:28:38.567 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/unix/unix_diag.ko 2023-12-05T09:28:38.568 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/vmw_vsock 2023-12-05T09:28:38.568 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-12-05T09:28:38.568 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-12-05T09:28:38.568 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/vmw_vsock/vsock.ko 2023-12-05T09:28:38.568 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/vmw_vsock/vsock_diag.ko 2023-12-05T09:28:38.568 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/vmw_vsock/vsock_loopback.ko 2023-12-05T09:28:38.568 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/xfrm 2023-12-05T09:28:38.568 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/xfrm/xfrm_ipcomp.ko 2023-12-05T09:28:38.568 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/security 2023-12-05T09:28:38.568 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/security/keys 2023-12-05T09:28:38.568 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/security/keys/encrypted-keys 2023-12-05T09:28:38.568 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-12-05T09:28:38.568 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/security/keys/trusted-keys 2023-12-05T09:28:38.568 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/security/keys/trusted-keys/trusted.ko 2023-12-05T09:28:38.568 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/virt 2023-12-05T09:28:38.568 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/virt/lib 2023-12-05T09:28:38.569 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/virt/lib/irqbypass.ko 2023-12-05T09:28:38.569 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/modules.alias 2023-12-05T09:28:38.569 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/modules.alias.bin 2023-12-05T09:28:38.569 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/modules.builtin 2023-12-05T09:28:38.569 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/modules.builtin.bin 2023-12-05T09:28:38.569 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/modules.builtin.modinfo 2023-12-05T09:28:38.569 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/modules.dep 2023-12-05T09:28:38.569 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/modules.dep.bin 2023-12-05T09:28:38.569 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/modules.devname 2023-12-05T09:28:38.569 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/modules.order 2023-12-05T09:28:38.569 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/modules.softdep 2023-12-05T09:28:38.569 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/modules.symbols 2023-12-05T09:28:38.569 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-g9471594ae3a4/modules.symbols.bin 2023-12-05T09:28:38.570 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-g9471594ae3a4 2023-12-05T09:28:38.570 DEBUG:teuthology.orchestra.run.smithi100:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-12-05T09:28:38.594 INFO:teuthology.orchestra.run.smithi100.stdout:postinstall scriptlet (using /bin/sh): 2023-12-05T09:28:38.594 INFO:teuthology.orchestra.run.smithi100.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-g9471594ae3a4 -a -r /boot/System.map-6.6.0-g9471594ae3a4 ]; then 2023-12-05T09:28:38.595 INFO:teuthology.orchestra.run.smithi100.stdout:cp /boot/vmlinuz-6.6.0-g9471594ae3a4 /boot/.vmlinuz-6.6.0-g9471594ae3a4-rpm 2023-12-05T09:28:38.595 INFO:teuthology.orchestra.run.smithi100.stdout:cp /boot/System.map-6.6.0-g9471594ae3a4 /boot/.System.map-6.6.0-g9471594ae3a4-rpm 2023-12-05T09:28:38.595 INFO:teuthology.orchestra.run.smithi100.stdout:rm -f /boot/vmlinuz-6.6.0-g9471594ae3a4 /boot/System.map-6.6.0-g9471594ae3a4 2023-12-05T09:28:38.595 INFO:teuthology.orchestra.run.smithi100.stdout:/sbin/installkernel 6.6.0-g9471594ae3a4 /boot/.vmlinuz-6.6.0-g9471594ae3a4-rpm /boot/.System.map-6.6.0-g9471594ae3a4-rpm 2023-12-05T09:28:38.595 INFO:teuthology.orchestra.run.smithi100.stdout:rm -f /boot/.vmlinuz-6.6.0-g9471594ae3a4-rpm /boot/.System.map-6.6.0-g9471594ae3a4-rpm 2023-12-05T09:28:38.595 INFO:teuthology.orchestra.run.smithi100.stdout:fi 2023-12-05T09:28:38.595 INFO:teuthology.orchestra.run.smithi100.stdout:preuninstall scriptlet (using /bin/sh): 2023-12-05T09:28:38.595 INFO:teuthology.orchestra.run.smithi100.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-12-05T09:28:38.595 INFO:teuthology.orchestra.run.smithi100.stdout:new-kernel-pkg --remove 6.6.0-g9471594ae3a4 --rminitrd --initrdfile=/boot/initramfs-6.6.0-g9471594ae3a4.img 2023-12-05T09:28:38.595 INFO:teuthology.orchestra.run.smithi100.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-12-05T09:28:38.595 INFO:teuthology.orchestra.run.smithi100.stdout:kernel-install remove 6.6.0-g9471594ae3a4 2023-12-05T09:28:38.595 INFO:teuthology.orchestra.run.smithi100.stdout:fi 2023-12-05T09:28:38.595 INFO:teuthology.orchestra.run.smithi100.stdout:postuninstall scriptlet (using /bin/sh): 2023-12-05T09:28:38.595 INFO:teuthology.orchestra.run.smithi100.stdout:if [ -x /sbin/update-bootloader ]; then 2023-12-05T09:28:38.595 INFO:teuthology.orchestra.run.smithi100.stdout:/sbin/update-bootloader --remove 6.6.0-g9471594ae3a4 2023-12-05T09:28:38.596 INFO:teuthology.orchestra.run.smithi100.stdout:fi 2023-12-05T09:28:38.596 DEBUG:teuthology.orchestra.run.smithi100:> sudo rpm -qi grub2-tools 2023-12-05T09:28:38.671 INFO:teuthology.orchestra.run.smithi100.stdout:Name : grub2-tools 2023-12-05T09:28:38.672 INFO:teuthology.orchestra.run.smithi100.stdout:Epoch : 1 2023-12-05T09:28:38.672 INFO:teuthology.orchestra.run.smithi100.stdout:Version : 2.02 2023-12-05T09:28:38.672 INFO:teuthology.orchestra.run.smithi100.stdout:Release : 129.el8 2023-12-05T09:28:38.672 INFO:teuthology.orchestra.run.smithi100.stdout:Architecture: x86_64 2023-12-05T09:28:38.672 INFO:teuthology.orchestra.run.smithi100.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-12-05T09:28:38.672 INFO:teuthology.orchestra.run.smithi100.stdout:Group : System Environment/Base 2023-12-05T09:28:38.672 INFO:teuthology.orchestra.run.smithi100.stdout:Size : 9265586 2023-12-05T09:28:38.672 INFO:teuthology.orchestra.run.smithi100.stdout:License : GPLv3+ 2023-12-05T09:28:38.672 INFO:teuthology.orchestra.run.smithi100.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-12-05T09:28:38.672 INFO:teuthology.orchestra.run.smithi100.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-12-05T09:28:38.672 INFO:teuthology.orchestra.run.smithi100.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-12-05T09:28:38.672 INFO:teuthology.orchestra.run.smithi100.stdout:Build Host : kbuilder.bsys.centos.org 2023-12-05T09:28:38.672 INFO:teuthology.orchestra.run.smithi100.stdout:Relocations : (not relocatable) 2023-12-05T09:28:38.672 INFO:teuthology.orchestra.run.smithi100.stdout:Packager : CentOS BuildSystem 2023-12-05T09:28:38.672 INFO:teuthology.orchestra.run.smithi100.stdout:Vendor : CentOS 2023-12-05T09:28:38.673 INFO:teuthology.orchestra.run.smithi100.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-05T09:28:38.673 INFO:teuthology.orchestra.run.smithi100.stdout:Summary : Support tools for GRUB. 2023-12-05T09:28:38.673 INFO:teuthology.orchestra.run.smithi100.stdout:Description : 2023-12-05T09:28:38.673 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:28:38.673 INFO:teuthology.orchestra.run.smithi100.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-05T09:28:38.673 INFO:teuthology.orchestra.run.smithi100.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-05T09:28:38.673 INFO:teuthology.orchestra.run.smithi100.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-05T09:28:38.673 INFO:teuthology.orchestra.run.smithi100.stdout:hardware devices. 2023-12-05T09:28:38.673 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:28:38.673 INFO:teuthology.orchestra.run.smithi100.stdout:This subpackage provides tools for support of all platforms. 2023-12-05T09:28:38.674 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-05T09:28:38.674 INFO:teuthology.task.kernel:Updating grub on smithi100 to boot 6.6.0-g9471594ae3a4 2023-12-05T09:28:38.674 DEBUG:teuthology.orchestra.run.smithi100:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-05T09:28:44.084 INFO:teuthology.orchestra.run.smithi100.stderr:Generating grub configuration file ... 2023-12-05T09:28:45.381 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05 09:28:45 URL:https://2.chacra.ceph.com/r/kernel/testing/9471594ae3a4c6992c4327df9a789df8f2b6aeae/centos/8/flavors/default/x86_64/kernel-6.6.0_g9471594ae3a4-1.x86_64.rpm [383178600/383178600] -> "/tmp/kernel.x86_64.rpm" [1] 2023-12-05T09:28:45.381 INFO:teuthology.orchestra.run.smithi150.stderr:FINISHED --2023-12-05 09:28:45-- 2023-12-05T09:28:45.382 INFO:teuthology.orchestra.run.smithi150.stderr:Total wall clock time: 1m 28s 2023-12-05T09:28:45.382 INFO:teuthology.orchestra.run.smithi150.stderr:Downloaded: 1 files, 365M in 1m 28s (4.17 MB/s) 2023-12-05T09:28:45.383 INFO:teuthology.task.kernel:Installing kernel 9471594ae3a4c6992c4327df9a789df8f2b6aeae on host.b... 2023-12-05T09:28:45.383 DEBUG:teuthology.orchestra.run.smithi150:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-12-05T09:28:46.343 INFO:teuthology.orchestra.run.smithi100.stderr:done 2023-12-05T09:28:46.347 DEBUG:teuthology.orchestra.run.smithi100:> mktemp 2023-12-05T09:28:46.385 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/tmp.bx8RGZ3f3a 2023-12-05T09:28:46.385 DEBUG:teuthology.orchestra.run.smithi100:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.bx8RGZ3f3a 2023-12-05T09:28:46.481 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 0666 /tmp/tmp.bx8RGZ3f3a 2023-12-05T09:28:46.586 DEBUG:teuthology.orchestra.remote:smithi100:/tmp/tmp.bx8RGZ3f3a is 6KB 2023-12-05T09:28:46.635 DEBUG:teuthology.orchestra.run.smithi100:> rm -fr /tmp/tmp.bx8RGZ3f3a 2023-12-05T09:28:46.653 DEBUG:teuthology.orchestra.run.smithi100:> sudo /bin/ls /boot/loader/entries || true 2023-12-05T09:28:46.731 INFO:teuthology.orchestra.run.smithi100.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-12-05T09:28:46.731 INFO:teuthology.orchestra.run.smithi100.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-12-05T09:28:46.731 INFO:teuthology.orchestra.run.smithi100.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-12-05T09:28:46.731 INFO:teuthology.orchestra.run.smithi100.stdout:a1b29d6c289747bdb22930598d39874a-6.6.0-g9471594ae3a4.conf 2023-12-05T09:28:46.732 DEBUG:teuthology.orchestra.run.smithi100:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-6.6.0-g9471594ae3a4 2023-12-05T09:28:46.891 DEBUG:teuthology.orchestra.run.smithi100:> sudo shutdown -r now 2023-12-05T09:28:47.058 INFO:teuthology.orchestra.run.smithi150.stdout:Verifying... ######################################## 2023-12-05T09:28:47.102 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing... ######################################## 2023-12-05T09:28:47.211 INFO:teuthology.orchestra.run.smithi150.stdout:Updating / installing... 2023-12-05T09:29:16.894 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2023-12-05T09:29:16.895 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2023-12-05T09:29:16.896 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T09:29:25.360 INFO:teuthology.orchestra.run.smithi150.stdout:kernel-6.6.0_g9471594ae3a4-1 ######################################## 2023-12-05T09:29:30.152 INFO:teuthology.orchestra.run.smithi150.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-12-05T09:29:49.338 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi150.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-12-05T09:29:49.338 DEBUG:teuthology.orchestra.run.smithi150:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-12-05T09:29:49.397 INFO:teuthology.orchestra.run.smithi150.stdout:/boot/System.map-6.6.0-g9471594ae3a4 2023-12-05T09:29:49.397 INFO:teuthology.orchestra.run.smithi150.stdout:/boot/config-6.6.0-g9471594ae3a4 2023-12-05T09:29:49.397 INFO:teuthology.orchestra.run.smithi150.stdout:/boot/vmlinuz-6.6.0-g9471594ae3a4 2023-12-05T09:29:49.397 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4 2023-12-05T09:29:49.397 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel 2023-12-05T09:29:49.397 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch 2023-12-05T09:29:49.397 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86 2023-12-05T09:29:49.397 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto 2023-12-05T09:29:49.397 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-12-05T09:29:49.398 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-12-05T09:29:49.398 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-12-05T09:29:49.398 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-12-05T09:29:49.398 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-12-05T09:29:49.398 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-12-05T09:29:49.398 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-12-05T09:29:49.398 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/crc32c-intel.ko 2023-12-05T09:29:49.398 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-12-05T09:29:49.398 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-12-05T09:29:49.398 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-12-05T09:29:49.398 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-12-05T09:29:49.398 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/serpent-avx2.ko 2023-12-05T09:29:49.398 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-12-05T09:29:49.398 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-12-05T09:29:49.399 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-12-05T09:29:49.399 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-12-05T09:29:49.399 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-12-05T09:29:49.403 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-12-05T09:29:49.403 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-12-05T09:29:49.403 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/kernel 2023-12-05T09:29:49.403 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/kernel/cpu 2023-12-05T09:29:49.403 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/kernel/cpu/mce 2023-12-05T09:29:49.403 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-12-05T09:29:49.403 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/kvm 2023-12-05T09:29:49.403 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/kvm/kvm-amd.ko 2023-12-05T09:29:49.404 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/kvm/kvm-intel.ko 2023-12-05T09:29:49.404 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/kvm/kvm.ko 2023-12-05T09:29:49.404 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto 2023-12-05T09:29:49.404 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/ansi_cprng.ko 2023-12-05T09:29:49.404 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/anubis.ko 2023-12-05T09:29:49.404 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/arc4.ko 2023-12-05T09:29:49.404 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/async_tx 2023-12-05T09:29:49.404 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/async_tx/async_memcpy.ko 2023-12-05T09:29:49.404 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/async_tx/async_pq.ko 2023-12-05T09:29:49.404 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/async_tx/async_raid6_recov.ko 2023-12-05T09:29:49.404 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/async_tx/async_tx.ko 2023-12-05T09:29:49.404 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/async_tx/async_xor.ko 2023-12-05T09:29:49.404 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/async_tx/raid6test.ko 2023-12-05T09:29:49.405 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/authenc.ko 2023-12-05T09:29:49.405 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/authencesn.ko 2023-12-05T09:29:49.405 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/blake2b_generic.ko 2023-12-05T09:29:49.405 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/blowfish_common.ko 2023-12-05T09:29:49.405 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/blowfish_generic.ko 2023-12-05T09:29:49.405 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/camellia_generic.ko 2023-12-05T09:29:49.405 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/cast5_generic.ko 2023-12-05T09:29:49.405 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/cast6_generic.ko 2023-12-05T09:29:49.405 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/cast_common.ko 2023-12-05T09:29:49.405 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/ccm.ko 2023-12-05T09:29:49.405 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/cmac.ko 2023-12-05T09:29:49.405 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/crc32_generic.ko 2023-12-05T09:29:49.405 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/crypto_engine.ko 2023-12-05T09:29:49.405 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/crypto_user.ko 2023-12-05T09:29:49.405 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/cts.ko 2023-12-05T09:29:49.406 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/des_generic.ko 2023-12-05T09:29:49.406 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/dh_generic.ko 2023-12-05T09:29:49.406 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/echainiv.ko 2023-12-05T09:29:49.406 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/essiv.ko 2023-12-05T09:29:49.406 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/fcrypt.ko 2023-12-05T09:29:49.406 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/khazad.ko 2023-12-05T09:29:49.406 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/lz4.ko 2023-12-05T09:29:49.406 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/lz4hc.ko 2023-12-05T09:29:49.406 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/md4.ko 2023-12-05T09:29:49.406 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/michael_mic.ko 2023-12-05T09:29:49.406 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/pcbc.ko 2023-12-05T09:29:49.406 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/pcrypt.ko 2023-12-05T09:29:49.406 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/rmd160.ko 2023-12-05T09:29:49.406 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/seed.ko 2023-12-05T09:29:49.407 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/serpent_generic.ko 2023-12-05T09:29:49.407 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/tcrypt.ko 2023-12-05T09:29:49.407 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/tea.ko 2023-12-05T09:29:49.407 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/twofish_common.ko 2023-12-05T09:29:49.407 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/twofish_generic.ko 2023-12-05T09:29:49.407 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/vmac.ko 2023-12-05T09:29:49.407 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/wp512.ko 2023-12-05T09:29:49.407 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/xcbc.ko 2023-12-05T09:29:49.407 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/xor.ko 2023-12-05T09:29:49.407 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/xxhash_generic.ko 2023-12-05T09:29:49.407 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers 2023-12-05T09:29:49.407 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/acpi 2023-12-05T09:29:49.407 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/acpi/acpi_ipmi.ko 2023-12-05T09:29:49.407 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/acpi/acpi_pad.ko 2023-12-05T09:29:49.407 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/acpi/custom_method.ko 2023-12-05T09:29:49.408 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/acpi/ec_sys.ko 2023-12-05T09:29:49.408 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/acpi/platform_profile.ko 2023-12-05T09:29:49.408 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/acpi/sbs.ko 2023-12-05T09:29:49.408 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/acpi/sbshc.ko 2023-12-05T09:29:49.408 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/acpi/video.ko 2023-12-05T09:29:49.408 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata 2023-12-05T09:29:49.408 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/acard-ahci.ko 2023-12-05T09:29:49.408 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/ahci_platform.ko 2023-12-05T09:29:49.408 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/ata_generic.ko 2023-12-05T09:29:49.408 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/libahci_platform.ko 2023-12-05T09:29:49.408 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_acpi.ko 2023-12-05T09:29:49.408 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_ali.ko 2023-12-05T09:29:49.408 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_amd.ko 2023-12-05T09:29:49.408 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_artop.ko 2023-12-05T09:29:49.408 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_atiixp.ko 2023-12-05T09:29:49.409 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_atp867x.ko 2023-12-05T09:29:49.409 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_cmd640.ko 2023-12-05T09:29:49.409 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_cmd64x.ko 2023-12-05T09:29:49.409 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_cypress.ko 2023-12-05T09:29:49.409 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_efar.ko 2023-12-05T09:29:49.409 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_hpt366.ko 2023-12-05T09:29:49.409 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_hpt37x.ko 2023-12-05T09:29:49.409 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_hpt3x2n.ko 2023-12-05T09:29:49.409 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_hpt3x3.ko 2023-12-05T09:29:49.409 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_it8213.ko 2023-12-05T09:29:49.409 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_it821x.ko 2023-12-05T09:29:49.409 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_jmicron.ko 2023-12-05T09:29:49.409 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_marvell.ko 2023-12-05T09:29:49.409 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_mpiix.ko 2023-12-05T09:29:49.409 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_netcell.ko 2023-12-05T09:29:49.409 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_ninja32.ko 2023-12-05T09:29:49.410 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_ns87410.ko 2023-12-05T09:29:49.410 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_ns87415.ko 2023-12-05T09:29:49.410 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_oldpiix.ko 2023-12-05T09:29:49.410 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_opti.ko 2023-12-05T09:29:49.410 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_optidma.ko 2023-12-05T09:29:49.410 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_pcmcia.ko 2023-12-05T09:29:49.410 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_pdc2027x.ko 2023-12-05T09:29:49.410 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-12-05T09:29:49.410 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_piccolo.ko 2023-12-05T09:29:49.410 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_rdc.ko 2023-12-05T09:29:49.410 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_sch.ko 2023-12-05T09:29:49.410 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_serverworks.ko 2023-12-05T09:29:49.410 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_sil680.ko 2023-12-05T09:29:49.411 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_sis.ko 2023-12-05T09:29:49.411 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_sl82c105.ko 2023-12-05T09:29:49.411 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_triflex.ko 2023-12-05T09:29:49.411 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_via.ko 2023-12-05T09:29:49.411 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pdc_adma.ko 2023-12-05T09:29:49.411 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_inic162x.ko 2023-12-05T09:29:49.411 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_mv.ko 2023-12-05T09:29:49.411 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_nv.ko 2023-12-05T09:29:49.411 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_promise.ko 2023-12-05T09:29:49.411 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_qstor.ko 2023-12-05T09:29:49.411 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_sil.ko 2023-12-05T09:29:49.411 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_sil24.ko 2023-12-05T09:29:49.411 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_sis.ko 2023-12-05T09:29:49.411 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_svw.ko 2023-12-05T09:29:49.411 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_sx4.ko 2023-12-05T09:29:49.412 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_uli.ko 2023-12-05T09:29:49.412 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_via.ko 2023-12-05T09:29:49.412 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_vsc.ko 2023-12-05T09:29:49.412 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/auxdisplay 2023-12-05T09:29:49.412 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/auxdisplay/ks0108.ko 2023-12-05T09:29:49.412 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/base 2023-12-05T09:29:49.412 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/base/regmap 2023-12-05T09:29:49.412 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/base/regmap/regmap-i2c.ko 2023-12-05T09:29:49.412 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/base/regmap/regmap-mmio.ko 2023-12-05T09:29:49.412 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/bcma 2023-12-05T09:29:49.412 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/bcma/bcma.ko 2023-12-05T09:29:49.412 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block 2023-12-05T09:29:49.412 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/aoe 2023-12-05T09:29:49.412 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/aoe/aoe.ko 2023-12-05T09:29:49.413 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/brd.ko 2023-12-05T09:29:49.413 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/drbd 2023-12-05T09:29:49.413 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/drbd/drbd.ko 2023-12-05T09:29:49.413 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/floppy.ko 2023-12-05T09:29:49.413 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/loop.ko 2023-12-05T09:29:49.413 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/mtip32xx 2023-12-05T09:29:49.413 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-12-05T09:29:49.413 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/nbd.ko 2023-12-05T09:29:49.413 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/null_blk 2023-12-05T09:29:49.413 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/null_blk/null_blk.ko 2023-12-05T09:29:49.413 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/pktcdvd.ko 2023-12-05T09:29:49.413 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/rbd.ko 2023-12-05T09:29:49.413 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/virtio_blk.ko 2023-12-05T09:29:49.413 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/xen-blkback 2023-12-05T09:29:49.413 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-12-05T09:29:49.414 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/xen-blkfront.ko 2023-12-05T09:29:49.414 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/zram 2023-12-05T09:29:49.414 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/zram/zram.ko 2023-12-05T09:29:49.414 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char 2023-12-05T09:29:49.414 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/hangcheck-timer.ko 2023-12-05T09:29:49.414 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/hw_random 2023-12-05T09:29:49.414 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/hw_random/amd-rng.ko 2023-12-05T09:29:49.414 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/hw_random/intel-rng.ko 2023-12-05T09:29:49.414 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-12-05T09:29:49.414 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/hw_random/via-rng.ko 2023-12-05T09:29:49.414 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/hw_random/virtio-rng.ko 2023-12-05T09:29:49.414 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/ipmi 2023-12-05T09:29:49.414 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-12-05T09:29:49.415 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-12-05T09:29:49.415 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-12-05T09:29:49.415 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/ipmi/ipmi_si.ko 2023-12-05T09:29:49.415 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-12-05T09:29:49.415 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-12-05T09:29:49.415 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/lp.ko 2023-12-05T09:29:49.415 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/mwave 2023-12-05T09:29:49.415 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/mwave/mwave.ko 2023-12-05T09:29:49.415 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/ppdev.ko 2023-12-05T09:29:49.415 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/tlclk.ko 2023-12-05T09:29:49.415 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/tpm 2023-12-05T09:29:49.415 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/tpm/tpm.ko 2023-12-05T09:29:49.415 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/tpm/tpm_atmel.ko 2023-12-05T09:29:49.415 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/tpm/tpm_infineon.ko 2023-12-05T09:29:49.415 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/tpm/tpm_nsc.ko 2023-12-05T09:29:49.416 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/tpm/tpm_tis.ko 2023-12-05T09:29:49.416 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-12-05T09:29:49.416 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/uv_mmtimer.ko 2023-12-05T09:29:49.416 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/virtio_console.ko 2023-12-05T09:29:49.416 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/cpufreq 2023-12-05T09:29:49.416 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-12-05T09:29:49.416 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-12-05T09:29:49.416 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/cpufreq/p4-clockmod.ko 2023-12-05T09:29:49.416 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-12-05T09:29:49.416 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/cpufreq/powernow-k8.ko 2023-12-05T09:29:49.416 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/cpufreq/speedstep-lib.ko 2023-12-05T09:29:49.416 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto 2023-12-05T09:29:49.416 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/ccp 2023-12-05T09:29:49.416 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-12-05T09:29:49.416 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/ccp/ccp.ko 2023-12-05T09:29:49.417 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/intel 2023-12-05T09:29:49.417 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/intel/qat 2023-12-05T09:29:49.417 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/intel/qat/qat_common 2023-12-05T09:29:49.417 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-12-05T09:29:49.417 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-12-05T09:29:49.417 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-12-05T09:29:49.417 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/padlock-aes.ko 2023-12-05T09:29:49.417 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/padlock-sha.ko 2023-12-05T09:29:49.417 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/virtio 2023-12-05T09:29:49.417 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-12-05T09:29:49.417 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/dca 2023-12-05T09:29:49.417 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/dca/dca.ko 2023-12-05T09:29:49.417 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/devfreq 2023-12-05T09:29:49.417 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-12-05T09:29:49.417 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/dma 2023-12-05T09:29:49.418 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/dma/dw 2023-12-05T09:29:49.418 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/dma/dw/dw_dmac.ko 2023-12-05T09:29:49.418 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/dma/ioat 2023-12-05T09:29:49.418 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/dma/ioat/ioatdma.ko 2023-12-05T09:29:49.418 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac 2023-12-05T09:29:49.418 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/amd64_edac.ko 2023-12-05T09:29:49.418 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/e752x_edac.ko 2023-12-05T09:29:49.418 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/edac_mce_amd.ko 2023-12-05T09:29:49.418 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/i3000_edac.ko 2023-12-05T09:29:49.418 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/i3200_edac.ko 2023-12-05T09:29:49.418 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/i5100_edac.ko 2023-12-05T09:29:49.418 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/i5400_edac.ko 2023-12-05T09:29:49.418 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/i7300_edac.ko 2023-12-05T09:29:49.418 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/i7core_edac.ko 2023-12-05T09:29:49.419 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/i82975x_edac.ko 2023-12-05T09:29:49.419 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/ie31200_edac.ko 2023-12-05T09:29:49.419 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/sb_edac.ko 2023-12-05T09:29:49.419 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/x38_edac.ko 2023-12-05T09:29:49.419 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/firmware 2023-12-05T09:29:49.419 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/firmware/edd.ko 2023-12-05T09:29:49.419 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/firmware/iscsi_ibft.ko 2023-12-05T09:29:49.419 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/gpio 2023-12-05T09:29:49.419 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/gpio/gpio-ich.ko 2023-12-05T09:29:49.419 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/gpio/gpio-viperboard.ko 2023-12-05T09:29:49.419 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid 2023-12-05T09:29:49.419 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-appleir.ko 2023-12-05T09:29:49.419 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-aureal.ko 2023-12-05T09:29:49.419 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-axff.ko 2023-12-05T09:29:49.420 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-dr.ko 2023-12-05T09:29:49.420 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-elecom.ko 2023-12-05T09:29:49.420 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-elo.ko 2023-12-05T09:29:49.420 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-emsff.ko 2023-12-05T09:29:49.420 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-gaff.ko 2023-12-05T09:29:49.420 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-gt683r.ko 2023-12-05T09:29:49.420 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-gyration.ko 2023-12-05T09:29:49.420 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-holtek-kbd.ko 2023-12-05T09:29:49.420 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-holtek-mouse.ko 2023-12-05T09:29:49.420 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-holtekff.ko 2023-12-05T09:29:49.420 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-hyperv.ko 2023-12-05T09:29:49.420 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-icade.ko 2023-12-05T09:29:49.420 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-keytouch.ko 2023-12-05T09:29:49.420 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-kye.ko 2023-12-05T09:29:49.420 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-lcpower.ko 2023-12-05T09:29:49.421 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-led.ko 2023-12-05T09:29:49.421 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-lenovo.ko 2023-12-05T09:29:49.421 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-logitech-dj.ko 2023-12-05T09:29:49.421 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-12-05T09:29:49.421 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-multitouch.ko 2023-12-05T09:29:49.421 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-ortek.ko 2023-12-05T09:29:49.421 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-penmount.ko 2023-12-05T09:29:49.421 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-petalynx.ko 2023-12-05T09:29:49.421 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-picolcd.ko 2023-12-05T09:29:49.421 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-pl.ko 2023-12-05T09:29:49.421 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-plantronics.ko 2023-12-05T09:29:49.421 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-primax.ko 2023-12-05T09:29:49.422 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-rmi.ko 2023-12-05T09:29:49.422 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-roccat-arvo.ko 2023-12-05T09:29:49.422 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-roccat-common.ko 2023-12-05T09:29:49.422 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-roccat-isku.ko 2023-12-05T09:29:49.422 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-roccat-kone.ko 2023-12-05T09:29:49.422 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-12-05T09:29:49.422 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-roccat-konepure.ko 2023-12-05T09:29:49.422 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-12-05T09:29:49.422 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-roccat-lua.ko 2023-12-05T09:29:49.422 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-roccat-pyra.ko 2023-12-05T09:29:49.422 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-roccat-ryos.ko 2023-12-05T09:29:49.422 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-roccat-savu.ko 2023-12-05T09:29:49.422 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-roccat.ko 2023-12-05T09:29:49.422 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-saitek.ko 2023-12-05T09:29:49.423 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-samsung.ko 2023-12-05T09:29:49.423 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-sensor-hub.ko 2023-12-05T09:29:49.423 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-sjoy.ko 2023-12-05T09:29:49.423 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-sony.ko 2023-12-05T09:29:49.423 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-speedlink.ko 2023-12-05T09:29:49.423 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-steelseries.ko 2023-12-05T09:29:49.423 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-sunplus.ko 2023-12-05T09:29:49.423 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-thrustmaster.ko 2023-12-05T09:29:49.423 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-tivo.ko 2023-12-05T09:29:49.423 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-tmff.ko 2023-12-05T09:29:49.423 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-topseed.ko 2023-12-05T09:29:49.424 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-twinhan.ko 2023-12-05T09:29:49.424 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-uclogic.ko 2023-12-05T09:29:49.424 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-waltop.ko 2023-12-05T09:29:49.424 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-wiimote.ko 2023-12-05T09:29:49.424 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-xinmo.ko 2023-12-05T09:29:49.424 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-zpff.ko 2023-12-05T09:29:49.424 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-zydacron.ko 2023-12-05T09:29:49.424 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/uhid.ko 2023-12-05T09:29:49.424 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/wacom.ko 2023-12-05T09:29:49.424 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hv 2023-12-05T09:29:49.424 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hv/hv_balloon.ko 2023-12-05T09:29:49.424 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hv/hv_utils.ko 2023-12-05T09:29:49.424 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hv/hv_vmbus.ko 2023-12-05T09:29:49.424 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon 2023-12-05T09:29:49.424 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/abituguru.ko 2023-12-05T09:29:49.425 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/abituguru3.ko 2023-12-05T09:29:49.425 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/acpi_power_meter.ko 2023-12-05T09:29:49.425 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ad7414.ko 2023-12-05T09:29:49.425 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ad7418.ko 2023-12-05T09:29:49.425 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/adc128d818.ko 2023-12-05T09:29:49.425 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/adm1025.ko 2023-12-05T09:29:49.425 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/adm1026.ko 2023-12-05T09:29:49.425 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/adm1029.ko 2023-12-05T09:29:49.425 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/adm1031.ko 2023-12-05T09:29:49.425 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/adm9240.ko 2023-12-05T09:29:49.425 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ads7828.ko 2023-12-05T09:29:49.425 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/adt7410.ko 2023-12-05T09:29:49.425 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/adt7411.ko 2023-12-05T09:29:49.425 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/adt7462.ko 2023-12-05T09:29:49.425 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/adt7470.ko 2023-12-05T09:29:49.426 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/adt7475.ko 2023-12-05T09:29:49.426 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/adt7x10.ko 2023-12-05T09:29:49.426 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/amc6821.ko 2023-12-05T09:29:49.426 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/applesmc.ko 2023-12-05T09:29:49.426 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/asb100.ko 2023-12-05T09:29:49.426 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/asc7621.ko 2023-12-05T09:29:49.426 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/asus_atk0110.ko 2023-12-05T09:29:49.426 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/atxp1.ko 2023-12-05T09:29:49.426 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/coretemp.ko 2023-12-05T09:29:49.426 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-12-05T09:29:49.426 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/dme1737.ko 2023-12-05T09:29:49.426 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ds1621.ko 2023-12-05T09:29:49.426 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ds620.ko 2023-12-05T09:29:49.426 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/emc1403.ko 2023-12-05T09:29:49.427 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/emc6w201.ko 2023-12-05T09:29:49.427 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/f71805f.ko 2023-12-05T09:29:49.427 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/f71882fg.ko 2023-12-05T09:29:49.427 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/f75375s.ko 2023-12-05T09:29:49.427 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/fam15h_power.ko 2023-12-05T09:29:49.427 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/fschmd.ko 2023-12-05T09:29:49.427 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/g760a.ko 2023-12-05T09:29:49.427 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/g762.ko 2023-12-05T09:29:49.427 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/gl518sm.ko 2023-12-05T09:29:49.427 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/gl520sm.ko 2023-12-05T09:29:49.427 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/hwmon-vid.ko 2023-12-05T09:29:49.427 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/i5500_temp.ko 2023-12-05T09:29:49.428 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/i5k_amb.ko 2023-12-05T09:29:49.428 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ibmaem.ko 2023-12-05T09:29:49.428 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ibmpex.ko 2023-12-05T09:29:49.428 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ina209.ko 2023-12-05T09:29:49.428 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ina2xx.ko 2023-12-05T09:29:49.428 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/it87.ko 2023-12-05T09:29:49.428 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/k10temp.ko 2023-12-05T09:29:49.428 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/k8temp.ko 2023-12-05T09:29:49.428 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lineage-pem.ko 2023-12-05T09:29:49.428 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm63.ko 2023-12-05T09:29:49.429 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm73.ko 2023-12-05T09:29:49.429 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm75.ko 2023-12-05T09:29:49.429 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm77.ko 2023-12-05T09:29:49.429 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm78.ko 2023-12-05T09:29:49.429 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm80.ko 2023-12-05T09:29:49.429 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm83.ko 2023-12-05T09:29:49.429 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm85.ko 2023-12-05T09:29:49.429 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm87.ko 2023-12-05T09:29:49.429 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm90.ko 2023-12-05T09:29:49.429 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm92.ko 2023-12-05T09:29:49.429 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm93.ko 2023-12-05T09:29:49.429 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm95234.ko 2023-12-05T09:29:49.430 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm95241.ko 2023-12-05T09:29:49.430 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm95245.ko 2023-12-05T09:29:49.430 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ltc2945.ko 2023-12-05T09:29:49.430 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ltc4151.ko 2023-12-05T09:29:49.430 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ltc4215.ko 2023-12-05T09:29:49.430 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ltc4222.ko 2023-12-05T09:29:49.430 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ltc4245.ko 2023-12-05T09:29:49.430 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ltc4260.ko 2023-12-05T09:29:49.430 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ltc4261.ko 2023-12-05T09:29:49.430 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/max16065.ko 2023-12-05T09:29:49.430 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/max1619.ko 2023-12-05T09:29:49.430 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/max1668.ko 2023-12-05T09:29:49.430 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/max197.ko 2023-12-05T09:29:49.430 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/max6639.ko 2023-12-05T09:29:49.430 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/max6650.ko 2023-12-05T09:29:49.431 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/max6697.ko 2023-12-05T09:29:49.431 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/mcp3021.ko 2023-12-05T09:29:49.431 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/nct6683.ko 2023-12-05T09:29:49.431 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/nct6775-core.ko 2023-12-05T09:29:49.431 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/nct6775.ko 2023-12-05T09:29:49.431 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/nct7802.ko 2023-12-05T09:29:49.431 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pc87360.ko 2023-12-05T09:29:49.431 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pc87427.ko 2023-12-05T09:29:49.431 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pcf8591.ko 2023-12-05T09:29:49.431 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus 2023-12-05T09:29:49.431 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-12-05T09:29:49.431 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-12-05T09:29:49.431 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-12-05T09:29:49.431 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus/max16064.ko 2023-12-05T09:29:49.431 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus/max34440.ko 2023-12-05T09:29:49.432 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus/max8688.ko 2023-12-05T09:29:49.432 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-12-05T09:29:49.432 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-12-05T09:29:49.432 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-12-05T09:29:49.432 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-12-05T09:29:49.432 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-12-05T09:29:49.432 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-12-05T09:29:49.432 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/powr1220.ko 2023-12-05T09:29:49.432 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/sch5627.ko 2023-12-05T09:29:49.432 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/sch5636.ko 2023-12-05T09:29:49.432 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/sch56xx-common.ko 2023-12-05T09:29:49.432 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/sht15.ko 2023-12-05T09:29:49.433 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/sht21.ko 2023-12-05T09:29:49.433 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/shtc1.ko 2023-12-05T09:29:49.433 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/sis5595.ko 2023-12-05T09:29:49.433 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/smsc47b397.ko 2023-12-05T09:29:49.433 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/smsc47m1.ko 2023-12-05T09:29:49.433 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/smsc47m192.ko 2023-12-05T09:29:49.433 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/thmc50.ko 2023-12-05T09:29:49.433 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/tmp102.ko 2023-12-05T09:29:49.433 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/tmp103.ko 2023-12-05T09:29:49.433 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/tmp401.ko 2023-12-05T09:29:49.433 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/tmp421.ko 2023-12-05T09:29:49.433 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/via-cputemp.ko 2023-12-05T09:29:49.433 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/via686a.ko 2023-12-05T09:29:49.433 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/vt1211.ko 2023-12-05T09:29:49.433 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/vt8231.ko 2023-12-05T09:29:49.434 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/w83627ehf.ko 2023-12-05T09:29:49.434 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/w83627hf.ko 2023-12-05T09:29:49.434 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/w83781d.ko 2023-12-05T09:29:49.434 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/w83791d.ko 2023-12-05T09:29:49.434 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/w83792d.ko 2023-12-05T09:29:49.434 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/w83793.ko 2023-12-05T09:29:49.434 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/w83795.ko 2023-12-05T09:29:49.434 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/w83l785ts.ko 2023-12-05T09:29:49.434 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/w83l786ng.ko 2023-12-05T09:29:49.434 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c 2023-12-05T09:29:49.434 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/algos 2023-12-05T09:29:49.434 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-12-05T09:29:49.434 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-12-05T09:29:49.434 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses 2023-12-05T09:29:49.435 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-12-05T09:29:49.435 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-12-05T09:29:49.435 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-12-05T09:29:49.435 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-12-05T09:29:49.435 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-12-05T09:29:49.435 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-12-05T09:29:49.435 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-12-05T09:29:49.435 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-12-05T09:29:49.435 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-i801.ko 2023-12-05T09:29:49.435 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-isch.ko 2023-12-05T09:29:49.435 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-12-05T09:29:49.435 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-12-05T09:29:49.435 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-12-05T09:29:49.436 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-parport.ko 2023-12-05T09:29:49.436 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-12-05T09:29:49.436 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-12-05T09:29:49.436 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-12-05T09:29:49.436 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-12-05T09:29:49.436 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-12-05T09:29:49.436 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-12-05T09:29:49.436 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-via.ko 2023-12-05T09:29:49.436 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-12-05T09:29:49.436 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-12-05T09:29:49.436 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/i2c-dev.ko 2023-12-05T09:29:49.436 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/i2c-mux.ko 2023-12-05T09:29:49.436 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-12-05T09:29:49.436 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/i2c-smbus.ko 2023-12-05T09:29:49.436 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/i2c-stub.ko 2023-12-05T09:29:49.437 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband 2023-12-05T09:29:49.437 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/core 2023-12-05T09:29:49.437 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/core/ib_cm.ko 2023-12-05T09:29:49.437 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/core/ib_core.ko 2023-12-05T09:29:49.437 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/core/ib_umad.ko 2023-12-05T09:29:49.437 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-12-05T09:29:49.437 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/core/iw_cm.ko 2023-12-05T09:29:49.437 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/core/rdma_cm.ko 2023-12-05T09:29:49.437 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-12-05T09:29:49.437 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/hw 2023-12-05T09:29:49.437 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/hw/cxgb4 2023-12-05T09:29:49.437 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-12-05T09:29:49.437 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/hw/mlx4 2023-12-05T09:29:49.437 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-12-05T09:29:49.438 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/hw/mlx5 2023-12-05T09:29:49.438 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-12-05T09:29:49.438 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/hw/mthca 2023-12-05T09:29:49.438 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-12-05T09:29:49.438 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/ulp 2023-12-05T09:29:49.438 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/ulp/ipoib 2023-12-05T09:29:49.438 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-12-05T09:29:49.438 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/ulp/iser 2023-12-05T09:29:49.438 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-12-05T09:29:49.438 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/ulp/isert 2023-12-05T09:29:49.438 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-12-05T09:29:49.438 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/ulp/srp 2023-12-05T09:29:49.438 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-12-05T09:29:49.438 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/ulp/srpt 2023-12-05T09:29:49.438 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-12-05T09:29:49.439 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input 2023-12-05T09:29:49.439 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/gameport 2023-12-05T09:29:49.439 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-12-05T09:29:49.439 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/gameport/fm801-gp.ko 2023-12-05T09:29:49.439 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/gameport/gameport.ko 2023-12-05T09:29:49.439 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/joydev.ko 2023-12-05T09:29:49.439 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/keyboard 2023-12-05T09:29:49.439 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/keyboard/gpio_keys.ko 2023-12-05T09:29:49.439 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/mouse 2023-12-05T09:29:49.439 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/mouse/appletouch.ko 2023-12-05T09:29:49.439 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/mouse/bcm5974.ko 2023-12-05T09:29:49.439 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/mouse/cyapatp.ko 2023-12-05T09:29:49.439 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/mouse/elan_i2c.ko 2023-12-05T09:29:49.439 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/mouse/sermouse.ko 2023-12-05T09:29:49.439 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-12-05T09:29:49.440 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/mouse/synaptics_usb.ko 2023-12-05T09:29:49.440 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/mouse/vsxxxaa.ko 2023-12-05T09:29:49.440 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/rmi4 2023-12-05T09:29:49.440 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/rmi4/rmi_core.ko 2023-12-05T09:29:49.440 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/serio 2023-12-05T09:29:49.440 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/serio/altera_ps2.ko 2023-12-05T09:29:49.440 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/serio/arc_ps2.ko 2023-12-05T09:29:49.440 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-12-05T09:29:49.440 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/serio/serio_raw.ko 2023-12-05T09:29:49.440 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/sparse-keymap.ko 2023-12-05T09:29:49.440 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/iommu 2023-12-05T09:29:49.440 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/iommu/amd 2023-12-05T09:29:49.440 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/iommu/amd/iommu_v2.ko 2023-12-05T09:29:49.440 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds 2023-12-05T09:29:49.440 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/leds-blinkm.ko 2023-12-05T09:29:49.441 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/leds-lm3530.ko 2023-12-05T09:29:49.441 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/leds-lp3944.ko 2023-12-05T09:29:49.441 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/leds-ss4200.ko 2023-12-05T09:29:49.441 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/trigger 2023-12-05T09:29:49.441 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-12-05T09:29:49.441 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-12-05T09:29:49.441 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-12-05T09:29:49.441 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-12-05T09:29:49.441 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-12-05T09:29:49.441 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-12-05T09:29:49.441 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-12-05T09:29:49.441 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-12-05T09:29:49.441 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md 2023-12-05T09:29:49.441 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/bcache 2023-12-05T09:29:49.441 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/bcache/bcache.ko 2023-12-05T09:29:49.441 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-bio-prison.ko 2023-12-05T09:29:49.442 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-cache-smq.ko 2023-12-05T09:29:49.442 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-cache.ko 2023-12-05T09:29:49.442 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-crypt.ko 2023-12-05T09:29:49.442 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-delay.ko 2023-12-05T09:29:49.442 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-flakey.ko 2023-12-05T09:29:49.442 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-log-userspace.ko 2023-12-05T09:29:49.442 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-multipath.ko 2023-12-05T09:29:49.442 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-queue-length.ko 2023-12-05T09:29:49.442 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-raid.ko 2023-12-05T09:29:49.442 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-round-robin.ko 2023-12-05T09:29:49.442 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-service-time.ko 2023-12-05T09:29:49.442 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-switch.ko 2023-12-05T09:29:49.442 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-thin-pool.ko 2023-12-05T09:29:49.442 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-verity.ko 2023-12-05T09:29:49.443 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/faulty.ko 2023-12-05T09:29:49.443 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/linear.ko 2023-12-05T09:29:49.443 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/multipath.ko 2023-12-05T09:29:49.443 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/persistent-data 2023-12-05T09:29:49.443 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-12-05T09:29:49.443 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/raid0.ko 2023-12-05T09:29:49.443 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/raid1.ko 2023-12-05T09:29:49.443 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/raid10.ko 2023-12-05T09:29:49.443 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/raid456.ko 2023-12-05T09:29:49.443 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/message 2023-12-05T09:29:49.443 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/message/fusion 2023-12-05T09:29:49.443 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/message/fusion/mptbase.ko 2023-12-05T09:29:49.443 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/message/fusion/mptctl.ko 2023-12-05T09:29:49.443 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/message/fusion/mptfc.ko 2023-12-05T09:29:49.443 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/message/fusion/mptlan.ko 2023-12-05T09:29:49.443 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/message/fusion/mptsas.ko 2023-12-05T09:29:49.444 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/message/fusion/mptscsih.ko 2023-12-05T09:29:49.444 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/message/fusion/mptspi.ko 2023-12-05T09:29:49.444 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd 2023-12-05T09:29:49.444 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/lpc_ich.ko 2023-12-05T09:29:49.444 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/lpc_sch.ko 2023-12-05T09:29:49.444 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/mfd-core.ko 2023-12-05T09:29:49.444 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/sm501.ko 2023-12-05T09:29:49.444 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/viperboard.ko 2023-12-05T09:29:49.444 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/vx855.ko 2023-12-05T09:29:49.444 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/wl1273-core.ko 2023-12-05T09:29:49.444 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc 2023-12-05T09:29:49.444 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/altera-stapl 2023-12-05T09:29:49.444 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-12-05T09:29:49.444 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/apds9802als.ko 2023-12-05T09:29:49.444 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/apds990x.ko 2023-12-05T09:29:49.445 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/bh1770glc.ko 2023-12-05T09:29:49.445 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/cb710 2023-12-05T09:29:49.445 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/cb710/cb710.ko 2023-12-05T09:29:49.445 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/eeprom 2023-12-05T09:29:49.445 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/eeprom/at24.ko 2023-12-05T09:29:49.445 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/eeprom/eeprom.ko 2023-12-05T09:29:49.445 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-12-05T09:29:49.445 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/eeprom/max6875.ko 2023-12-05T09:29:49.445 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/enclosure.ko 2023-12-05T09:29:49.445 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/hpilo.ko 2023-12-05T09:29:49.445 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/isl29003.ko 2023-12-05T09:29:49.445 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/isl29020.ko 2023-12-05T09:29:49.445 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/lis3lv02d 2023-12-05T09:29:49.445 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-12-05T09:29:49.446 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-12-05T09:29:49.446 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/mei 2023-12-05T09:29:49.446 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/mei/mei-me.ko 2023-12-05T09:29:49.446 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/mei/mei-txe.ko 2023-12-05T09:29:49.446 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/mei/mei.ko 2023-12-05T09:29:49.446 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/sgi-gru 2023-12-05T09:29:49.446 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/sgi-gru/gru.ko 2023-12-05T09:29:49.446 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/sgi-xp 2023-12-05T09:29:49.446 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/sgi-xp/xp.ko 2023-12-05T09:29:49.446 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/sgi-xp/xpc.ko 2023-12-05T09:29:49.446 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-12-05T09:29:49.446 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/tifm_7xx1.ko 2023-12-05T09:29:49.446 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/tifm_core.ko 2023-12-05T09:29:49.446 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/tsl2550.ko 2023-12-05T09:29:49.446 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/vmw_balloon.ko 2023-12-05T09:29:49.447 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/vmw_vmci 2023-12-05T09:29:49.447 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-12-05T09:29:49.447 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net 2023-12-05T09:29:49.447 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/bonding 2023-12-05T09:29:49.447 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/bonding/bonding.ko 2023-12-05T09:29:49.447 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/dsa 2023-12-05T09:29:49.447 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/dsa/b53 2023-12-05T09:29:49.447 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/dsa/b53/b53_common.ko 2023-12-05T09:29:49.447 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/dsa/bcm-sf2.ko 2023-12-05T09:29:49.447 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/dsa/mv88e6060.ko 2023-12-05T09:29:49.447 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/dsa/mv88e6xxx 2023-12-05T09:29:49.447 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-12-05T09:29:49.447 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/dummy.ko 2023-12-05T09:29:49.447 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/eql.ko 2023-12-05T09:29:49.447 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet 2023-12-05T09:29:49.447 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/3com 2023-12-05T09:29:49.448 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-12-05T09:29:49.448 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-12-05T09:29:49.448 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-12-05T09:29:49.448 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-12-05T09:29:49.448 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/8390 2023-12-05T09:29:49.448 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/8390/8390.ko 2023-12-05T09:29:49.448 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-12-05T09:29:49.448 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-12-05T09:29:49.448 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-12-05T09:29:49.448 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/adaptec 2023-12-05T09:29:49.448 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-12-05T09:29:49.448 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/agere 2023-12-05T09:29:49.448 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/agere/et131x.ko 2023-12-05T09:29:49.448 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/alteon 2023-12-05T09:29:49.448 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-12-05T09:29:49.449 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/altera 2023-12-05T09:29:49.449 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-12-05T09:29:49.449 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/amd 2023-12-05T09:29:49.449 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-12-05T09:29:49.449 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-12-05T09:29:49.449 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-12-05T09:29:49.449 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/atheros 2023-12-05T09:29:49.449 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/atheros/alx 2023-12-05T09:29:49.449 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-12-05T09:29:49.449 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/atheros/atl1c 2023-12-05T09:29:49.449 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-12-05T09:29:49.449 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/atheros/atl1e 2023-12-05T09:29:49.449 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-12-05T09:29:49.449 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/atheros/atlx 2023-12-05T09:29:49.449 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-12-05T09:29:49.450 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-12-05T09:29:49.450 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/broadcom 2023-12-05T09:29:49.450 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-12-05T09:29:49.450 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-12-05T09:29:49.450 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-12-05T09:29:49.450 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-12-05T09:29:49.450 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-12-05T09:29:49.450 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/broadcom/genet 2023-12-05T09:29:49.450 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-12-05T09:29:49.450 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-12-05T09:29:49.450 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/brocade 2023-12-05T09:29:49.451 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/brocade/bna 2023-12-05T09:29:49.451 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-12-05T09:29:49.451 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/chelsio 2023-12-05T09:29:49.451 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/chelsio/cxgb 2023-12-05T09:29:49.451 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-12-05T09:29:49.451 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-12-05T09:29:49.451 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-12-05T09:29:49.451 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-12-05T09:29:49.451 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-12-05T09:29:49.451 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-12-05T09:29:49.451 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-12-05T09:29:49.452 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-12-05T09:29:49.452 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-12-05T09:29:49.452 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/cisco 2023-12-05T09:29:49.452 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/cisco/enic 2023-12-05T09:29:49.452 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-12-05T09:29:49.452 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/dec 2023-12-05T09:29:49.452 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/dec/tulip 2023-12-05T09:29:49.452 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-12-05T09:29:49.452 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-12-05T09:29:49.452 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-12-05T09:29:49.452 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-12-05T09:29:49.452 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-12-05T09:29:49.452 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-12-05T09:29:49.452 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/dlink 2023-12-05T09:29:49.452 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-12-05T09:29:49.453 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-12-05T09:29:49.453 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/dnet.ko 2023-12-05T09:29:49.453 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/emulex 2023-12-05T09:29:49.453 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/emulex/benet 2023-12-05T09:29:49.453 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-12-05T09:29:49.453 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/ethoc.ko 2023-12-05T09:29:49.453 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/fealnx.ko 2023-12-05T09:29:49.453 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel 2023-12-05T09:29:49.453 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/e100.ko 2023-12-05T09:29:49.453 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/e1000 2023-12-05T09:29:49.453 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-12-05T09:29:49.453 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/e1000e 2023-12-05T09:29:49.453 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-12-05T09:29:49.453 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/fm10k 2023-12-05T09:29:49.454 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-12-05T09:29:49.454 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/i40e 2023-12-05T09:29:49.454 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-12-05T09:29:49.454 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/iavf 2023-12-05T09:29:49.454 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-12-05T09:29:49.454 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/igb 2023-12-05T09:29:49.454 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-12-05T09:29:49.454 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/igbvf 2023-12-05T09:29:49.454 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-12-05T09:29:49.454 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/ixgbe 2023-12-05T09:29:49.454 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-12-05T09:29:49.454 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/ixgbevf 2023-12-05T09:29:49.454 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-12-05T09:29:49.454 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/jme.ko 2023-12-05T09:29:49.455 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/marvell 2023-12-05T09:29:49.455 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-12-05T09:29:49.455 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/marvell/skge.ko 2023-12-05T09:29:49.455 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-12-05T09:29:49.455 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/mellanox 2023-12-05T09:29:49.455 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/mellanox/mlx4 2023-12-05T09:29:49.455 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-12-05T09:29:49.455 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-12-05T09:29:49.455 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/mellanox/mlx5 2023-12-05T09:29:49.455 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-12-05T09:29:49.455 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-12-05T09:29:49.455 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/micrel 2023-12-05T09:29:49.455 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-12-05T09:29:49.455 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/myricom 2023-12-05T09:29:49.455 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/myricom/myri10ge 2023-12-05T09:29:49.456 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-12-05T09:29:49.456 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/natsemi 2023-12-05T09:29:49.456 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-12-05T09:29:49.456 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-12-05T09:29:49.456 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/neterion 2023-12-05T09:29:49.456 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-12-05T09:29:49.456 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/nvidia 2023-12-05T09:29:49.456 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-12-05T09:29:49.456 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/packetengines 2023-12-05T09:29:49.456 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-12-05T09:29:49.456 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-12-05T09:29:49.456 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/qlogic 2023-12-05T09:29:49.456 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/qlogic/netxen 2023-12-05T09:29:49.456 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-12-05T09:29:49.456 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-12-05T09:29:49.456 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-12-05T09:29:49.457 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-12-05T09:29:49.457 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/rdc 2023-12-05T09:29:49.457 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-12-05T09:29:49.457 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/realtek 2023-12-05T09:29:49.457 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-12-05T09:29:49.457 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-12-05T09:29:49.457 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/realtek/atp.ko 2023-12-05T09:29:49.457 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-12-05T09:29:49.457 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/rocker 2023-12-05T09:29:49.457 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-12-05T09:29:49.457 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/sfc 2023-12-05T09:29:49.457 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-12-05T09:29:49.457 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/silan 2023-12-05T09:29:49.457 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-12-05T09:29:49.457 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/sis 2023-12-05T09:29:49.458 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/sis/sis190.ko 2023-12-05T09:29:49.458 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/sis/sis900.ko 2023-12-05T09:29:49.458 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/smsc 2023-12-05T09:29:49.458 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-12-05T09:29:49.458 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-12-05T09:29:49.458 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-12-05T09:29:49.458 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-12-05T09:29:49.458 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/stmicro 2023-12-05T09:29:49.458 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/stmicro/stmmac 2023-12-05T09:29:49.458 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-12-05T09:29:49.458 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-12-05T09:29:49.458 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/sun 2023-12-05T09:29:49.458 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/sun/cassini.ko 2023-12-05T09:29:49.458 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/sun/niu.ko 2023-12-05T09:29:49.458 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/sun/sungem.ko 2023-12-05T09:29:49.459 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-12-05T09:29:49.459 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/tehuti 2023-12-05T09:29:49.459 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-12-05T09:29:49.459 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/ti 2023-12-05T09:29:49.459 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/ti/tlan.ko 2023-12-05T09:29:49.459 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/via 2023-12-05T09:29:49.459 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-12-05T09:29:49.459 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-12-05T09:29:49.459 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/wiznet 2023-12-05T09:29:49.459 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-12-05T09:29:49.459 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-12-05T09:29:49.459 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/xircom 2023-12-05T09:29:49.459 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-12-05T09:29:49.459 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/geneve.ko 2023-12-05T09:29:49.459 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/hyperv 2023-12-05T09:29:49.460 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-12-05T09:29:49.460 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ieee802154 2023-12-05T09:29:49.460 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ieee802154/fakelb.ko 2023-12-05T09:29:49.460 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ifb.ko 2023-12-05T09:29:49.460 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ipvlan 2023-12-05T09:29:49.460 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ipvlan/ipvlan.ko 2023-12-05T09:29:49.460 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/macvlan.ko 2023-12-05T09:29:49.460 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/macvtap.ko 2023-12-05T09:29:49.460 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/mdio 2023-12-05T09:29:49.460 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/mdio.ko 2023-12-05T09:29:49.460 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-12-05T09:29:49.460 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-12-05T09:29:49.460 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/mdio/mdio-regmap.ko 2023-12-05T09:29:49.460 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/mii.ko 2023-12-05T09:29:49.460 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/net_failover.ko 2023-12-05T09:29:49.461 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/netconsole.ko 2023-12-05T09:29:49.461 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/nlmon.ko 2023-12-05T09:29:49.461 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/pcs 2023-12-05T09:29:49.461 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/pcs/pcs-lynx.ko 2023-12-05T09:29:49.461 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-12-05T09:29:49.461 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy 2023-12-05T09:29:49.461 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/amd.ko 2023-12-05T09:29:49.461 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-12-05T09:29:49.461 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-12-05T09:29:49.461 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/bcm7xxx.ko 2023-12-05T09:29:49.461 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/bcm87xx.ko 2023-12-05T09:29:49.461 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/broadcom.ko 2023-12-05T09:29:49.461 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/cicada.ko 2023-12-05T09:29:49.461 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/davicom.ko 2023-12-05T09:29:49.461 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/dp83640.ko 2023-12-05T09:29:49.462 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/et1011c.ko 2023-12-05T09:29:49.462 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/icplus.ko 2023-12-05T09:29:49.462 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/lxt.ko 2023-12-05T09:29:49.462 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/marvell.ko 2023-12-05T09:29:49.462 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/micrel.ko 2023-12-05T09:29:49.462 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/national.ko 2023-12-05T09:29:49.462 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/phylink.ko 2023-12-05T09:29:49.462 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/qsemi.ko 2023-12-05T09:29:49.462 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/realtek.ko 2023-12-05T09:29:49.462 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/smsc.ko 2023-12-05T09:29:49.462 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/ste10Xp.ko 2023-12-05T09:29:49.462 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/vitesse.ko 2023-12-05T09:29:49.462 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ppp 2023-12-05T09:29:49.462 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ppp/bsd_comp.ko 2023-12-05T09:29:49.462 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ppp/ppp_async.ko 2023-12-05T09:29:49.463 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ppp/ppp_deflate.ko 2023-12-05T09:29:49.463 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ppp/ppp_generic.ko 2023-12-05T09:29:49.463 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ppp/ppp_mppe.ko 2023-12-05T09:29:49.463 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ppp/ppp_synctty.ko 2023-12-05T09:29:49.463 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ppp/pppoe.ko 2023-12-05T09:29:49.463 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ppp/pppox.ko 2023-12-05T09:29:49.463 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ppp/pptp.ko 2023-12-05T09:29:49.463 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/slip 2023-12-05T09:29:49.463 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/slip/slhc.ko 2023-12-05T09:29:49.463 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/slip/slip.ko 2023-12-05T09:29:49.463 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/sungem_phy.ko 2023-12-05T09:29:49.463 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/tap.ko 2023-12-05T09:29:49.463 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/team 2023-12-05T09:29:49.463 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/team/team.ko 2023-12-05T09:29:49.463 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/team/team_mode_activebackup.ko 2023-12-05T09:29:49.464 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/team/team_mode_broadcast.ko 2023-12-05T09:29:49.464 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-12-05T09:29:49.464 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/team/team_mode_random.ko 2023-12-05T09:29:49.464 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-12-05T09:29:49.464 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/tun.ko 2023-12-05T09:29:49.464 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/veth.ko 2023-12-05T09:29:49.464 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/virtio_net.ko 2023-12-05T09:29:49.464 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/vmxnet3 2023-12-05T09:29:49.464 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-12-05T09:29:49.464 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/vxlan 2023-12-05T09:29:49.464 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/vxlan/vxlan.ko 2023-12-05T09:29:49.464 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/xen-netback 2023-12-05T09:29:49.464 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/xen-netback/xen-netback.ko 2023-12-05T09:29:49.464 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/xen-netfront.ko 2023-12-05T09:29:49.464 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ntb 2023-12-05T09:29:49.465 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ntb/ntb.ko 2023-12-05T09:29:49.465 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/nvme 2023-12-05T09:29:49.465 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/nvme/host 2023-12-05T09:29:49.465 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/nvme/host/nvme-core.ko 2023-12-05T09:29:49.465 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/nvme/host/nvme.ko 2023-12-05T09:29:49.465 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/parport 2023-12-05T09:29:49.465 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/parport/parport.ko 2023-12-05T09:29:49.465 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/parport/parport_cs.ko 2023-12-05T09:29:49.465 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/parport/parport_pc.ko 2023-12-05T09:29:49.465 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/parport/parport_serial.ko 2023-12-05T09:29:49.465 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pci 2023-12-05T09:29:49.465 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pci/hotplug 2023-12-05T09:29:49.465 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-12-05T09:29:49.465 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pci/pcie 2023-12-05T09:29:49.465 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pci/pcie/aer_inject.ko 2023-12-05T09:29:49.466 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pci/xen-pcifront.ko 2023-12-05T09:29:49.466 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pcmcia 2023-12-05T09:29:49.466 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pcmcia/i82092.ko 2023-12-05T09:29:49.466 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pcmcia/pd6729.ko 2023-12-05T09:29:49.466 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pcmcia/yenta_socket.ko 2023-12-05T09:29:49.466 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pinctrl 2023-12-05T09:29:49.466 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pinctrl/intel 2023-12-05T09:29:49.466 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-12-05T09:29:49.466 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform 2023-12-05T09:29:49.466 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86 2023-12-05T09:29:49.466 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/acer-wmi.ko 2023-12-05T09:29:49.466 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/acerhdf.ko 2023-12-05T09:29:49.466 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/apple-gmux.ko 2023-12-05T09:29:49.466 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/asus-laptop.ko 2023-12-05T09:29:49.467 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-12-05T09:29:49.467 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/asus-wmi.ko 2023-12-05T09:29:49.467 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/classmate-laptop.ko 2023-12-05T09:29:49.467 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-12-05T09:29:49.467 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-12-05T09:29:49.467 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-12-05T09:29:49.467 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-12-05T09:29:49.467 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/hdaps.ko 2023-12-05T09:29:49.467 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/intel 2023-12-05T09:29:49.467 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-12-05T09:29:49.467 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/intel_ips.ko 2023-12-05T09:29:49.467 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/msi-wmi.ko 2023-12-05T09:29:49.467 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/mxm-wmi.ko 2023-12-05T09:29:49.467 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-12-05T09:29:49.467 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/samsung-laptop.ko 2023-12-05T09:29:49.468 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/samsung-q10.ko 2023-12-05T09:29:49.468 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/topstar-laptop.ko 2023-12-05T09:29:49.468 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-12-05T09:29:49.468 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/toshiba_haps.ko 2023-12-05T09:29:49.468 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/wmi-bmof.ko 2023-12-05T09:29:49.468 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/wmi.ko 2023-12-05T09:29:49.468 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/powercap 2023-12-05T09:29:49.468 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/powercap/intel_rapl_common.ko 2023-12-05T09:29:49.468 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/powercap/intel_rapl_msr.ko 2023-12-05T09:29:49.468 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pps 2023-12-05T09:29:49.468 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pps/clients 2023-12-05T09:29:49.468 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pps/clients/pps-gpio.ko 2023-12-05T09:29:49.468 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pps/clients/pps-ldisc.ko 2023-12-05T09:29:49.468 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pps/clients/pps_parport.ko 2023-12-05T09:29:49.469 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pps/pps_core.ko 2023-12-05T09:29:49.469 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ptp 2023-12-05T09:29:49.469 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ptp/ptp.ko 2023-12-05T09:29:49.469 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ptp/ptp_kvm.ko 2023-12-05T09:29:49.469 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc 2023-12-05T09:29:49.469 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-bq32k.ko 2023-12-05T09:29:49.469 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-ds1286.ko 2023-12-05T09:29:49.469 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-ds1307.ko 2023-12-05T09:29:49.469 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-ds1374.ko 2023-12-05T09:29:49.469 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-ds1511.ko 2023-12-05T09:29:49.469 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-ds1553.ko 2023-12-05T09:29:49.469 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-ds1672.ko 2023-12-05T09:29:49.469 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-ds1742.ko 2023-12-05T09:29:49.469 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-ds2404.ko 2023-12-05T09:29:49.469 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-ds3232.ko 2023-12-05T09:29:49.470 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-em3027.ko 2023-12-05T09:29:49.470 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-fm3130.ko 2023-12-05T09:29:49.470 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-isl12022.ko 2023-12-05T09:29:49.470 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-isl1208.ko 2023-12-05T09:29:49.470 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-m41t80.ko 2023-12-05T09:29:49.470 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-m48t35.ko 2023-12-05T09:29:49.470 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-m48t59.ko 2023-12-05T09:29:49.470 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-max6900.ko 2023-12-05T09:29:49.470 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-msm6242.ko 2023-12-05T09:29:49.470 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-pcf2127.ko 2023-12-05T09:29:49.470 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-pcf85063.ko 2023-12-05T09:29:49.470 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-pcf8523.ko 2023-12-05T09:29:49.470 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-pcf8563.ko 2023-12-05T09:29:49.470 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-pcf8583.ko 2023-12-05T09:29:49.471 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-rp5c01.ko 2023-12-05T09:29:49.471 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-rs5c372.ko 2023-12-05T09:29:49.471 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-12-05T09:29:49.471 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-rx8025.ko 2023-12-05T09:29:49.471 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-rx8581.ko 2023-12-05T09:29:49.471 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-12-05T09:29:49.471 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-x1205.ko 2023-12-05T09:29:49.471 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi 2023-12-05T09:29:49.471 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/3w-9xxx.ko 2023-12-05T09:29:49.471 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/3w-sas.ko 2023-12-05T09:29:49.471 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/3w-xxxx.ko 2023-12-05T09:29:49.471 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/BusLogic.ko 2023-12-05T09:29:49.471 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/a100u2w.ko 2023-12-05T09:29:49.471 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/aacraid 2023-12-05T09:29:49.471 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/aacraid/aacraid.ko 2023-12-05T09:29:49.471 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/advansys.ko 2023-12-05T09:29:49.472 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/aic7xxx 2023-12-05T09:29:49.472 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-12-05T09:29:49.472 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-12-05T09:29:49.472 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/am53c974.ko 2023-12-05T09:29:49.472 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/arcmsr 2023-12-05T09:29:49.472 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-12-05T09:29:49.472 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/atp870u.ko 2023-12-05T09:29:49.472 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/be2iscsi 2023-12-05T09:29:49.472 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-12-05T09:29:49.472 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/bfa 2023-12-05T09:29:49.472 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/bfa/bfa.ko 2023-12-05T09:29:49.472 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/bnx2fc 2023-12-05T09:29:49.472 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-12-05T09:29:49.472 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/bnx2i 2023-12-05T09:29:49.472 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-12-05T09:29:49.473 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/ch.ko 2023-12-05T09:29:49.473 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/csiostor 2023-12-05T09:29:49.473 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/csiostor/csiostor.ko 2023-12-05T09:29:49.473 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/cxgbi 2023-12-05T09:29:49.473 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/cxgbi/cxgb3i 2023-12-05T09:29:49.473 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-12-05T09:29:49.473 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/cxgbi/cxgb4i 2023-12-05T09:29:49.473 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-12-05T09:29:49.473 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-12-05T09:29:49.473 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/dc395x.ko 2023-12-05T09:29:49.473 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/device_handler 2023-12-05T09:29:49.473 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-12-05T09:29:49.473 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-12-05T09:29:49.473 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-12-05T09:29:49.473 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-12-05T09:29:49.474 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/dmx3191d.ko 2023-12-05T09:29:49.474 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/esas2r 2023-12-05T09:29:49.474 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/esas2r/esas2r.ko 2023-12-05T09:29:49.474 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/esp_scsi.ko 2023-12-05T09:29:49.474 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/fcoe 2023-12-05T09:29:49.474 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/fcoe/fcoe.ko 2023-12-05T09:29:49.474 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-12-05T09:29:49.474 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/fnic 2023-12-05T09:29:49.474 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/fnic/fnic.ko 2023-12-05T09:29:49.474 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/hpsa.ko 2023-12-05T09:29:49.474 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/hptiop.ko 2023-12-05T09:29:49.474 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/hv_storvsc.ko 2023-12-05T09:29:49.474 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/initio.ko 2023-12-05T09:29:49.474 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/ipr.ko 2023-12-05T09:29:49.475 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/ips.ko 2023-12-05T09:29:49.475 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/isci 2023-12-05T09:29:49.475 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/isci/isci.ko 2023-12-05T09:29:49.475 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-12-05T09:29:49.475 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/iscsi_tcp.ko 2023-12-05T09:29:49.475 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/libfc 2023-12-05T09:29:49.475 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/libfc/libfc.ko 2023-12-05T09:29:49.475 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/libiscsi.ko 2023-12-05T09:29:49.475 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/libiscsi_tcp.ko 2023-12-05T09:29:49.475 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/libsas 2023-12-05T09:29:49.475 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/libsas/libsas.ko 2023-12-05T09:29:49.475 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/lpfc 2023-12-05T09:29:49.475 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/lpfc/lpfc.ko 2023-12-05T09:29:49.475 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/megaraid 2023-12-05T09:29:49.475 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/megaraid.ko 2023-12-05T09:29:49.475 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-12-05T09:29:49.476 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-12-05T09:29:49.476 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-12-05T09:29:49.476 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/mpt3sas 2023-12-05T09:29:49.476 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-12-05T09:29:49.476 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/mvsas 2023-12-05T09:29:49.476 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/mvsas/mvsas.ko 2023-12-05T09:29:49.476 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/mvumi.ko 2023-12-05T09:29:49.476 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/pm8001 2023-12-05T09:29:49.476 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-12-05T09:29:49.476 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/pmcraid.ko 2023-12-05T09:29:49.476 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/qla1280.ko 2023-12-05T09:29:49.476 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/qla2xxx 2023-12-05T09:29:49.476 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-12-05T09:29:49.476 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-12-05T09:29:49.476 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/qla4xxx 2023-12-05T09:29:49.477 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-12-05T09:29:49.477 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/raid_class.ko 2023-12-05T09:29:49.477 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/scsi_debug.ko 2023-12-05T09:29:49.477 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/scsi_transport_fc.ko 2023-12-05T09:29:49.477 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-12-05T09:29:49.477 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/scsi_transport_sas.ko 2023-12-05T09:29:49.477 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/scsi_transport_spi.ko 2023-12-05T09:29:49.477 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/scsi_transport_srp.ko 2023-12-05T09:29:49.477 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/ses.ko 2023-12-05T09:29:49.477 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/st.ko 2023-12-05T09:29:49.477 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/stex.ko 2023-12-05T09:29:49.477 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/sym53c8xx_2 2023-12-05T09:29:49.477 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-12-05T09:29:49.477 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/virtio_scsi.ko 2023-12-05T09:29:49.478 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/vmw_pvscsi.ko 2023-12-05T09:29:49.478 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/wd719x.ko 2023-12-05T09:29:49.478 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ssb 2023-12-05T09:29:49.478 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ssb/ssb.ko 2023-12-05T09:29:49.478 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/target 2023-12-05T09:29:49.478 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/target/iscsi 2023-12-05T09:29:49.478 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-12-05T09:29:49.478 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/target/loopback 2023-12-05T09:29:49.478 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/target/loopback/tcm_loop.ko 2023-12-05T09:29:49.478 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/target/target_core_file.ko 2023-12-05T09:29:49.478 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/target/target_core_iblock.ko 2023-12-05T09:29:49.478 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/target/target_core_mod.ko 2023-12-05T09:29:49.478 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/target/target_core_pscsi.ko 2023-12-05T09:29:49.478 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/target/target_core_user.ko 2023-12-05T09:29:49.478 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/target/tcm_fc 2023-12-05T09:29:49.479 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-12-05T09:29:49.479 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal 2023-12-05T09:29:49.479 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel 2023-12-05T09:29:49.479 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal 2023-12-05T09:29:49.479 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-12-05T09:29:49.479 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-12-05T09:29:49.479 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-12-05T09:29:49.479 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-12-05T09:29:49.479 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-12-05T09:29:49.479 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-12-05T09:29:49.479 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-12-05T09:29:49.480 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-12-05T09:29:49.480 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-12-05T09:29:49.480 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-12-05T09:29:49.480 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-12-05T09:29:49.480 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-12-05T09:29:49.480 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-12-05T09:29:49.480 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-12-05T09:29:49.480 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-12-05T09:29:49.480 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty 2023-12-05T09:29:49.480 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/ipwireless 2023-12-05T09:29:49.480 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-12-05T09:29:49.480 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/n_gsm.ko 2023-12-05T09:29:49.480 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/n_hdlc.ko 2023-12-05T09:29:49.480 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/nozomi.ko 2023-12-05T09:29:49.480 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/serial 2023-12-05T09:29:49.481 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/serial/8250 2023-12-05T09:29:49.481 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-12-05T09:29:49.481 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/serial/arc_uart.ko 2023-12-05T09:29:49.481 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/serial/jsm 2023-12-05T09:29:49.481 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/serial/jsm/jsm.ko 2023-12-05T09:29:49.481 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ufs 2023-12-05T09:29:49.481 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ufs/core 2023-12-05T09:29:49.481 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ufs/core/ufshcd-core.ko 2023-12-05T09:29:49.481 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ufs/host 2023-12-05T09:29:49.481 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-12-05T09:29:49.481 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/uio 2023-12-05T09:29:49.481 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/uio/uio.ko 2023-12-05T09:29:49.481 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/uio/uio_aec.ko 2023-12-05T09:29:49.481 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/uio/uio_cif.ko 2023-12-05T09:29:49.481 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/uio/uio_pci_generic.ko 2023-12-05T09:29:49.482 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/uio/uio_sercos3.ko 2023-12-05T09:29:49.482 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb 2023-12-05T09:29:49.482 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/class 2023-12-05T09:29:49.482 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/class/cdc-acm.ko 2023-12-05T09:29:49.482 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/class/cdc-wdm.ko 2023-12-05T09:29:49.482 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/class/usblp.ko 2023-12-05T09:29:49.482 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/class/usbtmc.ko 2023-12-05T09:29:49.482 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/host 2023-12-05T09:29:49.482 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/host/sl811-hcd.ko 2023-12-05T09:29:49.482 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/image 2023-12-05T09:29:49.482 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/image/mdc800.ko 2023-12-05T09:29:49.482 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/image/microtek.ko 2023-12-05T09:29:49.482 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc 2023-12-05T09:29:49.482 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/adutux.ko 2023-12-05T09:29:49.483 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/appledisplay.ko 2023-12-05T09:29:49.483 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/emi26.ko 2023-12-05T09:29:49.483 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/emi62.ko 2023-12-05T09:29:49.483 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/ezusb.ko 2023-12-05T09:29:49.483 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/idmouse.ko 2023-12-05T09:29:49.483 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/iowarrior.ko 2023-12-05T09:29:49.483 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/isight_firmware.ko 2023-12-05T09:29:49.483 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/ldusb.ko 2023-12-05T09:29:49.483 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/legousbtower.ko 2023-12-05T09:29:49.483 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/sisusbvga 2023-12-05T09:29:49.483 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-12-05T09:29:49.483 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/trancevibrator.ko 2023-12-05T09:29:49.483 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/usb3503.ko 2023-12-05T09:29:49.483 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/usblcd.ko 2023-12-05T09:29:49.483 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/usbsevseg.ko 2023-12-05T09:29:49.483 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/uss720.ko 2023-12-05T09:29:49.484 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/yurex.ko 2023-12-05T09:29:49.484 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/phy 2023-12-05T09:29:49.484 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/phy/phy-generic.ko 2023-12-05T09:29:49.484 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial 2023-12-05T09:29:49.484 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/aircable.ko 2023-12-05T09:29:49.484 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/ark3116.ko 2023-12-05T09:29:49.484 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/belkin_sa.ko 2023-12-05T09:29:49.484 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/ch341.ko 2023-12-05T09:29:49.484 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/cp210x.ko 2023-12-05T09:29:49.484 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/cyberjack.ko 2023-12-05T09:29:49.484 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/cypress_m8.ko 2023-12-05T09:29:49.484 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/digi_acceleport.ko 2023-12-05T09:29:49.484 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/empeg.ko 2023-12-05T09:29:49.484 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/ftdi_sio.ko 2023-12-05T09:29:49.484 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/garmin_gps.ko 2023-12-05T09:29:49.485 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/io_edgeport.ko 2023-12-05T09:29:49.485 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/io_ti.ko 2023-12-05T09:29:49.485 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/ipaq.ko 2023-12-05T09:29:49.485 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/ipw.ko 2023-12-05T09:29:49.485 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/ir-usb.ko 2023-12-05T09:29:49.485 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-12-05T09:29:49.485 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/keyspan.ko 2023-12-05T09:29:49.485 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/keyspan_pda.ko 2023-12-05T09:29:49.485 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/kl5kusb105.ko 2023-12-05T09:29:49.485 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/kobil_sct.ko 2023-12-05T09:29:49.485 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/mct_u232.ko 2023-12-05T09:29:49.485 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/mos7720.ko 2023-12-05T09:29:49.485 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/mos7840.ko 2023-12-05T09:29:49.485 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/navman.ko 2023-12-05T09:29:49.485 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/omninet.ko 2023-12-05T09:29:49.486 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/opticon.ko 2023-12-05T09:29:49.486 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/option.ko 2023-12-05T09:29:49.486 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/oti6858.ko 2023-12-05T09:29:49.486 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/pl2303.ko 2023-12-05T09:29:49.486 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/qcaux.ko 2023-12-05T09:29:49.486 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/qcserial.ko 2023-12-05T09:29:49.486 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/quatech2.ko 2023-12-05T09:29:49.486 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/safe_serial.ko 2023-12-05T09:29:49.486 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/sierra.ko 2023-12-05T09:29:49.486 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/spcp8x5.ko 2023-12-05T09:29:49.486 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/ssu100.ko 2023-12-05T09:29:49.486 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/symbolserial.ko 2023-12-05T09:29:49.486 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-12-05T09:29:49.486 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-12-05T09:29:49.486 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/usb_debug.ko 2023-12-05T09:29:49.487 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/usb_wwan.ko 2023-12-05T09:29:49.487 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/visor.ko 2023-12-05T09:29:49.487 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/whiteheat.ko 2023-12-05T09:29:49.487 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/xsens_mt.ko 2023-12-05T09:29:49.487 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage 2023-12-05T09:29:49.487 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/uas.ko 2023-12-05T09:29:49.487 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-alauda.ko 2023-12-05T09:29:49.487 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-cypress.ko 2023-12-05T09:29:49.487 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-datafab.ko 2023-12-05T09:29:49.487 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-12-05T09:29:49.487 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-freecom.ko 2023-12-05T09:29:49.487 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-isd200.ko 2023-12-05T09:29:49.487 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-12-05T09:29:49.487 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-karma.ko 2023-12-05T09:29:49.487 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-onetouch.ko 2023-12-05T09:29:49.488 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-realtek.ko 2023-12-05T09:29:49.488 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-sddr09.ko 2023-12-05T09:29:49.488 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-sddr55.ko 2023-12-05T09:29:49.488 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-usbat.ko 2023-12-05T09:29:49.488 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/usb-storage.ko 2023-12-05T09:29:49.488 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/usbip 2023-12-05T09:29:49.488 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/usbip/usbip-core.ko 2023-12-05T09:29:49.488 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/usbip/usbip-host.ko 2023-12-05T09:29:49.488 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-12-05T09:29:49.488 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/vfio 2023-12-05T09:29:49.488 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/vfio/pci 2023-12-05T09:29:49.488 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-12-05T09:29:49.488 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/vfio/pci/vfio-pci.ko 2023-12-05T09:29:49.488 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/vfio/vfio.ko 2023-12-05T09:29:49.488 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-12-05T09:29:49.489 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/vhost 2023-12-05T09:29:49.489 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/vhost/vhost.ko 2023-12-05T09:29:49.489 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/vhost/vhost_iotlb.ko 2023-12-05T09:29:49.489 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/vhost/vhost_net.ko 2023-12-05T09:29:49.489 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/vhost/vhost_scsi.ko 2023-12-05T09:29:49.489 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/video 2023-12-05T09:29:49.489 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/video/backlight 2023-12-05T09:29:49.489 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/video/backlight/apple_bl.ko 2023-12-05T09:29:49.489 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/video/backlight/lcd.ko 2023-12-05T09:29:49.489 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/video/backlight/platform_lcd.ko 2023-12-05T09:29:49.489 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/virtio 2023-12-05T09:29:49.489 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/virtio/virtio.ko 2023-12-05T09:29:49.489 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/virtio/virtio_balloon.ko 2023-12-05T09:29:49.489 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/virtio/virtio_mmio.ko 2023-12-05T09:29:49.489 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/virtio/virtio_pci.ko 2023-12-05T09:29:49.489 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-12-05T09:29:49.490 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-12-05T09:29:49.490 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/virtio/virtio_ring.ko 2023-12-05T09:29:49.490 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1 2023-12-05T09:29:49.490 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/masters 2023-12-05T09:29:49.490 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/masters/ds2482.ko 2023-12-05T09:29:49.490 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/masters/ds2490.ko 2023-12-05T09:29:49.490 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/slaves 2023-12-05T09:29:49.490 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-12-05T09:29:49.490 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-12-05T09:29:49.490 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-12-05T09:29:49.490 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-12-05T09:29:49.490 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-12-05T09:29:49.490 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-12-05T09:29:49.490 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-12-05T09:29:49.491 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-12-05T09:29:49.491 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-12-05T09:29:49.491 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/slaves/w1_smem.ko 2023-12-05T09:29:49.491 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/slaves/w1_therm.ko 2023-12-05T09:29:49.491 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/wire.ko 2023-12-05T09:29:49.491 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog 2023-12-05T09:29:49.491 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/alim1535_wdt.ko 2023-12-05T09:29:49.491 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/alim7101_wdt.ko 2023-12-05T09:29:49.491 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/f71808e_wdt.ko 2023-12-05T09:29:49.491 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/hpwdt.ko 2023-12-05T09:29:49.491 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/i6300esb.ko 2023-12-05T09:29:49.491 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-12-05T09:29:49.491 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/iTCO_wdt.ko 2023-12-05T09:29:49.491 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/ib700wdt.ko 2023-12-05T09:29:49.491 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/ibmasr.ko 2023-12-05T09:29:49.492 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-12-05T09:29:49.492 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/it8712f_wdt.ko 2023-12-05T09:29:49.492 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/it87_wdt.ko 2023-12-05T09:29:49.492 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/machzwd.ko 2023-12-05T09:29:49.492 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/nv_tco.ko 2023-12-05T09:29:49.492 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/pcwd_pci.ko 2023-12-05T09:29:49.492 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/pcwd_usb.ko 2023-12-05T09:29:49.492 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-12-05T09:29:49.492 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/sch311x_wdt.ko 2023-12-05T09:29:49.492 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/softdog.ko 2023-12-05T09:29:49.492 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/sp5100_tco.ko 2023-12-05T09:29:49.492 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/via_wdt.ko 2023-12-05T09:29:49.492 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-12-05T09:29:49.492 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/w83877f_wdt.ko 2023-12-05T09:29:49.492 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/w83977f_wdt.ko 2023-12-05T09:29:49.493 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/wdt_pci.ko 2023-12-05T09:29:49.493 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/xen_wdt.ko 2023-12-05T09:29:49.493 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/xen 2023-12-05T09:29:49.493 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/xen/xen-acpi-processor.ko 2023-12-05T09:29:49.493 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/xen/xen-evtchn.ko 2023-12-05T09:29:49.493 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/xen/xen-gntalloc.ko 2023-12-05T09:29:49.493 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/xen/xen-gntdev.ko 2023-12-05T09:29:49.493 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/xen/xen-pciback 2023-12-05T09:29:49.493 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-12-05T09:29:49.493 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/xen/xen-privcmd.ko 2023-12-05T09:29:49.493 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/xen/xenfs 2023-12-05T09:29:49.493 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/xen/xenfs/xenfs.ko 2023-12-05T09:29:49.493 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs 2023-12-05T09:29:49.493 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/9p 2023-12-05T09:29:49.493 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/9p/9p.ko 2023-12-05T09:29:49.493 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/affs 2023-12-05T09:29:49.494 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/affs/affs.ko 2023-12-05T09:29:49.494 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/befs 2023-12-05T09:29:49.494 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/befs/befs.ko 2023-12-05T09:29:49.494 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/binfmt_misc.ko 2023-12-05T09:29:49.494 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/btrfs 2023-12-05T09:29:49.494 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/btrfs/btrfs.ko 2023-12-05T09:29:49.494 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/cachefiles 2023-12-05T09:29:49.494 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/cachefiles/cachefiles.ko 2023-12-05T09:29:49.494 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ceph 2023-12-05T09:29:49.494 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ceph/ceph.ko 2023-12-05T09:29:49.494 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/coda 2023-12-05T09:29:49.494 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/coda/coda.ko 2023-12-05T09:29:49.494 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/cramfs 2023-12-05T09:29:49.494 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/cramfs/cramfs.ko 2023-12-05T09:29:49.495 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/dlm 2023-12-05T09:29:49.495 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/dlm/dlm.ko 2023-12-05T09:29:49.495 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ecryptfs 2023-12-05T09:29:49.495 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ecryptfs/ecryptfs.ko 2023-12-05T09:29:49.495 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/f2fs 2023-12-05T09:29:49.495 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/f2fs/f2fs.ko 2023-12-05T09:29:49.495 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/fat 2023-12-05T09:29:49.495 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/fat/fat.ko 2023-12-05T09:29:49.495 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/fat/msdos.ko 2023-12-05T09:29:49.495 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/fat/vfat.ko 2023-12-05T09:29:49.495 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/fscache 2023-12-05T09:29:49.495 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/fscache/fscache.ko 2023-12-05T09:29:49.495 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/fuse 2023-12-05T09:29:49.495 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/fuse/cuse.ko 2023-12-05T09:29:49.495 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/fuse/fuse.ko 2023-12-05T09:29:49.496 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/gfs2 2023-12-05T09:29:49.496 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/gfs2/gfs2.ko 2023-12-05T09:29:49.496 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/hfs 2023-12-05T09:29:49.496 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/hfs/hfs.ko 2023-12-05T09:29:49.496 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/hfsplus 2023-12-05T09:29:49.496 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/hfsplus/hfsplus.ko 2023-12-05T09:29:49.496 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/isofs 2023-12-05T09:29:49.496 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/isofs/isofs.ko 2023-12-05T09:29:49.496 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/jfs 2023-12-05T09:29:49.496 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/jfs/jfs.ko 2023-12-05T09:29:49.496 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/lockd 2023-12-05T09:29:49.496 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/lockd/lockd.ko 2023-12-05T09:29:49.496 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/minix 2023-12-05T09:29:49.496 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/minix/minix.ko 2023-12-05T09:29:49.496 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/netfs 2023-12-05T09:29:49.497 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/netfs/netfs.ko 2023-12-05T09:29:49.497 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs 2023-12-05T09:29:49.497 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs/blocklayout 2023-12-05T09:29:49.497 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-12-05T09:29:49.497 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs/filelayout 2023-12-05T09:29:49.497 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-12-05T09:29:49.497 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs/flexfilelayout 2023-12-05T09:29:49.497 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-12-05T09:29:49.497 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs/nfs.ko 2023-12-05T09:29:49.497 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs/nfsv3.ko 2023-12-05T09:29:49.497 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs/nfsv4.ko 2023-12-05T09:29:49.497 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs_common 2023-12-05T09:29:49.497 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs_common/grace.ko 2023-12-05T09:29:49.497 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs_common/nfs_acl.ko 2023-12-05T09:29:49.497 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfsd 2023-12-05T09:29:49.497 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfsd/nfsd.ko 2023-12-05T09:29:49.498 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nilfs2 2023-12-05T09:29:49.498 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nilfs2/nilfs2.ko 2023-12-05T09:29:49.498 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls 2023-12-05T09:29:49.498 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/mac-celtic.ko 2023-12-05T09:29:49.498 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/mac-centeuro.ko 2023-12-05T09:29:49.498 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/mac-croatian.ko 2023-12-05T09:29:49.498 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/mac-cyrillic.ko 2023-12-05T09:29:49.498 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/mac-gaelic.ko 2023-12-05T09:29:49.498 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/mac-greek.ko 2023-12-05T09:29:49.498 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/mac-iceland.ko 2023-12-05T09:29:49.498 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/mac-inuit.ko 2023-12-05T09:29:49.498 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/mac-roman.ko 2023-12-05T09:29:49.498 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/mac-romanian.ko 2023-12-05T09:29:49.498 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/mac-turkish.ko 2023-12-05T09:29:49.499 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp1250.ko 2023-12-05T09:29:49.499 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp1251.ko 2023-12-05T09:29:49.499 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp1255.ko 2023-12-05T09:29:49.499 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp737.ko 2023-12-05T09:29:49.499 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp775.ko 2023-12-05T09:29:49.499 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp850.ko 2023-12-05T09:29:49.499 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp852.ko 2023-12-05T09:29:49.499 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp855.ko 2023-12-05T09:29:49.499 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp857.ko 2023-12-05T09:29:49.499 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp860.ko 2023-12-05T09:29:49.499 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp861.ko 2023-12-05T09:29:49.499 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp862.ko 2023-12-05T09:29:49.499 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp863.ko 2023-12-05T09:29:49.499 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp864.ko 2023-12-05T09:29:49.499 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp865.ko 2023-12-05T09:29:49.500 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp866.ko 2023-12-05T09:29:49.500 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp869.ko 2023-12-05T09:29:49.500 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp874.ko 2023-12-05T09:29:49.500 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp932.ko 2023-12-05T09:29:49.500 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp936.ko 2023-12-05T09:29:49.500 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp949.ko 2023-12-05T09:29:49.500 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp950.ko 2023-12-05T09:29:49.500 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_euc-jp.ko 2023-12-05T09:29:49.500 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_iso8859-1.ko 2023-12-05T09:29:49.500 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_iso8859-13.ko 2023-12-05T09:29:49.500 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_iso8859-14.ko 2023-12-05T09:29:49.500 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_iso8859-15.ko 2023-12-05T09:29:49.500 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_iso8859-2.ko 2023-12-05T09:29:49.500 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_iso8859-3.ko 2023-12-05T09:29:49.500 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_iso8859-4.ko 2023-12-05T09:29:49.500 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_iso8859-5.ko 2023-12-05T09:29:49.501 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_iso8859-6.ko 2023-12-05T09:29:49.501 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_iso8859-7.ko 2023-12-05T09:29:49.501 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_iso8859-9.ko 2023-12-05T09:29:49.501 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_koi8-r.ko 2023-12-05T09:29:49.501 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_koi8-ru.ko 2023-12-05T09:29:49.501 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_koi8-u.ko 2023-12-05T09:29:49.501 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_ucs2_utils.ko 2023-12-05T09:29:49.501 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_utf8.ko 2023-12-05T09:29:49.501 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ocfs2 2023-12-05T09:29:49.501 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ocfs2/cluster 2023-12-05T09:29:49.501 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-12-05T09:29:49.501 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ocfs2/dlm 2023-12-05T09:29:49.501 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-12-05T09:29:49.501 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ocfs2/dlmfs 2023-12-05T09:29:49.501 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-12-05T09:29:49.502 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ocfs2/ocfs2.ko 2023-12-05T09:29:49.502 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-12-05T09:29:49.502 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-12-05T09:29:49.502 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-12-05T09:29:49.502 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/overlayfs 2023-12-05T09:29:49.502 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/overlayfs/overlay.ko 2023-12-05T09:29:49.502 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/pstore 2023-12-05T09:29:49.502 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/pstore/ramoops.ko 2023-12-05T09:29:49.502 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/reiserfs 2023-12-05T09:29:49.502 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/reiserfs/reiserfs.ko 2023-12-05T09:29:49.502 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/romfs 2023-12-05T09:29:49.502 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/romfs/romfs.ko 2023-12-05T09:29:49.502 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/smb 2023-12-05T09:29:49.502 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/smb/client 2023-12-05T09:29:49.503 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/smb/client/cifs.ko 2023-12-05T09:29:49.503 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/smb/common 2023-12-05T09:29:49.503 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/smb/common/cifs_arc4.ko 2023-12-05T09:29:49.503 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/smb/common/cifs_md4.ko 2023-12-05T09:29:49.503 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/squashfs 2023-12-05T09:29:49.503 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/squashfs/squashfs.ko 2023-12-05T09:29:49.503 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/sysv 2023-12-05T09:29:49.503 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/sysv/sysv.ko 2023-12-05T09:29:49.503 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/udf 2023-12-05T09:29:49.503 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/udf/udf.ko 2023-12-05T09:29:49.503 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ufs 2023-12-05T09:29:49.503 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ufs/ufs.ko 2023-12-05T09:29:49.503 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/xfs 2023-12-05T09:29:49.503 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/xfs/xfs.ko 2023-12-05T09:29:49.503 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/kernel 2023-12-05T09:29:49.504 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/kernel/rcu 2023-12-05T09:29:49.504 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/kernel/rcu/rcutorture.ko 2023-12-05T09:29:49.504 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/kernel/torture.ko 2023-12-05T09:29:49.504 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/kernel/trace 2023-12-05T09:29:49.504 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-12-05T09:29:49.504 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib 2023-12-05T09:29:49.504 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/asn1_encoder.ko 2023-12-05T09:29:49.504 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/crc-itu-t.ko 2023-12-05T09:29:49.504 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/crc8.ko 2023-12-05T09:29:49.504 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/crypto 2023-12-05T09:29:49.504 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/crypto/libarc4.ko 2023-12-05T09:29:49.504 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/crypto/libdes.ko 2023-12-05T09:29:49.504 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/libcrc32c.ko 2023-12-05T09:29:49.504 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/lru_cache.ko 2023-12-05T09:29:49.504 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/lz4 2023-12-05T09:29:49.504 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/lz4/lz4_compress.ko 2023-12-05T09:29:49.505 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/lz4/lz4hc_compress.ko 2023-12-05T09:29:49.505 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/math 2023-12-05T09:29:49.505 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/math/cordic.ko 2023-12-05T09:29:49.505 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/raid6 2023-12-05T09:29:49.505 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/raid6/raid6_pq.ko 2023-12-05T09:29:49.505 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/reed_solomon 2023-12-05T09:29:49.505 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/reed_solomon/reed_solomon.ko 2023-12-05T09:29:49.505 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/ts_bm.ko 2023-12-05T09:29:49.505 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/ts_fsm.ko 2023-12-05T09:29:49.505 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/ts_kmp.ko 2023-12-05T09:29:49.505 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/zstd 2023-12-05T09:29:49.505 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/zstd/zstd_compress.ko 2023-12-05T09:29:49.505 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/mm 2023-12-05T09:29:49.505 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/mm/hwpoison-inject.ko 2023-12-05T09:29:49.505 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net 2023-12-05T09:29:49.506 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/6lowpan 2023-12-05T09:29:49.506 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/6lowpan/6lowpan.ko 2023-12-05T09:29:49.506 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/6lowpan/nhc_dest.ko 2023-12-05T09:29:49.506 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/6lowpan/nhc_fragment.ko 2023-12-05T09:29:49.506 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/6lowpan/nhc_hop.ko 2023-12-05T09:29:49.506 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/6lowpan/nhc_ipv6.ko 2023-12-05T09:29:49.506 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/6lowpan/nhc_mobility.ko 2023-12-05T09:29:49.506 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/6lowpan/nhc_routing.ko 2023-12-05T09:29:49.506 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/6lowpan/nhc_udp.ko 2023-12-05T09:29:49.506 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/802 2023-12-05T09:29:49.506 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/802/garp.ko 2023-12-05T09:29:49.506 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/802/mrp.ko 2023-12-05T09:29:49.506 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/802/p8022.ko 2023-12-05T09:29:49.506 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/802/psnap.ko 2023-12-05T09:29:49.506 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/802/stp.ko 2023-12-05T09:29:49.507 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/8021q 2023-12-05T09:29:49.507 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/8021q/8021q.ko 2023-12-05T09:29:49.507 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/9p 2023-12-05T09:29:49.507 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/9p/9pnet.ko 2023-12-05T09:29:49.507 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/9p/9pnet_fd.ko 2023-12-05T09:29:49.507 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/9p/9pnet_rdma.ko 2023-12-05T09:29:49.507 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/9p/9pnet_virtio.ko 2023-12-05T09:29:49.507 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/batman-adv 2023-12-05T09:29:49.507 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/batman-adv/batman-adv.ko 2023-12-05T09:29:49.507 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge 2023-12-05T09:29:49.507 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/br_netfilter.ko 2023-12-05T09:29:49.507 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/bridge.ko 2023-12-05T09:29:49.507 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter 2023-12-05T09:29:49.507 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-12-05T09:29:49.507 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_among.ko 2023-12-05T09:29:49.508 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_arp.ko 2023-12-05T09:29:49.508 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-12-05T09:29:49.508 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-12-05T09:29:49.508 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_ip.ko 2023-12-05T09:29:49.508 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-12-05T09:29:49.508 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_limit.ko 2023-12-05T09:29:49.508 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_log.ko 2023-12-05T09:29:49.508 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_mark.ko 2023-12-05T09:29:49.508 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-12-05T09:29:49.508 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-12-05T09:29:49.508 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-12-05T09:29:49.508 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-12-05T09:29:49.508 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_snat.ko 2023-12-05T09:29:49.508 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_stp.ko 2023-12-05T09:29:49.508 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-12-05T09:29:49.509 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-12-05T09:29:49.509 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-12-05T09:29:49.509 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-12-05T09:29:49.509 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebtables.ko 2023-12-05T09:29:49.509 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-12-05T09:29:49.509 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-12-05T09:29:49.509 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-12-05T09:29:49.509 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ceph 2023-12-05T09:29:49.509 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ceph/libceph.ko 2023-12-05T09:29:49.509 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/core 2023-12-05T09:29:49.509 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/core/failover.ko 2023-12-05T09:29:49.509 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/core/pktgen.ko 2023-12-05T09:29:49.509 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/dccp 2023-12-05T09:29:49.509 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/dccp/dccp.ko 2023-12-05T09:29:49.509 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/dccp/dccp_diag.ko 2023-12-05T09:29:49.510 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/dccp/dccp_ipv4.ko 2023-12-05T09:29:49.510 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/dccp/dccp_ipv6.ko 2023-12-05T09:29:49.510 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/dns_resolver 2023-12-05T09:29:49.510 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/dns_resolver/dns_resolver.ko 2023-12-05T09:29:49.510 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/dsa 2023-12-05T09:29:49.510 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/dsa/dsa_core.ko 2023-12-05T09:29:49.510 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/dsa/tag_brcm.ko 2023-12-05T09:29:49.510 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/dsa/tag_dsa.ko 2023-12-05T09:29:49.510 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/dsa/tag_none.ko 2023-12-05T09:29:49.510 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/dsa/tag_trailer.ko 2023-12-05T09:29:49.510 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ieee802154 2023-12-05T09:29:49.510 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ieee802154/6lowpan 2023-12-05T09:29:49.510 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-12-05T09:29:49.510 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ieee802154/ieee802154.ko 2023-12-05T09:29:49.510 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ieee802154/ieee802154_socket.ko 2023-12-05T09:29:49.511 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4 2023-12-05T09:29:49.511 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/ah4.ko 2023-12-05T09:29:49.511 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/esp4.ko 2023-12-05T09:29:49.511 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/fou.ko 2023-12-05T09:29:49.511 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/gre.ko 2023-12-05T09:29:49.511 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/inet_diag.ko 2023-12-05T09:29:49.511 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/ip_gre.ko 2023-12-05T09:29:49.511 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/ip_tunnel.ko 2023-12-05T09:29:49.511 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/ip_vti.ko 2023-12-05T09:29:49.511 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/ipcomp.ko 2023-12-05T09:29:49.511 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/ipip.ko 2023-12-05T09:29:49.511 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter 2023-12-05T09:29:49.511 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/arp_tables.ko 2023-12-05T09:29:49.511 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-12-05T09:29:49.511 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-12-05T09:29:49.512 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-12-05T09:29:49.512 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-12-05T09:29:49.512 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-12-05T09:29:49.512 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-12-05T09:29:49.512 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-12-05T09:29:49.512 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-12-05T09:29:49.512 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-12-05T09:29:49.512 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/iptable_security.ko 2023-12-05T09:29:49.512 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-12-05T09:29:49.512 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-12-05T09:29:49.512 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-12-05T09:29:49.512 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-12-05T09:29:49.512 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-12-05T09:29:49.512 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-12-05T09:29:49.512 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-12-05T09:29:49.513 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-12-05T09:29:49.513 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-12-05T09:29:49.513 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-12-05T09:29:49.513 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_bic.ko 2023-12-05T09:29:49.513 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_dctcp.ko 2023-12-05T09:29:49.513 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_diag.ko 2023-12-05T09:29:49.513 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_highspeed.ko 2023-12-05T09:29:49.513 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_htcp.ko 2023-12-05T09:29:49.513 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_hybla.ko 2023-12-05T09:29:49.513 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_illinois.ko 2023-12-05T09:29:49.513 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_lp.ko 2023-12-05T09:29:49.513 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_scalable.ko 2023-12-05T09:29:49.513 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_vegas.ko 2023-12-05T09:29:49.513 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_veno.ko 2023-12-05T09:29:49.513 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_westwood.ko 2023-12-05T09:29:49.513 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_yeah.ko 2023-12-05T09:29:49.514 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tunnel4.ko 2023-12-05T09:29:49.514 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/udp_diag.ko 2023-12-05T09:29:49.514 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/udp_tunnel.ko 2023-12-05T09:29:49.514 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/xfrm4_tunnel.ko 2023-12-05T09:29:49.514 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6 2023-12-05T09:29:49.514 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/ah6.ko 2023-12-05T09:29:49.514 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/esp6.ko 2023-12-05T09:29:49.514 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/fou6.ko 2023-12-05T09:29:49.514 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/ip6_tunnel.ko 2023-12-05T09:29:49.514 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-12-05T09:29:49.514 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/ip6_vti.ko 2023-12-05T09:29:49.514 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/ipcomp6.ko 2023-12-05T09:29:49.514 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter 2023-12-05T09:29:49.514 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-12-05T09:29:49.514 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-12-05T09:29:49.515 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-12-05T09:29:49.515 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-12-05T09:29:49.515 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-12-05T09:29:49.515 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-12-05T09:29:49.515 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-12-05T09:29:49.515 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-12-05T09:29:49.515 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-12-05T09:29:49.515 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-12-05T09:29:49.515 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-12-05T09:29:49.515 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-12-05T09:29:49.515 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-12-05T09:29:49.515 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-12-05T09:29:49.515 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-12-05T09:29:49.515 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-12-05T09:29:49.515 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-12-05T09:29:49.516 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-12-05T09:29:49.516 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-12-05T09:29:49.516 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-12-05T09:29:49.516 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-12-05T09:29:49.516 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-12-05T09:29:49.516 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-12-05T09:29:49.516 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-12-05T09:29:49.516 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/sit.ko 2023-12-05T09:29:49.516 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/tunnel6.ko 2023-12-05T09:29:49.516 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/xfrm6_tunnel.ko 2023-12-05T09:29:49.516 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/key 2023-12-05T09:29:49.516 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/key/af_key.ko 2023-12-05T09:29:49.516 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/l2tp 2023-12-05T09:29:49.516 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/l2tp/l2tp_core.ko 2023-12-05T09:29:49.516 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/l2tp/l2tp_debugfs.ko 2023-12-05T09:29:49.517 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/l2tp/l2tp_eth.ko 2023-12-05T09:29:49.517 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/l2tp/l2tp_ip.ko 2023-12-05T09:29:49.517 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/l2tp/l2tp_ip6.ko 2023-12-05T09:29:49.517 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/l2tp/l2tp_netlink.ko 2023-12-05T09:29:49.517 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/l2tp/l2tp_ppp.ko 2023-12-05T09:29:49.517 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/llc 2023-12-05T09:29:49.517 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/llc/llc.ko 2023-12-05T09:29:49.517 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/mac802154 2023-12-05T09:29:49.517 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/mac802154/mac802154.ko 2023-12-05T09:29:49.517 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/mpls 2023-12-05T09:29:49.517 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/mpls/mpls_gso.ko 2023-12-05T09:29:49.517 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter 2023-12-05T09:29:49.517 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset 2023-12-05T09:29:49.517 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set.ko 2023-12-05T09:29:49.517 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-12-05T09:29:49.518 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-12-05T09:29:49.518 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-12-05T09:29:49.518 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-12-05T09:29:49.518 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-12-05T09:29:49.518 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-12-05T09:29:49.518 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-12-05T09:29:49.518 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-12-05T09:29:49.518 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-12-05T09:29:49.518 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-12-05T09:29:49.518 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-12-05T09:29:49.518 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-12-05T09:29:49.518 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-12-05T09:29:49.518 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-12-05T09:29:49.518 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-12-05T09:29:49.519 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs 2023-12-05T09:29:49.519 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs.ko 2023-12-05T09:29:49.519 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-12-05T09:29:49.519 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-12-05T09:29:49.519 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-12-05T09:29:49.519 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-12-05T09:29:49.519 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-12-05T09:29:49.519 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-12-05T09:29:49.519 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-12-05T09:29:49.519 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-12-05T09:29:49.519 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-12-05T09:29:49.519 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-12-05T09:29:49.519 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-12-05T09:29:49.519 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-12-05T09:29:49.519 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-12-05T09:29:49.519 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conncount.ko 2023-12-05T09:29:49.520 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack.ko 2023-12-05T09:29:49.520 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-12-05T09:29:49.520 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-12-05T09:29:49.520 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-12-05T09:29:49.520 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack_h323.ko 2023-12-05T09:29:49.520 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack_irc.ko 2023-12-05T09:29:49.520 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-12-05T09:29:49.520 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-12-05T09:29:49.520 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-12-05T09:29:49.520 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack_sane.ko 2023-12-05T09:29:49.520 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack_sip.ko 2023-12-05T09:29:49.520 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-12-05T09:29:49.520 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-12-05T09:29:49.520 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_dup_netdev.ko 2023-12-05T09:29:49.520 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_flow_table.ko 2023-12-05T09:29:49.521 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_flow_table_inet.ko 2023-12-05T09:29:49.521 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_log_syslog.ko 2023-12-05T09:29:49.521 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_nat.ko 2023-12-05T09:29:49.521 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_nat_amanda.ko 2023-12-05T09:29:49.521 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_nat_ftp.ko 2023-12-05T09:29:49.521 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_nat_irc.ko 2023-12-05T09:29:49.521 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_nat_sip.ko 2023-12-05T09:29:49.521 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_nat_tftp.ko 2023-12-05T09:29:49.521 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_synproxy_core.ko 2023-12-05T09:29:49.521 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_tables.ko 2023-12-05T09:29:49.521 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nfnetlink.ko 2023-12-05T09:29:49.521 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nfnetlink_acct.ko 2023-12-05T09:29:49.521 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nfnetlink_log.ko 2023-12-05T09:29:49.521 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nfnetlink_osf.ko 2023-12-05T09:29:49.521 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nfnetlink_queue.ko 2023-12-05T09:29:49.522 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_chain_nat.ko 2023-12-05T09:29:49.522 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_compat.ko 2023-12-05T09:29:49.522 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_ct.ko 2023-12-05T09:29:49.522 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_dup_netdev.ko 2023-12-05T09:29:49.522 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_fib.ko 2023-12-05T09:29:49.522 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_fwd_netdev.ko 2023-12-05T09:29:49.522 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_hash.ko 2023-12-05T09:29:49.522 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_limit.ko 2023-12-05T09:29:49.522 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_log.ko 2023-12-05T09:29:49.522 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_masq.ko 2023-12-05T09:29:49.522 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_nat.ko 2023-12-05T09:29:49.522 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_numgen.ko 2023-12-05T09:29:49.522 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_queue.ko 2023-12-05T09:29:49.522 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_quota.ko 2023-12-05T09:29:49.522 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_redir.ko 2023-12-05T09:29:49.523 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_reject.ko 2023-12-05T09:29:49.523 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_reject_inet.ko 2023-12-05T09:29:49.523 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_socket.ko 2023-12-05T09:29:49.523 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_tunnel.ko 2023-12-05T09:29:49.523 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_AUDIT.ko 2023-12-05T09:29:49.523 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_CHECKSUM.ko 2023-12-05T09:29:49.523 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_CLASSIFY.ko 2023-12-05T09:29:49.523 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-12-05T09:29:49.523 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_CT.ko 2023-12-05T09:29:49.523 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_DSCP.ko 2023-12-05T09:29:49.523 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_HL.ko 2023-12-05T09:29:49.523 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_HMARK.ko 2023-12-05T09:29:49.523 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_IDLETIMER.ko 2023-12-05T09:29:49.523 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_LED.ko 2023-12-05T09:29:49.523 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_LOG.ko 2023-12-05T09:29:49.524 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_MASQUERADE.ko 2023-12-05T09:29:49.524 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_NETMAP.ko 2023-12-05T09:29:49.524 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_NFLOG.ko 2023-12-05T09:29:49.524 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_NFQUEUE.ko 2023-12-05T09:29:49.524 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_RATEEST.ko 2023-12-05T09:29:49.524 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_REDIRECT.ko 2023-12-05T09:29:49.524 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_SECMARK.ko 2023-12-05T09:29:49.524 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_TCPMSS.ko 2023-12-05T09:29:49.524 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-12-05T09:29:49.524 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_TEE.ko 2023-12-05T09:29:49.524 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_TPROXY.ko 2023-12-05T09:29:49.524 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_TRACE.ko 2023-12-05T09:29:49.524 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_addrtype.ko 2023-12-05T09:29:49.524 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_bpf.ko 2023-12-05T09:29:49.524 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_cgroup.ko 2023-12-05T09:29:49.525 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_cluster.ko 2023-12-05T09:29:49.525 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_comment.ko 2023-12-05T09:29:49.525 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_connbytes.ko 2023-12-05T09:29:49.525 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_connlabel.ko 2023-12-05T09:29:49.525 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_connlimit.ko 2023-12-05T09:29:49.525 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_connmark.ko 2023-12-05T09:29:49.525 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_conntrack.ko 2023-12-05T09:29:49.525 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_cpu.ko 2023-12-05T09:29:49.525 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_dccp.ko 2023-12-05T09:29:49.525 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_devgroup.ko 2023-12-05T09:29:49.525 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_dscp.ko 2023-12-05T09:29:49.525 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_ecn.ko 2023-12-05T09:29:49.525 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_esp.ko 2023-12-05T09:29:49.525 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_hashlimit.ko 2023-12-05T09:29:49.525 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_helper.ko 2023-12-05T09:29:49.525 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_hl.ko 2023-12-05T09:29:49.526 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_ipcomp.ko 2023-12-05T09:29:49.526 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_iprange.ko 2023-12-05T09:29:49.526 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_ipvs.ko 2023-12-05T09:29:49.526 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_l2tp.ko 2023-12-05T09:29:49.526 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_length.ko 2023-12-05T09:29:49.526 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_limit.ko 2023-12-05T09:29:49.526 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_mac.ko 2023-12-05T09:29:49.526 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_mark.ko 2023-12-05T09:29:49.526 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_multiport.ko 2023-12-05T09:29:49.526 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_nat.ko 2023-12-05T09:29:49.526 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_nfacct.ko 2023-12-05T09:29:49.526 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_osf.ko 2023-12-05T09:29:49.526 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_owner.ko 2023-12-05T09:29:49.526 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_physdev.ko 2023-12-05T09:29:49.527 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_pkttype.ko 2023-12-05T09:29:49.527 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_policy.ko 2023-12-05T09:29:49.527 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_quota.ko 2023-12-05T09:29:49.527 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_rateest.ko 2023-12-05T09:29:49.527 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_realm.ko 2023-12-05T09:29:49.527 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_recent.ko 2023-12-05T09:29:49.527 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_sctp.ko 2023-12-05T09:29:49.527 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_set.ko 2023-12-05T09:29:49.527 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_socket.ko 2023-12-05T09:29:49.527 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_state.ko 2023-12-05T09:29:49.527 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_statistic.ko 2023-12-05T09:29:49.527 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_string.ko 2023-12-05T09:29:49.527 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_tcpmss.ko 2023-12-05T09:29:49.527 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_time.ko 2023-12-05T09:29:49.527 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_u32.ko 2023-12-05T09:29:49.528 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netlink 2023-12-05T09:29:49.528 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netlink/netlink_diag.ko 2023-12-05T09:29:49.528 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/nsh 2023-12-05T09:29:49.528 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/nsh/nsh.ko 2023-12-05T09:29:49.528 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/openvswitch 2023-12-05T09:29:49.528 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/openvswitch/openvswitch.ko 2023-12-05T09:29:49.528 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/openvswitch/vport-geneve.ko 2023-12-05T09:29:49.528 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/openvswitch/vport-gre.ko 2023-12-05T09:29:49.528 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/openvswitch/vport-vxlan.ko 2023-12-05T09:29:49.528 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/packet 2023-12-05T09:29:49.528 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/packet/af_packet_diag.ko 2023-12-05T09:29:49.528 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/rds 2023-12-05T09:29:49.528 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/rds/rds.ko 2023-12-05T09:29:49.528 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/rds/rds_rdma.ko 2023-12-05T09:29:49.529 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/rds/rds_tcp.ko 2023-12-05T09:29:49.529 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched 2023-12-05T09:29:49.529 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/act_csum.ko 2023-12-05T09:29:49.529 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/act_gact.ko 2023-12-05T09:29:49.529 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/act_ipt.ko 2023-12-05T09:29:49.529 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/act_mirred.ko 2023-12-05T09:29:49.529 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/act_nat.ko 2023-12-05T09:29:49.529 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/act_pedit.ko 2023-12-05T09:29:49.529 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/act_police.ko 2023-12-05T09:29:49.529 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/act_simple.ko 2023-12-05T09:29:49.529 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/act_skbedit.ko 2023-12-05T09:29:49.529 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/act_vlan.ko 2023-12-05T09:29:49.529 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/cls_basic.ko 2023-12-05T09:29:49.530 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/cls_bpf.ko 2023-12-05T09:29:49.530 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/cls_flow.ko 2023-12-05T09:29:49.530 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/cls_fw.ko 2023-12-05T09:29:49.530 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/cls_route.ko 2023-12-05T09:29:49.530 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/cls_u32.ko 2023-12-05T09:29:49.530 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/em_cmp.ko 2023-12-05T09:29:49.530 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/em_ipset.ko 2023-12-05T09:29:49.530 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/em_meta.ko 2023-12-05T09:29:49.530 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/em_nbyte.ko 2023-12-05T09:29:49.530 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/em_text.ko 2023-12-05T09:29:49.530 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/em_u32.ko 2023-12-05T09:29:49.530 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_choke.ko 2023-12-05T09:29:49.530 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_codel.ko 2023-12-05T09:29:49.531 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_drr.ko 2023-12-05T09:29:49.531 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_fq.ko 2023-12-05T09:29:49.531 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_gred.ko 2023-12-05T09:29:49.531 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_hfsc.ko 2023-12-05T09:29:49.531 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_hhf.ko 2023-12-05T09:29:49.531 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_htb.ko 2023-12-05T09:29:49.531 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_ingress.ko 2023-12-05T09:29:49.531 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_mqprio.ko 2023-12-05T09:29:49.531 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_mqprio_lib.ko 2023-12-05T09:29:49.531 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_multiq.ko 2023-12-05T09:29:49.531 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_netem.ko 2023-12-05T09:29:49.531 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_pie.ko 2023-12-05T09:29:49.531 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_plug.ko 2023-12-05T09:29:49.531 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_prio.ko 2023-12-05T09:29:49.531 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_qfq.ko 2023-12-05T09:29:49.532 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_red.ko 2023-12-05T09:29:49.532 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_sfb.ko 2023-12-05T09:29:49.532 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_sfq.ko 2023-12-05T09:29:49.532 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_tbf.ko 2023-12-05T09:29:49.532 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_teql.ko 2023-12-05T09:29:49.532 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sctp 2023-12-05T09:29:49.532 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sctp/sctp.ko 2023-12-05T09:29:49.532 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sctp/sctp_diag.ko 2023-12-05T09:29:49.532 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sunrpc 2023-12-05T09:29:49.532 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sunrpc/auth_gss 2023-12-05T09:29:49.532 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-12-05T09:29:49.532 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-12-05T09:29:49.532 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sunrpc/sunrpc.ko 2023-12-05T09:29:49.532 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sunrpc/xprtrdma 2023-12-05T09:29:49.533 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-12-05T09:29:49.533 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/tipc 2023-12-05T09:29:49.533 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/tipc/diag.ko 2023-12-05T09:29:49.533 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/tipc/tipc.ko 2023-12-05T09:29:49.533 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/unix 2023-12-05T09:29:49.533 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/unix/unix_diag.ko 2023-12-05T09:29:49.533 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/vmw_vsock 2023-12-05T09:29:49.533 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-12-05T09:29:49.533 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-12-05T09:29:49.533 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/vmw_vsock/vsock.ko 2023-12-05T09:29:49.533 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/vmw_vsock/vsock_diag.ko 2023-12-05T09:29:49.533 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/vmw_vsock/vsock_loopback.ko 2023-12-05T09:29:49.533 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/xfrm 2023-12-05T09:29:49.533 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/xfrm/xfrm_ipcomp.ko 2023-12-05T09:29:49.533 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/security 2023-12-05T09:29:49.534 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/security/keys 2023-12-05T09:29:49.534 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/security/keys/encrypted-keys 2023-12-05T09:29:49.534 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-12-05T09:29:49.534 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/security/keys/trusted-keys 2023-12-05T09:29:49.534 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/security/keys/trusted-keys/trusted.ko 2023-12-05T09:29:49.534 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/virt 2023-12-05T09:29:49.534 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/virt/lib 2023-12-05T09:29:49.534 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/virt/lib/irqbypass.ko 2023-12-05T09:29:49.534 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/modules.alias 2023-12-05T09:29:49.534 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/modules.alias.bin 2023-12-05T09:29:49.534 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/modules.builtin 2023-12-05T09:29:49.534 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/modules.builtin.bin 2023-12-05T09:29:49.534 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/modules.builtin.modinfo 2023-12-05T09:29:49.534 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/modules.dep 2023-12-05T09:29:49.534 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/modules.dep.bin 2023-12-05T09:29:49.535 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/modules.devname 2023-12-05T09:29:49.535 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/modules.order 2023-12-05T09:29:49.535 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/modules.softdep 2023-12-05T09:29:49.535 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/modules.symbols 2023-12-05T09:29:49.535 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.6.0-g9471594ae3a4/modules.symbols.bin 2023-12-05T09:29:49.535 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-g9471594ae3a4 2023-12-05T09:29:49.536 DEBUG:teuthology.orchestra.run.smithi150:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-12-05T09:29:49.561 INFO:teuthology.orchestra.run.smithi150.stdout:postinstall scriptlet (using /bin/sh): 2023-12-05T09:29:49.561 INFO:teuthology.orchestra.run.smithi150.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-g9471594ae3a4 -a -r /boot/System.map-6.6.0-g9471594ae3a4 ]; then 2023-12-05T09:29:49.561 INFO:teuthology.orchestra.run.smithi150.stdout:cp /boot/vmlinuz-6.6.0-g9471594ae3a4 /boot/.vmlinuz-6.6.0-g9471594ae3a4-rpm 2023-12-05T09:29:49.561 INFO:teuthology.orchestra.run.smithi150.stdout:cp /boot/System.map-6.6.0-g9471594ae3a4 /boot/.System.map-6.6.0-g9471594ae3a4-rpm 2023-12-05T09:29:49.561 INFO:teuthology.orchestra.run.smithi150.stdout:rm -f /boot/vmlinuz-6.6.0-g9471594ae3a4 /boot/System.map-6.6.0-g9471594ae3a4 2023-12-05T09:29:49.561 INFO:teuthology.orchestra.run.smithi150.stdout:/sbin/installkernel 6.6.0-g9471594ae3a4 /boot/.vmlinuz-6.6.0-g9471594ae3a4-rpm /boot/.System.map-6.6.0-g9471594ae3a4-rpm 2023-12-05T09:29:49.561 INFO:teuthology.orchestra.run.smithi150.stdout:rm -f /boot/.vmlinuz-6.6.0-g9471594ae3a4-rpm /boot/.System.map-6.6.0-g9471594ae3a4-rpm 2023-12-05T09:29:49.561 INFO:teuthology.orchestra.run.smithi150.stdout:fi 2023-12-05T09:29:49.561 INFO:teuthology.orchestra.run.smithi150.stdout:preuninstall scriptlet (using /bin/sh): 2023-12-05T09:29:49.561 INFO:teuthology.orchestra.run.smithi150.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-12-05T09:29:49.561 INFO:teuthology.orchestra.run.smithi150.stdout:new-kernel-pkg --remove 6.6.0-g9471594ae3a4 --rminitrd --initrdfile=/boot/initramfs-6.6.0-g9471594ae3a4.img 2023-12-05T09:29:49.561 INFO:teuthology.orchestra.run.smithi150.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-12-05T09:29:49.562 INFO:teuthology.orchestra.run.smithi150.stdout:kernel-install remove 6.6.0-g9471594ae3a4 2023-12-05T09:29:49.562 INFO:teuthology.orchestra.run.smithi150.stdout:fi 2023-12-05T09:29:49.562 INFO:teuthology.orchestra.run.smithi150.stdout:postuninstall scriptlet (using /bin/sh): 2023-12-05T09:29:49.562 INFO:teuthology.orchestra.run.smithi150.stdout:if [ -x /sbin/update-bootloader ]; then 2023-12-05T09:29:49.562 INFO:teuthology.orchestra.run.smithi150.stdout:/sbin/update-bootloader --remove 6.6.0-g9471594ae3a4 2023-12-05T09:29:49.562 INFO:teuthology.orchestra.run.smithi150.stdout:fi 2023-12-05T09:29:49.563 DEBUG:teuthology.orchestra.run.smithi150:> sudo rpm -qi grub2-tools 2023-12-05T09:29:49.639 INFO:teuthology.orchestra.run.smithi150.stdout:Name : grub2-tools 2023-12-05T09:29:49.639 INFO:teuthology.orchestra.run.smithi150.stdout:Epoch : 1 2023-12-05T09:29:49.639 INFO:teuthology.orchestra.run.smithi150.stdout:Version : 2.02 2023-12-05T09:29:49.639 INFO:teuthology.orchestra.run.smithi150.stdout:Release : 129.el8 2023-12-05T09:29:49.640 INFO:teuthology.orchestra.run.smithi150.stdout:Architecture: x86_64 2023-12-05T09:29:49.640 INFO:teuthology.orchestra.run.smithi150.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-12-05T09:29:49.640 INFO:teuthology.orchestra.run.smithi150.stdout:Group : System Environment/Base 2023-12-05T09:29:49.640 INFO:teuthology.orchestra.run.smithi150.stdout:Size : 9265586 2023-12-05T09:29:49.640 INFO:teuthology.orchestra.run.smithi150.stdout:License : GPLv3+ 2023-12-05T09:29:49.640 INFO:teuthology.orchestra.run.smithi150.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-12-05T09:29:49.640 INFO:teuthology.orchestra.run.smithi150.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-12-05T09:29:49.640 INFO:teuthology.orchestra.run.smithi150.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-12-05T09:29:49.640 INFO:teuthology.orchestra.run.smithi150.stdout:Build Host : kbuilder.bsys.centos.org 2023-12-05T09:29:49.640 INFO:teuthology.orchestra.run.smithi150.stdout:Relocations : (not relocatable) 2023-12-05T09:29:49.640 INFO:teuthology.orchestra.run.smithi150.stdout:Packager : CentOS BuildSystem 2023-12-05T09:29:49.640 INFO:teuthology.orchestra.run.smithi150.stdout:Vendor : CentOS 2023-12-05T09:29:49.640 INFO:teuthology.orchestra.run.smithi150.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-05T09:29:49.640 INFO:teuthology.orchestra.run.smithi150.stdout:Summary : Support tools for GRUB. 2023-12-05T09:29:49.640 INFO:teuthology.orchestra.run.smithi150.stdout:Description : 2023-12-05T09:29:49.641 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:29:49.641 INFO:teuthology.orchestra.run.smithi150.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-05T09:29:49.641 INFO:teuthology.orchestra.run.smithi150.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-05T09:29:49.641 INFO:teuthology.orchestra.run.smithi150.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-05T09:29:49.641 INFO:teuthology.orchestra.run.smithi150.stdout:hardware devices. 2023-12-05T09:29:49.641 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:29:49.641 INFO:teuthology.orchestra.run.smithi150.stdout:This subpackage provides tools for support of all platforms. 2023-12-05T09:29:49.642 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-05T09:29:49.642 INFO:teuthology.task.kernel:Updating grub on smithi150 to boot 6.6.0-g9471594ae3a4 2023-12-05T09:29:49.642 DEBUG:teuthology.orchestra.run.smithi150:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-05T09:29:54.006 INFO:teuthology.orchestra.run.smithi150.stderr:Generating grub configuration file ... 2023-12-05T09:29:56.359 INFO:teuthology.orchestra.run.smithi150.stderr:done 2023-12-05T09:29:56.362 DEBUG:teuthology.orchestra.run.smithi150:> mktemp 2023-12-05T09:29:56.385 INFO:teuthology.orchestra.run.smithi150.stdout:/tmp/tmp.v5y2dRLpJU 2023-12-05T09:29:56.385 DEBUG:teuthology.orchestra.run.smithi150:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.v5y2dRLpJU 2023-12-05T09:29:56.459 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 0666 /tmp/tmp.v5y2dRLpJU 2023-12-05T09:29:56.624 DEBUG:teuthology.orchestra.remote:smithi150:/tmp/tmp.v5y2dRLpJU is 6KB 2023-12-05T09:29:56.672 DEBUG:teuthology.orchestra.run.smithi150:> rm -fr /tmp/tmp.v5y2dRLpJU 2023-12-05T09:29:56.690 DEBUG:teuthology.orchestra.run.smithi150:> sudo /bin/ls /boot/loader/entries || true 2023-12-05T09:29:56.767 INFO:teuthology.orchestra.run.smithi150.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-12-05T09:29:56.767 INFO:teuthology.orchestra.run.smithi150.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-12-05T09:29:56.768 INFO:teuthology.orchestra.run.smithi150.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-12-05T09:29:56.768 INFO:teuthology.orchestra.run.smithi150.stdout:a1b29d6c289747bdb22930598d39874a-6.6.0-g9471594ae3a4.conf 2023-12-05T09:29:56.769 DEBUG:teuthology.orchestra.run.smithi150:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-6.6.0-g9471594ae3a4 2023-12-05T09:29:56.958 DEBUG:teuthology.orchestra.run.smithi150:> sudo shutdown -r now 2023-12-05T09:30:16.915 DEBUG:teuthology.orchestra.remote:timed out 2023-12-05T09:30:25.925 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2023-12-05T09:30:25.926 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T09:30:26.961 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2023-12-05T09:30:26.961 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2023-12-05T09:30:26.962 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T09:30:27.232 DEBUG:teuthology.orchestra.run.smithi100:> true 2023-12-05T09:30:27.675 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi100.front.sepia.ceph.com' 2023-12-05T09:30:27.675 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "6.6.0-g9471594ae3a4"... 2023-12-05T09:30:27.675 DEBUG:teuthology.orchestra.run.smithi100:> uname -r 2023-12-05T09:30:27.721 INFO:teuthology.orchestra.run.smithi100.stdout:6.6.0-g9471594ae3a4 2023-12-05T09:30:27.721 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-g9471594ae3a4 vs 6.6.0-g9471594ae3a4 2023-12-05T09:30:27.722 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-05T09:30:27.722 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-05T09:30:28.723 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2023-12-05T09:30:28.723 DEBUG:teuthology.orchestra.run.smithi100:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-05T09:30:28.858 INFO:teuthology.orchestra.run.smithi100.stdout:ttyS1 2023-12-05T09:30:28.890 DEBUG:teuthology.parallel:result is None 2023-12-05T09:31:01.606 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.150 2023-12-05T09:31:10.607 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2023-12-05T09:31:10.608 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T09:32:10.610 DEBUG:teuthology.orchestra.remote:timed out 2023-12-05T09:32:22.611 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2023-12-05T09:32:22.612 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T09:32:23.195 DEBUG:teuthology.orchestra.run.smithi150:> true 2023-12-05T09:32:23.622 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi150.front.sepia.ceph.com' 2023-12-05T09:32:23.622 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "6.6.0-g9471594ae3a4"... 2023-12-05T09:32:23.622 DEBUG:teuthology.orchestra.run.smithi150:> uname -r 2023-12-05T09:32:23.668 INFO:teuthology.orchestra.run.smithi150.stdout:6.6.0-g9471594ae3a4 2023-12-05T09:32:23.668 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-g9471594ae3a4 vs 6.6.0-g9471594ae3a4 2023-12-05T09:32:23.668 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-05T09:32:23.668 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-05T09:32:24.669 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2023-12-05T09:32:24.669 DEBUG:teuthology.orchestra.run.smithi150:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-05T09:32:24.789 INFO:teuthology.orchestra.run.smithi150.stdout:ttyS1 2023-12-05T09:32:24.810 DEBUG:teuthology.parallel:result is None 2023-12-05T09:32:24.811 INFO:teuthology.run_tasks:Running task internal.base... 2023-12-05T09:32:24.817 INFO:teuthology.task.internal:Creating test directory... 2023-12-05T09:32:24.818 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-05T09:32:24.823 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-05T09:32:24.871 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-12-05T09:32:24.878 INFO:teuthology.run_tasks:Running task internal.archive... 2023-12-05T09:32:24.889 INFO:teuthology.task.internal:Creating archive directory... 2023-12-05T09:32:24.889 DEBUG:teuthology.orchestra.run.smithi100:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-05T09:32:24.894 DEBUG:teuthology.orchestra.run.smithi150:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-05T09:32:24.954 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-12-05T09:32:24.960 INFO:teuthology.task.internal:Enabling coredump saving... 2023-12-05T09:32:24.961 DEBUG:teuthology.orchestra.run.smithi100:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-05T09:32:24.965 DEBUG:teuthology.orchestra.run.smithi150:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-05T09:32:25.043 INFO:teuthology.orchestra.run.smithi150.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-05T09:32:25.057 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-05T09:32:25.069 INFO:teuthology.orchestra.run.smithi150.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-05T09:32:25.083 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-05T09:32:25.087 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-12-05T09:32:25.096 INFO:teuthology.task.internal:Configuring sudo... 2023-12-05T09:32:25.096 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-05T09:32:25.100 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-05T09:32:25.170 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-12-05T09:32:25.179 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-12-05T09:32:25.179 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-05T09:32:25.183 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-05T09:32:25.229 DEBUG:teuthology.orchestra.run.smithi100:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-05T09:32:25.340 DEBUG:teuthology.orchestra.run.smithi100:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-05T09:32:25.416 DEBUG:teuthology.orchestra.run.smithi100:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-05T09:32:25.485 DEBUG:teuthology.orchestra.run.smithi100:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-05T09:32:25.555 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-12-05T09:32:25.555 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-05T09:32:25.625 DEBUG:teuthology.orchestra.run.smithi150:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-05T09:32:25.703 DEBUG:teuthology.orchestra.run.smithi150:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-05T09:32:25.772 DEBUG:teuthology.orchestra.run.smithi150:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-05T09:32:25.847 DEBUG:teuthology.orchestra.run.smithi150:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-05T09:32:25.917 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-12-05T09:32:25.917 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-05T09:32:25.987 DEBUG:teuthology.orchestra.run.smithi100:> sudo service rsyslog restart 2023-12-05T09:32:25.991 DEBUG:teuthology.orchestra.run.smithi150:> sudo service rsyslog restart 2023-12-05T09:32:26.118 INFO:teuthology.orchestra.run.smithi100.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-05T09:32:26.156 INFO:teuthology.orchestra.run.smithi150.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-05T09:32:26.426 INFO:teuthology.run_tasks:Running task internal.timer... 2023-12-05T09:32:26.434 INFO:teuthology.task.internal:Starting timer... 2023-12-05T09:32:26.434 INFO:teuthology.run_tasks:Running task pcp... 2023-12-05T09:32:26.444 INFO:teuthology.run_tasks:Running task selinux... 2023-12-05T09:32:26.451 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-12-05T09:32:26.452 DEBUG:teuthology.orchestra.run.smithi100:> sudo service auditd rotate 2023-12-05T09:32:26.600 INFO:teuthology.orchestra.run.smithi100.stdout:Rotating logs: 2023-12-05T09:32:26.604 DEBUG:teuthology.orchestra.run.smithi150:> sudo service auditd rotate 2023-12-05T09:32:26.752 INFO:teuthology.orchestra.run.smithi150.stdout:Rotating logs: 2023-12-05T09:32:26.755 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-12-05T09:32:26.756 DEBUG:teuthology.orchestra.run.smithi100:> /usr/sbin/getenforce 2023-12-05T09:32:26.813 INFO:teuthology.orchestra.run.smithi100.stdout:Permissive 2023-12-05T09:32:26.814 DEBUG:teuthology.orchestra.run.smithi150:> /usr/sbin/getenforce 2023-12-05T09:32:26.866 INFO:teuthology.orchestra.run.smithi150.stdout:Permissive 2023-12-05T09:32:26.866 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi100.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi150.front.sepia.ceph.com': 'permissive'} 2023-12-05T09:32:26.866 DEBUG:teuthology.orchestra.run.smithi100:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-05T09:32:26.940 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-05T09:32:26.941 DEBUG:teuthology.orchestra.run.smithi150:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-05T09:32:27.012 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-05T09:32:27.012 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-12-05T09:32:27.012 DEBUG:teuthology.orchestra.run.smithi100:> sudo /usr/sbin/setenforce permissive 2023-12-05T09:32:27.081 DEBUG:teuthology.orchestra.run.smithi150:> sudo /usr/sbin/setenforce permissive 2023-12-05T09:32:27.150 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-12-05T09:32:27.160 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-12-05T09:32:27.160 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-12-05T09:32:27.178 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-12-05T09:32:27.179 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi100.front.sepia.ceph.com,smithi150.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-12-05T09:43:14.879 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi100.front.sepia.ceph.com'), Remote(name='ubuntu@smithi150.front.sepia.ceph.com')] 2023-12-05T09:43:14.880 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2023-12-05T09:43:14.881 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T09:43:14.970 DEBUG:teuthology.orchestra.run.smithi100:> true 2023-12-05T09:43:15.083 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi100.front.sepia.ceph.com' 2023-12-05T09:43:15.084 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2023-12-05T09:43:15.084 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T09:43:15.167 DEBUG:teuthology.orchestra.run.smithi150:> true 2023-12-05T09:43:15.284 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi150.front.sepia.ceph.com' 2023-12-05T09:43:15.285 INFO:teuthology.run_tasks:Running task clock... 2023-12-05T09:43:15.297 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-12-05T09:43:15.297 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-05T09:43:15.298 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-05T09:43:15.302 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-05T09:43:15.302 DEBUG:teuthology.orchestra.run.smithi150:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-05T09:43:15.372 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-05T09:43:15.377 INFO:teuthology.orchestra.run.smithi150.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-05T09:43:15.405 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-05T09:43:15.410 INFO:teuthology.orchestra.run.smithi150.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-05T09:43:15.492 INFO:teuthology.orchestra.run.smithi100.stderr:sudo: ntpd: command not found 2023-12-05T09:43:15.497 INFO:teuthology.orchestra.run.smithi150.stderr:sudo: ntpd: command not found 2023-12-05T09:43:15.519 INFO:teuthology.orchestra.run.smithi100.stdout:506 Cannot talk to daemon 2023-12-05T09:43:15.526 INFO:teuthology.orchestra.run.smithi150.stdout:506 Cannot talk to daemon 2023-12-05T09:43:15.551 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-05T09:43:15.558 INFO:teuthology.orchestra.run.smithi150.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-05T09:43:15.584 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-05T09:43:15.591 INFO:teuthology.orchestra.run.smithi150.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-05T09:43:15.667 INFO:teuthology.orchestra.run.smithi100.stderr:bash: ntpq: command not found 2023-12-05T09:43:15.675 INFO:teuthology.orchestra.run.smithi100.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-05T09:43:15.675 INFO:teuthology.orchestra.run.smithi100.stdout:=============================================================================== 2023-12-05T09:43:15.675 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-05T09:43:15.675 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-05T09:43:15.675 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-05T09:43:15.675 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-05T09:43:15.677 INFO:teuthology.orchestra.run.smithi150.stderr:bash: ntpq: command not found 2023-12-05T09:43:15.684 INFO:teuthology.orchestra.run.smithi150.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-05T09:43:15.685 INFO:teuthology.orchestra.run.smithi150.stdout:=============================================================================== 2023-12-05T09:43:15.685 INFO:teuthology.orchestra.run.smithi150.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-05T09:43:15.685 INFO:teuthology.orchestra.run.smithi150.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-05T09:43:15.685 INFO:teuthology.orchestra.run.smithi150.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-05T09:43:15.685 INFO:teuthology.orchestra.run.smithi150.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-05T09:43:15.686 INFO:teuthology.run_tasks:Running task pexec... 2023-12-05T09:43:15.701 INFO:teuthology.task.pexec:Executing custom commands... 2023-12-05T09:43:15.701 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi100.front.sepia.ceph.com 2023-12-05T09:43:15.701 DEBUG:teuthology.orchestra.run.smithi100:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-12-05T09:43:15.702 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi150.front.sepia.ceph.com 2023-12-05T09:43:15.702 DEBUG:teuthology.orchestra.run.smithi150:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-12-05T09:43:16.776 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:02:04 ago on Tue 05 Dec 2023 09:41:12 AM UTC. 2023-12-05T09:43:16.781 INFO:teuthology.orchestra.run.smithi150.stdout:Last metadata expiration check: 0:02:04 ago on Tue 05 Dec 2023 09:41:12 AM UTC. 2023-12-05T09:43:18.978 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2023-12-05T09:43:18.979 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2023-12-05T09:43:18.979 INFO:teuthology.orchestra.run.smithi150.stdout: Package Architecture Version Repository Size 2023-12-05T09:43:18.979 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2023-12-05T09:43:18.979 INFO:teuthology.orchestra.run.smithi150.stdout:Resetting modules: 2023-12-05T09:43:18.979 INFO:teuthology.orchestra.run.smithi150.stdout: container-tools 2023-12-05T09:43:18.979 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:43:18.979 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction Summary 2023-12-05T09:43:18.979 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2023-12-05T09:43:18.979 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:43:19.087 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2023-12-05T09:43:19.088 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2023-12-05T09:43:19.088 INFO:teuthology.orchestra.run.smithi100.stdout: Package Architecture Version Repository Size 2023-12-05T09:43:19.088 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2023-12-05T09:43:19.089 INFO:teuthology.orchestra.run.smithi100.stdout:Resetting modules: 2023-12-05T09:43:19.089 INFO:teuthology.orchestra.run.smithi100.stdout: container-tools 2023-12-05T09:43:19.089 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:43:19.089 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2023-12-05T09:43:19.089 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2023-12-05T09:43:19.089 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:43:19.251 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2023-12-05T09:43:19.353 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2023-12-05T09:43:20.385 INFO:teuthology.orchestra.run.smithi150.stdout:Last metadata expiration check: 0:02:08 ago on Tue 05 Dec 2023 09:41:12 AM UTC. 2023-12-05T09:43:20.484 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:02:08 ago on Tue 05 Dec 2023 09:41:12 AM UTC. 2023-12-05T09:43:22.609 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2023-12-05T09:43:22.669 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2023-12-05T09:43:22.803 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2023-12-05T09:43:22.803 INFO:teuthology.orchestra.run.smithi150.stdout: Package Arch Version Repository Size 2023-12-05T09:43:22.803 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2023-12-05T09:43:22.803 INFO:teuthology.orchestra.run.smithi150.stdout:Installing group/module packages: 2023-12-05T09:43:22.803 INFO:teuthology.orchestra.run.smithi150.stdout: aardvark-dns x86_64 2:1.8.0-1.module_el8+712+4cd1bd69 appstream 1.0 M 2023-12-05T09:43:22.803 INFO:teuthology.orchestra.run.smithi150.stdout: buildah x86_64 1:1.32.0-1.module_el8+712+4cd1bd69 appstream 9.6 M 2023-12-05T09:43:22.803 INFO:teuthology.orchestra.run.smithi150.stdout: cockpit-podman noarch 78-1.module_el8+712+4cd1bd69 appstream 750 k 2023-12-05T09:43:22.803 INFO:teuthology.orchestra.run.smithi150.stdout: crun x86_64 1.9.2-1.module_el8+712+4cd1bd69 appstream 241 k 2023-12-05T09:43:22.803 INFO:teuthology.orchestra.run.smithi150.stdout: netavark x86_64 2:1.8.0-2.module_el8+712+4cd1bd69 appstream 3.9 M 2023-12-05T09:43:22.803 INFO:teuthology.orchestra.run.smithi150.stdout: python3-podman noarch 4.7.0-1.module_el8+712+4cd1bd69 appstream 178 k 2023-12-05T09:43:22.803 INFO:teuthology.orchestra.run.smithi150.stdout: skopeo x86_64 2:1.13.3-1.module_el8+712+4cd1bd69 appstream 8.1 M 2023-12-05T09:43:22.804 INFO:teuthology.orchestra.run.smithi150.stdout: toolbox x86_64 0.0.99.4-6.module_el8+712+4cd1bd69 appstream 2.5 M 2023-12-05T09:43:22.804 INFO:teuthology.orchestra.run.smithi150.stdout: udica noarch 0.2.6-20.module_el8+712+4cd1bd69 appstream 53 k 2023-12-05T09:43:22.804 INFO:teuthology.orchestra.run.smithi150.stdout:Installing dependencies: 2023-12-05T09:43:22.804 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 appstream 25 k 2023-12-05T09:43:22.804 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyxdg noarch 0.25-16.el8 appstream 94 k 2023-12-05T09:43:22.804 INFO:teuthology.orchestra.run.smithi150.stdout: yajl x86_64 2.1.0-12.el8 appstream 41 k 2023-12-05T09:43:22.804 INFO:teuthology.orchestra.run.smithi150.stdout:Installing weak dependencies: 2023-12-05T09:43:22.804 INFO:teuthology.orchestra.run.smithi150.stdout: criu-libs x86_64 3.15-3.module_el8.7.0+1216+b022c01d appstream 38 k 2023-12-05T09:43:22.804 INFO:teuthology.orchestra.run.smithi150.stdout:Installing module profiles: 2023-12-05T09:43:22.804 INFO:teuthology.orchestra.run.smithi150.stdout: container-tools/common 2023-12-05T09:43:22.804 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:43:22.804 INFO:teuthology.orchestra.run.smithi150.stdout:Enabling module streams: 2023-12-05T09:43:22.804 INFO:teuthology.orchestra.run.smithi150.stdout: container-tools rhel8 2023-12-05T09:43:22.804 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:43:22.804 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction Summary 2023-12-05T09:43:22.805 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2023-12-05T09:43:22.805 INFO:teuthology.orchestra.run.smithi150.stdout:Install 13 Packages 2023-12-05T09:43:22.805 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:43:22.805 INFO:teuthology.orchestra.run.smithi150.stdout:Total download size: 27 M 2023-12-05T09:43:22.805 INFO:teuthology.orchestra.run.smithi150.stdout:Installed size: 89 M 2023-12-05T09:43:22.805 INFO:teuthology.orchestra.run.smithi150.stdout:Downloading Packages: 2023-12-05T09:43:22.862 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2023-12-05T09:43:22.862 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repository Size 2023-12-05T09:43:22.862 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2023-12-05T09:43:22.862 INFO:teuthology.orchestra.run.smithi100.stdout:Installing group/module packages: 2023-12-05T09:43:22.862 INFO:teuthology.orchestra.run.smithi100.stdout: aardvark-dns x86_64 2:1.8.0-1.module_el8+712+4cd1bd69 appstream 1.0 M 2023-12-05T09:43:22.862 INFO:teuthology.orchestra.run.smithi100.stdout: buildah x86_64 1:1.32.0-1.module_el8+712+4cd1bd69 appstream 9.6 M 2023-12-05T09:43:22.862 INFO:teuthology.orchestra.run.smithi100.stdout: cockpit-podman noarch 78-1.module_el8+712+4cd1bd69 appstream 750 k 2023-12-05T09:43:22.862 INFO:teuthology.orchestra.run.smithi100.stdout: crun x86_64 1.9.2-1.module_el8+712+4cd1bd69 appstream 241 k 2023-12-05T09:43:22.862 INFO:teuthology.orchestra.run.smithi100.stdout: netavark x86_64 2:1.8.0-2.module_el8+712+4cd1bd69 appstream 3.9 M 2023-12-05T09:43:22.863 INFO:teuthology.orchestra.run.smithi100.stdout: python3-podman noarch 4.7.0-1.module_el8+712+4cd1bd69 appstream 178 k 2023-12-05T09:43:22.863 INFO:teuthology.orchestra.run.smithi100.stdout: skopeo x86_64 2:1.13.3-1.module_el8+712+4cd1bd69 appstream 8.1 M 2023-12-05T09:43:22.863 INFO:teuthology.orchestra.run.smithi100.stdout: toolbox x86_64 0.0.99.4-6.module_el8+712+4cd1bd69 appstream 2.5 M 2023-12-05T09:43:22.863 INFO:teuthology.orchestra.run.smithi100.stdout: udica noarch 0.2.6-20.module_el8+712+4cd1bd69 appstream 53 k 2023-12-05T09:43:22.863 INFO:teuthology.orchestra.run.smithi100.stdout:Installing dependencies: 2023-12-05T09:43:22.863 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 appstream 25 k 2023-12-05T09:43:22.863 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyxdg noarch 0.25-16.el8 appstream 94 k 2023-12-05T09:43:22.863 INFO:teuthology.orchestra.run.smithi100.stdout: yajl x86_64 2.1.0-12.el8 appstream 41 k 2023-12-05T09:43:22.863 INFO:teuthology.orchestra.run.smithi100.stdout:Installing weak dependencies: 2023-12-05T09:43:22.863 INFO:teuthology.orchestra.run.smithi100.stdout: criu-libs x86_64 3.15-3.module_el8.7.0+1216+b022c01d appstream 38 k 2023-12-05T09:43:22.863 INFO:teuthology.orchestra.run.smithi100.stdout:Installing module profiles: 2023-12-05T09:43:22.863 INFO:teuthology.orchestra.run.smithi100.stdout: container-tools/common 2023-12-05T09:43:22.863 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:43:22.863 INFO:teuthology.orchestra.run.smithi100.stdout:Enabling module streams: 2023-12-05T09:43:22.863 INFO:teuthology.orchestra.run.smithi100.stdout: container-tools rhel8 2023-12-05T09:43:22.863 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:43:22.864 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2023-12-05T09:43:22.864 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2023-12-05T09:43:22.864 INFO:teuthology.orchestra.run.smithi100.stdout:Install 13 Packages 2023-12-05T09:43:22.864 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:43:22.864 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 27 M 2023-12-05T09:43:22.864 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 89 M 2023-12-05T09:43:22.864 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2023-12-05T09:43:23.111 INFO:teuthology.orchestra.run.smithi150.stdout:(1/13): aardvark-dns-1.8.0-1.module_el8+712+4cd 3.8 MB/s | 1.0 MB 00:00 2023-12-05T09:43:23.145 INFO:teuthology.orchestra.run.smithi150.stdout:(2/13): cockpit-podman-78-1.module_el8+712+4cd1 2.5 MB/s | 750 kB 00:00 2023-12-05T09:43:23.170 INFO:teuthology.orchestra.run.smithi150.stdout:(3/13): criu-libs-3.15-3.module_el8.7.0+1216+b0 649 kB/s | 38 kB 00:00 2023-12-05T09:43:23.204 INFO:teuthology.orchestra.run.smithi150.stdout:(4/13): crun-1.9.2-1.module_el8+712+4cd1bd69.x8 4.0 MB/s | 241 kB 00:00 2023-12-05T09:43:23.329 INFO:teuthology.orchestra.run.smithi150.stdout:(5/13): python3-podman-4.7.0-1.module_el8+712+4 1.4 MB/s | 178 kB 00:00 2023-12-05T09:43:23.405 INFO:teuthology.orchestra.run.smithi150.stdout:(6/13): netavark-1.8.0-2.module_el8+712+4cd1bd6 17 MB/s | 3.9 MB 00:00 2023-12-05T09:43:23.430 INFO:teuthology.orchestra.run.smithi150.stdout:(7/13): python3-pytoml-0.1.14-5.git7dea353.el8. 248 kB/s | 25 kB 00:00 2023-12-05T09:43:23.454 INFO:teuthology.orchestra.run.smithi100.stdout:(1/13): cockpit-podman-78-1.module_el8+712+4cd1 1.9 MB/s | 750 kB 00:00 2023-12-05T09:43:23.455 INFO:teuthology.orchestra.run.smithi150.stdout:(8/13): python3-pyxdg-0.25-16.el8.noarch.rpm 1.8 MB/s | 94 kB 00:00 2023-12-05T09:43:23.496 INFO:teuthology.orchestra.run.smithi100.stdout:(2/13): aardvark-dns-1.8.0-1.module_el8+712+4cd 2.3 MB/s | 1.0 MB 00:00 2023-12-05T09:43:23.530 INFO:teuthology.orchestra.run.smithi100.stdout:(3/13): criu-libs-3.15-3.module_el8.7.0+1216+b0 503 kB/s | 38 kB 00:00 2023-12-05T09:43:23.580 INFO:teuthology.orchestra.run.smithi100.stdout:(4/13): crun-1.9.2-1.module_el8+712+4cd1bd69.x8 2.8 MB/s | 241 kB 00:00 2023-12-05T09:43:23.639 INFO:teuthology.orchestra.run.smithi100.stdout:(5/13): python3-podman-4.7.0-1.module_el8+712+4 3.0 MB/s | 178 kB 00:00 2023-12-05T09:43:23.647 INFO:teuthology.orchestra.run.smithi150.stdout:(9/13): buildah-1.32.0-1.module_el8+712+4cd1bd6 12 MB/s | 9.6 MB 00:00 2023-12-05T09:43:23.698 INFO:teuthology.orchestra.run.smithi100.stdout:(6/13): python3-pytoml-0.1.14-5.git7dea353.el8. 426 kB/s | 25 kB 00:00 2023-12-05T09:43:23.714 INFO:teuthology.orchestra.run.smithi150.stdout:(10/13): toolbox-0.0.99.4-6.module_el8+712+4cd1 9.8 MB/s | 2.5 MB 00:00 2023-12-05T09:43:23.739 INFO:teuthology.orchestra.run.smithi150.stdout:(11/13): udica-0.2.6-20.module_el8+712+4cd1bd69 575 kB/s | 53 kB 00:00 2023-12-05T09:43:23.756 INFO:teuthology.orchestra.run.smithi100.stdout:(7/13): python3-pyxdg-0.25-16.el8.noarch.rpm 1.6 MB/s | 94 kB 00:00 2023-12-05T09:43:23.773 INFO:teuthology.orchestra.run.smithi150.stdout:(12/13): yajl-2.1.0-12.el8.x86_64.rpm 702 kB/s | 41 kB 00:00 2023-12-05T09:43:23.940 INFO:teuthology.orchestra.run.smithi150.stdout:(13/13): skopeo-1.13.3-1.module_el8+712+4cd1bd6 16 MB/s | 8.1 MB 00:00 2023-12-05T09:43:23.940 INFO:teuthology.orchestra.run.smithi150.stdout:-------------------------------------------------------------------------------- 2023-12-05T09:43:23.940 INFO:teuthology.orchestra.run.smithi150.stdout:Total 23 MB/s | 27 MB 00:01 2023-12-05T09:43:24.174 INFO:teuthology.orchestra.run.smithi100.stdout:(8/13): netavark-1.8.0-2.module_el8+712+4cd1bd6 6.1 MB/s | 3.9 MB 00:00 2023-12-05T09:43:24.376 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction check 2023-12-05T09:43:24.402 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction check succeeded. 2023-12-05T09:43:24.402 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction test 2023-12-05T09:43:24.416 INFO:teuthology.orchestra.run.smithi100.stdout:(9/13): toolbox-0.0.99.4-6.module_el8+712+4cd1b 10 MB/s | 2.5 MB 00:00 2023-12-05T09:43:24.482 INFO:teuthology.orchestra.run.smithi100.stdout:(10/13): udica-0.2.6-20.module_el8+712+4cd1bd69 792 kB/s | 53 kB 00:00 2023-12-05T09:43:24.591 INFO:teuthology.orchestra.run.smithi100.stdout:(11/13): skopeo-1.13.3-1.module_el8+712+4cd1bd6 9.8 MB/s | 8.1 MB 00:00 2023-12-05T09:43:24.616 INFO:teuthology.orchestra.run.smithi100.stdout:(12/13): yajl-2.1.0-12.el8.x86_64.rpm 306 kB/s | 41 kB 00:00 2023-12-05T09:43:24.660 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction test succeeded. 2023-12-05T09:43:24.664 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction 2023-12-05T09:43:24.725 INFO:teuthology.orchestra.run.smithi100.stdout:(13/13): buildah-1.32.0-1.module_el8+712+4cd1bd 5.8 MB/s | 9.6 MB 00:01 2023-12-05T09:43:24.725 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2023-12-05T09:43:24.725 INFO:teuthology.orchestra.run.smithi100.stdout:Total 14 MB/s | 27 MB 00:01 2023-12-05T09:43:25.161 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2023-12-05T09:43:25.187 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2023-12-05T09:43:25.187 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2023-12-05T09:43:25.383 INFO:teuthology.orchestra.run.smithi150.stdout: Preparing : 1/1 2023-12-05T09:43:25.461 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2023-12-05T09:43:25.465 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2023-12-05T09:43:25.604 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : yajl-2.1.0-12.el8.x86_64 1/13 2023-12-05T09:43:25.747 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 2/13 2023-12-05T09:43:25.929 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/13 2023-12-05T09:43:26.161 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2023-12-05T09:43:26.164 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2023-12-05T09:43:26.400 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : yajl-2.1.0-12.el8.x86_64 1/13 2023-12-05T09:43:26.568 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 2/13 2023-12-05T09:43:26.775 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86 5/13 2023-12-05T09:43:26.793 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/13 2023-12-05T09:43:27.058 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2023-12-05T09:43:27.677 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86 5/13 2023-12-05T09:43:27.801 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 6/13 2023-12-05T09:43:28.044 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 7/13 2023-12-05T09:43:28.282 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 8/13 2023-12-05T09:43:28.594 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noa 9/13 2023-12-05T09:43:28.713 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 6/13 2023-12-05T09:43:29.107 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 7/13 2023-12-05T09:43:29.115 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 10/13 2023-12-05T09:43:29.374 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 8/13 2023-12-05T09:43:29.624 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noa 9/13 2023-12-05T09:43:30.040 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 11/13 2023-12-05T09:43:30.068 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 10/13 2023-12-05T09:43:30.255 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 12/13 2023-12-05T09:43:30.427 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 13/13 2023-12-05T09:43:31.051 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 11/13 2023-12-05T09:43:31.084 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 13/13 2023-12-05T09:43:31.084 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86 1/13 2023-12-05T09:43:31.084 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 2/13 2023-12-05T09:43:31.084 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 3/13 2023-12-05T09:43:31.084 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2023-12-05T09:43:31.084 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 5/13 2023-12-05T09:43:31.084 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 6/13 2023-12-05T09:43:31.084 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noa 7/13 2023-12-05T09:43:31.085 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 8/13 2023-12-05T09:43:31.085 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 9/13 2023-12-05T09:43:31.085 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 10/13 2023-12-05T09:43:31.085 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 11/13 2023-12-05T09:43:31.085 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 12/13 2023-12-05T09:43:31.288 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 12/13 2023-12-05T09:43:31.482 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 13/13 2023-12-05T09:43:31.936 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 13/13 2023-12-05T09:43:31.936 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:43:31.937 INFO:teuthology.orchestra.run.smithi150.stdout:Installed: 2023-12-05T09:43:31.937 INFO:teuthology.orchestra.run.smithi150.stdout: aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86_64 2023-12-05T09:43:31.937 INFO:teuthology.orchestra.run.smithi150.stdout: buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 2023-12-05T09:43:31.937 INFO:teuthology.orchestra.run.smithi150.stdout: cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 2023-12-05T09:43:31.937 INFO:teuthology.orchestra.run.smithi150.stdout: criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 2023-12-05T09:43:31.937 INFO:teuthology.orchestra.run.smithi150.stdout: crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 2023-12-05T09:43:31.937 INFO:teuthology.orchestra.run.smithi150.stdout: netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 2023-12-05T09:43:31.937 INFO:teuthology.orchestra.run.smithi150.stdout: python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noarch 2023-12-05T09:43:31.937 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-12-05T09:43:31.937 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-12-05T09:43:31.938 INFO:teuthology.orchestra.run.smithi150.stdout: skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 2023-12-05T09:43:31.938 INFO:teuthology.orchestra.run.smithi150.stdout: toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 2023-12-05T09:43:31.938 INFO:teuthology.orchestra.run.smithi150.stdout: udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 2023-12-05T09:43:31.938 INFO:teuthology.orchestra.run.smithi150.stdout: yajl-2.1.0-12.el8.x86_64 2023-12-05T09:43:31.938 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:43:31.938 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2023-12-05T09:43:32.136 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 13/13 2023-12-05T09:43:32.136 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86 1/13 2023-12-05T09:43:32.136 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 2/13 2023-12-05T09:43:32.136 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 3/13 2023-12-05T09:43:32.137 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2023-12-05T09:43:32.137 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 5/13 2023-12-05T09:43:32.137 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 6/13 2023-12-05T09:43:32.137 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noa 7/13 2023-12-05T09:43:32.137 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 8/13 2023-12-05T09:43:32.137 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 9/13 2023-12-05T09:43:32.137 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 10/13 2023-12-05T09:43:32.137 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 11/13 2023-12-05T09:43:32.137 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 12/13 2023-12-05T09:43:32.172 DEBUG:teuthology.parallel:result is None 2023-12-05T09:43:33.026 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 13/13 2023-12-05T09:43:33.026 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:43:33.026 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2023-12-05T09:43:33.026 INFO:teuthology.orchestra.run.smithi100.stdout: aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86_64 2023-12-05T09:43:33.026 INFO:teuthology.orchestra.run.smithi100.stdout: buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 2023-12-05T09:43:33.026 INFO:teuthology.orchestra.run.smithi100.stdout: cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 2023-12-05T09:43:33.026 INFO:teuthology.orchestra.run.smithi100.stdout: criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 2023-12-05T09:43:33.026 INFO:teuthology.orchestra.run.smithi100.stdout: crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 2023-12-05T09:43:33.026 INFO:teuthology.orchestra.run.smithi100.stdout: netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 2023-12-05T09:43:33.026 INFO:teuthology.orchestra.run.smithi100.stdout: python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noarch 2023-12-05T09:43:33.026 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-12-05T09:43:33.027 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-12-05T09:43:33.027 INFO:teuthology.orchestra.run.smithi100.stdout: skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 2023-12-05T09:43:33.027 INFO:teuthology.orchestra.run.smithi100.stdout: toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 2023-12-05T09:43:33.027 INFO:teuthology.orchestra.run.smithi100.stdout: udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 2023-12-05T09:43:33.027 INFO:teuthology.orchestra.run.smithi100.stdout: yajl-2.1.0-12.el8.x86_64 2023-12-05T09:43:33.027 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:43:33.027 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2023-12-05T09:43:33.240 DEBUG:teuthology.parallel:result is None 2023-12-05T09:43:33.241 INFO:teuthology.run_tasks:Running task install... 2023-12-05T09:43:33.250 DEBUG:teuthology.task.install:project ceph 2023-12-05T09:43:33.250 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '3fe8d441c2f973bfe963ba4dd30ba8eac9f36227'}} 2023-12-05T09:43:33.250 DEBUG:teuthology.task.install:config {'branch': 'quincy', 'exclude_packages': ['ceph-volume'], 'flavor': 'default', 'sha1': '3fe8d441c2f973bfe963ba4dd30ba8eac9f36227'} 2023-12-05T09:43:33.250 INFO:teuthology.task.install:Using flavor: default 2023-12-05T09:43:33.259 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-12-05T09:43:33.259 INFO:teuthology.task.install:extra packages: [] 2023-12-05T09:43:33.260 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3fe8d441c2f973bfe963ba4dd30ba8eac9f36227', 'tag': None, 'wait_for_package': False} 2023-12-05T09:43:33.260 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-05T09:43:33.260 INFO:teuthology.packaging:ref: None 2023-12-05T09:43:33.260 INFO:teuthology.packaging:tag: None 2023-12-05T09:43:33.260 INFO:teuthology.packaging:branch: quincy 2023-12-05T09:43:33.260 INFO:teuthology.packaging:sha1: 3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 2023-12-05T09:43:33.261 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2023-12-05T09:43:33.262 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3fe8d441c2f973bfe963ba4dd30ba8eac9f36227', 'tag': None, 'wait_for_package': False} 2023-12-05T09:43:33.263 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-05T09:43:33.263 INFO:teuthology.packaging:ref: None 2023-12-05T09:43:33.263 INFO:teuthology.packaging:tag: None 2023-12-05T09:43:33.263 INFO:teuthology.packaging:branch: quincy 2023-12-05T09:43:33.263 INFO:teuthology.packaging:sha1: 3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 2023-12-05T09:43:33.263 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2023-12-05T09:43:33.498 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/quincy/1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c/centos/8/flavors/default/ 2023-12-05T09:43:33.498 INFO:teuthology.task.install.rpm:Package version is 17.2.7-109.g1fd3ca3c 2023-12-05T09:43:33.536 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/quincy/1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c/centos/8/flavors/default/ 2023-12-05T09:43:33.537 INFO:teuthology.task.install.rpm:Package version is 17.2.7-109.g1fd3ca3c 2023-12-05T09:43:33.633 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/quincy/1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/quincy/1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/quincy/1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-05T09:43:33.634 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-12-05T09:43:33.634 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-05T09:43:33.644 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/quincy/1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/quincy/1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/quincy/1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-05T09:43:33.644 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-12-05T09:43:33.644 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-05T09:43:33.713 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-12-05T09:43:33.713 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-05T09:43:33.713 INFO:teuthology.packaging:ref: None 2023-12-05T09:43:33.713 INFO:teuthology.packaging:tag: None 2023-12-05T09:43:33.714 INFO:teuthology.packaging:branch: quincy 2023-12-05T09:43:33.714 INFO:teuthology.packaging:sha1: 3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 2023-12-05T09:43:33.714 DEBUG:teuthology.orchestra.run.smithi100:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-05T09:43:33.716 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-12-05T09:43:33.716 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-05T09:43:33.716 INFO:teuthology.packaging:ref: None 2023-12-05T09:43:33.716 INFO:teuthology.packaging:tag: None 2023-12-05T09:43:33.717 INFO:teuthology.packaging:branch: quincy 2023-12-05T09:43:33.717 INFO:teuthology.packaging:sha1: 3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 2023-12-05T09:43:33.717 DEBUG:teuthology.orchestra.run.smithi150:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-05T09:43:33.825 DEBUG:teuthology.orchestra.run.smithi100:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-05T09:43:33.829 DEBUG:teuthology.orchestra.run.smithi150:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-05T09:43:33.920 DEBUG:teuthology.orchestra.run.smithi100:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-05T09:43:33.926 DEBUG:teuthology.orchestra.run.smithi150:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-05T09:43:33.988 INFO:teuthology.orchestra.run.smithi100.stdout:check_obsoletes = 1 2023-12-05T09:43:33.991 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum clean all 2023-12-05T09:43:33.995 INFO:teuthology.orchestra.run.smithi150.stdout:check_obsoletes = 1 2023-12-05T09:43:33.998 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum clean all 2023-12-05T09:43:34.351 INFO:teuthology.orchestra.run.smithi100.stdout:76 files removed 2023-12-05T09:43:34.360 INFO:teuthology.orchestra.run.smithi150.stdout:76 files removed 2023-12-05T09:43:34.387 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph-radosgw 2023-12-05T09:43:34.400 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum -y install ceph-radosgw 2023-12-05T09:43:35.482 INFO:teuthology.orchestra.run.smithi150.stdout:ceph packages for x86_64 148 kB/s | 78 kB 00:00 2023-12-05T09:43:35.519 INFO:teuthology.orchestra.run.smithi100.stdout:ceph packages for x86_64 135 kB/s | 78 kB 00:00 2023-12-05T09:43:35.816 INFO:teuthology.orchestra.run.smithi150.stdout:ceph noarch packages 31 kB/s | 9.1 kB 00:00 2023-12-05T09:43:36.003 INFO:teuthology.orchestra.run.smithi100.stdout:ceph noarch packages 20 kB/s | 9.1 kB 00:00 2023-12-05T09:43:36.375 INFO:teuthology.orchestra.run.smithi150.stdout:ceph source packages 2.7 kB/s | 1.5 kB 00:00 2023-12-05T09:43:36.411 INFO:teuthology.orchestra.run.smithi100.stdout:ceph source packages 3.8 kB/s | 1.5 kB 00:00 2023-12-05T09:43:41.895 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 8 - AppStream 6.3 MB/s | 34 MB 00:05 2023-12-05T09:43:44.141 INFO:teuthology.orchestra.run.smithi150.stdout:CentOS Stream 8 - AppStream 4.4 MB/s | 34 MB 00:07 2023-12-05T09:43:51.378 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 8 - BaseOS 20 MB/s | 55 MB 00:02 2023-12-05T09:43:52.958 INFO:teuthology.orchestra.run.smithi150.stdout:CentOS Stream 8 - BaseOS 32 MB/s | 55 MB 00:01 2023-12-05T09:43:59.887 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 8 - Extras 50 kB/s | 18 kB 00:00 2023-12-05T09:44:00.213 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 8 - Extras common packages 50 kB/s | 6.9 kB 00:00 2023-12-05T09:44:00.914 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 8 - PowerTools 12 MB/s | 6.6 MB 00:00 2023-12-05T09:44:01.826 INFO:teuthology.orchestra.run.smithi150.stdout:CentOS Stream 8 - Extras 51 kB/s | 18 kB 00:00 2023-12-05T09:44:02.490 INFO:teuthology.orchestra.run.smithi100.stdout:Copr repo for python3-asyncssh owned by ceph 18 kB/s | 3.5 kB 00:00 2023-12-05T09:44:02.801 INFO:teuthology.orchestra.run.smithi150.stdout:CentOS Stream 8 - Extras common packages 8.7 kB/s | 6.9 kB 00:00 2023-12-05T09:44:04.362 INFO:teuthology.orchestra.run.smithi150.stdout:CentOS Stream 8 - PowerTools 4.7 MB/s | 6.6 MB 00:01 2023-12-05T09:44:05.946 INFO:teuthology.orchestra.run.smithi150.stdout:Copr repo for python3-asyncssh owned by ceph 20 kB/s | 3.5 kB 00:00 2023-12-05T09:44:06.108 INFO:teuthology.orchestra.run.smithi100.stdout:Extra Packages for Enterprise Linux 4.6 MB/s | 16 MB 00:03 2023-12-05T09:44:08.165 INFO:teuthology.orchestra.run.smithi150.stdout:Extra Packages for Enterprise Linux 7.7 MB/s | 16 MB 00:02 2023-12-05T09:44:10.625 INFO:teuthology.orchestra.run.smithi100.stdout:lab-extras 410 kB/s | 24 kB 00:00 2023-12-05T09:44:12.730 INFO:teuthology.orchestra.run.smithi150.stdout:lab-extras 246 kB/s | 24 kB 00:00 2023-12-05T09:44:15.475 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2023-12-05T09:44:15.478 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2023-12-05T09:44:15.478 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repository Size 2023-12-05T09:44:15.478 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2023-12-05T09:44:15.478 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2023-12-05T09:44:15.478 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-radosgw x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 17 M 2023-12-05T09:44:15.478 INFO:teuthology.orchestra.run.smithi100.stdout:Upgrading: 2023-12-05T09:44:15.478 INFO:teuthology.orchestra.run.smithi100.stdout: librados2 x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 3.5 M 2023-12-05T09:44:15.478 INFO:teuthology.orchestra.run.smithi100.stdout: librbd1 x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 3.6 M 2023-12-05T09:44:15.479 INFO:teuthology.orchestra.run.smithi100.stdout:Installing dependencies: 2023-12-05T09:44:15.479 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-base x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 5.2 M 2023-12-05T09:44:15.479 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-common x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 23 M 2023-12-05T09:44:15.479 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-selinux x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 24 k 2023-12-05T09:44:15.479 INFO:teuthology.orchestra.run.smithi100.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-12-05T09:44:15.479 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs2 x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 796 k 2023-12-05T09:44:15.479 INFO:teuthology.orchestra.run.smithi100.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-12-05T09:44:15.479 INFO:teuthology.orchestra.run.smithi100.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-12-05T09:44:15.479 INFO:teuthology.orchestra.run.smithi100.stdout: libradosstriper1 x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 506 k 2023-12-05T09:44:15.479 INFO:teuthology.orchestra.run.smithi100.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-12-05T09:44:15.479 INFO:teuthology.orchestra.run.smithi100.stdout: librgw2 x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 5.6 M 2023-12-05T09:44:15.479 INFO:teuthology.orchestra.run.smithi100.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-12-05T09:44:15.479 INFO:teuthology.orchestra.run.smithi100.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-12-05T09:44:15.480 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-argparse x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 45 k 2023-12-05T09:44:15.480 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-common x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 115 k 2023-12-05T09:44:15.480 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cephfs x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 190 k 2023-12-05T09:44:15.480 INFO:teuthology.orchestra.run.smithi100.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-12-05T09:44:15.480 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rados x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 372 k 2023-12-05T09:44:15.480 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rbd x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 358 k 2023-12-05T09:44:15.480 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rgw x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 107 k 2023-12-05T09:44:15.480 INFO:teuthology.orchestra.run.smithi100.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-12-05T09:44:15.480 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:44:15.480 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2023-12-05T09:44:15.480 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2023-12-05T09:44:15.480 INFO:teuthology.orchestra.run.smithi100.stdout:Install 21 Packages 2023-12-05T09:44:15.480 INFO:teuthology.orchestra.run.smithi100.stdout:Upgrade 2 Packages 2023-12-05T09:44:15.480 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:44:15.481 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 63 M 2023-12-05T09:44:15.481 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2023-12-05T09:44:17.334 INFO:teuthology.orchestra.run.smithi100.stdout:(1/23): ceph-common-17.2.7-109.g1fd3ca3c.el8.x8 17 MB/s | 23 MB 00:01 2023-12-05T09:44:17.378 INFO:teuthology.orchestra.run.smithi100.stdout:(2/23): ceph-selinux-17.2.7-109.g1fd3ca3c.el8.x 590 kB/s | 24 kB 00:00 2023-12-05T09:44:17.457 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2023-12-05T09:44:17.459 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2023-12-05T09:44:17.460 INFO:teuthology.orchestra.run.smithi150.stdout: Package Arch Version Repository Size 2023-12-05T09:44:17.460 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2023-12-05T09:44:17.460 INFO:teuthology.orchestra.run.smithi150.stdout:Installing: 2023-12-05T09:44:17.460 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-radosgw x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 17 M 2023-12-05T09:44:17.460 INFO:teuthology.orchestra.run.smithi150.stdout:Upgrading: 2023-12-05T09:44:17.460 INFO:teuthology.orchestra.run.smithi150.stdout: librados2 x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 3.5 M 2023-12-05T09:44:17.460 INFO:teuthology.orchestra.run.smithi150.stdout: librbd1 x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 3.6 M 2023-12-05T09:44:17.460 INFO:teuthology.orchestra.run.smithi150.stdout:Installing dependencies: 2023-12-05T09:44:17.460 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-base x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 5.2 M 2023-12-05T09:44:17.460 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-common x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 23 M 2023-12-05T09:44:17.460 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-selinux x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 24 k 2023-12-05T09:44:17.460 INFO:teuthology.orchestra.run.smithi150.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-12-05T09:44:17.460 INFO:teuthology.orchestra.run.smithi150.stdout: libcephfs2 x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 796 k 2023-12-05T09:44:17.460 INFO:teuthology.orchestra.run.smithi150.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-12-05T09:44:17.461 INFO:teuthology.orchestra.run.smithi150.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-12-05T09:44:17.461 INFO:teuthology.orchestra.run.smithi150.stdout: libradosstriper1 x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 506 k 2023-12-05T09:44:17.461 INFO:teuthology.orchestra.run.smithi150.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-12-05T09:44:17.461 INFO:teuthology.orchestra.run.smithi150.stdout: librgw2 x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 5.6 M 2023-12-05T09:44:17.461 INFO:teuthology.orchestra.run.smithi150.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-12-05T09:44:17.461 INFO:teuthology.orchestra.run.smithi150.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-12-05T09:44:17.461 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ceph-argparse x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 45 k 2023-12-05T09:44:17.461 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ceph-common x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 115 k 2023-12-05T09:44:17.461 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cephfs x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 190 k 2023-12-05T09:44:17.461 INFO:teuthology.orchestra.run.smithi150.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-12-05T09:44:17.461 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rados x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 372 k 2023-12-05T09:44:17.461 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rbd x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 358 k 2023-12-05T09:44:17.461 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rgw x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 107 k 2023-12-05T09:44:17.462 INFO:teuthology.orchestra.run.smithi150.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-12-05T09:44:17.462 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:44:17.462 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction Summary 2023-12-05T09:44:17.462 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2023-12-05T09:44:17.462 INFO:teuthology.orchestra.run.smithi150.stdout:Install 21 Packages 2023-12-05T09:44:17.462 INFO:teuthology.orchestra.run.smithi150.stdout:Upgrade 2 Packages 2023-12-05T09:44:17.462 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:44:17.463 INFO:teuthology.orchestra.run.smithi150.stdout:Total download size: 63 M 2023-12-05T09:44:17.463 INFO:teuthology.orchestra.run.smithi150.stdout:Downloading Packages: 2023-12-05T09:44:17.468 INFO:teuthology.orchestra.run.smithi100.stdout:(3/23): libcephfs2-17.2.7-109.g1fd3ca3c.el8.x86 8.5 MB/s | 796 kB 00:00 2023-12-05T09:44:17.526 INFO:teuthology.orchestra.run.smithi100.stdout:(4/23): libradosstriper1-17.2.7-109.g1fd3ca3c.e 8.5 MB/s | 506 kB 00:00 2023-12-05T09:44:17.702 INFO:teuthology.orchestra.run.smithi100.stdout:(5/23): ceph-base-17.2.7-109.g1fd3ca3c.el8.x86_ 2.9 MB/s | 5.2 MB 00:01 2023-12-05T09:44:17.794 INFO:teuthology.orchestra.run.smithi100.stdout:(6/23): python3-ceph-argparse-17.2.7-109.g1fd3c 489 kB/s | 45 kB 00:00 2023-12-05T09:44:17.877 INFO:teuthology.orchestra.run.smithi100.stdout:(7/23): librgw2-17.2.7-109.g1fd3ca3c.el8.x86_64 16 MB/s | 5.6 MB 00:00 2023-12-05T09:44:17.902 INFO:teuthology.orchestra.run.smithi100.stdout:(8/23): python3-ceph-common-17.2.7-109.g1fd3ca3 1.0 MB/s | 115 kB 00:00 2023-12-05T09:44:17.936 INFO:teuthology.orchestra.run.smithi100.stdout:(9/23): python3-cephfs-17.2.7-109.g1fd3ca3c.el8 3.2 MB/s | 190 kB 00:00 2023-12-05T09:44:17.970 INFO:teuthology.orchestra.run.smithi100.stdout:(10/23): python3-rados-17.2.7-109.g1fd3ca3c.el8 5.4 MB/s | 372 kB 00:00 2023-12-05T09:44:18.003 INFO:teuthology.orchestra.run.smithi100.stdout:(11/23): python3-rbd-17.2.7-109.g1fd3ca3c.el8.x 5.2 MB/s | 358 kB 00:00 2023-12-05T09:44:18.045 INFO:teuthology.orchestra.run.smithi100.stdout:(12/23): python3-rgw-17.2.7-109.g1fd3ca3c.el8.x 1.4 MB/s | 107 kB 00:00 2023-12-05T09:44:18.220 INFO:teuthology.orchestra.run.smithi100.stdout:(13/23): librdkafka-0.11.4-3.el8.x86_64.rpm 1.6 MB/s | 354 kB 00:00 2023-12-05T09:44:18.246 INFO:teuthology.orchestra.run.smithi100.stdout:(14/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.3 MB/s | 259 kB 00:00 2023-12-05T09:44:18.272 INFO:teuthology.orchestra.run.smithi100.stdout:(15/23): python3-prettytable-0.7.2-14.el8.noarc 873 kB/s | 44 kB 00:00 2023-12-05T09:44:18.388 INFO:teuthology.orchestra.run.smithi100.stdout:(16/23): librabbitmq-0.9.0-4.el8.x86_64.rpm 331 kB/s | 47 kB 00:00 2023-12-05T09:44:18.631 INFO:teuthology.orchestra.run.smithi150.stdout:(1/23): ceph-base-17.2.7-109.g1fd3ca3c.el8.x86_ 5.7 MB/s | 5.2 MB 00:00 2023-12-05T09:44:18.673 INFO:teuthology.orchestra.run.smithi150.stdout:(2/23): ceph-selinux-17.2.7-109.g1fd3ca3c.el8.x 587 kB/s | 24 kB 00:00 2023-12-05T09:44:18.697 INFO:teuthology.orchestra.run.smithi100.stdout:(17/23): ceph-radosgw-17.2.7-109.g1fd3ca3c.el8. 6.1 MB/s | 17 MB 00:02 2023-12-05T09:44:18.774 INFO:teuthology.orchestra.run.smithi150.stdout:(3/23): libcephfs2-17.2.7-109.g1fd3ca3c.el8.x86 7.8 MB/s | 796 kB 00:00 2023-12-05T09:44:18.840 INFO:teuthology.orchestra.run.smithi150.stdout:(4/23): libradosstriper1-17.2.7-109.g1fd3ca3c.e 7.4 MB/s | 506 kB 00:00 2023-12-05T09:44:19.022 INFO:teuthology.orchestra.run.smithi100.stdout:(18/23): liboath-2.6.2-3.el8.x86_64.rpm 93 kB/s | 59 kB 00:00 2023-12-05T09:44:19.123 INFO:teuthology.orchestra.run.smithi100.stdout:(19/23): gperftools-libs-2.7-9.el8.x86_64.rpm 360 kB/s | 306 kB 00:00 2023-12-05T09:44:19.258 INFO:teuthology.orchestra.run.smithi100.stdout:(20/23): libunwind-1.3.1-3.el8.x86_64.rpm 134 kB/s | 75 kB 00:00 2023-12-05T09:44:19.333 INFO:teuthology.orchestra.run.smithi150.stdout:(5/23): librgw2-17.2.7-109.g1fd3ca3c.el8.x86_64 11 MB/s | 5.6 MB 00:00 2023-12-05T09:44:19.408 INFO:teuthology.orchestra.run.smithi150.stdout:(6/23): python3-ceph-argparse-17.2.7-109.g1fd3c 599 kB/s | 45 kB 00:00 2023-12-05T09:44:19.517 INFO:teuthology.orchestra.run.smithi150.stdout:(7/23): python3-ceph-common-17.2.7-109.g1fd3ca3 1.0 MB/s | 115 kB 00:00 2023-12-05T09:44:19.656 INFO:teuthology.orchestra.run.smithi100.stdout:(21/23): thrift-0.13.0-2.el8.x86_64.rpm 2.7 MB/s | 1.7 MB 00:00 2023-12-05T09:44:19.732 INFO:teuthology.orchestra.run.smithi100.stdout:(22/23): librbd1-17.2.7-109.g1fd3ca3c.el8.x86_6 7.5 MB/s | 3.6 MB 00:00 2023-12-05T09:44:19.833 INFO:teuthology.orchestra.run.smithi150.stdout:(8/23): ceph-radosgw-17.2.7-109.g1fd3ca3c.el8.x 8.0 MB/s | 17 MB 00:02 2023-12-05T09:44:19.858 INFO:teuthology.orchestra.run.smithi150.stdout:(9/23): python3-cephfs-17.2.7-109.g1fd3ca3c.el8 556 kB/s | 190 kB 00:00 2023-12-05T09:44:19.892 INFO:teuthology.orchestra.run.smithi150.stdout:(10/23): python3-rados-17.2.7-109.g1fd3ca3c.el8 6.2 MB/s | 372 kB 00:00 2023-12-05T09:44:19.926 INFO:teuthology.orchestra.run.smithi150.stdout:(11/23): python3-rbd-17.2.7-109.g1fd3ca3c.el8.x 5.2 MB/s | 358 kB 00:00 2023-12-05T09:44:19.951 INFO:teuthology.orchestra.run.smithi150.stdout:(12/23): python3-rgw-17.2.7-109.g1fd3ca3c.el8.x 1.8 MB/s | 107 kB 00:00 2023-12-05T09:44:20.126 INFO:teuthology.orchestra.run.smithi150.stdout:(13/23): librdkafka-0.11.4-3.el8.x86_64.rpm 1.7 MB/s | 354 kB 00:00 2023-12-05T09:44:20.152 INFO:teuthology.orchestra.run.smithi150.stdout:(14/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.3 MB/s | 259 kB 00:00 2023-12-05T09:44:20.177 INFO:teuthology.orchestra.run.smithi150.stdout:(15/23): python3-prettytable-0.7.2-14.el8.noarc 877 kB/s | 44 kB 00:00 2023-12-05T09:44:20.199 INFO:teuthology.orchestra.run.smithi100.stdout:(23/23): librados2-17.2.7-109.g1fd3ca3c.el8.x86 3.2 MB/s | 3.5 MB 00:01 2023-12-05T09:44:20.203 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2023-12-05T09:44:20.204 INFO:teuthology.orchestra.run.smithi100.stdout:Total 13 MB/s | 63 MB 00:04 2023-12-05T09:44:20.285 INFO:teuthology.orchestra.run.smithi150.stdout:(16/23): librabbitmq-0.9.0-4.el8.x86_64.rpm 352 kB/s | 47 kB 00:00 2023-12-05T09:44:20.299 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2023-12-05T09:44:20.328 INFO:teuthology.orchestra.run.smithi150.stdout:(17/23): gperftools-libs-2.7-9.el8.x86_64.rpm 2.0 MB/s | 306 kB 00:00 2023-12-05T09:44:20.350 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2023-12-05T09:44:20.350 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2023-12-05T09:44:20.576 INFO:teuthology.orchestra.run.smithi150.stdout:(18/23): libunwind-1.3.1-3.el8.x86_64.rpm 302 kB/s | 75 kB 00:00 2023-12-05T09:44:20.603 INFO:teuthology.orchestra.run.smithi150.stdout:(19/23): liboath-2.6.2-3.el8.x86_64.rpm 185 kB/s | 59 kB 00:00 2023-12-05T09:44:20.687 INFO:teuthology.orchestra.run.smithi150.stdout:(20/23): thrift-0.13.0-2.el8.x86_64.rpm 16 MB/s | 1.7 MB 00:00 2023-12-05T09:44:20.750 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2023-12-05T09:44:20.753 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2023-12-05T09:44:21.021 INFO:teuthology.orchestra.run.smithi150.stdout:(21/23): librados2-17.2.7-109.g1fd3ca3c.el8.x86 8.3 MB/s | 3.5 MB 00:00 2023-12-05T09:44:21.129 INFO:teuthology.orchestra.run.smithi150.stdout:(22/23): librbd1-17.2.7-109.g1fd3ca3c.el8.x86_6 8.1 MB/s | 3.6 MB 00:00 2023-12-05T09:44:21.649 INFO:teuthology.orchestra.run.smithi150.stdout:(23/23): ceph-common-17.2.7-109.g1fd3ca3c.el8.x 6.0 MB/s | 23 MB 00:03 2023-12-05T09:44:21.649 INFO:teuthology.orchestra.run.smithi150.stdout:-------------------------------------------------------------------------------- 2023-12-05T09:44:21.649 INFO:teuthology.orchestra.run.smithi150.stdout:Total 15 MB/s | 63 MB 00:04 2023-12-05T09:44:21.743 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction check 2023-12-05T09:44:21.793 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction check succeeded. 2023-12-05T09:44:21.793 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction test 2023-12-05T09:44:21.799 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2023-12-05T09:44:22.037 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/25 2023-12-05T09:44:22.191 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction test succeeded. 2023-12-05T09:44:22.194 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction 2023-12-05T09:44:22.216 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/25 2023-12-05T09:44:22.631 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/25 2023-12-05T09:44:22.800 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : librados2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 3/25 2023-12-05T09:44:22.912 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librados2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 3/25 2023-12-05T09:44:23.168 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rados-2:17.2.7-109.g1fd3ca3c.el8.x86_64 4/25 2023-12-05T09:44:23.206 INFO:teuthology.orchestra.run.smithi150.stdout: Preparing : 1/1 2023-12-05T09:44:23.333 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libcephfs2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 5/25 2023-12-05T09:44:23.432 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/25 2023-12-05T09:44:23.647 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/25 2023-12-05T09:44:23.773 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libcephfs2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 5/25 2023-12-05T09:44:23.983 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : librbd1-2:17.2.7-109.g1fd3ca3c.el8.x86_64 6/25 2023-12-05T09:44:24.077 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/25 2023-12-05T09:44:24.244 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librbd1-2:17.2.7-109.g1fd3ca3c.el8.x86_64 6/25 2023-12-05T09:44:24.288 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : librados2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 3/25 2023-12-05T09:44:24.392 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librados2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 3/25 2023-12-05T09:44:24.421 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : thrift-0.13.0-2.el8.x86_64 7/25 2023-12-05T09:44:24.614 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 8/25 2023-12-05T09:44:24.646 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-rados-2:17.2.7-109.g1fd3ca3c.el8.x86_64 4/25 2023-12-05T09:44:24.741 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 9/25 2023-12-05T09:44:24.804 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libcephfs2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 5/25 2023-12-05T09:44:25.230 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: libcephfs2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 5/25 2023-12-05T09:44:25.345 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 9/25 2023-12-05T09:44:25.404 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : librbd1-2:17.2.7-109.g1fd3ca3c.el8.x86_64 6/25 2023-12-05T09:44:25.507 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librgw2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 10/25 2023-12-05T09:44:25.586 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librgw2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 10/25 2023-12-05T09:44:25.653 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librbd1-2:17.2.7-109.g1fd3ca3c.el8.x86_64 6/25 2023-12-05T09:44:25.720 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-ceph-argparse-2:17.2.7-109.g1fd3ca3c.el8.x 11/25 2023-12-05T09:44:25.843 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : thrift-0.13.0-2.el8.x86_64 7/25 2023-12-05T09:44:25.903 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cephfs-2:17.2.7-109.g1fd3ca3c.el8.x86_64 12/25 2023-12-05T09:44:26.063 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 8/25 2023-12-05T09:44:26.119 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rgw-2:17.2.7-109.g1fd3ca3c.el8.x86_64 13/25 2023-12-05T09:44:26.213 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 9/25 2023-12-05T09:44:26.322 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rbd-2:17.2.7-109.g1fd3ca3c.el8.x86_64 14/25 2023-12-05T09:44:26.474 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libradosstriper1-2:17.2.7-109.g1fd3ca3c.el8.x86_64 15/25 2023-12-05T09:44:26.565 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libradosstriper1-2:17.2.7-109.g1fd3ca3c.el8.x86_64 15/25 2023-12-05T09:44:26.796 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 16/25 2023-12-05T09:44:26.833 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 9/25 2023-12-05T09:44:26.958 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 17/25 2023-12-05T09:44:26.996 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : librgw2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 10/25 2023-12-05T09:44:27.084 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librgw2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 10/25 2023-12-05T09:44:27.174 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2023-12-05T09:44:27.225 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-ceph-argparse-2:17.2.7-109.g1fd3ca3c.el8.x 11/25 2023-12-05T09:44:27.383 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-ceph-common-2:17.2.7-109.g1fd3ca3c.el8.x86 19/25 2023-12-05T09:44:27.400 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cephfs-2:17.2.7-109.g1fd3ca3c.el8.x86_64 12/25 2023-12-05T09:44:27.625 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-rgw-2:17.2.7-109.g1fd3ca3c.el8.x86_64 13/25 2023-12-05T09:44:27.827 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-rbd-2:17.2.7-109.g1fd3ca3c.el8.x86_64 14/25 2023-12-05T09:44:28.021 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libradosstriper1-2:17.2.7-109.g1fd3ca3c.el8.x86_64 15/25 2023-12-05T09:44:28.097 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: libradosstriper1-2:17.2.7-109.g1fd3ca3c.el8.x86_64 15/25 2023-12-05T09:44:28.335 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 16/25 2023-12-05T09:44:28.513 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 17/25 2023-12-05T09:44:28.704 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2023-12-05T09:44:28.938 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-ceph-common-2:17.2.7-109.g1fd3ca3c.el8.x86 19/25 2023-12-05T09:44:30.362 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-common-2:17.2.7-109.g1fd3ca3c.el8.x86_64 20/25 2023-12-05T09:44:30.841 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-common-2:17.2.7-109.g1fd3ca3c.el8.x86_64 20/25 2023-12-05T09:44:31.510 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-common-2:17.2.7-109.g1fd3ca3c.el8.x86_64 20/25 2023-12-05T09:44:31.770 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-base-2:17.2.7-109.g1fd3ca3c.el8.x86_64 21/25 2023-12-05T09:44:31.968 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-base-2:17.2.7-109.g1fd3ca3c.el8.x86_64 21/25 2023-12-05T09:44:32.017 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-common-2:17.2.7-109.g1fd3ca3c.el8.x86_64 20/25 2023-12-05T09:44:32.165 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-selinux-2:17.2.7-109.g1fd3ca3c.el8.x86_64 22/25 2023-12-05T09:44:32.263 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-common-2:17.2.7-109.g1fd3ca3c.el8.x86_64 20/25 2023-12-05T09:44:32.934 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-common-2:17.2.7-109.g1fd3ca3c.el8.x86_64 20/25 2023-12-05T09:44:33.188 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-base-2:17.2.7-109.g1fd3ca3c.el8.x86_64 21/25 2023-12-05T09:44:33.391 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-base-2:17.2.7-109.g1fd3ca3c.el8.x86_64 21/25 2023-12-05T09:44:33.587 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-selinux-2:17.2.7-109.g1fd3ca3c.el8.x86_64 22/25 2023-12-05T09:44:52.407 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-selinux-2:17.2.7-109.g1fd3ca3c.el8.x86_64 22/25 2023-12-05T09:44:52.407 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /sys 2023-12-05T09:44:52.407 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /proc 2023-12-05T09:44:52.408 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /dev 2023-12-05T09:44:52.408 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /run 2023-12-05T09:44:52.408 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /mnt 2023-12-05T09:44:52.408 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /var/tmp 2023-12-05T09:44:52.408 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /home 2023-12-05T09:44:52.408 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /tmp 2023-12-05T09:44:52.408 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /dev 2023-12-05T09:44:52.408 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:44:53.660 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-selinux-2:17.2.7-109.g1fd3ca3c.el8.x86_64 22/25 2023-12-05T09:44:53.660 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /sys 2023-12-05T09:44:53.660 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /proc 2023-12-05T09:44:53.660 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /dev 2023-12-05T09:44:53.660 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /run 2023-12-05T09:44:53.660 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /mnt 2023-12-05T09:44:53.660 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /var/tmp 2023-12-05T09:44:53.660 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /home 2023-12-05T09:44:53.660 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /tmp 2023-12-05T09:44:53.660 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /dev 2023-12-05T09:44:53.660 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:44:54.200 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-radosgw-2:17.2.7-109.g1fd3ca3c.el8.x86_64 23/25 2023-12-05T09:44:54.315 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-109.g1fd3ca3c.el8.x86_64 23/25 2023-12-05T09:44:54.315 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-12-05T09:44:54.558 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-12-05T09:44:54.559 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2023-12-05T09:44:55.460 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-radosgw-2:17.2.7-109.g1fd3ca3c.el8.x86_64 23/25 2023-12-05T09:44:55.513 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2023-12-05T09:44:55.513 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-base-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/25 2023-12-05T09:44:55.513 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-common-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2/25 2023-12-05T09:44:55.513 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-radosgw-2:17.2.7-109.g1fd3ca3c.el8.x86_64 3/25 2023-12-05T09:44:55.513 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-selinux-2:17.2.7-109.g1fd3ca3c.el8.x86_64 4/25 2023-12-05T09:44:55.513 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libcephfs2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 5/25 2023-12-05T09:44:55.513 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libradosstriper1-2:17.2.7-109.g1fd3ca3c.el8.x86_64 6/25 2023-12-05T09:44:55.513 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librgw2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 7/25 2023-12-05T09:44:55.513 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-ceph-argparse-2:17.2.7-109.g1fd3ca3c.el8.x 8/25 2023-12-05T09:44:55.514 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-ceph-common-2:17.2.7-109.g1fd3ca3c.el8.x86 9/25 2023-12-05T09:44:55.514 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cephfs-2:17.2.7-109.g1fd3ca3c.el8.x86_64 10/25 2023-12-05T09:44:55.514 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rados-2:17.2.7-109.g1fd3ca3c.el8.x86_64 11/25 2023-12-05T09:44:55.514 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rbd-2:17.2.7-109.g1fd3ca3c.el8.x86_64 12/25 2023-12-05T09:44:55.514 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rgw-2:17.2.7-109.g1fd3ca3c.el8.x86_64 13/25 2023-12-05T09:44:55.514 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 14/25 2023-12-05T09:44:55.514 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2023-12-05T09:44:55.514 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2023-12-05T09:44:55.514 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 17/25 2023-12-05T09:44:55.514 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2023-12-05T09:44:55.514 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 19/25 2023-12-05T09:44:55.514 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 20/25 2023-12-05T09:44:55.514 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 21/25 2023-12-05T09:44:55.514 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librados2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 22/25 2023-12-05T09:44:55.515 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2023-12-05T09:44:55.515 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librbd1-2:17.2.7-109.g1fd3ca3c.el8.x86_64 24/25 2023-12-05T09:44:55.570 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-109.g1fd3ca3c.el8.x86_64 23/25 2023-12-05T09:44:55.570 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-12-05T09:44:55.789 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-12-05T09:44:55.789 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2023-12-05T09:44:56.504 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2023-12-05T09:44:56.504 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:44:56.505 INFO:teuthology.orchestra.run.smithi100.stdout:Upgraded: 2023-12-05T09:44:56.505 INFO:teuthology.orchestra.run.smithi100.stdout: librados2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:44:56.505 INFO:teuthology.orchestra.run.smithi100.stdout: librbd1-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:44:56.505 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2023-12-05T09:44:56.505 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-base-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:44:56.505 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-common-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:44:56.505 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-radosgw-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:44:56.505 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-selinux-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:44:56.505 INFO:teuthology.orchestra.run.smithi100.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-12-05T09:44:56.505 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:44:56.505 INFO:teuthology.orchestra.run.smithi100.stdout: liboath-2.6.2-3.el8.x86_64 2023-12-05T09:44:56.505 INFO:teuthology.orchestra.run.smithi100.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-12-05T09:44:56.505 INFO:teuthology.orchestra.run.smithi100.stdout: libradosstriper1-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:44:56.506 INFO:teuthology.orchestra.run.smithi100.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-12-05T09:44:56.506 INFO:teuthology.orchestra.run.smithi100.stdout: librgw2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:44:56.506 INFO:teuthology.orchestra.run.smithi100.stdout: libunwind-1.3.1-3.el8.x86_64 2023-12-05T09:44:56.506 INFO:teuthology.orchestra.run.smithi100.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-12-05T09:44:56.506 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-argparse-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:44:56.506 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-common-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:44:56.506 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cephfs-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:44:56.506 INFO:teuthology.orchestra.run.smithi100.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-12-05T09:44:56.506 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rados-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:44:56.506 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rbd-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:44:56.506 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rgw-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:44:56.506 INFO:teuthology.orchestra.run.smithi100.stdout: thrift-0.13.0-2.el8.x86_64 2023-12-05T09:44:56.506 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:44:56.506 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2023-12-05T09:44:56.753 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2023-12-05T09:44:56.753 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-base-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/25 2023-12-05T09:44:56.753 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-common-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2/25 2023-12-05T09:44:56.754 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-radosgw-2:17.2.7-109.g1fd3ca3c.el8.x86_64 3/25 2023-12-05T09:44:56.754 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-selinux-2:17.2.7-109.g1fd3ca3c.el8.x86_64 4/25 2023-12-05T09:44:56.754 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libcephfs2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 5/25 2023-12-05T09:44:56.754 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libradosstriper1-2:17.2.7-109.g1fd3ca3c.el8.x86_64 6/25 2023-12-05T09:44:56.754 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librgw2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 7/25 2023-12-05T09:44:56.754 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-ceph-argparse-2:17.2.7-109.g1fd3ca3c.el8.x 8/25 2023-12-05T09:44:56.754 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-ceph-common-2:17.2.7-109.g1fd3ca3c.el8.x86 9/25 2023-12-05T09:44:56.754 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cephfs-2:17.2.7-109.g1fd3ca3c.el8.x86_64 10/25 2023-12-05T09:44:56.754 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-rados-2:17.2.7-109.g1fd3ca3c.el8.x86_64 11/25 2023-12-05T09:44:56.754 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-rbd-2:17.2.7-109.g1fd3ca3c.el8.x86_64 12/25 2023-12-05T09:44:56.754 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-rgw-2:17.2.7-109.g1fd3ca3c.el8.x86_64 13/25 2023-12-05T09:44:56.754 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 14/25 2023-12-05T09:44:56.754 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2023-12-05T09:44:56.755 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2023-12-05T09:44:56.755 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 17/25 2023-12-05T09:44:56.755 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2023-12-05T09:44:56.755 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 19/25 2023-12-05T09:44:56.755 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 20/25 2023-12-05T09:44:56.755 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 21/25 2023-12-05T09:44:56.755 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librados2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 22/25 2023-12-05T09:44:56.755 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2023-12-05T09:44:56.755 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librbd1-2:17.2.7-109.g1fd3ca3c.el8.x86_64 24/25 2023-12-05T09:44:56.871 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph-test 2023-12-05T09:44:57.735 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2023-12-05T09:44:57.735 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:44:57.735 INFO:teuthology.orchestra.run.smithi150.stdout:Upgraded: 2023-12-05T09:44:57.735 INFO:teuthology.orchestra.run.smithi150.stdout: librados2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:44:57.735 INFO:teuthology.orchestra.run.smithi150.stdout: librbd1-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:44:57.735 INFO:teuthology.orchestra.run.smithi150.stdout:Installed: 2023-12-05T09:44:57.735 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-base-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:44:57.735 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-common-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:44:57.735 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-radosgw-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:44:57.736 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-selinux-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:44:57.736 INFO:teuthology.orchestra.run.smithi150.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-12-05T09:44:57.736 INFO:teuthology.orchestra.run.smithi150.stdout: libcephfs2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:44:57.736 INFO:teuthology.orchestra.run.smithi150.stdout: liboath-2.6.2-3.el8.x86_64 2023-12-05T09:44:57.736 INFO:teuthology.orchestra.run.smithi150.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-12-05T09:44:57.736 INFO:teuthology.orchestra.run.smithi150.stdout: libradosstriper1-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:44:57.736 INFO:teuthology.orchestra.run.smithi150.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-12-05T09:44:57.736 INFO:teuthology.orchestra.run.smithi150.stdout: librgw2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:44:57.736 INFO:teuthology.orchestra.run.smithi150.stdout: libunwind-1.3.1-3.el8.x86_64 2023-12-05T09:44:57.736 INFO:teuthology.orchestra.run.smithi150.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-12-05T09:44:57.736 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ceph-argparse-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:44:57.736 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ceph-common-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:44:57.736 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cephfs-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:44:57.736 INFO:teuthology.orchestra.run.smithi150.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-12-05T09:44:57.736 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rados-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:44:57.737 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rbd-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:44:57.737 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rgw-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:44:57.737 INFO:teuthology.orchestra.run.smithi150.stdout: thrift-0.13.0-2.el8.x86_64 2023-12-05T09:44:57.737 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:44:57.737 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2023-12-05T09:44:57.936 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:00:47 ago on Tue 05 Dec 2023 09:44:10 AM UTC. 2023-12-05T09:44:58.089 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum -y install ceph-test 2023-12-05T09:44:59.170 INFO:teuthology.orchestra.run.smithi150.stdout:Last metadata expiration check: 0:00:47 ago on Tue 05 Dec 2023 09:44:12 AM UTC. 2023-12-05T09:44:59.697 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2023-12-05T09:44:59.698 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2023-12-05T09:44:59.699 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repository Size 2023-12-05T09:44:59.699 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2023-12-05T09:44:59.699 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2023-12-05T09:44:59.699 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-test x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 52 M 2023-12-05T09:44:59.699 INFO:teuthology.orchestra.run.smithi100.stdout:Installing dependencies: 2023-12-05T09:44:59.699 INFO:teuthology.orchestra.run.smithi100.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2023-12-05T09:44:59.699 INFO:teuthology.orchestra.run.smithi100.stdout: libcephsqlite x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 174 k 2023-12-05T09:44:59.699 INFO:teuthology.orchestra.run.smithi100.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-12-05T09:44:59.699 INFO:teuthology.orchestra.run.smithi100.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-12-05T09:44:59.699 INFO:teuthology.orchestra.run.smithi100.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-12-05T09:44:59.700 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:44:59.700 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2023-12-05T09:44:59.700 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2023-12-05T09:44:59.700 INFO:teuthology.orchestra.run.smithi100.stdout:Install 6 Packages 2023-12-05T09:44:59.700 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:44:59.701 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 53 M 2023-12-05T09:44:59.701 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 234 M 2023-12-05T09:44:59.701 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2023-12-05T09:44:59.956 INFO:teuthology.orchestra.run.smithi100.stdout:(1/6): jq-1.6-8.el8.x86_64.rpm 953 kB/s | 203 kB 00:00 2023-12-05T09:45:00.015 INFO:teuthology.orchestra.run.smithi100.stdout:(2/6): oniguruma-6.8.2-2.el8.x86_64.rpm 3.1 MB/s | 187 kB 00:00 2023-12-05T09:45:00.090 INFO:teuthology.orchestra.run.smithi100.stdout:(3/6): socat-1.7.4.1-1.el8.x86_64.rpm 4.2 MB/s | 323 kB 00:00 2023-12-05T09:45:00.149 INFO:teuthology.orchestra.run.smithi100.stdout:(4/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.2 MB/s | 71 kB 00:00 2023-12-05T09:45:00.324 INFO:teuthology.orchestra.run.smithi100.stdout:(5/6): libcephsqlite-17.2.7-109.g1fd3ca3c.el8.x 300 kB/s | 174 kB 00:00 2023-12-05T09:45:00.919 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2023-12-05T09:45:00.920 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2023-12-05T09:45:00.920 INFO:teuthology.orchestra.run.smithi150.stdout: Package Arch Version Repository Size 2023-12-05T09:45:00.921 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2023-12-05T09:45:00.921 INFO:teuthology.orchestra.run.smithi150.stdout:Installing: 2023-12-05T09:45:00.921 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-test x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 52 M 2023-12-05T09:45:00.921 INFO:teuthology.orchestra.run.smithi150.stdout:Installing dependencies: 2023-12-05T09:45:00.921 INFO:teuthology.orchestra.run.smithi150.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2023-12-05T09:45:00.922 INFO:teuthology.orchestra.run.smithi150.stdout: libcephsqlite x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 174 k 2023-12-05T09:45:00.922 INFO:teuthology.orchestra.run.smithi150.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-12-05T09:45:00.922 INFO:teuthology.orchestra.run.smithi150.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-12-05T09:45:00.922 INFO:teuthology.orchestra.run.smithi150.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-12-05T09:45:00.922 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:45:00.922 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction Summary 2023-12-05T09:45:00.923 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2023-12-05T09:45:00.923 INFO:teuthology.orchestra.run.smithi150.stdout:Install 6 Packages 2023-12-05T09:45:00.923 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:45:00.924 INFO:teuthology.orchestra.run.smithi150.stdout:Total download size: 53 M 2023-12-05T09:45:00.924 INFO:teuthology.orchestra.run.smithi150.stdout:Installed size: 234 M 2023-12-05T09:45:00.924 INFO:teuthology.orchestra.run.smithi150.stdout:Downloading Packages: 2023-12-05T09:45:01.311 INFO:teuthology.orchestra.run.smithi150.stdout:(1/6): jq-1.6-8.el8.x86_64.rpm 1.0 MB/s | 203 kB 00:00 2023-12-05T09:45:01.370 INFO:teuthology.orchestra.run.smithi150.stdout:(2/6): oniguruma-6.8.2-2.el8.x86_64.rpm 3.1 MB/s | 187 kB 00:00 2023-12-05T09:45:01.453 INFO:teuthology.orchestra.run.smithi150.stdout:(3/6): socat-1.7.4.1-1.el8.x86_64.rpm 3.8 MB/s | 323 kB 00:00 2023-12-05T09:45:01.503 INFO:teuthology.orchestra.run.smithi150.stdout:(4/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.4 MB/s | 71 kB 00:00 2023-12-05T09:45:01.738 INFO:teuthology.orchestra.run.smithi150.stdout:(5/6): libcephsqlite-17.2.7-109.g1fd3ca3c.el8.x 278 kB/s | 174 kB 00:00 2023-12-05T09:45:04.995 INFO:teuthology.orchestra.run.smithi150.stdout:(6/6): ceph-test-17.2.7-109.g1fd3ca3c.el8.x86_6 13 MB/s | 52 MB 00:03 2023-12-05T09:45:04.997 INFO:teuthology.orchestra.run.smithi150.stdout:-------------------------------------------------------------------------------- 2023-12-05T09:45:04.998 INFO:teuthology.orchestra.run.smithi150.stdout:Total 13 MB/s | 53 MB 00:04 2023-12-05T09:45:05.095 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction check 2023-12-05T09:45:05.120 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction check succeeded. 2023-12-05T09:45:05.120 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction test 2023-12-05T09:45:05.434 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction test succeeded. 2023-12-05T09:45:05.438 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction 2023-12-05T09:45:05.941 INFO:teuthology.orchestra.run.smithi150.stdout: Preparing : 1/1 2023-12-05T09:45:06.172 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/6 2023-12-05T09:45:06.353 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/6 2023-12-05T09:45:06.507 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 3/6 2023-12-05T09:45:06.549 INFO:teuthology.orchestra.run.smithi100.stdout:(6/6): ceph-test-17.2.7-109.g1fd3ca3c.el8.x86_6 7.6 MB/s | 52 MB 00:06 2023-12-05T09:45:06.551 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2023-12-05T09:45:06.551 INFO:teuthology.orchestra.run.smithi100.stdout:Total 7.7 MB/s | 53 MB 00:06 2023-12-05T09:45:06.603 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 3/6 2023-12-05T09:45:06.648 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2023-12-05T09:45:06.672 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2023-12-05T09:45:06.672 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2023-12-05T09:45:06.834 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : jq-1.6-8.el8.x86_64 4/6 2023-12-05T09:45:06.983 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2023-12-05T09:45:06.987 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2023-12-05T09:45:07.016 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libcephsqlite-2:17.2.7-109.g1fd3ca3c.el8.x86_64 5/6 2023-12-05T09:45:07.495 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2023-12-05T09:45:07.699 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/6 2023-12-05T09:45:07.888 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/6 2023-12-05T09:45:08.025 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 3/6 2023-12-05T09:45:08.123 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 3/6 2023-12-05T09:45:08.318 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : jq-1.6-8.el8.x86_64 4/6 2023-12-05T09:45:08.458 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libcephsqlite-2:17.2.7-109.g1fd3ca3c.el8.x86_64 5/6 2023-12-05T09:45:12.367 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: libcephsqlite-2:17.2.7-109.g1fd3ca3c.el8.x86_64 5/6 2023-12-05T09:45:12.638 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-test-2:17.2.7-109.g1fd3ca3c.el8.x86_64 6/6 2023-12-05T09:45:13.007 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-test-2:17.2.7-109.g1fd3ca3c.el8.x86_64 6/6 2023-12-05T09:45:13.010 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-test-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/6 2023-12-05T09:45:13.010 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libcephsqlite-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2/6 2023-12-05T09:45:13.010 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : jq-1.6-8.el8.x86_64 3/6 2023-12-05T09:45:13.010 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 4/6 2023-12-05T09:45:13.011 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/6 2023-12-05T09:45:13.809 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libcephsqlite-2:17.2.7-109.g1fd3ca3c.el8.x86_64 5/6 2023-12-05T09:45:13.844 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 6/6 2023-12-05T09:45:13.844 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:45:13.844 INFO:teuthology.orchestra.run.smithi150.stdout:Installed: 2023-12-05T09:45:13.844 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-test-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:45:13.844 INFO:teuthology.orchestra.run.smithi150.stdout: jq-1.6-8.el8.x86_64 2023-12-05T09:45:13.844 INFO:teuthology.orchestra.run.smithi150.stdout: libcephsqlite-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:45:13.845 INFO:teuthology.orchestra.run.smithi150.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-12-05T09:45:13.845 INFO:teuthology.orchestra.run.smithi150.stdout: socat-1.7.4.1-1.el8.x86_64 2023-12-05T09:45:13.845 INFO:teuthology.orchestra.run.smithi150.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-12-05T09:45:13.845 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:45:13.845 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2023-12-05T09:45:14.050 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum -y install ceph 2023-12-05T09:45:14.073 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-test-2:17.2.7-109.g1fd3ca3c.el8.x86_64 6/6 2023-12-05T09:45:14.436 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-test-2:17.2.7-109.g1fd3ca3c.el8.x86_64 6/6 2023-12-05T09:45:14.436 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-test-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/6 2023-12-05T09:45:14.436 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libcephsqlite-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2/6 2023-12-05T09:45:14.437 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : jq-1.6-8.el8.x86_64 3/6 2023-12-05T09:45:14.437 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 4/6 2023-12-05T09:45:14.437 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/6 2023-12-05T09:45:15.178 INFO:teuthology.orchestra.run.smithi150.stdout:Last metadata expiration check: 0:01:03 ago on Tue 05 Dec 2023 09:44:12 AM UTC. 2023-12-05T09:45:15.233 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 6/6 2023-12-05T09:45:15.234 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:45:15.234 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2023-12-05T09:45:15.234 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-test-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:45:15.234 INFO:teuthology.orchestra.run.smithi100.stdout: jq-1.6-8.el8.x86_64 2023-12-05T09:45:15.234 INFO:teuthology.orchestra.run.smithi100.stdout: libcephsqlite-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:45:15.234 INFO:teuthology.orchestra.run.smithi100.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-12-05T09:45:15.234 INFO:teuthology.orchestra.run.smithi100.stdout: socat-1.7.4.1-1.el8.x86_64 2023-12-05T09:45:15.234 INFO:teuthology.orchestra.run.smithi100.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-12-05T09:45:15.234 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:45:15.234 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2023-12-05T09:45:15.423 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph 2023-12-05T09:45:16.506 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:01:06 ago on Tue 05 Dec 2023 09:44:10 AM UTC. 2023-12-05T09:45:16.949 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2023-12-05T09:45:16.952 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2023-12-05T09:45:16.952 INFO:teuthology.orchestra.run.smithi150.stdout: Package Arch Version Repository Size 2023-12-05T09:45:16.952 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2023-12-05T09:45:16.952 INFO:teuthology.orchestra.run.smithi150.stdout:Installing: 2023-12-05T09:45:16.952 INFO:teuthology.orchestra.run.smithi150.stdout: ceph x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 6.4 k 2023-12-05T09:45:16.953 INFO:teuthology.orchestra.run.smithi150.stdout:Installing dependencies: 2023-12-05T09:45:16.953 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mds x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 2.3 M 2023-12-05T09:45:16.953 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 1.6 M 2023-12-05T09:45:16.953 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-modules-core noarch 2:17.2.7-109.g1fd3ca3c.el8 ceph-noarch 238 k 2023-12-05T09:45:16.953 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mon x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 3.9 M 2023-12-05T09:45:16.953 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-osd x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 17 M 2023-12-05T09:45:16.953 INFO:teuthology.orchestra.run.smithi150.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-12-05T09:45:16.953 INFO:teuthology.orchestra.run.smithi150.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-12-05T09:45:16.953 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-12-05T09:45:16.953 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-12-05T09:45:16.953 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-12-05T09:45:16.953 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-12-05T09:45:16.953 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-12-05T09:45:16.953 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-12-05T09:45:16.954 INFO:teuthology.orchestra.run.smithi150.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-12-05T09:45:16.954 INFO:teuthology.orchestra.run.smithi150.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-12-05T09:45:16.954 INFO:teuthology.orchestra.run.smithi150.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-12-05T09:45:16.954 INFO:teuthology.orchestra.run.smithi150.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-12-05T09:45:16.954 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-12-05T09:45:16.954 INFO:teuthology.orchestra.run.smithi150.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-12-05T09:45:16.954 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-12-05T09:45:16.954 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-12-05T09:45:16.954 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2023-12-05T09:45:16.954 INFO:teuthology.orchestra.run.smithi150.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-12-05T09:45:16.954 INFO:teuthology.orchestra.run.smithi150.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-12-05T09:45:16.954 INFO:teuthology.orchestra.run.smithi150.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-12-05T09:45:16.954 INFO:teuthology.orchestra.run.smithi150.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-12-05T09:45:16.954 INFO:teuthology.orchestra.run.smithi150.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-12-05T09:45:16.955 INFO:teuthology.orchestra.run.smithi150.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-12-05T09:45:16.955 INFO:teuthology.orchestra.run.smithi150.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-12-05T09:45:16.955 INFO:teuthology.orchestra.run.smithi150.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-12-05T09:45:16.955 INFO:teuthology.orchestra.run.smithi150.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-12-05T09:45:16.955 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:45:16.955 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction Summary 2023-12-05T09:45:16.955 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2023-12-05T09:45:16.955 INFO:teuthology.orchestra.run.smithi150.stdout:Install 32 Packages 2023-12-05T09:45:16.955 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:45:16.956 INFO:teuthology.orchestra.run.smithi150.stdout:Total download size: 28 M 2023-12-05T09:45:16.956 INFO:teuthology.orchestra.run.smithi150.stdout:Installed size: 110 M 2023-12-05T09:45:16.956 INFO:teuthology.orchestra.run.smithi150.stdout:Downloading Packages: 2023-12-05T09:45:18.063 INFO:teuthology.orchestra.run.smithi150.stdout:(1/32): ceph-17.2.7-109.g1fd3ca3c.el8.x86_64.rp 7.3 kB/s | 6.4 kB 00:00 2023-12-05T09:45:18.254 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2023-12-05T09:45:18.258 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2023-12-05T09:45:18.258 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repository Size 2023-12-05T09:45:18.258 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2023-12-05T09:45:18.258 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2023-12-05T09:45:18.258 INFO:teuthology.orchestra.run.smithi100.stdout: ceph x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 6.4 k 2023-12-05T09:45:18.258 INFO:teuthology.orchestra.run.smithi100.stdout:Installing dependencies: 2023-12-05T09:45:18.258 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mds x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 2.3 M 2023-12-05T09:45:18.258 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 1.6 M 2023-12-05T09:45:18.258 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-modules-core noarch 2:17.2.7-109.g1fd3ca3c.el8 ceph-noarch 238 k 2023-12-05T09:45:18.259 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mon x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 3.9 M 2023-12-05T09:45:18.259 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-osd x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 17 M 2023-12-05T09:45:18.259 INFO:teuthology.orchestra.run.smithi100.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-12-05T09:45:18.259 INFO:teuthology.orchestra.run.smithi100.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-12-05T09:45:18.259 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-12-05T09:45:18.259 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-12-05T09:45:18.259 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-12-05T09:45:18.259 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-12-05T09:45:18.259 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-12-05T09:45:18.259 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-12-05T09:45:18.259 INFO:teuthology.orchestra.run.smithi100.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-12-05T09:45:18.259 INFO:teuthology.orchestra.run.smithi100.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-12-05T09:45:18.259 INFO:teuthology.orchestra.run.smithi100.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-12-05T09:45:18.259 INFO:teuthology.orchestra.run.smithi100.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-12-05T09:45:18.260 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-12-05T09:45:18.260 INFO:teuthology.orchestra.run.smithi100.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-12-05T09:45:18.260 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-12-05T09:45:18.260 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-12-05T09:45:18.260 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2023-12-05T09:45:18.260 INFO:teuthology.orchestra.run.smithi100.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-12-05T09:45:18.260 INFO:teuthology.orchestra.run.smithi100.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-12-05T09:45:18.260 INFO:teuthology.orchestra.run.smithi100.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-12-05T09:45:18.260 INFO:teuthology.orchestra.run.smithi100.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-12-05T09:45:18.260 INFO:teuthology.orchestra.run.smithi100.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-12-05T09:45:18.260 INFO:teuthology.orchestra.run.smithi100.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-12-05T09:45:18.260 INFO:teuthology.orchestra.run.smithi100.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-12-05T09:45:18.260 INFO:teuthology.orchestra.run.smithi100.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-12-05T09:45:18.260 INFO:teuthology.orchestra.run.smithi100.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-12-05T09:45:18.260 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:45:18.260 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2023-12-05T09:45:18.261 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2023-12-05T09:45:18.261 INFO:teuthology.orchestra.run.smithi100.stdout:Install 32 Packages 2023-12-05T09:45:18.261 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:45:18.261 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 28 M 2023-12-05T09:45:18.261 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 110 M 2023-12-05T09:45:18.261 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2023-12-05T09:45:18.346 INFO:teuthology.orchestra.run.smithi150.stdout:(2/32): ceph-mds-17.2.7-109.g1fd3ca3c.el8.x86_6 2.0 MB/s | 2.3 MB 00:01 2023-12-05T09:45:18.388 INFO:teuthology.orchestra.run.smithi150.stdout:(3/32): ceph-mgr-17.2.7-109.g1fd3ca3c.el8.x86_6 1.3 MB/s | 1.6 MB 00:01 2023-12-05T09:45:18.763 INFO:teuthology.orchestra.run.smithi150.stdout:(4/32): ceph-mgr-modules-core-17.2.7-109.g1fd3c 636 kB/s | 238 kB 00:00 2023-12-05T09:45:18.939 INFO:teuthology.orchestra.run.smithi150.stdout:(5/32): python3-mako-1.0.6-14.el8.noarch.rpm 898 kB/s | 157 kB 00:00 2023-12-05T09:45:18.992 INFO:teuthology.orchestra.run.smithi150.stdout:(6/32): python3-markupsafe-0.23-19.el8.x86_64.r 781 kB/s | 39 kB 00:00 2023-12-05T09:45:19.031 INFO:teuthology.orchestra.run.smithi150.stdout:(7/32): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 2.4 MB/s | 103 kB 00:00 2023-12-05T09:45:19.081 INFO:teuthology.orchestra.run.smithi150.stdout:(8/32): python3-pytz-2017.2-11.el8.noarch.rpm 1.1 MB/s | 57 kB 00:00 2023-12-05T09:45:19.165 INFO:teuthology.orchestra.run.smithi150.stdout:(9/32): python3-werkzeug-0.12.2-4.el8.noarch.rp 5.4 MB/s | 457 kB 00:00 2023-12-05T09:45:19.407 INFO:teuthology.orchestra.run.smithi150.stdout:(10/32): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.0 MB/s | 249 kB 00:00 2023-12-05T09:45:19.715 INFO:teuthology.orchestra.run.smithi150.stdout:(11/32): python3-cryptography-3.2.1-6.el8.x86_6 2.0 MB/s | 641 kB 00:00 2023-12-05T09:45:19.791 INFO:teuthology.orchestra.run.smithi150.stdout:(12/32): python3-pycparser-2.14-14.el8.noarch.r 1.4 MB/s | 109 kB 00:00 2023-12-05T09:45:19.901 INFO:teuthology.orchestra.run.smithi100.stdout:(1/32): ceph-mgr-17.2.7-109.g1fd3ca3c.el8.x86_6 1.5 MB/s | 1.6 MB 00:01 2023-12-05T09:45:19.941 INFO:teuthology.orchestra.run.smithi150.stdout:(13/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 291 kB/s | 44 kB 00:00 2023-12-05T09:45:20.041 INFO:teuthology.orchestra.run.smithi150.stdout:(14/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 1.8 MB/s | 185 kB 00:00 2023-12-05T09:45:20.142 INFO:teuthology.orchestra.run.smithi150.stdout:(15/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 1.7 MB/s | 173 kB 00:00 2023-12-05T09:45:20.309 INFO:teuthology.orchestra.run.smithi150.stdout:(16/32): python3-cherrypy-18.4.0-1.el8.noarch.r 2.3 MB/s | 384 kB 00:00 2023-12-05T09:45:20.351 INFO:teuthology.orchestra.run.smithi150.stdout:(17/32): python3-jaraco-6.2-6.el8.noarch.rpm 268 kB/s | 11 kB 00:00 2023-12-05T09:45:20.393 INFO:teuthology.orchestra.run.smithi150.stdout:(18/32): python3-jaraco-functools-2.0-4.el8.noa 423 kB/s | 18 kB 00:00 2023-12-05T09:45:20.435 INFO:teuthology.orchestra.run.smithi150.stdout:(19/32): python3-logutils-0.3.5-11.el8.noarch.r 1.1 MB/s | 49 kB 00:00 2023-12-05T09:45:20.477 INFO:teuthology.orchestra.run.smithi150.stdout:(20/32): python3-more-itertools-7.2.0-3.el8.noa 1.4 MB/s | 59 kB 00:00 2023-12-05T09:45:20.501 INFO:teuthology.orchestra.run.smithi100.stdout:(2/32): ceph-mon-17.2.7-109.g1fd3ca3c.el8.x86_6 6.6 MB/s | 3.9 MB 00:00 2023-12-05T09:45:20.615 INFO:teuthology.orchestra.run.smithi150.stdout:(21/32): python3-pecan-1.3.2-9.el8.noarch.rpm 2.0 MB/s | 283 kB 00:00 2023-12-05T09:45:20.660 INFO:teuthology.orchestra.run.smithi150.stdout:(22/32): python3-portend-2.6-1.el8.noarch.rpm 344 kB/s | 16 kB 00:00 2023-12-05T09:45:20.702 INFO:teuthology.orchestra.run.smithi150.stdout:(23/32): python3-simplegeneric-0.8.1-17.el8.noa 449 kB/s | 19 kB 00:00 2023-12-05T09:45:20.744 INFO:teuthology.orchestra.run.smithi150.stdout:(24/32): python3-singledispatch-3.4.0.3-18.el8. 576 kB/s | 24 kB 00:00 2023-12-05T09:45:20.787 INFO:teuthology.orchestra.run.smithi150.stdout:(25/32): python3-tempora-1.14.1-5.el8.noarch.rp 700 kB/s | 29 kB 00:00 2023-12-05T09:45:20.828 INFO:teuthology.orchestra.run.smithi150.stdout:(26/32): python3-trustme-0.6.0-4.el8.noarch.rpm 665 kB/s | 27 kB 00:00 2023-12-05T09:45:20.953 INFO:teuthology.orchestra.run.smithi150.stdout:(27/32): python3-waitress-1.4.3-1.el8.noarch.rp 2.0 MB/s | 255 kB 00:00 2023-12-05T09:45:20.994 INFO:teuthology.orchestra.run.smithi100.stdout:(3/32): ceph-mds-17.2.7-109.g1fd3ca3c.el8.x86_6 1.1 MB/s | 2.3 MB 00:02 2023-12-05T09:45:21.068 INFO:teuthology.orchestra.run.smithi100.stdout:(4/32): ceph-mgr-modules-core-17.2.7-109.g1fd3c 3.1 MB/s | 238 kB 00:00 2023-12-05T09:45:21.070 INFO:teuthology.orchestra.run.smithi150.stdout:(28/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 2.1 MB/s | 251 kB 00:00 2023-12-05T09:45:21.129 INFO:teuthology.orchestra.run.smithi150.stdout:(29/32): python3-webtest-2.0.33-1.el8.noarch.rp 1.4 MB/s | 85 kB 00:00 2023-12-05T09:45:21.163 INFO:teuthology.orchestra.run.smithi150.stdout:(30/32): python3-zc-lockfile-2.0-2.el8.noarch.r 688 kB/s | 23 kB 00:00 2023-12-05T09:45:21.235 INFO:teuthology.orchestra.run.smithi100.stdout:(5/32): python3-mako-1.0.6-14.el8.noarch.rpm 942 kB/s | 157 kB 00:00 2023-12-05T09:45:21.277 INFO:teuthology.orchestra.run.smithi100.stdout:(6/32): ceph-17.2.7-109.g1fd3ca3c.el8.x86_64.rp 2.6 kB/s | 6.4 kB 00:02 2023-12-05T09:45:21.302 INFO:teuthology.orchestra.run.smithi100.stdout:(7/32): python3-markupsafe-0.23-19.el8.x86_64.r 580 kB/s | 39 kB 00:00 2023-12-05T09:45:21.352 INFO:teuthology.orchestra.run.smithi100.stdout:(8/32): python3-pytz-2017.2-11.el8.noarch.rpm 1.1 MB/s | 57 kB 00:00 2023-12-05T09:45:21.436 INFO:teuthology.orchestra.run.smithi100.stdout:(9/32): python3-werkzeug-0.12.2-4.el8.noarch.rp 5.4 MB/s | 457 kB 00:00 2023-12-05T09:45:21.462 INFO:teuthology.orchestra.run.smithi100.stdout:(10/32): python3-pyOpenSSL-19.0.0-1.el8.noarch. 561 kB/s | 103 kB 00:00 2023-12-05T09:45:21.703 INFO:teuthology.orchestra.run.smithi100.stdout:(11/32): python3-cffi-1.11.5-6.el8.x86_64.rpm 932 kB/s | 249 kB 00:00 2023-12-05T09:45:21.787 INFO:teuthology.orchestra.run.smithi100.stdout:(12/32): python3-pycparser-2.14-14.el8.noarch.r 1.3 MB/s | 109 kB 00:00 2023-12-05T09:45:21.871 INFO:teuthology.orchestra.run.smithi100.stdout:(13/32): python3-cryptography-3.2.1-6.el8.x86_6 1.5 MB/s | 641 kB 00:00 2023-12-05T09:45:21.929 INFO:teuthology.orchestra.run.smithi100.stdout:(14/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 307 kB/s | 44 kB 00:00 2023-12-05T09:45:22.088 INFO:teuthology.orchestra.run.smithi100.stdout:(15/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 1.1 MB/s | 173 kB 00:00 2023-12-05T09:45:22.113 INFO:teuthology.orchestra.run.smithi100.stdout:(16/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 765 kB/s | 185 kB 00:00 2023-12-05T09:45:22.163 INFO:teuthology.orchestra.run.smithi100.stdout:(17/32): python3-jaraco-6.2-6.el8.noarch.rpm 224 kB/s | 11 kB 00:00 2023-12-05T09:45:22.197 INFO:teuthology.orchestra.run.smithi100.stdout:(18/32): python3-cherrypy-18.4.0-1.el8.noarch.r 3.5 MB/s | 384 kB 00:00 2023-12-05T09:45:22.223 INFO:teuthology.orchestra.run.smithi100.stdout:(19/32): python3-jaraco-functools-2.0-4.el8.noa 300 kB/s | 18 kB 00:00 2023-12-05T09:45:22.256 INFO:teuthology.orchestra.run.smithi100.stdout:(20/32): python3-logutils-0.3.5-11.el8.noarch.r 835 kB/s | 49 kB 00:00 2023-12-05T09:45:22.290 INFO:teuthology.orchestra.run.smithi100.stdout:(21/32): python3-more-itertools-7.2.0-3.el8.noa 882 kB/s | 59 kB 00:00 2023-12-05T09:45:22.332 INFO:teuthology.orchestra.run.smithi100.stdout:(22/32): python3-pecan-1.3.2-9.el8.noarch.rpm 3.7 MB/s | 283 kB 00:00 2023-12-05T09:45:22.357 INFO:teuthology.orchestra.run.smithi100.stdout:(23/32): python3-portend-2.6-1.el8.noarch.rpm 233 kB/s | 16 kB 00:00 2023-12-05T09:45:22.391 INFO:teuthology.orchestra.run.smithi100.stdout:(24/32): python3-simplegeneric-0.8.1-17.el8.noa 319 kB/s | 19 kB 00:00 2023-12-05T09:45:22.416 INFO:teuthology.orchestra.run.smithi100.stdout:(25/32): python3-singledispatch-3.4.0.3-18.el8. 408 kB/s | 24 kB 00:00 2023-12-05T09:45:22.600 INFO:teuthology.orchestra.run.smithi100.stdout:(26/32): ceph-osd-17.2.7-109.g1fd3ca3c.el8.x86_ 8.0 MB/s | 17 MB 00:02 2023-12-05T09:45:22.625 INFO:teuthology.orchestra.run.smithi100.stdout:(27/32): python3-tempora-1.14.1-5.el8.noarch.rp 125 kB/s | 29 kB 00:00 2023-12-05T09:45:22.650 INFO:teuthology.orchestra.run.smithi100.stdout:(28/32): python3-trustme-0.6.0-4.el8.noarch.rpm 118 kB/s | 27 kB 00:00 2023-12-05T09:45:22.709 INFO:teuthology.orchestra.run.smithi100.stdout:(29/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 4.3 MB/s | 251 kB 00:00 2023-12-05T09:45:22.734 INFO:teuthology.orchestra.run.smithi100.stdout:(30/32): python3-webtest-2.0.33-1.el8.noarch.rp 1.0 MB/s | 85 kB 00:00 2023-12-05T09:45:22.768 INFO:teuthology.orchestra.run.smithi100.stdout:(31/32): python3-zc-lockfile-2.0-2.el8.noarch.r 392 kB/s | 23 kB 00:00 2023-12-05T09:45:22.860 INFO:teuthology.orchestra.run.smithi100.stdout:(32/32): python3-waitress-1.4.3-1.el8.noarch.rp 987 kB/s | 255 kB 00:00 2023-12-05T09:45:22.861 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2023-12-05T09:45:22.861 INFO:teuthology.orchestra.run.smithi100.stdout:Total 6.2 MB/s | 28 MB 00:04 2023-12-05T09:45:23.067 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2023-12-05T09:45:23.114 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2023-12-05T09:45:23.114 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2023-12-05T09:45:23.444 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2023-12-05T09:45:23.447 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2023-12-05T09:45:24.576 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2023-12-05T09:45:24.806 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2023-12-05T09:45:25.049 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2023-12-05T09:45:25.338 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2023-12-05T09:45:25.580 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/32 2023-12-05T09:45:25.785 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2023-12-05T09:45:25.995 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2023-12-05T09:45:26.736 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2023-12-05T09:45:26.897 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2023-12-05T09:45:27.121 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2023-12-05T09:45:27.356 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2023-12-05T09:45:27.619 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2023-12-05T09:45:27.845 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2023-12-05T09:45:28.291 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/32 2023-12-05T09:45:28.580 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 14/32 2023-12-05T09:45:28.757 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2023-12-05T09:45:28.991 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2023-12-05T09:45:29.242 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-12-05T09:45:29.599 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2023-12-05T09:45:29.797 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2023-12-05T09:45:29.968 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/32 2023-12-05T09:45:30.161 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2023-12-05T09:45:30.413 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2023-12-05T09:45:30.693 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2023-12-05T09:45:30.921 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2023-12-05T09:45:31.258 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/32 2023-12-05T09:45:31.584 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2023-12-05T09:45:31.999 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-109.g1fd3ca3c.el8.n 27/32 2023-12-05T09:45:32.185 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-2:17.2.7-109.g1fd3ca3c.el8.x86_64 28/32 2023-12-05T09:45:33.793 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-2:17.2.7-109.g1fd3ca3c.el8.x86_64 28/32 2023-12-05T09:45:34.019 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-osd-2:17.2.7-109.g1fd3ca3c.el8.x86_64 29/32 2023-12-05T09:45:34.484 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-osd-2:17.2.7-109.g1fd3ca3c.el8.x86_64 29/32 2023-12-05T09:45:34.673 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mon-2:17.2.7-109.g1fd3ca3c.el8.x86_64 30/32 2023-12-05T09:45:34.930 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mon-2:17.2.7-109.g1fd3ca3c.el8.x86_64 30/32 2023-12-05T09:45:35.097 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mds-2:17.2.7-109.g1fd3ca3c.el8.x86_64 31/32 2023-12-05T09:45:35.140 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mds-2:17.2.7-109.g1fd3ca3c.el8.x86_64 31/32 2023-12-05T09:45:35.254 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-2:17.2.7-109.g1fd3ca3c.el8.x86_64 32/32 2023-12-05T09:45:35.360 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-2:17.2.7-109.g1fd3ca3c.el8.x86_64 32/32 2023-12-05T09:45:35.360 INFO:teuthology.orchestra.run.smithi100.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-12-05T09:45:35.360 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:45:35.909 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/32 2023-12-05T09:45:35.909 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mds-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2/32 2023-12-05T09:45:35.910 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-2:17.2.7-109.g1fd3ca3c.el8.x86_64 3/32 2023-12-05T09:45:35.910 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mon-2:17.2.7-109.g1fd3ca3c.el8.x86_64 4/32 2023-12-05T09:45:35.910 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-osd-2:17.2.7-109.g1fd3ca3c.el8.x86_64 5/32 2023-12-05T09:45:35.910 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-109.g1fd3ca3c.el8.n 6/32 2023-12-05T09:45:35.910 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 7/32 2023-12-05T09:45:35.910 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2023-12-05T09:45:35.910 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2023-12-05T09:45:35.910 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 10/32 2023-12-05T09:45:35.910 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2023-12-05T09:45:35.910 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 12/32 2023-12-05T09:45:35.910 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 13/32 2023-12-05T09:45:35.911 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2023-12-05T09:45:35.911 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2023-12-05T09:45:35.911 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2023-12-05T09:45:35.911 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-12-05T09:45:35.911 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2023-12-05T09:45:35.911 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2023-12-05T09:45:35.911 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2023-12-05T09:45:35.911 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2023-12-05T09:45:35.911 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2023-12-05T09:45:35.911 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2023-12-05T09:45:35.911 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2023-12-05T09:45:35.911 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2023-12-05T09:45:35.912 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2023-12-05T09:45:35.912 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2023-12-05T09:45:35.912 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2023-12-05T09:45:35.912 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 29/32 2023-12-05T09:45:35.912 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2023-12-05T09:45:35.912 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2023-12-05T09:45:36.912 INFO:teuthology.orchestra.run.smithi150.stdout:(31/32): ceph-osd-17.2.7-109.g1fd3ca3c.el8.x86_ 922 kB/s | 17 MB 00:18 2023-12-05T09:45:37.106 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2023-12-05T09:45:37.107 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:45:37.107 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2023-12-05T09:45:37.107 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:45:37.107 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mds-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:45:37.107 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:45:37.107 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-modules-core-2:17.2.7-109.g1fd3ca3c.el8.noarch 2023-12-05T09:45:37.107 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mon-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:45:37.107 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-osd-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:45:37.107 INFO:teuthology.orchestra.run.smithi100.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-12-05T09:45:37.107 INFO:teuthology.orchestra.run.smithi100.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-12-05T09:45:37.107 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-12-05T09:45:37.107 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-12-05T09:45:37.107 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-12-05T09:45:37.108 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-12-05T09:45:37.108 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-6.2-6.el8.noarch 2023-12-05T09:45:37.108 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-12-05T09:45:37.108 INFO:teuthology.orchestra.run.smithi100.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-12-05T09:45:37.108 INFO:teuthology.orchestra.run.smithi100.stdout: python3-mako-1.0.6-14.el8.noarch 2023-12-05T09:45:37.108 INFO:teuthology.orchestra.run.smithi100.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-12-05T09:45:37.108 INFO:teuthology.orchestra.run.smithi100.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-12-05T09:45:37.108 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-12-05T09:45:37.108 INFO:teuthology.orchestra.run.smithi100.stdout: python3-portend-2.6-1.el8.noarch 2023-12-05T09:45:37.108 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-12-05T09:45:37.108 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pycparser-2.14-14.el8.noarch 2023-12-05T09:45:37.108 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pytz-2017.2-11.el8.noarch 2023-12-05T09:45:37.108 INFO:teuthology.orchestra.run.smithi100.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-12-05T09:45:37.108 INFO:teuthology.orchestra.run.smithi100.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-12-05T09:45:37.109 INFO:teuthology.orchestra.run.smithi100.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-12-05T09:45:37.109 INFO:teuthology.orchestra.run.smithi100.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-12-05T09:45:37.109 INFO:teuthology.orchestra.run.smithi100.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-12-05T09:45:37.109 INFO:teuthology.orchestra.run.smithi100.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-12-05T09:45:37.109 INFO:teuthology.orchestra.run.smithi100.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-12-05T09:45:37.109 INFO:teuthology.orchestra.run.smithi100.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-12-05T09:45:37.109 INFO:teuthology.orchestra.run.smithi100.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-12-05T09:45:37.109 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:45:37.109 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2023-12-05T09:45:37.381 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph-base 2023-12-05T09:45:38.461 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:01:28 ago on Tue 05 Dec 2023 09:44:10 AM UTC. 2023-12-05T09:45:39.012 INFO:teuthology.orchestra.run.smithi150.stdout:(32/32): ceph-mon-17.2.7-109.g1fd3ca3c.el8.x86_ 192 kB/s | 3.9 MB 00:20 2023-12-05T09:45:39.016 INFO:teuthology.orchestra.run.smithi150.stdout:-------------------------------------------------------------------------------- 2023-12-05T09:45:39.016 INFO:teuthology.orchestra.run.smithi150.stdout:Total 1.3 MB/s | 28 MB 00:22 2023-12-05T09:45:39.208 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction check 2023-12-05T09:45:39.254 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction check succeeded. 2023-12-05T09:45:39.254 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction test 2023-12-05T09:45:39.587 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction test succeeded. 2023-12-05T09:45:39.590 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction 2023-12-05T09:45:39.976 INFO:teuthology.orchestra.run.smithi100.stdout:Package ceph-base-2:17.2.7-109.g1fd3ca3c.el8.x86_64 is already installed. 2023-12-05T09:45:40.220 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2023-12-05T09:45:40.221 INFO:teuthology.orchestra.run.smithi100.stdout:Nothing to do. 2023-12-05T09:45:40.221 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2023-12-05T09:45:40.355 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install cephadm 2023-12-05T09:45:40.716 INFO:teuthology.orchestra.run.smithi150.stdout: Preparing : 1/1 2023-12-05T09:45:40.953 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2023-12-05T09:45:41.179 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2023-12-05T09:45:41.409 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:01:31 ago on Tue 05 Dec 2023 09:44:10 AM UTC. 2023-12-05T09:45:41.433 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2023-12-05T09:45:41.713 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/32 2023-12-05T09:45:41.871 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2023-12-05T09:45:42.066 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2023-12-05T09:45:42.256 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2023-12-05T09:45:42.426 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2023-12-05T09:45:42.640 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2023-12-05T09:45:42.892 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2023-12-05T09:45:43.139 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2023-12-05T09:45:43.142 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2023-12-05T09:45:43.142 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2023-12-05T09:45:43.142 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repository Size 2023-12-05T09:45:43.143 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2023-12-05T09:45:43.143 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2023-12-05T09:45:43.143 INFO:teuthology.orchestra.run.smithi100.stdout: cephadm noarch 2:17.2.7-109.g1fd3ca3c.el8 ceph-noarch 80 k 2023-12-05T09:45:43.143 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:45:43.143 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2023-12-05T09:45:43.143 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2023-12-05T09:45:43.143 INFO:teuthology.orchestra.run.smithi100.stdout:Install 1 Package 2023-12-05T09:45:43.143 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:45:43.144 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 80 k 2023-12-05T09:45:43.144 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 364 k 2023-12-05T09:45:43.144 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2023-12-05T09:45:43.380 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2023-12-05T09:45:43.829 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/32 2023-12-05T09:45:44.103 INFO:teuthology.orchestra.run.smithi100.stdout:cephadm-17.2.7-109.g1fd3ca3c.el8.noarch.rpm 84 kB/s | 80 kB 00:00 2023-12-05T09:45:44.104 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2023-12-05T09:45:44.105 INFO:teuthology.orchestra.run.smithi100.stdout:Total 84 kB/s | 80 kB 00:00 2023-12-05T09:45:44.105 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2023-12-05T09:45:44.117 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2023-12-05T09:45:44.117 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2023-12-05T09:45:44.121 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2023-12-05T09:45:44.124 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2023-12-05T09:45:44.312 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2023-12-05T09:45:44.975 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: cephadm-2:17.2.7-109.g1fd3ca3c.el8.noarch 1/1 2023-12-05T09:45:45.087 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 14/32 2023-12-05T09:45:45.171 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : cephadm-2:17.2.7-109.g1fd3ca3c.el8.noarch 1/1 2023-12-05T09:45:45.264 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2023-12-05T09:45:45.474 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: cephadm-2:17.2.7-109.g1fd3ca3c.el8.noarch 1/1 2023-12-05T09:45:45.509 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2023-12-05T09:45:45.748 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-12-05T09:45:46.108 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2023-12-05T09:45:46.156 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : cephadm-2:17.2.7-109.g1fd3ca3c.el8.noarch 1/1 2023-12-05T09:45:46.156 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:45:46.156 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2023-12-05T09:45:46.156 INFO:teuthology.orchestra.run.smithi100.stdout: cephadm-2:17.2.7-109.g1fd3ca3c.el8.noarch 2023-12-05T09:45:46.156 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:45:46.156 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2023-12-05T09:45:46.336 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2023-12-05T09:45:46.390 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph-immutable-object-cache 2023-12-05T09:45:46.533 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/32 2023-12-05T09:45:46.734 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2023-12-05T09:45:47.012 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2023-12-05T09:45:47.239 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2023-12-05T09:45:47.470 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:01:37 ago on Tue 05 Dec 2023 09:44:10 AM UTC. 2023-12-05T09:45:47.526 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2023-12-05T09:45:47.871 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/32 2023-12-05T09:45:48.186 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2023-12-05T09:45:48.624 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-109.g1fd3ca3c.el8.n 27/32 2023-12-05T09:45:48.828 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-2:17.2.7-109.g1fd3ca3c.el8.x86_64 28/32 2023-12-05T09:45:49.234 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2023-12-05T09:45:49.235 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2023-12-05T09:45:49.235 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repo Size 2023-12-05T09:45:49.235 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2023-12-05T09:45:49.235 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2023-12-05T09:45:49.235 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 162 k 2023-12-05T09:45:49.235 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:45:49.236 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2023-12-05T09:45:49.236 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2023-12-05T09:45:49.236 INFO:teuthology.orchestra.run.smithi100.stdout:Install 1 Package 2023-12-05T09:45:49.236 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:45:49.236 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 162 k 2023-12-05T09:45:49.236 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 490 k 2023-12-05T09:45:49.236 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2023-12-05T09:45:49.433 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-immutable-object-cache-17.2.7-109.g1fd3ca3 824 kB/s | 162 kB 00:00 2023-12-05T09:45:49.434 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2023-12-05T09:45:49.434 INFO:teuthology.orchestra.run.smithi100.stdout:Total 818 kB/s | 162 kB 00:00 2023-12-05T09:45:49.435 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2023-12-05T09:45:49.448 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2023-12-05T09:45:49.448 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2023-12-05T09:45:49.503 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2023-12-05T09:45:49.506 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2023-12-05T09:45:49.643 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2023-12-05T09:45:49.811 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-109.g1fd3ca3c.e 1/1 2023-12-05T09:45:50.434 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mgr-2:17.2.7-109.g1fd3ca3c.el8.x86_64 28/32 2023-12-05T09:45:50.474 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-109.g1fd3ca3c.e 1/1 2023-12-05T09:45:50.627 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-osd-2:17.2.7-109.g1fd3ca3c.el8.x86_64 29/32 2023-12-05T09:45:51.090 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-osd-2:17.2.7-109.g1fd3ca3c.el8.x86_64 29/32 2023-12-05T09:45:51.207 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-109.g1fd3ca3c.e 1/1 2023-12-05T09:45:51.208 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:45:51.208 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2023-12-05T09:45:51.208 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-immutable-object-cache-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:45:51.208 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:45:51.208 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2023-12-05T09:45:51.283 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mon-2:17.2.7-109.g1fd3ca3c.el8.x86_64 30/32 2023-12-05T09:45:51.430 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph-mgr 2023-12-05T09:45:51.538 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mon-2:17.2.7-109.g1fd3ca3c.el8.x86_64 30/32 2023-12-05T09:45:51.719 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mds-2:17.2.7-109.g1fd3ca3c.el8.x86_64 31/32 2023-12-05T09:45:51.762 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mds-2:17.2.7-109.g1fd3ca3c.el8.x86_64 31/32 2023-12-05T09:45:51.885 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-2:17.2.7-109.g1fd3ca3c.el8.x86_64 32/32 2023-12-05T09:45:51.996 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-2:17.2.7-109.g1fd3ca3c.el8.x86_64 32/32 2023-12-05T09:45:51.996 INFO:teuthology.orchestra.run.smithi150.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-12-05T09:45:51.996 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:45:52.494 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:01:42 ago on Tue 05 Dec 2023 09:44:10 AM UTC. 2023-12-05T09:45:52.551 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/32 2023-12-05T09:45:52.551 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mds-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2/32 2023-12-05T09:45:52.552 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-2:17.2.7-109.g1fd3ca3c.el8.x86_64 3/32 2023-12-05T09:45:52.552 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mon-2:17.2.7-109.g1fd3ca3c.el8.x86_64 4/32 2023-12-05T09:45:52.552 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-osd-2:17.2.7-109.g1fd3ca3c.el8.x86_64 5/32 2023-12-05T09:45:52.552 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-109.g1fd3ca3c.el8.n 6/32 2023-12-05T09:45:52.552 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 7/32 2023-12-05T09:45:52.552 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2023-12-05T09:45:52.552 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2023-12-05T09:45:52.552 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 10/32 2023-12-05T09:45:52.552 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2023-12-05T09:45:52.552 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 12/32 2023-12-05T09:45:52.552 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 13/32 2023-12-05T09:45:52.552 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2023-12-05T09:45:52.552 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2023-12-05T09:45:52.552 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2023-12-05T09:45:52.553 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-12-05T09:45:52.553 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2023-12-05T09:45:52.553 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2023-12-05T09:45:52.553 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2023-12-05T09:45:52.553 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2023-12-05T09:45:52.553 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2023-12-05T09:45:52.553 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2023-12-05T09:45:52.553 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2023-12-05T09:45:52.553 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2023-12-05T09:45:52.553 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2023-12-05T09:45:52.553 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2023-12-05T09:45:52.553 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2023-12-05T09:45:52.553 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 29/32 2023-12-05T09:45:52.553 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2023-12-05T09:45:52.553 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2023-12-05T09:45:53.693 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2023-12-05T09:45:53.693 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:45:53.693 INFO:teuthology.orchestra.run.smithi150.stdout:Installed: 2023-12-05T09:45:53.693 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:45:53.694 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mds-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:45:53.694 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:45:53.694 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-modules-core-2:17.2.7-109.g1fd3ca3c.el8.noarch 2023-12-05T09:45:53.694 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mon-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:45:53.694 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-osd-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:45:53.694 INFO:teuthology.orchestra.run.smithi150.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-12-05T09:45:53.694 INFO:teuthology.orchestra.run.smithi150.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-12-05T09:45:53.694 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-12-05T09:45:53.694 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-12-05T09:45:53.694 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-12-05T09:45:53.694 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-12-05T09:45:53.694 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-6.2-6.el8.noarch 2023-12-05T09:45:53.694 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-12-05T09:45:53.694 INFO:teuthology.orchestra.run.smithi150.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-12-05T09:45:53.695 INFO:teuthology.orchestra.run.smithi150.stdout: python3-mako-1.0.6-14.el8.noarch 2023-12-05T09:45:53.695 INFO:teuthology.orchestra.run.smithi150.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-12-05T09:45:53.695 INFO:teuthology.orchestra.run.smithi150.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-12-05T09:45:53.695 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-12-05T09:45:53.695 INFO:teuthology.orchestra.run.smithi150.stdout: python3-portend-2.6-1.el8.noarch 2023-12-05T09:45:53.695 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-12-05T09:45:53.695 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pycparser-2.14-14.el8.noarch 2023-12-05T09:45:53.695 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pytz-2017.2-11.el8.noarch 2023-12-05T09:45:53.695 INFO:teuthology.orchestra.run.smithi150.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-12-05T09:45:53.695 INFO:teuthology.orchestra.run.smithi150.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-12-05T09:45:53.695 INFO:teuthology.orchestra.run.smithi150.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-12-05T09:45:53.695 INFO:teuthology.orchestra.run.smithi150.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-12-05T09:45:53.695 INFO:teuthology.orchestra.run.smithi150.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-12-05T09:45:53.695 INFO:teuthology.orchestra.run.smithi150.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-12-05T09:45:53.695 INFO:teuthology.orchestra.run.smithi150.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-12-05T09:45:53.696 INFO:teuthology.orchestra.run.smithi150.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-12-05T09:45:53.696 INFO:teuthology.orchestra.run.smithi150.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-12-05T09:45:53.696 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:45:53.696 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2023-12-05T09:45:53.957 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum -y install ceph-base 2023-12-05T09:45:54.009 INFO:teuthology.orchestra.run.smithi100.stdout:Package ceph-mgr-2:17.2.7-109.g1fd3ca3c.el8.x86_64 is already installed. 2023-12-05T09:45:54.248 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2023-12-05T09:45:54.250 INFO:teuthology.orchestra.run.smithi100.stdout:Nothing to do. 2023-12-05T09:45:54.250 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2023-12-05T09:45:54.373 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph-mgr-dashboard 2023-12-05T09:45:55.031 INFO:teuthology.orchestra.run.smithi150.stdout:Last metadata expiration check: 0:01:43 ago on Tue 05 Dec 2023 09:44:12 AM UTC. 2023-12-05T09:45:55.433 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:01:45 ago on Tue 05 Dec 2023 09:44:10 AM UTC. 2023-12-05T09:45:56.546 INFO:teuthology.orchestra.run.smithi150.stdout:Package ceph-base-2:17.2.7-109.g1fd3ca3c.el8.x86_64 is already installed. 2023-12-05T09:45:56.790 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2023-12-05T09:45:56.792 INFO:teuthology.orchestra.run.smithi150.stdout:Nothing to do. 2023-12-05T09:45:56.792 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2023-12-05T09:45:56.932 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum -y install cephadm 2023-12-05T09:45:57.275 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2023-12-05T09:45:57.276 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2023-12-05T09:45:57.277 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repository Size 2023-12-05T09:45:57.277 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2023-12-05T09:45:57.277 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2023-12-05T09:45:57.277 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-dashboard noarch 2:17.2.7-109.g1fd3ca3c.el8 ceph-noarch 1.7 M 2023-12-05T09:45:57.277 INFO:teuthology.orchestra.run.smithi100.stdout:Installing dependencies: 2023-12-05T09:45:57.277 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-grafana-dashboards noarch 2:17.2.7-109.g1fd3ca3c.el8 ceph-noarch 23 k 2023-12-05T09:45:57.277 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-prometheus-alerts noarch 2:17.2.7-109.g1fd3ca3c.el8 ceph-noarch 14 k 2023-12-05T09:45:57.277 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-12-05T09:45:57.277 INFO:teuthology.orchestra.run.smithi100.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-12-05T09:45:57.277 INFO:teuthology.orchestra.run.smithi100.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-12-05T09:45:57.277 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:45:57.277 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2023-12-05T09:45:57.277 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2023-12-05T09:45:57.277 INFO:teuthology.orchestra.run.smithi100.stdout:Install 6 Packages 2023-12-05T09:45:57.277 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:45:57.278 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 2.0 M 2023-12-05T09:45:57.278 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 8.0 M 2023-12-05T09:45:57.278 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2023-12-05T09:45:57.495 INFO:teuthology.orchestra.run.smithi100.stdout:(1/6): ceph-prometheus-alerts-17.2.7-109.g1fd3c 99 kB/s | 14 kB 00:00 2023-12-05T09:45:57.595 INFO:teuthology.orchestra.run.smithi100.stdout:(2/6): ceph-grafana-dashboards-17.2.7-109.g1fd3 93 kB/s | 23 kB 00:00 2023-12-05T09:45:57.637 INFO:teuthology.orchestra.run.smithi100.stdout:(3/6): python3-jwt-1.6.1-2.el8.noarch.rpm 301 kB/s | 43 kB 00:00 2023-12-05T09:45:57.729 INFO:teuthology.orchestra.run.smithi100.stdout:(4/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 252 kB/s | 34 kB 00:00 2023-12-05T09:45:57.830 INFO:teuthology.orchestra.run.smithi100.stdout:(5/6): python3-routes-2.4.1-12.el8.noarch.rpm 1.0 MB/s | 196 kB 00:00 2023-12-05T09:45:57.996 INFO:teuthology.orchestra.run.smithi150.stdout:Last metadata expiration check: 0:01:45 ago on Tue 05 Dec 2023 09:44:12 AM UTC. 2023-12-05T09:45:58.138 INFO:teuthology.orchestra.run.smithi100.stdout:(6/6): ceph-mgr-dashboard-17.2.7-109.g1fd3ca3c. 2.1 MB/s | 1.7 MB 00:00 2023-12-05T09:45:58.141 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2023-12-05T09:45:58.141 INFO:teuthology.orchestra.run.smithi100.stdout:Total 2.3 MB/s | 2.0 MB 00:00 2023-12-05T09:45:58.166 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2023-12-05T09:45:58.178 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2023-12-05T09:45:58.179 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2023-12-05T09:45:58.275 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2023-12-05T09:45:58.279 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2023-12-05T09:45:58.564 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2023-12-05T09:45:58.778 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2023-12-05T09:45:59.073 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2023-12-05T09:45:59.278 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2023-12-05T09:45:59.575 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-109.g1fd3ca3c.el8.no 4/6 2023-12-05T09:45:59.750 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2023-12-05T09:45:59.751 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2023-12-05T09:45:59.751 INFO:teuthology.orchestra.run.smithi150.stdout: Package Arch Version Repository Size 2023-12-05T09:45:59.751 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2023-12-05T09:45:59.751 INFO:teuthology.orchestra.run.smithi150.stdout:Installing: 2023-12-05T09:45:59.752 INFO:teuthology.orchestra.run.smithi150.stdout: cephadm noarch 2:17.2.7-109.g1fd3ca3c.el8 ceph-noarch 80 k 2023-12-05T09:45:59.752 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:45:59.752 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction Summary 2023-12-05T09:45:59.752 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2023-12-05T09:45:59.752 INFO:teuthology.orchestra.run.smithi150.stdout:Install 1 Package 2023-12-05T09:45:59.752 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:45:59.752 INFO:teuthology.orchestra.run.smithi150.stdout:Total download size: 80 k 2023-12-05T09:45:59.752 INFO:teuthology.orchestra.run.smithi150.stdout:Installed size: 364 k 2023-12-05T09:45:59.752 INFO:teuthology.orchestra.run.smithi150.stdout:Downloading Packages: 2023-12-05T09:45:59.936 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-109.g1fd3ca3c.el8.n 5/6 2023-12-05T09:45:59.971 INFO:teuthology.orchestra.run.smithi150.stdout:cephadm-17.2.7-109.g1fd3ca3c.el8.noarch.rpm 367 kB/s | 80 kB 00:00 2023-12-05T09:45:59.972 INFO:teuthology.orchestra.run.smithi150.stdout:-------------------------------------------------------------------------------- 2023-12-05T09:45:59.972 INFO:teuthology.orchestra.run.smithi150.stdout:Total 364 kB/s | 80 kB 00:00 2023-12-05T09:45:59.973 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction check 2023-12-05T09:45:59.983 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction check succeeded. 2023-12-05T09:45:59.983 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction test 2023-12-05T09:45:59.986 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction test succeeded. 2023-12-05T09:45:59.990 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction 2023-12-05T09:46:00.042 INFO:teuthology.orchestra.run.smithi150.stdout: Preparing : 1/1 2023-12-05T09:46:00.138 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-109.g1fd3ca3c.el8.noarch 6/6 2023-12-05T09:46:00.486 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-109.g1fd3ca3c.el8.noarch 6/6 2023-12-05T09:46:00.486 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-109.g1fd3ca3c.el8.n 1/6 2023-12-05T09:46:00.486 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-109.g1fd3ca3c.el8.noarch 2/6 2023-12-05T09:46:00.486 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-109.g1fd3ca3c.el8.no 3/6 2023-12-05T09:46:00.486 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2023-12-05T09:46:00.486 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2023-12-05T09:46:00.626 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: cephadm-2:17.2.7-109.g1fd3ca3c.el8.noarch 1/1 2023-12-05T09:46:00.806 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : cephadm-2:17.2.7-109.g1fd3ca3c.el8.noarch 1/1 2023-12-05T09:46:01.105 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: cephadm-2:17.2.7-109.g1fd3ca3c.el8.noarch 1/1 2023-12-05T09:46:01.236 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2023-12-05T09:46:01.236 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:46:01.237 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2023-12-05T09:46:01.237 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-grafana-dashboards-2:17.2.7-109.g1fd3ca3c.el8.noarch 2023-12-05T09:46:01.237 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-dashboard-2:17.2.7-109.g1fd3ca3c.el8.noarch 2023-12-05T09:46:01.237 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-prometheus-alerts-2:17.2.7-109.g1fd3ca3c.el8.noarch 2023-12-05T09:46:01.237 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-12-05T09:46:01.237 INFO:teuthology.orchestra.run.smithi100.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-12-05T09:46:01.237 INFO:teuthology.orchestra.run.smithi100.stdout: python3-routes-2.4.1-12.el8.noarch 2023-12-05T09:46:01.237 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:46:01.237 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2023-12-05T09:46:01.408 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph-mgr-diskprediction-local 2023-12-05T09:46:01.835 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : cephadm-2:17.2.7-109.g1fd3ca3c.el8.noarch 1/1 2023-12-05T09:46:01.835 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:46:01.836 INFO:teuthology.orchestra.run.smithi150.stdout:Installed: 2023-12-05T09:46:01.836 INFO:teuthology.orchestra.run.smithi150.stdout: cephadm-2:17.2.7-109.g1fd3ca3c.el8.noarch 2023-12-05T09:46:01.836 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:46:01.836 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2023-12-05T09:46:02.090 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum -y install ceph-immutable-object-cache 2023-12-05T09:46:02.471 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:01:52 ago on Tue 05 Dec 2023 09:44:10 AM UTC. 2023-12-05T09:46:03.160 INFO:teuthology.orchestra.run.smithi150.stdout:Last metadata expiration check: 0:01:51 ago on Tue 05 Dec 2023 09:44:12 AM UTC. 2023-12-05T09:46:04.212 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2023-12-05T09:46:04.214 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================================ 2023-12-05T09:46:04.214 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repository Size 2023-12-05T09:46:04.214 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================================ 2023-12-05T09:46:04.214 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2023-12-05T09:46:04.214 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-109.g1fd3ca3c.el8 ceph-noarch 7.4 M 2023-12-05T09:46:04.214 INFO:teuthology.orchestra.run.smithi100.stdout:Installing dependencies: 2023-12-05T09:46:04.214 INFO:teuthology.orchestra.run.smithi100.stdout: libgfortran x86_64 8.5.0-21.el8 baseos 645 k 2023-12-05T09:46:04.214 INFO:teuthology.orchestra.run.smithi100.stdout: libquadmath x86_64 8.5.0-21.el8 baseos 172 k 2023-12-05T09:46:04.215 INFO:teuthology.orchestra.run.smithi100.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-12-05T09:46:04.215 INFO:teuthology.orchestra.run.smithi100.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-12-05T09:46:04.215 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-12-05T09:46:04.215 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-12-05T09:46:04.215 INFO:teuthology.orchestra.run.smithi100.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-12-05T09:46:04.215 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:46:04.215 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2023-12-05T09:46:04.215 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================================ 2023-12-05T09:46:04.215 INFO:teuthology.orchestra.run.smithi100.stdout:Install 8 Packages 2023-12-05T09:46:04.215 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:46:04.216 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 35 M 2023-12-05T09:46:04.216 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 210 M 2023-12-05T09:46:04.216 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2023-12-05T09:46:04.897 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2023-12-05T09:46:04.898 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2023-12-05T09:46:04.898 INFO:teuthology.orchestra.run.smithi150.stdout: Package Arch Version Repo Size 2023-12-05T09:46:04.898 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2023-12-05T09:46:04.898 INFO:teuthology.orchestra.run.smithi150.stdout:Installing: 2023-12-05T09:46:04.898 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 162 k 2023-12-05T09:46:04.898 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:46:04.898 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction Summary 2023-12-05T09:46:04.898 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2023-12-05T09:46:04.898 INFO:teuthology.orchestra.run.smithi150.stdout:Install 1 Package 2023-12-05T09:46:04.898 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:46:04.898 INFO:teuthology.orchestra.run.smithi150.stdout:Total download size: 162 k 2023-12-05T09:46:04.898 INFO:teuthology.orchestra.run.smithi150.stdout:Installed size: 490 k 2023-12-05T09:46:04.899 INFO:teuthology.orchestra.run.smithi150.stdout:Downloading Packages: 2023-12-05T09:46:05.232 INFO:teuthology.orchestra.run.smithi150.stdout:ceph-immutable-object-cache-17.2.7-109.g1fd3ca3 483 kB/s | 162 kB 00:00 2023-12-05T09:46:05.233 INFO:teuthology.orchestra.run.smithi150.stdout:-------------------------------------------------------------------------------- 2023-12-05T09:46:05.233 INFO:teuthology.orchestra.run.smithi150.stdout:Total 481 kB/s | 162 kB 00:00 2023-12-05T09:46:05.233 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction check 2023-12-05T09:46:05.247 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction check succeeded. 2023-12-05T09:46:05.248 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction test 2023-12-05T09:46:05.303 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction test succeeded. 2023-12-05T09:46:05.306 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction 2023-12-05T09:46:05.322 INFO:teuthology.orchestra.run.smithi100.stdout:(1/8): openblas-0.3.15-4.el8.x86_64.rpm 5.5 MB/s | 4.7 MB 00:00 2023-12-05T09:46:05.398 INFO:teuthology.orchestra.run.smithi100.stdout:(2/8): openblas-threads-0.3.15-4.el8.x86_64.rpm 5.2 MB/s | 4.9 MB 00:00 2023-12-05T09:46:05.432 INFO:teuthology.orchestra.run.smithi150.stdout: Preparing : 1/1 2023-12-05T09:46:05.456 INFO:teuthology.orchestra.run.smithi100.stdout:(3/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 3.8 MB/s | 225 kB 00:00 2023-12-05T09:46:05.608 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-109.g1fd3ca3c.e 1/1 2023-12-05T09:46:05.723 INFO:teuthology.orchestra.run.smithi100.stdout:(4/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 9.3 MB/s | 3.7 MB 00:00 2023-12-05T09:46:05.974 INFO:teuthology.orchestra.run.smithi100.stdout:(5/8): libgfortran-8.5.0-21.el8.x86_64.rpm 2.5 MB/s | 645 kB 00:00 2023-12-05T09:46:06.024 INFO:teuthology.orchestra.run.smithi100.stdout:(6/8): libquadmath-8.5.0-21.el8.x86_64.rpm 3.4 MB/s | 172 kB 00:00 2023-12-05T09:46:06.191 INFO:teuthology.orchestra.run.smithi100.stdout:(7/8): ceph-mgr-diskprediction-local-17.2.7-109 4.3 MB/s | 7.4 MB 00:01 2023-12-05T09:46:06.297 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-109.g1fd3ca3c.e 1/1 2023-12-05T09:46:06.391 INFO:teuthology.orchestra.run.smithi100.stdout:(8/8): python3-scipy-1.0.0-21.module_el8.5.0+77 15 MB/s | 14 MB 00:00 2023-12-05T09:46:06.392 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2023-12-05T09:46:06.392 INFO:teuthology.orchestra.run.smithi100.stdout:Total 16 MB/s | 35 MB 00:02 2023-12-05T09:46:06.719 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2023-12-05T09:46:06.742 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2023-12-05T09:46:06.742 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2023-12-05T09:46:07.026 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-109.g1fd3ca3c.e 1/1 2023-12-05T09:46:07.026 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:46:07.026 INFO:teuthology.orchestra.run.smithi150.stdout:Installed: 2023-12-05T09:46:07.027 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-immutable-object-cache-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:46:07.027 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:46:07.027 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2023-12-05T09:46:07.161 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2023-12-05T09:46:07.165 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2023-12-05T09:46:07.298 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum -y install ceph-mgr 2023-12-05T09:46:07.747 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2023-12-05T09:46:07.874 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libquadmath-8.5.0-21.el8.x86_64 1/8 2023-12-05T09:46:08.035 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libquadmath-8.5.0-21.el8.x86_64 1/8 2023-12-05T09:46:08.190 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libgfortran-8.5.0-21.el8.x86_64 2/8 2023-12-05T09:46:08.383 INFO:teuthology.orchestra.run.smithi150.stdout:Last metadata expiration check: 0:01:56 ago on Tue 05 Dec 2023 09:44:12 AM UTC. 2023-12-05T09:46:08.844 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libgfortran-8.5.0-21.el8.x86_64 2/8 2023-12-05T09:46:09.000 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : openblas-0.3.15-4.el8.x86_64 3/8 2023-12-05T09:46:09.681 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 3/8 2023-12-05T09:46:09.824 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-12-05T09:46:09.931 INFO:teuthology.orchestra.run.smithi150.stdout:Package ceph-mgr-2:17.2.7-109.g1fd3ca3c.el8.x86_64 is already installed. 2023-12-05T09:46:10.173 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2023-12-05T09:46:10.174 INFO:teuthology.orchestra.run.smithi150.stdout:Nothing to do. 2023-12-05T09:46:10.174 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2023-12-05T09:46:10.313 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum -y install ceph-mgr-dashboard 2023-12-05T09:46:10.630 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-12-05T09:46:10.981 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2023-12-05T09:46:11.182 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-12-05T09:46:11.379 INFO:teuthology.orchestra.run.smithi150.stdout:Last metadata expiration check: 0:01:59 ago on Tue 05 Dec 2023 09:44:12 AM UTC. 2023-12-05T09:46:13.136 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2023-12-05T09:46:13.137 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2023-12-05T09:46:13.137 INFO:teuthology.orchestra.run.smithi150.stdout: Package Arch Version Repository Size 2023-12-05T09:46:13.138 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2023-12-05T09:46:13.138 INFO:teuthology.orchestra.run.smithi150.stdout:Installing: 2023-12-05T09:46:13.138 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-dashboard noarch 2:17.2.7-109.g1fd3ca3c.el8 ceph-noarch 1.7 M 2023-12-05T09:46:13.138 INFO:teuthology.orchestra.run.smithi150.stdout:Installing dependencies: 2023-12-05T09:46:13.138 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-grafana-dashboards noarch 2:17.2.7-109.g1fd3ca3c.el8 ceph-noarch 23 k 2023-12-05T09:46:13.138 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-prometheus-alerts noarch 2:17.2.7-109.g1fd3ca3c.el8 ceph-noarch 14 k 2023-12-05T09:46:13.138 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-12-05T09:46:13.138 INFO:teuthology.orchestra.run.smithi150.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-12-05T09:46:13.138 INFO:teuthology.orchestra.run.smithi150.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-12-05T09:46:13.138 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:46:13.138 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction Summary 2023-12-05T09:46:13.138 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2023-12-05T09:46:13.139 INFO:teuthology.orchestra.run.smithi150.stdout:Install 6 Packages 2023-12-05T09:46:13.139 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:46:13.139 INFO:teuthology.orchestra.run.smithi150.stdout:Total download size: 2.0 M 2023-12-05T09:46:13.139 INFO:teuthology.orchestra.run.smithi150.stdout:Installed size: 8.0 M 2023-12-05T09:46:13.139 INFO:teuthology.orchestra.run.smithi150.stdout:Downloading Packages: 2023-12-05T09:46:13.194 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-12-05T09:46:13.819 INFO:teuthology.orchestra.run.smithi150.stdout:(1/6): ceph-grafana-dashboards-17.2.7-109.g1fd3 79 kB/s | 23 kB 00:00 2023-12-05T09:46:13.849 INFO:teuthology.orchestra.run.smithi150.stdout:(2/6): ceph-prometheus-alerts-17.2.7-109.g1fd3c 46 kB/s | 14 kB 00:00 2023-12-05T09:46:14.094 INFO:teuthology.orchestra.run.smithi150.stdout:(3/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 135 kB/s | 34 kB 00:00 2023-12-05T09:46:14.120 INFO:teuthology.orchestra.run.smithi150.stdout:(4/6): python3-jwt-1.6.1-2.el8.noarch.rpm 142 kB/s | 43 kB 00:00 2023-12-05T09:46:14.312 INFO:teuthology.orchestra.run.smithi150.stdout:(5/6): python3-routes-2.4.1-12.el8.noarch.rpm 905 kB/s | 196 kB 00:00 2023-12-05T09:46:14.507 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 7/8 2023-12-05T09:46:14.754 INFO:teuthology.orchestra.run.smithi150.stdout:(6/6): ceph-mgr-dashboard-17.2.7-109.g1fd3ca3c. 1.4 MB/s | 1.7 MB 00:01 2023-12-05T09:46:14.756 INFO:teuthology.orchestra.run.smithi150.stdout:-------------------------------------------------------------------------------- 2023-12-05T09:46:14.756 INFO:teuthology.orchestra.run.smithi150.stdout:Total 1.2 MB/s | 2.0 MB 00:01 2023-12-05T09:46:14.764 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-109.g1fd3ca3c 8/8 2023-12-05T09:46:14.783 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction check 2023-12-05T09:46:14.796 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction check succeeded. 2023-12-05T09:46:14.797 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction test 2023-12-05T09:46:14.894 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction test succeeded. 2023-12-05T09:46:14.898 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction 2023-12-05T09:46:15.158 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-109.g1fd3ca3c 8/8 2023-12-05T09:46:15.158 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-109.g1fd3ca3c 1/8 2023-12-05T09:46:15.158 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 2/8 2023-12-05T09:46:15.158 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 3/8 2023-12-05T09:46:15.159 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2023-12-05T09:46:15.159 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2023-12-05T09:46:15.159 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 6/8 2023-12-05T09:46:15.159 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libgfortran-8.5.0-21.el8.x86_64 7/8 2023-12-05T09:46:15.214 INFO:teuthology.orchestra.run.smithi150.stdout: Preparing : 1/1 2023-12-05T09:46:15.435 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2023-12-05T09:46:15.846 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2023-12-05T09:46:15.943 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libquadmath-8.5.0-21.el8.x86_64 8/8 2023-12-05T09:46:15.943 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:46:15.943 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2023-12-05T09:46:15.943 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-diskprediction-local-2:17.2.7-109.g1fd3ca3c.el8.noarch 2023-12-05T09:46:15.944 INFO:teuthology.orchestra.run.smithi100.stdout: libgfortran-8.5.0-21.el8.x86_64 2023-12-05T09:46:15.944 INFO:teuthology.orchestra.run.smithi100.stdout: libquadmath-8.5.0-21.el8.x86_64 2023-12-05T09:46:15.944 INFO:teuthology.orchestra.run.smithi100.stdout: openblas-0.3.15-4.el8.x86_64 2023-12-05T09:46:15.944 INFO:teuthology.orchestra.run.smithi100.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-12-05T09:46:15.944 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-12-05T09:46:15.944 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-12-05T09:46:15.944 INFO:teuthology.orchestra.run.smithi100.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-12-05T09:46:15.944 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:46:15.944 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2023-12-05T09:46:16.051 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2023-12-05T09:46:16.115 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph-mgr-rook 2023-12-05T09:46:16.198 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-109.g1fd3ca3c.el8.no 4/6 2023-12-05T09:46:16.583 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-109.g1fd3ca3c.el8.n 5/6 2023-12-05T09:46:16.756 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-109.g1fd3ca3c.el8.noarch 6/6 2023-12-05T09:46:17.105 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-109.g1fd3ca3c.el8.noarch 6/6 2023-12-05T09:46:17.106 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-109.g1fd3ca3c.el8.n 1/6 2023-12-05T09:46:17.106 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-109.g1fd3ca3c.el8.noarch 2/6 2023-12-05T09:46:17.106 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-109.g1fd3ca3c.el8.no 3/6 2023-12-05T09:46:17.106 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2023-12-05T09:46:17.106 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2023-12-05T09:46:17.175 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:02:07 ago on Tue 05 Dec 2023 09:44:10 AM UTC. 2023-12-05T09:46:17.857 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2023-12-05T09:46:17.857 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:46:17.857 INFO:teuthology.orchestra.run.smithi150.stdout:Installed: 2023-12-05T09:46:17.857 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-grafana-dashboards-2:17.2.7-109.g1fd3ca3c.el8.noarch 2023-12-05T09:46:17.858 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-dashboard-2:17.2.7-109.g1fd3ca3c.el8.noarch 2023-12-05T09:46:17.858 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-prometheus-alerts-2:17.2.7-109.g1fd3ca3c.el8.noarch 2023-12-05T09:46:17.858 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-12-05T09:46:17.858 INFO:teuthology.orchestra.run.smithi150.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-12-05T09:46:17.858 INFO:teuthology.orchestra.run.smithi150.stdout: python3-routes-2.4.1-12.el8.noarch 2023-12-05T09:46:17.858 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:46:17.858 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2023-12-05T09:46:18.019 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum -y install ceph-mgr-diskprediction-local 2023-12-05T09:46:18.933 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2023-12-05T09:46:18.935 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2023-12-05T09:46:18.935 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repository Size 2023-12-05T09:46:18.935 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2023-12-05T09:46:18.935 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2023-12-05T09:46:18.935 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-rook noarch 2:17.2.7-109.g1fd3ca3c.el8 ceph-noarch 47 k 2023-12-05T09:46:18.936 INFO:teuthology.orchestra.run.smithi100.stdout:Installing dependencies: 2023-12-05T09:46:18.936 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-12-05T09:46:18.936 INFO:teuthology.orchestra.run.smithi100.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-12-05T09:46:18.936 INFO:teuthology.orchestra.run.smithi100.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-12-05T09:46:18.936 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-12-05T09:46:18.936 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-12-05T09:46:18.936 INFO:teuthology.orchestra.run.smithi100.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-12-05T09:46:18.936 INFO:teuthology.orchestra.run.smithi100.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-12-05T09:46:18.936 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-12-05T09:46:18.936 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-12-05T09:46:18.936 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-12-05T09:46:18.936 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-12-05T09:46:18.937 INFO:teuthology.orchestra.run.smithi100.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-12-05T09:46:18.937 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:46:18.937 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2023-12-05T09:46:18.937 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2023-12-05T09:46:18.937 INFO:teuthology.orchestra.run.smithi100.stdout:Install 13 Packages 2023-12-05T09:46:18.937 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:46:18.938 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 1.9 M 2023-12-05T09:46:18.938 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 25 M 2023-12-05T09:46:18.938 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2023-12-05T09:46:19.093 INFO:teuthology.orchestra.run.smithi150.stdout:Last metadata expiration check: 0:02:07 ago on Tue 05 Dec 2023 09:44:12 AM UTC. 2023-12-05T09:46:19.641 INFO:teuthology.orchestra.run.smithi100.stdout:(1/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 220 kB/s | 27 kB 00:00 2023-12-05T09:46:19.665 INFO:teuthology.orchestra.run.smithi100.stdout:(2/13): python3-jsonpointer-1.10-11.el8.noarch. 137 kB/s | 20 kB 00:00 2023-12-05T09:46:19.691 INFO:teuthology.orchestra.run.smithi100.stdout:(3/13): ceph-mgr-rook-17.2.7-109.g1fd3ca3c.el8. 277 kB/s | 47 kB 00:00 2023-12-05T09:46:19.749 INFO:teuthology.orchestra.run.smithi100.stdout:(4/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.1 MB/s | 126 kB 00:00 2023-12-05T09:46:19.775 INFO:teuthology.orchestra.run.smithi100.stdout:(5/13): python3-pyasn1-modules-0.3.7-6.el8.noar 1.0 MB/s | 110 kB 00:00 2023-12-05T09:46:19.883 INFO:teuthology.orchestra.run.smithi100.stdout:(6/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 806 kB/s | 155 kB 00:00 2023-12-05T09:46:19.942 INFO:teuthology.orchestra.run.smithi100.stdout:(7/13): python3-requests-oauthlib-1.0.0-1.el8.n 222 kB/s | 43 kB 00:00 2023-12-05T09:46:19.975 INFO:teuthology.orchestra.run.smithi100.stdout:(8/13): python3-cachetools-3.1.1-4.el8.noarch.r 164 kB/s | 33 kB 00:00 2023-12-05T09:46:20.079 INFO:teuthology.orchestra.run.smithi100.stdout:(9/13): python3-google-auth-1.1.1-10.el8.noarch 628 kB/s | 81 kB 00:00 2023-12-05T09:46:20.101 INFO:teuthology.orchestra.run.smithi100.stdout:(10/13): python3-certifi-2018.10.15-7.el8.noarc 75 kB/s | 16 kB 00:00 2023-12-05T09:46:20.143 INFO:teuthology.orchestra.run.smithi100.stdout:(11/13): python3-rsa-4.9-2.el8.noarch.rpm 962 kB/s | 64 kB 00:00 2023-12-05T09:46:20.177 INFO:teuthology.orchestra.run.smithi100.stdout:(12/13): python3-kubernetes-11.0.0-6.el8.noarch 6.0 MB/s | 1.2 MB 00:00 2023-12-05T09:46:20.202 INFO:teuthology.orchestra.run.smithi100.stdout:(13/13): python3-websocket-client-0.56.0-5.el8. 611 kB/s | 61 kB 00:00 2023-12-05T09:46:20.205 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2023-12-05T09:46:20.205 INFO:teuthology.orchestra.run.smithi100.stdout:Total 1.5 MB/s | 1.9 MB 00:01 2023-12-05T09:46:20.337 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2023-12-05T09:46:20.356 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2023-12-05T09:46:20.356 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2023-12-05T09:46:20.462 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2023-12-05T09:46:20.466 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2023-12-05T09:46:20.884 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2023-12-05T09:46:20.885 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================================ 2023-12-05T09:46:20.885 INFO:teuthology.orchestra.run.smithi150.stdout: Package Arch Version Repository Size 2023-12-05T09:46:20.885 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================================ 2023-12-05T09:46:20.885 INFO:teuthology.orchestra.run.smithi150.stdout:Installing: 2023-12-05T09:46:20.885 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-109.g1fd3ca3c.el8 ceph-noarch 7.4 M 2023-12-05T09:46:20.885 INFO:teuthology.orchestra.run.smithi150.stdout:Installing dependencies: 2023-12-05T09:46:20.885 INFO:teuthology.orchestra.run.smithi150.stdout: libgfortran x86_64 8.5.0-21.el8 baseos 645 k 2023-12-05T09:46:20.885 INFO:teuthology.orchestra.run.smithi150.stdout: libquadmath x86_64 8.5.0-21.el8 baseos 172 k 2023-12-05T09:46:20.886 INFO:teuthology.orchestra.run.smithi150.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-12-05T09:46:20.886 INFO:teuthology.orchestra.run.smithi150.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-12-05T09:46:20.886 INFO:teuthology.orchestra.run.smithi150.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-12-05T09:46:20.886 INFO:teuthology.orchestra.run.smithi150.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-12-05T09:46:20.886 INFO:teuthology.orchestra.run.smithi150.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-12-05T09:46:20.886 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:46:20.886 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction Summary 2023-12-05T09:46:20.886 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================================ 2023-12-05T09:46:20.886 INFO:teuthology.orchestra.run.smithi150.stdout:Install 8 Packages 2023-12-05T09:46:20.886 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:46:20.887 INFO:teuthology.orchestra.run.smithi150.stdout:Total download size: 35 M 2023-12-05T09:46:20.887 INFO:teuthology.orchestra.run.smithi150.stdout:Installed size: 210 M 2023-12-05T09:46:20.887 INFO:teuthology.orchestra.run.smithi150.stdout:Downloading Packages: 2023-12-05T09:46:21.034 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2023-12-05T09:46:21.257 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2023-12-05T09:46:21.444 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2023-12-05T09:46:21.669 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rsa-4.9-2.el8.noarch 3/13 2023-12-05T09:46:21.880 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2023-12-05T09:46:22.138 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2023-12-05T09:46:22.366 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2023-12-05T09:46:22.664 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2023-12-05T09:46:22.905 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2023-12-05T09:46:23.521 INFO:teuthology.orchestra.run.smithi150.stdout:(1/8): openblas-threads-0.3.15-4.el8.x86_64.rpm 2.2 MB/s | 4.9 MB 00:02 2023-12-05T09:46:23.672 INFO:teuthology.orchestra.run.smithi150.stdout:(2/8): openblas-0.3.15-4.el8.x86_64.rpm 2.0 MB/s | 4.7 MB 00:02 2023-12-05T09:46:23.872 INFO:teuthology.orchestra.run.smithi150.stdout:(3/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 1.1 MB/s | 225 kB 00:00 2023-12-05T09:46:24.133 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2023-12-05T09:46:24.388 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2023-12-05T09:46:24.555 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2023-12-05T09:46:24.758 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2023-12-05T09:46:24.954 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-rook-2:17.2.7-109.g1fd3ca3c.el8.noarch 13/13 2023-12-05T09:46:24.989 INFO:teuthology.orchestra.run.smithi150.stdout:(4/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 2.5 MB/s | 3.7 MB 00:01 2023-12-05T09:46:25.313 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-109.g1fd3ca3c.el8.noarch 13/13 2023-12-05T09:46:25.313 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-rook-2:17.2.7-109.g1fd3ca3c.el8.noarch 1/13 2023-12-05T09:46:25.313 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2023-12-05T09:46:25.314 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2023-12-05T09:46:25.314 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2023-12-05T09:46:25.314 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2023-12-05T09:46:25.314 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2023-12-05T09:46:25.314 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2023-12-05T09:46:25.314 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2023-12-05T09:46:25.314 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2023-12-05T09:46:25.314 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2023-12-05T09:46:25.314 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2023-12-05T09:46:25.314 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 12/13 2023-12-05T09:46:25.398 INFO:teuthology.orchestra.run.smithi150.stdout:(5/8): libgfortran-8.5.0-21.el8.x86_64.rpm 1.5 MB/s | 645 kB 00:00 2023-12-05T09:46:25.498 INFO:teuthology.orchestra.run.smithi150.stdout:(6/8): libquadmath-8.5.0-21.el8.x86_64.rpm 1.7 MB/s | 172 kB 00:00 2023-12-05T09:46:26.121 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2023-12-05T09:46:26.121 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:46:26.121 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2023-12-05T09:46:26.121 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-rook-2:17.2.7-109.g1fd3ca3c.el8.noarch 2023-12-05T09:46:26.121 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-12-05T09:46:26.121 INFO:teuthology.orchestra.run.smithi100.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-12-05T09:46:26.121 INFO:teuthology.orchestra.run.smithi100.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-12-05T09:46:26.122 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-12-05T09:46:26.122 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-12-05T09:46:26.122 INFO:teuthology.orchestra.run.smithi100.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-12-05T09:46:26.122 INFO:teuthology.orchestra.run.smithi100.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-12-05T09:46:26.122 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-12-05T09:46:26.122 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-12-05T09:46:26.122 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-12-05T09:46:26.122 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rsa-4.9-2.el8.noarch 2023-12-05T09:46:26.122 INFO:teuthology.orchestra.run.smithi100.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-12-05T09:46:26.122 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:46:26.122 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2023-12-05T09:46:26.264 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph-mgr-cephadm 2023-12-05T09:46:26.290 INFO:teuthology.orchestra.run.smithi150.stdout:(7/8): ceph-mgr-diskprediction-local-17.2.7-109 1.5 MB/s | 7.4 MB 00:04 2023-12-05T09:46:27.331 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:02:17 ago on Tue 05 Dec 2023 09:44:10 AM UTC. 2023-12-05T09:46:27.915 INFO:teuthology.orchestra.run.smithi150.stdout:(8/8): python3-scipy-1.0.0-21.module_el8.5.0+77 3.4 MB/s | 14 MB 00:04 2023-12-05T09:46:27.916 INFO:teuthology.orchestra.run.smithi150.stdout:-------------------------------------------------------------------------------- 2023-12-05T09:46:27.916 INFO:teuthology.orchestra.run.smithi150.stdout:Total 5.0 MB/s | 35 MB 00:07 2023-12-05T09:46:28.249 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction check 2023-12-05T09:46:28.272 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction check succeeded. 2023-12-05T09:46:28.272 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction test 2023-12-05T09:46:28.690 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction test succeeded. 2023-12-05T09:46:28.693 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction 2023-12-05T09:46:29.085 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2023-12-05T09:46:29.086 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2023-12-05T09:46:29.086 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repository Size 2023-12-05T09:46:29.086 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2023-12-05T09:46:29.086 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2023-12-05T09:46:29.086 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-cephadm noarch 2:17.2.7-109.g1fd3ca3c.el8 ceph-noarch 121 k 2023-12-05T09:46:29.086 INFO:teuthology.orchestra.run.smithi100.stdout:Installing dependencies: 2023-12-05T09:46:29.087 INFO:teuthology.orchestra.run.smithi100.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-12-05T09:46:29.087 INFO:teuthology.orchestra.run.smithi100.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-12-05T09:46:29.087 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-12-05T09:46:29.087 INFO:teuthology.orchestra.run.smithi100.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-12-05T09:46:29.087 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:46:29.087 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2023-12-05T09:46:29.087 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2023-12-05T09:46:29.087 INFO:teuthology.orchestra.run.smithi100.stdout:Install 5 Packages 2023-12-05T09:46:29.087 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:46:29.088 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 6.0 M 2023-12-05T09:46:29.088 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 26 M 2023-12-05T09:46:29.088 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2023-12-05T09:46:29.306 INFO:teuthology.orchestra.run.smithi150.stdout: Preparing : 1/1 2023-12-05T09:46:29.463 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libquadmath-8.5.0-21.el8.x86_64 1/8 2023-12-05T09:46:29.618 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: libquadmath-8.5.0-21.el8.x86_64 1/8 2023-12-05T09:46:29.755 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libgfortran-8.5.0-21.el8.x86_64 2/8 2023-12-05T09:46:29.817 INFO:teuthology.orchestra.run.smithi100.stdout:(1/5): ceph-mgr-cephadm-17.2.7-109.g1fd3ca3c.el 589 kB/s | 121 kB 00:00 2023-12-05T09:46:29.884 INFO:teuthology.orchestra.run.smithi100.stdout:(2/5): python3-jinja2-2.10.1-3.el8.noarch.rpm 1.9 MB/s | 538 kB 00:00 2023-12-05T09:46:30.301 INFO:teuthology.orchestra.run.smithi100.stdout:(3/5): python3-natsort-7.1.1-2.el8.noarch.rpm 145 kB/s | 60 kB 00:00 2023-12-05T09:46:30.418 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: libgfortran-8.5.0-21.el8.x86_64 2/8 2023-12-05T09:46:30.510 INFO:teuthology.orchestra.run.smithi100.stdout:(4/5): python3-asyncssh-2.7.0-2.el8.noarch.rpm 687 kB/s | 476 kB 00:00 2023-12-05T09:46:30.563 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : openblas-0.3.15-4.el8.x86_64 3/8 2023-12-05T09:46:30.738 INFO:teuthology.orchestra.run.smithi100.stdout:(5/5): python3-babel-2.5.1-7.el8.noarch.rpm 4.3 MB/s | 4.8 MB 00:01 2023-12-05T09:46:30.738 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2023-12-05T09:46:30.738 INFO:teuthology.orchestra.run.smithi100.stdout:Total 3.6 MB/s | 6.0 MB 00:01 2023-12-05T09:46:30.819 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2023-12-05T09:46:30.835 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2023-12-05T09:46:30.835 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2023-12-05T09:46:30.953 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2023-12-05T09:46:30.957 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2023-12-05T09:46:31.249 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 3/8 2023-12-05T09:46:31.251 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2023-12-05T09:46:31.405 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-12-05T09:46:31.614 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 1/5 2023-12-05T09:46:32.223 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-12-05T09:46:32.571 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2023-12-05T09:46:32.629 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 2/5 2023-12-05T09:46:32.804 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-12-05T09:46:32.985 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 3/5 2023-12-05T09:46:33.286 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 4/5 2023-12-05T09:46:33.561 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-109.g1fd3ca3c.el8.noarch 5/5 2023-12-05T09:46:33.905 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-109.g1fd3ca3c.el8.noarch 5/5 2023-12-05T09:46:33.905 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-109.g1fd3ca3c.el8.noarch 1/5 2023-12-05T09:46:33.905 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/5 2023-12-05T09:46:33.905 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 3/5 2023-12-05T09:46:33.905 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 4/5 2023-12-05T09:46:34.605 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 5/5 2023-12-05T09:46:34.605 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:46:34.605 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2023-12-05T09:46:34.605 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-cephadm-2:17.2.7-109.g1fd3ca3c.el8.noarch 2023-12-05T09:46:34.605 INFO:teuthology.orchestra.run.smithi100.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-12-05T09:46:34.605 INFO:teuthology.orchestra.run.smithi100.stdout: python3-babel-2.5.1-7.el8.noarch 2023-12-05T09:46:34.605 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-12-05T09:46:34.605 INFO:teuthology.orchestra.run.smithi100.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-12-05T09:46:34.606 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:46:34.606 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2023-12-05T09:46:34.770 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph-fuse 2023-12-05T09:46:34.844 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-12-05T09:46:35.836 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:02:25 ago on Tue 05 Dec 2023 09:44:10 AM UTC. 2023-12-05T09:46:36.176 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 7/8 2023-12-05T09:46:36.379 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-109.g1fd3ca3c 8/8 2023-12-05T09:46:36.812 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-109.g1fd3ca3c 8/8 2023-12-05T09:46:36.812 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-109.g1fd3ca3c 1/8 2023-12-05T09:46:36.812 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 2/8 2023-12-05T09:46:36.812 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 3/8 2023-12-05T09:46:36.812 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2023-12-05T09:46:36.812 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2023-12-05T09:46:36.812 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 6/8 2023-12-05T09:46:36.813 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libgfortran-8.5.0-21.el8.x86_64 7/8 2023-12-05T09:46:37.592 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2023-12-05T09:46:37.592 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libquadmath-8.5.0-21.el8.x86_64 8/8 2023-12-05T09:46:37.592 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:46:37.592 INFO:teuthology.orchestra.run.smithi150.stdout:Installed: 2023-12-05T09:46:37.592 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-diskprediction-local-2:17.2.7-109.g1fd3ca3c.el8.noarch 2023-12-05T09:46:37.592 INFO:teuthology.orchestra.run.smithi150.stdout: libgfortran-8.5.0-21.el8.x86_64 2023-12-05T09:46:37.592 INFO:teuthology.orchestra.run.smithi150.stdout: libquadmath-8.5.0-21.el8.x86_64 2023-12-05T09:46:37.593 INFO:teuthology.orchestra.run.smithi150.stdout: openblas-0.3.15-4.el8.x86_64 2023-12-05T09:46:37.593 INFO:teuthology.orchestra.run.smithi150.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-12-05T09:46:37.593 INFO:teuthology.orchestra.run.smithi150.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-12-05T09:46:37.593 INFO:teuthology.orchestra.run.smithi150.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-12-05T09:46:37.593 INFO:teuthology.orchestra.run.smithi150.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-12-05T09:46:37.593 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:46:37.593 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2023-12-05T09:46:37.593 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2023-12-05T09:46:37.594 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repository Size 2023-12-05T09:46:37.594 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2023-12-05T09:46:37.594 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2023-12-05T09:46:37.594 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-fuse x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 875 k 2023-12-05T09:46:37.594 INFO:teuthology.orchestra.run.smithi100.stdout:Installing dependencies: 2023-12-05T09:46:37.594 INFO:teuthology.orchestra.run.smithi100.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-12-05T09:46:37.594 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:46:37.594 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2023-12-05T09:46:37.594 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2023-12-05T09:46:37.594 INFO:teuthology.orchestra.run.smithi100.stdout:Install 2 Packages 2023-12-05T09:46:37.594 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:46:37.594 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 958 k 2023-12-05T09:46:37.594 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 3.0 M 2023-12-05T09:46:37.595 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2023-12-05T09:46:37.774 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum -y install ceph-mgr-rook 2023-12-05T09:46:37.927 INFO:teuthology.orchestra.run.smithi100.stdout:(1/2): fuse-2.9.7-17.el8.x86_64.rpm 571 kB/s | 83 kB 00:00 2023-12-05T09:46:38.244 INFO:teuthology.orchestra.run.smithi100.stdout:(2/2): ceph-fuse-17.2.7-109.g1fd3ca3c.el8.x86_6 1.8 MB/s | 875 kB 00:00 2023-12-05T09:46:38.245 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2023-12-05T09:46:38.245 INFO:teuthology.orchestra.run.smithi100.stdout:Total 1.4 MB/s | 958 kB 00:00 2023-12-05T09:46:38.269 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2023-12-05T09:46:38.294 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2023-12-05T09:46:38.294 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2023-12-05T09:46:38.399 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2023-12-05T09:46:38.402 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2023-12-05T09:46:38.599 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2023-12-05T09:46:38.829 INFO:teuthology.orchestra.run.smithi150.stdout:Last metadata expiration check: 0:02:26 ago on Tue 05 Dec 2023 09:44:12 AM UTC. 2023-12-05T09:46:38.877 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : fuse-2.9.7-17.el8.x86_64 1/2 2023-12-05T09:46:39.085 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-fuse-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2/2 2023-12-05T09:46:39.700 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-fuse-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2/2 2023-12-05T09:46:39.701 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-fuse-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/2 2023-12-05T09:46:40.443 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 2/2 2023-12-05T09:46:40.444 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:46:40.444 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2023-12-05T09:46:40.444 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-fuse-2:17.2.7-109.g1fd3ca3c.el8.x86_64 fuse-2.9.7-17.el8.x86_64 2023-12-05T09:46:40.444 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:46:40.444 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2023-12-05T09:46:40.637 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2023-12-05T09:46:40.639 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2023-12-05T09:46:40.639 INFO:teuthology.orchestra.run.smithi150.stdout: Package Arch Version Repository Size 2023-12-05T09:46:40.639 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2023-12-05T09:46:40.640 INFO:teuthology.orchestra.run.smithi150.stdout:Installing: 2023-12-05T09:46:40.640 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-rook noarch 2:17.2.7-109.g1fd3ca3c.el8 ceph-noarch 47 k 2023-12-05T09:46:40.640 INFO:teuthology.orchestra.run.smithi150.stdout:Installing dependencies: 2023-12-05T09:46:40.640 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-12-05T09:46:40.640 INFO:teuthology.orchestra.run.smithi150.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-12-05T09:46:40.640 INFO:teuthology.orchestra.run.smithi150.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-12-05T09:46:40.640 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-12-05T09:46:40.640 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-12-05T09:46:40.640 INFO:teuthology.orchestra.run.smithi150.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-12-05T09:46:40.640 INFO:teuthology.orchestra.run.smithi150.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-12-05T09:46:40.640 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-12-05T09:46:40.640 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-12-05T09:46:40.641 INFO:teuthology.orchestra.run.smithi150.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-12-05T09:46:40.641 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-12-05T09:46:40.641 INFO:teuthology.orchestra.run.smithi150.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-12-05T09:46:40.641 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:46:40.641 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction Summary 2023-12-05T09:46:40.641 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2023-12-05T09:46:40.641 INFO:teuthology.orchestra.run.smithi150.stdout:Install 13 Packages 2023-12-05T09:46:40.641 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:46:40.642 INFO:teuthology.orchestra.run.smithi150.stdout:Total download size: 1.9 M 2023-12-05T09:46:40.642 INFO:teuthology.orchestra.run.smithi150.stdout:Installed size: 25 M 2023-12-05T09:46:40.642 INFO:teuthology.orchestra.run.smithi150.stdout:Downloading Packages: 2023-12-05T09:46:40.666 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install librados-devel 2023-12-05T09:46:41.139 INFO:teuthology.orchestra.run.smithi150.stdout:(1/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 207 kB/s | 27 kB 00:00 2023-12-05T09:46:41.164 INFO:teuthology.orchestra.run.smithi150.stdout:(2/13): python3-jsonpointer-1.10-11.el8.noarch. 130 kB/s | 20 kB 00:00 2023-12-05T09:46:41.190 INFO:teuthology.orchestra.run.smithi150.stdout:(3/13): ceph-mgr-rook-17.2.7-109.g1fd3ca3c.el8. 265 kB/s | 47 kB 00:00 2023-12-05T09:46:41.282 INFO:teuthology.orchestra.run.smithi150.stdout:(4/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 889 kB/s | 126 kB 00:00 2023-12-05T09:46:41.307 INFO:teuthology.orchestra.run.smithi150.stdout:(5/13): python3-pyasn1-modules-0.3.7-6.el8.noar 774 kB/s | 110 kB 00:00 2023-12-05T09:46:41.407 INFO:teuthology.orchestra.run.smithi150.stdout:(6/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 713 kB/s | 155 kB 00:00 2023-12-05T09:46:41.466 INFO:teuthology.orchestra.run.smithi150.stdout:(7/13): python3-requests-oauthlib-1.0.0-1.el8.n 232 kB/s | 43 kB 00:00 2023-12-05T09:46:41.716 INFO:teuthology.orchestra.run.smithi150.stdout:(8/13): python3-cachetools-3.1.1-4.el8.noarch.r 81 kB/s | 33 kB 00:00 2023-12-05T09:46:41.742 INFO:teuthology.orchestra.run.smithi150.stdout:(9/13): python3-certifi-2018.10.15-7.el8.noarch 49 kB/s | 16 kB 00:00 2023-12-05T09:46:41.933 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:02:31 ago on Tue 05 Dec 2023 09:44:10 AM UTC. 2023-12-05T09:46:41.942 INFO:teuthology.orchestra.run.smithi150.stdout:(10/13): python3-google-auth-1.1.1-10.el8.noarc 171 kB/s | 81 kB 00:00 2023-12-05T09:46:41.967 INFO:teuthology.orchestra.run.smithi150.stdout:(11/13): python3-rsa-4.9-2.el8.noarch.rpm 285 kB/s | 64 kB 00:00 2023-12-05T09:46:42.101 INFO:teuthology.orchestra.run.smithi150.stdout:(12/13): python3-websocket-client-0.56.0-5.el8. 386 kB/s | 61 kB 00:00 2023-12-05T09:46:42.218 INFO:teuthology.orchestra.run.smithi150.stdout:(13/13): python3-kubernetes-11.0.0-6.el8.noarch 2.3 MB/s | 1.2 MB 00:00 2023-12-05T09:46:42.221 INFO:teuthology.orchestra.run.smithi150.stdout:-------------------------------------------------------------------------------- 2023-12-05T09:46:42.221 INFO:teuthology.orchestra.run.smithi150.stdout:Total 1.2 MB/s | 1.9 MB 00:01 2023-12-05T09:46:42.362 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction check 2023-12-05T09:46:42.383 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction check succeeded. 2023-12-05T09:46:42.383 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction test 2023-12-05T09:46:42.491 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction test succeeded. 2023-12-05T09:46:42.494 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction 2023-12-05T09:46:43.088 INFO:teuthology.orchestra.run.smithi150.stdout: Preparing : 1/1 2023-12-05T09:46:43.315 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2023-12-05T09:46:43.502 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2023-12-05T09:46:43.696 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2023-12-05T09:46:43.697 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2023-12-05T09:46:43.697 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repo Size 2023-12-05T09:46:43.697 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2023-12-05T09:46:43.697 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2023-12-05T09:46:43.697 INFO:teuthology.orchestra.run.smithi100.stdout: librados-devel x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 130 k 2023-12-05T09:46:43.697 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:46:43.697 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2023-12-05T09:46:43.697 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2023-12-05T09:46:43.697 INFO:teuthology.orchestra.run.smithi100.stdout:Install 1 Package 2023-12-05T09:46:43.697 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:46:43.698 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 130 k 2023-12-05T09:46:43.698 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 464 k 2023-12-05T09:46:43.698 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2023-12-05T09:46:43.735 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-rsa-4.9-2.el8.noarch 3/13 2023-12-05T09:46:43.987 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2023-12-05T09:46:44.009 INFO:teuthology.orchestra.run.smithi100.stdout:librados-devel-17.2.7-109.g1fd3ca3c.el8.x86_64. 418 kB/s | 130 kB 00:00 2023-12-05T09:46:44.010 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2023-12-05T09:46:44.010 INFO:teuthology.orchestra.run.smithi100.stdout:Total 416 kB/s | 130 kB 00:00 2023-12-05T09:46:44.010 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2023-12-05T09:46:44.018 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2023-12-05T09:46:44.018 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2023-12-05T09:46:44.074 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2023-12-05T09:46:44.077 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2023-12-05T09:46:44.196 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2023-12-05T09:46:44.208 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2023-12-05T09:46:44.433 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librados-devel-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T09:46:44.434 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2023-12-05T09:46:44.722 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2023-12-05T09:46:44.811 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librados-devel-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T09:46:44.963 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2023-12-05T09:46:45.544 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librados-devel-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T09:46:45.544 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:46:45.544 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2023-12-05T09:46:45.544 INFO:teuthology.orchestra.run.smithi100.stdout: librados-devel-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:46:45.544 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:46:45.544 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2023-12-05T09:46:45.802 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install libcephfs2 2023-12-05T09:46:46.239 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2023-12-05T09:46:46.519 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2023-12-05T09:46:46.720 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2023-12-05T09:46:46.868 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:02:36 ago on Tue 05 Dec 2023 09:44:10 AM UTC. 2023-12-05T09:46:47.376 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2023-12-05T09:46:47.544 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-rook-2:17.2.7-109.g1fd3ca3c.el8.noarch 13/13 2023-12-05T09:46:47.926 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-109.g1fd3ca3c.el8.noarch 13/13 2023-12-05T09:46:47.926 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-rook-2:17.2.7-109.g1fd3ca3c.el8.noarch 1/13 2023-12-05T09:46:47.926 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2023-12-05T09:46:47.926 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2023-12-05T09:46:47.926 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2023-12-05T09:46:47.926 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2023-12-05T09:46:47.926 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2023-12-05T09:46:47.926 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2023-12-05T09:46:47.926 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2023-12-05T09:46:47.926 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2023-12-05T09:46:47.926 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2023-12-05T09:46:47.926 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2023-12-05T09:46:47.927 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 12/13 2023-12-05T09:46:48.399 INFO:teuthology.orchestra.run.smithi100.stdout:Package libcephfs2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 is already installed. 2023-12-05T09:46:48.640 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2023-12-05T09:46:48.641 INFO:teuthology.orchestra.run.smithi100.stdout:Nothing to do. 2023-12-05T09:46:48.642 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2023-12-05T09:46:48.729 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2023-12-05T09:46:48.729 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:46:48.729 INFO:teuthology.orchestra.run.smithi150.stdout:Installed: 2023-12-05T09:46:48.729 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-rook-2:17.2.7-109.g1fd3ca3c.el8.noarch 2023-12-05T09:46:48.729 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-12-05T09:46:48.729 INFO:teuthology.orchestra.run.smithi150.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-12-05T09:46:48.729 INFO:teuthology.orchestra.run.smithi150.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-12-05T09:46:48.729 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-12-05T09:46:48.729 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-12-05T09:46:48.730 INFO:teuthology.orchestra.run.smithi150.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-12-05T09:46:48.730 INFO:teuthology.orchestra.run.smithi150.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-12-05T09:46:48.730 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-12-05T09:46:48.730 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-12-05T09:46:48.730 INFO:teuthology.orchestra.run.smithi150.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-12-05T09:46:48.730 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rsa-4.9-2.el8.noarch 2023-12-05T09:46:48.730 INFO:teuthology.orchestra.run.smithi150.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-12-05T09:46:48.730 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:46:48.730 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2023-12-05T09:46:48.752 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install libcephfs-devel 2023-12-05T09:46:48.884 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum -y install ceph-mgr-cephadm 2023-12-05T09:46:49.811 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:02:39 ago on Tue 05 Dec 2023 09:44:10 AM UTC. 2023-12-05T09:46:49.951 INFO:teuthology.orchestra.run.smithi150.stdout:Last metadata expiration check: 0:02:37 ago on Tue 05 Dec 2023 09:44:12 AM UTC. 2023-12-05T09:46:51.591 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2023-12-05T09:46:51.591 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2023-12-05T09:46:51.591 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repo Size 2023-12-05T09:46:51.591 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2023-12-05T09:46:51.592 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2023-12-05T09:46:51.592 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs-devel x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 25 k 2023-12-05T09:46:51.592 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:46:51.592 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2023-12-05T09:46:51.592 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2023-12-05T09:46:51.592 INFO:teuthology.orchestra.run.smithi100.stdout:Install 1 Package 2023-12-05T09:46:51.592 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:46:51.592 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 25 k 2023-12-05T09:46:51.593 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 109 k 2023-12-05T09:46:51.593 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2023-12-05T09:46:51.692 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2023-12-05T09:46:51.693 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2023-12-05T09:46:51.693 INFO:teuthology.orchestra.run.smithi150.stdout: Package Arch Version Repository Size 2023-12-05T09:46:51.693 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2023-12-05T09:46:51.693 INFO:teuthology.orchestra.run.smithi150.stdout:Installing: 2023-12-05T09:46:51.694 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-cephadm noarch 2:17.2.7-109.g1fd3ca3c.el8 ceph-noarch 121 k 2023-12-05T09:46:51.694 INFO:teuthology.orchestra.run.smithi150.stdout:Installing dependencies: 2023-12-05T09:46:51.694 INFO:teuthology.orchestra.run.smithi150.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-12-05T09:46:51.694 INFO:teuthology.orchestra.run.smithi150.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-12-05T09:46:51.694 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-12-05T09:46:51.694 INFO:teuthology.orchestra.run.smithi150.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-12-05T09:46:51.694 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:46:51.694 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction Summary 2023-12-05T09:46:51.694 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2023-12-05T09:46:51.694 INFO:teuthology.orchestra.run.smithi150.stdout:Install 5 Packages 2023-12-05T09:46:51.694 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:46:51.695 INFO:teuthology.orchestra.run.smithi150.stdout:Total download size: 6.0 M 2023-12-05T09:46:51.695 INFO:teuthology.orchestra.run.smithi150.stdout:Installed size: 26 M 2023-12-05T09:46:51.695 INFO:teuthology.orchestra.run.smithi150.stdout:Downloading Packages: 2023-12-05T09:46:51.839 INFO:teuthology.orchestra.run.smithi100.stdout:libcephfs-devel-17.2.7-109.g1fd3ca3c.el8.x86_64 101 kB/s | 25 kB 00:00 2023-12-05T09:46:51.839 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2023-12-05T09:46:51.840 INFO:teuthology.orchestra.run.smithi100.stdout:Total 100 kB/s | 25 kB 00:00 2023-12-05T09:46:51.840 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2023-12-05T09:46:51.845 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2023-12-05T09:46:51.845 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2023-12-05T09:46:51.849 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2023-12-05T09:46:51.853 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2023-12-05T09:46:51.910 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2023-12-05T09:46:52.107 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libcephfs-devel-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T09:46:52.421 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T09:46:52.468 INFO:teuthology.orchestra.run.smithi150.stdout:(1/5): python3-jinja2-2.10.1-3.el8.noarch.rpm 2.3 MB/s | 538 kB 00:00 2023-12-05T09:46:52.551 INFO:teuthology.orchestra.run.smithi150.stdout:(2/5): ceph-mgr-cephadm-17.2.7-109.g1fd3ca3c.el 386 kB/s | 121 kB 00:00 2023-12-05T09:46:52.669 INFO:teuthology.orchestra.run.smithi150.stdout:(3/5): python3-natsort-7.1.1-2.el8.noarch.rpm 516 kB/s | 60 kB 00:00 2023-12-05T09:46:52.693 INFO:teuthology.orchestra.run.smithi150.stdout:(4/5): python3-asyncssh-2.7.0-2.el8.noarch.rpm 2.1 MB/s | 476 kB 00:00 2023-12-05T09:46:53.026 INFO:teuthology.orchestra.run.smithi150.stdout:(5/5): python3-babel-2.5.1-7.el8.noarch.rpm 6.1 MB/s | 4.8 MB 00:00 2023-12-05T09:46:53.026 INFO:teuthology.orchestra.run.smithi150.stdout:-------------------------------------------------------------------------------- 2023-12-05T09:46:53.027 INFO:teuthology.orchestra.run.smithi150.stdout:Total 4.5 MB/s | 6.0 MB 00:01 2023-12-05T09:46:53.107 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction check 2023-12-05T09:46:53.115 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libcephfs-devel-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T09:46:53.115 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:46:53.115 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2023-12-05T09:46:53.115 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs-devel-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:46:53.115 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:46:53.115 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2023-12-05T09:46:53.122 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction check succeeded. 2023-12-05T09:46:53.122 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction test 2023-12-05T09:46:53.242 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction test succeeded. 2023-12-05T09:46:53.246 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction 2023-12-05T09:46:53.258 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install librados2 2023-12-05T09:46:53.538 INFO:teuthology.orchestra.run.smithi150.stdout: Preparing : 1/1 2023-12-05T09:46:53.903 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 1/5 2023-12-05T09:46:54.327 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:02:44 ago on Tue 05 Dec 2023 09:44:10 AM UTC. 2023-12-05T09:46:54.968 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 2/5 2023-12-05T09:46:55.316 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 3/5 2023-12-05T09:46:55.602 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 4/5 2023-12-05T09:46:55.810 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-109.g1fd3ca3c.el8.noarch 5/5 2023-12-05T09:46:55.835 INFO:teuthology.orchestra.run.smithi100.stdout:Package librados2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 is already installed. 2023-12-05T09:46:56.076 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2023-12-05T09:46:56.078 INFO:teuthology.orchestra.run.smithi100.stdout:Nothing to do. 2023-12-05T09:46:56.078 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2023-12-05T09:46:56.157 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-109.g1fd3ca3c.el8.noarch 5/5 2023-12-05T09:46:56.158 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-109.g1fd3ca3c.el8.noarch 1/5 2023-12-05T09:46:56.158 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/5 2023-12-05T09:46:56.158 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 3/5 2023-12-05T09:46:56.158 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 4/5 2023-12-05T09:46:56.193 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install librbd1 2023-12-05T09:46:56.876 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 5/5 2023-12-05T09:46:56.877 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:46:56.877 INFO:teuthology.orchestra.run.smithi150.stdout:Installed: 2023-12-05T09:46:56.877 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-cephadm-2:17.2.7-109.g1fd3ca3c.el8.noarch 2023-12-05T09:46:56.877 INFO:teuthology.orchestra.run.smithi150.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-12-05T09:46:56.877 INFO:teuthology.orchestra.run.smithi150.stdout: python3-babel-2.5.1-7.el8.noarch 2023-12-05T09:46:56.877 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-12-05T09:46:56.877 INFO:teuthology.orchestra.run.smithi150.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-12-05T09:46:56.877 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:46:56.877 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2023-12-05T09:46:57.049 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum -y install ceph-fuse 2023-12-05T09:46:57.263 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:02:47 ago on Tue 05 Dec 2023 09:44:10 AM UTC. 2023-12-05T09:46:58.114 INFO:teuthology.orchestra.run.smithi150.stdout:Last metadata expiration check: 0:02:46 ago on Tue 05 Dec 2023 09:44:12 AM UTC. 2023-12-05T09:46:58.809 INFO:teuthology.orchestra.run.smithi100.stdout:Package librbd1-2:17.2.7-109.g1fd3ca3c.el8.x86_64 is already installed. 2023-12-05T09:46:59.050 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2023-12-05T09:46:59.051 INFO:teuthology.orchestra.run.smithi100.stdout:Nothing to do. 2023-12-05T09:46:59.051 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2023-12-05T09:46:59.167 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install python3-rados 2023-12-05T09:46:59.881 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2023-12-05T09:46:59.881 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2023-12-05T09:46:59.881 INFO:teuthology.orchestra.run.smithi150.stdout: Package Arch Version Repository Size 2023-12-05T09:46:59.881 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2023-12-05T09:46:59.881 INFO:teuthology.orchestra.run.smithi150.stdout:Installing: 2023-12-05T09:46:59.882 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-fuse x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 875 k 2023-12-05T09:46:59.882 INFO:teuthology.orchestra.run.smithi150.stdout:Installing dependencies: 2023-12-05T09:46:59.882 INFO:teuthology.orchestra.run.smithi150.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-12-05T09:46:59.882 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:46:59.882 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction Summary 2023-12-05T09:46:59.882 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2023-12-05T09:46:59.882 INFO:teuthology.orchestra.run.smithi150.stdout:Install 2 Packages 2023-12-05T09:46:59.882 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:46:59.882 INFO:teuthology.orchestra.run.smithi150.stdout:Total download size: 958 k 2023-12-05T09:46:59.883 INFO:teuthology.orchestra.run.smithi150.stdout:Installed size: 3.0 M 2023-12-05T09:46:59.883 INFO:teuthology.orchestra.run.smithi150.stdout:Downloading Packages: 2023-12-05T09:47:00.077 INFO:teuthology.orchestra.run.smithi150.stdout:(1/2): fuse-2.9.7-17.el8.x86_64.rpm 545 kB/s | 83 kB 00:00 2023-12-05T09:47:00.227 INFO:teuthology.orchestra.run.smithi150.stdout:(2/2): ceph-fuse-17.2.7-109.g1fd3ca3c.el8.x86_6 2.8 MB/s | 875 kB 00:00 2023-12-05T09:47:00.227 INFO:teuthology.orchestra.run.smithi150.stdout:-------------------------------------------------------------------------------- 2023-12-05T09:47:00.228 INFO:teuthology.orchestra.run.smithi150.stdout:Total 2.7 MB/s | 958 kB 00:00 2023-12-05T09:47:00.230 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:02:50 ago on Tue 05 Dec 2023 09:44:10 AM UTC. 2023-12-05T09:47:00.252 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction check 2023-12-05T09:47:00.279 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction check succeeded. 2023-12-05T09:47:00.280 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction test 2023-12-05T09:47:00.383 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction test succeeded. 2023-12-05T09:47:00.387 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction 2023-12-05T09:47:00.586 INFO:teuthology.orchestra.run.smithi150.stdout: Preparing : 1/1 2023-12-05T09:47:00.876 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : fuse-2.9.7-17.el8.x86_64 1/2 2023-12-05T09:47:01.068 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-fuse-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2/2 2023-12-05T09:47:01.695 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-fuse-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2/2 2023-12-05T09:47:01.695 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-fuse-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/2 2023-12-05T09:47:01.738 INFO:teuthology.orchestra.run.smithi100.stdout:Package python3-rados-2:17.2.7-109.g1fd3ca3c.el8.x86_64 is already installed. 2023-12-05T09:47:01.977 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2023-12-05T09:47:01.978 INFO:teuthology.orchestra.run.smithi100.stdout:Nothing to do. 2023-12-05T09:47:01.979 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2023-12-05T09:47:02.091 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install python3-rgw 2023-12-05T09:47:02.431 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 2/2 2023-12-05T09:47:02.432 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:47:02.432 INFO:teuthology.orchestra.run.smithi150.stdout:Installed: 2023-12-05T09:47:02.432 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-fuse-2:17.2.7-109.g1fd3ca3c.el8.x86_64 fuse-2.9.7-17.el8.x86_64 2023-12-05T09:47:02.432 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:47:02.432 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2023-12-05T09:47:02.653 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum -y install librados-devel 2023-12-05T09:47:03.161 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:02:53 ago on Tue 05 Dec 2023 09:44:10 AM UTC. 2023-12-05T09:47:03.754 INFO:teuthology.orchestra.run.smithi150.stdout:Last metadata expiration check: 0:02:51 ago on Tue 05 Dec 2023 09:44:12 AM UTC. 2023-12-05T09:47:04.666 INFO:teuthology.orchestra.run.smithi100.stdout:Package python3-rgw-2:17.2.7-109.g1fd3ca3c.el8.x86_64 is already installed. 2023-12-05T09:47:04.907 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2023-12-05T09:47:04.909 INFO:teuthology.orchestra.run.smithi100.stdout:Nothing to do. 2023-12-05T09:47:04.909 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2023-12-05T09:47:05.031 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install python3-cephfs 2023-12-05T09:47:05.539 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2023-12-05T09:47:05.541 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2023-12-05T09:47:05.541 INFO:teuthology.orchestra.run.smithi150.stdout: Package Arch Version Repo Size 2023-12-05T09:47:05.541 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2023-12-05T09:47:05.541 INFO:teuthology.orchestra.run.smithi150.stdout:Installing: 2023-12-05T09:47:05.541 INFO:teuthology.orchestra.run.smithi150.stdout: librados-devel x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 130 k 2023-12-05T09:47:05.541 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:47:05.541 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction Summary 2023-12-05T09:47:05.541 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2023-12-05T09:47:05.541 INFO:teuthology.orchestra.run.smithi150.stdout:Install 1 Package 2023-12-05T09:47:05.541 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:47:05.541 INFO:teuthology.orchestra.run.smithi150.stdout:Total download size: 130 k 2023-12-05T09:47:05.541 INFO:teuthology.orchestra.run.smithi150.stdout:Installed size: 464 k 2023-12-05T09:47:05.541 INFO:teuthology.orchestra.run.smithi150.stdout:Downloading Packages: 2023-12-05T09:47:05.772 INFO:teuthology.orchestra.run.smithi150.stdout:librados-devel-17.2.7-109.g1fd3ca3c.el8.x86_64. 563 kB/s | 130 kB 00:00 2023-12-05T09:47:05.773 INFO:teuthology.orchestra.run.smithi150.stdout:-------------------------------------------------------------------------------- 2023-12-05T09:47:05.773 INFO:teuthology.orchestra.run.smithi150.stdout:Total 559 kB/s | 130 kB 00:00 2023-12-05T09:47:05.773 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction check 2023-12-05T09:47:05.781 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction check succeeded. 2023-12-05T09:47:05.781 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction test 2023-12-05T09:47:05.839 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction test succeeded. 2023-12-05T09:47:05.842 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction 2023-12-05T09:47:05.973 INFO:teuthology.orchestra.run.smithi150.stdout: Preparing : 1/1 2023-12-05T09:47:06.095 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:02:56 ago on Tue 05 Dec 2023 09:44:10 AM UTC. 2023-12-05T09:47:06.190 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : librados-devel-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T09:47:06.566 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librados-devel-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T09:47:07.353 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librados-devel-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T09:47:07.353 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:47:07.353 INFO:teuthology.orchestra.run.smithi150.stdout:Installed: 2023-12-05T09:47:07.353 INFO:teuthology.orchestra.run.smithi150.stdout: librados-devel-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:47:07.353 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:47:07.353 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2023-12-05T09:47:07.595 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum -y install libcephfs2 2023-12-05T09:47:07.606 INFO:teuthology.orchestra.run.smithi100.stdout:Package python3-cephfs-2:17.2.7-109.g1fd3ca3c.el8.x86_64 is already installed. 2023-12-05T09:47:07.847 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2023-12-05T09:47:07.848 INFO:teuthology.orchestra.run.smithi100.stdout:Nothing to do. 2023-12-05T09:47:07.849 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2023-12-05T09:47:07.975 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install python3-rbd 2023-12-05T09:47:08.667 INFO:teuthology.orchestra.run.smithi150.stdout:Last metadata expiration check: 0:02:56 ago on Tue 05 Dec 2023 09:44:12 AM UTC. 2023-12-05T09:47:09.036 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:02:59 ago on Tue 05 Dec 2023 09:44:10 AM UTC. 2023-12-05T09:47:10.202 INFO:teuthology.orchestra.run.smithi150.stdout:Package libcephfs2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 is already installed. 2023-12-05T09:47:10.445 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2023-12-05T09:47:10.446 INFO:teuthology.orchestra.run.smithi150.stdout:Nothing to do. 2023-12-05T09:47:10.446 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2023-12-05T09:47:10.514 INFO:teuthology.orchestra.run.smithi100.stdout:Package python3-rbd-2:17.2.7-109.g1fd3ca3c.el8.x86_64 is already installed. 2023-12-05T09:47:10.584 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum -y install libcephfs-devel 2023-12-05T09:47:10.752 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2023-12-05T09:47:10.754 INFO:teuthology.orchestra.run.smithi100.stdout:Nothing to do. 2023-12-05T09:47:10.754 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2023-12-05T09:47:10.873 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install rbd-fuse 2023-12-05T09:47:11.645 INFO:teuthology.orchestra.run.smithi150.stdout:Last metadata expiration check: 0:02:59 ago on Tue 05 Dec 2023 09:44:12 AM UTC. 2023-12-05T09:47:11.934 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:03:01 ago on Tue 05 Dec 2023 09:44:10 AM UTC. 2023-12-05T09:47:13.416 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2023-12-05T09:47:13.416 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2023-12-05T09:47:13.416 INFO:teuthology.orchestra.run.smithi150.stdout: Package Arch Version Repo Size 2023-12-05T09:47:13.416 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2023-12-05T09:47:13.417 INFO:teuthology.orchestra.run.smithi150.stdout:Installing: 2023-12-05T09:47:13.417 INFO:teuthology.orchestra.run.smithi150.stdout: libcephfs-devel x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 25 k 2023-12-05T09:47:13.417 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:47:13.417 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction Summary 2023-12-05T09:47:13.417 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2023-12-05T09:47:13.417 INFO:teuthology.orchestra.run.smithi150.stdout:Install 1 Package 2023-12-05T09:47:13.417 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:47:13.417 INFO:teuthology.orchestra.run.smithi150.stdout:Total download size: 25 k 2023-12-05T09:47:13.417 INFO:teuthology.orchestra.run.smithi150.stdout:Installed size: 109 k 2023-12-05T09:47:13.418 INFO:teuthology.orchestra.run.smithi150.stdout:Downloading Packages: 2023-12-05T09:47:13.555 INFO:teuthology.orchestra.run.smithi150.stdout:libcephfs-devel-17.2.7-109.g1fd3ca3c.el8.x86_64 182 kB/s | 25 kB 00:00 2023-12-05T09:47:13.556 INFO:teuthology.orchestra.run.smithi150.stdout:-------------------------------------------------------------------------------- 2023-12-05T09:47:13.556 INFO:teuthology.orchestra.run.smithi150.stdout:Total 180 kB/s | 25 kB 00:00 2023-12-05T09:47:13.556 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction check 2023-12-05T09:47:13.561 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction check succeeded. 2023-12-05T09:47:13.561 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction test 2023-12-05T09:47:13.566 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction test succeeded. 2023-12-05T09:47:13.568 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction 2023-12-05T09:47:13.620 INFO:teuthology.orchestra.run.smithi150.stdout: Preparing : 1/1 2023-12-05T09:47:13.810 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2023-12-05T09:47:13.811 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2023-12-05T09:47:13.811 INFO:teuthology.orchestra.run.smithi100.stdout: Package Architecture Version Repository Size 2023-12-05T09:47:13.811 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2023-12-05T09:47:13.811 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2023-12-05T09:47:13.811 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-fuse x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 90 k 2023-12-05T09:47:13.811 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:47:13.811 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2023-12-05T09:47:13.811 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2023-12-05T09:47:13.811 INFO:teuthology.orchestra.run.smithi100.stdout:Install 1 Package 2023-12-05T09:47:13.812 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:47:13.812 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 90 k 2023-12-05T09:47:13.812 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 264 k 2023-12-05T09:47:13.812 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2023-12-05T09:47:13.848 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libcephfs-devel-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T09:47:14.150 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T09:47:14.688 INFO:teuthology.orchestra.run.smithi100.stdout:rbd-fuse-17.2.7-109.g1fd3ca3c.el8.x86_64.rpm 103 kB/s | 90 kB 00:00 2023-12-05T09:47:14.689 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2023-12-05T09:47:14.689 INFO:teuthology.orchestra.run.smithi100.stdout:Total 103 kB/s | 90 kB 00:00 2023-12-05T09:47:14.690 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2023-12-05T09:47:14.703 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2023-12-05T09:47:14.703 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2023-12-05T09:47:14.764 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2023-12-05T09:47:14.767 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2023-12-05T09:47:14.795 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libcephfs-devel-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T09:47:14.795 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:47:14.795 INFO:teuthology.orchestra.run.smithi150.stdout:Installed: 2023-12-05T09:47:14.795 INFO:teuthology.orchestra.run.smithi150.stdout: libcephfs-devel-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:47:14.795 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:47:14.795 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2023-12-05T09:47:14.882 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2023-12-05T09:47:14.958 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum -y install librados2 2023-12-05T09:47:15.095 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : rbd-fuse-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T09:47:15.484 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: rbd-fuse-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T09:47:16.030 INFO:teuthology.orchestra.run.smithi150.stdout:Last metadata expiration check: 0:03:04 ago on Tue 05 Dec 2023 09:44:12 AM UTC. 2023-12-05T09:47:16.194 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : rbd-fuse-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T09:47:16.195 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:47:16.195 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2023-12-05T09:47:16.195 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-fuse-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:47:16.195 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:47:16.195 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2023-12-05T09:47:16.413 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install rbd-mirror 2023-12-05T09:47:17.483 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:03:07 ago on Tue 05 Dec 2023 09:44:10 AM UTC. 2023-12-05T09:47:17.690 INFO:teuthology.orchestra.run.smithi150.stdout:Package librados2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 is already installed. 2023-12-05T09:47:17.933 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2023-12-05T09:47:17.934 INFO:teuthology.orchestra.run.smithi150.stdout:Nothing to do. 2023-12-05T09:47:17.935 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2023-12-05T09:47:18.071 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum -y install librbd1 2023-12-05T09:47:19.153 INFO:teuthology.orchestra.run.smithi150.stdout:Last metadata expiration check: 0:03:07 ago on Tue 05 Dec 2023 09:44:12 AM UTC. 2023-12-05T09:47:19.250 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2023-12-05T09:47:19.252 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2023-12-05T09:47:19.252 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repo Size 2023-12-05T09:47:19.252 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2023-12-05T09:47:19.252 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2023-12-05T09:47:19.252 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-mirror x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 3.5 M 2023-12-05T09:47:19.252 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:47:19.252 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2023-12-05T09:47:19.253 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2023-12-05T09:47:19.253 INFO:teuthology.orchestra.run.smithi100.stdout:Install 1 Package 2023-12-05T09:47:19.253 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:47:19.253 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 3.5 M 2023-12-05T09:47:19.253 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 16 M 2023-12-05T09:47:19.253 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2023-12-05T09:47:20.644 INFO:teuthology.orchestra.run.smithi150.stdout:Package librbd1-2:17.2.7-109.g1fd3ca3c.el8.x86_64 is already installed. 2023-12-05T09:47:20.888 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2023-12-05T09:47:20.890 INFO:teuthology.orchestra.run.smithi150.stdout:Nothing to do. 2023-12-05T09:47:20.890 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2023-12-05T09:47:21.026 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum -y install python3-rados 2023-12-05T09:47:21.699 INFO:teuthology.orchestra.run.smithi100.stdout:rbd-mirror-17.2.7-109.g1fd3ca3c.el8.x86_64.rpm 1.4 MB/s | 3.5 MB 00:02 2023-12-05T09:47:21.700 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2023-12-05T09:47:21.701 INFO:teuthology.orchestra.run.smithi100.stdout:Total 1.4 MB/s | 3.5 MB 00:02 2023-12-05T09:47:21.701 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2023-12-05T09:47:21.717 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2023-12-05T09:47:21.717 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2023-12-05T09:47:21.790 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2023-12-05T09:47:21.794 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2023-12-05T09:47:22.101 INFO:teuthology.orchestra.run.smithi150.stdout:Last metadata expiration check: 0:03:10 ago on Tue 05 Dec 2023 09:44:12 AM UTC. 2023-12-05T09:47:22.277 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2023-12-05T09:47:22.476 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : rbd-mirror-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T09:47:23.131 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: rbd-mirror-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T09:47:23.608 INFO:teuthology.orchestra.run.smithi150.stdout:Package python3-rados-2:17.2.7-109.g1fd3ca3c.el8.x86_64 is already installed. 2023-12-05T09:47:23.849 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : rbd-mirror-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T09:47:23.849 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:47:23.849 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2023-12-05T09:47:23.849 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-mirror-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:47:23.849 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:47:23.849 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2023-12-05T09:47:23.849 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2023-12-05T09:47:23.850 INFO:teuthology.orchestra.run.smithi150.stdout:Nothing to do. 2023-12-05T09:47:23.850 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2023-12-05T09:47:24.002 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum -y install python3-rgw 2023-12-05T09:47:24.093 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install rbd-nbd 2023-12-05T09:47:25.077 INFO:teuthology.orchestra.run.smithi150.stdout:Last metadata expiration check: 0:03:13 ago on Tue 05 Dec 2023 09:44:12 AM UTC. 2023-12-05T09:47:25.159 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:03:15 ago on Tue 05 Dec 2023 09:44:10 AM UTC. 2023-12-05T09:47:26.594 INFO:teuthology.orchestra.run.smithi150.stdout:Package python3-rgw-2:17.2.7-109.g1fd3ca3c.el8.x86_64 is already installed. 2023-12-05T09:47:26.833 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2023-12-05T09:47:26.834 INFO:teuthology.orchestra.run.smithi150.stdout:Nothing to do. 2023-12-05T09:47:26.834 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2023-12-05T09:47:26.880 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2023-12-05T09:47:26.880 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2023-12-05T09:47:26.880 INFO:teuthology.orchestra.run.smithi100.stdout: Package Architecture Version Repository Size 2023-12-05T09:47:26.880 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2023-12-05T09:47:26.880 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2023-12-05T09:47:26.880 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-nbd x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 173 k 2023-12-05T09:47:26.880 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:47:26.880 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2023-12-05T09:47:26.881 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2023-12-05T09:47:26.881 INFO:teuthology.orchestra.run.smithi100.stdout:Install 1 Package 2023-12-05T09:47:26.881 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:47:26.881 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 173 k 2023-12-05T09:47:26.881 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 552 k 2023-12-05T09:47:26.881 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2023-12-05T09:47:26.970 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum -y install python3-cephfs 2023-12-05T09:47:27.212 INFO:teuthology.orchestra.run.smithi100.stdout:rbd-nbd-17.2.7-109.g1fd3ca3c.el8.x86_64.rpm 524 kB/s | 173 kB 00:00 2023-12-05T09:47:27.212 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2023-12-05T09:47:27.212 INFO:teuthology.orchestra.run.smithi100.stdout:Total 522 kB/s | 173 kB 00:00 2023-12-05T09:47:27.213 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2023-12-05T09:47:27.226 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2023-12-05T09:47:27.226 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2023-12-05T09:47:27.283 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2023-12-05T09:47:27.286 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2023-12-05T09:47:27.406 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2023-12-05T09:47:27.601 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : rbd-nbd-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T09:47:27.979 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: rbd-nbd-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T09:47:28.044 INFO:teuthology.orchestra.run.smithi150.stdout:Last metadata expiration check: 0:03:16 ago on Tue 05 Dec 2023 09:44:12 AM UTC. 2023-12-05T09:47:28.694 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : rbd-nbd-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T09:47:28.694 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:47:28.694 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2023-12-05T09:47:28.694 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-nbd-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:47:28.695 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:47:28.695 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2023-12-05T09:47:28.938 DEBUG:teuthology.parallel:result is None 2023-12-05T09:47:29.546 INFO:teuthology.orchestra.run.smithi150.stdout:Package python3-cephfs-2:17.2.7-109.g1fd3ca3c.el8.x86_64 is already installed. 2023-12-05T09:47:29.786 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2023-12-05T09:47:29.787 INFO:teuthology.orchestra.run.smithi150.stdout:Nothing to do. 2023-12-05T09:47:29.787 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2023-12-05T09:47:29.924 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum -y install python3-rbd 2023-12-05T09:47:30.998 INFO:teuthology.orchestra.run.smithi150.stdout:Last metadata expiration check: 0:03:19 ago on Tue 05 Dec 2023 09:44:12 AM UTC. 2023-12-05T09:47:32.552 INFO:teuthology.orchestra.run.smithi150.stdout:Package python3-rbd-2:17.2.7-109.g1fd3ca3c.el8.x86_64 is already installed. 2023-12-05T09:47:32.793 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2023-12-05T09:47:32.794 INFO:teuthology.orchestra.run.smithi150.stdout:Nothing to do. 2023-12-05T09:47:32.794 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2023-12-05T09:47:32.936 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum -y install rbd-fuse 2023-12-05T09:47:34.014 INFO:teuthology.orchestra.run.smithi150.stdout:Last metadata expiration check: 0:03:22 ago on Tue 05 Dec 2023 09:44:12 AM UTC. 2023-12-05T09:47:35.910 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2023-12-05T09:47:35.911 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2023-12-05T09:47:35.911 INFO:teuthology.orchestra.run.smithi150.stdout: Package Architecture Version Repository Size 2023-12-05T09:47:35.911 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2023-12-05T09:47:35.911 INFO:teuthology.orchestra.run.smithi150.stdout:Installing: 2023-12-05T09:47:35.911 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-fuse x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 90 k 2023-12-05T09:47:35.911 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:47:35.911 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction Summary 2023-12-05T09:47:35.911 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2023-12-05T09:47:35.911 INFO:teuthology.orchestra.run.smithi150.stdout:Install 1 Package 2023-12-05T09:47:35.911 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:47:35.912 INFO:teuthology.orchestra.run.smithi150.stdout:Total download size: 90 k 2023-12-05T09:47:35.912 INFO:teuthology.orchestra.run.smithi150.stdout:Installed size: 264 k 2023-12-05T09:47:35.912 INFO:teuthology.orchestra.run.smithi150.stdout:Downloading Packages: 2023-12-05T09:47:36.103 INFO:teuthology.orchestra.run.smithi150.stdout:rbd-fuse-17.2.7-109.g1fd3ca3c.el8.x86_64.rpm 473 kB/s | 90 kB 00:00 2023-12-05T09:47:36.103 INFO:teuthology.orchestra.run.smithi150.stdout:-------------------------------------------------------------------------------- 2023-12-05T09:47:36.104 INFO:teuthology.orchestra.run.smithi150.stdout:Total 470 kB/s | 90 kB 00:00 2023-12-05T09:47:36.104 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction check 2023-12-05T09:47:36.117 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction check succeeded. 2023-12-05T09:47:36.117 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction test 2023-12-05T09:47:36.174 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction test succeeded. 2023-12-05T09:47:36.177 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction 2023-12-05T09:47:36.293 INFO:teuthology.orchestra.run.smithi150.stdout: Preparing : 1/1 2023-12-05T09:47:36.513 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : rbd-fuse-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T09:47:36.894 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: rbd-fuse-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T09:47:37.644 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : rbd-fuse-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T09:47:37.644 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:47:37.644 INFO:teuthology.orchestra.run.smithi150.stdout:Installed: 2023-12-05T09:47:37.644 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-fuse-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:47:37.644 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:47:37.645 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2023-12-05T09:47:37.902 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum -y install rbd-mirror 2023-12-05T09:47:38.979 INFO:teuthology.orchestra.run.smithi150.stdout:Last metadata expiration check: 0:03:26 ago on Tue 05 Dec 2023 09:44:12 AM UTC. 2023-12-05T09:47:40.748 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2023-12-05T09:47:40.748 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2023-12-05T09:47:40.748 INFO:teuthology.orchestra.run.smithi150.stdout: Package Arch Version Repo Size 2023-12-05T09:47:40.749 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2023-12-05T09:47:40.749 INFO:teuthology.orchestra.run.smithi150.stdout:Installing: 2023-12-05T09:47:40.749 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-mirror x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 3.5 M 2023-12-05T09:47:40.749 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:47:40.749 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction Summary 2023-12-05T09:47:40.749 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2023-12-05T09:47:40.749 INFO:teuthology.orchestra.run.smithi150.stdout:Install 1 Package 2023-12-05T09:47:40.749 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:47:40.750 INFO:teuthology.orchestra.run.smithi150.stdout:Total download size: 3.5 M 2023-12-05T09:47:40.750 INFO:teuthology.orchestra.run.smithi150.stdout:Installed size: 16 M 2023-12-05T09:47:40.750 INFO:teuthology.orchestra.run.smithi150.stdout:Downloading Packages: 2023-12-05T09:47:42.039 INFO:teuthology.orchestra.run.smithi150.stdout:rbd-mirror-17.2.7-109.g1fd3ca3c.el8.x86_64.rpm 2.7 MB/s | 3.5 MB 00:01 2023-12-05T09:47:42.040 INFO:teuthology.orchestra.run.smithi150.stdout:-------------------------------------------------------------------------------- 2023-12-05T09:47:42.041 INFO:teuthology.orchestra.run.smithi150.stdout:Total 2.7 MB/s | 3.5 MB 00:01 2023-12-05T09:47:42.041 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction check 2023-12-05T09:47:42.056 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction check succeeded. 2023-12-05T09:47:42.056 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction test 2023-12-05T09:47:42.127 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction test succeeded. 2023-12-05T09:47:42.130 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction 2023-12-05T09:47:42.617 INFO:teuthology.orchestra.run.smithi150.stdout: Preparing : 1/1 2023-12-05T09:47:42.824 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : rbd-mirror-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T09:47:43.502 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: rbd-mirror-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T09:47:44.267 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : rbd-mirror-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T09:47:44.267 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:47:44.267 INFO:teuthology.orchestra.run.smithi150.stdout:Installed: 2023-12-05T09:47:44.267 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-mirror-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:47:44.268 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:47:44.268 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2023-12-05T09:47:44.507 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum -y install rbd-nbd 2023-12-05T09:47:45.581 INFO:teuthology.orchestra.run.smithi150.stdout:Last metadata expiration check: 0:03:33 ago on Tue 05 Dec 2023 09:44:12 AM UTC. 2023-12-05T09:47:47.339 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2023-12-05T09:47:47.340 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2023-12-05T09:47:47.340 INFO:teuthology.orchestra.run.smithi150.stdout: Package Architecture Version Repository Size 2023-12-05T09:47:47.340 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2023-12-05T09:47:47.340 INFO:teuthology.orchestra.run.smithi150.stdout:Installing: 2023-12-05T09:47:47.340 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-nbd x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 173 k 2023-12-05T09:47:47.340 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:47:47.340 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction Summary 2023-12-05T09:47:47.340 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2023-12-05T09:47:47.340 INFO:teuthology.orchestra.run.smithi150.stdout:Install 1 Package 2023-12-05T09:47:47.340 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:47:47.341 INFO:teuthology.orchestra.run.smithi150.stdout:Total download size: 173 k 2023-12-05T09:47:47.341 INFO:teuthology.orchestra.run.smithi150.stdout:Installed size: 552 k 2023-12-05T09:47:47.341 INFO:teuthology.orchestra.run.smithi150.stdout:Downloading Packages: 2023-12-05T09:47:47.551 INFO:teuthology.orchestra.run.smithi150.stdout:rbd-nbd-17.2.7-109.g1fd3ca3c.el8.x86_64.rpm 826 kB/s | 173 kB 00:00 2023-12-05T09:47:47.552 INFO:teuthology.orchestra.run.smithi150.stdout:-------------------------------------------------------------------------------- 2023-12-05T09:47:47.552 INFO:teuthology.orchestra.run.smithi150.stdout:Total 820 kB/s | 173 kB 00:00 2023-12-05T09:47:47.552 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction check 2023-12-05T09:47:47.565 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction check succeeded. 2023-12-05T09:47:47.566 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction test 2023-12-05T09:47:47.622 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction test succeeded. 2023-12-05T09:47:47.625 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction 2023-12-05T09:47:47.750 INFO:teuthology.orchestra.run.smithi150.stdout: Preparing : 1/1 2023-12-05T09:47:47.944 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : rbd-nbd-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T09:47:48.312 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: rbd-nbd-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T09:47:49.086 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : rbd-nbd-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T09:47:49.086 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:47:49.086 INFO:teuthology.orchestra.run.smithi150.stdout:Installed: 2023-12-05T09:47:49.086 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-nbd-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:47:49.086 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:47:49.086 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2023-12-05T09:47:49.343 DEBUG:teuthology.parallel:result is None 2023-12-05T09:47:49.343 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-05T09:47:49.344 INFO:teuthology.packaging:ref: None 2023-12-05T09:47:49.344 INFO:teuthology.packaging:tag: None 2023-12-05T09:47:49.344 INFO:teuthology.packaging:branch: quincy 2023-12-05T09:47:49.344 INFO:teuthology.packaging:sha1: 3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 2023-12-05T09:47:49.344 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2023-12-05T09:47:49.673 DEBUG:teuthology.orchestra.run.smithi100:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-05T09:47:49.734 INFO:teuthology.orchestra.run.smithi100.stdout:17.2.7-109.g1fd3ca3c.el8 2023-12-05T09:47:49.734 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-109.g1fd3ca3c.el8 2023-12-05T09:47:49.734 INFO:teuthology.task.install:The correct ceph version 17.2.7-109.g1fd3ca3c is installed. 2023-12-05T09:47:49.735 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-05T09:47:49.735 INFO:teuthology.packaging:ref: None 2023-12-05T09:47:49.735 INFO:teuthology.packaging:tag: None 2023-12-05T09:47:49.735 INFO:teuthology.packaging:branch: quincy 2023-12-05T09:47:49.735 INFO:teuthology.packaging:sha1: 3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 2023-12-05T09:47:49.735 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2023-12-05T09:47:49.974 DEBUG:teuthology.orchestra.run.smithi150:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-05T09:47:50.030 INFO:teuthology.orchestra.run.smithi150.stdout:17.2.7-109.g1fd3ca3c.el8 2023-12-05T09:47:50.031 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-109.g1fd3ca3c.el8 2023-12-05T09:47:50.031 INFO:teuthology.task.install:The correct ceph version 17.2.7-109.g1fd3ca3c is installed. 2023-12-05T09:47:50.031 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-12-05T09:47:50.031 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-12-05T09:47:50.031 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-05T09:47:50.109 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-12-05T09:47:50.110 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-05T09:47:50.180 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-12-05T09:47:50.180 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-12-05T09:47:50.180 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/daemon-helper 2023-12-05T09:47:50.251 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-05T09:47:50.361 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-12-05T09:47:50.361 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/usr/bin/daemon-helper 2023-12-05T09:47:50.430 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-05T09:47:50.538 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-12-05T09:47:50.539 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-12-05T09:47:50.539 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-05T09:47:50.607 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-05T09:47:50.716 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-12-05T09:47:50.716 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-05T09:47:50.785 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-05T09:47:50.894 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-12-05T09:47:50.895 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-12-05T09:47:50.895 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/stdin-killer 2023-12-05T09:47:50.963 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-05T09:47:51.072 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-12-05T09:47:51.072 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/usr/bin/stdin-killer 2023-12-05T09:47:51.141 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-05T09:47:51.251 INFO:teuthology.run_tasks:Running task print... 2023-12-05T09:47:51.261 INFO:teuthology.task.print:**** done install task... 2023-12-05T09:47:51.261 INFO:teuthology.run_tasks:Running task cephadm... 2023-12-05T09:47:51.357 INFO:tasks.cephadm:Config: {'cephadm_branch': 'quincy', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}}, 'image': 'quay.ceph.io/ceph-ci/ceph:quincy', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '3fe8d441c2f973bfe963ba4dd30ba8eac9f36227'} 2023-12-05T09:47:51.357 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:quincy 2023-12-05T09:47:51.358 INFO:tasks.cephadm:Cluster fsid is 5b035ce6-9353-11ee-95a2-87774f69a715 2023-12-05T09:47:51.358 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2023-12-05T09:47:51.358 INFO:tasks.cephadm:No mon roles; fabricating mons 2023-12-05T09:47:51.358 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi100': '172.21.15.100', 'mon.smithi150': '172.21.15.150'} 2023-12-05T09:47:51.358 INFO:tasks.cephadm:Normalizing hostnames... 2023-12-05T09:47:51.358 DEBUG:teuthology.orchestra.run.smithi100:> sudo hostname $(hostname -s) 2023-12-05T09:47:51.430 DEBUG:teuthology.orchestra.run.smithi150:> sudo hostname $(hostname -s) 2023-12-05T09:47:51.501 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref quincy)... 2023-12-05T09:47:51.501 DEBUG:teuthology.orchestra.run.smithi100:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-12-05T09:47:51.837 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r--. 1 ubuntu ubuntu 367151 Dec 5 09:47 /home/ubuntu/cephtest/cephadm 2023-12-05T09:47:51.838 DEBUG:teuthology.orchestra.run.smithi150:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-12-05T09:47:52.061 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-rw-r--. 1 ubuntu ubuntu 367151 Dec 5 09:47 /home/ubuntu/cephtest/cephadm 2023-12-05T09:47:52.061 DEBUG:teuthology.orchestra.run.smithi100:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-12-05T09:47:52.111 DEBUG:teuthology.orchestra.run.smithi150:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-12-05T09:47:52.173 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:quincy on all hosts... 2023-12-05T09:47:52.173 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2023-12-05T09:47:52.178 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2023-12-05T09:47:53.282 INFO:teuthology.orchestra.run.smithi100.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2023-12-05T09:47:53.371 INFO:teuthology.orchestra.run.smithi150.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2023-12-05T09:48:24.594 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2023-12-05T09:48:24.594 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_version": "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)", 2023-12-05T09:48:24.595 INFO:teuthology.orchestra.run.smithi150.stdout: "image_id": "e139fc5fd9fc28339620da34f9acb14e94fcbf74091249cf080e32fcdc94a81d", 2023-12-05T09:48:24.595 INFO:teuthology.orchestra.run.smithi150.stdout: "repo_digests": [ 2023-12-05T09:48:24.595 INFO:teuthology.orchestra.run.smithi150.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:0d4f01deeba216c15211c4d6aff905005feecdc02196b3d83cd04ba900a424d3" 2023-12-05T09:48:24.595 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2023-12-05T09:48:24.595 INFO:teuthology.orchestra.run.smithi150.stdout:} 2023-12-05T09:48:26.194 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2023-12-05T09:48:26.195 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_version": "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)", 2023-12-05T09:48:26.195 INFO:teuthology.orchestra.run.smithi100.stdout: "image_id": "e139fc5fd9fc28339620da34f9acb14e94fcbf74091249cf080e32fcdc94a81d", 2023-12-05T09:48:26.195 INFO:teuthology.orchestra.run.smithi100.stdout: "repo_digests": [ 2023-12-05T09:48:26.195 INFO:teuthology.orchestra.run.smithi100.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:0d4f01deeba216c15211c4d6aff905005feecdc02196b3d83cd04ba900a424d3" 2023-12-05T09:48:26.195 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2023-12-05T09:48:26.195 INFO:teuthology.orchestra.run.smithi100.stdout:} 2023-12-05T09:48:26.220 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /etc/ceph 2023-12-05T09:48:26.294 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /etc/ceph 2023-12-05T09:48:26.374 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 777 /etc/ceph 2023-12-05T09:48:26.443 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 777 /etc/ceph 2023-12-05T09:48:26.514 INFO:tasks.cephadm:Writing seed config... 2023-12-05T09:48:26.515 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2023-12-05T09:48:26.515 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2023-12-05T09:48:26.515 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2023-12-05T09:48:26.516 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2023-12-05T09:48:26.516 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2023-12-05T09:48:26.516 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2023-12-05T09:48:26.516 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2023-12-05T09:48:26.516 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2023-12-05T09:48:26.516 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2023-12-05T09:48:26.516 INFO:tasks.cephadm: override: [osd] debug ms = 1 2023-12-05T09:48:26.516 INFO:tasks.cephadm: override: [osd] debug osd = 20 2023-12-05T09:48:26.516 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2023-12-05T09:48:26.516 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2023-12-05T09:48:26.516 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2023-12-05T09:48:26.516 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2023-12-05T09:48:26.516 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2023-12-05T09:48:26.516 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2023-12-05T09:48:26.516 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2023-12-05T09:48:26.517 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2023-12-05T09:48:26.517 INFO:tasks.cephadm: override: [client] debug client = 20 2023-12-05T09:48:26.517 INFO:tasks.cephadm: override: [client] debug ms = 1 2023-12-05T09:48:26.517 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2023-12-05T09:48:26.517 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2023-12-05T09:48:26.517 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2023-12-05T09:48:26.517 INFO:tasks.cephadm: override: [mds] debug mds = 20 2023-12-05T09:48:26.517 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2023-12-05T09:48:26.517 INFO:tasks.cephadm: override: [mds] debug ms = 1 2023-12-05T09:48:26.517 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2023-12-05T09:48:26.517 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2023-12-05T09:48:26.517 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2023-12-05T09:48:26.517 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2023-12-05T09:48:26.517 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2023-12-05T09:48:26.517 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2023-12-05T09:48:26.518 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2023-12-05T09:48:26.518 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2023-12-05T09:48:26.518 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2023-12-05T09:48:26.518 INFO:tasks.cephadm: override: [mon] debug mon = 20 2023-12-05T09:48:26.518 INFO:tasks.cephadm: override: [mon] debug ms = 1 2023-12-05T09:48:26.518 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2023-12-05T09:48:26.518 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2023-12-05T09:48:26.519 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-12-05T09:48:26.519 DEBUG:teuthology.orchestra.run.smithi100:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2023-12-05T09:48:26.564 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 5b035ce6-9353-11ee-95a2-87774f69a715 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2023-12-05T09:48:26.565 DEBUG:teuthology.orchestra.run.smithi100:mon.smithi100> sudo journalctl -f -n 0 -u ceph-5b035ce6-9353-11ee-95a2-87774f69a715@mon.smithi100.service 2023-12-05T09:48:26.609 INFO:tasks.cephadm:Bootstrapping... 2023-12-05T09:48:26.609 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy -v bootstrap --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.100 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2023-12-05T09:48:26.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:-- Logs begin at Tue 2023-12-05 09:30:11 UTC. -- 2023-12-05T09:48:26.905 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2023-12-05T09:48:26.905 INFO:teuthology.orchestra.run.smithi100.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:quincy', '-v', 'bootstrap', '--fsid', '5b035ce6-9353-11ee-95a2-87774f69a715', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.100', '--skip-admin-label'] 2023-12-05T09:48:26.954 INFO:teuthology.orchestra.run.smithi100.stdout:/bin/podman: stdout 4.6.1 2023-12-05T09:48:26.955 INFO:teuthology.orchestra.run.smithi100.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2023-12-05T09:48:26.955 INFO:teuthology.orchestra.run.smithi100.stdout:Verifying podman|docker is present... 2023-12-05T09:48:27.002 INFO:teuthology.orchestra.run.smithi100.stdout:/bin/podman: stdout 4.6.1 2023-12-05T09:48:27.002 INFO:teuthology.orchestra.run.smithi100.stdout:Verifying lvm2 is present... 2023-12-05T09:48:27.002 INFO:teuthology.orchestra.run.smithi100.stdout:Verifying time synchronization is in place... 2023-12-05T09:48:27.015 INFO:teuthology.orchestra.run.smithi100.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-12-05T09:48:27.015 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-12-05T09:48:27.027 INFO:teuthology.orchestra.run.smithi100.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-12-05T09:48:27.028 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stdout inactive 2023-12-05T09:48:27.041 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stdout enabled 2023-12-05T09:48:27.054 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stdout active 2023-12-05T09:48:27.054 INFO:teuthology.orchestra.run.smithi100.stdout:Unit chronyd.service is enabled and running 2023-12-05T09:48:27.054 INFO:teuthology.orchestra.run.smithi100.stdout:Repeating the final host check... 2023-12-05T09:48:27.097 INFO:teuthology.orchestra.run.smithi100.stdout:/bin/podman: stdout 4.6.1 2023-12-05T09:48:27.097 INFO:teuthology.orchestra.run.smithi100.stdout:podman (/bin/podman) version 4.6.1 is present 2023-12-05T09:48:27.098 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl is present 2023-12-05T09:48:27.098 INFO:teuthology.orchestra.run.smithi100.stdout:lvcreate is present 2023-12-05T09:48:27.111 INFO:teuthology.orchestra.run.smithi100.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-12-05T09:48:27.111 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-12-05T09:48:27.123 INFO:teuthology.orchestra.run.smithi100.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-12-05T09:48:27.123 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stdout inactive 2023-12-05T09:48:27.137 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stdout enabled 2023-12-05T09:48:27.149 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stdout active 2023-12-05T09:48:27.149 INFO:teuthology.orchestra.run.smithi100.stdout:Unit chronyd.service is enabled and running 2023-12-05T09:48:27.150 INFO:teuthology.orchestra.run.smithi100.stdout:Host looks OK 2023-12-05T09:48:27.150 INFO:teuthology.orchestra.run.smithi100.stdout:Cluster fsid: 5b035ce6-9353-11ee-95a2-87774f69a715 2023-12-05T09:48:27.150 INFO:teuthology.orchestra.run.smithi100.stdout:Acquiring lock 139958880414184 on /run/cephadm/5b035ce6-9353-11ee-95a2-87774f69a715.lock 2023-12-05T09:48:27.150 INFO:teuthology.orchestra.run.smithi100.stdout:Lock 139958880414184 acquired on /run/cephadm/5b035ce6-9353-11ee-95a2-87774f69a715.lock 2023-12-05T09:48:27.150 INFO:teuthology.orchestra.run.smithi100.stdout:Verifying IP 172.21.15.100 port 3300 ... 2023-12-05T09:48:27.151 INFO:teuthology.orchestra.run.smithi100.stdout:Verifying IP 172.21.15.100 port 6789 ... 2023-12-05T09:48:27.151 INFO:teuthology.orchestra.run.smithi100.stdout:Base mon IP(s) is [172.21.15.100:3300, 172.21.15.100:6789], mon addrv is [v2:172.21.15.100:3300,v1:172.21.15.100:6789] 2023-12-05T09:48:27.159 INFO:teuthology.orchestra.run.smithi100.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.100 metric 100 2023-12-05T09:48:27.159 INFO:teuthology.orchestra.run.smithi100.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.100 metric 100 2023-12-05T09:48:27.166 INFO:teuthology.orchestra.run.smithi100.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2023-12-05T09:48:27.167 INFO:teuthology.orchestra.run.smithi100.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2023-12-05T09:48:27.167 INFO:teuthology.orchestra.run.smithi100.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 1024 expires 1797sec hoplimit 64 pref medium 2023-12-05T09:48:27.173 INFO:teuthology.orchestra.run.smithi100.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2023-12-05T09:48:27.174 INFO:teuthology.orchestra.run.smithi100.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2023-12-05T09:48:27.174 INFO:teuthology.orchestra.run.smithi100.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-12-05T09:48:27.174 INFO:teuthology.orchestra.run.smithi100.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2023-12-05T09:48:27.174 INFO:teuthology.orchestra.run.smithi100.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:d733/64 scope link 2023-12-05T09:48:27.174 INFO:teuthology.orchestra.run.smithi100.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-12-05T09:48:27.174 INFO:teuthology.orchestra.run.smithi100.stdout:Mon IP `172.21.15.100` is in CIDR network `172.21.0.0/20` 2023-12-05T09:48:27.175 INFO:teuthology.orchestra.run.smithi100.stdout:Mon IP `172.21.15.100` is in CIDR network `172.21.0.0/20` 2023-12-05T09:48:27.175 INFO:teuthology.orchestra.run.smithi100.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2023-12-05T09:48:27.176 INFO:teuthology.orchestra.run.smithi100.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2023-12-05T09:48:27.177 INFO:teuthology.orchestra.run.smithi100.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2023-12-05T09:48:27.588 INFO:teuthology.orchestra.run.smithi100.stdout:/bin/podman: stdout e139fc5fd9fc28339620da34f9acb14e94fcbf74091249cf080e32fcdc94a81d 2023-12-05T09:48:27.588 INFO:teuthology.orchestra.run.smithi100.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:quincy... 2023-12-05T09:48:27.588 INFO:teuthology.orchestra.run.smithi100.stdout:/bin/podman: stderr Getting image source signatures 2023-12-05T09:48:27.589 INFO:teuthology.orchestra.run.smithi100.stdout:/bin/podman: stderr Copying blob sha256:f8d912e8e8635896f84e43426bf9a1ea53664c8ccfe5796c31e0716d111e3afa 2023-12-05T09:48:27.589 INFO:teuthology.orchestra.run.smithi100.stdout:/bin/podman: stderr Copying blob sha256:d3e436ac93e4b5a6d94c7ac8024df331e66e67275836276615dc044fd3cbf83a 2023-12-05T09:48:27.589 INFO:teuthology.orchestra.run.smithi100.stdout:/bin/podman: stderr Copying config sha256:e139fc5fd9fc28339620da34f9acb14e94fcbf74091249cf080e32fcdc94a81d 2023-12-05T09:48:27.589 INFO:teuthology.orchestra.run.smithi100.stdout:/bin/podman: stderr Writing manifest to image destination 2023-12-05T09:48:28.310 INFO:teuthology.orchestra.run.smithi100.stdout:ceph: stdout ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable) 2023-12-05T09:48:28.311 INFO:teuthology.orchestra.run.smithi100.stdout:Ceph version: ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable) 2023-12-05T09:48:28.311 INFO:teuthology.orchestra.run.smithi100.stdout:Extracting ceph user uid/gid from container image... 2023-12-05T09:48:28.914 INFO:teuthology.orchestra.run.smithi100.stdout:stat: stdout 167 167 2023-12-05T09:48:28.914 INFO:teuthology.orchestra.run.smithi100.stdout:Creating initial keys... 2023-12-05T09:48:29.518 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph-authtool: stdout AQDt8W5lY9C8CxAAikNm9jY6bFhMeYaPQZsw+Q== 2023-12-05T09:48:30.170 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph-authtool: stdout AQDt8W5laEHpMBAA1c4Nynixv5YHjrhF5Evv1Q== 2023-12-05T09:48:30.794 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph-authtool: stdout AQDu8W5lI6mdGhAAL4ni6DLh6C/c+U+eF4JtsQ== 2023-12-05T09:48:30.795 INFO:teuthology.orchestra.run.smithi100.stdout:Creating initial monmap... 2023-12-05T09:48:31.416 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2023-12-05T09:48:31.417 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = octopus 2023-12-05T09:48:31.417 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 5b035ce6-9353-11ee-95a2-87774f69a715 2023-12-05T09:48:31.417 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-12-05T09:48:31.417 INFO:teuthology.orchestra.run.smithi100.stdout:monmaptool for smithi100 [v2:172.21.15.100:3300,v1:172.21.15.100:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2023-12-05T09:48:31.417 INFO:teuthology.orchestra.run.smithi100.stdout:setting min_mon_release = octopus 2023-12-05T09:48:31.417 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/monmaptool: set fsid to 5b035ce6-9353-11ee-95a2-87774f69a715 2023-12-05T09:48:31.417 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-12-05T09:48:31.417 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:48:31.417 INFO:teuthology.orchestra.run.smithi100.stdout:Creating mon... 2023-12-05T09:48:32.055 INFO:teuthology.orchestra.run.smithi100.stdout:create mon.smithi100 on 2023-12-05T09:48:32.268 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stderr Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2023-12-05T09:48:32.468 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2023-12-05T09:48:32.684 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-5b035ce6-9353-11ee-95a2-87774f69a715.target → /etc/systemd/system/ceph-5b035ce6-9353-11ee-95a2-87774f69a715.target. 2023-12-05T09:48:32.684 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-5b035ce6-9353-11ee-95a2-87774f69a715.target → /etc/systemd/system/ceph-5b035ce6-9353-11ee-95a2-87774f69a715.target. 2023-12-05T09:48:33.003 INFO:teuthology.orchestra.run.smithi100.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-5b035ce6-9353-11ee-95a2-87774f69a715@mon.smithi100 2023-12-05T09:48:33.003 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stderr Failed to reset failed state of unit ceph-5b035ce6-9353-11ee-95a2-87774f69a715@mon.smithi100.service: Unit ceph-5b035ce6-9353-11ee-95a2-87774f69a715@mon.smithi100.service not loaded. 2023-12-05T09:48:33.214 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-5b035ce6-9353-11ee-95a2-87774f69a715.target.wants/ceph-5b035ce6-9353-11ee-95a2-87774f69a715@mon.smithi100.service → /etc/systemd/system/ceph-5b035ce6-9353-11ee-95a2-87774f69a715@.service. 2023-12-05T09:48:33.300 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:33 smithi100 systemd[1]: Starting Ceph mon.smithi100 for 5b035ce6-9353-11ee-95a2-87774f69a715... 2023-12-05T09:48:33.741 INFO:teuthology.orchestra.run.smithi100.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-12-05T09:48:33.741 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stdout disabled 2023-12-05T09:48:33.759 INFO:teuthology.orchestra.run.smithi100.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-12-05T09:48:33.759 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stdout inactive 2023-12-05T09:48:33.759 INFO:teuthology.orchestra.run.smithi100.stdout:firewalld.service is not enabled 2023-12-05T09:48:33.759 INFO:teuthology.orchestra.run.smithi100.stdout:Not possible to enable service . firewalld.service is not available 2023-12-05T09:48:33.759 INFO:teuthology.orchestra.run.smithi100.stdout:Waiting for mon to start... 2023-12-05T09:48:33.759 INFO:teuthology.orchestra.run.smithi100.stdout:Waiting for mon... 2023-12-05T09:48:33.987 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:33 smithi100 bash[106615]: 82d25849e419fbf5f7066d1b705d35f78b350368ea1c14137969c5d0e5d308c9 2023-12-05T09:48:33.987 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:33 smithi100 systemd[1]: Started Ceph mon.smithi100 for 5b035ce6-9353-11ee-95a2-87774f69a715. 2023-12-05T09:48:33.987 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:33 smithi100 ceph-mon[106653]: mkfs 5b035ce6-9353-11ee-95a2-87774f69a715 2023-12-05T09:48:33.987 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:33 smithi100 ceph-mon[106653]: mon.smithi100 is new leader, mons smithi100 in quorum (ranks 0) 2023-12-05T09:48:34.629 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout cluster: 2023-12-05T09:48:34.635 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout id: 5b035ce6-9353-11ee-95a2-87774f69a715 2023-12-05T09:48:34.636 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2023-12-05T09:48:34.636 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 2023-12-05T09:48:34.636 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout services: 2023-12-05T09:48:34.636 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi100 (age 0.591387s) 2023-12-05T09:48:34.636 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2023-12-05T09:48:34.636 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2023-12-05T09:48:34.636 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 2023-12-05T09:48:34.636 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout data: 2023-12-05T09:48:34.636 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2023-12-05T09:48:34.636 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2023-12-05T09:48:34.636 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2023-12-05T09:48:34.636 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout pgs: 2023-12-05T09:48:34.636 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 2023-12-05T09:48:34.637 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:34.224+0000 7f62968e7700 1 Processor -- start 2023-12-05T09:48:34.637 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:34.224+0000 7f62968e7700 1 -- start start 2023-12-05T09:48:34.637 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:34.225+0000 7f62968e7700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6290077bd0 0x7f62900760e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:48:34.637 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:34.225+0000 7f62968e7700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6290077fe0 con 0x7f6290077bd0 2023-12-05T09:48:34.637 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:34.225+0000 7f628ffff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6290077bd0 0x7f62900760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:48:34.637 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:34.226+0000 7f628ffff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6290077bd0 0x7f62900760e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54122/0 (socket says 172.21.15.100:54122) 2023-12-05T09:48:34.637 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:34.226+0000 7f628ffff700 1 -- 172.21.15.100:0/1135584429 learned_addr learned my addr 172.21.15.100:0/1135584429 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:48:34.637 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:34.226+0000 7f628ffff700 1 -- 172.21.15.100:0/1135584429 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6290076620 con 0x7f6290077bd0 2023-12-05T09:48:34.637 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:34.226+0000 7f628ffff700 1 --2- 172.21.15.100:0/1135584429 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6290077bd0 0x7f62900760e0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f62800098e0 tx=0x7f6280009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2e2381a381d2ff7 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:48:34.637 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:34.226+0000 7f628effd700 1 -- 172.21.15.100:0/1135584429 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f628000b860 con 0x7f6290077bd0 2023-12-05T09:48:34.637 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:34.226+0000 7f628effd700 1 -- 172.21.15.100:0/1135584429 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f628000b9c0 con 0x7f6290077bd0 2023-12-05T09:48:34.637 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:34.226+0000 7f628effd700 1 -- 172.21.15.100:0/1135584429 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f628000bc90 con 0x7f6290077bd0 2023-12-05T09:48:34.637 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:34.227+0000 7f62968e7700 1 -- 172.21.15.100:0/1135584429 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6290077bd0 msgr2=0x7f62900760e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:48:34.637 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:34.227+0000 7f62968e7700 1 --2- 172.21.15.100:0/1135584429 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6290077bd0 0x7f62900760e0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f62800098e0 tx=0x7f6280009250 comp rx=0 tx=0).stop 2023-12-05T09:48:34.638 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:34.227+0000 7f62968e7700 1 -- 172.21.15.100:0/1135584429 shutdown_connections 2023-12-05T09:48:34.638 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:34.227+0000 7f62968e7700 1 --2- 172.21.15.100:0/1135584429 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6290077bd0 0x7f62900760e0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:48:34.638 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:34.227+0000 7f62968e7700 1 -- 172.21.15.100:0/1135584429 >> 172.21.15.100:0/1135584429 conn(0x7f62900fda50 msgr2=0x7f62900ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:48:34.638 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:34.227+0000 7f62968e7700 1 -- 172.21.15.100:0/1135584429 shutdown_connections 2023-12-05T09:48:34.638 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:34.227+0000 7f62968e7700 1 -- 172.21.15.100:0/1135584429 wait complete. 2023-12-05T09:48:34.638 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:34.228+0000 7f62968e7700 1 Processor -- start 2023-12-05T09:48:34.638 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:34.228+0000 7f62968e7700 1 -- start start 2023-12-05T09:48:34.638 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:34.228+0000 7f62968e7700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6290077bd0 0x7f6290112b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:48:34.638 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:34.228+0000 7f62968e7700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62901130c0 con 0x7f6290077bd0 2023-12-05T09:48:34.638 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:34.229+0000 7f628ffff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6290077bd0 0x7f6290112b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:48:34.638 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:34.229+0000 7f628ffff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6290077bd0 0x7f6290112b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54138/0 (socket says 172.21.15.100:54138) 2023-12-05T09:48:34.638 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:34.229+0000 7f628ffff700 1 -- 172.21.15.100:0/1665874633 learned_addr learned my addr 172.21.15.100:0/1665874633 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:48:34.638 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:34.229+0000 7f628ffff700 1 -- 172.21.15.100:0/1665874633 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62800094f0 con 0x7f6290077bd0 2023-12-05T09:48:34.638 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:34.229+0000 7f628ffff700 1 --2- 172.21.15.100:0/1665874633 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6290077bd0 0x7f6290112b80 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f6280009290 tx=0x7f6280016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:48:34.639 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:34.230+0000 7f628cff9700 1 -- 172.21.15.100:0/1665874633 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f628001c5c0 con 0x7f6290077bd0 2023-12-05T09:48:34.639 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:34.230+0000 7f628cff9700 1 -- 172.21.15.100:0/1665874633 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f628001c740 con 0x7f6290077bd0 2023-12-05T09:48:34.639 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:34.230+0000 7f628cff9700 1 -- 172.21.15.100:0/1665874633 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f628001ca50 con 0x7f6290077bd0 2023-12-05T09:48:34.639 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:34.230+0000 7f62968e7700 1 -- 172.21.15.100:0/1665874633 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62901132c0 con 0x7f6290077bd0 2023-12-05T09:48:34.639 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:34.230+0000 7f62968e7700 1 -- 172.21.15.100:0/1665874633 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62901136d0 con 0x7f6290077bd0 2023-12-05T09:48:34.639 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:34.230+0000 7f628cff9700 1 -- 172.21.15.100:0/1665874633 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f628001a450 con 0x7f6290077bd0 2023-12-05T09:48:34.639 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:34.230+0000 7f628cff9700 1 -- 172.21.15.100:0/1665874633 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f628002e790 con 0x7f6290077bd0 2023-12-05T09:48:34.639 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:34.231+0000 7f62968e7700 1 -- 172.21.15.100:0/1665874633 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f629004bb80 con 0x7f6290077bd0 2023-12-05T09:48:34.639 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:34.234+0000 7f628cff9700 1 -- 172.21.15.100:0/1665874633 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f628001ce30 con 0x7f6290077bd0 2023-12-05T09:48:34.639 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:34.307+0000 7f62968e7700 1 -- 172.21.15.100:0/1665874633 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f629010c160 con 0x7f6290077bd0 2023-12-05T09:48:34.639 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:34.308+0000 7f628cff9700 1 -- 172.21.15.100:0/1665874633 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+325 (secure 0 0 0) 0x7f628001a890 con 0x7f6290077bd0 2023-12-05T09:48:34.639 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:34.309+0000 7f62968e7700 1 -- 172.21.15.100:0/1665874633 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6290077bd0 msgr2=0x7f6290112b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:48:34.639 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:34.309+0000 7f62968e7700 1 --2- 172.21.15.100:0/1665874633 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6290077bd0 0x7f6290112b80 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f6280009290 tx=0x7f6280016000 comp rx=0 tx=0).stop 2023-12-05T09:48:34.639 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:34.309+0000 7f62968e7700 1 -- 172.21.15.100:0/1665874633 shutdown_connections 2023-12-05T09:48:34.639 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:34.309+0000 7f62968e7700 1 --2- 172.21.15.100:0/1665874633 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6290077bd0 0x7f6290112b80 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:48:34.640 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:34.309+0000 7f62968e7700 1 -- 172.21.15.100:0/1665874633 >> 172.21.15.100:0/1665874633 conn(0x7f62900fda50 msgr2=0x7f6290107040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:48:34.640 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:34.309+0000 7f62968e7700 1 -- 172.21.15.100:0/1665874633 shutdown_connections 2023-12-05T09:48:34.640 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:34.309+0000 7f62968e7700 1 -- 172.21.15.100:0/1665874633 wait complete. 2023-12-05T09:48:34.640 INFO:teuthology.orchestra.run.smithi100.stdout:mon is available 2023-12-05T09:48:34.640 INFO:teuthology.orchestra.run.smithi100.stdout:Assimilating anything we can from ceph.conf... 2023-12-05T09:48:34.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:34 smithi100 ceph-mon[106653]: mon.smithi100 is new leader, mons smithi100 in quorum (ranks 0) 2023-12-05T09:48:34.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:34 smithi100 ceph-mon[106653]: monmap e1: 1 mons at {smithi100=[v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-05T09:48:34.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:34 smithi100 ceph-mon[106653]: fsmap 2023-12-05T09:48:34.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:34 smithi100 ceph-mon[106653]: osdmap e1: 0 total, 0 up, 0 in 2023-12-05T09:48:34.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:34 smithi100 ceph-mon[106653]: mgrmap e1: no daemons active 2023-12-05T09:48:34.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:34 smithi100 ceph-mon[106653]: from='client.? 172.21.15.100:0/1665874633' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2023-12-05T09:48:36.065 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 2023-12-05T09:48:36.065 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout [global] 2023-12-05T09:48:36.065 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout fsid = 5b035ce6-9353-11ee-95a2-87774f69a715 2023-12-05T09:48:36.065 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.100:3300,v1:172.21.15.100:6789] 2023-12-05T09:48:36.065 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-12-05T09:48:36.066 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-12-05T09:48:36.066 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-12-05T09:48:36.066 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-12-05T09:48:36.066 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 2023-12-05T09:48:36.066 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout [mgr] 2023-12-05T09:48:36.066 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-12-05T09:48:36.066 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 2023-12-05T09:48:36.066 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout [osd] 2023-12-05T09:48:36.066 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-12-05T09:48:36.066 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-12-05T09:48:36.067 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-12-05T09:48:36.067 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-12-05T09:48:36.067 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-12-05T09:48:36.067 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:35.089+0000 7f209a0c2700 1 Processor -- start 2023-12-05T09:48:36.067 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:35.089+0000 7f209a0c2700 1 -- start start 2023-12-05T09:48:36.067 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:35.089+0000 7f209a0c2700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2094077b90 0x7f20940760a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:48:36.067 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:35.089+0000 7f209a0c2700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2094077fa0 con 0x7f2094077b90 2023-12-05T09:48:36.067 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:35.090+0000 7f20937fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2094077b90 0x7f20940760a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:48:36.067 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:35.090+0000 7f20937fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2094077b90 0x7f20940760a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54142/0 (socket says 172.21.15.100:54142) 2023-12-05T09:48:36.067 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:35.090+0000 7f20937fe700 1 -- 172.21.15.100:0/2820439145 learned_addr learned my addr 172.21.15.100:0/2820439145 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:48:36.067 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:35.091+0000 7f20937fe700 1 -- 172.21.15.100:0/2820439145 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20940765e0 con 0x7f2094077b90 2023-12-05T09:48:36.067 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:35.091+0000 7f20937fe700 1 --2- 172.21.15.100:0/2820439145 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2094077b90 0x7f20940760a0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f20840098e0 tx=0x7f2084009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2825a1b4dcde957 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:48:36.067 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:35.091+0000 7f20927fc700 1 -- 172.21.15.100:0/2820439145 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f208400b860 con 0x7f2094077b90 2023-12-05T09:48:36.067 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:35.091+0000 7f20927fc700 1 -- 172.21.15.100:0/2820439145 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f208400b9c0 con 0x7f2094077b90 2023-12-05T09:48:36.067 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:35.091+0000 7f20927fc700 1 -- 172.21.15.100:0/2820439145 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f208400bc90 con 0x7f2094077b90 2023-12-05T09:48:36.068 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:35.091+0000 7f209a0c2700 1 -- 172.21.15.100:0/2820439145 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2094077b90 msgr2=0x7f20940760a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:48:36.068 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:35.092+0000 7f209a0c2700 1 --2- 172.21.15.100:0/2820439145 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2094077b90 0x7f20940760a0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f20840098e0 tx=0x7f2084009250 comp rx=0 tx=0).stop 2023-12-05T09:48:36.068 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:35.092+0000 7f209a0c2700 1 -- 172.21.15.100:0/2820439145 shutdown_connections 2023-12-05T09:48:36.068 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:35.092+0000 7f209a0c2700 1 --2- 172.21.15.100:0/2820439145 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2094077b90 0x7f20940760a0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:48:36.068 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:35.092+0000 7f209a0c2700 1 -- 172.21.15.100:0/2820439145 >> 172.21.15.100:0/2820439145 conn(0x7f20940fda50 msgr2=0x7f20940ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:48:36.068 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:35.092+0000 7f209a0c2700 1 -- 172.21.15.100:0/2820439145 shutdown_connections 2023-12-05T09:48:36.068 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:35.092+0000 7f209a0c2700 1 -- 172.21.15.100:0/2820439145 wait complete. 2023-12-05T09:48:36.068 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:35.093+0000 7f209a0c2700 1 Processor -- start 2023-12-05T09:48:36.068 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:35.093+0000 7f209a0c2700 1 -- start start 2023-12-05T09:48:36.068 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:35.093+0000 7f209a0c2700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2094077b90 0x7f2094112b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:48:36.068 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:35.093+0000 7f209a0c2700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20941130d0 con 0x7f2094077b90 2023-12-05T09:48:36.068 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:35.093+0000 7f20937fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2094077b90 0x7f2094112b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:48:36.068 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:35.093+0000 7f20937fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2094077b90 0x7f2094112b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54154/0 (socket says 172.21.15.100:54154) 2023-12-05T09:48:36.069 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:35.093+0000 7f20937fe700 1 -- 172.21.15.100:0/1336578953 learned_addr learned my addr 172.21.15.100:0/1336578953 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:48:36.069 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:35.094+0000 7f20937fe700 1 -- 172.21.15.100:0/1336578953 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20840094f0 con 0x7f2094077b90 2023-12-05T09:48:36.069 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:35.094+0000 7f20937fe700 1 --2- 172.21.15.100:0/1336578953 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2094077b90 0x7f2094112b90 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f2084009290 tx=0x7f2084016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:48:36.069 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:35.094+0000 7f207bfff700 1 -- 172.21.15.100:0/1336578953 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f208401c5c0 con 0x7f2094077b90 2023-12-05T09:48:36.069 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:35.094+0000 7f207bfff700 1 -- 172.21.15.100:0/1336578953 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f208401c740 con 0x7f2094077b90 2023-12-05T09:48:36.069 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:35.094+0000 7f207bfff700 1 -- 172.21.15.100:0/1336578953 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f208401ca50 con 0x7f2094077b90 2023-12-05T09:48:36.069 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:35.094+0000 7f209a0c2700 1 -- 172.21.15.100:0/1336578953 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20941132d0 con 0x7f2094077b90 2023-12-05T09:48:36.069 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:35.094+0000 7f209a0c2700 1 -- 172.21.15.100:0/1336578953 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20941136e0 con 0x7f2094077b90 2023-12-05T09:48:36.069 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:35.095+0000 7f207bfff700 1 -- 172.21.15.100:0/1336578953 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f208401a450 con 0x7f2094077b90 2023-12-05T09:48:36.069 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:35.095+0000 7f207bfff700 1 -- 172.21.15.100:0/1336578953 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f208402e790 con 0x7f2094077b90 2023-12-05T09:48:36.069 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:35.095+0000 7f209a0c2700 1 -- 172.21.15.100:0/1336578953 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f209404bb80 con 0x7f2094077b90 2023-12-05T09:48:36.069 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:35.098+0000 7f207bfff700 1 -- 172.21.15.100:0/1336578953 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f208401ce30 con 0x7f2094077b90 2023-12-05T09:48:36.069 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:35.168+0000 7f209a0c2700 1 -- 172.21.15.100:0/1336578953 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f2094076950 con 0x7f2094077b90 2023-12-05T09:48:36.069 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:35.172+0000 7f207bfff700 1 -- 172.21.15.100:0/1336578953 <== mon.0 v2:172.21.15.100:3300/0 7 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f208401b3e0 con 0x7f2094077b90 2023-12-05T09:48:36.070 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:35.172+0000 7f207bfff700 1 -- 172.21.15.100:0/1336578953 <== mon.0 v2:172.21.15.100:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+431 (secure 0 0 0) 0x7f208402e950 con 0x7f2094077b90 2023-12-05T09:48:36.070 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:35.173+0000 7f209a0c2700 1 -- 172.21.15.100:0/1336578953 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2094077b90 msgr2=0x7f2094112b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:48:36.070 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:35.173+0000 7f209a0c2700 1 --2- 172.21.15.100:0/1336578953 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2094077b90 0x7f2094112b90 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f2084009290 tx=0x7f2084016000 comp rx=0 tx=0).stop 2023-12-05T09:48:36.070 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:35.173+0000 7f209a0c2700 1 -- 172.21.15.100:0/1336578953 shutdown_connections 2023-12-05T09:48:36.070 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:35.173+0000 7f209a0c2700 1 --2- 172.21.15.100:0/1336578953 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2094077b90 0x7f2094112b90 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:48:36.070 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:35.174+0000 7f209a0c2700 1 -- 172.21.15.100:0/1336578953 >> 172.21.15.100:0/1336578953 conn(0x7f20940fda50 msgr2=0x7f2094107080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:48:36.070 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:35.174+0000 7f209a0c2700 1 -- 172.21.15.100:0/1336578953 shutdown_connections 2023-12-05T09:48:36.070 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:35.174+0000 7f209a0c2700 1 -- 172.21.15.100:0/1336578953 wait complete. 2023-12-05T09:48:36.070 INFO:teuthology.orchestra.run.smithi100.stdout:Generating new minimal ceph.conf... 2023-12-05T09:48:36.070 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:35 smithi100 ceph-mon[106653]: from='client.? 172.21.15.100:0/1336578953' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-12-05T09:48:36.070 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:35 smithi100 ceph-mon[106653]: from='client.? 172.21.15.100:0/1336578953' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2023-12-05T09:48:36.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:36 smithi100 ceph-mon[106653]: from='client.? 172.21.15.100:0/1623069937' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:48:36.904 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:36.464+0000 7fd845c4a700 1 Processor -- start 2023-12-05T09:48:36.904 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:36.464+0000 7fd845c4a700 1 -- start start 2023-12-05T09:48:36.904 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:36.464+0000 7fd845c4a700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd840077bf0 0x7fd840076100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:48:36.904 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:36.464+0000 7fd845c4a700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd840078000 con 0x7fd840077bf0 2023-12-05T09:48:36.904 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:36.465+0000 7fd83f7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd840077bf0 0x7fd840076100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:48:36.904 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:36.465+0000 7fd83f7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd840077bf0 0x7fd840076100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54164/0 (socket says 172.21.15.100:54164) 2023-12-05T09:48:36.904 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:36.465+0000 7fd83f7fe700 1 -- 172.21.15.100:0/1076771367 learned_addr learned my addr 172.21.15.100:0/1076771367 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:48:36.904 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:36.465+0000 7fd83f7fe700 1 -- 172.21.15.100:0/1076771367 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd840076640 con 0x7fd840077bf0 2023-12-05T09:48:36.904 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:36.465+0000 7fd83f7fe700 1 --2- 172.21.15.100:0/1076771367 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd840077bf0 0x7fd840076100 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fd8300098e0 tx=0x7fd830009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24eee8a6ee1d5e75 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:48:36.904 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:36.465+0000 7fd83e7fc700 1 -- 172.21.15.100:0/1076771367 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd83000b860 con 0x7fd840077bf0 2023-12-05T09:48:36.904 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:36.466+0000 7fd83e7fc700 1 -- 172.21.15.100:0/1076771367 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fd83000be30 con 0x7fd840077bf0 2023-12-05T09:48:36.904 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:36.466+0000 7fd83e7fc700 1 -- 172.21.15.100:0/1076771367 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd830010380 con 0x7fd840077bf0 2023-12-05T09:48:36.904 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:36.466+0000 7fd845c4a700 1 -- 172.21.15.100:0/1076771367 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd840077bf0 msgr2=0x7fd840076100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:48:36.905 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:36.466+0000 7fd845c4a700 1 --2- 172.21.15.100:0/1076771367 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd840077bf0 0x7fd840076100 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fd8300098e0 tx=0x7fd830009250 comp rx=0 tx=0).stop 2023-12-05T09:48:36.905 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:36.466+0000 7fd845c4a700 1 -- 172.21.15.100:0/1076771367 shutdown_connections 2023-12-05T09:48:36.905 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:36.466+0000 7fd845c4a700 1 --2- 172.21.15.100:0/1076771367 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd840077bf0 0x7fd840076100 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:48:36.905 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:36.466+0000 7fd845c4a700 1 -- 172.21.15.100:0/1076771367 >> 172.21.15.100:0/1076771367 conn(0x7fd8400fda50 msgr2=0x7fd8400ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:48:36.905 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:36.466+0000 7fd845c4a700 1 -- 172.21.15.100:0/1076771367 shutdown_connections 2023-12-05T09:48:36.905 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:36.466+0000 7fd845c4a700 1 -- 172.21.15.100:0/1076771367 wait complete. 2023-12-05T09:48:36.905 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:36.467+0000 7fd845c4a700 1 Processor -- start 2023-12-05T09:48:36.905 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:36.467+0000 7fd845c4a700 1 -- start start 2023-12-05T09:48:36.905 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:36.467+0000 7fd845c4a700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd840077bf0 0x7fd840113380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:48:36.905 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:36.467+0000 7fd845c4a700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8401138c0 con 0x7fd840077bf0 2023-12-05T09:48:36.905 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:36.468+0000 7fd83f7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd840077bf0 0x7fd840113380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:48:36.905 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:36.468+0000 7fd83f7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd840077bf0 0x7fd840113380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54166/0 (socket says 172.21.15.100:54166) 2023-12-05T09:48:36.905 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:36.468+0000 7fd83f7fe700 1 -- 172.21.15.100:0/1623069937 learned_addr learned my addr 172.21.15.100:0/1623069937 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:48:36.906 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:36.468+0000 7fd83f7fe700 1 -- 172.21.15.100:0/1623069937 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8300094f0 con 0x7fd840077bf0 2023-12-05T09:48:36.906 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:36.468+0000 7fd83f7fe700 1 --2- 172.21.15.100:0/1623069937 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd840077bf0 0x7fd840113380 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd830006d40 tx=0x7fd830009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:48:36.906 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:36.468+0000 7fd827fff700 1 -- 172.21.15.100:0/1623069937 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd8300109b0 con 0x7fd840077bf0 2023-12-05T09:48:36.906 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:36.469+0000 7fd827fff700 1 -- 172.21.15.100:0/1623069937 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fd830024440 con 0x7fd840077bf0 2023-12-05T09:48:36.906 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:36.469+0000 7fd845c4a700 1 -- 172.21.15.100:0/1623069937 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd840113ac0 con 0x7fd840077bf0 2023-12-05T09:48:36.906 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:36.469+0000 7fd827fff700 1 -- 172.21.15.100:0/1623069937 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd83001a5f0 con 0x7fd840077bf0 2023-12-05T09:48:36.906 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:36.469+0000 7fd845c4a700 1 -- 172.21.15.100:0/1623069937 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd840113ed0 con 0x7fd840077bf0 2023-12-05T09:48:36.906 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:36.469+0000 7fd827fff700 1 -- 172.21.15.100:0/1623069937 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fd83001aaa0 con 0x7fd840077bf0 2023-12-05T09:48:36.906 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:36.469+0000 7fd827fff700 1 -- 172.21.15.100:0/1623069937 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fd83002da00 con 0x7fd840077bf0 2023-12-05T09:48:36.906 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:36.470+0000 7fd845c4a700 1 -- 172.21.15.100:0/1623069937 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd84004bb80 con 0x7fd840077bf0 2023-12-05T09:48:36.906 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:36.473+0000 7fd827fff700 1 -- 172.21.15.100:0/1623069937 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fd830006d70 con 0x7fd840077bf0 2023-12-05T09:48:36.906 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:36.542+0000 7fd845c4a700 1 -- 172.21.15.100:0/1623069937 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fd840108570 con 0x7fd840077bf0 2023-12-05T09:48:36.906 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:36.542+0000 7fd827fff700 1 -- 172.21.15.100:0/1623069937 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+177 (secure 0 0 0) 0x7fd840108570 con 0x7fd840077bf0 2023-12-05T09:48:36.906 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:36.543+0000 7fd845c4a700 1 -- 172.21.15.100:0/1623069937 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd840077bf0 msgr2=0x7fd840113380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:48:36.907 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:36.543+0000 7fd845c4a700 1 --2- 172.21.15.100:0/1623069937 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd840077bf0 0x7fd840113380 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd830006d40 tx=0x7fd830009250 comp rx=0 tx=0).stop 2023-12-05T09:48:36.907 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:36.543+0000 7fd845c4a700 1 -- 172.21.15.100:0/1623069937 shutdown_connections 2023-12-05T09:48:36.907 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:36.543+0000 7fd845c4a700 1 --2- 172.21.15.100:0/1623069937 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd840077bf0 0x7fd840113380 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:48:36.907 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:36.543+0000 7fd845c4a700 1 -- 172.21.15.100:0/1623069937 >> 172.21.15.100:0/1623069937 conn(0x7fd8400fda50 msgr2=0x7fd8400ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:48:36.907 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:36.543+0000 7fd845c4a700 1 -- 172.21.15.100:0/1623069937 shutdown_connections 2023-12-05T09:48:36.907 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:36.543+0000 7fd845c4a700 1 -- 172.21.15.100:0/1623069937 wait complete. 2023-12-05T09:48:36.907 INFO:teuthology.orchestra.run.smithi100.stdout:Restarting the monitor... 2023-12-05T09:48:37.171 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:36 smithi100 systemd[1]: Stopping Ceph mon.smithi100 for 5b035ce6-9353-11ee-95a2-87774f69a715... 2023-12-05T09:48:37.430 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:37 smithi100 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-mon-smithi100[106630]: 2023-12-05T09:48:37.173+0000 7efcf8ebf700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi100 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-05T09:48:37.430 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:37 smithi100 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-mon-smithi100[106630]: 2023-12-05T09:48:37.173+0000 7efcf8ebf700 -1 mon.smithi100@0(leader) e1 *** Got Signal Terminated *** 2023-12-05T09:48:37.822 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:37 smithi100 bash[106989]: ceph-5b035ce6-9353-11ee-95a2-87774f69a715-mon-smithi100 2023-12-05T09:48:38.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:37 smithi100 systemd[1]: ceph-5b035ce6-9353-11ee-95a2-87774f69a715@mon.smithi100.service: Succeeded. 2023-12-05T09:48:38.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:37 smithi100 systemd[1]: Stopped Ceph mon.smithi100 for 5b035ce6-9353-11ee-95a2-87774f69a715. 2023-12-05T09:48:38.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:37 smithi100 systemd[1]: Starting Ceph mon.smithi100 for 5b035ce6-9353-11ee-95a2-87774f69a715... 2023-12-05T09:48:38.276 INFO:teuthology.orchestra.run.smithi100.stdout:Setting mon public_network to 172.21.0.0/20 2023-12-05T09:48:38.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 bash[107108]: 8e091d6081cce301c5e5ec42042274d69fb580984514e43ca5f0636fc4d02182 2023-12-05T09:48:38.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 systemd[1]: Started Ceph mon.smithi100 for 5b035ce6-9353-11ee-95a2-87774f69a715. 2023-12-05T09:48:38.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: set uid:gid to 167:167 (ceph:ceph) 2023-12-05T09:48:38.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable), process ceph-mon, pid 7 2023-12-05T09:48:38.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: pidfile_write: ignore empty --pid-file 2023-12-05T09:48:38.647 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: load: jerasure load: lrc 2023-12-05T09:48:38.647 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: RocksDB version: 6.15.5 2023-12-05T09:48:38.647 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2023-12-05T09:48:38.647 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Compile date Dec 4 2023 2023-12-05T09:48:38.647 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: DB SUMMARY 2023-12-05T09:48:38.647 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: DB Session ID: FST2WBGGZUWWGT1FOC5Q 2023-12-05T09:48:38.647 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: CURRENT file: CURRENT 2023-12-05T09:48:38.647 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: IDENTITY file: IDENTITY 2023-12-05T09:48:38.647 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: MANIFEST file: MANIFEST-000009 size: 131 Bytes 2023-12-05T09:48:38.647 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi100/store.db dir, Total Num: 1, files: 000008.sst 2023-12-05T09:48:38.647 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi100/store.db: 000010.log size: 96788 ; 2023-12-05T09:48:38.647 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.error_if_exists: 0 2023-12-05T09:48:38.647 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.create_if_missing: 0 2023-12-05T09:48:38.647 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.paranoid_checks: 1 2023-12-05T09:48:38.648 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-12-05T09:48:38.648 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.env: 0x555af5749a80 2023-12-05T09:48:38.648 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.fs: Posix File System 2023-12-05T09:48:38.648 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.info_log: 0x555af6770780 2023-12-05T09:48:38.648 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.max_file_opening_threads: 16 2023-12-05T09:48:38.648 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.statistics: (nil) 2023-12-05T09:48:38.648 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.use_fsync: 0 2023-12-05T09:48:38.648 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.max_log_file_size: 0 2023-12-05T09:48:38.648 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-12-05T09:48:38.648 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.log_file_time_to_roll: 0 2023-12-05T09:48:38.648 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.keep_log_file_num: 1000 2023-12-05T09:48:38.648 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.recycle_log_file_num: 0 2023-12-05T09:48:38.648 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.allow_fallocate: 1 2023-12-05T09:48:38.648 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.allow_mmap_reads: 0 2023-12-05T09:48:38.648 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.allow_mmap_writes: 0 2023-12-05T09:48:38.648 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.use_direct_reads: 0 2023-12-05T09:48:38.649 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-12-05T09:48:38.649 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.create_missing_column_families: 0 2023-12-05T09:48:38.649 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.db_log_dir: 2023-12-05T09:48:38.649 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi100/store.db 2023-12-05T09:48:38.649 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.table_cache_numshardbits: 6 2023-12-05T09:48:38.649 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.WAL_ttl_seconds: 0 2023-12-05T09:48:38.649 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.WAL_size_limit_MB: 0 2023-12-05T09:48:38.649 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-12-05T09:48:38.649 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-12-05T09:48:38.649 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.is_fd_close_on_exec: 1 2023-12-05T09:48:38.649 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.advise_random_on_open: 1 2023-12-05T09:48:38.649 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.db_write_buffer_size: 0 2023-12-05T09:48:38.649 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.write_buffer_manager: 0x555af74e0990 2023-12-05T09:48:38.649 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-12-05T09:48:38.649 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2023-12-05T09:48:38.650 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-12-05T09:48:38.650 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.use_adaptive_mutex: 0 2023-12-05T09:48:38.650 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.rate_limiter: (nil) 2023-12-05T09:48:38.650 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-12-05T09:48:38.650 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.wal_recovery_mode: 2 2023-12-05T09:48:38.650 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.enable_thread_tracking: 0 2023-12-05T09:48:38.650 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.enable_pipelined_write: 0 2023-12-05T09:48:38.650 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.unordered_write: 0 2023-12-05T09:48:38.650 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-12-05T09:48:38.650 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-12-05T09:48:38.650 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-12-05T09:48:38.651 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-12-05T09:48:38.651 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.row_cache: None 2023-12-05T09:48:38.651 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.wal_filter: None 2023-12-05T09:48:38.651 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-12-05T09:48:38.651 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.allow_ingest_behind: 0 2023-12-05T09:48:38.651 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.preserve_deletes: 0 2023-12-05T09:48:38.651 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.two_write_queues: 0 2023-12-05T09:48:38.651 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.manual_wal_flush: 0 2023-12-05T09:48:38.651 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.atomic_flush: 0 2023-12-05T09:48:38.651 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-12-05T09:48:38.651 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.persist_stats_to_disk: 0 2023-12-05T09:48:38.651 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.write_dbid_to_manifest: 0 2023-12-05T09:48:38.651 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.log_readahead_size: 0 2023-12-05T09:48:38.651 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-12-05T09:48:38.651 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.best_efforts_recovery: 0 2023-12-05T09:48:38.652 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-12-05T09:48:38.652 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-12-05T09:48:38.652 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.allow_data_in_errors: 0 2023-12-05T09:48:38.652 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.db_host_id: __hostname__ 2023-12-05T09:48:38.652 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.max_background_jobs: 2 2023-12-05T09:48:38.652 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.max_background_compactions: -1 2023-12-05T09:48:38.652 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.max_subcompactions: 1 2023-12-05T09:48:38.652 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-12-05T09:48:38.652 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-12-05T09:48:38.652 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.delayed_write_rate : 16777216 2023-12-05T09:48:38.652 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.max_total_wal_size: 0 2023-12-05T09:48:38.652 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-12-05T09:48:38.652 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.stats_dump_period_sec: 600 2023-12-05T09:48:38.652 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.stats_persist_period_sec: 600 2023-12-05T09:48:38.652 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-12-05T09:48:38.653 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.max_open_files: -1 2023-12-05T09:48:38.653 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.bytes_per_sync: 0 2023-12-05T09:48:38.653 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.wal_bytes_per_sync: 0 2023-12-05T09:48:38.653 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.strict_bytes_per_sync: 0 2023-12-05T09:48:38.653 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.compaction_readahead_size: 0 2023-12-05T09:48:38.653 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.max_background_flushes: -1 2023-12-05T09:48:38.653 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Compression algorithms supported: 2023-12-05T09:48:38.653 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-12-05T09:48:38.653 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: kZSTD supported: 0 2023-12-05T09:48:38.653 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: kXpressCompression supported: 0 2023-12-05T09:48:38.653 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: kLZ4HCCompression supported: 1 2023-12-05T09:48:38.653 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: kZlibCompression supported: 1 2023-12-05T09:48:38.653 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: kSnappyCompression supported: 1 2023-12-05T09:48:38.653 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: kLZ4Compression supported: 1 2023-12-05T09:48:38.653 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: kBZip2Compression supported: 0 2023-12-05T09:48:38.653 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Fast CRC32 supported: Supported on x86 2023-12-05T09:48:38.654 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi100/store.db/MANIFEST-000009 2023-12-05T09:48:38.654 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2023-12-05T09:48:38.654 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-12-05T09:48:38.654 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.merge_operator: 2023-12-05T09:48:38.654 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.compaction_filter: None 2023-12-05T09:48:38.654 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.compaction_filter_factory: None 2023-12-05T09:48:38.654 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.sst_partitioner_factory: None 2023-12-05T09:48:38.654 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.memtable_factory: SkipListFactory 2023-12-05T09:48:38.654 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.table_factory: BlockBasedTable 2023-12-05T09:48:38.654 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x555af67c0f90) 2023-12-05T09:48:38.654 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: cache_index_and_filter_blocks: 1 2023-12-05T09:48:38.654 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-12-05T09:48:38.654 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-12-05T09:48:38.654 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: pin_top_level_index_and_filter: 1 2023-12-05T09:48:38.655 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: index_type: 0 2023-12-05T09:48:38.655 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: data_block_index_type: 0 2023-12-05T09:48:38.655 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: index_shortening: 1 2023-12-05T09:48:38.655 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: data_block_hash_table_util_ratio: 0.750000 2023-12-05T09:48:38.655 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: hash_index_allow_collision: 1 2023-12-05T09:48:38.655 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: checksum: 1 2023-12-05T09:48:38.655 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: no_block_cache: 0 2023-12-05T09:48:38.655 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: block_cache: 0x555af67f3090 2023-12-05T09:48:38.655 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: block_cache_name: BinnedLRUCache 2023-12-05T09:48:38.655 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: block_cache_options: 2023-12-05T09:48:38.655 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: capacity : 536870912 2023-12-05T09:48:38.655 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: num_shard_bits : 4 2023-12-05T09:48:38.655 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: strict_capacity_limit : 0 2023-12-05T09:48:38.655 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: high_pri_pool_ratio: 0.000 2023-12-05T09:48:38.655 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: block_cache_compressed: (nil) 2023-12-05T09:48:38.656 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: persistent_cache: (nil) 2023-12-05T09:48:38.656 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: block_size: 4096 2023-12-05T09:48:38.656 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: block_size_deviation: 10 2023-12-05T09:48:38.656 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: block_restart_interval: 16 2023-12-05T09:48:38.656 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: index_block_restart_interval: 1 2023-12-05T09:48:38.656 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: metadata_block_size: 4096 2023-12-05T09:48:38.656 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: partition_filters: 0 2023-12-05T09:48:38.656 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: use_delta_encoding: 1 2023-12-05T09:48:38.656 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2023-12-05T09:48:38.656 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: whole_key_filtering: 1 2023-12-05T09:48:38.656 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: verify_compression: 0 2023-12-05T09:48:38.656 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: read_amp_bytes_per_bit: 0 2023-12-05T09:48:38.656 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: format_version: 4 2023-12-05T09:48:38.656 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: enable_index_compression: 1 2023-12-05T09:48:38.656 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: block_align: 0 2023-12-05T09:48:38.657 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.write_buffer_size: 33554432 2023-12-05T09:48:38.657 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.max_write_buffer_number: 2 2023-12-05T09:48:38.657 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.compression: NoCompression 2023-12-05T09:48:38.657 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.bottommost_compression: Disabled 2023-12-05T09:48:38.657 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.prefix_extractor: nullptr 2023-12-05T09:48:38.657 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-12-05T09:48:38.657 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.num_levels: 7 2023-12-05T09:48:38.657 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-12-05T09:48:38.657 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-12-05T09:48:38.657 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-12-05T09:48:38.657 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-12-05T09:48:38.657 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-12-05T09:48:38.657 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-12-05T09:48:38.657 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-12-05T09:48:38.657 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-12-05T09:48:38.657 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-12-05T09:48:38.658 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-12-05T09:48:38.659 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.compression_opts.window_bits: -14 2023-12-05T09:48:38.659 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.compression_opts.level: 32767 2023-12-05T09:48:38.659 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.compression_opts.strategy: 0 2023-12-05T09:48:38.659 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-12-05T09:48:38.659 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-12-05T09:48:38.659 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-12-05T09:48:38.659 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.compression_opts.enabled: false 2023-12-05T09:48:38.659 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-12-05T09:48:38.659 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-12-05T09:48:38.659 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-12-05T09:48:38.659 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.target_file_size_base: 67108864 2023-12-05T09:48:38.659 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.target_file_size_multiplier: 1 2023-12-05T09:48:38.659 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-12-05T09:48:38.659 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-12-05T09:48:38.660 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-12-05T09:48:38.660 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-12-05T09:48:38.660 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-12-05T09:48:38.660 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-12-05T09:48:38.660 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-12-05T09:48:38.660 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-12-05T09:48:38.660 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-12-05T09:48:38.660 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-12-05T09:48:38.660 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-12-05T09:48:38.660 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-12-05T09:48:38.660 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.arena_block_size: 4194304 2023-12-05T09:48:38.660 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-12-05T09:48:38.660 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-12-05T09:48:38.660 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2023-12-05T09:48:38.660 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.disable_auto_compactions: 0 2023-12-05T09:48:38.660 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-12-05T09:48:38.661 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-12-05T09:48:38.661 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-12-05T09:48:38.661 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-12-05T09:48:38.661 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-12-05T09:48:38.661 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-12-05T09:48:38.661 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-12-05T09:48:38.661 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-12-05T09:48:38.661 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-12-05T09:48:38.661 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-12-05T09:48:38.661 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.table_properties_collectors: 2023-12-05T09:48:38.662 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.inplace_update_support: 0 2023-12-05T09:48:38.662 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.inplace_update_num_locks: 10000 2023-12-05T09:48:38.662 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-12-05T09:48:38.662 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-12-05T09:48:38.662 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.memtable_huge_page_size: 0 2023-12-05T09:48:38.662 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.bloom_locality: 0 2023-12-05T09:48:38.662 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.max_successive_merges: 0 2023-12-05T09:48:38.662 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.optimize_filters_for_hits: 0 2023-12-05T09:48:38.662 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.paranoid_file_checks: 0 2023-12-05T09:48:38.662 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.force_consistency_checks: 1 2023-12-05T09:48:38.662 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.report_bg_io_stats: 0 2023-12-05T09:48:38.662 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.ttl: 2592000 2023-12-05T09:48:38.662 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.periodic_compaction_seconds: 0 2023-12-05T09:48:38.662 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.enable_blob_files: false 2023-12-05T09:48:38.662 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.min_blob_size: 0 2023-12-05T09:48:38.663 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.blob_file_size: 268435456 2023-12-05T09:48:38.663 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.blob_compression_type: NoCompression 2023-12-05T09:48:38.663 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.enable_blob_garbage_collection: false 2023-12-05T09:48:38.663 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-12-05T09:48:38.663 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi100/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 11, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-12-05T09:48:38.663 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 5 2023-12-05T09:48:38.663 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: [db/version_set.cc:4082] Creating manifest 13 2023-12-05T09:48:38.663 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: EVENT_LOG_v1 {"time_micros": 1701769718297418, "job": 1, "event": "recovery_started", "wal_files": [10]} 2023-12-05T09:48:38.663 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #10 mode 2 2023-12-05T09:48:38.663 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2023-12-05T09:48:38.663 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: EVENT_LOG_v1 {"time_micros": 1701769718298866, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 14, "file_size": 92157, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 90252, "index_size": 265, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13225, "raw_average_key_size": 49, "raw_value_size": 82991, "raw_average_value_size": 310, "num_data_blocks": 11, "num_entries": 267, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1701769718, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "eca67d5f-e8f3-4aec-bfcf-e8e867a7d5f4", "db_session_id": "FST2WBGGZUWWGT1FOC5Q"}} 2023-12-05T09:48:38.663 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: [db/version_set.cc:4082] Creating manifest 15 2023-12-05T09:48:38.663 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: EVENT_LOG_v1 {"time_micros": 1701769718299511, "job": 1, "event": "recovery_finished"} 2023-12-05T09:48:38.663 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-smithi100/store.db/000010.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-12-05T09:48:38.664 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x555af6787180 2023-12-05T09:48:38.664 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: DB pointer 0x555af685c000 2023-12-05T09:48:38.664 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2023-12-05T09:48:38.664 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: rocksdb: [db/db_impl/db_impl.cc:903] 2023-12-05T09:48:38.664 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: ** DB Stats ** 2023-12-05T09:48:38.664 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-05T09:48:38.664 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-12-05T09:48:38.664 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-05T09:48:38.664 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-05T09:48:38.664 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-12-05T09:48:38.664 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2023-12-05T09:48:38.664 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-05T09:48:38.664 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: 2023-12-05T09:48:38.664 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: ** Compaction Stats [default] ** 2023-12-05T09:48:38.664 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-05T09:48:38.665 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-05T09:48:38.665 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: L0 2/0 91.79 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 93.5 0.00 0.00 1 0.001 0 0 2023-12-05T09:48:38.665 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Sum 2/0 91.79 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 93.5 0.00 0.00 1 0.001 0 0 2023-12-05T09:48:38.665 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 93.5 0.00 0.00 1 0.001 0 0 2023-12-05T09:48:38.665 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: 2023-12-05T09:48:38.665 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: ** Compaction Stats [default] ** 2023-12-05T09:48:38.665 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-05T09:48:38.665 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-05T09:48:38.665 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 93.5 0.00 0.00 1 0.001 0 0 2023-12-05T09:48:38.665 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-05T09:48:38.665 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-12-05T09:48:38.665 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-05T09:48:38.666 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-05T09:48:38.666 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-05T09:48:38.666 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-05T09:48:38.666 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Cumulative compaction: 0.00 GB write, 13.33 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-05T09:48:38.666 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Interval compaction: 0.00 GB write, 13.33 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-05T09:48:38.666 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-05T09:48:38.666 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: 2023-12-05T09:48:38.666 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-05T09:48:38.666 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: 2023-12-05T09:48:38.666 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: ** Compaction Stats [default] ** 2023-12-05T09:48:38.666 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-05T09:48:38.666 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-05T09:48:38.666 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: L0 2/0 91.79 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 93.5 0.00 0.00 1 0.001 0 0 2023-12-05T09:48:38.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Sum 2/0 91.79 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 93.5 0.00 0.00 1 0.001 0 0 2023-12-05T09:48:38.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2023-12-05T09:48:38.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: 2023-12-05T09:48:38.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: ** Compaction Stats [default] ** 2023-12-05T09:48:38.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-05T09:48:38.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-05T09:48:38.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 93.5 0.00 0.00 1 0.001 0 0 2023-12-05T09:48:38.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-05T09:48:38.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-12-05T09:48:38.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-05T09:48:38.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-05T09:48:38.669 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-05T09:48:38.669 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-05T09:48:38.669 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Cumulative compaction: 0.00 GB write, 13.26 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-05T09:48:38.669 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-05T09:48:38.669 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-05T09:48:38.669 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: 2023-12-05T09:48:38.669 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-05T09:48:38.669 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: starting mon.smithi100 rank 0 at public addrs [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] at bind addrs [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi100 fsid 5b035ce6-9353-11ee-95a2-87774f69a715 2023-12-05T09:48:38.669 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: mon.smithi100@-1(???) e1 preinit fsid 5b035ce6-9353-11ee-95a2-87774f69a715 2023-12-05T09:48:38.669 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: mon.smithi100@-1(???).mds e1 new map 2023-12-05T09:48:38.669 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: mon.smithi100@-1(???).mds e1 print_map 2023-12-05T09:48:38.670 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: e1 2023-12-05T09:48:38.670 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-12-05T09:48:38.670 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T09:48:38.670 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: legacy client fscid: -1 2023-12-05T09:48:38.670 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: 2023-12-05T09:48:38.670 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: No filesystems configured 2023-12-05T09:48:38.670 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: mon.smithi100@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2023-12-05T09:48:38.670 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: mon.smithi100@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-12-05T09:48:38.670 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: mon.smithi100@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-12-05T09:48:38.670 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: mon.smithi100@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-12-05T09:48:38.670 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: mon.smithi100@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2023-12-05T09:48:38.670 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: mon.smithi100 is new leader, mons smithi100 in quorum (ranks 0) 2023-12-05T09:48:38.670 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: monmap e1: 1 mons at {smithi100=[v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-05T09:48:38.670 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: fsmap 2023-12-05T09:48:38.670 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: osdmap e1: 0 total, 0 up, 0 in 2023-12-05T09:48:38.671 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:38 smithi100 ceph-mon[107145]: mgrmap e1: no daemons active 2023-12-05T09:48:39.137 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:38.670+0000 7f07bbc43700 1 Processor -- start 2023-12-05T09:48:39.153 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:38.670+0000 7f07bbc43700 1 -- start start 2023-12-05T09:48:39.153 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:38.670+0000 7f07bbc43700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07b41022d0 0x7f07b41026e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:48:39.157 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:38.670+0000 7f07bbc43700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b4102c20 con 0x7f07b41022d0 2023-12-05T09:48:39.158 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:38.671+0000 7f07b99df700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07b41022d0 0x7f07b41026e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:48:39.158 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:38.671+0000 7f07b99df700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07b41022d0 0x7f07b41026e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54172/0 (socket says 172.21.15.100:54172) 2023-12-05T09:48:39.158 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:38.671+0000 7f07b99df700 1 -- 172.21.15.100:0/815484061 learned_addr learned my addr 172.21.15.100:0/815484061 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:48:39.158 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:38.671+0000 7f07b99df700 1 -- 172.21.15.100:0/815484061 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b4102d60 con 0x7f07b41022d0 2023-12-05T09:48:39.158 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:38.671+0000 7f07b99df700 1 --2- 172.21.15.100:0/815484061 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07b41022d0 0x7f07b41026e0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f07b00098e0 tx=0x7f07b0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d66ea6469b159052 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:48:39.158 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:38.672+0000 7f07b89dd700 1 -- 172.21.15.100:0/815484061 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f07b000b860 con 0x7f07b41022d0 2023-12-05T09:48:39.158 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:38.672+0000 7f07b89dd700 1 -- 172.21.15.100:0/815484061 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f07b000be30 con 0x7f07b41022d0 2023-12-05T09:48:39.158 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:38.672+0000 7f07b89dd700 1 -- 172.21.15.100:0/815484061 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f07b0010380 con 0x7f07b41022d0 2023-12-05T09:48:39.158 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:38.672+0000 7f07bbc43700 1 -- 172.21.15.100:0/815484061 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07b41022d0 msgr2=0x7f07b41026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:48:39.158 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:38.672+0000 7f07bbc43700 1 --2- 172.21.15.100:0/815484061 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07b41022d0 0x7f07b41026e0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f07b00098e0 tx=0x7f07b0009250 comp rx=0 tx=0).stop 2023-12-05T09:48:39.158 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:38.672+0000 7f07bbc43700 1 -- 172.21.15.100:0/815484061 shutdown_connections 2023-12-05T09:48:39.158 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:38.672+0000 7f07bbc43700 1 --2- 172.21.15.100:0/815484061 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07b41022d0 0x7f07b41026e0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:48:39.158 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:38.672+0000 7f07bbc43700 1 -- 172.21.15.100:0/815484061 >> 172.21.15.100:0/815484061 conn(0x7f07b40fda50 msgr2=0x7f07b40ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:48:39.159 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:38.672+0000 7f07bbc43700 1 -- 172.21.15.100:0/815484061 shutdown_connections 2023-12-05T09:48:39.159 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:38.672+0000 7f07bbc43700 1 -- 172.21.15.100:0/815484061 wait complete. 2023-12-05T09:48:39.159 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:38.673+0000 7f07bbc43700 1 Processor -- start 2023-12-05T09:48:39.159 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:38.673+0000 7f07bbc43700 1 -- start start 2023-12-05T09:48:39.159 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:38.674+0000 7f07bbc43700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07b41022d0 0x7f07b4077c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:48:39.159 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:38.674+0000 7f07bbc43700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b4076080 con 0x7f07b41022d0 2023-12-05T09:48:39.159 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:38.674+0000 7f07b99df700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07b41022d0 0x7f07b4077c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:48:39.159 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:38.674+0000 7f07b99df700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07b41022d0 0x7f07b4077c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54180/0 (socket says 172.21.15.100:54180) 2023-12-05T09:48:39.159 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:38.674+0000 7f07b99df700 1 -- 172.21.15.100:0/573576594 learned_addr learned my addr 172.21.15.100:0/573576594 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:48:39.159 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:38.674+0000 7f07b99df700 1 -- 172.21.15.100:0/573576594 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b00094f0 con 0x7f07b41022d0 2023-12-05T09:48:39.159 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:38.675+0000 7f07b99df700 1 --2- 172.21.15.100:0/573576594 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07b41022d0 0x7f07b4077c00 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f07b0000c00 tx=0x7f07b0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:48:39.159 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:38.675+0000 7f07aa7fc700 1 -- 172.21.15.100:0/573576594 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f07b0010a80 con 0x7f07b41022d0 2023-12-05T09:48:39.159 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:38.675+0000 7f07aa7fc700 1 -- 172.21.15.100:0/573576594 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f07b001a430 con 0x7f07b41022d0 2023-12-05T09:48:39.159 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:38.675+0000 7f07aa7fc700 1 -- 172.21.15.100:0/573576594 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f07b00245b0 con 0x7f07b41022d0 2023-12-05T09:48:39.160 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:38.675+0000 7f07bbc43700 1 -- 172.21.15.100:0/573576594 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07b4076280 con 0x7f07b41022d0 2023-12-05T09:48:39.160 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:38.675+0000 7f07bbc43700 1 -- 172.21.15.100:0/573576594 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07b4076690 con 0x7f07b41022d0 2023-12-05T09:48:39.160 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:38.675+0000 7f07aa7fc700 1 -- 172.21.15.100:0/573576594 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f07b0024a20 con 0x7f07b41022d0 2023-12-05T09:48:39.160 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:38.675+0000 7f07aa7fc700 1 -- 172.21.15.100:0/573576594 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f07b002eb00 con 0x7f07b41022d0 2023-12-05T09:48:39.160 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:38.676+0000 7f07bbc43700 1 -- 172.21.15.100:0/573576594 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07b404bb80 con 0x7f07b41022d0 2023-12-05T09:48:39.160 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:38.680+0000 7f07aa7fc700 1 -- 172.21.15.100:0/573576594 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f07b001a960 con 0x7f07b41022d0 2023-12-05T09:48:39.160 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:38.749+0000 7f07bbc43700 1 -- 172.21.15.100:0/573576594 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7f07b41040e0 con 0x7f07b41022d0 2023-12-05T09:48:39.160 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:38.754+0000 7f07aa7fc700 1 -- 172.21.15.100:0/573576594 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7f07b002ecc0 con 0x7f07b41022d0 2023-12-05T09:48:39.160 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:38.755+0000 7f07bbc43700 1 -- 172.21.15.100:0/573576594 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07b41022d0 msgr2=0x7f07b4077c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:48:39.160 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:38.755+0000 7f07bbc43700 1 --2- 172.21.15.100:0/573576594 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07b41022d0 0x7f07b4077c00 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f07b0000c00 tx=0x7f07b0009250 comp rx=0 tx=0).stop 2023-12-05T09:48:39.160 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:38.756+0000 7f07bbc43700 1 -- 172.21.15.100:0/573576594 shutdown_connections 2023-12-05T09:48:39.160 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:38.756+0000 7f07bbc43700 1 --2- 172.21.15.100:0/573576594 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07b41022d0 0x7f07b4077c00 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:48:39.160 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:38.756+0000 7f07bbc43700 1 -- 172.21.15.100:0/573576594 >> 172.21.15.100:0/573576594 conn(0x7f07b40fda50 msgr2=0x7f07b40ff250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:48:39.160 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:38.756+0000 7f07bbc43700 1 -- 172.21.15.100:0/573576594 shutdown_connections 2023-12-05T09:48:39.160 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:38.756+0000 7f07bbc43700 1 -- 172.21.15.100:0/573576594 wait complete. 2023-12-05T09:48:39.161 INFO:teuthology.orchestra.run.smithi100.stdout:Wrote config to /etc/ceph/ceph.conf 2023-12-05T09:48:39.161 INFO:teuthology.orchestra.run.smithi100.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2023-12-05T09:48:39.161 INFO:teuthology.orchestra.run.smithi100.stdout:Creating mgr... 2023-12-05T09:48:39.161 INFO:teuthology.orchestra.run.smithi100.stdout:Verifying port 9283 ... 2023-12-05T09:48:39.433 INFO:teuthology.orchestra.run.smithi100.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-5b035ce6-9353-11ee-95a2-87774f69a715@mgr.smithi100.ehmuhg 2023-12-05T09:48:39.433 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stderr Failed to reset failed state of unit ceph-5b035ce6-9353-11ee-95a2-87774f69a715@mgr.smithi100.ehmuhg.service: Unit ceph-5b035ce6-9353-11ee-95a2-87774f69a715@mgr.smithi100.ehmuhg.service not loaded. 2023-12-05T09:48:39.634 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-5b035ce6-9353-11ee-95a2-87774f69a715.target.wants/ceph-5b035ce6-9353-11ee-95a2-87774f69a715@mgr.smithi100.ehmuhg.service → /etc/systemd/system/ceph-5b035ce6-9353-11ee-95a2-87774f69a715@.service. 2023-12-05T09:48:40.073 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:39 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/573576594' entity='client.admin' 2023-12-05T09:48:40.225 INFO:teuthology.orchestra.run.smithi100.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-12-05T09:48:40.225 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stdout disabled 2023-12-05T09:48:40.243 INFO:teuthology.orchestra.run.smithi100.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-12-05T09:48:40.243 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stdout inactive 2023-12-05T09:48:40.243 INFO:teuthology.orchestra.run.smithi100.stdout:firewalld.service is not enabled 2023-12-05T09:48:40.243 INFO:teuthology.orchestra.run.smithi100.stdout:Not possible to enable service . firewalld.service is not available 2023-12-05T09:48:40.261 INFO:teuthology.orchestra.run.smithi100.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-12-05T09:48:40.261 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stdout disabled 2023-12-05T09:48:40.279 INFO:teuthology.orchestra.run.smithi100.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-12-05T09:48:40.279 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stdout inactive 2023-12-05T09:48:40.279 INFO:teuthology.orchestra.run.smithi100.stdout:firewalld.service is not enabled 2023-12-05T09:48:40.280 INFO:teuthology.orchestra.run.smithi100.stdout:Not possible to open ports <[9283]>. firewalld.service is not available 2023-12-05T09:48:40.280 INFO:teuthology.orchestra.run.smithi100.stdout:Waiting for mgr to start... 2023-12-05T09:48:40.280 INFO:teuthology.orchestra.run.smithi100.stdout:Waiting for mgr... 2023-12-05T09:48:41.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:40 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/2778691732' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-05T09:48:42.450 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 2023-12-05T09:48:42.450 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout { 2023-12-05T09:48:42.450 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "fsid": "5b035ce6-9353-11ee-95a2-87774f69a715", 2023-12-05T09:48:42.450 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "health": { 2023-12-05T09:48:42.450 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-05T09:48:42.450 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-05T09:48:42.451 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-05T09:48:42.451 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2023-12-05T09:48:42.451 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-05T09:48:42.451 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-05T09:48:42.451 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 0 2023-12-05T09:48:42.451 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout ], 2023-12-05T09:48:42.451 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-05T09:48:42.451 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "smithi100" 2023-12-05T09:48:42.451 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout ], 2023-12-05T09:48:42.451 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2023-12-05T09:48:42.451 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-05T09:48:42.451 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-05T09:48:42.451 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2023-12-05T09:48:42.451 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-05T09:48:42.452 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2023-12-05T09:48:42.452 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-05T09:48:42.452 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-05T09:48:42.452 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-05T09:48:42.452 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-05T09:48:42.452 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-05T09:48:42.452 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-05T09:48:42.452 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-05T09:48:42.452 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-05T09:48:42.452 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2023-12-05T09:48:42.452 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-05T09:48:42.452 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-05T09:48:42.452 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-05T09:48:42.452 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-05T09:48:42.452 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-05T09:48:42.453 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-05T09:48:42.453 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-05T09:48:42.453 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-05T09:48:42.453 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-05T09:48:42.453 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2023-12-05T09:48:42.453 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-05T09:48:42.453 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-05T09:48:42.453 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-05T09:48:42.453 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-05T09:48:42.453 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2023-12-05T09:48:42.453 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-05T09:48:42.453 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "available": false, 2023-12-05T09:48:42.453 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-05T09:48:42.453 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-05T09:48:42.453 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-05T09:48:42.454 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-05T09:48:42.454 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "restful" 2023-12-05T09:48:42.454 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout ], 2023-12-05T09:48:42.454 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-05T09:48:42.454 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2023-12-05T09:48:42.454 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-05T09:48:42.454 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-05T09:48:42.454 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "modified": "2023-12-05T09:48:33.719283+0000", 2023-12-05T09:48:42.454 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-05T09:48:42.454 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2023-12-05T09:48:42.454 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-05T09:48:42.454 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout } 2023-12-05T09:48:42.454 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:40.714+0000 7f7ab375c700 1 Processor -- start 2023-12-05T09:48:42.454 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:40.715+0000 7f7ab375c700 1 -- start start 2023-12-05T09:48:42.454 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:40.715+0000 7f7ab375c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7aac077b90 0x7f7aac0760a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:48:42.455 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:40.715+0000 7f7ab375c700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aac077fa0 con 0x7f7aac077b90 2023-12-05T09:48:42.455 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:40.715+0000 7f7ab14f8700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7aac077b90 0x7f7aac0760a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:48:42.455 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:40.716+0000 7f7ab14f8700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7aac077b90 0x7f7aac0760a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59506/0 (socket says 172.21.15.100:59506) 2023-12-05T09:48:42.455 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:40.716+0000 7f7ab14f8700 1 -- 172.21.15.100:0/733314201 learned_addr learned my addr 172.21.15.100:0/733314201 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:48:42.455 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:40.716+0000 7f7ab14f8700 1 -- 172.21.15.100:0/733314201 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aac0765e0 con 0x7f7aac077b90 2023-12-05T09:48:42.455 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:40.716+0000 7f7ab14f8700 1 --2- 172.21.15.100:0/733314201 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7aac077b90 0x7f7aac0760a0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f7aa80098e0 tx=0x7f7aa8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a2d976765aa241c server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:48:42.455 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:40.716+0000 7f7aa3fff700 1 -- 172.21.15.100:0/733314201 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7aa800b860 con 0x7f7aac077b90 2023-12-05T09:48:42.455 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:40.716+0000 7f7aa3fff700 1 -- 172.21.15.100:0/733314201 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f7aa800be30 con 0x7f7aac077b90 2023-12-05T09:48:42.455 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:40.716+0000 7f7aa3fff700 1 -- 172.21.15.100:0/733314201 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7aa8010380 con 0x7f7aac077b90 2023-12-05T09:48:42.455 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:40.717+0000 7f7ab375c700 1 -- 172.21.15.100:0/733314201 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7aac077b90 msgr2=0x7f7aac0760a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:48:42.455 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:40.717+0000 7f7ab375c700 1 --2- 172.21.15.100:0/733314201 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7aac077b90 0x7f7aac0760a0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f7aa80098e0 tx=0x7f7aa8009250 comp rx=0 tx=0).stop 2023-12-05T09:48:42.455 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:40.717+0000 7f7ab375c700 1 -- 172.21.15.100:0/733314201 shutdown_connections 2023-12-05T09:48:42.455 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:40.717+0000 7f7ab375c700 1 --2- 172.21.15.100:0/733314201 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7aac077b90 0x7f7aac0760a0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:48:42.456 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:40.717+0000 7f7ab375c700 1 -- 172.21.15.100:0/733314201 >> 172.21.15.100:0/733314201 conn(0x7f7aac0fda50 msgr2=0x7f7aac0ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:48:42.456 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:40.717+0000 7f7ab375c700 1 -- 172.21.15.100:0/733314201 shutdown_connections 2023-12-05T09:48:42.456 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:40.717+0000 7f7ab375c700 1 -- 172.21.15.100:0/733314201 wait complete. 2023-12-05T09:48:42.456 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:40.718+0000 7f7ab375c700 1 Processor -- start 2023-12-05T09:48:42.456 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:40.718+0000 7f7ab375c700 1 -- start start 2023-12-05T09:48:42.456 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:40.718+0000 7f7ab375c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7aac077b90 0x7f7aac113380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:48:42.456 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:40.718+0000 7f7ab375c700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aac1138c0 con 0x7f7aac077b90 2023-12-05T09:48:42.456 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:40.719+0000 7f7ab14f8700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7aac077b90 0x7f7aac113380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:48:42.456 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:40.719+0000 7f7ab14f8700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7aac077b90 0x7f7aac113380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59512/0 (socket says 172.21.15.100:59512) 2023-12-05T09:48:42.456 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:40.719+0000 7f7ab14f8700 1 -- 172.21.15.100:0/2778691732 learned_addr learned my addr 172.21.15.100:0/2778691732 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:48:42.456 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:40.719+0000 7f7ab14f8700 1 -- 172.21.15.100:0/2778691732 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa80094f0 con 0x7f7aac077b90 2023-12-05T09:48:42.456 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:40.719+0000 7f7ab14f8700 1 --2- 172.21.15.100:0/2778691732 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7aac077b90 0x7f7aac113380 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7aa8006b00 tx=0x7f7aa8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:48:42.456 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:40.719+0000 7f7aa1ffb700 1 -- 172.21.15.100:0/2778691732 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7aa8010a80 con 0x7f7aac077b90 2023-12-05T09:48:42.456 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:40.719+0000 7f7aa1ffb700 1 -- 172.21.15.100:0/2778691732 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f7aa801a430 con 0x7f7aac077b90 2023-12-05T09:48:42.456 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:40.719+0000 7f7ab375c700 1 -- 172.21.15.100:0/2778691732 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7aac113ac0 con 0x7f7aac077b90 2023-12-05T09:48:42.457 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:40.720+0000 7f7aa1ffb700 1 -- 172.21.15.100:0/2778691732 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7aa80245b0 con 0x7f7aac077b90 2023-12-05T09:48:42.457 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:40.720+0000 7f7ab375c700 1 -- 172.21.15.100:0/2778691732 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7aac113ed0 con 0x7f7aac077b90 2023-12-05T09:48:42.457 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:40.720+0000 7f7aa1ffb700 1 -- 172.21.15.100:0/2778691732 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f7aa8024a60 con 0x7f7aac077b90 2023-12-05T09:48:42.457 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:40.720+0000 7f7aa1ffb700 1 -- 172.21.15.100:0/2778691732 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f7aa802ec20 con 0x7f7aac077b90 2023-12-05T09:48:42.457 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:40.721+0000 7f7ab375c700 1 -- 172.21.15.100:0/2778691732 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7aac04bb80 con 0x7f7aac077b90 2023-12-05T09:48:42.457 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:40.723+0000 7f7aa1ffb700 1 -- 172.21.15.100:0/2778691732 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f7aa802ede0 con 0x7f7aac077b90 2023-12-05T09:48:42.457 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:40.797+0000 7f7ab375c700 1 -- 172.21.15.100:0/2778691732 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f7aac10cd60 con 0x7f7aac077b90 2023-12-05T09:48:42.457 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:40.798+0000 7f7aa1ffb700 1 -- 172.21.15.100:0/2778691732 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f7aa8010be0 con 0x7f7aac077b90 2023-12-05T09:48:42.457 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:40.799+0000 7f7ab375c700 1 -- 172.21.15.100:0/2778691732 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7aac077b90 msgr2=0x7f7aac113380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:48:42.457 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:40.799+0000 7f7ab375c700 1 --2- 172.21.15.100:0/2778691732 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7aac077b90 0x7f7aac113380 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7aa8006b00 tx=0x7f7aa8009250 comp rx=0 tx=0).stop 2023-12-05T09:48:42.457 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:40.799+0000 7f7ab375c700 1 -- 172.21.15.100:0/2778691732 shutdown_connections 2023-12-05T09:48:42.457 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:40.799+0000 7f7ab375c700 1 --2- 172.21.15.100:0/2778691732 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7aac077b90 0x7f7aac113380 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:48:42.457 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:40.799+0000 7f7ab375c700 1 -- 172.21.15.100:0/2778691732 >> 172.21.15.100:0/2778691732 conn(0x7f7aac0fda50 msgr2=0x7f7aac0ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:48:42.457 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:40.799+0000 7f7ab375c700 1 -- 172.21.15.100:0/2778691732 shutdown_connections 2023-12-05T09:48:42.458 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:40.799+0000 7f7ab375c700 1 -- 172.21.15.100:0/2778691732 wait complete. 2023-12-05T09:48:42.458 INFO:teuthology.orchestra.run.smithi100.stdout:mgr not available, waiting (1/15)... 2023-12-05T09:48:45.302 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 2023-12-05T09:48:45.302 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:45 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/3076040087' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-05T09:48:45.312 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout { 2023-12-05T09:48:45.312 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "fsid": "5b035ce6-9353-11ee-95a2-87774f69a715", 2023-12-05T09:48:45.313 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "health": { 2023-12-05T09:48:45.313 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-05T09:48:45.313 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-05T09:48:45.313 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-05T09:48:45.313 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2023-12-05T09:48:45.313 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-05T09:48:45.313 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-05T09:48:45.313 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 0 2023-12-05T09:48:45.313 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout ], 2023-12-05T09:48:45.313 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-05T09:48:45.313 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "smithi100" 2023-12-05T09:48:45.313 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout ], 2023-12-05T09:48:45.313 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2023-12-05T09:48:45.313 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-05T09:48:45.314 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-05T09:48:45.314 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2023-12-05T09:48:45.314 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-05T09:48:45.314 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2023-12-05T09:48:45.314 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-05T09:48:45.314 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-05T09:48:45.314 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-05T09:48:45.314 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-05T09:48:45.314 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-05T09:48:45.314 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-05T09:48:45.314 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-05T09:48:45.314 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-05T09:48:45.315 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2023-12-05T09:48:45.315 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-05T09:48:45.315 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-05T09:48:45.315 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-05T09:48:45.315 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-05T09:48:45.315 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-05T09:48:45.315 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-05T09:48:45.315 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-05T09:48:45.315 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-05T09:48:45.315 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-05T09:48:45.315 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2023-12-05T09:48:45.315 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-05T09:48:45.315 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-05T09:48:45.315 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-05T09:48:45.316 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-05T09:48:45.316 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2023-12-05T09:48:45.316 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-05T09:48:45.316 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "available": false, 2023-12-05T09:48:45.316 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-05T09:48:45.316 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-05T09:48:45.316 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-05T09:48:45.316 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-05T09:48:45.316 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "restful" 2023-12-05T09:48:45.316 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout ], 2023-12-05T09:48:45.316 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-05T09:48:45.316 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2023-12-05T09:48:45.316 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-05T09:48:45.316 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-05T09:48:45.316 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "modified": "2023-12-05T09:48:33.719283+0000", 2023-12-05T09:48:45.317 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-05T09:48:45.317 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2023-12-05T09:48:45.317 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-05T09:48:45.317 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout } 2023-12-05T09:48:45.317 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:44.876+0000 7f82345c3700 1 Processor -- start 2023-12-05T09:48:45.317 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:44.876+0000 7f82345c3700 1 -- start start 2023-12-05T09:48:45.317 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:44.876+0000 7f82345c3700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f822c070fa0 0x7f822c107300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:48:45.317 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:44.876+0000 7f82345c3700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f822c102cf0 con 0x7f822c070fa0 2023-12-05T09:48:45.317 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:44.876+0000 7f823235f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f822c070fa0 0x7f822c107300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:48:45.317 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:44.877+0000 7f823235f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f822c070fa0 0x7f822c107300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59526/0 (socket says 172.21.15.100:59526) 2023-12-05T09:48:45.317 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:44.877+0000 7f823235f700 1 -- 172.21.15.100:0/1219552890 learned_addr learned my addr 172.21.15.100:0/1219552890 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:48:45.317 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:44.877+0000 7f823235f700 1 -- 172.21.15.100:0/1219552890 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f822c107840 con 0x7f822c070fa0 2023-12-05T09:48:45.317 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:44.877+0000 7f823235f700 1 --2- 172.21.15.100:0/1219552890 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f822c070fa0 0x7f822c107300 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f82280098e0 tx=0x7f8228009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=138d489472fb4e22 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:48:45.317 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:44.877+0000 7f823135d700 1 -- 172.21.15.100:0/1219552890 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f822800b860 con 0x7f822c070fa0 2023-12-05T09:48:45.317 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:44.878+0000 7f823135d700 1 -- 172.21.15.100:0/1219552890 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f822800be30 con 0x7f822c070fa0 2023-12-05T09:48:45.318 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:44.878+0000 7f823135d700 1 -- 172.21.15.100:0/1219552890 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8228010380 con 0x7f822c070fa0 2023-12-05T09:48:45.318 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:44.878+0000 7f82345c3700 1 -- 172.21.15.100:0/1219552890 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f822c070fa0 msgr2=0x7f822c107300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:48:45.318 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:44.878+0000 7f82345c3700 1 --2- 172.21.15.100:0/1219552890 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f822c070fa0 0x7f822c107300 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f82280098e0 tx=0x7f8228009250 comp rx=0 tx=0).stop 2023-12-05T09:48:45.318 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:44.878+0000 7f82345c3700 1 -- 172.21.15.100:0/1219552890 shutdown_connections 2023-12-05T09:48:45.318 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:44.878+0000 7f82345c3700 1 --2- 172.21.15.100:0/1219552890 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f822c070fa0 0x7f822c107300 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:48:45.318 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:44.878+0000 7f82345c3700 1 -- 172.21.15.100:0/1219552890 >> 172.21.15.100:0/1219552890 conn(0x7f822c0fc970 msgr2=0x7f822c0fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:48:45.319 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:44.879+0000 7f82345c3700 1 -- 172.21.15.100:0/1219552890 shutdown_connections 2023-12-05T09:48:45.319 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:44.879+0000 7f82345c3700 1 -- 172.21.15.100:0/1219552890 wait complete. 2023-12-05T09:48:45.319 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:44.880+0000 7f82345c3700 1 Processor -- start 2023-12-05T09:48:45.319 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:44.880+0000 7f82345c3700 1 -- start start 2023-12-05T09:48:45.319 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:44.880+0000 7f82345c3700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f822c070fa0 0x7f822c113380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:48:45.319 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:44.880+0000 7f82345c3700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f822c1138c0 con 0x7f822c070fa0 2023-12-05T09:48:45.319 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:44.881+0000 7f823235f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f822c070fa0 0x7f822c113380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:48:45.319 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:44.881+0000 7f823235f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f822c070fa0 0x7f822c113380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59542/0 (socket says 172.21.15.100:59542) 2023-12-05T09:48:45.319 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:44.881+0000 7f823235f700 1 -- 172.21.15.100:0/3076040087 learned_addr learned my addr 172.21.15.100:0/3076040087 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:48:45.319 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:44.881+0000 7f823235f700 1 -- 172.21.15.100:0/3076040087 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82280094f0 con 0x7f822c070fa0 2023-12-05T09:48:45.319 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:44.881+0000 7f823235f700 1 --2- 172.21.15.100:0/3076040087 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f822c070fa0 0x7f822c113380 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8228006b00 tx=0x7f8228009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:48:45.319 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:44.881+0000 7f8222ffd700 1 -- 172.21.15.100:0/3076040087 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8228010a80 con 0x7f822c070fa0 2023-12-05T09:48:45.319 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:44.882+0000 7f8222ffd700 1 -- 172.21.15.100:0/3076040087 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f822801a430 con 0x7f822c070fa0 2023-12-05T09:48:45.319 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:44.882+0000 7f82345c3700 1 -- 172.21.15.100:0/3076040087 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f822c113ac0 con 0x7f822c070fa0 2023-12-05T09:48:45.320 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:44.882+0000 7f8222ffd700 1 -- 172.21.15.100:0/3076040087 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f82280245b0 con 0x7f822c070fa0 2023-12-05T09:48:45.320 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:44.882+0000 7f82345c3700 1 -- 172.21.15.100:0/3076040087 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f822c113ed0 con 0x7f822c070fa0 2023-12-05T09:48:45.320 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:44.882+0000 7f8222ffd700 1 -- 172.21.15.100:0/3076040087 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f8228024a60 con 0x7f822c070fa0 2023-12-05T09:48:45.320 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:44.882+0000 7f8222ffd700 1 -- 172.21.15.100:0/3076040087 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f822802eaa0 con 0x7f822c070fa0 2023-12-05T09:48:45.320 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:44.883+0000 7f82345c3700 1 -- 172.21.15.100:0/3076040087 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f822c04bb80 con 0x7f822c070fa0 2023-12-05T09:48:45.320 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:44.886+0000 7f8222ffd700 1 -- 172.21.15.100:0/3076040087 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f822802ec60 con 0x7f822c070fa0 2023-12-05T09:48:45.320 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:44.961+0000 7f82345c3700 1 -- 172.21.15.100:0/3076040087 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f822c108500 con 0x7f822c070fa0 2023-12-05T09:48:45.320 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:44.961+0000 7f8222ffd700 1 -- 172.21.15.100:0/3076040087 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f822c108500 con 0x7f822c070fa0 2023-12-05T09:48:45.320 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:44.962+0000 7f82345c3700 1 -- 172.21.15.100:0/3076040087 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f822c070fa0 msgr2=0x7f822c113380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:48:45.320 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:44.962+0000 7f82345c3700 1 --2- 172.21.15.100:0/3076040087 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f822c070fa0 0x7f822c113380 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8228006b00 tx=0x7f8228009250 comp rx=0 tx=0).stop 2023-12-05T09:48:45.320 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:44.962+0000 7f82345c3700 1 -- 172.21.15.100:0/3076040087 shutdown_connections 2023-12-05T09:48:45.320 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:44.962+0000 7f82345c3700 1 --2- 172.21.15.100:0/3076040087 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f822c070fa0 0x7f822c113380 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:48:45.320 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:44.962+0000 7f82345c3700 1 -- 172.21.15.100:0/3076040087 >> 172.21.15.100:0/3076040087 conn(0x7f822c0fc970 msgr2=0x7f822c0fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:48:45.321 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:44.962+0000 7f82345c3700 1 -- 172.21.15.100:0/3076040087 shutdown_connections 2023-12-05T09:48:45.321 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:44.962+0000 7f82345c3700 1 -- 172.21.15.100:0/3076040087 wait complete. 2023-12-05T09:48:45.321 INFO:teuthology.orchestra.run.smithi100.stdout:mgr not available, waiting (2/15)... 2023-12-05T09:48:49.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:49 smithi100 ceph-mon[107145]: Activating manager daemon smithi100.ehmuhg 2023-12-05T09:48:49.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:49 smithi100 ceph-mon[107145]: mgrmap e2: smithi100.ehmuhg(active, starting, since 0.0039551s) 2023-12-05T09:48:49.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:49 smithi100 ceph-mon[107145]: from='mgr.14100 172.21.15.100:0/1188439742' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-05T09:48:49.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:49 smithi100 ceph-mon[107145]: from='mgr.14100 172.21.15.100:0/1188439742' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-05T09:48:49.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:49 smithi100 ceph-mon[107145]: from='mgr.14100 172.21.15.100:0/1188439742' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-05T09:48:49.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:49 smithi100 ceph-mon[107145]: from='mgr.14100 172.21.15.100:0/1188439742' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mon metadata", "id": "smithi100"}]: dispatch 2023-12-05T09:48:49.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:49 smithi100 ceph-mon[107145]: from='mgr.14100 172.21.15.100:0/1188439742' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mgr metadata", "who": "smithi100.ehmuhg", "id": "smithi100.ehmuhg"}]: dispatch 2023-12-05T09:48:49.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:49 smithi100 ceph-mon[107145]: Manager daemon smithi100.ehmuhg is now available 2023-12-05T09:48:49.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:49 smithi100 ceph-mon[107145]: from='mgr.14100 172.21.15.100:0/1188439742' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi100.ehmuhg/mirror_snapshot_schedule"}]: dispatch 2023-12-05T09:48:49.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:49 smithi100 ceph-mon[107145]: from='mgr.14100 172.21.15.100:0/1188439742' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:48:49.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:49 smithi100 ceph-mon[107145]: from='mgr.14100 172.21.15.100:0/1188439742' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi100.ehmuhg/trash_purge_schedule"}]: dispatch 2023-12-05T09:48:49.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:49 smithi100 ceph-mon[107145]: from='mgr.14100 172.21.15.100:0/1188439742' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:48:49.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:49 smithi100 ceph-mon[107145]: from='mgr.14100 172.21.15.100:0/1188439742' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:48:50.281 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 2023-12-05T09:48:50.281 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout { 2023-12-05T09:48:50.281 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "fsid": "5b035ce6-9353-11ee-95a2-87774f69a715", 2023-12-05T09:48:50.281 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "health": { 2023-12-05T09:48:50.281 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-05T09:48:50.281 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-05T09:48:50.282 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-05T09:48:50.282 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2023-12-05T09:48:50.282 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-05T09:48:50.282 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-05T09:48:50.282 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 0 2023-12-05T09:48:50.282 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout ], 2023-12-05T09:48:50.282 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-05T09:48:50.282 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "smithi100" 2023-12-05T09:48:50.282 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout ], 2023-12-05T09:48:50.282 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "quorum_age": 11, 2023-12-05T09:48:50.282 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-05T09:48:50.282 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-05T09:48:50.282 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2023-12-05T09:48:50.282 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-05T09:48:50.283 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2023-12-05T09:48:50.283 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-05T09:48:50.283 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-05T09:48:50.283 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-05T09:48:50.283 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-05T09:48:50.283 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-05T09:48:50.292 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-05T09:48:50.292 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-05T09:48:50.292 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-05T09:48:50.292 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2023-12-05T09:48:50.292 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-05T09:48:50.292 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-05T09:48:50.292 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-05T09:48:50.292 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-05T09:48:50.292 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-05T09:48:50.293 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-05T09:48:50.293 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-05T09:48:50.293 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-05T09:48:50.293 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-05T09:48:50.293 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2023-12-05T09:48:50.293 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-05T09:48:50.293 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-05T09:48:50.293 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-05T09:48:50.293 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-05T09:48:50.293 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2023-12-05T09:48:50.293 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-05T09:48:50.293 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "available": true, 2023-12-05T09:48:50.293 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-05T09:48:50.294 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-05T09:48:50.294 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-05T09:48:50.294 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-05T09:48:50.294 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "restful" 2023-12-05T09:48:50.294 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout ], 2023-12-05T09:48:50.294 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-05T09:48:50.294 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2023-12-05T09:48:50.294 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-05T09:48:50.294 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-05T09:48:50.294 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "modified": "2023-12-05T09:48:33.719283+0000", 2023-12-05T09:48:50.295 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-05T09:48:50.295 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2023-12-05T09:48:50.295 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-05T09:48:50.295 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout } 2023-12-05T09:48:50.295 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:49.655+0000 7fc58912f700 1 Processor -- start 2023-12-05T09:48:50.295 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:49.655+0000 7fc58912f700 1 -- start start 2023-12-05T09:48:50.295 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:49.655+0000 7fc58912f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc584077bb0 0x7fc5840760c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:48:50.295 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:49.655+0000 7fc58912f700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc584077fc0 con 0x7fc584077bb0 2023-12-05T09:48:50.295 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:49.655+0000 7fc582d9d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc584077bb0 0x7fc5840760c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:48:50.295 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:49.656+0000 7fc582d9d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc584077bb0 0x7fc5840760c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59612/0 (socket says 172.21.15.100:59612) 2023-12-05T09:48:50.295 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:49.656+0000 7fc582d9d700 1 -- 172.21.15.100:0/1506571205 learned_addr learned my addr 172.21.15.100:0/1506571205 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:48:50.295 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:49.656+0000 7fc582d9d700 1 -- 172.21.15.100:0/1506571205 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc584076600 con 0x7fc584077bb0 2023-12-05T09:48:50.296 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:49.656+0000 7fc582d9d700 1 --2- 172.21.15.100:0/1506571205 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc584077bb0 0x7fc5840760c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc5740098e0 tx=0x7fc574009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7584875f4996c0e5 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:48:50.296 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:49.656+0000 7fc581d9b700 1 -- 172.21.15.100:0/1506571205 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc57400b860 con 0x7fc584077bb0 2023-12-05T09:48:50.296 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:49.656+0000 7fc581d9b700 1 -- 172.21.15.100:0/1506571205 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fc57400be30 con 0x7fc584077bb0 2023-12-05T09:48:50.296 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:49.656+0000 7fc581d9b700 1 -- 172.21.15.100:0/1506571205 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc574010380 con 0x7fc584077bb0 2023-12-05T09:48:50.296 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:49.657+0000 7fc58912f700 1 -- 172.21.15.100:0/1506571205 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc584077bb0 msgr2=0x7fc5840760c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:48:50.296 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:49.657+0000 7fc58912f700 1 --2- 172.21.15.100:0/1506571205 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc584077bb0 0x7fc5840760c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc5740098e0 tx=0x7fc574009250 comp rx=0 tx=0).stop 2023-12-05T09:48:50.296 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:49.657+0000 7fc58912f700 1 -- 172.21.15.100:0/1506571205 shutdown_connections 2023-12-05T09:48:50.296 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:49.657+0000 7fc58912f700 1 --2- 172.21.15.100:0/1506571205 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc584077bb0 0x7fc5840760c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:48:50.296 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:49.657+0000 7fc58912f700 1 -- 172.21.15.100:0/1506571205 >> 172.21.15.100:0/1506571205 conn(0x7fc5840fda50 msgr2=0x7fc5840ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:48:50.296 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:49.657+0000 7fc58912f700 1 -- 172.21.15.100:0/1506571205 shutdown_connections 2023-12-05T09:48:50.296 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:49.657+0000 7fc58912f700 1 -- 172.21.15.100:0/1506571205 wait complete. 2023-12-05T09:48:50.297 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:49.658+0000 7fc58912f700 1 Processor -- start 2023-12-05T09:48:50.297 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:49.658+0000 7fc58912f700 1 -- start start 2023-12-05T09:48:50.297 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:49.658+0000 7fc58912f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc584077bb0 0x7fc5841133d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:48:50.297 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:49.658+0000 7fc58912f700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc584113910 con 0x7fc584077bb0 2023-12-05T09:48:50.297 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:49.659+0000 7fc582d9d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc584077bb0 0x7fc5841133d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:48:50.297 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:49.659+0000 7fc582d9d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc584077bb0 0x7fc5841133d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59622/0 (socket says 172.21.15.100:59622) 2023-12-05T09:48:50.297 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:49.659+0000 7fc582d9d700 1 -- 172.21.15.100:0/3214715353 learned_addr learned my addr 172.21.15.100:0/3214715353 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:48:50.297 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:49.659+0000 7fc582d9d700 1 -- 172.21.15.100:0/3214715353 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5740094f0 con 0x7fc584077bb0 2023-12-05T09:48:50.297 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:49.659+0000 7fc582d9d700 1 --2- 172.21.15.100:0/3214715353 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc584077bb0 0x7fc5841133d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc574006fd0 tx=0x7fc574009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:48:50.297 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:49.659+0000 7fc56b7fe700 1 -- 172.21.15.100:0/3214715353 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc574010750 con 0x7fc584077bb0 2023-12-05T09:48:50.297 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:49.659+0000 7fc56b7fe700 1 -- 172.21.15.100:0/3214715353 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fc574010d20 con 0x7fc584077bb0 2023-12-05T09:48:50.297 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:49.659+0000 7fc56b7fe700 1 -- 172.21.15.100:0/3214715353 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc57401ada0 con 0x7fc584077bb0 2023-12-05T09:48:50.298 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:49.659+0000 7fc58912f700 1 -- 172.21.15.100:0/3214715353 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc584113b10 con 0x7fc584077bb0 2023-12-05T09:48:50.298 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:49.660+0000 7fc58912f700 1 -- 172.21.15.100:0/3214715353 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc584113f20 con 0x7fc584077bb0 2023-12-05T09:48:50.298 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:49.661+0000 7fc58912f700 1 -- 172.21.15.100:0/3214715353 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc58404bb80 con 0x7fc584077bb0 2023-12-05T09:48:50.298 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:49.661+0000 7fc56b7fe700 1 -- 172.21.15.100:0/3214715353 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 3) v1 ==== 43164+0+0 (secure 0 0 0) 0x7fc5740108b0 con 0x7fc584077bb0 2023-12-05T09:48:50.298 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:49.661+0000 7fc56b7fe700 1 --2- 172.21.15.100:0/3214715353 >> [v2:172.21.15.100:6800/3606837497,v1:172.21.15.100:6801/3606837497] conn(0x7fc56c0364c0 0x7fc56c038970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:48:50.298 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:49.661+0000 7fc56b7fe700 1 -- 172.21.15.100:0/3214715353 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fc5740498a0 con 0x7fc584077bb0 2023-12-05T09:48:50.298 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:49.661+0000 7fc58259c700 1 --2- 172.21.15.100:0/3214715353 >> [v2:172.21.15.100:6800/3606837497,v1:172.21.15.100:6801/3606837497] conn(0x7fc56c0364c0 0x7fc56c038970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:48:50.298 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:49.662+0000 7fc58259c700 1 --2- 172.21.15.100:0/3214715353 >> [v2:172.21.15.100:6800/3606837497,v1:172.21.15.100:6801/3606837497] conn(0x7fc56c0364c0 0x7fc56c038970 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc578009990 tx=0x7fc578006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:48:50.298 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:49.667+0000 7fc56b7fe700 1 -- 172.21.15.100:0/3214715353 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fc574010b60 con 0x7fc584077bb0 2023-12-05T09:48:50.298 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:49.934+0000 7fc58912f700 1 -- 172.21.15.100:0/3214715353 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fc58410d190 con 0x7fc584077bb0 2023-12-05T09:48:50.298 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:49.935+0000 7fc56b7fe700 1 -- 172.21.15.100:0/3214715353 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7fc574020030 con 0x7fc584077bb0 2023-12-05T09:48:50.299 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:49.937+0000 7fc58912f700 1 -- 172.21.15.100:0/3214715353 >> [v2:172.21.15.100:6800/3606837497,v1:172.21.15.100:6801/3606837497] conn(0x7fc56c0364c0 msgr2=0x7fc56c038970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:48:50.299 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:49.937+0000 7fc58912f700 1 --2- 172.21.15.100:0/3214715353 >> [v2:172.21.15.100:6800/3606837497,v1:172.21.15.100:6801/3606837497] conn(0x7fc56c0364c0 0x7fc56c038970 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc578009990 tx=0x7fc578006e40 comp rx=0 tx=0).stop 2023-12-05T09:48:50.299 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:49.937+0000 7fc58912f700 1 -- 172.21.15.100:0/3214715353 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc584077bb0 msgr2=0x7fc5841133d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:48:50.299 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:49.937+0000 7fc58912f700 1 --2- 172.21.15.100:0/3214715353 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc584077bb0 0x7fc5841133d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc574006fd0 tx=0x7fc574009250 comp rx=0 tx=0).stop 2023-12-05T09:48:50.299 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:49.937+0000 7fc58912f700 1 -- 172.21.15.100:0/3214715353 shutdown_connections 2023-12-05T09:48:50.299 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:49.937+0000 7fc58912f700 1 --2- 172.21.15.100:0/3214715353 >> [v2:172.21.15.100:6800/3606837497,v1:172.21.15.100:6801/3606837497] conn(0x7fc56c0364c0 0x7fc56c038970 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:48:50.299 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:49.937+0000 7fc58912f700 1 --2- 172.21.15.100:0/3214715353 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc584077bb0 0x7fc5841133d0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:48:50.299 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:49.937+0000 7fc58912f700 1 -- 172.21.15.100:0/3214715353 >> 172.21.15.100:0/3214715353 conn(0x7fc5840fda50 msgr2=0x7fc5840ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:48:50.299 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:49.937+0000 7fc58912f700 1 -- 172.21.15.100:0/3214715353 shutdown_connections 2023-12-05T09:48:50.299 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:49.937+0000 7fc58912f700 1 -- 172.21.15.100:0/3214715353 wait complete. 2023-12-05T09:48:50.299 INFO:teuthology.orchestra.run.smithi100.stdout:mgr is available 2023-12-05T09:48:50.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:50 smithi100 ceph-mon[107145]: mgrmap e3: smithi100.ehmuhg(active, since 1.00983s) 2023-12-05T09:48:50.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:50 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/3214715353' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-05T09:48:51.282 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 2023-12-05T09:48:51.282 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout [global] 2023-12-05T09:48:51.282 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout fsid = 5b035ce6-9353-11ee-95a2-87774f69a715 2023-12-05T09:48:51.282 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-12-05T09:48:51.282 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-12-05T09:48:51.282 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-12-05T09:48:51.282 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-12-05T09:48:51.282 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 2023-12-05T09:48:51.283 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout [mgr] 2023-12-05T09:48:51.283 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-12-05T09:48:51.283 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 2023-12-05T09:48:51.283 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout [osd] 2023-12-05T09:48:51.283 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-12-05T09:48:51.283 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-12-05T09:48:51.283 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-12-05T09:48:51.283 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-12-05T09:48:51.283 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-12-05T09:48:51.283 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:50.686+0000 7f32674a4700 1 Processor -- start 2023-12-05T09:48:51.283 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:50.686+0000 7f32674a4700 1 -- start start 2023-12-05T09:48:51.283 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:50.686+0000 7f32674a4700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3260077bb0 0x7f32600760c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:48:51.284 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:50.686+0000 7f32674a4700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3260077fc0 con 0x7f3260077bb0 2023-12-05T09:48:51.284 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:50.687+0000 7f3265240700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3260077bb0 0x7f32600760c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:48:51.284 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:50.687+0000 7f3265240700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3260077bb0 0x7f32600760c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49738/0 (socket says 172.21.15.100:49738) 2023-12-05T09:48:51.284 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:50.687+0000 7f3265240700 1 -- 172.21.15.100:0/3323918525 learned_addr learned my addr 172.21.15.100:0/3323918525 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:48:51.284 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:50.687+0000 7f3265240700 1 -- 172.21.15.100:0/3323918525 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3260076600 con 0x7f3260077bb0 2023-12-05T09:48:51.284 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:50.687+0000 7f3265240700 1 --2- 172.21.15.100:0/3323918525 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3260077bb0 0x7f32600760c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f325c0098e0 tx=0x7f325c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=782bd8b92c9762e server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:48:51.284 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:50.688+0000 7f3257fff700 1 -- 172.21.15.100:0/3323918525 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f325c00b860 con 0x7f3260077bb0 2023-12-05T09:48:51.284 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:50.688+0000 7f3257fff700 1 -- 172.21.15.100:0/3323918525 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f325c00be30 con 0x7f3260077bb0 2023-12-05T09:48:51.284 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:50.688+0000 7f3257fff700 1 -- 172.21.15.100:0/3323918525 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f325c010380 con 0x7f3260077bb0 2023-12-05T09:48:51.284 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:50.688+0000 7f32674a4700 1 -- 172.21.15.100:0/3323918525 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3260077bb0 msgr2=0x7f32600760c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:48:51.285 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:50.688+0000 7f32674a4700 1 --2- 172.21.15.100:0/3323918525 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3260077bb0 0x7f32600760c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f325c0098e0 tx=0x7f325c009250 comp rx=0 tx=0).stop 2023-12-05T09:48:51.285 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:50.688+0000 7f32674a4700 1 -- 172.21.15.100:0/3323918525 shutdown_connections 2023-12-05T09:48:51.285 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:50.688+0000 7f32674a4700 1 --2- 172.21.15.100:0/3323918525 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3260077bb0 0x7f32600760c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:48:51.285 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:50.688+0000 7f32674a4700 1 -- 172.21.15.100:0/3323918525 >> 172.21.15.100:0/3323918525 conn(0x7f32600fda50 msgr2=0x7f32600ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:48:51.285 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:50.688+0000 7f32674a4700 1 -- 172.21.15.100:0/3323918525 shutdown_connections 2023-12-05T09:48:51.285 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:50.688+0000 7f32674a4700 1 -- 172.21.15.100:0/3323918525 wait complete. 2023-12-05T09:48:51.285 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:50.689+0000 7f32674a4700 1 Processor -- start 2023-12-05T09:48:51.285 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:50.689+0000 7f32674a4700 1 -- start start 2023-12-05T09:48:51.285 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:50.690+0000 7f32674a4700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3260077bb0 0x7f32601133d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:48:51.285 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:50.690+0000 7f32674a4700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3260113910 con 0x7f3260077bb0 2023-12-05T09:48:51.285 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:50.690+0000 7f3265240700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3260077bb0 0x7f32601133d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:48:51.285 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:50.690+0000 7f3265240700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3260077bb0 0x7f32601133d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49740/0 (socket says 172.21.15.100:49740) 2023-12-05T09:48:51.285 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:50.690+0000 7f3265240700 1 -- 172.21.15.100:0/4220665958 learned_addr learned my addr 172.21.15.100:0/4220665958 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:48:51.285 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:50.690+0000 7f3265240700 1 -- 172.21.15.100:0/4220665958 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f325c0094f0 con 0x7f3260077bb0 2023-12-05T09:48:51.285 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:50.690+0000 7f3265240700 1 --2- 172.21.15.100:0/4220665958 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3260077bb0 0x7f32601133d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f325c006fd0 tx=0x7f325c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:48:51.286 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:50.691+0000 7f3255ffb700 1 -- 172.21.15.100:0/4220665958 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f325c010750 con 0x7f3260077bb0 2023-12-05T09:48:51.286 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:50.691+0000 7f3255ffb700 1 -- 172.21.15.100:0/4220665958 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f325c010d20 con 0x7f3260077bb0 2023-12-05T09:48:51.286 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:50.691+0000 7f32674a4700 1 -- 172.21.15.100:0/4220665958 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3260113b10 con 0x7f3260077bb0 2023-12-05T09:48:51.286 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:50.691+0000 7f3255ffb700 1 -- 172.21.15.100:0/4220665958 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f325c01ada0 con 0x7f3260077bb0 2023-12-05T09:48:51.286 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:50.691+0000 7f32674a4700 1 -- 172.21.15.100:0/4220665958 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3260113f20 con 0x7f3260077bb0 2023-12-05T09:48:51.286 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:50.692+0000 7f3255ffb700 1 -- 172.21.15.100:0/4220665958 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 43270+0+0 (secure 0 0 0) 0x7f325c0108b0 con 0x7f3260077bb0 2023-12-05T09:48:51.286 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:50.692+0000 7f32674a4700 1 -- 172.21.15.100:0/4220665958 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f326004bb80 con 0x7f3260077bb0 2023-12-05T09:48:51.286 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:50.692+0000 7f3255ffb700 1 --2- 172.21.15.100:0/4220665958 >> [v2:172.21.15.100:6800/3606837497,v1:172.21.15.100:6801/3606837497] conn(0x7f324c0365f0 0x7f324c038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:48:51.286 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:50.692+0000 7f3255ffb700 1 -- 172.21.15.100:0/4220665958 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f325c049ad0 con 0x7f3260077bb0 2023-12-05T09:48:51.286 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:50.692+0000 7f3264a3f700 1 --2- 172.21.15.100:0/4220665958 >> [v2:172.21.15.100:6800/3606837497,v1:172.21.15.100:6801/3606837497] conn(0x7f324c0365f0 0x7f324c038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:48:51.286 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:50.693+0000 7f3264a3f700 1 --2- 172.21.15.100:0/4220665958 >> [v2:172.21.15.100:6800/3606837497,v1:172.21.15.100:6801/3606837497] conn(0x7f324c0365f0 0x7f324c038aa0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3250009990 tx=0x7f3250006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:48:51.287 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:50.697+0000 7f3255ffb700 1 -- 172.21.15.100:0/4220665958 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f325c01a5d0 con 0x7f3260077bb0 2023-12-05T09:48:51.287 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:50.889+0000 7f32674a4700 1 -- 172.21.15.100:0/4220665958 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f3260108550 con 0x7f3260077bb0 2023-12-05T09:48:51.287 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:50.890+0000 7f3255ffb700 1 -- 172.21.15.100:0/4220665958 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7f325c020020 con 0x7f3260077bb0 2023-12-05T09:48:51.287 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:50.893+0000 7f32674a4700 1 -- 172.21.15.100:0/4220665958 >> [v2:172.21.15.100:6800/3606837497,v1:172.21.15.100:6801/3606837497] conn(0x7f324c0365f0 msgr2=0x7f324c038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:48:51.287 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:50.893+0000 7f32674a4700 1 --2- 172.21.15.100:0/4220665958 >> [v2:172.21.15.100:6800/3606837497,v1:172.21.15.100:6801/3606837497] conn(0x7f324c0365f0 0x7f324c038aa0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3250009990 tx=0x7f3250006e40 comp rx=0 tx=0).stop 2023-12-05T09:48:51.287 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:50.893+0000 7f32674a4700 1 -- 172.21.15.100:0/4220665958 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3260077bb0 msgr2=0x7f32601133d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:48:51.287 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:50.893+0000 7f32674a4700 1 --2- 172.21.15.100:0/4220665958 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3260077bb0 0x7f32601133d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f325c006fd0 tx=0x7f325c009250 comp rx=0 tx=0).stop 2023-12-05T09:48:51.287 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:50.893+0000 7f32674a4700 1 -- 172.21.15.100:0/4220665958 shutdown_connections 2023-12-05T09:48:51.287 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:50.893+0000 7f32674a4700 1 --2- 172.21.15.100:0/4220665958 >> [v2:172.21.15.100:6800/3606837497,v1:172.21.15.100:6801/3606837497] conn(0x7f324c0365f0 0x7f324c038aa0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:48:51.287 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:50.893+0000 7f32674a4700 1 --2- 172.21.15.100:0/4220665958 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3260077bb0 0x7f32601133d0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:48:51.287 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:50.893+0000 7f32674a4700 1 -- 172.21.15.100:0/4220665958 >> 172.21.15.100:0/4220665958 conn(0x7f32600fda50 msgr2=0x7f32600ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:48:51.288 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:50.893+0000 7f32674a4700 1 -- 172.21.15.100:0/4220665958 shutdown_connections 2023-12-05T09:48:51.288 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:50.893+0000 7f32674a4700 1 -- 172.21.15.100:0/4220665958 wait complete. 2023-12-05T09:48:51.288 INFO:teuthology.orchestra.run.smithi100.stdout:Enabling cephadm module... 2023-12-05T09:48:51.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:51 smithi100 ceph-mon[107145]: mgrmap e4: smithi100.ehmuhg(active, since 2s) 2023-12-05T09:48:51.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:51 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/4220665958' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-12-05T09:48:52.805 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:52 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/486228301' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2023-12-05T09:48:52.897 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:51.654+0000 7f5c91334700 1 Processor -- start 2023-12-05T09:48:52.898 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:51.654+0000 7f5c91334700 1 -- start start 2023-12-05T09:48:52.898 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:51.654+0000 7f5c91334700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c8c077bb0 0x7f5c8c0760c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:48:52.898 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:51.654+0000 7f5c91334700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c8c077fc0 con 0x7f5c8c077bb0 2023-12-05T09:48:52.898 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:51.655+0000 7f5c8affd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c8c077bb0 0x7f5c8c0760c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:48:52.898 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:51.655+0000 7f5c8affd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c8c077bb0 0x7f5c8c0760c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49748/0 (socket says 172.21.15.100:49748) 2023-12-05T09:48:52.898 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:51.655+0000 7f5c8affd700 1 -- 172.21.15.100:0/3436864223 learned_addr learned my addr 172.21.15.100:0/3436864223 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:48:52.898 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:51.655+0000 7f5c8affd700 1 -- 172.21.15.100:0/3436864223 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c8c076600 con 0x7f5c8c077bb0 2023-12-05T09:48:52.898 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:51.655+0000 7f5c8affd700 1 --2- 172.21.15.100:0/3436864223 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c8c077bb0 0x7f5c8c0760c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c0098e0 tx=0x7f5c7c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=364850e5b24dcf77 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:48:52.898 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:51.655+0000 7f5c89ffb700 1 -- 172.21.15.100:0/3436864223 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5c7c00b860 con 0x7f5c8c077bb0 2023-12-05T09:48:52.898 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:51.655+0000 7f5c89ffb700 1 -- 172.21.15.100:0/3436864223 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f5c7c00be30 con 0x7f5c8c077bb0 2023-12-05T09:48:52.898 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:51.655+0000 7f5c89ffb700 1 -- 172.21.15.100:0/3436864223 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5c7c010380 con 0x7f5c8c077bb0 2023-12-05T09:48:52.898 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:51.656+0000 7f5c91334700 1 -- 172.21.15.100:0/3436864223 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c8c077bb0 msgr2=0x7f5c8c0760c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:48:52.899 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:51.656+0000 7f5c91334700 1 --2- 172.21.15.100:0/3436864223 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c8c077bb0 0x7f5c8c0760c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c0098e0 tx=0x7f5c7c009250 comp rx=0 tx=0).stop 2023-12-05T09:48:52.899 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:51.656+0000 7f5c91334700 1 -- 172.21.15.100:0/3436864223 shutdown_connections 2023-12-05T09:48:52.899 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:51.656+0000 7f5c91334700 1 --2- 172.21.15.100:0/3436864223 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c8c077bb0 0x7f5c8c0760c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:48:52.899 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:51.656+0000 7f5c91334700 1 -- 172.21.15.100:0/3436864223 >> 172.21.15.100:0/3436864223 conn(0x7f5c8c0fda50 msgr2=0x7f5c8c0ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:48:52.899 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:51.656+0000 7f5c91334700 1 -- 172.21.15.100:0/3436864223 shutdown_connections 2023-12-05T09:48:52.899 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:51.656+0000 7f5c91334700 1 -- 172.21.15.100:0/3436864223 wait complete. 2023-12-05T09:48:52.899 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:51.657+0000 7f5c91334700 1 Processor -- start 2023-12-05T09:48:52.899 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:51.657+0000 7f5c91334700 1 -- start start 2023-12-05T09:48:52.899 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:51.657+0000 7f5c91334700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c8c077bb0 0x7f5c8c1133a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:48:52.899 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:51.657+0000 7f5c91334700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c8c1138e0 con 0x7f5c8c077bb0 2023-12-05T09:48:52.899 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:51.658+0000 7f5c8affd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c8c077bb0 0x7f5c8c1133a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:48:52.899 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:51.658+0000 7f5c8affd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c8c077bb0 0x7f5c8c1133a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49754/0 (socket says 172.21.15.100:49754) 2023-12-05T09:48:52.899 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:51.658+0000 7f5c8affd700 1 -- 172.21.15.100:0/486228301 learned_addr learned my addr 172.21.15.100:0/486228301 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:48:52.899 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:51.658+0000 7f5c8affd700 1 -- 172.21.15.100:0/486228301 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c7c0094f0 con 0x7f5c8c077bb0 2023-12-05T09:48:52.900 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:51.658+0000 7f5c8affd700 1 --2- 172.21.15.100:0/486228301 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c8c077bb0 0x7f5c8c1133a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c006fd0 tx=0x7f5c7c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:48:52.900 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:51.658+0000 7f5c737fe700 1 -- 172.21.15.100:0/486228301 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5c7c010750 con 0x7f5c8c077bb0 2023-12-05T09:48:52.900 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:51.658+0000 7f5c737fe700 1 -- 172.21.15.100:0/486228301 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f5c7c010d20 con 0x7f5c8c077bb0 2023-12-05T09:48:52.900 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:51.658+0000 7f5c91334700 1 -- 172.21.15.100:0/486228301 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c8c113ae0 con 0x7f5c8c077bb0 2023-12-05T09:48:52.900 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:51.658+0000 7f5c737fe700 1 -- 172.21.15.100:0/486228301 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5c7c01ada0 con 0x7f5c8c077bb0 2023-12-05T09:48:52.900 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:51.659+0000 7f5c91334700 1 -- 172.21.15.100:0/486228301 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c8c113ef0 con 0x7f5c8c077bb0 2023-12-05T09:48:52.900 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:51.659+0000 7f5c737fe700 1 -- 172.21.15.100:0/486228301 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 43270+0+0 (secure 0 0 0) 0x7f5c7c0108b0 con 0x7f5c8c077bb0 2023-12-05T09:48:52.900 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:51.660+0000 7f5c91334700 1 -- 172.21.15.100:0/486228301 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c8c04bb80 con 0x7f5c8c077bb0 2023-12-05T09:48:52.900 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:51.660+0000 7f5c737fe700 1 --2- 172.21.15.100:0/486228301 >> [v2:172.21.15.100:6800/3606837497,v1:172.21.15.100:6801/3606837497] conn(0x7f5c740365f0 0x7f5c74038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:48:52.900 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:51.660+0000 7f5c737fe700 1 -- 172.21.15.100:0/486228301 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f5c7c049a90 con 0x7f5c8c077bb0 2023-12-05T09:48:52.900 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:51.660+0000 7f5c8a7fc700 1 --2- 172.21.15.100:0/486228301 >> [v2:172.21.15.100:6800/3606837497,v1:172.21.15.100:6801/3606837497] conn(0x7f5c740365f0 0x7f5c74038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:48:52.900 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:51.661+0000 7f5c8a7fc700 1 --2- 172.21.15.100:0/486228301 >> [v2:172.21.15.100:6800/3606837497,v1:172.21.15.100:6801/3606837497] conn(0x7f5c740365f0 0x7f5c74038aa0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5c80009990 tx=0x7f5c80006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:48:52.900 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:51.665+0000 7f5c737fe700 1 -- 172.21.15.100:0/486228301 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f5c7c02c350 con 0x7f5c8c077bb0 2023-12-05T09:48:52.900 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:51.905+0000 7f5c91334700 1 -- 172.21.15.100:0/486228301 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f5c8c0008d0 con 0x7f5c8c077bb0 2023-12-05T09:48:52.901 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:52.554+0000 7f5c737fe700 1 -- 172.21.15.100:0/486228301 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mgrmap(e 5) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f5c7c018350 con 0x7f5c8c077bb0 2023-12-05T09:48:52.901 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:52.555+0000 7f5c737fe700 1 -- 172.21.15.100:0/486228301 <== mon.0 v2:172.21.15.100:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f5c7c0224f0 con 0x7f5c8c077bb0 2023-12-05T09:48:52.901 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:52.557+0000 7f5c91334700 1 -- 172.21.15.100:0/486228301 >> [v2:172.21.15.100:6800/3606837497,v1:172.21.15.100:6801/3606837497] conn(0x7f5c740365f0 msgr2=0x7f5c74038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:48:52.901 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:52.557+0000 7f5c91334700 1 --2- 172.21.15.100:0/486228301 >> [v2:172.21.15.100:6800/3606837497,v1:172.21.15.100:6801/3606837497] conn(0x7f5c740365f0 0x7f5c74038aa0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5c80009990 tx=0x7f5c80006e40 comp rx=0 tx=0).stop 2023-12-05T09:48:52.901 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:52.557+0000 7f5c91334700 1 -- 172.21.15.100:0/486228301 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c8c077bb0 msgr2=0x7f5c8c1133a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:48:52.901 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:52.557+0000 7f5c91334700 1 --2- 172.21.15.100:0/486228301 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c8c077bb0 0x7f5c8c1133a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c006fd0 tx=0x7f5c7c009250 comp rx=0 tx=0).stop 2023-12-05T09:48:52.901 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:52.558+0000 7f5c91334700 1 -- 172.21.15.100:0/486228301 shutdown_connections 2023-12-05T09:48:52.901 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:52.558+0000 7f5c91334700 1 --2- 172.21.15.100:0/486228301 >> [v2:172.21.15.100:6800/3606837497,v1:172.21.15.100:6801/3606837497] conn(0x7f5c740365f0 0x7f5c74038aa0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:48:52.901 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:52.558+0000 7f5c91334700 1 --2- 172.21.15.100:0/486228301 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c8c077bb0 0x7f5c8c1133a0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:48:52.901 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:52.558+0000 7f5c91334700 1 -- 172.21.15.100:0/486228301 >> 172.21.15.100:0/486228301 conn(0x7f5c8c0fda50 msgr2=0x7f5c8c0ffe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:48:52.901 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:52.558+0000 7f5c91334700 1 -- 172.21.15.100:0/486228301 shutdown_connections 2023-12-05T09:48:52.901 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:52.558+0000 7f5c91334700 1 -- 172.21.15.100:0/486228301 wait complete. 2023-12-05T09:48:53.827 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:53 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/486228301' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2023-12-05T09:48:53.827 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:53 smithi100 ceph-mon[107145]: mgrmap e5: smithi100.ehmuhg(active, since 4s) 2023-12-05T09:48:53.977 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout { 2023-12-05T09:48:53.977 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "epoch": 5, 2023-12-05T09:48:53.977 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "available": true, 2023-12-05T09:48:53.978 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "active_name": "smithi100.ehmuhg", 2023-12-05T09:48:53.978 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-12-05T09:48:53.978 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout } 2023-12-05T09:48:53.978 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:53.364+0000 7fe6dc1c9700 1 Processor -- start 2023-12-05T09:48:53.978 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:53.364+0000 7fe6dc1c9700 1 -- start start 2023-12-05T09:48:53.978 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:53.365+0000 7fe6dc1c9700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6d41022d0 0x7fe6d41026e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:48:53.978 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:53.365+0000 7fe6dc1c9700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d4102c20 con 0x7fe6d41022d0 2023-12-05T09:48:53.978 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:53.365+0000 7fe6d9f65700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6d41022d0 0x7fe6d41026e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:48:53.978 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:53.365+0000 7fe6d9f65700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6d41022d0 0x7fe6d41026e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49762/0 (socket says 172.21.15.100:49762) 2023-12-05T09:48:53.978 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:53.365+0000 7fe6d9f65700 1 -- 172.21.15.100:0/557068883 learned_addr learned my addr 172.21.15.100:0/557068883 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:48:53.978 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:53.365+0000 7fe6d9f65700 1 -- 172.21.15.100:0/557068883 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6d4102d60 con 0x7fe6d41022d0 2023-12-05T09:48:53.978 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:53.366+0000 7fe6d9f65700 1 --2- 172.21.15.100:0/557068883 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6d41022d0 0x7fe6d41026e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe6d00098e0 tx=0x7fe6d0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f03d3262c298729 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:48:53.978 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:53.366+0000 7fe6d8f63700 1 -- 172.21.15.100:0/557068883 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe6d000b860 con 0x7fe6d41022d0 2023-12-05T09:48:53.979 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:53.366+0000 7fe6d8f63700 1 -- 172.21.15.100:0/557068883 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fe6d000be30 con 0x7fe6d41022d0 2023-12-05T09:48:53.979 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:53.366+0000 7fe6d8f63700 1 -- 172.21.15.100:0/557068883 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe6d0010380 con 0x7fe6d41022d0 2023-12-05T09:48:53.979 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:53.366+0000 7fe6dc1c9700 1 -- 172.21.15.100:0/557068883 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6d41022d0 msgr2=0x7fe6d41026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:48:53.979 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:53.366+0000 7fe6dc1c9700 1 --2- 172.21.15.100:0/557068883 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6d41022d0 0x7fe6d41026e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe6d00098e0 tx=0x7fe6d0009250 comp rx=0 tx=0).stop 2023-12-05T09:48:53.979 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:53.367+0000 7fe6dc1c9700 1 -- 172.21.15.100:0/557068883 shutdown_connections 2023-12-05T09:48:53.979 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:53.367+0000 7fe6dc1c9700 1 --2- 172.21.15.100:0/557068883 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6d41022d0 0x7fe6d41026e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:48:53.979 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:53.367+0000 7fe6dc1c9700 1 -- 172.21.15.100:0/557068883 >> 172.21.15.100:0/557068883 conn(0x7fe6d40fda50 msgr2=0x7fe6d40ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:48:53.979 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:53.367+0000 7fe6dc1c9700 1 -- 172.21.15.100:0/557068883 shutdown_connections 2023-12-05T09:48:53.979 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:53.367+0000 7fe6dc1c9700 1 -- 172.21.15.100:0/557068883 wait complete. 2023-12-05T09:48:53.979 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:53.368+0000 7fe6dc1c9700 1 Processor -- start 2023-12-05T09:48:53.979 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:53.368+0000 7fe6dc1c9700 1 -- start start 2023-12-05T09:48:53.979 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:53.368+0000 7fe6dc1c9700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6d41022d0 0x7fe6d4077c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:48:53.979 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:53.368+0000 7fe6dc1c9700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d4076080 con 0x7fe6d41022d0 2023-12-05T09:48:53.979 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:53.368+0000 7fe6d9f65700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6d41022d0 0x7fe6d4077c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:48:53.979 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:53.368+0000 7fe6d9f65700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6d41022d0 0x7fe6d4077c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49774/0 (socket says 172.21.15.100:49774) 2023-12-05T09:48:53.980 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:53.368+0000 7fe6d9f65700 1 -- 172.21.15.100:0/575502109 learned_addr learned my addr 172.21.15.100:0/575502109 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:48:53.980 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:53.369+0000 7fe6d9f65700 1 -- 172.21.15.100:0/575502109 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6d00094f0 con 0x7fe6d41022d0 2023-12-05T09:48:53.980 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:53.369+0000 7fe6d9f65700 1 --2- 172.21.15.100:0/575502109 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6d41022d0 0x7fe6d4077c00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe6d0000c00 tx=0x7fe6d0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:48:53.980 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:53.369+0000 7fe6ca7fc700 1 -- 172.21.15.100:0/575502109 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe6d0010a80 con 0x7fe6d41022d0 2023-12-05T09:48:53.980 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:53.369+0000 7fe6ca7fc700 1 -- 172.21.15.100:0/575502109 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fe6d001a430 con 0x7fe6d41022d0 2023-12-05T09:48:53.980 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:53.369+0000 7fe6ca7fc700 1 -- 172.21.15.100:0/575502109 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe6d00245b0 con 0x7fe6d41022d0 2023-12-05T09:48:53.980 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:53.369+0000 7fe6dc1c9700 1 -- 172.21.15.100:0/575502109 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6d4076280 con 0x7fe6d41022d0 2023-12-05T09:48:53.980 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:53.369+0000 7fe6dc1c9700 1 -- 172.21.15.100:0/575502109 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6d4076690 con 0x7fe6d41022d0 2023-12-05T09:48:53.980 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:53.370+0000 7fe6ca7fc700 1 -- 172.21.15.100:0/575502109 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fe6d0010be0 con 0x7fe6d41022d0 2023-12-05T09:48:53.980 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:53.370+0000 7fe6dc1c9700 1 -- 172.21.15.100:0/575502109 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6d404bb80 con 0x7fe6d41022d0 2023-12-05T09:48:53.980 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:53.371+0000 7fe6ca7fc700 1 --2- 172.21.15.100:0/575502109 >> [v2:172.21.15.100:6800/3606837497,v1:172.21.15.100:6801/3606837497] conn(0x7fe6c0036640 0x7fe6c0038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:48:53.980 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:53.371+0000 7fe6ca7fc700 1 -- 172.21.15.100:0/575502109 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fe6d004aae0 con 0x7fe6d41022d0 2023-12-05T09:48:53.980 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:53.371+0000 7fe6d9764700 1 -- 172.21.15.100:0/575502109 >> [v2:172.21.15.100:6800/3606837497,v1:172.21.15.100:6801/3606837497] conn(0x7fe6c0036640 msgr2=0x7fe6c0038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/3606837497 2023-12-05T09:48:53.980 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:53.371+0000 7fe6d9764700 1 --2- 172.21.15.100:0/575502109 >> [v2:172.21.15.100:6800/3606837497,v1:172.21.15.100:6801/3606837497] conn(0x7fe6c0036640 0x7fe6c0038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-05T09:48:53.980 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:53.376+0000 7fe6ca7fc700 1 -- 172.21.15.100:0/575502109 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fe6d00239e0 con 0x7fe6d41022d0 2023-12-05T09:48:53.981 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:53.572+0000 7fe6d9764700 1 -- 172.21.15.100:0/575502109 >> [v2:172.21.15.100:6800/3606837497,v1:172.21.15.100:6801/3606837497] conn(0x7fe6c0036640 msgr2=0x7fe6c0038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/3606837497 2023-12-05T09:48:53.981 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:53.572+0000 7fe6d9764700 1 --2- 172.21.15.100:0/575502109 >> [v2:172.21.15.100:6800/3606837497,v1:172.21.15.100:6801/3606837497] conn(0x7fe6c0036640 0x7fe6c0038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-05T09:48:53.981 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:53.630+0000 7fe6dc1c9700 1 -- 172.21.15.100:0/575502109 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fe6d410ad50 con 0x7fe6d41022d0 2023-12-05T09:48:53.981 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:53.631+0000 7fe6ca7fc700 1 -- 172.21.15.100:0/575502109 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7fe6d0023390 con 0x7fe6d41022d0 2023-12-05T09:48:53.981 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:53.634+0000 7fe6dc1c9700 1 -- 172.21.15.100:0/575502109 >> [v2:172.21.15.100:6800/3606837497,v1:172.21.15.100:6801/3606837497] conn(0x7fe6c0036640 msgr2=0x7fe6c0038af0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-05T09:48:53.981 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:53.634+0000 7fe6dc1c9700 1 --2- 172.21.15.100:0/575502109 >> [v2:172.21.15.100:6800/3606837497,v1:172.21.15.100:6801/3606837497] conn(0x7fe6c0036640 0x7fe6c0038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:48:53.981 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:53.634+0000 7fe6dc1c9700 1 -- 172.21.15.100:0/575502109 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6d41022d0 msgr2=0x7fe6d4077c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:48:53.981 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:53.634+0000 7fe6dc1c9700 1 --2- 172.21.15.100:0/575502109 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6d41022d0 0x7fe6d4077c00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe6d0000c00 tx=0x7fe6d0009250 comp rx=0 tx=0).stop 2023-12-05T09:48:53.981 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:53.634+0000 7fe6dc1c9700 1 -- 172.21.15.100:0/575502109 shutdown_connections 2023-12-05T09:48:53.981 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:53.634+0000 7fe6dc1c9700 1 --2- 172.21.15.100:0/575502109 >> [v2:172.21.15.100:6800/3606837497,v1:172.21.15.100:6801/3606837497] conn(0x7fe6c0036640 0x7fe6c0038af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:48:53.981 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:53.634+0000 7fe6dc1c9700 1 --2- 172.21.15.100:0/575502109 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6d41022d0 0x7fe6d4077c00 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:48:53.981 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:53.634+0000 7fe6dc1c9700 1 -- 172.21.15.100:0/575502109 >> 172.21.15.100:0/575502109 conn(0x7fe6d40fda50 msgr2=0x7fe6d40ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:48:53.981 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:53.634+0000 7fe6dc1c9700 1 -- 172.21.15.100:0/575502109 shutdown_connections 2023-12-05T09:48:53.981 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:53.634+0000 7fe6dc1c9700 1 -- 172.21.15.100:0/575502109 wait complete. 2023-12-05T09:48:53.981 INFO:teuthology.orchestra.run.smithi100.stdout:Waiting for the mgr to restart... 2023-12-05T09:48:53.982 INFO:teuthology.orchestra.run.smithi100.stdout:Waiting for mgr epoch 5... 2023-12-05T09:48:54.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:48:54 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/575502109' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-12-05T09:49:01.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:01 smithi100 ceph-mon[107145]: Active manager daemon smithi100.ehmuhg restarted 2023-12-05T09:49:01.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:01 smithi100 ceph-mon[107145]: Activating manager daemon smithi100.ehmuhg 2023-12-05T09:49:01.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:01 smithi100 ceph-mon[107145]: osdmap e2: 0 total, 0 up, 0 in 2023-12-05T09:49:01.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:01 smithi100 ceph-mon[107145]: mgrmap e6: smithi100.ehmuhg(active, starting, since 0.00352763s) 2023-12-05T09:49:01.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:01 smithi100 ceph-mon[107145]: from='mgr.14118 172.21.15.100:0/3445090407' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mon metadata", "id": "smithi100"}]: dispatch 2023-12-05T09:49:01.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:01 smithi100 ceph-mon[107145]: from='mgr.14118 172.21.15.100:0/3445090407' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mgr metadata", "who": "smithi100.ehmuhg", "id": "smithi100.ehmuhg"}]: dispatch 2023-12-05T09:49:01.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:01 smithi100 ceph-mon[107145]: from='mgr.14118 172.21.15.100:0/3445090407' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-05T09:49:01.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:01 smithi100 ceph-mon[107145]: from='mgr.14118 172.21.15.100:0/3445090407' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-05T09:49:01.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:01 smithi100 ceph-mon[107145]: from='mgr.14118 172.21.15.100:0/3445090407' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-05T09:49:01.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:01 smithi100 ceph-mon[107145]: Manager daemon smithi100.ehmuhg is now available 2023-12-05T09:49:01.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:01 smithi100 ceph-mon[107145]: from='mgr.14118 172.21.15.100:0/3445090407' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:49:01.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:01 smithi100 ceph-mon[107145]: from='mgr.14118 172.21.15.100:0/3445090407' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:49:01.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:01 smithi100 ceph-mon[107145]: from='mgr.14118 172.21.15.100:0/3445090407' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:49:01.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:01 smithi100 ceph-mon[107145]: from='mgr.14118 172.21.15.100:0/3445090407' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:49:01.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:01 smithi100 ceph-mon[107145]: from='mgr.14118 172.21.15.100:0/3445090407' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:49:02.383 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout { 2023-12-05T09:49:02.384 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2023-12-05T09:49:02.384 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "initialized": true 2023-12-05T09:49:02.384 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout } 2023-12-05T09:49:02.384 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:54.350+0000 7fdd2cf47700 1 Processor -- start 2023-12-05T09:49:02.384 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:54.351+0000 7fdd2cf47700 1 -- start start 2023-12-05T09:49:02.384 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:54.351+0000 7fdd2cf47700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd28077bd0 0x7fdd280760e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:02.384 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:54.351+0000 7fdd2cf47700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd28077fe0 con 0x7fdd28077bd0 2023-12-05T09:49:02.384 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:54.351+0000 7fdd2659c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd28077bd0 0x7fdd280760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:02.384 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:54.351+0000 7fdd2659c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd28077bd0 0x7fdd280760e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49790/0 (socket says 172.21.15.100:49790) 2023-12-05T09:49:02.384 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:54.351+0000 7fdd2659c700 1 -- 172.21.15.100:0/4283130494 learned_addr learned my addr 172.21.15.100:0/4283130494 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:49:02.384 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:54.352+0000 7fdd2659c700 1 -- 172.21.15.100:0/4283130494 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd28076620 con 0x7fdd28077bd0 2023-12-05T09:49:02.384 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:54.352+0000 7fdd2659c700 1 --2- 172.21.15.100:0/4283130494 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd28077bd0 0x7fdd280760e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fdd180098e0 tx=0x7fdd18009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b20bf59796476a0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:02.385 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:54.352+0000 7fdd2559a700 1 -- 172.21.15.100:0/4283130494 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdd1800b860 con 0x7fdd28077bd0 2023-12-05T09:49:02.385 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:54.352+0000 7fdd2559a700 1 -- 172.21.15.100:0/4283130494 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fdd1800be30 con 0x7fdd28077bd0 2023-12-05T09:49:02.385 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:54.352+0000 7fdd2559a700 1 -- 172.21.15.100:0/4283130494 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdd18010380 con 0x7fdd28077bd0 2023-12-05T09:49:02.385 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:54.353+0000 7fdd2cf47700 1 -- 172.21.15.100:0/4283130494 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd28077bd0 msgr2=0x7fdd280760e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:02.385 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:02 smithi100 ceph-mon[107145]: Found migration_current of "None". Setting to last migration. 2023-12-05T09:49:02.385 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:02 smithi100 ceph-mon[107145]: from='mgr.14118 172.21.15.100:0/3445090407' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi100.ehmuhg/mirror_snapshot_schedule"}]: dispatch 2023-12-05T09:49:02.385 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:02 smithi100 ceph-mon[107145]: from='mgr.14118 172.21.15.100:0/3445090407' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi100.ehmuhg/trash_purge_schedule"}]: dispatch 2023-12-05T09:49:02.385 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:02 smithi100 ceph-mon[107145]: mgrmap e7: smithi100.ehmuhg(active, since 1.00655s) 2023-12-05T09:49:02.391 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:54.353+0000 7fdd2cf47700 1 --2- 172.21.15.100:0/4283130494 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd28077bd0 0x7fdd280760e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fdd180098e0 tx=0x7fdd18009250 comp rx=0 tx=0).stop 2023-12-05T09:49:02.391 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:54.353+0000 7fdd2cf47700 1 -- 172.21.15.100:0/4283130494 shutdown_connections 2023-12-05T09:49:02.391 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:54.353+0000 7fdd2cf47700 1 --2- 172.21.15.100:0/4283130494 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd28077bd0 0x7fdd280760e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:02.391 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:54.353+0000 7fdd2cf47700 1 -- 172.21.15.100:0/4283130494 >> 172.21.15.100:0/4283130494 conn(0x7fdd280fda50 msgr2=0x7fdd280ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:49:02.391 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:54.353+0000 7fdd2cf47700 1 -- 172.21.15.100:0/4283130494 shutdown_connections 2023-12-05T09:49:02.392 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:54.353+0000 7fdd2cf47700 1 -- 172.21.15.100:0/4283130494 wait complete. 2023-12-05T09:49:02.392 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:54.354+0000 7fdd2cf47700 1 Processor -- start 2023-12-05T09:49:02.392 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:54.354+0000 7fdd2cf47700 1 -- start start 2023-12-05T09:49:02.392 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:54.354+0000 7fdd2cf47700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd28077bd0 0x7fdd281133c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:02.392 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:54.354+0000 7fdd2cf47700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd28113900 con 0x7fdd28077bd0 2023-12-05T09:49:02.392 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:54.354+0000 7fdd2659c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd28077bd0 0x7fdd281133c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:02.392 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:54.355+0000 7fdd2659c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd28077bd0 0x7fdd281133c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49796/0 (socket says 172.21.15.100:49796) 2023-12-05T09:49:02.392 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:54.355+0000 7fdd2659c700 1 -- 172.21.15.100:0/2056172767 learned_addr learned my addr 172.21.15.100:0/2056172767 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:49:02.392 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:54.355+0000 7fdd2659c700 1 -- 172.21.15.100:0/2056172767 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd180094f0 con 0x7fdd28077bd0 2023-12-05T09:49:02.392 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:54.355+0000 7fdd2659c700 1 --2- 172.21.15.100:0/2056172767 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd28077bd0 0x7fdd281133c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fdd18006fd0 tx=0x7fdd18009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:02.392 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:54.355+0000 7fdd16ffd700 1 -- 172.21.15.100:0/2056172767 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdd18010750 con 0x7fdd28077bd0 2023-12-05T09:49:02.392 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:54.355+0000 7fdd16ffd700 1 -- 172.21.15.100:0/2056172767 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fdd18010d20 con 0x7fdd28077bd0 2023-12-05T09:49:02.392 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:54.355+0000 7fdd2cf47700 1 -- 172.21.15.100:0/2056172767 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd28113b00 con 0x7fdd28077bd0 2023-12-05T09:49:02.393 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:54.355+0000 7fdd16ffd700 1 -- 172.21.15.100:0/2056172767 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdd1801ada0 con 0x7fdd28077bd0 2023-12-05T09:49:02.393 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:54.356+0000 7fdd2cf47700 1 -- 172.21.15.100:0/2056172767 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd28113f10 con 0x7fdd28077bd0 2023-12-05T09:49:02.393 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:54.357+0000 7fdd16ffd700 1 -- 172.21.15.100:0/2056172767 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fdd180108b0 con 0x7fdd28077bd0 2023-12-05T09:49:02.393 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:54.357+0000 7fdd16ffd700 1 --2- 172.21.15.100:0/2056172767 >> [v2:172.21.15.100:6800/3606837497,v1:172.21.15.100:6801/3606837497] conn(0x7fdd10036640 0x7fdd10038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:02.393 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:54.357+0000 7fdd2cf47700 1 -- 172.21.15.100:0/2056172767 --> [v2:172.21.15.100:6800/3606837497,v1:172.21.15.100:6801/3606837497] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdd2804bb80 con 0x7fdd10036640 2023-12-05T09:49:02.393 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:54.357+0000 7fdd16ffd700 1 -- 172.21.15.100:0/2056172767 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fdd18049470 con 0x7fdd28077bd0 2023-12-05T09:49:02.393 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:54.357+0000 7fdd25d9b700 1 -- 172.21.15.100:0/2056172767 >> [v2:172.21.15.100:6800/3606837497,v1:172.21.15.100:6801/3606837497] conn(0x7fdd10036640 msgr2=0x7fdd10038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/3606837497 2023-12-05T09:49:02.393 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:54.357+0000 7fdd25d9b700 1 --2- 172.21.15.100:0/2056172767 >> [v2:172.21.15.100:6800/3606837497,v1:172.21.15.100:6801/3606837497] conn(0x7fdd10036640 0x7fdd10038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-05T09:49:02.393 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:54.558+0000 7fdd25d9b700 1 -- 172.21.15.100:0/2056172767 >> [v2:172.21.15.100:6800/3606837497,v1:172.21.15.100:6801/3606837497] conn(0x7fdd10036640 msgr2=0x7fdd10038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/3606837497 2023-12-05T09:49:02.393 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:54.558+0000 7fdd25d9b700 1 --2- 172.21.15.100:0/2056172767 >> [v2:172.21.15.100:6800/3606837497,v1:172.21.15.100:6801/3606837497] conn(0x7fdd10036640 0x7fdd10038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-05T09:49:02.393 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:54.959+0000 7fdd25d9b700 1 -- 172.21.15.100:0/2056172767 >> [v2:172.21.15.100:6800/3606837497,v1:172.21.15.100:6801/3606837497] conn(0x7fdd10036640 msgr2=0x7fdd10038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/3606837497 2023-12-05T09:49:02.393 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:54.959+0000 7fdd25d9b700 1 --2- 172.21.15.100:0/2056172767 >> [v2:172.21.15.100:6800/3606837497,v1:172.21.15.100:6801/3606837497] conn(0x7fdd10036640 0x7fdd10038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-05T09:49:02.393 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:55.760+0000 7fdd25d9b700 1 -- 172.21.15.100:0/2056172767 >> [v2:172.21.15.100:6800/3606837497,v1:172.21.15.100:6801/3606837497] conn(0x7fdd10036640 msgr2=0x7fdd10038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/3606837497 2023-12-05T09:49:02.393 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:55.760+0000 7fdd25d9b700 1 --2- 172.21.15.100:0/2056172767 >> [v2:172.21.15.100:6800/3606837497,v1:172.21.15.100:6801/3606837497] conn(0x7fdd10036640 0x7fdd10038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-05T09:49:02.393 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:57.362+0000 7fdd25d9b700 1 -- 172.21.15.100:0/2056172767 >> [v2:172.21.15.100:6800/3606837497,v1:172.21.15.100:6801/3606837497] conn(0x7fdd10036640 msgr2=0x7fdd10038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/3606837497 2023-12-05T09:49:02.394 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:48:57.362+0000 7fdd25d9b700 1 --2- 172.21.15.100:0/2056172767 >> [v2:172.21.15.100:6800/3606837497,v1:172.21.15.100:6801/3606837497] conn(0x7fdd10036640 0x7fdd10038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-12-05T09:49:02.394 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:00.565+0000 7fdd25d9b700 1 -- 172.21.15.100:0/2056172767 >> [v2:172.21.15.100:6800/3606837497,v1:172.21.15.100:6801/3606837497] conn(0x7fdd10036640 msgr2=0x7fdd10038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/3606837497 2023-12-05T09:49:02.394 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:00.565+0000 7fdd25d9b700 1 --2- 172.21.15.100:0/2056172767 >> [v2:172.21.15.100:6800/3606837497,v1:172.21.15.100:6801/3606837497] conn(0x7fdd10036640 0x7fdd10038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2023-12-05T09:49:02.394 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:01.009+0000 7fdd16ffd700 1 -- 172.21.15.100:0/2056172767 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mgrmap(e 6) v1 ==== 43048+0+0 (secure 0 0 0) 0x7fdd18024780 con 0x7fdd28077bd0 2023-12-05T09:49:02.394 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:01.009+0000 7fdd16ffd700 1 -- 172.21.15.100:0/2056172767 >> [v2:172.21.15.100:6800/3606837497,v1:172.21.15.100:6801/3606837497] conn(0x7fdd10036640 msgr2=0x7fdd10038af0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-05T09:49:02.394 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:01.009+0000 7fdd16ffd700 1 --2- 172.21.15.100:0/2056172767 >> [v2:172.21.15.100:6800/3606837497,v1:172.21.15.100:6801/3606837497] conn(0x7fdd10036640 0x7fdd10038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:02.394 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:02.011+0000 7fdd16ffd700 1 -- 172.21.15.100:0/2056172767 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mgrmap(e 7) v1 ==== 43175+0+0 (secure 0 0 0) 0x7fdd18048a00 con 0x7fdd28077bd0 2023-12-05T09:49:02.394 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:02.011+0000 7fdd16ffd700 1 --2- 172.21.15.100:0/2056172767 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7fdd10039db0 0x7fdd1003c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:02.394 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:02.011+0000 7fdd16ffd700 1 -- 172.21.15.100:0/2056172767 --> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdd2804bb80 con 0x7fdd10039db0 2023-12-05T09:49:02.394 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:02.011+0000 7fdd25d9b700 1 --2- 172.21.15.100:0/2056172767 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7fdd10039db0 0x7fdd1003c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:02.394 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:02.013+0000 7fdd25d9b700 1 --2- 172.21.15.100:0/2056172767 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7fdd10039db0 0x7fdd1003c190 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c0039d0 tx=0x7fdd1c009350 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:02.394 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:02.014+0000 7fdd16ffd700 1 -- 172.21.15.100:0/2056172767 <== mgr.14118 v2:172.21.15.100:6800/2647899624 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7fdd2804bb80 con 0x7fdd10039db0 2023-12-05T09:49:02.394 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:02.020+0000 7fdd2cf47700 1 -- 172.21.15.100:0/2056172767 --> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7fdd28108540 con 0x7fdd10039db0 2023-12-05T09:49:02.395 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:02.020+0000 7fdd16ffd700 1 -- 172.21.15.100:0/2056172767 <== mgr.14118 v2:172.21.15.100:6800/2647899624 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fdd28108540 con 0x7fdd10039db0 2023-12-05T09:49:02.395 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:02.021+0000 7fdd2cf47700 1 -- 172.21.15.100:0/2056172767 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7fdd10039db0 msgr2=0x7fdd1003c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:02.395 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:02.021+0000 7fdd2cf47700 1 --2- 172.21.15.100:0/2056172767 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7fdd10039db0 0x7fdd1003c190 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c0039d0 tx=0x7fdd1c009350 comp rx=0 tx=0).stop 2023-12-05T09:49:02.395 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:02.021+0000 7fdd2cf47700 1 -- 172.21.15.100:0/2056172767 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd28077bd0 msgr2=0x7fdd281133c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:02.395 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:02.021+0000 7fdd2cf47700 1 --2- 172.21.15.100:0/2056172767 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd28077bd0 0x7fdd281133c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fdd18006fd0 tx=0x7fdd18009250 comp rx=0 tx=0).stop 2023-12-05T09:49:02.395 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:02.021+0000 7fdd2cf47700 1 -- 172.21.15.100:0/2056172767 shutdown_connections 2023-12-05T09:49:02.395 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:02.021+0000 7fdd2cf47700 1 --2- 172.21.15.100:0/2056172767 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7fdd10039db0 0x7fdd1003c190 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:02.395 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:02.021+0000 7fdd2cf47700 1 --2- 172.21.15.100:0/2056172767 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd28077bd0 0x7fdd281133c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:02.395 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:02.021+0000 7fdd2cf47700 1 --2- 172.21.15.100:0/2056172767 >> [v2:172.21.15.100:6800/3606837497,v1:172.21.15.100:6801/3606837497] conn(0x7fdd10036640 0x7fdd10038af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:02.395 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:02.021+0000 7fdd2cf47700 1 -- 172.21.15.100:0/2056172767 >> 172.21.15.100:0/2056172767 conn(0x7fdd280fda50 msgr2=0x7fdd280ff250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:49:02.395 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:02.021+0000 7fdd2cf47700 1 -- 172.21.15.100:0/2056172767 shutdown_connections 2023-12-05T09:49:02.395 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:02.021+0000 7fdd2cf47700 1 -- 172.21.15.100:0/2056172767 wait complete. 2023-12-05T09:49:02.395 INFO:teuthology.orchestra.run.smithi100.stdout:mgr epoch 5 is available 2023-12-05T09:49:02.395 INFO:teuthology.orchestra.run.smithi100.stdout:Setting orchestrator backend to cephadm... 2023-12-05T09:49:03.374 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:02.786+0000 7fe432c7e700 1 Processor -- start 2023-12-05T09:49:03.375 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:02.786+0000 7fe432c7e700 1 -- start start 2023-12-05T09:49:03.375 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:02.786+0000 7fe432c7e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe42c1022d0 0x7fe42c1026e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:03.375 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:02.786+0000 7fe432c7e700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe42c102c20 con 0x7fe42c1022d0 2023-12-05T09:49:03.375 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:02.787+0000 7fe430a1a700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe42c1022d0 0x7fe42c1026e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:03.375 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:02.787+0000 7fe430a1a700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe42c1022d0 0x7fe42c1026e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44332/0 (socket says 172.21.15.100:44332) 2023-12-05T09:49:03.375 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:02.787+0000 7fe430a1a700 1 -- 172.21.15.100:0/4117393648 learned_addr learned my addr 172.21.15.100:0/4117393648 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:49:03.375 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:02.787+0000 7fe430a1a700 1 -- 172.21.15.100:0/4117393648 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe42c102d60 con 0x7fe42c1022d0 2023-12-05T09:49:03.375 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:02.787+0000 7fe430a1a700 1 --2- 172.21.15.100:0/4117393648 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe42c1022d0 0x7fe42c1026e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe4200098e0 tx=0x7fe420009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e2a09443ae51be5 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:03.375 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:02.788+0000 7fe42b7fe700 1 -- 172.21.15.100:0/4117393648 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe42000b860 con 0x7fe42c1022d0 2023-12-05T09:49:03.375 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:02.788+0000 7fe42b7fe700 1 -- 172.21.15.100:0/4117393648 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fe42000be30 con 0x7fe42c1022d0 2023-12-05T09:49:03.375 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:02.788+0000 7fe42b7fe700 1 -- 172.21.15.100:0/4117393648 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe420010380 con 0x7fe42c1022d0 2023-12-05T09:49:03.375 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:02.788+0000 7fe432c7e700 1 -- 172.21.15.100:0/4117393648 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe42c1022d0 msgr2=0x7fe42c1026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:03.376 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:02.788+0000 7fe432c7e700 1 --2- 172.21.15.100:0/4117393648 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe42c1022d0 0x7fe42c1026e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe4200098e0 tx=0x7fe420009250 comp rx=0 tx=0).stop 2023-12-05T09:49:03.376 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:02.788+0000 7fe432c7e700 1 -- 172.21.15.100:0/4117393648 shutdown_connections 2023-12-05T09:49:03.376 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:02.788+0000 7fe432c7e700 1 --2- 172.21.15.100:0/4117393648 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe42c1022d0 0x7fe42c1026e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:03.376 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:02.788+0000 7fe432c7e700 1 -- 172.21.15.100:0/4117393648 >> 172.21.15.100:0/4117393648 conn(0x7fe42c0fda50 msgr2=0x7fe42c0ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:49:03.376 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:02.788+0000 7fe432c7e700 1 -- 172.21.15.100:0/4117393648 shutdown_connections 2023-12-05T09:49:03.376 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:02.788+0000 7fe432c7e700 1 -- 172.21.15.100:0/4117393648 wait complete. 2023-12-05T09:49:03.376 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:02.789+0000 7fe432c7e700 1 Processor -- start 2023-12-05T09:49:03.376 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:02.789+0000 7fe432c7e700 1 -- start start 2023-12-05T09:49:03.376 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:02.790+0000 7fe432c7e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe42c1022d0 0x7fe42c111130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:03.376 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:02.790+0000 7fe432c7e700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe42c111670 con 0x7fe42c1022d0 2023-12-05T09:49:03.376 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:02.790+0000 7fe430a1a700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe42c1022d0 0x7fe42c111130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:03.376 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:02.790+0000 7fe430a1a700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe42c1022d0 0x7fe42c111130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44334/0 (socket says 172.21.15.100:44334) 2023-12-05T09:49:03.376 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:02.790+0000 7fe430a1a700 1 -- 172.21.15.100:0/4125822061 learned_addr learned my addr 172.21.15.100:0/4125822061 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:49:03.376 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:02.790+0000 7fe430a1a700 1 -- 172.21.15.100:0/4125822061 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4200094f0 con 0x7fe42c1022d0 2023-12-05T09:49:03.376 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:02.790+0000 7fe430a1a700 1 --2- 172.21.15.100:0/4125822061 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe42c1022d0 0x7fe42c111130 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe420000c00 tx=0x7fe420009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:03.377 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:02.791+0000 7fe4297fa700 1 -- 172.21.15.100:0/4125822061 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe420010a80 con 0x7fe42c1022d0 2023-12-05T09:49:03.377 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:02.791+0000 7fe4297fa700 1 -- 172.21.15.100:0/4125822061 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fe42001a430 con 0x7fe42c1022d0 2023-12-05T09:49:03.377 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:02.791+0000 7fe4297fa700 1 -- 172.21.15.100:0/4125822061 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe4200245b0 con 0x7fe42c1022d0 2023-12-05T09:49:03.377 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:02.791+0000 7fe432c7e700 1 -- 172.21.15.100:0/4125822061 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe42c111870 con 0x7fe42c1022d0 2023-12-05T09:49:03.377 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:02.791+0000 7fe432c7e700 1 -- 172.21.15.100:0/4125822061 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe42c111c80 con 0x7fe42c1022d0 2023-12-05T09:49:03.377 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:02.792+0000 7fe4297fa700 1 -- 172.21.15.100:0/4125822061 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 43175+0+0 (secure 0 0 0) 0x7fe42001a5a0 con 0x7fe42c1022d0 2023-12-05T09:49:03.377 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:02.792+0000 7fe432c7e700 1 -- 172.21.15.100:0/4125822061 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe42c04bb80 con 0x7fe42c1022d0 2023-12-05T09:49:03.377 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:02.792+0000 7fe4297fa700 1 --2- 172.21.15.100:0/4125822061 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7fe41c036510 0x7fe41c0389c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:03.377 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:02.792+0000 7fe4297fa700 1 -- 172.21.15.100:0/4125822061 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fe42004a9d0 con 0x7fe42c1022d0 2023-12-05T09:49:03.377 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:02.792+0000 7fe42bfff700 1 --2- 172.21.15.100:0/4125822061 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7fe41c036510 0x7fe41c0389c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:03.377 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:02.793+0000 7fe42bfff700 1 --2- 172.21.15.100:0/4125822061 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7fe41c036510 0x7fe41c0389c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe418009990 tx=0x7fe418006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:03.377 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:02.798+0000 7fe4297fa700 1 -- 172.21.15.100:0/4125822061 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fe420023df0 con 0x7fe42c1022d0 2023-12-05T09:49:03.377 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:02.998+0000 7fe432c7e700 1 -- 172.21.15.100:0/4125822061 --> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7fe42c10afc0 con 0x7fe41c036510 2023-12-05T09:49:03.377 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:03.005+0000 7fe4297fa700 1 -- 172.21.15.100:0/4125822061 <== mgr.14118 v2:172.21.15.100:6800/2647899624 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fe42c10afc0 con 0x7fe41c036510 2023-12-05T09:49:03.378 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:03.008+0000 7fe432c7e700 1 -- 172.21.15.100:0/4125822061 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7fe41c036510 msgr2=0x7fe41c0389c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:03.378 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:03.008+0000 7fe432c7e700 1 --2- 172.21.15.100:0/4125822061 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7fe41c036510 0x7fe41c0389c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe418009990 tx=0x7fe418006e40 comp rx=0 tx=0).stop 2023-12-05T09:49:03.378 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:03.008+0000 7fe432c7e700 1 -- 172.21.15.100:0/4125822061 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe42c1022d0 msgr2=0x7fe42c111130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:03.378 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:03.008+0000 7fe432c7e700 1 --2- 172.21.15.100:0/4125822061 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe42c1022d0 0x7fe42c111130 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe420000c00 tx=0x7fe420009250 comp rx=0 tx=0).stop 2023-12-05T09:49:03.378 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:03.008+0000 7fe432c7e700 1 -- 172.21.15.100:0/4125822061 shutdown_connections 2023-12-05T09:49:03.378 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:03.008+0000 7fe432c7e700 1 --2- 172.21.15.100:0/4125822061 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7fe41c036510 0x7fe41c0389c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:03.378 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:03.008+0000 7fe432c7e700 1 --2- 172.21.15.100:0/4125822061 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe42c1022d0 0x7fe42c111130 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:03.378 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:03.008+0000 7fe432c7e700 1 -- 172.21.15.100:0/4125822061 >> 172.21.15.100:0/4125822061 conn(0x7fe42c0fda50 msgr2=0x7fe42c0ff250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:49:03.378 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:03.008+0000 7fe432c7e700 1 -- 172.21.15.100:0/4125822061 shutdown_connections 2023-12-05T09:49:03.378 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:03.008+0000 7fe432c7e700 1 -- 172.21.15.100:0/4125822061 wait complete. 2023-12-05T09:49:03.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:03 smithi100 ceph-mon[107145]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-12-05T09:49:03.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:03 smithi100 ceph-mon[107145]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-12-05T09:49:03.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:03 smithi100 ceph-mon[107145]: [05/Dec/2023:09:49:02] ENGINE Bus STARTING 2023-12-05T09:49:03.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:03 smithi100 ceph-mon[107145]: [05/Dec/2023:09:49:02] ENGINE Serving on https://172.21.15.100:7150 2023-12-05T09:49:03.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:03 smithi100 ceph-mon[107145]: [05/Dec/2023:09:49:02] ENGINE Bus STARTED 2023-12-05T09:49:03.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:03 smithi100 ceph-mon[107145]: from='mgr.14118 172.21.15.100:0/3445090407' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:49:03.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:03 smithi100 ceph-mon[107145]: from='mgr.14118 172.21.15.100:0/3445090407' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:49:03.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:03 smithi100 ceph-mon[107145]: from='mgr.14118 172.21.15.100:0/3445090407' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:49:03.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:03 smithi100 ceph-mon[107145]: from='mgr.14118 172.21.15.100:0/3445090407' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:49:04.307 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout value unchanged 2023-12-05T09:49:04.307 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:03.745+0000 7ff5bee05700 1 Processor -- start 2023-12-05T09:49:04.307 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:03.745+0000 7ff5bee05700 1 -- start start 2023-12-05T09:49:04.308 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:03.745+0000 7ff5bee05700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5b8077bb0 0x7ff5b80760c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:04.308 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:03.745+0000 7ff5bee05700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b8077fc0 con 0x7ff5b8077bb0 2023-12-05T09:49:04.308 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:03.745+0000 7ff5bcba1700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5b8077bb0 0x7ff5b80760c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:04.308 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:03.745+0000 7ff5bcba1700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5b8077bb0 0x7ff5b80760c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44342/0 (socket says 172.21.15.100:44342) 2023-12-05T09:49:04.308 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:03.745+0000 7ff5bcba1700 1 -- 172.21.15.100:0/1529201614 learned_addr learned my addr 172.21.15.100:0/1529201614 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:49:04.308 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:03.746+0000 7ff5bcba1700 1 -- 172.21.15.100:0/1529201614 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b8076600 con 0x7ff5b8077bb0 2023-12-05T09:49:04.308 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:03.746+0000 7ff5bcba1700 1 --2- 172.21.15.100:0/1529201614 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5b8077bb0 0x7ff5b80760c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac0098e0 tx=0x7ff5ac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92da16780c8c48dd server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:04.308 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:03.746+0000 7ff5b77fe700 1 -- 172.21.15.100:0/1529201614 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff5ac00b860 con 0x7ff5b8077bb0 2023-12-05T09:49:04.308 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:03.746+0000 7ff5b77fe700 1 -- 172.21.15.100:0/1529201614 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7ff5ac00be30 con 0x7ff5b8077bb0 2023-12-05T09:49:04.308 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:03.746+0000 7ff5b77fe700 1 -- 172.21.15.100:0/1529201614 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff5ac010380 con 0x7ff5b8077bb0 2023-12-05T09:49:04.308 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:03.747+0000 7ff5bee05700 1 -- 172.21.15.100:0/1529201614 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5b8077bb0 msgr2=0x7ff5b80760c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:04.309 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:03.747+0000 7ff5bee05700 1 --2- 172.21.15.100:0/1529201614 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5b8077bb0 0x7ff5b80760c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac0098e0 tx=0x7ff5ac009250 comp rx=0 tx=0).stop 2023-12-05T09:49:04.309 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:03.747+0000 7ff5bee05700 1 -- 172.21.15.100:0/1529201614 shutdown_connections 2023-12-05T09:49:04.309 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:03.747+0000 7ff5bee05700 1 --2- 172.21.15.100:0/1529201614 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5b8077bb0 0x7ff5b80760c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:04.309 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:03.747+0000 7ff5bee05700 1 -- 172.21.15.100:0/1529201614 >> 172.21.15.100:0/1529201614 conn(0x7ff5b80fda50 msgr2=0x7ff5b80ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:49:04.309 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:03.747+0000 7ff5bee05700 1 -- 172.21.15.100:0/1529201614 shutdown_connections 2023-12-05T09:49:04.309 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:03.747+0000 7ff5bee05700 1 -- 172.21.15.100:0/1529201614 wait complete. 2023-12-05T09:49:04.309 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:03.748+0000 7ff5bee05700 1 Processor -- start 2023-12-05T09:49:04.309 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:03.748+0000 7ff5bee05700 1 -- start start 2023-12-05T09:49:04.309 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:03.749+0000 7ff5bee05700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5b8077bb0 0x7ff5b81133d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:04.309 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:03.749+0000 7ff5bee05700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b8113910 con 0x7ff5b8077bb0 2023-12-05T09:49:04.309 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:03.749+0000 7ff5bcba1700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5b8077bb0 0x7ff5b81133d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:04.309 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:03.749+0000 7ff5bcba1700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5b8077bb0 0x7ff5b81133d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44344/0 (socket says 172.21.15.100:44344) 2023-12-05T09:49:04.309 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:03.749+0000 7ff5bcba1700 1 -- 172.21.15.100:0/882693672 learned_addr learned my addr 172.21.15.100:0/882693672 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:49:04.309 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:03.749+0000 7ff5bcba1700 1 -- 172.21.15.100:0/882693672 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5ac0094f0 con 0x7ff5b8077bb0 2023-12-05T09:49:04.310 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:03.750+0000 7ff5bcba1700 1 --2- 172.21.15.100:0/882693672 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5b8077bb0 0x7ff5b81133d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac006fd0 tx=0x7ff5ac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:04.310 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:03.750+0000 7ff5b57fa700 1 -- 172.21.15.100:0/882693672 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff5ac010750 con 0x7ff5b8077bb0 2023-12-05T09:49:04.310 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:03.750+0000 7ff5b57fa700 1 -- 172.21.15.100:0/882693672 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7ff5ac010d20 con 0x7ff5b8077bb0 2023-12-05T09:49:04.310 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:03.750+0000 7ff5b57fa700 1 -- 172.21.15.100:0/882693672 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff5ac01ada0 con 0x7ff5b8077bb0 2023-12-05T09:49:04.310 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:03.750+0000 7ff5bee05700 1 -- 172.21.15.100:0/882693672 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5b8113b10 con 0x7ff5b8077bb0 2023-12-05T09:49:04.310 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:03.750+0000 7ff5bee05700 1 -- 172.21.15.100:0/882693672 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5b8113f20 con 0x7ff5b8077bb0 2023-12-05T09:49:04.310 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:03.751+0000 7ff5b57fa700 1 -- 172.21.15.100:0/882693672 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 43175+0+0 (secure 0 0 0) 0x7ff5ac0108b0 con 0x7ff5b8077bb0 2023-12-05T09:49:04.310 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:03.751+0000 7ff5bee05700 1 -- 172.21.15.100:0/882693672 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5b804bb80 con 0x7ff5b8077bb0 2023-12-05T09:49:04.310 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:03.752+0000 7ff5b57fa700 1 --2- 172.21.15.100:0/882693672 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7ff5a8036510 0x7ff5a80389c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:04.310 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:03.752+0000 7ff5b57fa700 1 -- 172.21.15.100:0/882693672 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7ff5ac0499f0 con 0x7ff5b8077bb0 2023-12-05T09:49:04.310 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:03.752+0000 7ff5b7fff700 1 --2- 172.21.15.100:0/882693672 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7ff5a8036510 0x7ff5a80389c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:04.310 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:03.752+0000 7ff5b7fff700 1 --2- 172.21.15.100:0/882693672 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7ff5a8036510 0x7ff5a80389c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4009990 tx=0x7ff5a4006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:04.310 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:03.757+0000 7ff5b57fa700 1 -- 172.21.15.100:0/882693672 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ff5ac01a5d0 con 0x7ff5b8077bb0 2023-12-05T09:49:04.310 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:03.948+0000 7ff5bee05700 1 -- 172.21.15.100:0/882693672 --> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7ff5b810d200 con 0x7ff5a8036510 2023-12-05T09:49:04.311 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:03.949+0000 7ff5b57fa700 1 -- 172.21.15.100:0/882693672 <== mgr.14118 v2:172.21.15.100:6800/2647899624 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7ff5b810d200 con 0x7ff5a8036510 2023-12-05T09:49:04.311 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:03.951+0000 7ff5bee05700 1 -- 172.21.15.100:0/882693672 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7ff5a8036510 msgr2=0x7ff5a80389c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:04.311 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:03.951+0000 7ff5bee05700 1 --2- 172.21.15.100:0/882693672 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7ff5a8036510 0x7ff5a80389c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4009990 tx=0x7ff5a4006e40 comp rx=0 tx=0).stop 2023-12-05T09:49:04.311 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:03.951+0000 7ff5bee05700 1 -- 172.21.15.100:0/882693672 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5b8077bb0 msgr2=0x7ff5b81133d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:04.311 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:03.951+0000 7ff5bee05700 1 --2- 172.21.15.100:0/882693672 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5b8077bb0 0x7ff5b81133d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac006fd0 tx=0x7ff5ac009250 comp rx=0 tx=0).stop 2023-12-05T09:49:04.311 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:03.951+0000 7ff5bee05700 1 -- 172.21.15.100:0/882693672 shutdown_connections 2023-12-05T09:49:04.311 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:03.951+0000 7ff5bee05700 1 --2- 172.21.15.100:0/882693672 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7ff5a8036510 0x7ff5a80389c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:04.311 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:03.951+0000 7ff5bee05700 1 --2- 172.21.15.100:0/882693672 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5b8077bb0 0x7ff5b81133d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:04.311 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:03.951+0000 7ff5bee05700 1 -- 172.21.15.100:0/882693672 >> 172.21.15.100:0/882693672 conn(0x7ff5b80fda50 msgr2=0x7ff5b80ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:49:04.311 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:03.951+0000 7ff5bee05700 1 -- 172.21.15.100:0/882693672 shutdown_connections 2023-12-05T09:49:04.311 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:03.951+0000 7ff5bee05700 1 -- 172.21.15.100:0/882693672 wait complete. 2023-12-05T09:49:04.311 INFO:teuthology.orchestra.run.smithi100.stdout:Generating ssh key... 2023-12-05T09:49:04.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:04 smithi100 ceph-mon[107145]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:49:04.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:04 smithi100 ceph-mon[107145]: mgrmap e8: smithi100.ehmuhg(active, since 2s) 2023-12-05T09:49:05.508 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:04.718+0000 7fb915a0f700 1 Processor -- start 2023-12-05T09:49:05.508 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:04.718+0000 7fb915a0f700 1 -- start start 2023-12-05T09:49:05.508 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:04.719+0000 7fb915a0f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb910077bd0 0x7fb9100760e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:05.508 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:04.719+0000 7fb915a0f700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb910077fe0 con 0x7fb910077bd0 2023-12-05T09:49:05.508 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:04.719+0000 7fb90effd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb910077bd0 0x7fb9100760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:05.508 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:04.719+0000 7fb90effd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb910077bd0 0x7fb9100760e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44358/0 (socket says 172.21.15.100:44358) 2023-12-05T09:49:05.508 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:04.719+0000 7fb90effd700 1 -- 172.21.15.100:0/1355246033 learned_addr learned my addr 172.21.15.100:0/1355246033 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:49:05.508 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:04.719+0000 7fb90effd700 1 -- 172.21.15.100:0/1355246033 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb910076620 con 0x7fb910077bd0 2023-12-05T09:49:05.509 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:04.720+0000 7fb90effd700 1 --2- 172.21.15.100:0/1355246033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb910077bd0 0x7fb9100760e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb9000098e0 tx=0x7fb900009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeb6b2607e1ab864 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:05.509 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:04.720+0000 7fb90e7fc700 1 -- 172.21.15.100:0/1355246033 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb90000b860 con 0x7fb910077bd0 2023-12-05T09:49:05.509 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:04.720+0000 7fb90e7fc700 1 -- 172.21.15.100:0/1355246033 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fb90000be30 con 0x7fb910077bd0 2023-12-05T09:49:05.509 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:04.720+0000 7fb90e7fc700 1 -- 172.21.15.100:0/1355246033 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb900010380 con 0x7fb910077bd0 2023-12-05T09:49:05.509 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:04.720+0000 7fb915a0f700 1 -- 172.21.15.100:0/1355246033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb910077bd0 msgr2=0x7fb9100760e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:05.509 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:04.720+0000 7fb915a0f700 1 --2- 172.21.15.100:0/1355246033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb910077bd0 0x7fb9100760e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb9000098e0 tx=0x7fb900009250 comp rx=0 tx=0).stop 2023-12-05T09:49:05.509 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:04.720+0000 7fb915a0f700 1 -- 172.21.15.100:0/1355246033 shutdown_connections 2023-12-05T09:49:05.509 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:04.720+0000 7fb915a0f700 1 --2- 172.21.15.100:0/1355246033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb910077bd0 0x7fb9100760e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:05.509 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:04.720+0000 7fb915a0f700 1 -- 172.21.15.100:0/1355246033 >> 172.21.15.100:0/1355246033 conn(0x7fb9100fda50 msgr2=0x7fb9100ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:49:05.509 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:04.721+0000 7fb915a0f700 1 -- 172.21.15.100:0/1355246033 shutdown_connections 2023-12-05T09:49:05.509 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:04.721+0000 7fb915a0f700 1 -- 172.21.15.100:0/1355246033 wait complete. 2023-12-05T09:49:05.509 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:04.721+0000 7fb915a0f700 1 Processor -- start 2023-12-05T09:49:05.509 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:04.722+0000 7fb915a0f700 1 -- start start 2023-12-05T09:49:05.509 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:04.722+0000 7fb915a0f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb910077bd0 0x7fb9101133c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:05.509 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:04.722+0000 7fb915a0f700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb910113900 con 0x7fb910077bd0 2023-12-05T09:49:05.510 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:04.722+0000 7fb90effd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb910077bd0 0x7fb9101133c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:05.510 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:04.722+0000 7fb90effd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb910077bd0 0x7fb9101133c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44368/0 (socket says 172.21.15.100:44368) 2023-12-05T09:49:05.510 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:04.722+0000 7fb90effd700 1 -- 172.21.15.100:0/1803953113 learned_addr learned my addr 172.21.15.100:0/1803953113 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:49:05.510 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:04.722+0000 7fb90effd700 1 -- 172.21.15.100:0/1803953113 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9000094f0 con 0x7fb910077bd0 2023-12-05T09:49:05.510 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:04.723+0000 7fb90effd700 1 --2- 172.21.15.100:0/1803953113 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb910077bd0 0x7fb9101133c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb900006fd0 tx=0x7fb900009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:05.510 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:04.723+0000 7fb907fff700 1 -- 172.21.15.100:0/1803953113 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb900010750 con 0x7fb910077bd0 2023-12-05T09:49:05.510 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:04.723+0000 7fb907fff700 1 -- 172.21.15.100:0/1803953113 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fb900010d20 con 0x7fb910077bd0 2023-12-05T09:49:05.510 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:04.723+0000 7fb915a0f700 1 -- 172.21.15.100:0/1803953113 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb910113b00 con 0x7fb910077bd0 2023-12-05T09:49:05.510 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:04.723+0000 7fb907fff700 1 -- 172.21.15.100:0/1803953113 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb90001ada0 con 0x7fb910077bd0 2023-12-05T09:49:05.510 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:04.723+0000 7fb915a0f700 1 -- 172.21.15.100:0/1803953113 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb910113f10 con 0x7fb910077bd0 2023-12-05T09:49:05.510 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:04.724+0000 7fb915a0f700 1 -- 172.21.15.100:0/1803953113 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb91004bb80 con 0x7fb910077bd0 2023-12-05T09:49:05.510 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:04.724+0000 7fb907fff700 1 -- 172.21.15.100:0/1803953113 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fb9000108b0 con 0x7fb910077bd0 2023-12-05T09:49:05.510 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:04.725+0000 7fb907fff700 1 --2- 172.21.15.100:0/1803953113 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7fb8fc0365f0 0x7fb8fc038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:05.510 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:04.725+0000 7fb907fff700 1 -- 172.21.15.100:0/1803953113 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fb900049c00 con 0x7fb910077bd0 2023-12-05T09:49:05.511 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:04.725+0000 7fb9067fc700 1 --2- 172.21.15.100:0/1803953113 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7fb8fc0365f0 0x7fb8fc038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:05.511 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:04.725+0000 7fb9067fc700 1 --2- 172.21.15.100:0/1803953113 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7fb8fc0365f0 0x7fb8fc038aa0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb8f8009990 tx=0x7fb8f8006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:05.511 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:04.729+0000 7fb907fff700 1 -- 172.21.15.100:0/1803953113 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fb90001a5d0 con 0x7fb910077bd0 2023-12-05T09:49:05.511 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:04.920+0000 7fb915a0f700 1 -- 172.21.15.100:0/1803953113 --> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7fb9100008d0 con 0x7fb8fc0365f0 2023-12-05T09:49:05.511 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:05.145+0000 7fb907fff700 1 -- 172.21.15.100:0/1803953113 <== mgr.14118 v2:172.21.15.100:6800/2647899624 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fb9100008d0 con 0x7fb8fc0365f0 2023-12-05T09:49:05.511 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:05.148+0000 7fb915a0f700 1 -- 172.21.15.100:0/1803953113 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7fb8fc0365f0 msgr2=0x7fb8fc038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:05.512 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:05.148+0000 7fb915a0f700 1 --2- 172.21.15.100:0/1803953113 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7fb8fc0365f0 0x7fb8fc038aa0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb8f8009990 tx=0x7fb8f8006e40 comp rx=0 tx=0).stop 2023-12-05T09:49:05.512 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:05.148+0000 7fb915a0f700 1 -- 172.21.15.100:0/1803953113 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb910077bd0 msgr2=0x7fb9101133c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:05.512 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:05.148+0000 7fb915a0f700 1 --2- 172.21.15.100:0/1803953113 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb910077bd0 0x7fb9101133c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb900006fd0 tx=0x7fb900009250 comp rx=0 tx=0).stop 2023-12-05T09:49:05.512 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:05.148+0000 7fb915a0f700 1 -- 172.21.15.100:0/1803953113 shutdown_connections 2023-12-05T09:49:05.512 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:05.148+0000 7fb915a0f700 1 --2- 172.21.15.100:0/1803953113 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7fb8fc0365f0 0x7fb8fc038aa0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:05.512 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:05.148+0000 7fb915a0f700 1 --2- 172.21.15.100:0/1803953113 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb910077bd0 0x7fb9101133c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:05.512 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:05.148+0000 7fb915a0f700 1 -- 172.21.15.100:0/1803953113 >> 172.21.15.100:0/1803953113 conn(0x7fb9100fda50 msgr2=0x7fb9100ff250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:49:05.512 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:05.148+0000 7fb915a0f700 1 -- 172.21.15.100:0/1803953113 shutdown_connections 2023-12-05T09:49:05.512 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:05.148+0000 7fb915a0f700 1 -- 172.21.15.100:0/1803953113 wait complete. 2023-12-05T09:49:05.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:05 smithi100 ceph-mon[107145]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:49:05.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:05 smithi100 ceph-mon[107145]: from='mgr.14118 172.21.15.100:0/3445090407' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:49:05.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:05 smithi100 ceph-mon[107145]: from='mgr.14118 172.21.15.100:0/3445090407' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:49:06.446 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDIE/8lVOKD1/uRhb84cg6Ufo9SHGvXM/Wf5pvnGeRX3RneGbr1BaLsz/HTn70LwmtolBoVss53OSZOkZdObjkdEClmTHOkFzupfV7HHHrdLFcZ9XzAmLSit6uw+ZcaxLuuOeZFA7Uj7lIBiKi21VfwcFeyjsCE82Fc7jApS7XOYIOUU1bpw1Vbu/dtMKZ3haeY9gncFm+uDTq/afwBasors5Fl4Igd5YYWrbKCBROiiARQ9hHiP00uHk2aOZ1mSTmmyUYTUI4s9HAuJWzbO6XL3z7pTgzjoWZ3eNR+GW6DcmUMqspWaGuucSGUq3sl3dhu0U7MehAuwhM7TiFSdi1biYK9ZP/pLVzxr8DItIsnbz5oksDkIBxNoZYJrLgcxsJ2NeNxNNkN1cBVtmidWjj2yTPweG/N3aMqkN+2hYbgSJTqAokGhdgOCk/tyuMdltNSlry3XS41WyaZDemWOQi1PvPUNFrAIjN7oDETYaBFSm8Ty5vzaE9slEoUaxWlAWk= ceph-5b035ce6-9353-11ee-95a2-87774f69a715 2023-12-05T09:49:06.446 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:05.892+0000 7f1624e66700 1 Processor -- start 2023-12-05T09:49:06.446 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:05.892+0000 7f1624e66700 1 -- start start 2023-12-05T09:49:06.446 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:05.892+0000 7f1624e66700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1620077bd0 0x7f16200760e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:06.446 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:05.892+0000 7f1624e66700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1620077fe0 con 0x7f1620077bd0 2023-12-05T09:49:06.446 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:05.893+0000 7f161e59c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1620077bd0 0x7f16200760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:06.446 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:05.893+0000 7f161e59c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1620077bd0 0x7f16200760e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44370/0 (socket says 172.21.15.100:44370) 2023-12-05T09:49:06.446 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:05.893+0000 7f161e59c700 1 -- 172.21.15.100:0/1963778033 learned_addr learned my addr 172.21.15.100:0/1963778033 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:49:06.446 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:05.893+0000 7f161e59c700 1 -- 172.21.15.100:0/1963778033 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1620076620 con 0x7f1620077bd0 2023-12-05T09:49:06.446 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:05.893+0000 7f161e59c700 1 --2- 172.21.15.100:0/1963778033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1620077bd0 0x7f16200760e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f16100098e0 tx=0x7f1610009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed62302ddd0f8bd server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:06.447 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:05.893+0000 7f161d59a700 1 -- 172.21.15.100:0/1963778033 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f161000b860 con 0x7f1620077bd0 2023-12-05T09:49:06.447 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:05.893+0000 7f161d59a700 1 -- 172.21.15.100:0/1963778033 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f161000be30 con 0x7f1620077bd0 2023-12-05T09:49:06.447 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:05.893+0000 7f161d59a700 1 -- 172.21.15.100:0/1963778033 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1610010380 con 0x7f1620077bd0 2023-12-05T09:49:06.447 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:05.894+0000 7f1624e66700 1 -- 172.21.15.100:0/1963778033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1620077bd0 msgr2=0x7f16200760e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:06.447 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:05.894+0000 7f1624e66700 1 --2- 172.21.15.100:0/1963778033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1620077bd0 0x7f16200760e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f16100098e0 tx=0x7f1610009250 comp rx=0 tx=0).stop 2023-12-05T09:49:06.447 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:05.894+0000 7f1624e66700 1 -- 172.21.15.100:0/1963778033 shutdown_connections 2023-12-05T09:49:06.447 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:05.894+0000 7f1624e66700 1 --2- 172.21.15.100:0/1963778033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1620077bd0 0x7f16200760e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:06.447 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:05.894+0000 7f1624e66700 1 -- 172.21.15.100:0/1963778033 >> 172.21.15.100:0/1963778033 conn(0x7f16200fda50 msgr2=0x7f16200ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:49:06.447 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:05.894+0000 7f1624e66700 1 -- 172.21.15.100:0/1963778033 shutdown_connections 2023-12-05T09:49:06.447 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:05.894+0000 7f1624e66700 1 -- 172.21.15.100:0/1963778033 wait complete. 2023-12-05T09:49:06.447 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:05.895+0000 7f1624e66700 1 Processor -- start 2023-12-05T09:49:06.447 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:05.895+0000 7f1624e66700 1 -- start start 2023-12-05T09:49:06.447 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:05.895+0000 7f1624e66700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1620077bd0 0x7f16201133c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:06.447 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:05.895+0000 7f1624e66700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1620113900 con 0x7f1620077bd0 2023-12-05T09:49:06.448 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:05.896+0000 7f161e59c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1620077bd0 0x7f16201133c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:06.448 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:05.896+0000 7f161e59c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1620077bd0 0x7f16201133c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44380/0 (socket says 172.21.15.100:44380) 2023-12-05T09:49:06.448 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:05.896+0000 7f161e59c700 1 -- 172.21.15.100:0/22363381 learned_addr learned my addr 172.21.15.100:0/22363381 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:49:06.448 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:05.896+0000 7f161e59c700 1 -- 172.21.15.100:0/22363381 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16100094f0 con 0x7f1620077bd0 2023-12-05T09:49:06.448 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:05.896+0000 7f161e59c700 1 --2- 172.21.15.100:0/22363381 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1620077bd0 0x7f16201133c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1610006fd0 tx=0x7f1610009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:06.448 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:05.896+0000 7f160effd700 1 -- 172.21.15.100:0/22363381 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1610010750 con 0x7f1620077bd0 2023-12-05T09:49:06.448 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:05.896+0000 7f160effd700 1 -- 172.21.15.100:0/22363381 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f1610010d20 con 0x7f1620077bd0 2023-12-05T09:49:06.448 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:05.896+0000 7f1624e66700 1 -- 172.21.15.100:0/22363381 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1620113b00 con 0x7f1620077bd0 2023-12-05T09:49:06.448 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:05.896+0000 7f160effd700 1 -- 172.21.15.100:0/22363381 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f161001ada0 con 0x7f1620077bd0 2023-12-05T09:49:06.448 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:05.897+0000 7f1624e66700 1 -- 172.21.15.100:0/22363381 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1620113f10 con 0x7f1620077bd0 2023-12-05T09:49:06.448 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:05.897+0000 7f160effd700 1 -- 172.21.15.100:0/22363381 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f16100193c0 con 0x7f1620077bd0 2023-12-05T09:49:06.448 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:05.898+0000 7f1624e66700 1 -- 172.21.15.100:0/22363381 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f162004bb80 con 0x7f1620077bd0 2023-12-05T09:49:06.448 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:05.898+0000 7f160effd700 1 --2- 172.21.15.100:0/22363381 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f1608036640 0x7f1608038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:06.448 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:05.898+0000 7f160effd700 1 -- 172.21.15.100:0/22363381 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f1610049be0 con 0x7f1620077bd0 2023-12-05T09:49:06.449 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:05.898+0000 7f161dd9b700 1 --2- 172.21.15.100:0/22363381 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f1608036640 0x7f1608038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:06.449 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:05.899+0000 7f161dd9b700 1 --2- 172.21.15.100:0/22363381 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f1608036640 0x7f1608038af0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1614009990 tx=0x7f1614006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:06.449 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:05.903+0000 7f160effd700 1 -- 172.21.15.100:0/22363381 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f1610023360 con 0x7f1620077bd0 2023-12-05T09:49:06.449 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:06.098+0000 7f1624e66700 1 -- 172.21.15.100:0/22363381 --> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f162010d1f0 con 0x7f1608036640 2023-12-05T09:49:06.449 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:06.099+0000 7f160effd700 1 -- 172.21.15.100:0/22363381 <== mgr.14118 v2:172.21.15.100:6800/2647899624 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f162010d1f0 con 0x7f1608036640 2023-12-05T09:49:06.449 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:06.101+0000 7f1624e66700 1 -- 172.21.15.100:0/22363381 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f1608036640 msgr2=0x7f1608038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:06.449 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:06.101+0000 7f1624e66700 1 --2- 172.21.15.100:0/22363381 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f1608036640 0x7f1608038af0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1614009990 tx=0x7f1614006e40 comp rx=0 tx=0).stop 2023-12-05T09:49:06.449 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:06.101+0000 7f1624e66700 1 -- 172.21.15.100:0/22363381 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1620077bd0 msgr2=0x7f16201133c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:06.449 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:06.101+0000 7f1624e66700 1 --2- 172.21.15.100:0/22363381 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1620077bd0 0x7f16201133c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1610006fd0 tx=0x7f1610009250 comp rx=0 tx=0).stop 2023-12-05T09:49:06.449 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:06.101+0000 7f1624e66700 1 -- 172.21.15.100:0/22363381 shutdown_connections 2023-12-05T09:49:06.449 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:06.101+0000 7f1624e66700 1 --2- 172.21.15.100:0/22363381 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f1608036640 0x7f1608038af0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:06.449 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:06.101+0000 7f1624e66700 1 --2- 172.21.15.100:0/22363381 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1620077bd0 0x7f16201133c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:06.449 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:06.101+0000 7f1624e66700 1 -- 172.21.15.100:0/22363381 >> 172.21.15.100:0/22363381 conn(0x7f16200fda50 msgr2=0x7f16200ff250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:49:06.449 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:06.101+0000 7f1624e66700 1 -- 172.21.15.100:0/22363381 shutdown_connections 2023-12-05T09:49:06.450 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:06.101+0000 7f1624e66700 1 -- 172.21.15.100:0/22363381 wait complete. 2023-12-05T09:49:06.450 INFO:teuthology.orchestra.run.smithi100.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2023-12-05T09:49:06.450 INFO:teuthology.orchestra.run.smithi100.stdout:Adding key to root@localhost authorized_keys... 2023-12-05T09:49:06.450 INFO:teuthology.orchestra.run.smithi100.stdout:Adding host smithi100... 2023-12-05T09:49:06.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:06 smithi100 ceph-mon[107145]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:49:06.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:06 smithi100 ceph-mon[107145]: Generating ssh key... 2023-12-05T09:49:07.747 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:07 smithi100 ceph-mon[107145]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:49:08.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:08 smithi100 ceph-mon[107145]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi100", "addr": "172.21.15.100", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:49:09.841 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:09 smithi100 ceph-mon[107145]: Deploying cephadm binary to smithi100 2023-12-05T09:49:09.986 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout Added host 'smithi100' with addr '172.21.15.100' 2023-12-05T09:49:10.173 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:06.854+0000 7f25b0571700 1 Processor -- start 2023-12-05T09:49:10.173 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:06.854+0000 7f25b0571700 1 -- start start 2023-12-05T09:49:10.173 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:06.854+0000 7f25b0571700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25a8077bd0 0x7f25a80760e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:10.173 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:06.854+0000 7f25b0571700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a8077fe0 con 0x7f25a8077bd0 2023-12-05T09:49:10.173 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:06.855+0000 7f25ae30d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25a8077bd0 0x7f25a80760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:10.173 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:06.855+0000 7f25ae30d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25a8077bd0 0x7f25a80760e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44386/0 (socket says 172.21.15.100:44386) 2023-12-05T09:49:10.173 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:06.855+0000 7f25ae30d700 1 -- 172.21.15.100:0/279890287 learned_addr learned my addr 172.21.15.100:0/279890287 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:49:10.174 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:06.855+0000 7f25ae30d700 1 -- 172.21.15.100:0/279890287 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a8076620 con 0x7f25a8077bd0 2023-12-05T09:49:10.174 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:06.855+0000 7f25ae30d700 1 --2- 172.21.15.100:0/279890287 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25a8077bd0 0x7f25a80760e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f25a40098e0 tx=0x7f25a4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59098bb69f4269d4 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:10.178 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:06.855+0000 7f25ad30b700 1 -- 172.21.15.100:0/279890287 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f25a400b860 con 0x7f25a8077bd0 2023-12-05T09:49:10.178 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:06.855+0000 7f25ad30b700 1 -- 172.21.15.100:0/279890287 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f25a400be30 con 0x7f25a8077bd0 2023-12-05T09:49:10.178 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:06.855+0000 7f25ad30b700 1 -- 172.21.15.100:0/279890287 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f25a4010380 con 0x7f25a8077bd0 2023-12-05T09:49:10.178 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:06.856+0000 7f25b0571700 1 -- 172.21.15.100:0/279890287 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25a8077bd0 msgr2=0x7f25a80760e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:10.178 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:06.856+0000 7f25b0571700 1 --2- 172.21.15.100:0/279890287 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25a8077bd0 0x7f25a80760e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f25a40098e0 tx=0x7f25a4009250 comp rx=0 tx=0).stop 2023-12-05T09:49:10.178 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:06.856+0000 7f25b0571700 1 -- 172.21.15.100:0/279890287 shutdown_connections 2023-12-05T09:49:10.178 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:06.856+0000 7f25b0571700 1 --2- 172.21.15.100:0/279890287 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25a8077bd0 0x7f25a80760e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:10.178 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:06.856+0000 7f25b0571700 1 -- 172.21.15.100:0/279890287 >> 172.21.15.100:0/279890287 conn(0x7f25a80fda50 msgr2=0x7f25a80ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:49:10.178 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:06.856+0000 7f25b0571700 1 -- 172.21.15.100:0/279890287 shutdown_connections 2023-12-05T09:49:10.179 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:06.856+0000 7f25b0571700 1 -- 172.21.15.100:0/279890287 wait complete. 2023-12-05T09:49:10.179 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:06.857+0000 7f25b0571700 1 Processor -- start 2023-12-05T09:49:10.179 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:06.857+0000 7f25b0571700 1 -- start start 2023-12-05T09:49:10.179 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:06.857+0000 7f25b0571700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25a8077bd0 0x7f25a8113370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:10.179 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:06.857+0000 7f25b0571700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a81138b0 con 0x7f25a8077bd0 2023-12-05T09:49:10.179 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:06.858+0000 7f25ae30d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25a8077bd0 0x7f25a8113370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:10.179 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:06.858+0000 7f25ae30d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25a8077bd0 0x7f25a8113370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44398/0 (socket says 172.21.15.100:44398) 2023-12-05T09:49:10.179 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:06.858+0000 7f25ae30d700 1 -- 172.21.15.100:0/1126887446 learned_addr learned my addr 172.21.15.100:0/1126887446 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:49:10.179 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:06.858+0000 7f25ae30d700 1 -- 172.21.15.100:0/1126887446 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a40094f0 con 0x7f25a8077bd0 2023-12-05T09:49:10.179 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:06.858+0000 7f25ae30d700 1 --2- 172.21.15.100:0/1126887446 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25a8077bd0 0x7f25a8113370 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f25a4006fd0 tx=0x7f25a4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:10.179 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:06.858+0000 7f259effd700 1 -- 172.21.15.100:0/1126887446 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f25a4010750 con 0x7f25a8077bd0 2023-12-05T09:49:10.179 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:06.858+0000 7f259effd700 1 -- 172.21.15.100:0/1126887446 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f25a4010d20 con 0x7f25a8077bd0 2023-12-05T09:49:10.179 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:06.858+0000 7f259effd700 1 -- 172.21.15.100:0/1126887446 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f25a401ada0 con 0x7f25a8077bd0 2023-12-05T09:49:10.180 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:06.859+0000 7f25b0571700 1 -- 172.21.15.100:0/1126887446 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25a8113ab0 con 0x7f25a8077bd0 2023-12-05T09:49:10.180 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:06.859+0000 7f25b0571700 1 -- 172.21.15.100:0/1126887446 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25a8113ec0 con 0x7f25a8077bd0 2023-12-05T09:49:10.180 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:06.860+0000 7f259effd700 1 -- 172.21.15.100:0/1126887446 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f25a40108b0 con 0x7f25a8077bd0 2023-12-05T09:49:10.180 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:06.860+0000 7f25b0571700 1 -- 172.21.15.100:0/1126887446 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25a804bb80 con 0x7f25a8077bd0 2023-12-05T09:49:10.180 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:06.860+0000 7f259effd700 1 --2- 172.21.15.100:0/1126887446 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f2594036640 0x7f2594038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:10.180 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:06.860+0000 7f259effd700 1 -- 172.21.15.100:0/1126887446 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f25a4049c00 con 0x7f25a8077bd0 2023-12-05T09:49:10.181 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:06.860+0000 7f25adb0c700 1 --2- 172.21.15.100:0/1126887446 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f2594036640 0x7f2594038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:10.181 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:06.861+0000 7f25adb0c700 1 --2- 172.21.15.100:0/1126887446 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f2594036640 0x7f2594038af0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2598009990 tx=0x7f2598006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:10.181 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:06.865+0000 7f259effd700 1 -- 172.21.15.100:0/1126887446 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f25a401a5d0 con 0x7f25a8077bd0 2023-12-05T09:49:10.182 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:07.062+0000 7f25b0571700 1 -- 172.21.15.100:0/1126887446 --> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi100", "addr": "172.21.15.100", "target": ["mon-mgr", ""]}) v1 -- 0x7f25a810d1f0 con 0x7f2594036640 2023-12-05T09:49:10.182 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:09.644+0000 7f259effd700 1 -- 172.21.15.100:0/1126887446 <== mgr.14118 v2:172.21.15.100:6800/2647899624 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f25a810d1f0 con 0x7f2594036640 2023-12-05T09:49:10.182 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:09.647+0000 7f25b0571700 1 -- 172.21.15.100:0/1126887446 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f2594036640 msgr2=0x7f2594038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:10.182 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:09.647+0000 7f25b0571700 1 --2- 172.21.15.100:0/1126887446 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f2594036640 0x7f2594038af0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2598009990 tx=0x7f2598006e40 comp rx=0 tx=0).stop 2023-12-05T09:49:10.182 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:09.647+0000 7f25b0571700 1 -- 172.21.15.100:0/1126887446 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25a8077bd0 msgr2=0x7f25a8113370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:10.182 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:09.647+0000 7f25b0571700 1 --2- 172.21.15.100:0/1126887446 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25a8077bd0 0x7f25a8113370 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f25a4006fd0 tx=0x7f25a4009250 comp rx=0 tx=0).stop 2023-12-05T09:49:10.182 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:09.647+0000 7f25b0571700 1 -- 172.21.15.100:0/1126887446 shutdown_connections 2023-12-05T09:49:10.182 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:09.647+0000 7f25b0571700 1 --2- 172.21.15.100:0/1126887446 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f2594036640 0x7f2594038af0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:10.182 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:09.647+0000 7f25b0571700 1 --2- 172.21.15.100:0/1126887446 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25a8077bd0 0x7f25a8113370 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:10.182 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:09.647+0000 7f25b0571700 1 -- 172.21.15.100:0/1126887446 >> 172.21.15.100:0/1126887446 conn(0x7f25a80fda50 msgr2=0x7f25a80ffe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:49:10.182 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:09.647+0000 7f25b0571700 1 -- 172.21.15.100:0/1126887446 shutdown_connections 2023-12-05T09:49:10.182 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:09.647+0000 7f25b0571700 1 -- 172.21.15.100:0/1126887446 wait complete. 2023-12-05T09:49:10.182 INFO:teuthology.orchestra.run.smithi100.stdout:Deploying mon service with default placement... 2023-12-05T09:49:10.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:10 smithi100 ceph-mon[107145]: from='mgr.14118 172.21.15.100:0/3445090407' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:49:10.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:10 smithi100 ceph-mon[107145]: Added host smithi100 2023-12-05T09:49:10.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:10 smithi100 ceph-mon[107145]: from='mgr.14118 172.21.15.100:0/3445090407' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:49:10.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:10 smithi100 ceph-mon[107145]: from='mgr.14118 172.21.15.100:0/3445090407' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:49:10.977 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2023-12-05T09:49:10.977 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:10.392+0000 7f9ffa67e700 1 Processor -- start 2023-12-05T09:49:10.977 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:10.392+0000 7f9ffa67e700 1 -- start start 2023-12-05T09:49:10.977 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:10.393+0000 7f9ffa67e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ff4077bb0 0x7f9ff40760c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:10.977 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:10.393+0000 7f9ffa67e700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff4077fc0 con 0x7f9ff4077bb0 2023-12-05T09:49:10.977 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:10.393+0000 7f9ff3fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ff4077bb0 0x7f9ff40760c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:10.978 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:10.393+0000 7f9ff3fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ff4077bb0 0x7f9ff40760c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36826/0 (socket says 172.21.15.100:36826) 2023-12-05T09:49:10.978 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:10.393+0000 7f9ff3fff700 1 -- 172.21.15.100:0/500463493 learned_addr learned my addr 172.21.15.100:0/500463493 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:49:10.978 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:10.393+0000 7f9ff3fff700 1 -- 172.21.15.100:0/500463493 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff4076600 con 0x7f9ff4077bb0 2023-12-05T09:49:10.978 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:10.394+0000 7f9ff3fff700 1 --2- 172.21.15.100:0/500463493 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ff4077bb0 0x7f9ff40760c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9fe40098e0 tx=0x7f9fe4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b66e56bf324e291 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:10.978 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:10.394+0000 7f9ff2ffd700 1 -- 172.21.15.100:0/500463493 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9fe400b860 con 0x7f9ff4077bb0 2023-12-05T09:49:10.978 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:10.394+0000 7f9ff2ffd700 1 -- 172.21.15.100:0/500463493 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f9fe400be30 con 0x7f9ff4077bb0 2023-12-05T09:49:10.978 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:10.394+0000 7f9ff2ffd700 1 -- 172.21.15.100:0/500463493 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9fe4010380 con 0x7f9ff4077bb0 2023-12-05T09:49:10.978 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:10.394+0000 7f9ffa67e700 1 -- 172.21.15.100:0/500463493 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ff4077bb0 msgr2=0x7f9ff40760c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:10.978 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:10.394+0000 7f9ffa67e700 1 --2- 172.21.15.100:0/500463493 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ff4077bb0 0x7f9ff40760c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9fe40098e0 tx=0x7f9fe4009250 comp rx=0 tx=0).stop 2023-12-05T09:49:10.978 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:10.394+0000 7f9ffa67e700 1 -- 172.21.15.100:0/500463493 shutdown_connections 2023-12-05T09:49:10.978 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:10.394+0000 7f9ffa67e700 1 --2- 172.21.15.100:0/500463493 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ff4077bb0 0x7f9ff40760c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:10.978 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:10.394+0000 7f9ffa67e700 1 -- 172.21.15.100:0/500463493 >> 172.21.15.100:0/500463493 conn(0x7f9ff40fda50 msgr2=0x7f9ff40ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:49:10.978 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:10.395+0000 7f9ffa67e700 1 -- 172.21.15.100:0/500463493 shutdown_connections 2023-12-05T09:49:10.978 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:10.395+0000 7f9ffa67e700 1 -- 172.21.15.100:0/500463493 wait complete. 2023-12-05T09:49:10.979 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:10.395+0000 7f9ffa67e700 1 Processor -- start 2023-12-05T09:49:10.979 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:10.395+0000 7f9ffa67e700 1 -- start start 2023-12-05T09:49:10.979 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:10.396+0000 7f9ffa67e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ff4077bb0 0x7f9ff41133d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:10.979 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:10.396+0000 7f9ffa67e700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff4113910 con 0x7f9ff4077bb0 2023-12-05T09:49:10.979 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:10.396+0000 7f9ff3fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ff4077bb0 0x7f9ff41133d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:10.979 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:10.396+0000 7f9ff3fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ff4077bb0 0x7f9ff41133d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36832/0 (socket says 172.21.15.100:36832) 2023-12-05T09:49:10.979 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:10.396+0000 7f9ff3fff700 1 -- 172.21.15.100:0/2307833801 learned_addr learned my addr 172.21.15.100:0/2307833801 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:49:10.979 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:10.396+0000 7f9ff3fff700 1 -- 172.21.15.100:0/2307833801 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe40094f0 con 0x7f9ff4077bb0 2023-12-05T09:49:10.979 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:10.396+0000 7f9ff3fff700 1 --2- 172.21.15.100:0/2307833801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ff4077bb0 0x7f9ff41133d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9fe400b440 tx=0x7f9fe4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:10.979 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:10.397+0000 7f9ff0ff9700 1 -- 172.21.15.100:0/2307833801 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9fe40107a0 con 0x7f9ff4077bb0 2023-12-05T09:49:10.979 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:10.397+0000 7f9ff0ff9700 1 -- 172.21.15.100:0/2307833801 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f9fe4010d70 con 0x7f9ff4077bb0 2023-12-05T09:49:10.979 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:10.397+0000 7f9ffa67e700 1 -- 172.21.15.100:0/2307833801 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ff4113b10 con 0x7f9ff4077bb0 2023-12-05T09:49:10.979 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:10.397+0000 7f9ff0ff9700 1 -- 172.21.15.100:0/2307833801 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9fe401adc0 con 0x7f9ff4077bb0 2023-12-05T09:49:10.980 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:10.397+0000 7f9ffa67e700 1 -- 172.21.15.100:0/2307833801 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ff4113f20 con 0x7f9ff4077bb0 2023-12-05T09:49:10.980 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:10.398+0000 7f9ff0ff9700 1 -- 172.21.15.100:0/2307833801 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f9fe4010900 con 0x7f9ff4077bb0 2023-12-05T09:49:10.980 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:10.398+0000 7f9ffa67e700 1 -- 172.21.15.100:0/2307833801 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ff404bb80 con 0x7f9ff4077bb0 2023-12-05T09:49:10.980 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:10.398+0000 7f9ff0ff9700 1 --2- 172.21.15.100:0/2307833801 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f9fdc036640 0x7f9fdc038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:10.980 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:10.398+0000 7f9ff0ff9700 1 -- 172.21.15.100:0/2307833801 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f9fe4049d20 con 0x7f9ff4077bb0 2023-12-05T09:49:10.980 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:10.399+0000 7f9ff37fe700 1 --2- 172.21.15.100:0/2307833801 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f9fdc036640 0x7f9fdc038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:10.980 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:10.399+0000 7f9ff37fe700 1 --2- 172.21.15.100:0/2307833801 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f9fdc036640 0x7f9fdc038af0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9fe8009990 tx=0x7f9fe8006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:10.980 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:10.403+0000 7f9ff0ff9700 1 -- 172.21.15.100:0/2307833801 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f9fe4006d70 con 0x7f9ff4077bb0 2023-12-05T09:49:10.980 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:10.606+0000 7f9ffa67e700 1 -- 172.21.15.100:0/2307833801 --> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7f9ff410d200 con 0x7f9fdc036640 2023-12-05T09:49:10.980 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:10.611+0000 7f9ff0ff9700 1 -- 172.21.15.100:0/2307833801 <== mgr.14118 v2:172.21.15.100:6800/2647899624 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f9ff410d200 con 0x7f9fdc036640 2023-12-05T09:49:10.980 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:10.613+0000 7f9ffa67e700 1 -- 172.21.15.100:0/2307833801 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f9fdc036640 msgr2=0x7f9fdc038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:10.980 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:10.613+0000 7f9ffa67e700 1 --2- 172.21.15.100:0/2307833801 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f9fdc036640 0x7f9fdc038af0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9fe8009990 tx=0x7f9fe8006e40 comp rx=0 tx=0).stop 2023-12-05T09:49:10.980 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:10.613+0000 7f9ffa67e700 1 -- 172.21.15.100:0/2307833801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ff4077bb0 msgr2=0x7f9ff41133d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:10.980 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:10.613+0000 7f9ffa67e700 1 --2- 172.21.15.100:0/2307833801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ff4077bb0 0x7f9ff41133d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9fe400b440 tx=0x7f9fe4009250 comp rx=0 tx=0).stop 2023-12-05T09:49:10.981 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:10.613+0000 7f9ffa67e700 1 -- 172.21.15.100:0/2307833801 shutdown_connections 2023-12-05T09:49:10.981 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:10.613+0000 7f9ffa67e700 1 --2- 172.21.15.100:0/2307833801 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f9fdc036640 0x7f9fdc038af0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:10.981 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:10.613+0000 7f9ffa67e700 1 --2- 172.21.15.100:0/2307833801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ff4077bb0 0x7f9ff41133d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:10.981 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:10.613+0000 7f9ffa67e700 1 -- 172.21.15.100:0/2307833801 >> 172.21.15.100:0/2307833801 conn(0x7f9ff40fda50 msgr2=0x7f9ff40ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:49:10.981 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:10.613+0000 7f9ffa67e700 1 -- 172.21.15.100:0/2307833801 shutdown_connections 2023-12-05T09:49:10.981 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:10.613+0000 7f9ffa67e700 1 -- 172.21.15.100:0/2307833801 wait complete. 2023-12-05T09:49:10.981 INFO:teuthology.orchestra.run.smithi100.stdout:Deploying mgr service with default placement... 2023-12-05T09:49:11.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:11 smithi100 ceph-mon[107145]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:49:11.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:11 smithi100 ceph-mon[107145]: Saving service mon spec with placement count:5 2023-12-05T09:49:12.212 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2023-12-05T09:49:12.212 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:11.447+0000 7f352c023700 1 Processor -- start 2023-12-05T09:49:12.212 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:11.447+0000 7f352c023700 1 -- start start 2023-12-05T09:49:12.212 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:11.447+0000 7f352c023700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3524077bb0 0x7f35240760c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:12.212 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:11.448+0000 7f352c023700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3524077fc0 con 0x7f3524077bb0 2023-12-05T09:49:12.212 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:11.448+0000 7f3529dbf700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3524077bb0 0x7f35240760c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:12.212 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:11.448+0000 7f3529dbf700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3524077bb0 0x7f35240760c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36834/0 (socket says 172.21.15.100:36834) 2023-12-05T09:49:12.212 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:11.448+0000 7f3529dbf700 1 -- 172.21.15.100:0/2130511738 learned_addr learned my addr 172.21.15.100:0/2130511738 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:49:12.213 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:11.448+0000 7f3529dbf700 1 -- 172.21.15.100:0/2130511738 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3524076600 con 0x7f3524077bb0 2023-12-05T09:49:12.213 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:11.449+0000 7f3529dbf700 1 --2- 172.21.15.100:0/2130511738 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3524077bb0 0x7f35240760c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f35200098e0 tx=0x7f3520009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd17a363017456e4 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:12.213 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:11.449+0000 7f3528dbd700 1 -- 172.21.15.100:0/2130511738 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f352000b860 con 0x7f3524077bb0 2023-12-05T09:49:12.213 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:11.449+0000 7f3528dbd700 1 -- 172.21.15.100:0/2130511738 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f352000be30 con 0x7f3524077bb0 2023-12-05T09:49:12.213 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:11.449+0000 7f3528dbd700 1 -- 172.21.15.100:0/2130511738 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3520010380 con 0x7f3524077bb0 2023-12-05T09:49:12.213 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:11.449+0000 7f352c023700 1 -- 172.21.15.100:0/2130511738 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3524077bb0 msgr2=0x7f35240760c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:12.213 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:11.449+0000 7f352c023700 1 --2- 172.21.15.100:0/2130511738 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3524077bb0 0x7f35240760c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f35200098e0 tx=0x7f3520009250 comp rx=0 tx=0).stop 2023-12-05T09:49:12.213 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:11.450+0000 7f352c023700 1 -- 172.21.15.100:0/2130511738 shutdown_connections 2023-12-05T09:49:12.213 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:11.450+0000 7f352c023700 1 --2- 172.21.15.100:0/2130511738 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3524077bb0 0x7f35240760c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:12.213 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:11.450+0000 7f352c023700 1 -- 172.21.15.100:0/2130511738 >> 172.21.15.100:0/2130511738 conn(0x7f35240fda50 msgr2=0x7f35240ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:49:12.213 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:11.450+0000 7f352c023700 1 -- 172.21.15.100:0/2130511738 shutdown_connections 2023-12-05T09:49:12.213 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:11.450+0000 7f352c023700 1 -- 172.21.15.100:0/2130511738 wait complete. 2023-12-05T09:49:12.213 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:11.451+0000 7f352c023700 1 Processor -- start 2023-12-05T09:49:12.214 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:11.451+0000 7f352c023700 1 -- start start 2023-12-05T09:49:12.214 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:11.451+0000 7f352c023700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3524077bb0 0x7f35241133d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:12.214 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:11.451+0000 7f352c023700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3524113910 con 0x7f3524077bb0 2023-12-05T09:49:12.214 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:11.451+0000 7f3529dbf700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3524077bb0 0x7f35241133d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:12.214 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:11.451+0000 7f3529dbf700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3524077bb0 0x7f35241133d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36846/0 (socket says 172.21.15.100:36846) 2023-12-05T09:49:12.214 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:11.451+0000 7f3529dbf700 1 -- 172.21.15.100:0/3437663681 learned_addr learned my addr 172.21.15.100:0/3437663681 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:49:12.214 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:11.452+0000 7f3529dbf700 1 -- 172.21.15.100:0/3437663681 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35200094f0 con 0x7f3524077bb0 2023-12-05T09:49:12.214 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:11.452+0000 7f3529dbf700 1 --2- 172.21.15.100:0/3437663681 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3524077bb0 0x7f35241133d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3520006fd0 tx=0x7f3520009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:12.214 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:11.452+0000 7f351a7fc700 1 -- 172.21.15.100:0/3437663681 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3520010750 con 0x7f3524077bb0 2023-12-05T09:49:12.214 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:11.452+0000 7f351a7fc700 1 -- 172.21.15.100:0/3437663681 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f3520010d20 con 0x7f3524077bb0 2023-12-05T09:49:12.214 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:11.452+0000 7f351a7fc700 1 -- 172.21.15.100:0/3437663681 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f352001ada0 con 0x7f3524077bb0 2023-12-05T09:49:12.214 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:11.452+0000 7f352c023700 1 -- 172.21.15.100:0/3437663681 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3524113b10 con 0x7f3524077bb0 2023-12-05T09:49:12.215 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:11.452+0000 7f352c023700 1 -- 172.21.15.100:0/3437663681 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3524113f20 con 0x7f3524077bb0 2023-12-05T09:49:12.215 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:11.454+0000 7f351a7fc700 1 -- 172.21.15.100:0/3437663681 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f35200108b0 con 0x7f3524077bb0 2023-12-05T09:49:12.215 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:11.454+0000 7f352c023700 1 -- 172.21.15.100:0/3437663681 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f352404bb80 con 0x7f3524077bb0 2023-12-05T09:49:12.215 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:11.454+0000 7f351a7fc700 1 --2- 172.21.15.100:0/3437663681 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f3510036640 0x7f3510038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:12.215 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:11.454+0000 7f351a7fc700 1 -- 172.21.15.100:0/3437663681 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f3520049bc0 con 0x7f3524077bb0 2023-12-05T09:49:12.215 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:11.454+0000 7f35295be700 1 --2- 172.21.15.100:0/3437663681 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f3510036640 0x7f3510038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:12.215 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:11.455+0000 7f35295be700 1 --2- 172.21.15.100:0/3437663681 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f3510036640 0x7f3510038af0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3514009990 tx=0x7f3514006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:12.215 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:11.459+0000 7f351a7fc700 1 -- 172.21.15.100:0/3437663681 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f352002c350 con 0x7f3524077bb0 2023-12-05T09:49:12.215 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:11.671+0000 7f352c023700 1 -- 172.21.15.100:0/3437663681 --> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f35240008d0 con 0x7f3510036640 2023-12-05T09:49:12.215 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:11.676+0000 7f351a7fc700 1 -- 172.21.15.100:0/3437663681 <== mgr.14118 v2:172.21.15.100:6800/2647899624 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f35240008d0 con 0x7f3510036640 2023-12-05T09:49:12.215 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:11.678+0000 7f352c023700 1 -- 172.21.15.100:0/3437663681 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f3510036640 msgr2=0x7f3510038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:12.215 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:11.678+0000 7f352c023700 1 --2- 172.21.15.100:0/3437663681 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f3510036640 0x7f3510038af0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3514009990 tx=0x7f3514006e40 comp rx=0 tx=0).stop 2023-12-05T09:49:12.216 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:11.678+0000 7f352c023700 1 -- 172.21.15.100:0/3437663681 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3524077bb0 msgr2=0x7f35241133d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:12.216 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:11.678+0000 7f352c023700 1 --2- 172.21.15.100:0/3437663681 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3524077bb0 0x7f35241133d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3520006fd0 tx=0x7f3520009250 comp rx=0 tx=0).stop 2023-12-05T09:49:12.216 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:11.678+0000 7f352c023700 1 -- 172.21.15.100:0/3437663681 shutdown_connections 2023-12-05T09:49:12.216 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:11.678+0000 7f352c023700 1 --2- 172.21.15.100:0/3437663681 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f3510036640 0x7f3510038af0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:12.216 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:11.678+0000 7f352c023700 1 --2- 172.21.15.100:0/3437663681 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3524077bb0 0x7f35241133d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:12.216 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:11.678+0000 7f352c023700 1 -- 172.21.15.100:0/3437663681 >> 172.21.15.100:0/3437663681 conn(0x7f35240fda50 msgr2=0x7f35240ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:49:12.216 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:11.678+0000 7f352c023700 1 -- 172.21.15.100:0/3437663681 shutdown_connections 2023-12-05T09:49:12.216 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:11.678+0000 7f352c023700 1 -- 172.21.15.100:0/3437663681 wait complete. 2023-12-05T09:49:12.216 INFO:teuthology.orchestra.run.smithi100.stdout:Deploying crash service with default placement... 2023-12-05T09:49:13.073 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:12 smithi100 ceph-mon[107145]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:49:13.074 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:12 smithi100 ceph-mon[107145]: Saving service mgr spec with placement count:2 2023-12-05T09:49:13.074 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:12 smithi100 ceph-mon[107145]: from='mgr.14118 172.21.15.100:0/3445090407' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:49:13.074 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:12 smithi100 ceph-mon[107145]: from='mgr.14118 172.21.15.100:0/3445090407' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:49:13.074 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:12 smithi100 ceph-mon[107145]: from='mgr.14118 172.21.15.100:0/3445090407' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:49:13.220 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2023-12-05T09:49:13.220 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:12.658+0000 7f029c698700 1 Processor -- start 2023-12-05T09:49:13.220 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:12.658+0000 7f029c698700 1 -- start start 2023-12-05T09:49:13.221 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:12.658+0000 7f029c698700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0294077bb0 0x7f02940760c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:13.221 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:12.658+0000 7f029c698700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0294077fc0 con 0x7f0294077bb0 2023-12-05T09:49:13.221 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:12.659+0000 7f029a434700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0294077bb0 0x7f02940760c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:13.221 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:12.659+0000 7f029a434700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0294077bb0 0x7f02940760c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36852/0 (socket says 172.21.15.100:36852) 2023-12-05T09:49:13.221 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:12.659+0000 7f029a434700 1 -- 172.21.15.100:0/2032977075 learned_addr learned my addr 172.21.15.100:0/2032977075 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:49:13.221 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:12.659+0000 7f029a434700 1 -- 172.21.15.100:0/2032977075 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0294076600 con 0x7f0294077bb0 2023-12-05T09:49:13.221 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:12.659+0000 7f029a434700 1 --2- 172.21.15.100:0/2032977075 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0294077bb0 0x7f02940760c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f02900098e0 tx=0x7f0290009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a05d2d61892ab45e server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:13.221 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:12.660+0000 7f0299432700 1 -- 172.21.15.100:0/2032977075 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f029000b860 con 0x7f0294077bb0 2023-12-05T09:49:13.221 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:12.660+0000 7f0299432700 1 -- 172.21.15.100:0/2032977075 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f029000be70 con 0x7f0294077bb0 2023-12-05T09:49:13.221 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:12.660+0000 7f0299432700 1 -- 172.21.15.100:0/2032977075 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0290010380 con 0x7f0294077bb0 2023-12-05T09:49:13.221 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:12.660+0000 7f029c698700 1 -- 172.21.15.100:0/2032977075 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0294077bb0 msgr2=0x7f02940760c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:13.221 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:12.660+0000 7f029c698700 1 --2- 172.21.15.100:0/2032977075 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0294077bb0 0x7f02940760c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f02900098e0 tx=0x7f0290009250 comp rx=0 tx=0).stop 2023-12-05T09:49:13.221 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:12.660+0000 7f029c698700 1 -- 172.21.15.100:0/2032977075 shutdown_connections 2023-12-05T09:49:13.221 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:12.660+0000 7f029c698700 1 --2- 172.21.15.100:0/2032977075 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0294077bb0 0x7f02940760c0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:13.222 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:12.661+0000 7f029c698700 1 -- 172.21.15.100:0/2032977075 >> 172.21.15.100:0/2032977075 conn(0x7f02940fda50 msgr2=0x7f02940ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:49:13.222 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:12.661+0000 7f029c698700 1 -- 172.21.15.100:0/2032977075 shutdown_connections 2023-12-05T09:49:13.222 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:12.661+0000 7f029c698700 1 -- 172.21.15.100:0/2032977075 wait complete. 2023-12-05T09:49:13.222 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:12.661+0000 7f029c698700 1 Processor -- start 2023-12-05T09:49:13.222 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:12.662+0000 7f029c698700 1 -- start start 2023-12-05T09:49:13.222 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:12.662+0000 7f029c698700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0294077bb0 0x7f02941133d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:13.222 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:12.662+0000 7f029c698700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0294113910 con 0x7f0294077bb0 2023-12-05T09:49:13.223 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:12.662+0000 7f029a434700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0294077bb0 0x7f02941133d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:13.223 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:12.662+0000 7f029a434700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0294077bb0 0x7f02941133d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36862/0 (socket says 172.21.15.100:36862) 2023-12-05T09:49:13.223 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:12.662+0000 7f029a434700 1 -- 172.21.15.100:0/4159485268 learned_addr learned my addr 172.21.15.100:0/4159485268 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:49:13.223 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:12.663+0000 7f029a434700 1 -- 172.21.15.100:0/4159485268 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02900094f0 con 0x7f0294077bb0 2023-12-05T09:49:13.223 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:12.663+0000 7f029a434700 1 --2- 172.21.15.100:0/4159485268 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0294077bb0 0x7f02941133d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0290006d40 tx=0x7f0290009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:13.223 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:12.663+0000 7f028affd700 1 -- 172.21.15.100:0/4159485268 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0290010960 con 0x7f0294077bb0 2023-12-05T09:49:13.223 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:12.663+0000 7f028affd700 1 -- 172.21.15.100:0/4159485268 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f029001a430 con 0x7f0294077bb0 2023-12-05T09:49:13.223 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:12.663+0000 7f029c698700 1 -- 172.21.15.100:0/4159485268 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0294113b10 con 0x7f0294077bb0 2023-12-05T09:49:13.223 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:12.663+0000 7f028affd700 1 -- 172.21.15.100:0/4159485268 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f02900245b0 con 0x7f0294077bb0 2023-12-05T09:49:13.223 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:12.663+0000 7f029c698700 1 -- 172.21.15.100:0/4159485268 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0294113f20 con 0x7f0294077bb0 2023-12-05T09:49:13.223 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:12.664+0000 7f029c698700 1 -- 172.21.15.100:0/4159485268 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f029404bb80 con 0x7f0294077bb0 2023-12-05T09:49:13.223 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:12.665+0000 7f028affd700 1 -- 172.21.15.100:0/4159485268 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f029001a9f0 con 0x7f0294077bb0 2023-12-05T09:49:13.224 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:12.665+0000 7f028affd700 1 --2- 172.21.15.100:0/4159485268 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f0280036640 0x7f0280038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:13.224 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:12.665+0000 7f028affd700 1 -- 172.21.15.100:0/4159485268 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f029004a110 con 0x7f0294077bb0 2023-12-05T09:49:13.224 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:12.666+0000 7f0299c33700 1 --2- 172.21.15.100:0/4159485268 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f0280036640 0x7f0280038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:13.224 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:12.666+0000 7f0299c33700 1 --2- 172.21.15.100:0/4159485268 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f0280036640 0x7f0280038af0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0284009990 tx=0x7f0284006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:13.224 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:12.670+0000 7f028affd700 1 -- 172.21.15.100:0/4159485268 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f029002b8c0 con 0x7f0294077bb0 2023-12-05T09:49:13.224 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:12.881+0000 7f029c698700 1 -- 172.21.15.100:0/4159485268 --> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7f029410d200 con 0x7f0280036640 2023-12-05T09:49:13.224 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:12.889+0000 7f028affd700 1 -- 172.21.15.100:0/4159485268 <== mgr.14118 v2:172.21.15.100:6800/2647899624 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7f029410d200 con 0x7f0280036640 2023-12-05T09:49:13.224 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:12.891+0000 7f029c698700 1 -- 172.21.15.100:0/4159485268 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f0280036640 msgr2=0x7f0280038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:13.224 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:12.891+0000 7f029c698700 1 --2- 172.21.15.100:0/4159485268 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f0280036640 0x7f0280038af0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0284009990 tx=0x7f0284006e40 comp rx=0 tx=0).stop 2023-12-05T09:49:13.224 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:12.891+0000 7f029c698700 1 -- 172.21.15.100:0/4159485268 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0294077bb0 msgr2=0x7f02941133d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:13.224 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:12.891+0000 7f029c698700 1 --2- 172.21.15.100:0/4159485268 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0294077bb0 0x7f02941133d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0290006d40 tx=0x7f0290009250 comp rx=0 tx=0).stop 2023-12-05T09:49:13.224 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:12.891+0000 7f029c698700 1 -- 172.21.15.100:0/4159485268 shutdown_connections 2023-12-05T09:49:13.224 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:12.891+0000 7f029c698700 1 --2- 172.21.15.100:0/4159485268 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f0280036640 0x7f0280038af0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:13.224 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:12.891+0000 7f029c698700 1 --2- 172.21.15.100:0/4159485268 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0294077bb0 0x7f02941133d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:13.225 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:12.891+0000 7f029c698700 1 -- 172.21.15.100:0/4159485268 >> 172.21.15.100:0/4159485268 conn(0x7f02940fda50 msgr2=0x7f02940ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:49:13.225 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:12.892+0000 7f029c698700 1 -- 172.21.15.100:0/4159485268 shutdown_connections 2023-12-05T09:49:13.225 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:12.892+0000 7f029c698700 1 -- 172.21.15.100:0/4159485268 wait complete. 2023-12-05T09:49:13.225 INFO:teuthology.orchestra.run.smithi100.stdout:Deploying prometheus service with default placement... 2023-12-05T09:49:13.990 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:13 smithi100 ceph-mon[107145]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:49:13.990 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:13 smithi100 ceph-mon[107145]: Saving service crash spec with placement * 2023-12-05T09:49:13.990 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:13 smithi100 ceph-mon[107145]: from='mgr.14118 172.21.15.100:0/3445090407' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:49:14.335 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2023-12-05T09:49:14.338 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:13.721+0000 7f854b3bc700 1 Processor -- start 2023-12-05T09:49:14.338 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:13.721+0000 7f854b3bc700 1 -- start start 2023-12-05T09:49:14.338 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:13.721+0000 7f854b3bc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8544077bd0 0x7f85440760e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:14.338 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:13.721+0000 7f854b3bc700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8544077fe0 con 0x7f8544077bd0 2023-12-05T09:49:14.338 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:13.722+0000 7f8549158700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8544077bd0 0x7f85440760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:14.338 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:13.722+0000 7f8549158700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8544077bd0 0x7f85440760e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36878/0 (socket says 172.21.15.100:36878) 2023-12-05T09:49:14.338 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:13.722+0000 7f8549158700 1 -- 172.21.15.100:0/204947377 learned_addr learned my addr 172.21.15.100:0/204947377 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:49:14.338 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:13.722+0000 7f8549158700 1 -- 172.21.15.100:0/204947377 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8544076620 con 0x7f8544077bd0 2023-12-05T09:49:14.338 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:13.722+0000 7f8549158700 1 --2- 172.21.15.100:0/204947377 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8544077bd0 0x7f85440760e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f85400098e0 tx=0x7f8540009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5b8b3278b13c782 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:14.338 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:13.723+0000 7f853bfff700 1 -- 172.21.15.100:0/204947377 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f854000b860 con 0x7f8544077bd0 2023-12-05T09:49:14.339 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:13.723+0000 7f853bfff700 1 -- 172.21.15.100:0/204947377 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f854000be70 con 0x7f8544077bd0 2023-12-05T09:49:14.339 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:13.723+0000 7f853bfff700 1 -- 172.21.15.100:0/204947377 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8540010380 con 0x7f8544077bd0 2023-12-05T09:49:14.339 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:13.723+0000 7f854b3bc700 1 -- 172.21.15.100:0/204947377 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8544077bd0 msgr2=0x7f85440760e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:14.339 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:13.723+0000 7f854b3bc700 1 --2- 172.21.15.100:0/204947377 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8544077bd0 0x7f85440760e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f85400098e0 tx=0x7f8540009250 comp rx=0 tx=0).stop 2023-12-05T09:49:14.339 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:13.723+0000 7f854b3bc700 1 -- 172.21.15.100:0/204947377 shutdown_connections 2023-12-05T09:49:14.339 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:13.723+0000 7f854b3bc700 1 --2- 172.21.15.100:0/204947377 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8544077bd0 0x7f85440760e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:14.339 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:13.723+0000 7f854b3bc700 1 -- 172.21.15.100:0/204947377 >> 172.21.15.100:0/204947377 conn(0x7f85440fda50 msgr2=0x7f85440ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:49:14.339 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:13.724+0000 7f854b3bc700 1 -- 172.21.15.100:0/204947377 shutdown_connections 2023-12-05T09:49:14.339 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:13.724+0000 7f854b3bc700 1 -- 172.21.15.100:0/204947377 wait complete. 2023-12-05T09:49:14.339 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:13.725+0000 7f854b3bc700 1 Processor -- start 2023-12-05T09:49:14.339 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:13.725+0000 7f854b3bc700 1 -- start start 2023-12-05T09:49:14.339 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:13.725+0000 7f854b3bc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8544077bd0 0x7f85441133c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:14.339 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:13.725+0000 7f854b3bc700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8544113900 con 0x7f8544077bd0 2023-12-05T09:49:14.340 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:13.726+0000 7f8549158700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8544077bd0 0x7f85441133c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:14.340 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:13.726+0000 7f8549158700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8544077bd0 0x7f85441133c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36890/0 (socket says 172.21.15.100:36890) 2023-12-05T09:49:14.340 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:13.726+0000 7f8549158700 1 -- 172.21.15.100:0/65850540 learned_addr learned my addr 172.21.15.100:0/65850540 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:49:14.340 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:13.726+0000 7f8549158700 1 -- 172.21.15.100:0/65850540 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85400094f0 con 0x7f8544077bd0 2023-12-05T09:49:14.340 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:13.726+0000 7f8549158700 1 --2- 172.21.15.100:0/65850540 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8544077bd0 0x7f85441133c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8540006d40 tx=0x7f8540009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:14.340 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:13.726+0000 7f8539ffb700 1 -- 172.21.15.100:0/65850540 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8540010960 con 0x7f8544077bd0 2023-12-05T09:49:14.340 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:13.727+0000 7f8539ffb700 1 -- 172.21.15.100:0/65850540 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f854001a430 con 0x7f8544077bd0 2023-12-05T09:49:14.340 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:13.727+0000 7f854b3bc700 1 -- 172.21.15.100:0/65850540 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8544113b00 con 0x7f8544077bd0 2023-12-05T09:49:14.340 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:13.727+0000 7f8539ffb700 1 -- 172.21.15.100:0/65850540 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f85400245b0 con 0x7f8544077bd0 2023-12-05T09:49:14.340 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:13.727+0000 7f854b3bc700 1 -- 172.21.15.100:0/65850540 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8544113f10 con 0x7f8544077bd0 2023-12-05T09:49:14.340 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:13.728+0000 7f8539ffb700 1 -- 172.21.15.100:0/65850540 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f854002d3f0 con 0x7f8544077bd0 2023-12-05T09:49:14.340 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:13.728+0000 7f854b3bc700 1 -- 172.21.15.100:0/65850540 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f854404bb80 con 0x7f8544077bd0 2023-12-05T09:49:14.340 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:13.730+0000 7f8539ffb700 1 --2- 172.21.15.100:0/65850540 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f8530036640 0x7f8530038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:14.340 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:13.730+0000 7f8539ffb700 1 -- 172.21.15.100:0/65850540 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f854004a2e0 con 0x7f8544077bd0 2023-12-05T09:49:14.341 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:13.730+0000 7f8548957700 1 --2- 172.21.15.100:0/65850540 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f8530036640 0x7f8530038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:14.341 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:13.730+0000 7f8548957700 1 --2- 172.21.15.100:0/65850540 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f8530036640 0x7f8530038af0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8534009990 tx=0x7f8534006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:14.341 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:13.734+0000 7f8539ffb700 1 -- 172.21.15.100:0/65850540 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f85400189a0 con 0x7f8544077bd0 2023-12-05T09:49:14.341 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:13.963+0000 7f854b3bc700 1 -- 172.21.15.100:0/65850540 --> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7f854410d1f0 con 0x7f8530036640 2023-12-05T09:49:14.341 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:13.967+0000 7f8539ffb700 1 -- 172.21.15.100:0/65850540 <== mgr.14118 v2:172.21.15.100:6800/2647899624 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7f854410d1f0 con 0x7f8530036640 2023-12-05T09:49:14.341 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:13.970+0000 7f854b3bc700 1 -- 172.21.15.100:0/65850540 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f8530036640 msgr2=0x7f8530038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:14.341 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:13.970+0000 7f854b3bc700 1 --2- 172.21.15.100:0/65850540 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f8530036640 0x7f8530038af0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8534009990 tx=0x7f8534006e40 comp rx=0 tx=0).stop 2023-12-05T09:49:14.341 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:13.970+0000 7f854b3bc700 1 -- 172.21.15.100:0/65850540 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8544077bd0 msgr2=0x7f85441133c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:14.341 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:13.970+0000 7f854b3bc700 1 --2- 172.21.15.100:0/65850540 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8544077bd0 0x7f85441133c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8540006d40 tx=0x7f8540009250 comp rx=0 tx=0).stop 2023-12-05T09:49:14.341 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:13.970+0000 7f854b3bc700 1 -- 172.21.15.100:0/65850540 shutdown_connections 2023-12-05T09:49:14.341 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:13.970+0000 7f854b3bc700 1 --2- 172.21.15.100:0/65850540 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f8530036640 0x7f8530038af0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:14.341 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:13.970+0000 7f854b3bc700 1 --2- 172.21.15.100:0/65850540 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8544077bd0 0x7f85441133c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:14.341 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:13.970+0000 7f854b3bc700 1 -- 172.21.15.100:0/65850540 >> 172.21.15.100:0/65850540 conn(0x7f85440fda50 msgr2=0x7f85440ff250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:49:14.341 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:13.970+0000 7f854b3bc700 1 -- 172.21.15.100:0/65850540 shutdown_connections 2023-12-05T09:49:14.342 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:13.970+0000 7f854b3bc700 1 -- 172.21.15.100:0/65850540 wait complete. 2023-12-05T09:49:14.342 INFO:teuthology.orchestra.run.smithi100.stdout:Deploying grafana service with default placement... 2023-12-05T09:49:15.205 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:14 smithi100 ceph-mon[107145]: from='mgr.14118 172.21.15.100:0/3445090407' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:49:15.205 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:14 smithi100 ceph-mon[107145]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:49:15.205 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:14 smithi100 ceph-mon[107145]: Saving service prometheus spec with placement count:1 2023-12-05T09:49:15.206 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:14 smithi100 ceph-mon[107145]: from='mgr.14118 172.21.15.100:0/3445090407' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:49:15.337 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2023-12-05T09:49:15.337 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:14.749+0000 7fd81ccbf700 1 Processor -- start 2023-12-05T09:49:15.338 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:14.750+0000 7fd81ccbf700 1 -- start start 2023-12-05T09:49:15.338 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:14.750+0000 7fd81ccbf700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8181022d0 0x7fd8181026e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:15.338 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:14.750+0000 7fd81ccbf700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd818102c20 con 0x7fd8181022d0 2023-12-05T09:49:15.338 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:14.750+0000 7fd81659c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8181022d0 0x7fd8181026e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:15.338 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:14.750+0000 7fd81659c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8181022d0 0x7fd8181026e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36902/0 (socket says 172.21.15.100:36902) 2023-12-05T09:49:15.338 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:14.750+0000 7fd81659c700 1 -- 172.21.15.100:0/725083155 learned_addr learned my addr 172.21.15.100:0/725083155 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:49:15.338 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:14.751+0000 7fd81659c700 1 -- 172.21.15.100:0/725083155 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd818102d60 con 0x7fd8181022d0 2023-12-05T09:49:15.338 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:14.751+0000 7fd81659c700 1 --2- 172.21.15.100:0/725083155 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8181022d0 0x7fd8181026e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd8080098e0 tx=0x7fd808009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69a84335250940f1 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:15.338 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:14.751+0000 7fd81559a700 1 -- 172.21.15.100:0/725083155 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd80800b860 con 0x7fd8181022d0 2023-12-05T09:49:15.338 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:14.751+0000 7fd81559a700 1 -- 172.21.15.100:0/725083155 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd80800be70 con 0x7fd8181022d0 2023-12-05T09:49:15.338 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:14.751+0000 7fd81559a700 1 -- 172.21.15.100:0/725083155 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd808010380 con 0x7fd8181022d0 2023-12-05T09:49:15.338 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:14.752+0000 7fd81ccbf700 1 -- 172.21.15.100:0/725083155 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8181022d0 msgr2=0x7fd8181026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:15.338 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:14.752+0000 7fd81ccbf700 1 --2- 172.21.15.100:0/725083155 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8181022d0 0x7fd8181026e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd8080098e0 tx=0x7fd808009250 comp rx=0 tx=0).stop 2023-12-05T09:49:15.339 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:14.752+0000 7fd81ccbf700 1 -- 172.21.15.100:0/725083155 shutdown_connections 2023-12-05T09:49:15.339 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:14.752+0000 7fd81ccbf700 1 --2- 172.21.15.100:0/725083155 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8181022d0 0x7fd8181026e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:15.339 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:14.752+0000 7fd81ccbf700 1 -- 172.21.15.100:0/725083155 >> 172.21.15.100:0/725083155 conn(0x7fd8180fda50 msgr2=0x7fd8180ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:49:15.339 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:14.752+0000 7fd81ccbf700 1 -- 172.21.15.100:0/725083155 shutdown_connections 2023-12-05T09:49:15.339 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:14.752+0000 7fd81ccbf700 1 -- 172.21.15.100:0/725083155 wait complete. 2023-12-05T09:49:15.339 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:14.753+0000 7fd81ccbf700 1 Processor -- start 2023-12-05T09:49:15.339 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:14.753+0000 7fd81ccbf700 1 -- start start 2023-12-05T09:49:15.339 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:14.754+0000 7fd81ccbf700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8181022d0 0x7fd818077c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:15.339 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:14.754+0000 7fd81ccbf700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd818076080 con 0x7fd8181022d0 2023-12-05T09:49:15.339 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:14.754+0000 7fd81659c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8181022d0 0x7fd818077c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:15.339 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:14.754+0000 7fd81659c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8181022d0 0x7fd818077c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36904/0 (socket says 172.21.15.100:36904) 2023-12-05T09:49:15.339 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:14.754+0000 7fd81659c700 1 -- 172.21.15.100:0/3045849689 learned_addr learned my addr 172.21.15.100:0/3045849689 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:49:15.339 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:14.754+0000 7fd81659c700 1 -- 172.21.15.100:0/3045849689 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8080094f0 con 0x7fd8181022d0 2023-12-05T09:49:15.339 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:14.755+0000 7fd81659c700 1 --2- 172.21.15.100:0/3045849689 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8181022d0 0x7fd818077c00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd80800c010 tx=0x7fd808009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:15.340 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:14.755+0000 7fd806ffd700 1 -- 172.21.15.100:0/3045849689 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd808010960 con 0x7fd8181022d0 2023-12-05T09:49:15.340 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:14.755+0000 7fd806ffd700 1 -- 172.21.15.100:0/3045849689 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd80801a430 con 0x7fd8181022d0 2023-12-05T09:49:15.340 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:14.755+0000 7fd806ffd700 1 -- 172.21.15.100:0/3045849689 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd808019580 con 0x7fd8181022d0 2023-12-05T09:49:15.340 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:14.755+0000 7fd81ccbf700 1 -- 172.21.15.100:0/3045849689 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd818076280 con 0x7fd8181022d0 2023-12-05T09:49:15.340 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:14.755+0000 7fd81ccbf700 1 -- 172.21.15.100:0/3045849689 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd818076690 con 0x7fd8181022d0 2023-12-05T09:49:15.340 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:14.756+0000 7fd806ffd700 1 -- 172.21.15.100:0/3045849689 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fd80801a980 con 0x7fd8181022d0 2023-12-05T09:49:15.341 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:14.756+0000 7fd81ccbf700 1 -- 172.21.15.100:0/3045849689 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd81804bb80 con 0x7fd8181022d0 2023-12-05T09:49:15.341 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:14.756+0000 7fd806ffd700 1 --2- 172.21.15.100:0/3045849689 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7fd800036640 0x7fd800038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:15.341 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:14.756+0000 7fd806ffd700 1 -- 172.21.15.100:0/3045849689 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fd80804a420 con 0x7fd8181022d0 2023-12-05T09:49:15.341 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:14.757+0000 7fd815d9b700 1 --2- 172.21.15.100:0/3045849689 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7fd800036640 0x7fd800038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:15.341 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:14.757+0000 7fd815d9b700 1 --2- 172.21.15.100:0/3045849689 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7fd800036640 0x7fd800038af0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd80c009990 tx=0x7fd80c006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:15.341 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:14.761+0000 7fd806ffd700 1 -- 172.21.15.100:0/3045849689 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fd80802bb30 con 0x7fd8181022d0 2023-12-05T09:49:15.341 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:15.001+0000 7fd81ccbf700 1 -- 172.21.15.100:0/3045849689 --> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7fd81810ae00 con 0x7fd800036640 2023-12-05T09:49:15.341 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:15.007+0000 7fd806ffd700 1 -- 172.21.15.100:0/3045849689 <== mgr.14118 v2:172.21.15.100:6800/2647899624 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7fd81810ae00 con 0x7fd800036640 2023-12-05T09:49:15.341 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:15.009+0000 7fd81ccbf700 1 -- 172.21.15.100:0/3045849689 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7fd800036640 msgr2=0x7fd800038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:15.341 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:15.009+0000 7fd81ccbf700 1 --2- 172.21.15.100:0/3045849689 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7fd800036640 0x7fd800038af0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd80c009990 tx=0x7fd80c006e40 comp rx=0 tx=0).stop 2023-12-05T09:49:15.341 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:15.009+0000 7fd81ccbf700 1 -- 172.21.15.100:0/3045849689 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8181022d0 msgr2=0x7fd818077c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:15.341 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:15.009+0000 7fd81ccbf700 1 --2- 172.21.15.100:0/3045849689 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8181022d0 0x7fd818077c00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd80800c010 tx=0x7fd808009250 comp rx=0 tx=0).stop 2023-12-05T09:49:15.341 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:15.009+0000 7fd81ccbf700 1 -- 172.21.15.100:0/3045849689 shutdown_connections 2023-12-05T09:49:15.341 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:15.009+0000 7fd81ccbf700 1 --2- 172.21.15.100:0/3045849689 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7fd800036640 0x7fd800038af0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:15.342 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:15.009+0000 7fd81ccbf700 1 --2- 172.21.15.100:0/3045849689 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8181022d0 0x7fd818077c00 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:15.342 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:15.009+0000 7fd81ccbf700 1 -- 172.21.15.100:0/3045849689 >> 172.21.15.100:0/3045849689 conn(0x7fd8180fda50 msgr2=0x7fd8180ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:49:15.342 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:15.010+0000 7fd81ccbf700 1 -- 172.21.15.100:0/3045849689 shutdown_connections 2023-12-05T09:49:15.342 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:15.010+0000 7fd81ccbf700 1 -- 172.21.15.100:0/3045849689 wait complete. 2023-12-05T09:49:15.342 INFO:teuthology.orchestra.run.smithi100.stdout:Deploying node-exporter service with default placement... 2023-12-05T09:49:16.266 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:16 smithi100 ceph-mon[107145]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:49:16.267 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:16 smithi100 ceph-mon[107145]: Saving service grafana spec with placement count:1 2023-12-05T09:49:16.267 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:16 smithi100 ceph-mon[107145]: from='mgr.14118 172.21.15.100:0/3445090407' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:49:16.267 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:16 smithi100 ceph-mon[107145]: from='mgr.14118 172.21.15.100:0/3445090407' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:49:16.547 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2023-12-05T09:49:16.547 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:15.747+0000 7f7f3e745700 1 Processor -- start 2023-12-05T09:49:16.547 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:15.748+0000 7f7f3e745700 1 -- start start 2023-12-05T09:49:16.547 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:15.748+0000 7f7f3e745700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f38077b90 0x7f7f380760a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:16.547 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:15.748+0000 7f7f3e745700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f38077fa0 con 0x7f7f38077b90 2023-12-05T09:49:16.547 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:15.748+0000 7f7f37fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f38077b90 0x7f7f380760a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:16.547 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:15.749+0000 7f7f37fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f38077b90 0x7f7f380760a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36912/0 (socket says 172.21.15.100:36912) 2023-12-05T09:49:16.548 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:15.749+0000 7f7f37fff700 1 -- 172.21.15.100:0/3939291402 learned_addr learned my addr 172.21.15.100:0/3939291402 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:49:16.548 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:15.749+0000 7f7f37fff700 1 -- 172.21.15.100:0/3939291402 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f380765e0 con 0x7f7f38077b90 2023-12-05T09:49:16.548 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:15.749+0000 7f7f37fff700 1 --2- 172.21.15.100:0/3939291402 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f38077b90 0x7f7f380760a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7f280098e0 tx=0x7f7f28009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63b52371838101d4 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:16.548 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:15.749+0000 7f7f36ffd700 1 -- 172.21.15.100:0/3939291402 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7f2800b860 con 0x7f7f38077b90 2023-12-05T09:49:16.548 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:15.749+0000 7f7f36ffd700 1 -- 172.21.15.100:0/3939291402 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7f2800be70 con 0x7f7f38077b90 2023-12-05T09:49:16.548 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:15.749+0000 7f7f36ffd700 1 -- 172.21.15.100:0/3939291402 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7f28010380 con 0x7f7f38077b90 2023-12-05T09:49:16.548 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:15.750+0000 7f7f3e745700 1 -- 172.21.15.100:0/3939291402 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f38077b90 msgr2=0x7f7f380760a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:16.548 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:15.750+0000 7f7f3e745700 1 --2- 172.21.15.100:0/3939291402 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f38077b90 0x7f7f380760a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7f280098e0 tx=0x7f7f28009250 comp rx=0 tx=0).stop 2023-12-05T09:49:16.548 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:15.750+0000 7f7f3e745700 1 -- 172.21.15.100:0/3939291402 shutdown_connections 2023-12-05T09:49:16.548 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:15.750+0000 7f7f3e745700 1 --2- 172.21.15.100:0/3939291402 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f38077b90 0x7f7f380760a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:16.548 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:15.750+0000 7f7f3e745700 1 -- 172.21.15.100:0/3939291402 >> 172.21.15.100:0/3939291402 conn(0x7f7f380fda50 msgr2=0x7f7f380ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:49:16.548 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:15.750+0000 7f7f3e745700 1 -- 172.21.15.100:0/3939291402 shutdown_connections 2023-12-05T09:49:16.548 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:15.750+0000 7f7f3e745700 1 -- 172.21.15.100:0/3939291402 wait complete. 2023-12-05T09:49:16.548 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:15.751+0000 7f7f3e745700 1 Processor -- start 2023-12-05T09:49:16.549 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:15.751+0000 7f7f3e745700 1 -- start start 2023-12-05T09:49:16.549 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:15.752+0000 7f7f3e745700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f38077b90 0x7f7f381133c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:16.549 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:15.752+0000 7f7f3e745700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f38113900 con 0x7f7f38077b90 2023-12-05T09:49:16.549 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:15.752+0000 7f7f37fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f38077b90 0x7f7f381133c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:16.549 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:15.752+0000 7f7f37fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f38077b90 0x7f7f381133c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36920/0 (socket says 172.21.15.100:36920) 2023-12-05T09:49:16.549 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:15.752+0000 7f7f37fff700 1 -- 172.21.15.100:0/3686532826 learned_addr learned my addr 172.21.15.100:0/3686532826 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:49:16.549 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:15.752+0000 7f7f37fff700 1 -- 172.21.15.100:0/3686532826 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f280094f0 con 0x7f7f38077b90 2023-12-05T09:49:16.549 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:15.753+0000 7f7f37fff700 1 --2- 172.21.15.100:0/3686532826 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f38077b90 0x7f7f381133c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7f280094c0 tx=0x7f7f28009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:16.549 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:15.753+0000 7f7f34ff9700 1 -- 172.21.15.100:0/3686532826 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7f28010850 con 0x7f7f38077b90 2023-12-05T09:49:16.549 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:15.753+0000 7f7f34ff9700 1 -- 172.21.15.100:0/3686532826 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7f28010e60 con 0x7f7f38077b90 2023-12-05T09:49:16.549 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:15.753+0000 7f7f34ff9700 1 -- 172.21.15.100:0/3686532826 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7f2801a430 con 0x7f7f38077b90 2023-12-05T09:49:16.549 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:15.753+0000 7f7f3e745700 1 -- 172.21.15.100:0/3686532826 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f38113b00 con 0x7f7f38077b90 2023-12-05T09:49:16.549 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:15.753+0000 7f7f3e745700 1 -- 172.21.15.100:0/3686532826 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f38113f10 con 0x7f7f38077b90 2023-12-05T09:49:16.549 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:15.754+0000 7f7f34ff9700 1 -- 172.21.15.100:0/3686532826 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f7f280247b0 con 0x7f7f38077b90 2023-12-05T09:49:16.550 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:15.754+0000 7f7f3e745700 1 -- 172.21.15.100:0/3686532826 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f3804bb80 con 0x7f7f38077b90 2023-12-05T09:49:16.550 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:15.755+0000 7f7f34ff9700 1 --2- 172.21.15.100:0/3686532826 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f7f200365f0 0x7f7f20038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:16.550 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:15.755+0000 7f7f34ff9700 1 -- 172.21.15.100:0/3686532826 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f7f2804a4e0 con 0x7f7f38077b90 2023-12-05T09:49:16.550 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:15.755+0000 7f7f377fe700 1 --2- 172.21.15.100:0/3686532826 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f7f200365f0 0x7f7f20038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:16.550 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:15.755+0000 7f7f377fe700 1 --2- 172.21.15.100:0/3686532826 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f7f200365f0 0x7f7f20038aa0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c009990 tx=0x7f7f2c006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:16.550 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:15.759+0000 7f7f34ff9700 1 -- 172.21.15.100:0/3686532826 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f7f28022520 con 0x7f7f38077b90 2023-12-05T09:49:16.550 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:16.010+0000 7f7f3e745700 1 -- 172.21.15.100:0/3686532826 --> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7f7f3810d1f0 con 0x7f7f200365f0 2023-12-05T09:49:16.550 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:16.015+0000 7f7f34ff9700 1 -- 172.21.15.100:0/3686532826 <== mgr.14118 v2:172.21.15.100:6800/2647899624 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7f7f3810d1f0 con 0x7f7f200365f0 2023-12-05T09:49:16.550 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:16.017+0000 7f7f3e745700 1 -- 172.21.15.100:0/3686532826 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f7f200365f0 msgr2=0x7f7f20038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:16.550 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:16.017+0000 7f7f3e745700 1 --2- 172.21.15.100:0/3686532826 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f7f200365f0 0x7f7f20038aa0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c009990 tx=0x7f7f2c006e40 comp rx=0 tx=0).stop 2023-12-05T09:49:16.550 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:16.017+0000 7f7f3e745700 1 -- 172.21.15.100:0/3686532826 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f38077b90 msgr2=0x7f7f381133c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:16.550 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:16.017+0000 7f7f3e745700 1 --2- 172.21.15.100:0/3686532826 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f38077b90 0x7f7f381133c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7f280094c0 tx=0x7f7f28009250 comp rx=0 tx=0).stop 2023-12-05T09:49:16.550 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:16.017+0000 7f7f3e745700 1 -- 172.21.15.100:0/3686532826 shutdown_connections 2023-12-05T09:49:16.551 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:16.017+0000 7f7f3e745700 1 --2- 172.21.15.100:0/3686532826 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f7f200365f0 0x7f7f20038aa0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:16.551 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:16.017+0000 7f7f3e745700 1 --2- 172.21.15.100:0/3686532826 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f38077b90 0x7f7f381133c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:16.551 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:16.018+0000 7f7f3e745700 1 -- 172.21.15.100:0/3686532826 >> 172.21.15.100:0/3686532826 conn(0x7f7f380fda50 msgr2=0x7f7f380ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:49:16.551 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:16.018+0000 7f7f3e745700 1 -- 172.21.15.100:0/3686532826 shutdown_connections 2023-12-05T09:49:16.551 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:16.018+0000 7f7f3e745700 1 -- 172.21.15.100:0/3686532826 wait complete. 2023-12-05T09:49:16.551 INFO:teuthology.orchestra.run.smithi100.stdout:Deploying alertmanager service with default placement... 2023-12-05T09:49:17.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:17 smithi100 ceph-mon[107145]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:49:17.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:17 smithi100 ceph-mon[107145]: Saving service node-exporter spec with placement * 2023-12-05T09:49:17.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:17 smithi100 ceph-mon[107145]: from='mgr.14118 172.21.15.100:0/3445090407' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:49:17.631 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2023-12-05T09:49:17.631 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:17.076+0000 7fd61463d700 1 Processor -- start 2023-12-05T09:49:17.637 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:17.076+0000 7fd61463d700 1 -- start start 2023-12-05T09:49:17.637 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:17.077+0000 7fd61463d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd60c077b90 0x7fd60c0760a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:17.637 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:17.077+0000 7fd61463d700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd60c077fa0 con 0x7fd60c077b90 2023-12-05T09:49:17.637 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:17.077+0000 7fd6123d9700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd60c077b90 0x7fd60c0760a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:17.637 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:17.077+0000 7fd6123d9700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd60c077b90 0x7fd60c0760a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36934/0 (socket says 172.21.15.100:36934) 2023-12-05T09:49:17.637 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:17.077+0000 7fd6123d9700 1 -- 172.21.15.100:0/1237737683 learned_addr learned my addr 172.21.15.100:0/1237737683 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:49:17.638 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:17.077+0000 7fd6123d9700 1 -- 172.21.15.100:0/1237737683 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd60c0765e0 con 0x7fd60c077b90 2023-12-05T09:49:17.638 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:17.077+0000 7fd6123d9700 1 --2- 172.21.15.100:0/1237737683 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd60c077b90 0x7fd60c0760a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd6080098e0 tx=0x7fd608009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a90e8b634f8aae37 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:17.638 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:17.078+0000 7fd6113d7700 1 -- 172.21.15.100:0/1237737683 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd60800b860 con 0x7fd60c077b90 2023-12-05T09:49:17.638 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:17.078+0000 7fd6113d7700 1 -- 172.21.15.100:0/1237737683 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd60800be70 con 0x7fd60c077b90 2023-12-05T09:49:17.638 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:17.078+0000 7fd6113d7700 1 -- 172.21.15.100:0/1237737683 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd608010380 con 0x7fd60c077b90 2023-12-05T09:49:17.638 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:17.078+0000 7fd61463d700 1 -- 172.21.15.100:0/1237737683 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd60c077b90 msgr2=0x7fd60c0760a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:17.638 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:17.078+0000 7fd61463d700 1 --2- 172.21.15.100:0/1237737683 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd60c077b90 0x7fd60c0760a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd6080098e0 tx=0x7fd608009250 comp rx=0 tx=0).stop 2023-12-05T09:49:17.638 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:17.078+0000 7fd61463d700 1 -- 172.21.15.100:0/1237737683 shutdown_connections 2023-12-05T09:49:17.638 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:17.078+0000 7fd61463d700 1 --2- 172.21.15.100:0/1237737683 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd60c077b90 0x7fd60c0760a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:17.638 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:17.078+0000 7fd61463d700 1 -- 172.21.15.100:0/1237737683 >> 172.21.15.100:0/1237737683 conn(0x7fd60c0fda50 msgr2=0x7fd60c0ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:49:17.639 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:17.078+0000 7fd61463d700 1 -- 172.21.15.100:0/1237737683 shutdown_connections 2023-12-05T09:49:17.639 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:17.079+0000 7fd61463d700 1 -- 172.21.15.100:0/1237737683 wait complete. 2023-12-05T09:49:17.639 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:17.079+0000 7fd61463d700 1 Processor -- start 2023-12-05T09:49:17.639 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:17.079+0000 7fd61463d700 1 -- start start 2023-12-05T09:49:17.639 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:17.080+0000 7fd61463d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd60c077b90 0x7fd60c1133c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:17.639 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:17.080+0000 7fd61463d700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd60c113900 con 0x7fd60c077b90 2023-12-05T09:49:17.639 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:17.080+0000 7fd6123d9700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd60c077b90 0x7fd60c1133c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:17.639 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:17.080+0000 7fd6123d9700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd60c077b90 0x7fd60c1133c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36944/0 (socket says 172.21.15.100:36944) 2023-12-05T09:49:17.639 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:17.080+0000 7fd6123d9700 1 -- 172.21.15.100:0/4199835930 learned_addr learned my addr 172.21.15.100:0/4199835930 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:49:17.639 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:17.080+0000 7fd6123d9700 1 -- 172.21.15.100:0/4199835930 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6080094f0 con 0x7fd60c077b90 2023-12-05T09:49:17.640 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:17.080+0000 7fd6123d9700 1 --2- 172.21.15.100:0/4199835930 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd60c077b90 0x7fd60c1133c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd6080094c0 tx=0x7fd608009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:17.640 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:17.081+0000 7fd602ffd700 1 -- 172.21.15.100:0/4199835930 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd608010850 con 0x7fd60c077b90 2023-12-05T09:49:17.640 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:17.081+0000 7fd602ffd700 1 -- 172.21.15.100:0/4199835930 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd608010e60 con 0x7fd60c077b90 2023-12-05T09:49:17.640 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:17.081+0000 7fd61463d700 1 -- 172.21.15.100:0/4199835930 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd60c113b00 con 0x7fd60c077b90 2023-12-05T09:49:17.640 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:17.081+0000 7fd602ffd700 1 -- 172.21.15.100:0/4199835930 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd60801a430 con 0x7fd60c077b90 2023-12-05T09:49:17.640 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:17.081+0000 7fd61463d700 1 -- 172.21.15.100:0/4199835930 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd60c113f10 con 0x7fd60c077b90 2023-12-05T09:49:17.640 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:17.082+0000 7fd602ffd700 1 -- 172.21.15.100:0/4199835930 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fd6080247b0 con 0x7fd60c077b90 2023-12-05T09:49:17.640 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:17.082+0000 7fd61463d700 1 -- 172.21.15.100:0/4199835930 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd60c04bb80 con 0x7fd60c077b90 2023-12-05T09:49:17.640 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:17.082+0000 7fd602ffd700 1 --2- 172.21.15.100:0/4199835930 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7fd5f8036640 0x7fd5f8038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:17.640 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:17.082+0000 7fd602ffd700 1 -- 172.21.15.100:0/4199835930 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fd60804a470 con 0x7fd60c077b90 2023-12-05T09:49:17.641 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:17.082+0000 7fd611bd8700 1 --2- 172.21.15.100:0/4199835930 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7fd5f8036640 0x7fd5f8038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:17.641 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:17.083+0000 7fd611bd8700 1 --2- 172.21.15.100:0/4199835930 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7fd5f8036640 0x7fd5f8038af0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc009990 tx=0x7fd5fc006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:17.641 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:17.088+0000 7fd602ffd700 1 -- 172.21.15.100:0/4199835930 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fd608024440 con 0x7fd60c077b90 2023-12-05T09:49:17.641 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:17.290+0000 7fd61463d700 1 -- 172.21.15.100:0/4199835930 --> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7fd60c10d1f0 con 0x7fd5f8036640 2023-12-05T09:49:17.641 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:17.295+0000 7fd602ffd700 1 -- 172.21.15.100:0/4199835930 <== mgr.14118 v2:172.21.15.100:6800/2647899624 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7fd60c10d1f0 con 0x7fd5f8036640 2023-12-05T09:49:17.641 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:17.297+0000 7fd61463d700 1 -- 172.21.15.100:0/4199835930 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7fd5f8036640 msgr2=0x7fd5f8038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:17.641 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:17.297+0000 7fd61463d700 1 --2- 172.21.15.100:0/4199835930 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7fd5f8036640 0x7fd5f8038af0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc009990 tx=0x7fd5fc006e40 comp rx=0 tx=0).stop 2023-12-05T09:49:17.641 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:17.297+0000 7fd61463d700 1 -- 172.21.15.100:0/4199835930 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd60c077b90 msgr2=0x7fd60c1133c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:17.641 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:17.297+0000 7fd61463d700 1 --2- 172.21.15.100:0/4199835930 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd60c077b90 0x7fd60c1133c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd6080094c0 tx=0x7fd608009250 comp rx=0 tx=0).stop 2023-12-05T09:49:17.641 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:17.297+0000 7fd61463d700 1 -- 172.21.15.100:0/4199835930 shutdown_connections 2023-12-05T09:49:17.641 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:17.297+0000 7fd61463d700 1 --2- 172.21.15.100:0/4199835930 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7fd5f8036640 0x7fd5f8038af0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:17.641 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:17.297+0000 7fd61463d700 1 --2- 172.21.15.100:0/4199835930 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd60c077b90 0x7fd60c1133c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:17.642 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:17.297+0000 7fd61463d700 1 -- 172.21.15.100:0/4199835930 >> 172.21.15.100:0/4199835930 conn(0x7fd60c0fda50 msgr2=0x7fd60c0ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:49:17.642 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:17.297+0000 7fd61463d700 1 -- 172.21.15.100:0/4199835930 shutdown_connections 2023-12-05T09:49:17.642 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:17.297+0000 7fd61463d700 1 -- 172.21.15.100:0/4199835930 wait complete. 2023-12-05T09:49:18.581 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.038+0000 7f9c65f11700 1 Processor -- start 2023-12-05T09:49:18.581 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:18 smithi100 ceph-mon[107145]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:49:18.581 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:18 smithi100 ceph-mon[107145]: Saving service alertmanager spec with placement count:1 2023-12-05T09:49:18.581 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:18 smithi100 ceph-mon[107145]: from='mgr.14118 172.21.15.100:0/3445090407' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:49:18.582 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:18 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/2959460352' entity='client.admin' 2023-12-05T09:49:18.592 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.038+0000 7f9c65f11700 1 -- start start 2023-12-05T09:49:18.593 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.038+0000 7f9c65f11700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c60077bb0 0x7f9c600760c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:18.593 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.038+0000 7f9c65f11700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c60077fc0 con 0x7f9c60077bb0 2023-12-05T09:49:18.593 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.038+0000 7f9c5f7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c60077bb0 0x7f9c600760c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:18.593 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.038+0000 7f9c5f7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c60077bb0 0x7f9c600760c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36958/0 (socket says 172.21.15.100:36958) 2023-12-05T09:49:18.593 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.038+0000 7f9c5f7fe700 1 -- 172.21.15.100:0/3583136394 learned_addr learned my addr 172.21.15.100:0/3583136394 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:49:18.593 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.039+0000 7f9c5f7fe700 1 -- 172.21.15.100:0/3583136394 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c60076600 con 0x7f9c60077bb0 2023-12-05T09:49:18.593 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.039+0000 7f9c5f7fe700 1 --2- 172.21.15.100:0/3583136394 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c60077bb0 0x7f9c600760c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9c500098e0 tx=0x7f9c50009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8bcaf1694267e66 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:18.593 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.039+0000 7f9c5e7fc700 1 -- 172.21.15.100:0/3583136394 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9c5000b860 con 0x7f9c60077bb0 2023-12-05T09:49:18.593 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.039+0000 7f9c5e7fc700 1 -- 172.21.15.100:0/3583136394 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9c5000be70 con 0x7f9c60077bb0 2023-12-05T09:49:18.593 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.039+0000 7f9c5e7fc700 1 -- 172.21.15.100:0/3583136394 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9c50010380 con 0x7f9c60077bb0 2023-12-05T09:49:18.593 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.040+0000 7f9c65f11700 1 -- 172.21.15.100:0/3583136394 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c60077bb0 msgr2=0x7f9c600760c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:18.593 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.040+0000 7f9c65f11700 1 --2- 172.21.15.100:0/3583136394 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c60077bb0 0x7f9c600760c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9c500098e0 tx=0x7f9c50009250 comp rx=0 tx=0).stop 2023-12-05T09:49:18.594 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.040+0000 7f9c65f11700 1 -- 172.21.15.100:0/3583136394 shutdown_connections 2023-12-05T09:49:18.594 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.040+0000 7f9c65f11700 1 --2- 172.21.15.100:0/3583136394 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c60077bb0 0x7f9c600760c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:18.594 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.040+0000 7f9c65f11700 1 -- 172.21.15.100:0/3583136394 >> 172.21.15.100:0/3583136394 conn(0x7f9c600fda50 msgr2=0x7f9c600ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:49:18.594 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.040+0000 7f9c65f11700 1 -- 172.21.15.100:0/3583136394 shutdown_connections 2023-12-05T09:49:18.594 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.040+0000 7f9c65f11700 1 -- 172.21.15.100:0/3583136394 wait complete. 2023-12-05T09:49:18.594 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.041+0000 7f9c65f11700 1 Processor -- start 2023-12-05T09:49:18.594 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.041+0000 7f9c65f11700 1 -- start start 2023-12-05T09:49:18.594 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.041+0000 7f9c65f11700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c60077bb0 0x7f9c601133d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:18.594 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.041+0000 7f9c65f11700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c60113910 con 0x7f9c60077bb0 2023-12-05T09:49:18.594 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.042+0000 7f9c5f7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c60077bb0 0x7f9c601133d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:18.594 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.042+0000 7f9c5f7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c60077bb0 0x7f9c601133d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36968/0 (socket says 172.21.15.100:36968) 2023-12-05T09:49:18.594 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.042+0000 7f9c5f7fe700 1 -- 172.21.15.100:0/2959460352 learned_addr learned my addr 172.21.15.100:0/2959460352 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:49:18.594 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.042+0000 7f9c5f7fe700 1 -- 172.21.15.100:0/2959460352 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c500094f0 con 0x7f9c60077bb0 2023-12-05T09:49:18.594 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.042+0000 7f9c5f7fe700 1 --2- 172.21.15.100:0/2959460352 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c60077bb0 0x7f9c601133d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9c50006d40 tx=0x7f9c50009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:18.595 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.042+0000 7f9c47fff700 1 -- 172.21.15.100:0/2959460352 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9c50010960 con 0x7f9c60077bb0 2023-12-05T09:49:18.595 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.042+0000 7f9c47fff700 1 -- 172.21.15.100:0/2959460352 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9c5001a430 con 0x7f9c60077bb0 2023-12-05T09:49:18.595 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.042+0000 7f9c47fff700 1 -- 172.21.15.100:0/2959460352 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9c500245b0 con 0x7f9c60077bb0 2023-12-05T09:49:18.595 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.042+0000 7f9c65f11700 1 -- 172.21.15.100:0/2959460352 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c60113b10 con 0x7f9c60077bb0 2023-12-05T09:49:18.595 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.043+0000 7f9c65f11700 1 -- 172.21.15.100:0/2959460352 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c60113f20 con 0x7f9c60077bb0 2023-12-05T09:49:18.595 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.043+0000 7f9c47fff700 1 -- 172.21.15.100:0/2959460352 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f9c5001a9f0 con 0x7f9c60077bb0 2023-12-05T09:49:18.595 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.043+0000 7f9c65f11700 1 -- 172.21.15.100:0/2959460352 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c6004bb80 con 0x7f9c60077bb0 2023-12-05T09:49:18.595 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.044+0000 7f9c47fff700 1 --2- 172.21.15.100:0/2959460352 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f9c48036640 0x7f9c48038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:18.595 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.044+0000 7f9c47fff700 1 -- 172.21.15.100:0/2959460352 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f9c5004a150 con 0x7f9c60077bb0 2023-12-05T09:49:18.595 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.044+0000 7f9c5effd700 1 --2- 172.21.15.100:0/2959460352 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f9c48036640 0x7f9c48038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:18.595 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.045+0000 7f9c5effd700 1 --2- 172.21.15.100:0/2959460352 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f9c48036640 0x7f9c48038af0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9c54009990 tx=0x7f9c54006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:18.595 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.048+0000 7f9c47fff700 1 -- 172.21.15.100:0/2959460352 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f9c5002b8c0 con 0x7f9c60077bb0 2023-12-05T09:49:18.595 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.238+0000 7f9c65f11700 1 -- 172.21.15.100:0/2959460352 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7f9c60108550 con 0x7f9c60077bb0 2023-12-05T09:49:18.595 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.242+0000 7f9c47fff700 1 -- 172.21.15.100:0/2959460352 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7f9c5002b2f0 con 0x7f9c60077bb0 2023-12-05T09:49:18.596 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.244+0000 7f9c65f11700 1 -- 172.21.15.100:0/2959460352 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f9c48036640 msgr2=0x7f9c48038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:18.596 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.244+0000 7f9c65f11700 1 --2- 172.21.15.100:0/2959460352 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f9c48036640 0x7f9c48038af0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9c54009990 tx=0x7f9c54006e40 comp rx=0 tx=0).stop 2023-12-05T09:49:18.596 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.244+0000 7f9c65f11700 1 -- 172.21.15.100:0/2959460352 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c60077bb0 msgr2=0x7f9c601133d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:18.596 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.244+0000 7f9c65f11700 1 --2- 172.21.15.100:0/2959460352 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c60077bb0 0x7f9c601133d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9c50006d40 tx=0x7f9c50009250 comp rx=0 tx=0).stop 2023-12-05T09:49:18.596 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.244+0000 7f9c65f11700 1 -- 172.21.15.100:0/2959460352 shutdown_connections 2023-12-05T09:49:18.596 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.244+0000 7f9c65f11700 1 --2- 172.21.15.100:0/2959460352 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f9c48036640 0x7f9c48038af0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:18.596 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.244+0000 7f9c65f11700 1 --2- 172.21.15.100:0/2959460352 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c60077bb0 0x7f9c601133d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:18.596 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.244+0000 7f9c65f11700 1 -- 172.21.15.100:0/2959460352 >> 172.21.15.100:0/2959460352 conn(0x7f9c600fda50 msgr2=0x7f9c600ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:49:18.596 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.245+0000 7f9c65f11700 1 -- 172.21.15.100:0/2959460352 shutdown_connections 2023-12-05T09:49:18.596 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.245+0000 7f9c65f11700 1 -- 172.21.15.100:0/2959460352 wait complete. 2023-12-05T09:49:19.510 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.978+0000 7f998d253700 1 Processor -- start 2023-12-05T09:49:19.510 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.978+0000 7f998d253700 1 -- start start 2023-12-05T09:49:19.510 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.978+0000 7f998d253700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99881022d0 0x7f99881026e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:19.510 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.978+0000 7f998d253700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9988102c20 con 0x7f99881022d0 2023-12-05T09:49:19.510 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.978+0000 7f9986d9d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99881022d0 0x7f99881026e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:19.510 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.978+0000 7f9986d9d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99881022d0 0x7f99881026e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36982/0 (socket says 172.21.15.100:36982) 2023-12-05T09:49:19.510 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.978+0000 7f9986d9d700 1 -- 172.21.15.100:0/3792333828 learned_addr learned my addr 172.21.15.100:0/3792333828 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:49:19.510 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.979+0000 7f9986d9d700 1 -- 172.21.15.100:0/3792333828 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9988102d60 con 0x7f99881022d0 2023-12-05T09:49:19.510 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.979+0000 7f9986d9d700 1 --2- 172.21.15.100:0/3792333828 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99881022d0 0x7f99881026e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f99780098e0 tx=0x7f9978009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7931b3e977a492e server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:19.510 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.979+0000 7f9985d9b700 1 -- 172.21.15.100:0/3792333828 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f997800b860 con 0x7f99881022d0 2023-12-05T09:49:19.510 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.979+0000 7f9985d9b700 1 -- 172.21.15.100:0/3792333828 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f997800be70 con 0x7f99881022d0 2023-12-05T09:49:19.511 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.979+0000 7f9985d9b700 1 -- 172.21.15.100:0/3792333828 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9978010380 con 0x7f99881022d0 2023-12-05T09:49:19.511 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.980+0000 7f998d253700 1 -- 172.21.15.100:0/3792333828 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99881022d0 msgr2=0x7f99881026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:19.511 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.980+0000 7f998d253700 1 --2- 172.21.15.100:0/3792333828 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99881022d0 0x7f99881026e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f99780098e0 tx=0x7f9978009250 comp rx=0 tx=0).stop 2023-12-05T09:49:19.511 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.980+0000 7f998d253700 1 -- 172.21.15.100:0/3792333828 shutdown_connections 2023-12-05T09:49:19.511 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.980+0000 7f998d253700 1 --2- 172.21.15.100:0/3792333828 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99881022d0 0x7f99881026e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:19.511 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.980+0000 7f998d253700 1 -- 172.21.15.100:0/3792333828 >> 172.21.15.100:0/3792333828 conn(0x7f99880fda50 msgr2=0x7f99880ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:49:19.511 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.980+0000 7f998d253700 1 -- 172.21.15.100:0/3792333828 shutdown_connections 2023-12-05T09:49:19.511 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.980+0000 7f998d253700 1 -- 172.21.15.100:0/3792333828 wait complete. 2023-12-05T09:49:19.511 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.981+0000 7f998d253700 1 Processor -- start 2023-12-05T09:49:19.511 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.981+0000 7f998d253700 1 -- start start 2023-12-05T09:49:19.511 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.981+0000 7f998d253700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99881022d0 0x7f9988113370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:19.511 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.981+0000 7f998d253700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99881138b0 con 0x7f99881022d0 2023-12-05T09:49:19.511 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.981+0000 7f9986d9d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99881022d0 0x7f9988113370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:19.511 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.981+0000 7f9986d9d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99881022d0 0x7f9988113370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36998/0 (socket says 172.21.15.100:36998) 2023-12-05T09:49:19.512 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.981+0000 7f9986d9d700 1 -- 172.21.15.100:0/2050079026 learned_addr learned my addr 172.21.15.100:0/2050079026 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:49:19.512 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.982+0000 7f9986d9d700 1 -- 172.21.15.100:0/2050079026 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99780094f0 con 0x7f99881022d0 2023-12-05T09:49:19.512 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.982+0000 7f9986d9d700 1 --2- 172.21.15.100:0/2050079026 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99881022d0 0x7f9988113370 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f997800c010 tx=0x7f9978009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:19.512 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.982+0000 7f996f7fe700 1 -- 172.21.15.100:0/2050079026 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9978010960 con 0x7f99881022d0 2023-12-05T09:49:19.512 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.982+0000 7f996f7fe700 1 -- 172.21.15.100:0/2050079026 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f997801a430 con 0x7f99881022d0 2023-12-05T09:49:19.512 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.982+0000 7f996f7fe700 1 -- 172.21.15.100:0/2050079026 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9978019580 con 0x7f99881022d0 2023-12-05T09:49:19.512 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.982+0000 7f998d253700 1 -- 172.21.15.100:0/2050079026 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9988113ab0 con 0x7f99881022d0 2023-12-05T09:49:19.512 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.982+0000 7f998d253700 1 -- 172.21.15.100:0/2050079026 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9988113ec0 con 0x7f99881022d0 2023-12-05T09:49:19.512 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.983+0000 7f996f7fe700 1 -- 172.21.15.100:0/2050079026 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f997801a980 con 0x7f99881022d0 2023-12-05T09:49:19.512 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.983+0000 7f998d253700 1 -- 172.21.15.100:0/2050079026 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f998804bb80 con 0x7f99881022d0 2023-12-05T09:49:19.512 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.984+0000 7f996f7fe700 1 --2- 172.21.15.100:0/2050079026 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f9970036640 0x7f9970038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:19.512 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.984+0000 7f996f7fe700 1 -- 172.21.15.100:0/2050079026 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f997804a390 con 0x7f99881022d0 2023-12-05T09:49:19.512 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.984+0000 7f998659c700 1 --2- 172.21.15.100:0/2050079026 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f9970036640 0x7f9970038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:19.512 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.984+0000 7f998659c700 1 --2- 172.21.15.100:0/2050079026 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f9970036640 0x7f9970038af0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f997c009990 tx=0x7f997c006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:19.513 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:18.989+0000 7f996f7fe700 1 -- 172.21.15.100:0/2050079026 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f997802bb30 con 0x7f99881022d0 2023-12-05T09:49:19.513 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:19.179+0000 7f998d253700 1 -- 172.21.15.100:0/2050079026 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f99881040b0 con 0x7f99881022d0 2023-12-05T09:49:19.513 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:19.183+0000 7f996f7fe700 1 -- 172.21.15.100:0/2050079026 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f997802b300 con 0x7f99881022d0 2023-12-05T09:49:19.513 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:19.184+0000 7f998d253700 1 -- 172.21.15.100:0/2050079026 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f9970036640 msgr2=0x7f9970038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:19.513 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:19.184+0000 7f998d253700 1 --2- 172.21.15.100:0/2050079026 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f9970036640 0x7f9970038af0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f997c009990 tx=0x7f997c006e40 comp rx=0 tx=0).stop 2023-12-05T09:49:19.513 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:19.184+0000 7f998d253700 1 -- 172.21.15.100:0/2050079026 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99881022d0 msgr2=0x7f9988113370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:19.513 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:19.184+0000 7f998d253700 1 --2- 172.21.15.100:0/2050079026 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99881022d0 0x7f9988113370 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f997800c010 tx=0x7f9978009250 comp rx=0 tx=0).stop 2023-12-05T09:49:19.513 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:19.184+0000 7f998d253700 1 -- 172.21.15.100:0/2050079026 shutdown_connections 2023-12-05T09:49:19.513 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:19.184+0000 7f998d253700 1 --2- 172.21.15.100:0/2050079026 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f9970036640 0x7f9970038af0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:19.513 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:19.184+0000 7f998d253700 1 --2- 172.21.15.100:0/2050079026 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99881022d0 0x7f9988113370 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:19.513 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:19.184+0000 7f998d253700 1 -- 172.21.15.100:0/2050079026 >> 172.21.15.100:0/2050079026 conn(0x7f99880fda50 msgr2=0x7f99880ff190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:49:19.513 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:19.184+0000 7f998d253700 1 -- 172.21.15.100:0/2050079026 shutdown_connections 2023-12-05T09:49:19.513 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:19.184+0000 7f998d253700 1 -- 172.21.15.100:0/2050079026 wait complete. 2023-12-05T09:49:19.513 INFO:teuthology.orchestra.run.smithi100.stdout:Enabling the dashboard module... 2023-12-05T09:49:20.466 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:20 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/2050079026' entity='client.admin' 2023-12-05T09:49:20.466 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:20 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/3530252396' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2023-12-05T09:49:20.506 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:19.884+0000 7fa01050c700 1 Processor -- start 2023-12-05T09:49:20.506 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:19.884+0000 7fa01050c700 1 -- start start 2023-12-05T09:49:20.506 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:19.884+0000 7fa01050c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa008077bd0 0x7fa0080760e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:20.507 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:19.884+0000 7fa01050c700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa008077fe0 con 0x7fa008077bd0 2023-12-05T09:49:20.515 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:19.885+0000 7fa00e2a8700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa008077bd0 0x7fa0080760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:20.515 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:19.885+0000 7fa00e2a8700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa008077bd0 0x7fa0080760e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60668/0 (socket says 172.21.15.100:60668) 2023-12-05T09:49:20.515 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:19.885+0000 7fa00e2a8700 1 -- 172.21.15.100:0/2950373570 learned_addr learned my addr 172.21.15.100:0/2950373570 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:49:20.515 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:19.885+0000 7fa00e2a8700 1 -- 172.21.15.100:0/2950373570 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa008076620 con 0x7fa008077bd0 2023-12-05T09:49:20.515 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:19.885+0000 7fa00e2a8700 1 --2- 172.21.15.100:0/2950373570 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa008077bd0 0x7fa0080760e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa0040098e0 tx=0x7fa004009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83b18efd6d811ec2 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:20.515 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:19.885+0000 7fa00d2a6700 1 -- 172.21.15.100:0/2950373570 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa00400b860 con 0x7fa008077bd0 2023-12-05T09:49:20.515 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:19.886+0000 7fa00d2a6700 1 -- 172.21.15.100:0/2950373570 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa00400be70 con 0x7fa008077bd0 2023-12-05T09:49:20.515 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:19.886+0000 7fa00d2a6700 1 -- 172.21.15.100:0/2950373570 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa004010380 con 0x7fa008077bd0 2023-12-05T09:49:20.515 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:19.886+0000 7fa01050c700 1 -- 172.21.15.100:0/2950373570 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa008077bd0 msgr2=0x7fa0080760e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:20.516 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:19.886+0000 7fa01050c700 1 --2- 172.21.15.100:0/2950373570 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa008077bd0 0x7fa0080760e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa0040098e0 tx=0x7fa004009250 comp rx=0 tx=0).stop 2023-12-05T09:49:20.516 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:19.886+0000 7fa01050c700 1 -- 172.21.15.100:0/2950373570 shutdown_connections 2023-12-05T09:49:20.516 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:19.886+0000 7fa01050c700 1 --2- 172.21.15.100:0/2950373570 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa008077bd0 0x7fa0080760e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:20.516 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:19.886+0000 7fa01050c700 1 -- 172.21.15.100:0/2950373570 >> 172.21.15.100:0/2950373570 conn(0x7fa0080fda50 msgr2=0x7fa0080ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:49:20.516 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:19.886+0000 7fa01050c700 1 -- 172.21.15.100:0/2950373570 shutdown_connections 2023-12-05T09:49:20.516 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:19.886+0000 7fa01050c700 1 -- 172.21.15.100:0/2950373570 wait complete. 2023-12-05T09:49:20.516 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:19.887+0000 7fa01050c700 1 Processor -- start 2023-12-05T09:49:20.516 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:19.887+0000 7fa01050c700 1 -- start start 2023-12-05T09:49:20.516 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:19.887+0000 7fa01050c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa008077bd0 0x7fa008113370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:20.516 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:19.887+0000 7fa01050c700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0081138b0 con 0x7fa008077bd0 2023-12-05T09:49:20.516 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:19.888+0000 7fa00e2a8700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa008077bd0 0x7fa008113370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:20.516 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:19.888+0000 7fa00e2a8700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa008077bd0 0x7fa008113370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60676/0 (socket says 172.21.15.100:60676) 2023-12-05T09:49:20.516 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:19.888+0000 7fa00e2a8700 1 -- 172.21.15.100:0/3530252396 learned_addr learned my addr 172.21.15.100:0/3530252396 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:49:20.516 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:19.888+0000 7fa00e2a8700 1 -- 172.21.15.100:0/3530252396 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0040094f0 con 0x7fa008077bd0 2023-12-05T09:49:20.516 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:19.888+0000 7fa00e2a8700 1 --2- 172.21.15.100:0/3530252396 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa008077bd0 0x7fa008113370 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa004006d40 tx=0x7fa004009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:20.517 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:19.888+0000 7f9ffeffd700 1 -- 172.21.15.100:0/3530252396 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa004010960 con 0x7fa008077bd0 2023-12-05T09:49:20.517 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:19.888+0000 7f9ffeffd700 1 -- 172.21.15.100:0/3530252396 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa00401a430 con 0x7fa008077bd0 2023-12-05T09:49:20.517 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:19.888+0000 7fa01050c700 1 -- 172.21.15.100:0/3530252396 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa008113ab0 con 0x7fa008077bd0 2023-12-05T09:49:20.517 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:19.888+0000 7f9ffeffd700 1 -- 172.21.15.100:0/3530252396 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa0040245b0 con 0x7fa008077bd0 2023-12-05T09:49:20.517 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:19.889+0000 7fa01050c700 1 -- 172.21.15.100:0/3530252396 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa008113ec0 con 0x7fa008077bd0 2023-12-05T09:49:20.517 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:19.890+0000 7f9ffeffd700 1 -- 172.21.15.100:0/3530252396 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fa00401a9f0 con 0x7fa008077bd0 2023-12-05T09:49:20.517 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:19.890+0000 7fa01050c700 1 -- 172.21.15.100:0/3530252396 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa00804bb80 con 0x7fa008077bd0 2023-12-05T09:49:20.517 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:19.890+0000 7f9ffeffd700 1 --2- 172.21.15.100:0/3530252396 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f9ff4036640 0x7f9ff4038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:20.517 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:19.890+0000 7f9ffeffd700 1 -- 172.21.15.100:0/3530252396 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fa00404a150 con 0x7fa008077bd0 2023-12-05T09:49:20.517 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:19.890+0000 7fa00daa7700 1 --2- 172.21.15.100:0/3530252396 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f9ff4036640 0x7f9ff4038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:20.517 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:19.891+0000 7fa00daa7700 1 --2- 172.21.15.100:0/3530252396 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f9ff4036640 0x7f9ff4038af0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9ff8009990 tx=0x7f9ff8006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:20.517 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:19.895+0000 7f9ffeffd700 1 -- 172.21.15.100:0/3530252396 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fa00402b8c0 con 0x7fa008077bd0 2023-12-05T09:49:20.517 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:20.136+0000 7fa01050c700 1 -- 172.21.15.100:0/3530252396 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7fa0080008d0 con 0x7fa008077bd0 2023-12-05T09:49:20.517 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:20.182+0000 7f9ffeffd700 1 -- 172.21.15.100:0/3530252396 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mgrmap(e 9) v1 ==== 43294+0+0 (secure 0 0 0) 0x7fa00401a660 con 0x7fa008077bd0 2023-12-05T09:49:20.518 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:20.184+0000 7f9ffeffd700 1 -- 172.21.15.100:0/3530252396 <== mon.0 v2:172.21.15.100:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7fa00400fb50 con 0x7fa008077bd0 2023-12-05T09:49:20.518 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:20.186+0000 7fa01050c700 1 -- 172.21.15.100:0/3530252396 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f9ff4036640 msgr2=0x7f9ff4038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:20.518 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:20.186+0000 7fa01050c700 1 --2- 172.21.15.100:0/3530252396 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f9ff4036640 0x7f9ff4038af0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9ff8009990 tx=0x7f9ff8006e40 comp rx=0 tx=0).stop 2023-12-05T09:49:20.518 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:20.186+0000 7fa01050c700 1 -- 172.21.15.100:0/3530252396 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa008077bd0 msgr2=0x7fa008113370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:20.518 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:20.186+0000 7fa01050c700 1 --2- 172.21.15.100:0/3530252396 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa008077bd0 0x7fa008113370 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa004006d40 tx=0x7fa004009250 comp rx=0 tx=0).stop 2023-12-05T09:49:20.518 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:20.186+0000 7fa01050c700 1 -- 172.21.15.100:0/3530252396 shutdown_connections 2023-12-05T09:49:20.518 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:20.186+0000 7fa01050c700 1 --2- 172.21.15.100:0/3530252396 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f9ff4036640 0x7f9ff4038af0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:20.518 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:20.186+0000 7fa01050c700 1 --2- 172.21.15.100:0/3530252396 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa008077bd0 0x7fa008113370 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:20.518 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:20.186+0000 7fa01050c700 1 -- 172.21.15.100:0/3530252396 >> 172.21.15.100:0/3530252396 conn(0x7fa0080fda50 msgr2=0x7fa0080ffe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:49:20.518 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:20.186+0000 7fa01050c700 1 -- 172.21.15.100:0/3530252396 shutdown_connections 2023-12-05T09:49:20.518 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:20.187+0000 7fa01050c700 1 -- 172.21.15.100:0/3530252396 wait complete. 2023-12-05T09:49:21.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:21 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/3530252396' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2023-12-05T09:49:21.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:21 smithi100 ceph-mon[107145]: mgrmap e9: smithi100.ehmuhg(active, since 19s) 2023-12-05T09:49:21.562 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout { 2023-12-05T09:49:21.562 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "epoch": 9, 2023-12-05T09:49:21.562 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "available": true, 2023-12-05T09:49:21.562 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "active_name": "smithi100.ehmuhg", 2023-12-05T09:49:21.562 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-12-05T09:49:21.562 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout } 2023-12-05T09:49:21.562 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:20.952+0000 7f627c75c700 1 Processor -- start 2023-12-05T09:49:21.562 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:20.952+0000 7f627c75c700 1 -- start start 2023-12-05T09:49:21.563 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:20.952+0000 7f627c75c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6274070f40 0x7f6274104f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:21.563 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:20.952+0000 7f627c75c700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62741054a0 con 0x7f6274070f40 2023-12-05T09:49:21.563 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:20.953+0000 7f627a4f8700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6274070f40 0x7f6274104f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:21.563 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:20.953+0000 7f627a4f8700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6274070f40 0x7f6274104f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60706/0 (socket says 172.21.15.100:60706) 2023-12-05T09:49:21.563 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:20.953+0000 7f627a4f8700 1 -- 172.21.15.100:0/885924777 learned_addr learned my addr 172.21.15.100:0/885924777 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:49:21.563 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:20.953+0000 7f627a4f8700 1 -- 172.21.15.100:0/885924777 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62741055e0 con 0x7f6274070f40 2023-12-05T09:49:21.563 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:20.953+0000 7f627a4f8700 1 --2- 172.21.15.100:0/885924777 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6274070f40 0x7f6274104f60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f62700098e0 tx=0x7f6270009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1adeb9f2bd897675 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:21.563 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:20.953+0000 7f62794f6700 1 -- 172.21.15.100:0/885924777 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f627000b8f0 con 0x7f6274070f40 2023-12-05T09:49:21.563 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:20.954+0000 7f62794f6700 1 -- 172.21.15.100:0/885924777 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6270011420 con 0x7f6274070f40 2023-12-05T09:49:21.563 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:20.954+0000 7f62794f6700 1 -- 172.21.15.100:0/885924777 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6270010540 con 0x7f6274070f40 2023-12-05T09:49:21.563 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:20.954+0000 7f627c75c700 1 -- 172.21.15.100:0/885924777 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6274070f40 msgr2=0x7f6274104f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:21.563 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:20.954+0000 7f627c75c700 1 --2- 172.21.15.100:0/885924777 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6274070f40 0x7f6274104f60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f62700098e0 tx=0x7f6270009250 comp rx=0 tx=0).stop 2023-12-05T09:49:21.563 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:20.955+0000 7f627c75c700 1 -- 172.21.15.100:0/885924777 shutdown_connections 2023-12-05T09:49:21.564 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:20.955+0000 7f627c75c700 1 --2- 172.21.15.100:0/885924777 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6274070f40 0x7f6274104f60 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:21.564 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:20.955+0000 7f627c75c700 1 -- 172.21.15.100:0/885924777 >> 172.21.15.100:0/885924777 conn(0x7f62740fc970 msgr2=0x7f62740fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:49:21.564 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:20.955+0000 7f627c75c700 1 -- 172.21.15.100:0/885924777 shutdown_connections 2023-12-05T09:49:21.564 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:20.955+0000 7f627c75c700 1 -- 172.21.15.100:0/885924777 wait complete. 2023-12-05T09:49:21.564 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:20.956+0000 7f627c75c700 1 Processor -- start 2023-12-05T09:49:21.564 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:20.956+0000 7f627c75c700 1 -- start start 2023-12-05T09:49:21.564 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:20.956+0000 7f627c75c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6274070f40 0x7f6274113430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:21.564 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:20.956+0000 7f627c75c700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6274113970 con 0x7f6274070f40 2023-12-05T09:49:21.564 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:20.956+0000 7f627a4f8700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6274070f40 0x7f6274113430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:21.564 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:20.956+0000 7f627a4f8700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6274070f40 0x7f6274113430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60716/0 (socket says 172.21.15.100:60716) 2023-12-05T09:49:21.564 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:20.956+0000 7f627a4f8700 1 -- 172.21.15.100:0/3004287457 learned_addr learned my addr 172.21.15.100:0/3004287457 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:49:21.564 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:20.957+0000 7f627a4f8700 1 -- 172.21.15.100:0/3004287457 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62700094f0 con 0x7f6274070f40 2023-12-05T09:49:21.564 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:20.957+0000 7f627a4f8700 1 --2- 172.21.15.100:0/3004287457 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6274070f40 0x7f6274113430 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6270003080 tx=0x7f6270009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:21.564 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:20.957+0000 7f626affd700 1 -- 172.21.15.100:0/3004287457 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f627000be30 con 0x7f6274070f40 2023-12-05T09:49:21.564 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:20.957+0000 7f626affd700 1 -- 172.21.15.100:0/3004287457 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6270010c60 con 0x7f6274070f40 2023-12-05T09:49:21.565 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:20.957+0000 7f626affd700 1 -- 172.21.15.100:0/3004287457 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6270024d20 con 0x7f6274070f40 2023-12-05T09:49:21.565 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:20.957+0000 7f627c75c700 1 -- 172.21.15.100:0/3004287457 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6274113b70 con 0x7f6274070f40 2023-12-05T09:49:21.565 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:20.957+0000 7f627c75c700 1 -- 172.21.15.100:0/3004287457 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6274113f80 con 0x7f6274070f40 2023-12-05T09:49:21.565 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:20.958+0000 7f626affd700 1 -- 172.21.15.100:0/3004287457 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 9) v1 ==== 43294+0+0 (secure 0 0 0) 0x7f62700107b0 con 0x7f6274070f40 2023-12-05T09:49:21.565 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:20.959+0000 7f627c75c700 1 -- 172.21.15.100:0/3004287457 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f627404bb80 con 0x7f6274070f40 2023-12-05T09:49:21.565 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:20.959+0000 7f626affd700 1 --2- 172.21.15.100:0/3004287457 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f6260036690 0x7f6260038b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:21.565 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:20.959+0000 7f626affd700 1 -- 172.21.15.100:0/3004287457 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f627004a470 con 0x7f6274070f40 2023-12-05T09:49:21.565 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:20.959+0000 7f6279cf7700 1 -- 172.21.15.100:0/3004287457 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f6260036690 msgr2=0x7f6260038b40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/2647899624 2023-12-05T09:49:21.565 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:20.959+0000 7f6279cf7700 1 --2- 172.21.15.100:0/3004287457 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f6260036690 0x7f6260038b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-05T09:49:21.565 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:20.964+0000 7f626affd700 1 -- 172.21.15.100:0/3004287457 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f6270010dd0 con 0x7f6274070f40 2023-12-05T09:49:21.565 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:21.160+0000 7f6279cf7700 1 -- 172.21.15.100:0/3004287457 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f6260036690 msgr2=0x7f6260038b40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/2647899624 2023-12-05T09:49:21.566 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:21.160+0000 7f6279cf7700 1 --2- 172.21.15.100:0/3004287457 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f6260036690 0x7f6260038b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-05T09:49:21.566 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:21.215+0000 7f627c75c700 1 -- 172.21.15.100:0/3004287457 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f627410d390 con 0x7f6274070f40 2023-12-05T09:49:21.566 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:21.216+0000 7f626affd700 1 -- 172.21.15.100:0/3004287457 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7f6270022340 con 0x7f6274070f40 2023-12-05T09:49:21.566 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:21.218+0000 7f627c75c700 1 -- 172.21.15.100:0/3004287457 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f6260036690 msgr2=0x7f6260038b40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-05T09:49:21.566 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:21.218+0000 7f627c75c700 1 --2- 172.21.15.100:0/3004287457 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f6260036690 0x7f6260038b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:21.566 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:21.218+0000 7f627c75c700 1 -- 172.21.15.100:0/3004287457 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6274070f40 msgr2=0x7f6274113430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:21.566 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:21.218+0000 7f627c75c700 1 --2- 172.21.15.100:0/3004287457 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6274070f40 0x7f6274113430 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6270003080 tx=0x7f6270009250 comp rx=0 tx=0).stop 2023-12-05T09:49:21.566 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:21.218+0000 7f627c75c700 1 -- 172.21.15.100:0/3004287457 shutdown_connections 2023-12-05T09:49:21.566 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:21.218+0000 7f627c75c700 1 --2- 172.21.15.100:0/3004287457 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f6260036690 0x7f6260038b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:21.566 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:21.218+0000 7f627c75c700 1 --2- 172.21.15.100:0/3004287457 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6274070f40 0x7f6274113430 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:21.566 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:21.218+0000 7f627c75c700 1 -- 172.21.15.100:0/3004287457 >> 172.21.15.100:0/3004287457 conn(0x7f62740fc970 msgr2=0x7f62740fe160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:49:21.566 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:21.218+0000 7f627c75c700 1 -- 172.21.15.100:0/3004287457 shutdown_connections 2023-12-05T09:49:21.566 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:21.218+0000 7f627c75c700 1 -- 172.21.15.100:0/3004287457 wait complete. 2023-12-05T09:49:21.566 INFO:teuthology.orchestra.run.smithi100.stdout:Waiting for the mgr to restart... 2023-12-05T09:49:21.567 INFO:teuthology.orchestra.run.smithi100.stdout:Waiting for mgr epoch 9... 2023-12-05T09:49:22.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:22 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/3004287457' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-12-05T09:49:29.595 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:29 smithi100 ceph-mon[107145]: Active manager daemon smithi100.ehmuhg restarted 2023-12-05T09:49:29.595 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:29 smithi100 ceph-mon[107145]: Activating manager daemon smithi100.ehmuhg 2023-12-05T09:49:29.595 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:29 smithi100 ceph-mon[107145]: osdmap e3: 0 total, 0 up, 0 in 2023-12-05T09:49:29.595 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:29 smithi100 ceph-mon[107145]: mgrmap e10: smithi100.ehmuhg(active, starting, since 0.00631438s) 2023-12-05T09:49:29.595 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:29 smithi100 ceph-mon[107145]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mon metadata", "id": "smithi100"}]: dispatch 2023-12-05T09:49:29.595 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:29 smithi100 ceph-mon[107145]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mgr metadata", "who": "smithi100.ehmuhg", "id": "smithi100.ehmuhg"}]: dispatch 2023-12-05T09:49:29.595 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:29 smithi100 ceph-mon[107145]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-05T09:49:29.595 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:29 smithi100 ceph-mon[107145]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-05T09:49:29.595 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:29 smithi100 ceph-mon[107145]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-05T09:49:29.596 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:29 smithi100 ceph-mon[107145]: Manager daemon smithi100.ehmuhg is now available 2023-12-05T09:49:29.596 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:29 smithi100 ceph-mon[107145]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:49:29.596 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:29 smithi100 ceph-mon[107145]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:49:29.596 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:29 smithi100 ceph-mon[107145]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi100.ehmuhg/mirror_snapshot_schedule"}]: dispatch 2023-12-05T09:49:29.596 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:29 smithi100 ceph-mon[107145]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi100.ehmuhg/trash_purge_schedule"}]: dispatch 2023-12-05T09:49:29.596 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:29 smithi100 ceph-mon[107145]: [05/Dec/2023:09:49:29] ENGINE Bus STARTING 2023-12-05T09:49:29.596 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:29 smithi100 ceph-mon[107145]: [05/Dec/2023:09:49:29] ENGINE Serving on https://172.21.15.100:7150 2023-12-05T09:49:29.596 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:29 smithi100 ceph-mon[107145]: [05/Dec/2023:09:49:29] ENGINE Bus STARTED 2023-12-05T09:49:29.596 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:29 smithi100 ceph-mon[107145]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:49:30.049 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout { 2023-12-05T09:49:30.049 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2023-12-05T09:49:30.049 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "initialized": true 2023-12-05T09:49:30.049 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout } 2023-12-05T09:49:30.049 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:21.976+0000 7f7fe7523700 1 Processor -- start 2023-12-05T09:49:30.049 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:21.976+0000 7f7fe7523700 1 -- start start 2023-12-05T09:49:30.049 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:21.977+0000 7f7fe7523700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fe01022d0 0x7f7fe01026e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:30.049 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:21.977+0000 7f7fe7523700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe0102c20 con 0x7f7fe01022d0 2023-12-05T09:49:30.049 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:21.977+0000 7f7fe52bf700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fe01022d0 0x7f7fe01026e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:30.050 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:21.977+0000 7f7fe52bf700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fe01022d0 0x7f7fe01026e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60722/0 (socket says 172.21.15.100:60722) 2023-12-05T09:49:30.050 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:21.977+0000 7f7fe52bf700 1 -- 172.21.15.100:0/800080852 learned_addr learned my addr 172.21.15.100:0/800080852 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:49:30.050 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:21.978+0000 7f7fe52bf700 1 -- 172.21.15.100:0/800080852 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe0102d60 con 0x7f7fe01022d0 2023-12-05T09:49:30.050 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:21.978+0000 7f7fe52bf700 1 --2- 172.21.15.100:0/800080852 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fe01022d0 0x7f7fe01026e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc0098e0 tx=0x7f7fdc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ead9e5f363d146a server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:30.050 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:21.978+0000 7f7fd7fff700 1 -- 172.21.15.100:0/800080852 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7fdc00b860 con 0x7f7fe01022d0 2023-12-05T09:49:30.050 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:21.978+0000 7f7fd7fff700 1 -- 172.21.15.100:0/800080852 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7fdc00be70 con 0x7f7fe01022d0 2023-12-05T09:49:30.050 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:21.978+0000 7f7fd7fff700 1 -- 172.21.15.100:0/800080852 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7fdc010380 con 0x7f7fe01022d0 2023-12-05T09:49:30.050 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:21.979+0000 7f7fe7523700 1 -- 172.21.15.100:0/800080852 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fe01022d0 msgr2=0x7f7fe01026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:30.051 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:21.979+0000 7f7fe7523700 1 --2- 172.21.15.100:0/800080852 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fe01022d0 0x7f7fe01026e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc0098e0 tx=0x7f7fdc009250 comp rx=0 tx=0).stop 2023-12-05T09:49:30.051 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:21.979+0000 7f7fe7523700 1 -- 172.21.15.100:0/800080852 shutdown_connections 2023-12-05T09:49:30.051 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:21.979+0000 7f7fe7523700 1 --2- 172.21.15.100:0/800080852 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fe01022d0 0x7f7fe01026e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:30.051 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:21.979+0000 7f7fe7523700 1 -- 172.21.15.100:0/800080852 >> 172.21.15.100:0/800080852 conn(0x7f7fe00fda50 msgr2=0x7f7fe00ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:49:30.051 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:21.979+0000 7f7fe7523700 1 -- 172.21.15.100:0/800080852 shutdown_connections 2023-12-05T09:49:30.051 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:21.979+0000 7f7fe7523700 1 -- 172.21.15.100:0/800080852 wait complete. 2023-12-05T09:49:30.051 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:21.980+0000 7f7fe7523700 1 Processor -- start 2023-12-05T09:49:30.051 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:21.980+0000 7f7fe7523700 1 -- start start 2023-12-05T09:49:30.051 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:21.981+0000 7f7fe7523700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fe01022d0 0x7f7fe0111180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:30.051 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:21.981+0000 7f7fe7523700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe01116c0 con 0x7f7fe01022d0 2023-12-05T09:49:30.051 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:21.981+0000 7f7fe52bf700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fe01022d0 0x7f7fe0111180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:30.052 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:21.981+0000 7f7fe52bf700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fe01022d0 0x7f7fe0111180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60732/0 (socket says 172.21.15.100:60732) 2023-12-05T09:49:30.052 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:21.981+0000 7f7fe52bf700 1 -- 172.21.15.100:0/862179201 learned_addr learned my addr 172.21.15.100:0/862179201 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:49:30.052 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:21.981+0000 7f7fe52bf700 1 -- 172.21.15.100:0/862179201 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fdc0094f0 con 0x7f7fe01022d0 2023-12-05T09:49:30.052 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:21.982+0000 7f7fe52bf700 1 --2- 172.21.15.100:0/862179201 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fe01022d0 0x7f7fe0111180 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc011b60 tx=0x7f7fdc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:30.052 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:21.982+0000 7f7fd5ffb700 1 -- 172.21.15.100:0/862179201 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7fdc010850 con 0x7f7fe01022d0 2023-12-05T09:49:30.052 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:21.982+0000 7f7fd5ffb700 1 -- 172.21.15.100:0/862179201 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7fdc010e60 con 0x7f7fe01022d0 2023-12-05T09:49:30.052 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:21.982+0000 7f7fe7523700 1 -- 172.21.15.100:0/862179201 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fe01118c0 con 0x7f7fe01022d0 2023-12-05T09:49:30.052 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:21.982+0000 7f7fd5ffb700 1 -- 172.21.15.100:0/862179201 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7fdc01ae20 con 0x7f7fe01022d0 2023-12-05T09:49:30.052 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:21.982+0000 7f7fe7523700 1 -- 172.21.15.100:0/862179201 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fe0111cd0 con 0x7f7fe01022d0 2023-12-05T09:49:30.052 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:21.983+0000 7f7fd5ffb700 1 -- 172.21.15.100:0/862179201 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 9) v1 ==== 43294+0+0 (secure 0 0 0) 0x7f7fdc0109b0 con 0x7f7fe01022d0 2023-12-05T09:49:30.052 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:21.984+0000 7f7fd5ffb700 1 --2- 172.21.15.100:0/862179201 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f7fcc036640 0x7f7fcc038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:30.052 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:21.984+0000 7f7fd5ffb700 1 -- 172.21.15.100:0/862179201 --> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7fcc039200 con 0x7f7fcc036640 2023-12-05T09:49:30.052 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:21.984+0000 7f7fd5ffb700 1 -- 172.21.15.100:0/862179201 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f7fdc04a260 con 0x7f7fe01022d0 2023-12-05T09:49:30.052 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:21.984+0000 7f7fe4abe700 1 -- 172.21.15.100:0/862179201 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f7fcc036640 msgr2=0x7f7fcc038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/2647899624 2023-12-05T09:49:30.053 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:21.984+0000 7f7fe4abe700 1 --2- 172.21.15.100:0/862179201 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f7fcc036640 0x7f7fcc038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-05T09:49:30.053 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:22.185+0000 7f7fe4abe700 1 -- 172.21.15.100:0/862179201 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f7fcc036640 msgr2=0x7f7fcc038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/2647899624 2023-12-05T09:49:30.053 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:22.185+0000 7f7fe4abe700 1 --2- 172.21.15.100:0/862179201 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f7fcc036640 0x7f7fcc038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-05T09:49:30.053 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:22.586+0000 7f7fe4abe700 1 -- 172.21.15.100:0/862179201 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f7fcc036640 msgr2=0x7f7fcc038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/2647899624 2023-12-05T09:49:30.053 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:22.586+0000 7f7fe4abe700 1 --2- 172.21.15.100:0/862179201 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f7fcc036640 0x7f7fcc038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-05T09:49:30.053 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:23.387+0000 7f7fe4abe700 1 -- 172.21.15.100:0/862179201 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f7fcc036640 msgr2=0x7f7fcc038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/2647899624 2023-12-05T09:49:30.053 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:23.387+0000 7f7fe4abe700 1 --2- 172.21.15.100:0/862179201 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f7fcc036640 0x7f7fcc038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-05T09:49:30.053 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:24.988+0000 7f7fe4abe700 1 -- 172.21.15.100:0/862179201 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f7fcc036640 msgr2=0x7f7fcc038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/2647899624 2023-12-05T09:49:30.053 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:24.989+0000 7f7fe4abe700 1 --2- 172.21.15.100:0/862179201 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f7fcc036640 0x7f7fcc038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-12-05T09:49:30.053 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:28.192+0000 7f7fe4abe700 1 -- 172.21.15.100:0/862179201 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f7fcc036640 msgr2=0x7f7fcc038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/2647899624 2023-12-05T09:49:30.053 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:28.192+0000 7f7fe4abe700 1 --2- 172.21.15.100:0/862179201 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f7fcc036640 0x7f7fcc038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2023-12-05T09:49:30.053 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:28.563+0000 7f7fd5ffb700 1 -- 172.21.15.100:0/862179201 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mgrmap(e 10) v1 ==== 43061+0+0 (secure 0 0 0) 0x7f7fdc02d770 con 0x7f7fe01022d0 2023-12-05T09:49:30.053 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:28.563+0000 7f7fd5ffb700 1 -- 172.21.15.100:0/862179201 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f7fcc036640 msgr2=0x7f7fcc038af0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-05T09:49:30.053 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:28.563+0000 7f7fd5ffb700 1 --2- 172.21.15.100:0/862179201 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f7fcc036640 0x7f7fcc038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:30.053 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:29.565+0000 7f7fd5ffb700 1 -- 172.21.15.100:0/862179201 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mgrmap(e 11) v1 ==== 43188+0+0 (secure 0 0 0) 0x7f7fdc019a40 con 0x7f7fe01022d0 2023-12-05T09:49:30.054 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:29.565+0000 7f7fd5ffb700 1 --2- 172.21.15.100:0/862179201 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f7fcc039fb0 0x7f7fcc03c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:30.054 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:29.565+0000 7f7fd5ffb700 1 -- 172.21.15.100:0/862179201 --> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7fcc039200 con 0x7f7fcc039fb0 2023-12-05T09:49:30.054 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:29.565+0000 7f7fe4abe700 1 --2- 172.21.15.100:0/862179201 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f7fcc039fb0 0x7f7fcc03c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:30.054 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:29.566+0000 7f7fe4abe700 1 --2- 172.21.15.100:0/862179201 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f7fcc039fb0 0x7f7fcc03c390 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f7fd00039d0 tx=0x7f7fd00092f0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:30.054 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:29.567+0000 7f7fd5ffb700 1 -- 172.21.15.100:0/862179201 <== mgr.14160 v2:172.21.15.100:6800/2397627746 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7f7fcc039200 con 0x7f7fcc039fb0 2023-12-05T09:49:30.054 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:29.574+0000 7f7fe7523700 1 -- 172.21.15.100:0/862179201 --> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f7fe004bb80 con 0x7f7fcc039fb0 2023-12-05T09:49:30.054 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:29.574+0000 7f7fd5ffb700 1 -- 172.21.15.100:0/862179201 <== mgr.14160 v2:172.21.15.100:6800/2397627746 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f7fe004bb80 con 0x7f7fcc039fb0 2023-12-05T09:49:30.054 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:29.575+0000 7f7fe7523700 1 -- 172.21.15.100:0/862179201 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f7fcc039fb0 msgr2=0x7f7fcc03c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:30.054 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:29.575+0000 7f7fe7523700 1 --2- 172.21.15.100:0/862179201 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f7fcc039fb0 0x7f7fcc03c390 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f7fd00039d0 tx=0x7f7fd00092f0 comp rx=0 tx=0).stop 2023-12-05T09:49:30.054 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:29.575+0000 7f7fe7523700 1 -- 172.21.15.100:0/862179201 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fe01022d0 msgr2=0x7f7fe0111180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:30.054 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:29.575+0000 7f7fe7523700 1 --2- 172.21.15.100:0/862179201 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fe01022d0 0x7f7fe0111180 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc011b60 tx=0x7f7fdc009250 comp rx=0 tx=0).stop 2023-12-05T09:49:30.054 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:29.575+0000 7f7fe7523700 1 -- 172.21.15.100:0/862179201 shutdown_connections 2023-12-05T09:49:30.054 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:29.575+0000 7f7fe7523700 1 --2- 172.21.15.100:0/862179201 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f7fcc039fb0 0x7f7fcc03c390 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:30.054 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:29.575+0000 7f7fe7523700 1 --2- 172.21.15.100:0/862179201 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fe01022d0 0x7f7fe0111180 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:30.055 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:29.575+0000 7f7fe7523700 1 --2- 172.21.15.100:0/862179201 >> [v2:172.21.15.100:6800/2647899624,v1:172.21.15.100:6801/2647899624] conn(0x7f7fcc036640 0x7f7fcc038af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:30.055 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:29.575+0000 7f7fe7523700 1 -- 172.21.15.100:0/862179201 >> 172.21.15.100:0/862179201 conn(0x7f7fe00fda50 msgr2=0x7f7fe00ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:49:30.055 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:29.575+0000 7f7fe7523700 1 -- 172.21.15.100:0/862179201 shutdown_connections 2023-12-05T09:49:30.055 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:29.575+0000 7f7fe7523700 1 -- 172.21.15.100:0/862179201 wait complete. 2023-12-05T09:49:30.055 INFO:teuthology.orchestra.run.smithi100.stdout:mgr epoch 9 is available 2023-12-05T09:49:30.055 INFO:teuthology.orchestra.run.smithi100.stdout:Generating a dashboard self-signed certificate... 2023-12-05T09:49:30.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:30 smithi100 ceph-mon[107145]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-12-05T09:49:30.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:30 smithi100 ceph-mon[107145]: mgrmap e11: smithi100.ehmuhg(active, since 1.00912s) 2023-12-05T09:49:30.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:30 smithi100 ceph-mon[107145]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-12-05T09:49:30.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:30 smithi100 ceph-mon[107145]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:49:31.263 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2023-12-05T09:49:31.264 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:30.462+0000 7fb820a85700 1 Processor -- start 2023-12-05T09:49:31.264 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:30.462+0000 7fb820a85700 1 -- start start 2023-12-05T09:49:31.264 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:30.463+0000 7fb820a85700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb81c077bd0 0x7fb81c0760e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:31.269 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:30.463+0000 7fb820a85700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb81c077fe0 con 0x7fb81c077bd0 2023-12-05T09:49:31.269 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:30.463+0000 7fb81a59c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb81c077bd0 0x7fb81c0760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:31.269 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:30.463+0000 7fb81a59c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb81c077bd0 0x7fb81c0760e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60000/0 (socket says 172.21.15.100:60000) 2023-12-05T09:49:31.269 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:30.463+0000 7fb81a59c700 1 -- 172.21.15.100:0/765063062 learned_addr learned my addr 172.21.15.100:0/765063062 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:49:31.269 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:30.464+0000 7fb81a59c700 1 -- 172.21.15.100:0/765063062 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb81c076620 con 0x7fb81c077bd0 2023-12-05T09:49:31.270 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:30.464+0000 7fb81a59c700 1 --2- 172.21.15.100:0/765063062 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb81c077bd0 0x7fb81c0760e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb80c0098e0 tx=0x7fb80c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad6a8d0f26fe3268 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:31.270 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:30.464+0000 7fb81959a700 1 -- 172.21.15.100:0/765063062 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb80c00b860 con 0x7fb81c077bd0 2023-12-05T09:49:31.270 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:30.464+0000 7fb81959a700 1 -- 172.21.15.100:0/765063062 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb80c00be70 con 0x7fb81c077bd0 2023-12-05T09:49:31.270 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:30.464+0000 7fb81959a700 1 -- 172.21.15.100:0/765063062 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb80c010380 con 0x7fb81c077bd0 2023-12-05T09:49:31.270 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:30.465+0000 7fb820a85700 1 -- 172.21.15.100:0/765063062 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb81c077bd0 msgr2=0x7fb81c0760e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:31.270 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:30.465+0000 7fb820a85700 1 --2- 172.21.15.100:0/765063062 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb81c077bd0 0x7fb81c0760e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb80c0098e0 tx=0x7fb80c009250 comp rx=0 tx=0).stop 2023-12-05T09:49:31.270 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:30.465+0000 7fb820a85700 1 -- 172.21.15.100:0/765063062 shutdown_connections 2023-12-05T09:49:31.270 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:30.465+0000 7fb820a85700 1 --2- 172.21.15.100:0/765063062 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb81c077bd0 0x7fb81c0760e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:31.270 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:30.465+0000 7fb820a85700 1 -- 172.21.15.100:0/765063062 >> 172.21.15.100:0/765063062 conn(0x7fb81c0fda50 msgr2=0x7fb81c0ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:49:31.271 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:30.465+0000 7fb820a85700 1 -- 172.21.15.100:0/765063062 shutdown_connections 2023-12-05T09:49:31.271 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:30.465+0000 7fb820a85700 1 -- 172.21.15.100:0/765063062 wait complete. 2023-12-05T09:49:31.271 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:30.466+0000 7fb820a85700 1 Processor -- start 2023-12-05T09:49:31.271 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:30.466+0000 7fb820a85700 1 -- start start 2023-12-05T09:49:31.271 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:30.466+0000 7fb820a85700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb81c077bd0 0x7fb81c1133c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:31.271 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:30.466+0000 7fb820a85700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb81c113900 con 0x7fb81c077bd0 2023-12-05T09:49:31.271 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:30.466+0000 7fb81a59c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb81c077bd0 0x7fb81c1133c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:31.271 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:30.466+0000 7fb81a59c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb81c077bd0 0x7fb81c1133c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60004/0 (socket says 172.21.15.100:60004) 2023-12-05T09:49:31.271 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:30.466+0000 7fb81a59c700 1 -- 172.21.15.100:0/3520068222 learned_addr learned my addr 172.21.15.100:0/3520068222 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:49:31.271 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:30.467+0000 7fb81a59c700 1 -- 172.21.15.100:0/3520068222 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb80c0094f0 con 0x7fb81c077bd0 2023-12-05T09:49:31.271 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:30.467+0000 7fb81a59c700 1 --2- 172.21.15.100:0/3520068222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb81c077bd0 0x7fb81c1133c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb80c006d40 tx=0x7fb80c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:31.271 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:30.467+0000 7fb80affd700 1 -- 172.21.15.100:0/3520068222 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb80c010960 con 0x7fb81c077bd0 2023-12-05T09:49:31.271 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:30.467+0000 7fb80affd700 1 -- 172.21.15.100:0/3520068222 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb80c01a430 con 0x7fb81c077bd0 2023-12-05T09:49:31.271 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:30.467+0000 7fb820a85700 1 -- 172.21.15.100:0/3520068222 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb81c113b00 con 0x7fb81c077bd0 2023-12-05T09:49:31.272 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:30.467+0000 7fb80affd700 1 -- 172.21.15.100:0/3520068222 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb80c0245b0 con 0x7fb81c077bd0 2023-12-05T09:49:31.272 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:30.467+0000 7fb820a85700 1 -- 172.21.15.100:0/3520068222 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb81c113f10 con 0x7fb81c077bd0 2023-12-05T09:49:31.272 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:30.469+0000 7fb820a85700 1 -- 172.21.15.100:0/3520068222 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb81c04bb80 con 0x7fb81c077bd0 2023-12-05T09:49:31.272 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:30.469+0000 7fb80affd700 1 -- 172.21.15.100:0/3520068222 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 11) v1 ==== 43188+0+0 (secure 0 0 0) 0x7fb80c010ac0 con 0x7fb81c077bd0 2023-12-05T09:49:31.272 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:30.469+0000 7fb80affd700 1 --2- 172.21.15.100:0/3520068222 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7fb804036570 0x7fb804038a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:31.272 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:30.469+0000 7fb80affd700 1 -- 172.21.15.100:0/3520068222 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fb80c04a010 con 0x7fb81c077bd0 2023-12-05T09:49:31.272 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:30.470+0000 7fb819d9b700 1 --2- 172.21.15.100:0/3520068222 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7fb804036570 0x7fb804038a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:31.272 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:30.470+0000 7fb819d9b700 1 --2- 172.21.15.100:0/3520068222 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7fb804036570 0x7fb804038a20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb810009990 tx=0x7fb810006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:31.272 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:30.474+0000 7fb80affd700 1 -- 172.21.15.100:0/3520068222 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fb80c07ba00 con 0x7fb81c077bd0 2023-12-05T09:49:31.272 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:30.682+0000 7fb820a85700 1 -- 172.21.15.100:0/3520068222 --> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7fb81c0008d0 con 0x7fb804036570 2023-12-05T09:49:31.272 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:30.922+0000 7fb80affd700 1 -- 172.21.15.100:0/3520068222 <== mgr.14160 v2:172.21.15.100:6800/2397627746 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7fb81c0008d0 con 0x7fb804036570 2023-12-05T09:49:31.272 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:30.924+0000 7fb820a85700 1 -- 172.21.15.100:0/3520068222 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7fb804036570 msgr2=0x7fb804038a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:31.272 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:30.924+0000 7fb820a85700 1 --2- 172.21.15.100:0/3520068222 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7fb804036570 0x7fb804038a20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb810009990 tx=0x7fb810006e40 comp rx=0 tx=0).stop 2023-12-05T09:49:31.272 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:30.924+0000 7fb820a85700 1 -- 172.21.15.100:0/3520068222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb81c077bd0 msgr2=0x7fb81c1133c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:31.273 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:30.924+0000 7fb820a85700 1 --2- 172.21.15.100:0/3520068222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb81c077bd0 0x7fb81c1133c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb80c006d40 tx=0x7fb80c009250 comp rx=0 tx=0).stop 2023-12-05T09:49:31.273 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:30.924+0000 7fb820a85700 1 -- 172.21.15.100:0/3520068222 shutdown_connections 2023-12-05T09:49:31.273 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:30.924+0000 7fb820a85700 1 --2- 172.21.15.100:0/3520068222 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7fb804036570 0x7fb804038a20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:31.273 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:30.924+0000 7fb820a85700 1 --2- 172.21.15.100:0/3520068222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb81c077bd0 0x7fb81c1133c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:31.273 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:30.924+0000 7fb820a85700 1 -- 172.21.15.100:0/3520068222 >> 172.21.15.100:0/3520068222 conn(0x7fb81c0fda50 msgr2=0x7fb81c0ff250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:49:31.273 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:30.925+0000 7fb820a85700 1 -- 172.21.15.100:0/3520068222 shutdown_connections 2023-12-05T09:49:31.273 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:30.925+0000 7fb820a85700 1 -- 172.21.15.100:0/3520068222 wait complete. 2023-12-05T09:49:31.273 INFO:teuthology.orchestra.run.smithi100.stdout:Creating initial admin user... 2023-12-05T09:49:32.172 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:31 smithi100 ceph-mon[107145]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:49:32.172 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:31 smithi100 ceph-mon[107145]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:49:32.172 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:31 smithi100 ceph-mon[107145]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:49:32.172 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:31 smithi100 ceph-mon[107145]: mgrmap e12: smithi100.ehmuhg(active, since 2s) 2023-12-05T09:49:32.172 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:31 smithi100 ceph-mon[107145]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:49:32.724 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$avb5R2xZOOz2Sh.w1sIivepk3W7mdnnc9ci6WetZqPygZuWfdU.0C", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1701769772, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2023-12-05T09:49:32.724 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:31.711+0000 7fa19a017700 1 Processor -- start 2023-12-05T09:49:32.724 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:31.711+0000 7fa19a017700 1 -- start start 2023-12-05T09:49:32.724 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:31.711+0000 7fa19a017700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa194077bb0 0x7fa1940760c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:32.724 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:31.711+0000 7fa19a017700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa194077fc0 con 0x7fa194077bb0 2023-12-05T09:49:32.725 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:31.712+0000 7fa1937fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa194077bb0 0x7fa1940760c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:32.725 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:31.712+0000 7fa1937fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa194077bb0 0x7fa1940760c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60018/0 (socket says 172.21.15.100:60018) 2023-12-05T09:49:32.725 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:31.712+0000 7fa1937fe700 1 -- 172.21.15.100:0/3570358582 learned_addr learned my addr 172.21.15.100:0/3570358582 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:49:32.725 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:31.712+0000 7fa1937fe700 1 -- 172.21.15.100:0/3570358582 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa194076600 con 0x7fa194077bb0 2023-12-05T09:49:32.725 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:31.712+0000 7fa1937fe700 1 --2- 172.21.15.100:0/3570358582 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa194077bb0 0x7fa1940760c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa1840098e0 tx=0x7fa184009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=994d0206384e522c server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:32.725 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:31.713+0000 7fa1927fc700 1 -- 172.21.15.100:0/3570358582 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa18400b860 con 0x7fa194077bb0 2023-12-05T09:49:32.729 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:31.713+0000 7fa1927fc700 1 -- 172.21.15.100:0/3570358582 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa18400be70 con 0x7fa194077bb0 2023-12-05T09:49:32.729 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:31.713+0000 7fa1927fc700 1 -- 172.21.15.100:0/3570358582 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa184010380 con 0x7fa194077bb0 2023-12-05T09:49:32.729 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:31.713+0000 7fa19a017700 1 -- 172.21.15.100:0/3570358582 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa194077bb0 msgr2=0x7fa1940760c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:32.729 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:31.713+0000 7fa19a017700 1 --2- 172.21.15.100:0/3570358582 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa194077bb0 0x7fa1940760c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa1840098e0 tx=0x7fa184009250 comp rx=0 tx=0).stop 2023-12-05T09:49:32.729 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:31.714+0000 7fa19a017700 1 -- 172.21.15.100:0/3570358582 shutdown_connections 2023-12-05T09:49:32.730 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:31.714+0000 7fa19a017700 1 --2- 172.21.15.100:0/3570358582 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa194077bb0 0x7fa1940760c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:32.730 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:31.714+0000 7fa19a017700 1 -- 172.21.15.100:0/3570358582 >> 172.21.15.100:0/3570358582 conn(0x7fa1940fda50 msgr2=0x7fa1940ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:49:32.730 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:31.714+0000 7fa19a017700 1 -- 172.21.15.100:0/3570358582 shutdown_connections 2023-12-05T09:49:32.730 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:31.714+0000 7fa19a017700 1 -- 172.21.15.100:0/3570358582 wait complete. 2023-12-05T09:49:32.730 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:31.715+0000 7fa19a017700 1 Processor -- start 2023-12-05T09:49:32.730 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:31.715+0000 7fa19a017700 1 -- start start 2023-12-05T09:49:32.730 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:31.715+0000 7fa19a017700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa194077bb0 0x7fa1941133d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:32.730 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:31.715+0000 7fa19a017700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa194113910 con 0x7fa194077bb0 2023-12-05T09:49:32.730 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:31.715+0000 7fa1937fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa194077bb0 0x7fa1941133d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:32.730 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:31.715+0000 7fa1937fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa194077bb0 0x7fa1941133d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60030/0 (socket says 172.21.15.100:60030) 2023-12-05T09:49:32.730 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:31.715+0000 7fa1937fe700 1 -- 172.21.15.100:0/1415340735 learned_addr learned my addr 172.21.15.100:0/1415340735 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:49:32.731 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:31.716+0000 7fa1937fe700 1 -- 172.21.15.100:0/1415340735 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1840094f0 con 0x7fa194077bb0 2023-12-05T09:49:32.731 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:31.716+0000 7fa1937fe700 1 --2- 172.21.15.100:0/1415340735 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa194077bb0 0x7fa1941133d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa184006d40 tx=0x7fa184009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:32.731 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:31.716+0000 7fa17bfff700 1 -- 172.21.15.100:0/1415340735 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa184010960 con 0x7fa194077bb0 2023-12-05T09:49:32.731 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:31.716+0000 7fa17bfff700 1 -- 172.21.15.100:0/1415340735 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa18401a430 con 0x7fa194077bb0 2023-12-05T09:49:32.731 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:31.716+0000 7fa19a017700 1 -- 172.21.15.100:0/1415340735 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa194113b10 con 0x7fa194077bb0 2023-12-05T09:49:32.731 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:31.716+0000 7fa17bfff700 1 -- 172.21.15.100:0/1415340735 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa1840245b0 con 0x7fa194077bb0 2023-12-05T09:49:32.731 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:31.716+0000 7fa19a017700 1 -- 172.21.15.100:0/1415340735 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa194113f20 con 0x7fa194077bb0 2023-12-05T09:49:32.731 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:31.718+0000 7fa17bfff700 1 -- 172.21.15.100:0/1415340735 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 12) v1 ==== 43294+0+0 (secure 0 0 0) 0x7fa18402d3f0 con 0x7fa194077bb0 2023-12-05T09:49:32.731 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:31.718+0000 7fa19a017700 1 -- 172.21.15.100:0/1415340735 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa19404bb80 con 0x7fa194077bb0 2023-12-05T09:49:32.731 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:31.718+0000 7fa17bfff700 1 --2- 172.21.15.100:0/1415340735 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7fa17c036690 0x7fa17c038b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:32.731 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:31.718+0000 7fa17bfff700 1 -- 172.21.15.100:0/1415340735 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fa18404a440 con 0x7fa194077bb0 2023-12-05T09:49:32.731 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:31.719+0000 7fa192ffd700 1 --2- 172.21.15.100:0/1415340735 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7fa17c036690 0x7fa17c038b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:32.732 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:31.719+0000 7fa192ffd700 1 --2- 172.21.15.100:0/1415340735 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7fa17c036690 0x7fa17c038b40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa188009990 tx=0x7fa188006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:32.732 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:31.723+0000 7fa17bfff700 1 -- 172.21.15.100:0/1415340735 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fa18402b8e0 con 0x7fa194077bb0 2023-12-05T09:49:32.732 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:31.951+0000 7fa19a017700 1 -- 172.21.15.100:0/1415340735 --> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fa194108550 con 0x7fa17c036690 2023-12-05T09:49:32.732 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:32.179+0000 7fa17bfff700 1 -- 172.21.15.100:0/1415340735 <== mgr.14160 v2:172.21.15.100:6800/2397627746 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7fa194108550 con 0x7fa17c036690 2023-12-05T09:49:32.732 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:32.182+0000 7fa19a017700 1 -- 172.21.15.100:0/1415340735 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7fa17c036690 msgr2=0x7fa17c038b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:32.732 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:32.182+0000 7fa19a017700 1 --2- 172.21.15.100:0/1415340735 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7fa17c036690 0x7fa17c038b40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa188009990 tx=0x7fa188006e40 comp rx=0 tx=0).stop 2023-12-05T09:49:32.732 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:32.182+0000 7fa19a017700 1 -- 172.21.15.100:0/1415340735 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa194077bb0 msgr2=0x7fa1941133d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:32.732 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:32.182+0000 7fa19a017700 1 --2- 172.21.15.100:0/1415340735 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa194077bb0 0x7fa1941133d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa184006d40 tx=0x7fa184009250 comp rx=0 tx=0).stop 2023-12-05T09:49:32.732 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:32.182+0000 7fa19a017700 1 -- 172.21.15.100:0/1415340735 shutdown_connections 2023-12-05T09:49:32.732 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:32.182+0000 7fa19a017700 1 --2- 172.21.15.100:0/1415340735 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7fa17c036690 0x7fa17c038b40 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:32.732 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:32.182+0000 7fa19a017700 1 --2- 172.21.15.100:0/1415340735 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa194077bb0 0x7fa1941133d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:32.732 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:32.182+0000 7fa19a017700 1 -- 172.21.15.100:0/1415340735 >> 172.21.15.100:0/1415340735 conn(0x7fa1940fda50 msgr2=0x7fa1940ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:49:32.733 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:32.182+0000 7fa19a017700 1 -- 172.21.15.100:0/1415340735 shutdown_connections 2023-12-05T09:49:32.733 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:32.182+0000 7fa19a017700 1 -- 172.21.15.100:0/1415340735 wait complete. 2023-12-05T09:49:32.733 INFO:teuthology.orchestra.run.smithi100.stdout:Fetching dashboard port number... 2023-12-05T09:49:33.513 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:33 smithi100 ceph-mon[107145]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:49:33.513 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:33 smithi100 ceph-mon[107145]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:49:33.831 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 8443 2023-12-05T09:49:33.832 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:33.284+0000 7f7331162700 1 Processor -- start 2023-12-05T09:49:33.832 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:33.284+0000 7f7331162700 1 -- start start 2023-12-05T09:49:33.832 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:33.285+0000 7f7331162700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f732c077bb0 0x7f732c0760c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:33.832 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:33.285+0000 7f7331162700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f732c077fc0 con 0x7f732c077bb0 2023-12-05T09:49:33.832 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:33.285+0000 7f732ad9d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f732c077bb0 0x7f732c0760c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:33.832 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:33.285+0000 7f732ad9d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f732c077bb0 0x7f732c0760c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60040/0 (socket says 172.21.15.100:60040) 2023-12-05T09:49:33.832 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:33.285+0000 7f732ad9d700 1 -- 172.21.15.100:0/2821318738 learned_addr learned my addr 172.21.15.100:0/2821318738 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:49:33.832 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:33.286+0000 7f732ad9d700 1 -- 172.21.15.100:0/2821318738 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f732c076600 con 0x7f732c077bb0 2023-12-05T09:49:33.832 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:33.286+0000 7f732ad9d700 1 --2- 172.21.15.100:0/2821318738 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f732c077bb0 0x7f732c0760c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f731c0098e0 tx=0x7f731c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ac1c71c84e8d97d server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:33.832 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:33.286+0000 7f7329d9b700 1 -- 172.21.15.100:0/2821318738 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f731c00b860 con 0x7f732c077bb0 2023-12-05T09:49:33.832 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:33.286+0000 7f7329d9b700 1 -- 172.21.15.100:0/2821318738 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f731c00be70 con 0x7f732c077bb0 2023-12-05T09:49:33.832 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:33.286+0000 7f7329d9b700 1 -- 172.21.15.100:0/2821318738 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f731c010380 con 0x7f732c077bb0 2023-12-05T09:49:33.832 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:33.287+0000 7f7331162700 1 -- 172.21.15.100:0/2821318738 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f732c077bb0 msgr2=0x7f732c0760c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:33.833 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:33.287+0000 7f7331162700 1 --2- 172.21.15.100:0/2821318738 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f732c077bb0 0x7f732c0760c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f731c0098e0 tx=0x7f731c009250 comp rx=0 tx=0).stop 2023-12-05T09:49:33.833 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:33.287+0000 7f7331162700 1 -- 172.21.15.100:0/2821318738 shutdown_connections 2023-12-05T09:49:33.833 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:33.287+0000 7f7331162700 1 --2- 172.21.15.100:0/2821318738 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f732c077bb0 0x7f732c0760c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:33.833 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:33.287+0000 7f7331162700 1 -- 172.21.15.100:0/2821318738 >> 172.21.15.100:0/2821318738 conn(0x7f732c0fda50 msgr2=0x7f732c0ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:49:33.833 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:33.287+0000 7f7331162700 1 -- 172.21.15.100:0/2821318738 shutdown_connections 2023-12-05T09:49:33.833 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:33.287+0000 7f7331162700 1 -- 172.21.15.100:0/2821318738 wait complete. 2023-12-05T09:49:33.833 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:33.288+0000 7f7331162700 1 Processor -- start 2023-12-05T09:49:33.833 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:33.288+0000 7f7331162700 1 -- start start 2023-12-05T09:49:33.833 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:33.288+0000 7f7331162700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f732c077bb0 0x7f732c1133a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:33.833 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:33.288+0000 7f7331162700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f732c1138e0 con 0x7f732c077bb0 2023-12-05T09:49:33.833 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:33.288+0000 7f732ad9d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f732c077bb0 0x7f732c1133a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:33.833 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:33.288+0000 7f732ad9d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f732c077bb0 0x7f732c1133a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60052/0 (socket says 172.21.15.100:60052) 2023-12-05T09:49:33.833 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:33.288+0000 7f732ad9d700 1 -- 172.21.15.100:0/2188185434 learned_addr learned my addr 172.21.15.100:0/2188185434 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:49:33.833 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:33.289+0000 7f732ad9d700 1 -- 172.21.15.100:0/2188185434 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f731c0094f0 con 0x7f732c077bb0 2023-12-05T09:49:33.833 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:33.289+0000 7f732ad9d700 1 --2- 172.21.15.100:0/2188185434 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f732c077bb0 0x7f732c1133a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f731c006d40 tx=0x7f731c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:33.834 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:33.289+0000 7f73137fe700 1 -- 172.21.15.100:0/2188185434 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f731c010960 con 0x7f732c077bb0 2023-12-05T09:49:33.834 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:33.289+0000 7f73137fe700 1 -- 172.21.15.100:0/2188185434 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f731c01a430 con 0x7f732c077bb0 2023-12-05T09:49:33.834 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:33.289+0000 7f73137fe700 1 -- 172.21.15.100:0/2188185434 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f731c0245b0 con 0x7f732c077bb0 2023-12-05T09:49:33.834 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:33.289+0000 7f7331162700 1 -- 172.21.15.100:0/2188185434 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f732c113ae0 con 0x7f732c077bb0 2023-12-05T09:49:33.834 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:33.289+0000 7f7331162700 1 -- 172.21.15.100:0/2188185434 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f732c113ef0 con 0x7f732c077bb0 2023-12-05T09:49:33.834 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:33.291+0000 7f73137fe700 1 -- 172.21.15.100:0/2188185434 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 12) v1 ==== 43294+0+0 (secure 0 0 0) 0x7f731c01a9f0 con 0x7f732c077bb0 2023-12-05T09:49:33.834 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:33.291+0000 7f7331162700 1 -- 172.21.15.100:0/2188185434 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f732c04bb80 con 0x7f732c077bb0 2023-12-05T09:49:33.834 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:33.291+0000 7f73137fe700 1 --2- 172.21.15.100:0/2188185434 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f7314036690 0x7f7314038b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:33.834 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:33.291+0000 7f73137fe700 1 -- 172.21.15.100:0/2188185434 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f731c04a240 con 0x7f732c077bb0 2023-12-05T09:49:33.834 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:33.291+0000 7f732a59c700 1 --2- 172.21.15.100:0/2188185434 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f7314036690 0x7f7314038b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:33.834 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:33.292+0000 7f732a59c700 1 --2- 172.21.15.100:0/2188185434 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f7314036690 0x7f7314038b40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7320009990 tx=0x7f7320006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:33.834 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:33.296+0000 7f73137fe700 1 -- 172.21.15.100:0/2188185434 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f731c02b8c0 con 0x7f732c077bb0 2023-12-05T09:49:33.834 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:33.491+0000 7f7331162700 1 -- 172.21.15.100:0/2188185434 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f732c108550 con 0x7f732c077bb0 2023-12-05T09:49:33.834 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:33.491+0000 7f73137fe700 1 -- 172.21.15.100:0/2188185434 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f731c02b2f0 con 0x7f732c077bb0 2023-12-05T09:49:33.835 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:33.493+0000 7f7331162700 1 -- 172.21.15.100:0/2188185434 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f7314036690 msgr2=0x7f7314038b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:33.835 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:33.493+0000 7f7331162700 1 --2- 172.21.15.100:0/2188185434 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f7314036690 0x7f7314038b40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7320009990 tx=0x7f7320006e40 comp rx=0 tx=0).stop 2023-12-05T09:49:33.835 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:33.493+0000 7f7331162700 1 -- 172.21.15.100:0/2188185434 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f732c077bb0 msgr2=0x7f732c1133a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:33.835 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:33.493+0000 7f7331162700 1 --2- 172.21.15.100:0/2188185434 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f732c077bb0 0x7f732c1133a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f731c006d40 tx=0x7f731c009250 comp rx=0 tx=0).stop 2023-12-05T09:49:33.835 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:33.494+0000 7f7331162700 1 -- 172.21.15.100:0/2188185434 shutdown_connections 2023-12-05T09:49:33.835 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:33.494+0000 7f7331162700 1 --2- 172.21.15.100:0/2188185434 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f7314036690 0x7f7314038b40 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:33.835 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:33.494+0000 7f7331162700 1 --2- 172.21.15.100:0/2188185434 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f732c077bb0 0x7f732c1133a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:33.835 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:33.494+0000 7f7331162700 1 -- 172.21.15.100:0/2188185434 >> 172.21.15.100:0/2188185434 conn(0x7f732c0fda50 msgr2=0x7f732c0ffe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:49:33.835 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:33.494+0000 7f7331162700 1 -- 172.21.15.100:0/2188185434 shutdown_connections 2023-12-05T09:49:33.835 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:33.494+0000 7f7331162700 1 -- 172.21.15.100:0/2188185434 wait complete. 2023-12-05T09:49:33.849 INFO:teuthology.orchestra.run.smithi100.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-12-05T09:49:33.849 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stdout disabled 2023-12-05T09:49:33.867 INFO:teuthology.orchestra.run.smithi100.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-12-05T09:49:33.867 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stdout inactive 2023-12-05T09:49:33.867 INFO:teuthology.orchestra.run.smithi100.stdout:firewalld.service is not enabled 2023-12-05T09:49:33.867 INFO:teuthology.orchestra.run.smithi100.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2023-12-05T09:49:33.869 INFO:teuthology.orchestra.run.smithi100.stdout:Ceph Dashboard is now available at: 2023-12-05T09:49:33.869 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:49:33.869 INFO:teuthology.orchestra.run.smithi100.stdout: URL: https://smithi100.front.sepia.ceph.com:8443/ 2023-12-05T09:49:33.869 INFO:teuthology.orchestra.run.smithi100.stdout: User: admin 2023-12-05T09:49:33.870 INFO:teuthology.orchestra.run.smithi100.stdout: Password: 3psby3d2ye 2023-12-05T09:49:33.870 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:49:33.870 INFO:teuthology.orchestra.run.smithi100.stdout:Saving cluster configuration to /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/config directory 2023-12-05T09:49:33.870 INFO:teuthology.orchestra.run.smithi100.stdout:Enabling autotune for osd_memory_target 2023-12-05T09:49:34.644 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:34 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/2188185434' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2023-12-05T09:49:34.808 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:34.265+0000 7f030a05a700 1 Processor -- start 2023-12-05T09:49:34.808 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:34.265+0000 7f030a05a700 1 -- start start 2023-12-05T09:49:34.808 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:34.266+0000 7f030a05a700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0304077bb0 0x7f03040760c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:34.808 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:34.266+0000 7f030a05a700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0304077fc0 con 0x7f0304077bb0 2023-12-05T09:49:34.809 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:34.266+0000 7f03037fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0304077bb0 0x7f03040760c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:34.809 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:34.266+0000 7f03037fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0304077bb0 0x7f03040760c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60060/0 (socket says 172.21.15.100:60060) 2023-12-05T09:49:34.809 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:34.266+0000 7f03037fe700 1 -- 172.21.15.100:0/2375617224 learned_addr learned my addr 172.21.15.100:0/2375617224 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:49:34.809 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:34.266+0000 7f03037fe700 1 -- 172.21.15.100:0/2375617224 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0304076600 con 0x7f0304077bb0 2023-12-05T09:49:34.809 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:34.267+0000 7f03037fe700 1 --2- 172.21.15.100:0/2375617224 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0304077bb0 0x7f03040760c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f02f40098e0 tx=0x7f02f4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3392eaed16e74bd server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:34.809 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:34.267+0000 7f03027fc700 1 -- 172.21.15.100:0/2375617224 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f02f400b860 con 0x7f0304077bb0 2023-12-05T09:49:34.809 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:34.267+0000 7f03027fc700 1 -- 172.21.15.100:0/2375617224 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f02f400be70 con 0x7f0304077bb0 2023-12-05T09:49:34.809 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:34.267+0000 7f03027fc700 1 -- 172.21.15.100:0/2375617224 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f02f4010380 con 0x7f0304077bb0 2023-12-05T09:49:34.809 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:34.267+0000 7f030a05a700 1 -- 172.21.15.100:0/2375617224 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0304077bb0 msgr2=0x7f03040760c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:34.809 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:34.267+0000 7f030a05a700 1 --2- 172.21.15.100:0/2375617224 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0304077bb0 0x7f03040760c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f02f40098e0 tx=0x7f02f4009250 comp rx=0 tx=0).stop 2023-12-05T09:49:34.809 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:34.267+0000 7f030a05a700 1 -- 172.21.15.100:0/2375617224 shutdown_connections 2023-12-05T09:49:34.809 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:34.268+0000 7f030a05a700 1 --2- 172.21.15.100:0/2375617224 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0304077bb0 0x7f03040760c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:34.809 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:34.268+0000 7f030a05a700 1 -- 172.21.15.100:0/2375617224 >> 172.21.15.100:0/2375617224 conn(0x7f03040fda50 msgr2=0x7f03040ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:49:34.809 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:34.268+0000 7f030a05a700 1 -- 172.21.15.100:0/2375617224 shutdown_connections 2023-12-05T09:49:34.810 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:34.268+0000 7f030a05a700 1 -- 172.21.15.100:0/2375617224 wait complete. 2023-12-05T09:49:34.810 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:34.268+0000 7f030a05a700 1 Processor -- start 2023-12-05T09:49:34.810 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:34.269+0000 7f030a05a700 1 -- start start 2023-12-05T09:49:34.810 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:34.269+0000 7f030a05a700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0304077bb0 0x7f03041133a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:34.810 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:34.269+0000 7f030a05a700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03041138e0 con 0x7f0304077bb0 2023-12-05T09:49:34.810 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:34.269+0000 7f03037fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0304077bb0 0x7f03041133a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:34.810 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:34.269+0000 7f03037fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0304077bb0 0x7f03041133a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60070/0 (socket says 172.21.15.100:60070) 2023-12-05T09:49:34.810 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:34.269+0000 7f03037fe700 1 -- 172.21.15.100:0/3572023734 learned_addr learned my addr 172.21.15.100:0/3572023734 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:49:34.810 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:34.269+0000 7f03037fe700 1 -- 172.21.15.100:0/3572023734 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02f40094f0 con 0x7f0304077bb0 2023-12-05T09:49:34.810 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:34.270+0000 7f03037fe700 1 --2- 172.21.15.100:0/3572023734 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0304077bb0 0x7f03041133a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f02f4006d40 tx=0x7f02f4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:34.810 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:34.270+0000 7f02ebfff700 1 -- 172.21.15.100:0/3572023734 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f02f4010960 con 0x7f0304077bb0 2023-12-05T09:49:34.810 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:34.270+0000 7f030a05a700 1 -- 172.21.15.100:0/3572023734 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0304113ae0 con 0x7f0304077bb0 2023-12-05T09:49:34.811 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:34.270+0000 7f02ebfff700 1 -- 172.21.15.100:0/3572023734 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f02f401a430 con 0x7f0304077bb0 2023-12-05T09:49:34.811 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:34.270+0000 7f02ebfff700 1 -- 172.21.15.100:0/3572023734 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f02f40245b0 con 0x7f0304077bb0 2023-12-05T09:49:34.811 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:34.270+0000 7f030a05a700 1 -- 172.21.15.100:0/3572023734 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0304113ef0 con 0x7f0304077bb0 2023-12-05T09:49:34.811 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:34.271+0000 7f02ebfff700 1 -- 172.21.15.100:0/3572023734 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 12) v1 ==== 43294+0+0 (secure 0 0 0) 0x7f02f401a9f0 con 0x7f0304077bb0 2023-12-05T09:49:34.811 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:34.271+0000 7f030a05a700 1 -- 172.21.15.100:0/3572023734 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f030404bb80 con 0x7f0304077bb0 2023-12-05T09:49:34.811 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:34.271+0000 7f02ebfff700 1 --2- 172.21.15.100:0/3572023734 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f02ec036640 0x7f02ec038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:34.811 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:34.271+0000 7f02ebfff700 1 -- 172.21.15.100:0/3572023734 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f02f404a270 con 0x7f0304077bb0 2023-12-05T09:49:34.811 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:34.272+0000 7f0302ffd700 1 --2- 172.21.15.100:0/3572023734 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f02ec036640 0x7f02ec038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:34.811 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:34.272+0000 7f0302ffd700 1 --2- 172.21.15.100:0/3572023734 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f02ec036640 0x7f02ec038af0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f02f8009990 tx=0x7f02f8006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:34.811 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:34.276+0000 7f02ebfff700 1 -- 172.21.15.100:0/3572023734 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f02f402b8e0 con 0x7f0304077bb0 2023-12-05T09:49:34.811 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:34.470+0000 7f030a05a700 1 -- 172.21.15.100:0/3572023734 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f0304108550 con 0x7f0304077bb0 2023-12-05T09:49:34.811 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:34.471+0000 7f02ebfff700 1 -- 172.21.15.100:0/3572023734 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f02f402b2f0 con 0x7f0304077bb0 2023-12-05T09:49:34.811 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:34.473+0000 7f030a05a700 1 -- 172.21.15.100:0/3572023734 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f02ec036640 msgr2=0x7f02ec038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:34.811 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:34.473+0000 7f030a05a700 1 --2- 172.21.15.100:0/3572023734 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f02ec036640 0x7f02ec038af0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f02f8009990 tx=0x7f02f8006e40 comp rx=0 tx=0).stop 2023-12-05T09:49:34.812 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:34.473+0000 7f030a05a700 1 -- 172.21.15.100:0/3572023734 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0304077bb0 msgr2=0x7f03041133a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:34.812 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:34.473+0000 7f030a05a700 1 --2- 172.21.15.100:0/3572023734 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0304077bb0 0x7f03041133a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f02f4006d40 tx=0x7f02f4009250 comp rx=0 tx=0).stop 2023-12-05T09:49:34.812 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:34.473+0000 7f030a05a700 1 -- 172.21.15.100:0/3572023734 shutdown_connections 2023-12-05T09:49:34.812 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:34.473+0000 7f030a05a700 1 --2- 172.21.15.100:0/3572023734 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f02ec036640 0x7f02ec038af0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:34.812 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:34.473+0000 7f030a05a700 1 --2- 172.21.15.100:0/3572023734 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0304077bb0 0x7f03041133a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:34.812 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:34.473+0000 7f030a05a700 1 -- 172.21.15.100:0/3572023734 >> 172.21.15.100:0/3572023734 conn(0x7f03040fda50 msgr2=0x7f03040ffe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:49:34.812 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:34.473+0000 7f030a05a700 1 -- 172.21.15.100:0/3572023734 shutdown_connections 2023-12-05T09:49:34.812 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:34.473+0000 7f030a05a700 1 -- 172.21.15.100:0/3572023734 wait complete. 2023-12-05T09:49:35.849 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:35.207+0000 7f6dc3ff2700 1 Processor -- start 2023-12-05T09:49:35.849 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:35.207+0000 7f6dc3ff2700 1 -- start start 2023-12-05T09:49:35.849 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:35.208+0000 7f6dc3ff2700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6dbc077bd0 0x7f6dbc0760e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:35.849 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:35.208+0000 7f6dc3ff2700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dbc077fe0 con 0x7f6dbc077bd0 2023-12-05T09:49:35.849 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:35.208+0000 7f6dc1d8e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6dbc077bd0 0x7f6dbc0760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:35.849 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:35.208+0000 7f6dc1d8e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6dbc077bd0 0x7f6dbc0760e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60080/0 (socket says 172.21.15.100:60080) 2023-12-05T09:49:35.849 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:35.208+0000 7f6dc1d8e700 1 -- 172.21.15.100:0/1777022426 learned_addr learned my addr 172.21.15.100:0/1777022426 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:49:35.849 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:35.208+0000 7f6dc1d8e700 1 -- 172.21.15.100:0/1777022426 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dbc076620 con 0x7f6dbc077bd0 2023-12-05T09:49:35.849 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:35.209+0000 7f6dc1d8e700 1 --2- 172.21.15.100:0/1777022426 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6dbc077bd0 0x7f6dbc0760e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6db80098e0 tx=0x7f6db8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf64713db8fe476f server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:35.849 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:35.209+0000 7f6dc0d8c700 1 -- 172.21.15.100:0/1777022426 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6db800b860 con 0x7f6dbc077bd0 2023-12-05T09:49:35.850 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:35.209+0000 7f6dc0d8c700 1 -- 172.21.15.100:0/1777022426 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6db800be70 con 0x7f6dbc077bd0 2023-12-05T09:49:35.850 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:35.209+0000 7f6dc0d8c700 1 -- 172.21.15.100:0/1777022426 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6db8010380 con 0x7f6dbc077bd0 2023-12-05T09:49:35.850 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:35.209+0000 7f6dc3ff2700 1 -- 172.21.15.100:0/1777022426 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6dbc077bd0 msgr2=0x7f6dbc0760e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:35.850 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:35.209+0000 7f6dc3ff2700 1 --2- 172.21.15.100:0/1777022426 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6dbc077bd0 0x7f6dbc0760e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6db80098e0 tx=0x7f6db8009250 comp rx=0 tx=0).stop 2023-12-05T09:49:35.850 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:35.210+0000 7f6dc3ff2700 1 -- 172.21.15.100:0/1777022426 shutdown_connections 2023-12-05T09:49:35.850 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:35.210+0000 7f6dc3ff2700 1 --2- 172.21.15.100:0/1777022426 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6dbc077bd0 0x7f6dbc0760e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:35.850 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:35.210+0000 7f6dc3ff2700 1 -- 172.21.15.100:0/1777022426 >> 172.21.15.100:0/1777022426 conn(0x7f6dbc0fda50 msgr2=0x7f6dbc0ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:49:35.850 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:35.210+0000 7f6dc3ff2700 1 -- 172.21.15.100:0/1777022426 shutdown_connections 2023-12-05T09:49:35.850 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:35.210+0000 7f6dc3ff2700 1 -- 172.21.15.100:0/1777022426 wait complete. 2023-12-05T09:49:35.850 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:35.210+0000 7f6dc3ff2700 1 Processor -- start 2023-12-05T09:49:35.850 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:35.211+0000 7f6dc3ff2700 1 -- start start 2023-12-05T09:49:35.850 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:35.211+0000 7f6dc3ff2700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6dbc077bd0 0x7f6dbc113370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:35.850 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:35.211+0000 7f6dc3ff2700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dbc1138b0 con 0x7f6dbc077bd0 2023-12-05T09:49:35.850 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:35.211+0000 7f6dc1d8e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6dbc077bd0 0x7f6dbc113370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:35.851 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:35.211+0000 7f6dc1d8e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6dbc077bd0 0x7f6dbc113370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60086/0 (socket says 172.21.15.100:60086) 2023-12-05T09:49:35.851 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:35.211+0000 7f6dc1d8e700 1 -- 172.21.15.100:0/2856230202 learned_addr learned my addr 172.21.15.100:0/2856230202 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:49:35.851 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:35.211+0000 7f6dc1d8e700 1 -- 172.21.15.100:0/2856230202 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db80094f0 con 0x7f6dbc077bd0 2023-12-05T09:49:35.851 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:35.212+0000 7f6dc1d8e700 1 --2- 172.21.15.100:0/2856230202 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6dbc077bd0 0x7f6dbc113370 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6db8006d40 tx=0x7f6db8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:35.851 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:35.212+0000 7f6db27fc700 1 -- 172.21.15.100:0/2856230202 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6db8010960 con 0x7f6dbc077bd0 2023-12-05T09:49:35.851 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:35.212+0000 7f6db27fc700 1 -- 172.21.15.100:0/2856230202 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6db801a430 con 0x7f6dbc077bd0 2023-12-05T09:49:35.851 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:35.212+0000 7f6db27fc700 1 -- 172.21.15.100:0/2856230202 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6db80245b0 con 0x7f6dbc077bd0 2023-12-05T09:49:35.851 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:35.212+0000 7f6dc3ff2700 1 -- 172.21.15.100:0/2856230202 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dbc113ab0 con 0x7f6dbc077bd0 2023-12-05T09:49:35.851 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:35.212+0000 7f6dc3ff2700 1 -- 172.21.15.100:0/2856230202 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dbc113ec0 con 0x7f6dbc077bd0 2023-12-05T09:49:35.851 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:35.213+0000 7f6db27fc700 1 -- 172.21.15.100:0/2856230202 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 12) v1 ==== 43294+0+0 (secure 0 0 0) 0x7f6db801a9f0 con 0x7f6dbc077bd0 2023-12-05T09:49:35.851 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:35.213+0000 7f6dc3ff2700 1 -- 172.21.15.100:0/2856230202 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dbc04bb80 con 0x7f6dbc077bd0 2023-12-05T09:49:35.851 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:35.213+0000 7f6db27fc700 1 --2- 172.21.15.100:0/2856230202 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f6da8036690 0x7f6da8038b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:35.851 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:35.213+0000 7f6db27fc700 1 -- 172.21.15.100:0/2856230202 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f6db804a240 con 0x7f6dbc077bd0 2023-12-05T09:49:35.851 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:35.214+0000 7f6dc158d700 1 --2- 172.21.15.100:0/2856230202 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f6da8036690 0x7f6da8038b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:35.851 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:35.214+0000 7f6dc158d700 1 --2- 172.21.15.100:0/2856230202 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f6da8036690 0x7f6da8038b40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6dac009990 tx=0x7f6dac006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:35.852 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:35.218+0000 7f6db27fc700 1 -- 172.21.15.100:0/2856230202 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f6db802b8c0 con 0x7f6dbc077bd0 2023-12-05T09:49:35.852 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:35.320+0000 7f6db27fc700 1 -- 172.21.15.100:0/2856230202 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mgrmap(e 13) v1 ==== 43338+0+0 (secure 0 0 0) 0x7f6db802d3f0 con 0x7f6dbc077bd0 2023-12-05T09:49:35.852 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:35.516+0000 7f6dc3ff2700 1 -- 172.21.15.100:0/2856230202 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f6dbc108540 con 0x7f6dbc077bd0 2023-12-05T09:49:35.852 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:35.519+0000 7f6db27fc700 1 -- 172.21.15.100:0/2856230202 <== mon.0 v2:172.21.15.100:3300/0 8 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v33)=0 set mgr/dashboard/cluster/status v33) v1 ==== 153+0+0 (secure 0 0 0) 0x7f6db80172b0 con 0x7f6dbc077bd0 2023-12-05T09:49:35.852 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:35.521+0000 7f6dc3ff2700 1 -- 172.21.15.100:0/2856230202 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f6da8036690 msgr2=0x7f6da8038b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:35.852 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:35.521+0000 7f6dc3ff2700 1 --2- 172.21.15.100:0/2856230202 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f6da8036690 0x7f6da8038b40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6dac009990 tx=0x7f6dac006e40 comp rx=0 tx=0).stop 2023-12-05T09:49:35.852 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:35.521+0000 7f6dc3ff2700 1 -- 172.21.15.100:0/2856230202 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6dbc077bd0 msgr2=0x7f6dbc113370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:35.852 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:35.521+0000 7f6dc3ff2700 1 --2- 172.21.15.100:0/2856230202 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6dbc077bd0 0x7f6dbc113370 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6db8006d40 tx=0x7f6db8009250 comp rx=0 tx=0).stop 2023-12-05T09:49:35.852 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:35.521+0000 7f6dc3ff2700 1 -- 172.21.15.100:0/2856230202 shutdown_connections 2023-12-05T09:49:35.852 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:35.521+0000 7f6dc3ff2700 1 --2- 172.21.15.100:0/2856230202 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f6da8036690 0x7f6da8038b40 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:35.852 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:35.521+0000 7f6dc3ff2700 1 --2- 172.21.15.100:0/2856230202 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6dbc077bd0 0x7f6dbc113370 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:35.852 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:35.521+0000 7f6dc3ff2700 1 -- 172.21.15.100:0/2856230202 >> 172.21.15.100:0/2856230202 conn(0x7f6dbc0fda50 msgr2=0x7f6dbc0ffe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:49:35.852 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:35.522+0000 7f6dc3ff2700 1 -- 172.21.15.100:0/2856230202 shutdown_connections 2023-12-05T09:49:35.852 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2023-12-05T09:49:35.522+0000 7f6dc3ff2700 1 -- 172.21.15.100:0/2856230202 wait complete. 2023-12-05T09:49:35.853 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2023-12-05T09:49:35.853 INFO:teuthology.orchestra.run.smithi100.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2023-12-05T09:49:35.853 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:49:35.853 INFO:teuthology.orchestra.run.smithi100.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2023-12-05T09:49:35.853 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:49:35.853 INFO:teuthology.orchestra.run.smithi100.stdout:Or, if you are only running a single cluster on this host: 2023-12-05T09:49:35.853 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:49:35.853 INFO:teuthology.orchestra.run.smithi100.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2023-12-05T09:49:35.853 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:49:35.853 INFO:teuthology.orchestra.run.smithi100.stdout:Please consider enabling telemetry to help improve Ceph: 2023-12-05T09:49:35.853 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:49:35.853 INFO:teuthology.orchestra.run.smithi100.stdout: ceph telemetry on 2023-12-05T09:49:35.853 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:49:35.853 INFO:teuthology.orchestra.run.smithi100.stdout:For more information see: 2023-12-05T09:49:35.853 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:49:35.853 INFO:teuthology.orchestra.run.smithi100.stdout: https://docs.ceph.com/docs/master/mgr/telemetry/ 2023-12-05T09:49:35.854 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:49:35.854 INFO:teuthology.orchestra.run.smithi100.stdout:Bootstrap complete. 2023-12-05T09:49:35.904 INFO:tasks.cephadm:Fetching config... 2023-12-05T09:49:35.904 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-12-05T09:49:35.905 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2023-12-05T09:49:35.956 INFO:tasks.cephadm:Fetching client.admin keyring... 2023-12-05T09:49:35.956 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-12-05T09:49:35.956 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2023-12-05T09:49:36.002 INFO:tasks.cephadm:Fetching mon keyring... 2023-12-05T09:49:36.003 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-12-05T09:49:36.003 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi100/keyring of=/dev/stdout 2023-12-05T09:49:36.120 INFO:tasks.cephadm:Fetching pub ssh key... 2023-12-05T09:49:36.120 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-12-05T09:49:36.120 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2023-12-05T09:49:36.213 INFO:tasks.cephadm:Installing pub ssh key for root users... 2023-12-05T09:49:36.213 DEBUG:teuthology.orchestra.run.smithi100:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDIE/8lVOKD1/uRhb84cg6Ufo9SHGvXM/Wf5pvnGeRX3RneGbr1BaLsz/HTn70LwmtolBoVss53OSZOkZdObjkdEClmTHOkFzupfV7HHHrdLFcZ9XzAmLSit6uw+ZcaxLuuOeZFA7Uj7lIBiKi21VfwcFeyjsCE82Fc7jApS7XOYIOUU1bpw1Vbu/dtMKZ3haeY9gncFm+uDTq/afwBasors5Fl4Igd5YYWrbKCBROiiARQ9hHiP00uHk2aOZ1mSTmmyUYTUI4s9HAuJWzbO6XL3z7pTgzjoWZ3eNR+GW6DcmUMqspWaGuucSGUq3sl3dhu0U7MehAuwhM7TiFSdi1biYK9ZP/pLVzxr8DItIsnbz5oksDkIBxNoZYJrLgcxsJ2NeNxNNkN1cBVtmidWjj2yTPweG/N3aMqkN+2hYbgSJTqAokGhdgOCk/tyuMdltNSlry3XS41WyaZDemWOQi1PvPUNFrAIjN7oDETYaBFSm8Ty5vzaE9slEoUaxWlAWk= ceph-5b035ce6-9353-11ee-95a2-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-12-05T09:49:36.312 INFO:teuthology.orchestra.run.smithi100.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDIE/8lVOKD1/uRhb84cg6Ufo9SHGvXM/Wf5pvnGeRX3RneGbr1BaLsz/HTn70LwmtolBoVss53OSZOkZdObjkdEClmTHOkFzupfV7HHHrdLFcZ9XzAmLSit6uw+ZcaxLuuOeZFA7Uj7lIBiKi21VfwcFeyjsCE82Fc7jApS7XOYIOUU1bpw1Vbu/dtMKZ3haeY9gncFm+uDTq/afwBasors5Fl4Igd5YYWrbKCBROiiARQ9hHiP00uHk2aOZ1mSTmmyUYTUI4s9HAuJWzbO6XL3z7pTgzjoWZ3eNR+GW6DcmUMqspWaGuucSGUq3sl3dhu0U7MehAuwhM7TiFSdi1biYK9ZP/pLVzxr8DItIsnbz5oksDkIBxNoZYJrLgcxsJ2NeNxNNkN1cBVtmidWjj2yTPweG/N3aMqkN+2hYbgSJTqAokGhdgOCk/tyuMdltNSlry3XS41WyaZDemWOQi1PvPUNFrAIjN7oDETYaBFSm8Ty5vzaE9slEoUaxWlAWk= ceph-5b035ce6-9353-11ee-95a2-87774f69a715 2023-12-05T09:49:36.343 DEBUG:teuthology.orchestra.run.smithi150:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDIE/8lVOKD1/uRhb84cg6Ufo9SHGvXM/Wf5pvnGeRX3RneGbr1BaLsz/HTn70LwmtolBoVss53OSZOkZdObjkdEClmTHOkFzupfV7HHHrdLFcZ9XzAmLSit6uw+ZcaxLuuOeZFA7Uj7lIBiKi21VfwcFeyjsCE82Fc7jApS7XOYIOUU1bpw1Vbu/dtMKZ3haeY9gncFm+uDTq/afwBasors5Fl4Igd5YYWrbKCBROiiARQ9hHiP00uHk2aOZ1mSTmmyUYTUI4s9HAuJWzbO6XL3z7pTgzjoWZ3eNR+GW6DcmUMqspWaGuucSGUq3sl3dhu0U7MehAuwhM7TiFSdi1biYK9ZP/pLVzxr8DItIsnbz5oksDkIBxNoZYJrLgcxsJ2NeNxNNkN1cBVtmidWjj2yTPweG/N3aMqkN+2hYbgSJTqAokGhdgOCk/tyuMdltNSlry3XS41WyaZDemWOQi1PvPUNFrAIjN7oDETYaBFSm8Ty5vzaE9slEoUaxWlAWk= ceph-5b035ce6-9353-11ee-95a2-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-12-05T09:49:36.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:36 smithi100 ceph-mon[107145]: mgrmap e13: smithi100.ehmuhg(active, since 6s) 2023-12-05T09:49:36.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:36 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/2856230202' entity='client.admin' 2023-12-05T09:49:36.447 INFO:teuthology.orchestra.run.smithi150.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDIE/8lVOKD1/uRhb84cg6Ufo9SHGvXM/Wf5pvnGeRX3RneGbr1BaLsz/HTn70LwmtolBoVss53OSZOkZdObjkdEClmTHOkFzupfV7HHHrdLFcZ9XzAmLSit6uw+ZcaxLuuOeZFA7Uj7lIBiKi21VfwcFeyjsCE82Fc7jApS7XOYIOUU1bpw1Vbu/dtMKZ3haeY9gncFm+uDTq/afwBasors5Fl4Igd5YYWrbKCBROiiARQ9hHiP00uHk2aOZ1mSTmmyUYTUI4s9HAuJWzbO6XL3z7pTgzjoWZ3eNR+GW6DcmUMqspWaGuucSGUq3sl3dhu0U7MehAuwhM7TiFSdi1biYK9ZP/pLVzxr8DItIsnbz5oksDkIBxNoZYJrLgcxsJ2NeNxNNkN1cBVtmidWjj2yTPweG/N3aMqkN+2hYbgSJTqAokGhdgOCk/tyuMdltNSlry3XS41WyaZDemWOQi1PvPUNFrAIjN7oDETYaBFSm8Ty5vzaE9slEoUaxWlAWk= ceph-5b035ce6-9353-11ee-95a2-87774f69a715 2023-12-05T09:49:36.475 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2023-12-05T09:49:36.893 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi100/config 2023-12-05T09:49:38.405 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:38.406+0000 7ffba0321700 1 -- 172.21.15.100:0/4021599090 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb98071bc0 msgr2=0x7ffb98070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:38.405 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:38.406+0000 7ffba0321700 1 --2- 172.21.15.100:0/4021599090 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb98071bc0 0x7ffb98070030 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ffb940048c0 tx=0x7ffb94009e30 comp rx=0 tx=0).stop 2023-12-05T09:49:38.405 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:38.407+0000 7ffba0321700 1 -- 172.21.15.100:0/4021599090 shutdown_connections 2023-12-05T09:49:38.405 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:38.407+0000 7ffba0321700 1 --2- 172.21.15.100:0/4021599090 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb98071bc0 0x7ffb98070030 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:38.405 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:38.407+0000 7ffba0321700 1 -- 172.21.15.100:0/4021599090 >> 172.21.15.100:0/4021599090 conn(0x7ffb980f7f50 msgr2=0x7ffb980fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:49:38.405 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:38.407+0000 7ffba0321700 1 -- 172.21.15.100:0/4021599090 shutdown_connections 2023-12-05T09:49:38.405 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:38.407+0000 7ffba0321700 1 -- 172.21.15.100:0/4021599090 wait complete. 2023-12-05T09:49:38.406 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:38.408+0000 7ffba0321700 1 Processor -- start 2023-12-05T09:49:38.406 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:38.408+0000 7ffba0321700 1 -- start start 2023-12-05T09:49:38.407 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:38.408+0000 7ffba0321700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb98071bc0 0x7ffb98113040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:38.407 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:38.408+0000 7ffba0321700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb98113580 con 0x7ffb98071bc0 2023-12-05T09:49:38.407 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:38.409+0000 7ffb9e0bd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb98071bc0 0x7ffb98113040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:38.407 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:38.409+0000 7ffb9e0bd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb98071bc0 0x7ffb98113040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60110/0 (socket says 172.21.15.100:60110) 2023-12-05T09:49:38.407 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:38.409+0000 7ffb9e0bd700 1 -- 172.21.15.100:0/1872361923 learned_addr learned my addr 172.21.15.100:0/1872361923 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:49:38.407 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:38.409+0000 7ffb9e0bd700 1 -- 172.21.15.100:0/1872361923 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb94005040 con 0x7ffb98071bc0 2023-12-05T09:49:38.408 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:38.409+0000 7ffb9e0bd700 1 --2- 172.21.15.100:0/1872361923 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb98071bc0 0x7ffb98113040 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ffb9400b690 tx=0x7ffb94009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:38.408 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:38.410+0000 7ffb8effd700 1 -- 172.21.15.100:0/1872361923 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffb94009650 con 0x7ffb98071bc0 2023-12-05T09:49:38.408 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:38.410+0000 7ffb8effd700 1 -- 172.21.15.100:0/1872361923 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ffb940097b0 con 0x7ffb98071bc0 2023-12-05T09:49:38.408 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:38.410+0000 7ffb8effd700 1 -- 172.21.15.100:0/1872361923 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffb9401c5b0 con 0x7ffb98071bc0 2023-12-05T09:49:38.408 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:38.410+0000 7ffba0321700 1 -- 172.21.15.100:0/1872361923 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb98113780 con 0x7ffb98071bc0 2023-12-05T09:49:38.408 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:38.410+0000 7ffba0321700 1 -- 172.21.15.100:0/1872361923 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb98114420 con 0x7ffb98071bc0 2023-12-05T09:49:38.408 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:38.411+0000 7ffba0321700 1 -- 172.21.15.100:0/1872361923 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb9805f270 con 0x7ffb98071bc0 2023-12-05T09:49:38.409 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:38.411+0000 7ffb8effd700 1 -- 172.21.15.100:0/1872361923 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) v1 ==== 43338+0+0 (secure 0 0 0) 0x7ffb94013a60 con 0x7ffb98071bc0 2023-12-05T09:49:38.409 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:38.412+0000 7ffb8effd700 1 --2- 172.21.15.100:0/1872361923 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7ffb840366d0 0x7ffb84038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:38.409 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:38.412+0000 7ffb8effd700 1 -- 172.21.15.100:0/1872361923 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7ffb94049850 con 0x7ffb98071bc0 2023-12-05T09:49:38.410 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:38.412+0000 7ffb9d8bc700 1 --2- 172.21.15.100:0/1872361923 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7ffb840366d0 0x7ffb84038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:38.410 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:38.412+0000 7ffb9d8bc700 1 --2- 172.21.15.100:0/1872361923 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7ffb840366d0 0x7ffb84038b80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ffb88009990 tx=0x7ffb88006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:38.414 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:38.417+0000 7ffb8effd700 1 -- 172.21.15.100:0/1872361923 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ffb94011550 con 0x7ffb98071bc0 2023-12-05T09:49:38.612 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:38.614+0000 7ffba0321700 1 -- 172.21.15.100:0/1872361923 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7ffb9804bb80 con 0x7ffb98071bc0 2023-12-05T09:49:38.617 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:38.619+0000 7ffb8effd700 1 -- 172.21.15.100:0/1872361923 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7ffb94011370 con 0x7ffb98071bc0 2023-12-05T09:49:38.620 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:38.622+0000 7ffba0321700 1 -- 172.21.15.100:0/1872361923 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7ffb840366d0 msgr2=0x7ffb84038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:38.620 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:38.622+0000 7ffba0321700 1 --2- 172.21.15.100:0/1872361923 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7ffb840366d0 0x7ffb84038b80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ffb88009990 tx=0x7ffb88006e40 comp rx=0 tx=0).stop 2023-12-05T09:49:38.620 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:38.622+0000 7ffba0321700 1 -- 172.21.15.100:0/1872361923 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb98071bc0 msgr2=0x7ffb98113040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:38.620 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:38.622+0000 7ffba0321700 1 --2- 172.21.15.100:0/1872361923 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb98071bc0 0x7ffb98113040 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ffb9400b690 tx=0x7ffb94009e30 comp rx=0 tx=0).stop 2023-12-05T09:49:38.620 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:38.622+0000 7ffba0321700 1 -- 172.21.15.100:0/1872361923 shutdown_connections 2023-12-05T09:49:38.620 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:38.622+0000 7ffba0321700 1 --2- 172.21.15.100:0/1872361923 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7ffb840366d0 0x7ffb84038b80 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:38.621 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:38.622+0000 7ffba0321700 1 --2- 172.21.15.100:0/1872361923 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb98071bc0 0x7ffb98113040 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:38.621 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:38.622+0000 7ffba0321700 1 -- 172.21.15.100:0/1872361923 >> 172.21.15.100:0/1872361923 conn(0x7ffb980f7f50 msgr2=0x7ffb980f8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:49:38.621 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:38.622+0000 7ffba0321700 1 -- 172.21.15.100:0/1872361923 shutdown_connections 2023-12-05T09:49:38.621 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:38.622+0000 7ffba0321700 1 -- 172.21.15.100:0/1872361923 wait complete. 2023-12-05T09:49:39.001 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2023-12-05T09:49:39.002 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- ceph orch client-keyring set client.admin '*' --mode 0755 2023-12-05T09:49:39.472 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi100/config 2023-12-05T09:49:39.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:39 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/1872361923' entity='client.admin' 2023-12-05T09:49:40.824 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:40.826+0000 7f4884543700 1 -- 172.21.15.100:0/2665153837 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f487c071bc0 msgr2=0x7f487c070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:40.824 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:40.826+0000 7f4884543700 1 --2- 172.21.15.100:0/2665153837 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f487c071bc0 0x7f487c070030 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f48780048c0 tx=0x7f4878009e30 comp rx=0 tx=0).stop 2023-12-05T09:49:40.824 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:40.826+0000 7f4884543700 1 -- 172.21.15.100:0/2665153837 shutdown_connections 2023-12-05T09:49:40.824 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:40.826+0000 7f4884543700 1 --2- 172.21.15.100:0/2665153837 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f487c071bc0 0x7f487c070030 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:40.824 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:40.826+0000 7f4884543700 1 -- 172.21.15.100:0/2665153837 >> 172.21.15.100:0/2665153837 conn(0x7f487c0f7f50 msgr2=0x7f487c0fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:49:40.825 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:40.826+0000 7f4884543700 1 -- 172.21.15.100:0/2665153837 shutdown_connections 2023-12-05T09:49:40.825 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:40.826+0000 7f4884543700 1 -- 172.21.15.100:0/2665153837 wait complete. 2023-12-05T09:49:40.825 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:40.827+0000 7f4884543700 1 Processor -- start 2023-12-05T09:49:40.825 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:40.828+0000 7f4884543700 1 -- start start 2023-12-05T09:49:40.825 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:40.828+0000 7f4884543700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f487c071bc0 0x7f487c113060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:40.826 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:40.828+0000 7f4884543700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f487c1135a0 con 0x7f487c071bc0 2023-12-05T09:49:40.826 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:40.829+0000 7f48822df700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f487c071bc0 0x7f487c113060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:40.826 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:40.829+0000 7f48822df700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f487c071bc0 0x7f487c113060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37640/0 (socket says 172.21.15.100:37640) 2023-12-05T09:49:40.826 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:40.829+0000 7f48822df700 1 -- 172.21.15.100:0/846227807 learned_addr learned my addr 172.21.15.100:0/846227807 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:49:40.826 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:40.829+0000 7f48822df700 1 -- 172.21.15.100:0/846227807 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4878005040 con 0x7f487c071bc0 2023-12-05T09:49:40.827 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:40.829+0000 7f48822df700 1 --2- 172.21.15.100:0/846227807 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f487c071bc0 0x7f487c113060 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4878009040 tx=0x7f4878009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:40.827 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:40.829+0000 7f4872ffd700 1 -- 172.21.15.100:0/846227807 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4878009620 con 0x7f487c071bc0 2023-12-05T09:49:40.827 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:40.830+0000 7f4872ffd700 1 -- 172.21.15.100:0/846227807 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4878009780 con 0x7f487c071bc0 2023-12-05T09:49:40.827 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:40.830+0000 7f4872ffd700 1 -- 172.21.15.100:0/846227807 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f487801c5b0 con 0x7f487c071bc0 2023-12-05T09:49:40.827 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:40.830+0000 7f4884543700 1 -- 172.21.15.100:0/846227807 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f487c1137a0 con 0x7f487c071bc0 2023-12-05T09:49:40.828 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:40.830+0000 7f4884543700 1 -- 172.21.15.100:0/846227807 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f487c114440 con 0x7f487c071bc0 2023-12-05T09:49:40.829 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:40.831+0000 7f4884543700 1 -- 172.21.15.100:0/846227807 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f487c05f270 con 0x7f487c071bc0 2023-12-05T09:49:40.829 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:40.831+0000 7f4872ffd700 1 -- 172.21.15.100:0/846227807 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) v1 ==== 43338+0+0 (secure 0 0 0) 0x7f487801c820 con 0x7f487c071bc0 2023-12-05T09:49:40.829 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:40.832+0000 7f4872ffd700 1 --2- 172.21.15.100:0/846227807 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f4868036720 0x7f4868038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:40.830 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:40.832+0000 7f4872ffd700 1 -- 172.21.15.100:0/846227807 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f4878049860 con 0x7f487c071bc0 2023-12-05T09:49:40.830 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:40.832+0000 7f4881ade700 1 --2- 172.21.15.100:0/846227807 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f4868036720 0x7f4868038bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:40.830 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:40.833+0000 7f4881ade700 1 --2- 172.21.15.100:0/846227807 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f4868036720 0x7f4868038bd0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f486c009990 tx=0x7f486c006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:40.835 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:40.837+0000 7f4872ffd700 1 -- 172.21.15.100:0/846227807 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f4878011550 con 0x7f487c071bc0 2023-12-05T09:49:41.053 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:41.055+0000 7f4884543700 1 -- 172.21.15.100:0/846227807 --> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f487c115000 con 0x7f4868036720 2023-12-05T09:49:41.056 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:41.059+0000 7f4872ffd700 1 -- 172.21.15.100:0/846227807 <== mgr.14160 v2:172.21.15.100:6800/2397627746 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f487c115000 con 0x7f4868036720 2023-12-05T09:49:41.059 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:41.061+0000 7f4884543700 1 -- 172.21.15.100:0/846227807 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f4868036720 msgr2=0x7f4868038bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:41.059 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:41.061+0000 7f4884543700 1 --2- 172.21.15.100:0/846227807 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f4868036720 0x7f4868038bd0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f486c009990 tx=0x7f486c006e40 comp rx=0 tx=0).stop 2023-12-05T09:49:41.059 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:41.061+0000 7f4884543700 1 -- 172.21.15.100:0/846227807 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f487c071bc0 msgr2=0x7f487c113060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:41.059 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:41.061+0000 7f4884543700 1 --2- 172.21.15.100:0/846227807 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f487c071bc0 0x7f487c113060 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4878009040 tx=0x7f4878009e30 comp rx=0 tx=0).stop 2023-12-05T09:49:41.059 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:41.061+0000 7f4884543700 1 -- 172.21.15.100:0/846227807 shutdown_connections 2023-12-05T09:49:41.059 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:41.061+0000 7f4884543700 1 --2- 172.21.15.100:0/846227807 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f4868036720 0x7f4868038bd0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:41.059 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:41.061+0000 7f4884543700 1 --2- 172.21.15.100:0/846227807 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f487c071bc0 0x7f487c113060 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:41.060 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:41.061+0000 7f4884543700 1 -- 172.21.15.100:0/846227807 >> 172.21.15.100:0/846227807 conn(0x7f487c0f7f50 msgr2=0x7f487c0f8c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:49:41.060 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:41.061+0000 7f4884543700 1 -- 172.21.15.100:0/846227807 shutdown_connections 2023-12-05T09:49:41.060 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:41.061+0000 7f4884543700 1 -- 172.21.15.100:0/846227807 wait complete. 2023-12-05T09:49:41.602 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:41 smithi100 ceph-mon[107145]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:49:41.603 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:41 smithi100 ceph-mon[107145]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:49:41.603 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:41 smithi100 ceph-mon[107145]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config rm", "who": "osd/host:smithi100", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:49:41.603 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:41 smithi100 ceph-mon[107145]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:49:41.603 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:41 smithi100 ceph-mon[107145]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi100", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-05T09:49:41.603 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:41 smithi100 ceph-mon[107145]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi100", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2023-12-05T09:49:41.603 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:41 smithi100 ceph-mon[107145]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:49:41.603 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:41 smithi100 ceph-mon[107145]: Deploying daemon crash.smithi100 on smithi100 2023-12-05T09:49:41.603 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:41 smithi100 ceph-mon[107145]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:49:41.603 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:41 smithi100 ceph-mon[107145]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:49:41.766 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi150 2023-12-05T09:49:41.766 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-12-05T09:49:41.766 DEBUG:teuthology.orchestra.run.smithi150:> dd of=/etc/ceph/ceph.conf 2023-12-05T09:49:41.818 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-12-05T09:49:41.818 DEBUG:teuthology.orchestra.run.smithi150:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-12-05T09:49:41.906 INFO:tasks.cephadm:Adding host smithi150 to orchestrator... 2023-12-05T09:49:41.907 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- ceph orch host add smithi150 2023-12-05T09:49:42.450 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi100/config 2023-12-05T09:49:43.726 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:43.727+0000 7fb1bf7f2700 1 -- 172.21.15.100:0/809865648 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1b8071bc0 msgr2=0x7fb1b8070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:43.726 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:43.727+0000 7fb1bf7f2700 1 --2- 172.21.15.100:0/809865648 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1b8071bc0 0x7fb1b8070030 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb1b40048c0 tx=0x7fb1b4009e30 comp rx=0 tx=0).stop 2023-12-05T09:49:43.726 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:43.727+0000 7fb1bf7f2700 1 -- 172.21.15.100:0/809865648 shutdown_connections 2023-12-05T09:49:43.726 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:43.727+0000 7fb1bf7f2700 1 --2- 172.21.15.100:0/809865648 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1b8071bc0 0x7fb1b8070030 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:43.726 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:43.727+0000 7fb1bf7f2700 1 -- 172.21.15.100:0/809865648 >> 172.21.15.100:0/809865648 conn(0x7fb1b80f7f50 msgr2=0x7fb1b80fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:49:43.726 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:43.727+0000 7fb1bf7f2700 1 -- 172.21.15.100:0/809865648 shutdown_connections 2023-12-05T09:49:43.726 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:43.727+0000 7fb1bf7f2700 1 -- 172.21.15.100:0/809865648 wait complete. 2023-12-05T09:49:43.726 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:43.728+0000 7fb1bf7f2700 1 Processor -- start 2023-12-05T09:49:43.726 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:43.728+0000 7fb1bf7f2700 1 -- start start 2023-12-05T09:49:43.726 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:43.728+0000 7fb1bf7f2700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1b8071bc0 0x7fb1b8113040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:43.726 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:43.728+0000 7fb1bf7f2700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b8113580 con 0x7fb1b8071bc0 2023-12-05T09:49:43.727 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:43.729+0000 7fb1bd58e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1b8071bc0 0x7fb1b8113040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:43.728 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:43.729+0000 7fb1bd58e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1b8071bc0 0x7fb1b8113040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37662/0 (socket says 172.21.15.100:37662) 2023-12-05T09:49:43.728 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:43.729+0000 7fb1bd58e700 1 -- 172.21.15.100:0/1197543256 learned_addr learned my addr 172.21.15.100:0/1197543256 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:49:43.728 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:43.729+0000 7fb1bd58e700 1 -- 172.21.15.100:0/1197543256 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b4005040 con 0x7fb1b8071bc0 2023-12-05T09:49:43.728 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:43.729+0000 7fb1bd58e700 1 --2- 172.21.15.100:0/1197543256 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1b8071bc0 0x7fb1b8113040 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4009040 tx=0x7fb1b4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:43.728 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:43.729+0000 7fb1adffb700 1 -- 172.21.15.100:0/1197543256 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb1b4009620 con 0x7fb1b8071bc0 2023-12-05T09:49:43.728 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:43.730+0000 7fb1adffb700 1 -- 172.21.15.100:0/1197543256 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb1b4009780 con 0x7fb1b8071bc0 2023-12-05T09:49:43.728 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:43.730+0000 7fb1bf7f2700 1 -- 172.21.15.100:0/1197543256 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1b8113780 con 0x7fb1b8071bc0 2023-12-05T09:49:43.728 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:43.730+0000 7fb1adffb700 1 -- 172.21.15.100:0/1197543256 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb1b401c5b0 con 0x7fb1b8071bc0 2023-12-05T09:49:43.729 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:43.730+0000 7fb1bf7f2700 1 -- 172.21.15.100:0/1197543256 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1b8114420 con 0x7fb1b8071bc0 2023-12-05T09:49:43.729 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:43.731+0000 7fb1adffb700 1 -- 172.21.15.100:0/1197543256 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) v1 ==== 43338+0+0 (secure 0 0 0) 0x7fb1b401c870 con 0x7fb1b8071bc0 2023-12-05T09:49:43.729 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:43.731+0000 7fb1bf7f2700 1 -- 172.21.15.100:0/1197543256 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1b805f270 con 0x7fb1b8071bc0 2023-12-05T09:49:43.729 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:43.731+0000 7fb1adffb700 1 --2- 172.21.15.100:0/1197543256 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7fb1a40366d0 0x7fb1a4038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:43.729 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:43.731+0000 7fb1adffb700 1 -- 172.21.15.100:0/1197543256 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fb1b4049820 con 0x7fb1b8071bc0 2023-12-05T09:49:43.730 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:43.731+0000 7fb1bcd8d700 1 --2- 172.21.15.100:0/1197543256 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7fb1a40366d0 0x7fb1a4038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:43.730 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:43.732+0000 7fb1bcd8d700 1 --2- 172.21.15.100:0/1197543256 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7fb1a40366d0 0x7fb1a4038b80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb1a8009990 tx=0x7fb1a8006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:43.734 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:43.736+0000 7fb1adffb700 1 -- 172.21.15.100:0/1197543256 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fb1b4011550 con 0x7fb1b8071bc0 2023-12-05T09:49:43.939 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:43.941+0000 7fb1bf7f2700 1 -- 172.21.15.100:0/1197543256 --> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi150", "target": ["mon-mgr", ""]}) v1 -- 0x7fb1b8114fe0 con 0x7fb1a40366d0 2023-12-05T09:49:44.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:44 smithi100 ceph-mon[107145]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:49:44.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:44 smithi100 ceph-mon[107145]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:49:44.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:44 smithi100 ceph-mon[107145]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:49:44.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:44 smithi100 ceph-mon[107145]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:49:44.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:44 smithi100 ceph-mon[107145]: Deploying daemon node-exporter.smithi100 on smithi100 2023-12-05T09:49:44.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:44 smithi100 ceph-mon[107145]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:49:44.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:44 smithi100 ceph-mon[107145]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi150", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:49:45.897 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:45 smithi100 ceph-mon[107145]: Deploying cephadm binary to smithi150 2023-12-05T09:49:46.528 INFO:teuthology.orchestra.run.smithi100.stdout:Added host 'smithi150' with addr '172.21.15.150' 2023-12-05T09:49:46.528 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:46.529+0000 7fb1adffb700 1 -- 172.21.15.100:0/1197543256 <== mgr.14160 v2:172.21.15.100:6800/2397627746 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fb1b8114fe0 con 0x7fb1a40366d0 2023-12-05T09:49:46.529 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:46.532+0000 7fb1bf7f2700 1 -- 172.21.15.100:0/1197543256 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7fb1a40366d0 msgr2=0x7fb1a4038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:46.530 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:46.532+0000 7fb1bf7f2700 1 --2- 172.21.15.100:0/1197543256 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7fb1a40366d0 0x7fb1a4038b80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb1a8009990 tx=0x7fb1a8006e40 comp rx=0 tx=0).stop 2023-12-05T09:49:46.530 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:46.532+0000 7fb1bf7f2700 1 -- 172.21.15.100:0/1197543256 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1b8071bc0 msgr2=0x7fb1b8113040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:46.530 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:46.532+0000 7fb1bf7f2700 1 --2- 172.21.15.100:0/1197543256 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1b8071bc0 0x7fb1b8113040 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4009040 tx=0x7fb1b4009e30 comp rx=0 tx=0).stop 2023-12-05T09:49:46.530 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:46.532+0000 7fb1bf7f2700 1 -- 172.21.15.100:0/1197543256 shutdown_connections 2023-12-05T09:49:46.530 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:46.532+0000 7fb1bf7f2700 1 --2- 172.21.15.100:0/1197543256 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7fb1a40366d0 0x7fb1a4038b80 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:46.530 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:46.532+0000 7fb1bf7f2700 1 --2- 172.21.15.100:0/1197543256 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1b8071bc0 0x7fb1b8113040 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:46.530 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:46.532+0000 7fb1bf7f2700 1 -- 172.21.15.100:0/1197543256 >> 172.21.15.100:0/1197543256 conn(0x7fb1b80f7f50 msgr2=0x7fb1b80f8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:49:46.530 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:46.532+0000 7fb1bf7f2700 1 -- 172.21.15.100:0/1197543256 shutdown_connections 2023-12-05T09:49:46.530 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:46.532+0000 7fb1bf7f2700 1 -- 172.21.15.100:0/1197543256 wait complete. 2023-12-05T09:49:47.100 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- ceph orch host ls --format=json 2023-12-05T09:49:47.596 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi100/config 2023-12-05T09:49:47.794 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:47 smithi100 ceph-mon[107145]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:49:47.794 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:47 smithi100 ceph-mon[107145]: Added host smithi150 2023-12-05T09:49:48.858 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:48.858+0000 7ff4f55f1700 1 -- 172.21.15.100:0/3532288685 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4f00fc870 msgr2=0x7ff4f00fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:48.858 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:48.858+0000 7ff4f55f1700 1 --2- 172.21.15.100:0/3532288685 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4f00fc870 0x7ff4f00fcc80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff4e00048c0 tx=0x7ff4e0009e30 comp rx=0 tx=0).stop 2023-12-05T09:49:48.858 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:48.858+0000 7ff4f55f1700 1 -- 172.21.15.100:0/3532288685 shutdown_connections 2023-12-05T09:49:48.858 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:48.858+0000 7ff4f55f1700 1 --2- 172.21.15.100:0/3532288685 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4f00fc870 0x7ff4f00fcc80 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:48.859 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:48.858+0000 7ff4f55f1700 1 -- 172.21.15.100:0/3532288685 >> 172.21.15.100:0/3532288685 conn(0x7ff4f00f7f50 msgr2=0x7ff4f00fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:49:48.859 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:48.858+0000 7ff4f55f1700 1 -- 172.21.15.100:0/3532288685 shutdown_connections 2023-12-05T09:49:48.859 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:48.858+0000 7ff4f55f1700 1 -- 172.21.15.100:0/3532288685 wait complete. 2023-12-05T09:49:48.859 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:48.859+0000 7ff4f55f1700 1 Processor -- start 2023-12-05T09:49:48.859 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:48.859+0000 7ff4f55f1700 1 -- start start 2023-12-05T09:49:48.859 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:48.860+0000 7ff4f55f1700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4f00fc870 0x7ff4f010ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:48.859 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:48.860+0000 7ff4f55f1700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f010cfd0 con 0x7ff4f00fc870 2023-12-05T09:49:48.861 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:48.860+0000 7ff4eeffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4f00fc870 0x7ff4f010ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:48.862 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:48.860+0000 7ff4eeffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4f00fc870 0x7ff4f010ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37680/0 (socket says 172.21.15.100:37680) 2023-12-05T09:49:48.862 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:48.860+0000 7ff4eeffd700 1 -- 172.21.15.100:0/1821133491 learned_addr learned my addr 172.21.15.100:0/1821133491 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:49:48.862 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:48.860+0000 7ff4eeffd700 1 -- 172.21.15.100:0/1821133491 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4e0005040 con 0x7ff4f00fc870 2023-12-05T09:49:48.862 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:48.860+0000 7ff4eeffd700 1 --2- 172.21.15.100:0/1821133491 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4f00fc870 0x7ff4f010ca90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff4e000b690 tx=0x7ff4e0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:48.862 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:48.861+0000 7ff4d77fe700 1 -- 172.21.15.100:0/1821133491 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff4e0009650 con 0x7ff4f00fc870 2023-12-05T09:49:48.862 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:48.861+0000 7ff4d77fe700 1 -- 172.21.15.100:0/1821133491 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff4e00097b0 con 0x7ff4f00fc870 2023-12-05T09:49:48.862 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:48.861+0000 7ff4d77fe700 1 -- 172.21.15.100:0/1821133491 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff4e001c5d0 con 0x7ff4f00fc870 2023-12-05T09:49:48.862 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:48.861+0000 7ff4f55f1700 1 -- 172.21.15.100:0/1821133491 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4f010d1d0 con 0x7ff4f00fc870 2023-12-05T09:49:48.862 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:48.861+0000 7ff4f55f1700 1 -- 172.21.15.100:0/1821133491 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4f010de70 con 0x7ff4f00fc870 2023-12-05T09:49:48.862 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:48.862+0000 7ff4d77fe700 1 -- 172.21.15.100:0/1821133491 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) v1 ==== 43338+0+0 (secure 0 0 0) 0x7ff4e00139d0 con 0x7ff4f00fc870 2023-12-05T09:49:48.862 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:48.862+0000 7ff4f55f1700 1 -- 172.21.15.100:0/1821133491 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4f005f270 con 0x7ff4f00fc870 2023-12-05T09:49:48.862 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:48.862+0000 7ff4d77fe700 1 --2- 172.21.15.100:0/1821133491 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7ff4d8036720 0x7ff4d8038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:48.863 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:48.862+0000 7ff4d77fe700 1 -- 172.21.15.100:0/1821133491 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7ff4e00499e0 con 0x7ff4f00fc870 2023-12-05T09:49:48.863 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:48.863+0000 7ff4ee7fc700 1 --2- 172.21.15.100:0/1821133491 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7ff4d8036720 0x7ff4d8038bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:48.863 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:48.863+0000 7ff4ee7fc700 1 --2- 172.21.15.100:0/1821133491 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7ff4d8036720 0x7ff4d8038bd0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff4e4009990 tx=0x7ff4e4006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:48.865 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:48.867+0000 7ff4d77fe700 1 -- 172.21.15.100:0/1821133491 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ff4e0025400 con 0x7ff4f00fc870 2023-12-05T09:49:48.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:48 smithi100 ceph-mon[107145]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:49:48.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:48 smithi100 ceph-mon[107145]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:49:48.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:48 smithi100 ceph-mon[107145]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:49:48.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:48 smithi100 ceph-mon[107145]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:49:48.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:48 smithi100 ceph-mon[107145]: Deploying daemon alertmanager.smithi100 on smithi100 2023-12-05T09:49:49.083 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:49.085+0000 7ff4f55f1700 1 -- 172.21.15.100:0/1821133491 --> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff4f010ea30 con 0x7ff4d8036720 2023-12-05T09:49:49.084 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:49.087+0000 7ff4d77fe700 1 -- 172.21.15.100:0/1821133491 <== mgr.14160 v2:172.21.15.100:6800/2397627746 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+161 (secure 0 0 0) 0x7ff4f010ea30 con 0x7ff4d8036720 2023-12-05T09:49:49.084 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:49:49.085 INFO:teuthology.orchestra.run.smithi100.stdout:[{"addr": "172.21.15.100", "hostname": "smithi100", "labels": [], "status": ""}, {"addr": "172.21.15.150", "hostname": "smithi150", "labels": [], "status": ""}] 2023-12-05T09:49:49.087 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:49.089+0000 7ff4f55f1700 1 -- 172.21.15.100:0/1821133491 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7ff4d8036720 msgr2=0x7ff4d8038bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:49.087 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:49.089+0000 7ff4f55f1700 1 --2- 172.21.15.100:0/1821133491 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7ff4d8036720 0x7ff4d8038bd0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff4e4009990 tx=0x7ff4e4006e40 comp rx=0 tx=0).stop 2023-12-05T09:49:49.087 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:49.089+0000 7ff4f55f1700 1 -- 172.21.15.100:0/1821133491 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4f00fc870 msgr2=0x7ff4f010ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:49.087 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:49.089+0000 7ff4f55f1700 1 --2- 172.21.15.100:0/1821133491 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4f00fc870 0x7ff4f010ca90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff4e000b690 tx=0x7ff4e0009e30 comp rx=0 tx=0).stop 2023-12-05T09:49:49.088 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:49.089+0000 7ff4f55f1700 1 -- 172.21.15.100:0/1821133491 shutdown_connections 2023-12-05T09:49:49.088 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:49.089+0000 7ff4f55f1700 1 --2- 172.21.15.100:0/1821133491 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7ff4d8036720 0x7ff4d8038bd0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:49.088 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:49.089+0000 7ff4f55f1700 1 --2- 172.21.15.100:0/1821133491 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4f00fc870 0x7ff4f010ca90 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:49.088 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:49.089+0000 7ff4f55f1700 1 -- 172.21.15.100:0/1821133491 >> 172.21.15.100:0/1821133491 conn(0x7ff4f00f7f50 msgr2=0x7ff4f00f8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:49:49.088 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:49.089+0000 7ff4f55f1700 1 -- 172.21.15.100:0/1821133491 shutdown_connections 2023-12-05T09:49:49.088 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:49.089+0000 7ff4f55f1700 1 -- 172.21.15.100:0/1821133491 wait complete. 2023-12-05T09:49:49.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:49 smithi100 ceph-mon[107145]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:49:49.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:49 smithi100 ceph-mon[107145]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:49:49.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:49 smithi100 ceph-mon[107145]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-05T09:49:50.668 INFO:tasks.cephadm:Setting crush tunables to default 2023-12-05T09:49:50.669 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- ceph osd crush tunables default 2023-12-05T09:49:51.104 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi100/config 2023-12-05T09:49:51.791 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:51 smithi100 ceph-mon[107145]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:49:53.065 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:53.062+0000 7fcbf0f49700 1 -- 172.21.15.100:0/1475945843 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbec0fc870 msgr2=0x7fcbec0fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:53.065 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:53.062+0000 7fcbf0f49700 1 --2- 172.21.15.100:0/1475945843 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbec0fc870 0x7fcbec0fcc80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc0048c0 tx=0x7fcbdc009e30 comp rx=0 tx=0).stop 2023-12-05T09:49:53.066 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:53.063+0000 7fcbf0f49700 1 -- 172.21.15.100:0/1475945843 shutdown_connections 2023-12-05T09:49:53.066 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:53.063+0000 7fcbf0f49700 1 --2- 172.21.15.100:0/1475945843 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbec0fc870 0x7fcbec0fcc80 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:53.066 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:53.063+0000 7fcbf0f49700 1 -- 172.21.15.100:0/1475945843 >> 172.21.15.100:0/1475945843 conn(0x7fcbec0f7f50 msgr2=0x7fcbec0fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:49:53.066 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:53.063+0000 7fcbf0f49700 1 -- 172.21.15.100:0/1475945843 shutdown_connections 2023-12-05T09:49:53.066 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:53.063+0000 7fcbf0f49700 1 -- 172.21.15.100:0/1475945843 wait complete. 2023-12-05T09:49:53.066 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:53.063+0000 7fcbf0f49700 1 Processor -- start 2023-12-05T09:49:53.066 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:53.064+0000 7fcbf0f49700 1 -- start start 2023-12-05T09:49:53.066 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:53.064+0000 7fcbf0f49700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbec0fc870 0x7fcbec10ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:53.066 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:53.064+0000 7fcbf0f49700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbec10cfd0 con 0x7fcbec0fc870 2023-12-05T09:49:53.066 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:53.064+0000 7fcbea59c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbec0fc870 0x7fcbec10ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:53.066 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:53.064+0000 7fcbea59c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbec0fc870 0x7fcbec10ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38416/0 (socket says 172.21.15.100:38416) 2023-12-05T09:49:53.066 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:53.064+0000 7fcbea59c700 1 -- 172.21.15.100:0/4146310719 learned_addr learned my addr 172.21.15.100:0/4146310719 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:49:53.066 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:53.064+0000 7fcbea59c700 1 -- 172.21.15.100:0/4146310719 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbdc005040 con 0x7fcbec0fc870 2023-12-05T09:49:53.067 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:53.064+0000 7fcbea59c700 1 --2- 172.21.15.100:0/4146310719 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbec0fc870 0x7fcbec10ca90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc00b690 tx=0x7fcbdc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:53.067 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:53.065+0000 7fcbdaffd700 1 -- 172.21.15.100:0/4146310719 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcbdc009650 con 0x7fcbec0fc870 2023-12-05T09:49:53.067 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:53.065+0000 7fcbdaffd700 1 -- 172.21.15.100:0/4146310719 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcbdc0097b0 con 0x7fcbec0fc870 2023-12-05T09:49:53.067 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:53.065+0000 7fcbdaffd700 1 -- 172.21.15.100:0/4146310719 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcbdc01c5d0 con 0x7fcbec0fc870 2023-12-05T09:49:53.067 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:53.065+0000 7fcbf0f49700 1 -- 172.21.15.100:0/4146310719 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbec10d1d0 con 0x7fcbec0fc870 2023-12-05T09:49:53.067 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:53.065+0000 7fcbf0f49700 1 -- 172.21.15.100:0/4146310719 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbec10de70 con 0x7fcbec0fc870 2023-12-05T09:49:53.067 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:53.066+0000 7fcbdaffd700 1 -- 172.21.15.100:0/4146310719 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) v1 ==== 43338+0+0 (secure 0 0 0) 0x7fcbdc013420 con 0x7fcbec0fc870 2023-12-05T09:49:53.067 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:53.066+0000 7fcbf0f49700 1 -- 172.21.15.100:0/4146310719 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbec05f270 con 0x7fcbec0fc870 2023-12-05T09:49:53.068 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:53.066+0000 7fcbdaffd700 1 --2- 172.21.15.100:0/4146310719 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7fcbd4036720 0x7fcbd4038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:53.068 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:53.066+0000 7fcbdaffd700 1 -- 172.21.15.100:0/4146310719 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fcbdc049920 con 0x7fcbec0fc870 2023-12-05T09:49:53.068 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:53.066+0000 7fcbe9d9b700 1 --2- 172.21.15.100:0/4146310719 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7fcbd4036720 0x7fcbd4038bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:53.068 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:53.067+0000 7fcbe9d9b700 1 --2- 172.21.15.100:0/4146310719 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7fcbd4036720 0x7fcbd4038bd0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fcbe0009990 tx=0x7fcbe0006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:53.069 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:53.071+0000 7fcbdaffd700 1 -- 172.21.15.100:0/4146310719 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fcbdc025400 con 0x7fcbec0fc870 2023-12-05T09:49:53.301 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:53.304+0000 7fcbf0f49700 1 -- 172.21.15.100:0/4146310719 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fcbec10e9c0 con 0x7fcbec0fc870 2023-12-05T09:49:53.635 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:53.636+0000 7fcbdaffd700 1 -- 172.21.15.100:0/4146310719 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7fcbdc011370 con 0x7fcbec0fc870 2023-12-05T09:49:53.637 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:53.640+0000 7fcbf0f49700 1 -- 172.21.15.100:0/4146310719 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7fcbd4036720 msgr2=0x7fcbd4038bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:53.638 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:53.640+0000 7fcbf0f49700 1 --2- 172.21.15.100:0/4146310719 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7fcbd4036720 0x7fcbd4038bd0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fcbe0009990 tx=0x7fcbe0006e40 comp rx=0 tx=0).stop 2023-12-05T09:49:53.638 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:53.640+0000 7fcbf0f49700 1 -- 172.21.15.100:0/4146310719 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbec0fc870 msgr2=0x7fcbec10ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:53.638 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:53.640+0000 7fcbf0f49700 1 --2- 172.21.15.100:0/4146310719 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbec0fc870 0x7fcbec10ca90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc00b690 tx=0x7fcbdc009e30 comp rx=0 tx=0).stop 2023-12-05T09:49:53.638 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:53.640+0000 7fcbf0f49700 1 -- 172.21.15.100:0/4146310719 shutdown_connections 2023-12-05T09:49:53.638 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:53.640+0000 7fcbf0f49700 1 --2- 172.21.15.100:0/4146310719 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7fcbd4036720 0x7fcbd4038bd0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:53.638 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:53.640+0000 7fcbf0f49700 1 --2- 172.21.15.100:0/4146310719 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbec0fc870 0x7fcbec10ca90 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:53.638 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:53.640+0000 7fcbf0f49700 1 -- 172.21.15.100:0/4146310719 >> 172.21.15.100:0/4146310719 conn(0x7fcbec0f7f50 msgr2=0x7fcbec0f8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:49:53.638 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:53.640+0000 7fcbf0f49700 1 -- 172.21.15.100:0/4146310719 shutdown_connections 2023-12-05T09:49:53.638 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:49:53.640+0000 7fcbf0f49700 1 -- 172.21.15.100:0/4146310719 wait complete. 2023-12-05T09:49:53.639 INFO:teuthology.orchestra.run.smithi100.stderr:adjusted tunables profile to default 2023-12-05T09:49:53.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:53 smithi100 ceph-mon[107145]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:49:53.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:53 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/4146310719' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-12-05T09:49:54.259 INFO:tasks.cephadm:Adding mon.smithi100 on smithi100 2023-12-05T09:49:54.259 INFO:tasks.cephadm:Adding mon.smithi150 on smithi150 2023-12-05T09:49:54.260 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- ceph orch apply mon '2;smithi100:172.21.15.100=smithi100;smithi150:172.21.15.150=smithi150' 2023-12-05T09:49:54.667 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T09:49:54.756 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T09:49:54.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:54 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/4146310719' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-12-05T09:49:54.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:54 smithi100 ceph-mon[107145]: osdmap e4: 0 total, 0 up, 0 in 2023-12-05T09:49:56.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:55 smithi100 ceph-mon[107145]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:49:56.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:55 smithi100 ceph-mon[107145]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:49:56.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:55 smithi100 ceph-mon[107145]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:49:56.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:55 smithi100 ceph-mon[107145]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:49:56.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:55 smithi100 ceph-mon[107145]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:49:56.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:55 smithi100 ceph-mon[107145]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:49:56.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:55 smithi100 ceph-mon[107145]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:49:56.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:55 smithi100 ceph-mon[107145]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2023-12-05T09:49:56.147 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:55 smithi100 ceph-mon[107145]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2023-12-05T09:49:56.147 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:55 smithi100 ceph-mon[107145]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:49:56.147 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:55 smithi100 ceph-mon[107145]: Deploying daemon grafana.smithi100 on smithi100 2023-12-05T09:49:56.166 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:56.168+0000 7f85f66c7700 1 -- 172.21.15.150:0/2330314450 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85f00fc870 msgr2=0x7f85f00fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:56.166 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:56.168+0000 7f85f66c7700 1 --2- 172.21.15.150:0/2330314450 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85f00fc870 0x7f85f00fcc80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f85e00048c0 tx=0x7f85e0009e30 comp rx=0 tx=0).stop 2023-12-05T09:49:56.166 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:56.168+0000 7f85f66c7700 1 -- 172.21.15.150:0/2330314450 shutdown_connections 2023-12-05T09:49:56.166 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:56.168+0000 7f85f66c7700 1 --2- 172.21.15.150:0/2330314450 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85f00fc870 0x7f85f00fcc80 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:56.167 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:56.168+0000 7f85f66c7700 1 -- 172.21.15.150:0/2330314450 >> 172.21.15.150:0/2330314450 conn(0x7f85f00f7f50 msgr2=0x7f85f00fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:49:56.167 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:56.168+0000 7f85f66c7700 1 -- 172.21.15.150:0/2330314450 shutdown_connections 2023-12-05T09:49:56.167 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:56.168+0000 7f85f66c7700 1 -- 172.21.15.150:0/2330314450 wait complete. 2023-12-05T09:49:56.167 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:56.168+0000 7f85f66c7700 1 Processor -- start 2023-12-05T09:49:56.167 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:56.168+0000 7f85f66c7700 1 -- start start 2023-12-05T09:49:56.167 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:56.168+0000 7f85f66c7700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85f00fc870 0x7f85f0071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:56.167 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:56.168+0000 7f85f66c7700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f006ff90 con 0x7f85f00fc870 2023-12-05T09:49:56.168 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:56.170+0000 7f85effff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85f00fc870 0x7f85f0071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:56.168 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:56.170+0000 7f85effff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85f00fc870 0x7f85f0071b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.150:35472/0 (socket says 172.21.15.150:35472) 2023-12-05T09:49:56.168 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:56.170+0000 7f85effff700 1 -- 172.21.15.150:0/1796692163 learned_addr learned my addr 172.21.15.150:0/1796692163 (peer_addr_for_me v2:172.21.15.150:0/0) 2023-12-05T09:49:56.168 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:56.170+0000 7f85effff700 1 -- 172.21.15.150:0/1796692163 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e0005040 con 0x7f85f00fc870 2023-12-05T09:49:56.168 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:56.170+0000 7f85effff700 1 --2- 172.21.15.150:0/1796692163 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85f00fc870 0x7f85f0071b10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f85e000b690 tx=0x7f85e0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:56.168 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:56.170+0000 7f85ecff9700 1 -- 172.21.15.150:0/1796692163 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f85e0009650 con 0x7f85f00fc870 2023-12-05T09:49:56.169 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:56.170+0000 7f85ecff9700 1 -- 172.21.15.150:0/1796692163 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f85e00097b0 con 0x7f85f00fc870 2023-12-05T09:49:56.169 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:56.170+0000 7f85f66c7700 1 -- 172.21.15.150:0/1796692163 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85f0070190 con 0x7f85f00fc870 2023-12-05T09:49:56.169 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:56.170+0000 7f85ecff9700 1 -- 172.21.15.150:0/1796692163 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f85e001c5d0 con 0x7f85f00fc870 2023-12-05T09:49:56.169 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:56.170+0000 7f85f66c7700 1 -- 172.21.15.150:0/1796692163 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85f0070680 con 0x7f85f00fc870 2023-12-05T09:49:56.169 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:56.172+0000 7f85f66c7700 1 -- 172.21.15.150:0/1796692163 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85f0106500 con 0x7f85f00fc870 2023-12-05T09:49:56.169 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:56.172+0000 7f85ecff9700 1 -- 172.21.15.150:0/1796692163 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) v1 ==== 43338+0+0 (secure 0 0 0) 0x7f85e00139d0 con 0x7f85f00fc870 2023-12-05T09:49:56.170 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:56.173+0000 7f85ecff9700 1 --2- 172.21.15.150:0/1796692163 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f85d80366d0 0x7f85d8038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:56.170 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:56.173+0000 7f85ecff9700 1 -- 172.21.15.150:0/1796692163 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f85e0049a20 con 0x7f85f00fc870 2023-12-05T09:49:56.170 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:56.173+0000 7f85ef7fe700 1 --2- 172.21.15.150:0/1796692163 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f85d80366d0 0x7f85d8038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:56.171 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:56.173+0000 7f85ef7fe700 1 --2- 172.21.15.150:0/1796692163 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f85d80366d0 0x7f85d8038b80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f85e4009990 tx=0x7f85e4006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:56.175 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:56.178+0000 7f85ecff9700 1 -- 172.21.15.150:0/1796692163 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f85e0025400 con 0x7f85f00fc870 2023-12-05T09:49:56.374 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:56.376+0000 7f85f66c7700 1 -- 172.21.15.150:0/1796692163 --> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi100:172.21.15.100=smithi100;smithi150:172.21.15.150=smithi150", "target": ["mon-mgr", ""]}) v1 -- 0x7f85f002b250 con 0x7f85d80366d0 2023-12-05T09:49:56.380 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:56.383+0000 7f85ecff9700 1 -- 172.21.15.150:0/1796692163 <== mgr.14160 v2:172.21.15.100:6800/2397627746 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f85f002b250 con 0x7f85d80366d0 2023-12-05T09:49:56.380 INFO:teuthology.orchestra.run.smithi150.stdout:Scheduled mon update... 2023-12-05T09:49:56.383 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:56.385+0000 7f85f66c7700 1 -- 172.21.15.150:0/1796692163 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f85d80366d0 msgr2=0x7f85d8038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:56.383 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:56.385+0000 7f85f66c7700 1 --2- 172.21.15.150:0/1796692163 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f85d80366d0 0x7f85d8038b80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f85e4009990 tx=0x7f85e4006e40 comp rx=0 tx=0).stop 2023-12-05T09:49:56.383 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:56.385+0000 7f85f66c7700 1 -- 172.21.15.150:0/1796692163 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85f00fc870 msgr2=0x7f85f0071b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:56.383 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:56.385+0000 7f85f66c7700 1 --2- 172.21.15.150:0/1796692163 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85f00fc870 0x7f85f0071b10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f85e000b690 tx=0x7f85e0009e30 comp rx=0 tx=0).stop 2023-12-05T09:49:56.383 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:56.385+0000 7f85f66c7700 1 -- 172.21.15.150:0/1796692163 shutdown_connections 2023-12-05T09:49:56.383 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:56.385+0000 7f85f66c7700 1 --2- 172.21.15.150:0/1796692163 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f85d80366d0 0x7f85d8038b80 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:56.383 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:56.385+0000 7f85f66c7700 1 --2- 172.21.15.150:0/1796692163 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85f00fc870 0x7f85f0071b10 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:56.383 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:56.385+0000 7f85f66c7700 1 -- 172.21.15.150:0/1796692163 >> 172.21.15.150:0/1796692163 conn(0x7f85f00f7f50 msgr2=0x7f85f00f8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:49:56.383 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:56.386+0000 7f85f66c7700 1 -- 172.21.15.150:0/1796692163 shutdown_connections 2023-12-05T09:49:56.383 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:56.386+0000 7f85f66c7700 1 -- 172.21.15.150:0/1796692163 wait complete. 2023-12-05T09:49:56.824 DEBUG:teuthology.orchestra.run.smithi150:mon.smithi150> sudo journalctl -f -n 0 -u ceph-5b035ce6-9353-11ee-95a2-87774f69a715@mon.smithi150.service 2023-12-05T09:49:56.830 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-05T09:49:56.830 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-05T09:49:56.902 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:-- Logs begin at Tue 2023-12-05 09:31:29 UTC. -- 2023-12-05T09:49:57.266 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T09:49:57.355 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T09:49:57.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:57 smithi100 ceph-mon[107145]: from='client.14192 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi100:172.21.15.100=smithi100;smithi150:172.21.15.150=smithi150", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:49:57.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:57 smithi100 ceph-mon[107145]: Saving service mon spec with placement smithi100:172.21.15.100=smithi100;smithi150:172.21.15.150=smithi150;count:2 2023-12-05T09:49:57.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:57 smithi100 ceph-mon[107145]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:49:57.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:57 smithi100 ceph-mon[107145]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:49:58.446 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:58.448+0000 7f10158b8700 1 -- 172.21.15.150:0/2314578548 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10100fc870 msgr2=0x7f10100fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:58.446 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:58.448+0000 7f10158b8700 1 --2- 172.21.15.150:0/2314578548 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10100fc870 0x7f10100fcc80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f10000048c0 tx=0x7f1000009e30 comp rx=0 tx=0).stop 2023-12-05T09:49:58.446 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:58.448+0000 7f10158b8700 1 -- 172.21.15.150:0/2314578548 shutdown_connections 2023-12-05T09:49:58.446 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:58.448+0000 7f10158b8700 1 --2- 172.21.15.150:0/2314578548 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10100fc870 0x7f10100fcc80 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:58.446 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:58.448+0000 7f10158b8700 1 -- 172.21.15.150:0/2314578548 >> 172.21.15.150:0/2314578548 conn(0x7f10100f7f50 msgr2=0x7f10100fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:49:58.446 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:58.448+0000 7f10158b8700 1 -- 172.21.15.150:0/2314578548 shutdown_connections 2023-12-05T09:49:58.446 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:58.448+0000 7f10158b8700 1 -- 172.21.15.150:0/2314578548 wait complete. 2023-12-05T09:49:58.447 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:58.449+0000 7f10158b8700 1 Processor -- start 2023-12-05T09:49:58.447 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:58.450+0000 7f10158b8700 1 -- start start 2023-12-05T09:49:58.447 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:58.450+0000 7f10158b8700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10100fc870 0x7f101010ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:58.447 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:58.450+0000 7f10158b8700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f101010cfd0 con 0x7f10100fc870 2023-12-05T09:49:58.448 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:58.450+0000 7f100effd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10100fc870 0x7f101010ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:58.448 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:58.450+0000 7f100effd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10100fc870 0x7f101010ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.150:35230/0 (socket says 172.21.15.150:35230) 2023-12-05T09:49:58.448 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:58.450+0000 7f100effd700 1 -- 172.21.15.150:0/2567517796 learned_addr learned my addr 172.21.15.150:0/2567517796 (peer_addr_for_me v2:172.21.15.150:0/0) 2023-12-05T09:49:58.448 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:58.451+0000 7f100effd700 1 -- 172.21.15.150:0/2567517796 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1000005040 con 0x7f10100fc870 2023-12-05T09:49:58.448 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:58.451+0000 7f100effd700 1 --2- 172.21.15.150:0/2567517796 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10100fc870 0x7f101010ca90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f100000b690 tx=0x7f1000009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:58.448 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:58.451+0000 7f10077fe700 1 -- 172.21.15.150:0/2567517796 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1000009650 con 0x7f10100fc870 2023-12-05T09:49:58.449 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:58.451+0000 7f10077fe700 1 -- 172.21.15.150:0/2567517796 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f10000097b0 con 0x7f10100fc870 2023-12-05T09:49:58.449 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:58.451+0000 7f10077fe700 1 -- 172.21.15.150:0/2567517796 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f100001c5d0 con 0x7f10100fc870 2023-12-05T09:49:58.449 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:58.451+0000 7f10158b8700 1 -- 172.21.15.150:0/2567517796 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f101010d1d0 con 0x7f10100fc870 2023-12-05T09:49:58.449 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:58.451+0000 7f10158b8700 1 -- 172.21.15.150:0/2567517796 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f101010de70 con 0x7f10100fc870 2023-12-05T09:49:58.449 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:58.453+0000 7f10077fe700 1 -- 172.21.15.150:0/2567517796 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) v1 ==== 43338+0+0 (secure 0 0 0) 0x7f10000139d0 con 0x7f10100fc870 2023-12-05T09:49:58.450 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:58.453+0000 7f10158b8700 1 -- 172.21.15.150:0/2567517796 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f101005f270 con 0x7f10100fc870 2023-12-05T09:49:58.450 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:58.453+0000 7f10077fe700 1 --2- 172.21.15.150:0/2567517796 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f0ffc036720 0x7f0ffc038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:49:58.450 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:58.453+0000 7f10077fe700 1 -- 172.21.15.150:0/2567517796 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f1000049960 con 0x7f10100fc870 2023-12-05T09:49:58.450 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:58.453+0000 7f1007fff700 1 --2- 172.21.15.150:0/2567517796 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f0ffc036720 0x7f0ffc038bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:49:58.451 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:58.454+0000 7f1007fff700 1 --2- 172.21.15.150:0/2567517796 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f0ffc036720 0x7f0ffc038bd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0ff8009990 tx=0x7f0ff8006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:49:58.455 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:58.458+0000 7f10077fe700 1 -- 172.21.15.150:0/2567517796 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f1000025400 con 0x7f10100fc870 2023-12-05T09:49:58.728 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:58.731+0000 7f10158b8700 1 -- 172.21.15.150:0/2567517796 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f101010e9c0 con 0x7f10100fc870 2023-12-05T09:49:58.728 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:58.731+0000 7f10077fe700 1 -- 172.21.15.150:0/2567517796 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f1000049250 con 0x7f10100fc870 2023-12-05T09:49:58.728 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:49:58.729 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":1,"fsid":"5b035ce6-9353-11ee-95a2-87774f69a715","modified":"2023-12-05T09:48:31.075826Z","created":"2023-12-05T09:48:31.075826Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi100","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-05T09:49:58.731 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:58.733+0000 7f10158b8700 1 -- 172.21.15.150:0/2567517796 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f0ffc036720 msgr2=0x7f0ffc038bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:58.731 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:58.733+0000 7f10158b8700 1 --2- 172.21.15.150:0/2567517796 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f0ffc036720 0x7f0ffc038bd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0ff8009990 tx=0x7f0ff8006e40 comp rx=0 tx=0).stop 2023-12-05T09:49:58.731 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:58.733+0000 7f10158b8700 1 -- 172.21.15.150:0/2567517796 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10100fc870 msgr2=0x7f101010ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:49:58.731 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:58.733+0000 7f10158b8700 1 --2- 172.21.15.150:0/2567517796 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10100fc870 0x7f101010ca90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f100000b690 tx=0x7f1000009e30 comp rx=0 tx=0).stop 2023-12-05T09:49:58.731 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:58.733+0000 7f10158b8700 1 -- 172.21.15.150:0/2567517796 shutdown_connections 2023-12-05T09:49:58.731 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:58.734+0000 7f10158b8700 1 --2- 172.21.15.150:0/2567517796 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f0ffc036720 0x7f0ffc038bd0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:58.731 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:58.734+0000 7f10158b8700 1 --2- 172.21.15.150:0/2567517796 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10100fc870 0x7f101010ca90 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:49:58.731 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:58.734+0000 7f10158b8700 1 -- 172.21.15.150:0/2567517796 >> 172.21.15.150:0/2567517796 conn(0x7f10100f7f50 msgr2=0x7f10100f8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:49:58.731 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:58.734+0000 7f10158b8700 1 -- 172.21.15.150:0/2567517796 shutdown_connections 2023-12-05T09:49:58.731 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:49:58.734+0000 7f10158b8700 1 -- 172.21.15.150:0/2567517796 wait complete. 2023-12-05T09:49:58.732 INFO:teuthology.orchestra.run.smithi150.stderr:dumped monmap epoch 1 2023-12-05T09:49:59.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:59 smithi100 ceph-mon[107145]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:49:59.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:59 smithi100 ceph-mon[107145]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:49:59.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:49:59 smithi100 ceph-mon[107145]: from='client.? 172.21.15.150:0/2567517796' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T09:50:00.100 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-05T09:50:00.100 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-05T09:50:00.521 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T09:50:00.610 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T09:50:01.715 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:01.718+0000 7fa0f690d700 1 -- 172.21.15.150:0/776584114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0f00fc870 msgr2=0x7fa0f00fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:50:01.716 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:01.718+0000 7fa0f690d700 1 --2- 172.21.15.150:0/776584114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0f00fc870 0x7fa0f00fcc80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa0e00048c0 tx=0x7fa0e0009e30 comp rx=0 tx=0).stop 2023-12-05T09:50:01.716 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:01.718+0000 7fa0f690d700 1 -- 172.21.15.150:0/776584114 shutdown_connections 2023-12-05T09:50:01.716 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:01.718+0000 7fa0f690d700 1 --2- 172.21.15.150:0/776584114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0f00fc870 0x7fa0f00fcc80 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:50:01.716 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:01.718+0000 7fa0f690d700 1 -- 172.21.15.150:0/776584114 >> 172.21.15.150:0/776584114 conn(0x7fa0f00f7f50 msgr2=0x7fa0f00fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:50:01.716 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:01.718+0000 7fa0f690d700 1 -- 172.21.15.150:0/776584114 shutdown_connections 2023-12-05T09:50:01.716 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:01.718+0000 7fa0f690d700 1 -- 172.21.15.150:0/776584114 wait complete. 2023-12-05T09:50:01.719 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:01.719+0000 7fa0f690d700 1 Processor -- start 2023-12-05T09:50:01.719 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:01.719+0000 7fa0f690d700 1 -- start start 2023-12-05T09:50:01.719 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:01.719+0000 7fa0f690d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0f00fc870 0x7fa0f010ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:50:01.719 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:01.719+0000 7fa0f690d700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f010f270 con 0x7fa0f00fc870 2023-12-05T09:50:01.719 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:01.719+0000 7fa0effff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0f00fc870 0x7fa0f010ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:50:01.719 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:01.719+0000 7fa0effff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0f00fc870 0x7fa0f010ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.150:35252/0 (socket says 172.21.15.150:35252) 2023-12-05T09:50:01.719 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:01.719+0000 7fa0effff700 1 -- 172.21.15.150:0/372625948 learned_addr learned my addr 172.21.15.150:0/372625948 (peer_addr_for_me v2:172.21.15.150:0/0) 2023-12-05T09:50:01.720 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:01.720+0000 7fa0effff700 1 -- 172.21.15.150:0/372625948 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0e0005040 con 0x7fa0f00fc870 2023-12-05T09:50:01.720 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:01.720+0000 7fa0effff700 1 --2- 172.21.15.150:0/372625948 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0f00fc870 0x7fa0f010ed30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa0e000b690 tx=0x7fa0e0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:50:01.720 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:01.720+0000 7fa0ecff9700 1 -- 172.21.15.150:0/372625948 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa0e0009650 con 0x7fa0f00fc870 2023-12-05T09:50:01.720 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:01.720+0000 7fa0ecff9700 1 -- 172.21.15.150:0/372625948 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa0e00097b0 con 0x7fa0f00fc870 2023-12-05T09:50:01.720 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:01.720+0000 7fa0f690d700 1 -- 172.21.15.150:0/372625948 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0f010f470 con 0x7fa0f00fc870 2023-12-05T09:50:01.721 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:01.720+0000 7fa0ecff9700 1 -- 172.21.15.150:0/372625948 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa0e001c5d0 con 0x7fa0f00fc870 2023-12-05T09:50:01.721 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:01.720+0000 7fa0f690d700 1 -- 172.21.15.150:0/372625948 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0f010ffd0 con 0x7fa0f00fc870 2023-12-05T09:50:01.721 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:01.721+0000 7fa0f690d700 1 -- 172.21.15.150:0/372625948 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0f004bb80 con 0x7fa0f00fc870 2023-12-05T09:50:01.721 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:01.722+0000 7fa0ecff9700 1 -- 172.21.15.150:0/372625948 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) v1 ==== 43338+0+0 (secure 0 0 0) 0x7fa0e00139d0 con 0x7fa0f00fc870 2023-12-05T09:50:01.722 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:01.722+0000 7fa0ecff9700 1 --2- 172.21.15.150:0/372625948 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7fa0d80366d0 0x7fa0d8038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:50:01.722 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:01.722+0000 7fa0ecff9700 1 -- 172.21.15.150:0/372625948 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fa0e0049a20 con 0x7fa0f00fc870 2023-12-05T09:50:01.722 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:01.723+0000 7fa0ef7fe700 1 --2- 172.21.15.150:0/372625948 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7fa0d80366d0 0x7fa0d8038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:50:01.722 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:01.723+0000 7fa0ef7fe700 1 --2- 172.21.15.150:0/372625948 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7fa0d80366d0 0x7fa0d8038b80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa0e4009990 tx=0x7fa0e4006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:50:01.728 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:01.731+0000 7fa0ecff9700 1 -- 172.21.15.150:0/372625948 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fa0e0025400 con 0x7fa0f00fc870 2023-12-05T09:50:01.897 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:01 smithi100 ceph-mon[107145]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:50:01.994 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:01.997+0000 7fa0f690d700 1 -- 172.21.15.150:0/372625948 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fa0f0110160 con 0x7fa0f00fc870 2023-12-05T09:50:01.995 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:01.998+0000 7fa0ecff9700 1 -- 172.21.15.150:0/372625948 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7fa0e0011b60 con 0x7fa0f00fc870 2023-12-05T09:50:01.995 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:50:01.995 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":1,"fsid":"5b035ce6-9353-11ee-95a2-87774f69a715","modified":"2023-12-05T09:48:31.075826Z","created":"2023-12-05T09:48:31.075826Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi100","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-05T09:50:01.997 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:02.000+0000 7fa0f690d700 1 -- 172.21.15.150:0/372625948 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7fa0d80366d0 msgr2=0x7fa0d8038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:50:01.998 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:02.000+0000 7fa0f690d700 1 --2- 172.21.15.150:0/372625948 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7fa0d80366d0 0x7fa0d8038b80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa0e4009990 tx=0x7fa0e4006e40 comp rx=0 tx=0).stop 2023-12-05T09:50:01.998 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:02.000+0000 7fa0f690d700 1 -- 172.21.15.150:0/372625948 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0f00fc870 msgr2=0x7fa0f010ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:50:01.998 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:02.000+0000 7fa0f690d700 1 --2- 172.21.15.150:0/372625948 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0f00fc870 0x7fa0f010ed30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa0e000b690 tx=0x7fa0e0009e30 comp rx=0 tx=0).stop 2023-12-05T09:50:01.998 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:02.000+0000 7fa0f690d700 1 -- 172.21.15.150:0/372625948 shutdown_connections 2023-12-05T09:50:01.998 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:02.000+0000 7fa0f690d700 1 --2- 172.21.15.150:0/372625948 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7fa0d80366d0 0x7fa0d8038b80 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:50:01.998 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:02.000+0000 7fa0f690d700 1 --2- 172.21.15.150:0/372625948 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0f00fc870 0x7fa0f010ed30 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:50:01.998 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:02.000+0000 7fa0f690d700 1 -- 172.21.15.150:0/372625948 >> 172.21.15.150:0/372625948 conn(0x7fa0f00f7f50 msgr2=0x7fa0f006fe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:50:01.998 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:02.000+0000 7fa0f690d700 1 -- 172.21.15.150:0/372625948 shutdown_connections 2023-12-05T09:50:01.998 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:02.000+0000 7fa0f690d700 1 -- 172.21.15.150:0/372625948 wait complete. 2023-12-05T09:50:01.999 INFO:teuthology.orchestra.run.smithi150.stderr:dumped monmap epoch 1 2023-12-05T09:50:02.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:02 smithi100 ceph-mon[107145]: from='client.? 172.21.15.150:0/372625948' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T09:50:03.379 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-05T09:50:03.379 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-05T09:50:03.792 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T09:50:03.880 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T09:50:03.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:03 smithi100 ceph-mon[107145]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:50:04.994 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:04.996+0000 7f6f5dd7c700 1 -- 172.21.15.150:0/3044453618 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f580fc870 msgr2=0x7f6f580fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:50:04.995 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:04.996+0000 7f6f5dd7c700 1 --2- 172.21.15.150:0/3044453618 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f580fc870 0x7f6f580fcc80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6f480048c0 tx=0x7f6f48009e30 comp rx=0 tx=0).stop 2023-12-05T09:50:04.995 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:04.996+0000 7f6f5dd7c700 1 -- 172.21.15.150:0/3044453618 shutdown_connections 2023-12-05T09:50:04.995 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:04.996+0000 7f6f5dd7c700 1 --2- 172.21.15.150:0/3044453618 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f580fc870 0x7f6f580fcc80 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:50:04.995 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:04.996+0000 7f6f5dd7c700 1 -- 172.21.15.150:0/3044453618 >> 172.21.15.150:0/3044453618 conn(0x7f6f580f7f50 msgr2=0x7f6f580fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:50:04.995 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:04.996+0000 7f6f5dd7c700 1 -- 172.21.15.150:0/3044453618 shutdown_connections 2023-12-05T09:50:04.995 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:04.996+0000 7f6f5dd7c700 1 -- 172.21.15.150:0/3044453618 wait complete. 2023-12-05T09:50:04.995 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:04.997+0000 7f6f5dd7c700 1 Processor -- start 2023-12-05T09:50:04.995 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:04.997+0000 7f6f5dd7c700 1 -- start start 2023-12-05T09:50:04.995 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:04.997+0000 7f6f5dd7c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f580fc870 0x7f6f5810ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:50:04.995 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:04.998+0000 7f6f5dd7c700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5810f280 con 0x7f6f580fc870 2023-12-05T09:50:04.997 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:04.998+0000 7f6f577fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f580fc870 0x7f6f5810ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:50:04.997 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:04.998+0000 7f6f577fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f580fc870 0x7f6f5810ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.150:35266/0 (socket says 172.21.15.150:35266) 2023-12-05T09:50:04.997 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:04.998+0000 7f6f577fe700 1 -- 172.21.15.150:0/817485587 learned_addr learned my addr 172.21.15.150:0/817485587 (peer_addr_for_me v2:172.21.15.150:0/0) 2023-12-05T09:50:04.997 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:04.998+0000 7f6f577fe700 1 -- 172.21.15.150:0/817485587 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f48005040 con 0x7f6f580fc870 2023-12-05T09:50:04.997 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:04.998+0000 7f6f577fe700 1 --2- 172.21.15.150:0/817485587 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f580fc870 0x7f6f5810ed40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6f4800b690 tx=0x7f6f48009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:50:04.997 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:04.999+0000 7f6f3ffff700 1 -- 172.21.15.150:0/817485587 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6f48009650 con 0x7f6f580fc870 2023-12-05T09:50:04.997 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:04.999+0000 7f6f3ffff700 1 -- 172.21.15.150:0/817485587 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6f480097b0 con 0x7f6f580fc870 2023-12-05T09:50:04.997 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:04.999+0000 7f6f5dd7c700 1 -- 172.21.15.150:0/817485587 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f5810f480 con 0x7f6f580fc870 2023-12-05T09:50:04.997 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:04.999+0000 7f6f3ffff700 1 -- 172.21.15.150:0/817485587 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6f4801c5d0 con 0x7f6f580fc870 2023-12-05T09:50:04.997 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:04.999+0000 7f6f5dd7c700 1 -- 172.21.15.150:0/817485587 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f5810ffe0 con 0x7f6f580fc870 2023-12-05T09:50:04.997 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:05.000+0000 7f6f5dd7c700 1 -- 172.21.15.150:0/817485587 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f5804bb80 con 0x7f6f580fc870 2023-12-05T09:50:04.997 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:05.000+0000 7f6f3ffff700 1 -- 172.21.15.150:0/817485587 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) v1 ==== 43338+0+0 (secure 0 0 0) 0x7f6f480139d0 con 0x7f6f580fc870 2023-12-05T09:50:04.998 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:05.000+0000 7f6f3ffff700 1 --2- 172.21.15.150:0/817485587 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f6f40036720 0x7f6f40038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:50:04.998 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:05.000+0000 7f6f3ffff700 1 -- 172.21.15.150:0/817485587 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f6f480499e0 con 0x7f6f580fc870 2023-12-05T09:50:04.998 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:05.001+0000 7f6f56ffd700 1 --2- 172.21.15.150:0/817485587 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f6f40036720 0x7f6f40038bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:50:04.998 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:05.001+0000 7f6f56ffd700 1 --2- 172.21.15.150:0/817485587 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f6f40036720 0x7f6f40038bd0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c009990 tx=0x7f6f4c006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:50:05.003 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:05.006+0000 7f6f3ffff700 1 -- 172.21.15.150:0/817485587 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f6f48025400 con 0x7f6f580fc870 2023-12-05T09:50:05.269 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:05.272+0000 7f6f5dd7c700 1 -- 172.21.15.150:0/817485587 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f6f58110e60 con 0x7f6f580fc870 2023-12-05T09:50:05.269 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:05.272+0000 7f6f3ffff700 1 -- 172.21.15.150:0/817485587 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f6f48011b60 con 0x7f6f580fc870 2023-12-05T09:50:05.270 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:50:05.270 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":1,"fsid":"5b035ce6-9353-11ee-95a2-87774f69a715","modified":"2023-12-05T09:48:31.075826Z","created":"2023-12-05T09:48:31.075826Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi100","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-05T09:50:05.272 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:05.275+0000 7f6f5dd7c700 1 -- 172.21.15.150:0/817485587 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f6f40036720 msgr2=0x7f6f40038bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:50:05.272 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:05.275+0000 7f6f5dd7c700 1 --2- 172.21.15.150:0/817485587 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f6f40036720 0x7f6f40038bd0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c009990 tx=0x7f6f4c006e40 comp rx=0 tx=0).stop 2023-12-05T09:50:05.272 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:05.275+0000 7f6f5dd7c700 1 -- 172.21.15.150:0/817485587 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f580fc870 msgr2=0x7f6f5810ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:50:05.272 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:05.275+0000 7f6f5dd7c700 1 --2- 172.21.15.150:0/817485587 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f580fc870 0x7f6f5810ed40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6f4800b690 tx=0x7f6f48009e30 comp rx=0 tx=0).stop 2023-12-05T09:50:05.272 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:05.275+0000 7f6f5dd7c700 1 -- 172.21.15.150:0/817485587 shutdown_connections 2023-12-05T09:50:05.272 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:05.275+0000 7f6f5dd7c700 1 --2- 172.21.15.150:0/817485587 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f6f40036720 0x7f6f40038bd0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:50:05.272 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:05.275+0000 7f6f5dd7c700 1 --2- 172.21.15.150:0/817485587 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f580fc870 0x7f6f5810ed40 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:50:05.272 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:05.275+0000 7f6f5dd7c700 1 -- 172.21.15.150:0/817485587 >> 172.21.15.150:0/817485587 conn(0x7f6f580f7f50 msgr2=0x7f6f580f8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:50:05.273 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:05.275+0000 7f6f5dd7c700 1 -- 172.21.15.150:0/817485587 shutdown_connections 2023-12-05T09:50:05.273 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:05.275+0000 7f6f5dd7c700 1 -- 172.21.15.150:0/817485587 wait complete. 2023-12-05T09:50:05.273 INFO:teuthology.orchestra.run.smithi150.stderr:dumped monmap epoch 1 2023-12-05T09:50:05.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:05 smithi100 ceph-mon[107145]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:50:05.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:05 smithi100 ceph-mon[107145]: from='client.? 172.21.15.150:0/817485587' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T09:50:06.661 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-05T09:50:06.661 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-05T09:50:07.074 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T09:50:07.162 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T09:50:07.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:07 smithi100 ceph-mon[107145]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:50:08.286 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:08.288+0000 7f28ac7de700 1 -- 172.21.15.150:0/3008435855 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28a40fc870 msgr2=0x7f28a40fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:50:08.286 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:08.288+0000 7f28ac7de700 1 --2- 172.21.15.150:0/3008435855 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28a40fc870 0x7f28a40fcc80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f28a00048c0 tx=0x7f28a0009e30 comp rx=0 tx=0).stop 2023-12-05T09:50:08.286 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:08.288+0000 7f28ac7de700 1 -- 172.21.15.150:0/3008435855 shutdown_connections 2023-12-05T09:50:08.286 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:08.288+0000 7f28ac7de700 1 --2- 172.21.15.150:0/3008435855 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28a40fc870 0x7f28a40fcc80 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:50:08.287 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:08.288+0000 7f28ac7de700 1 -- 172.21.15.150:0/3008435855 >> 172.21.15.150:0/3008435855 conn(0x7f28a40f7f50 msgr2=0x7f28a40fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:50:08.287 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:08.288+0000 7f28ac7de700 1 -- 172.21.15.150:0/3008435855 shutdown_connections 2023-12-05T09:50:08.287 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:08.288+0000 7f28ac7de700 1 -- 172.21.15.150:0/3008435855 wait complete. 2023-12-05T09:50:08.287 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:08.289+0000 7f28ac7de700 1 Processor -- start 2023-12-05T09:50:08.287 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:08.289+0000 7f28ac7de700 1 -- start start 2023-12-05T09:50:08.288 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:08.289+0000 7f28ac7de700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28a40fc870 0x7f28a410ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:50:08.288 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:08.289+0000 7f28ac7de700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a410f280 con 0x7f28a40fc870 2023-12-05T09:50:08.288 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:08.290+0000 7f28aa57a700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28a40fc870 0x7f28a410ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:50:08.288 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:08.290+0000 7f28aa57a700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28a40fc870 0x7f28a410ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.150:57722/0 (socket says 172.21.15.150:57722) 2023-12-05T09:50:08.289 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:08.290+0000 7f28aa57a700 1 -- 172.21.15.150:0/496343632 learned_addr learned my addr 172.21.15.150:0/496343632 (peer_addr_for_me v2:172.21.15.150:0/0) 2023-12-05T09:50:08.289 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:08.290+0000 7f28aa57a700 1 -- 172.21.15.150:0/496343632 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28a0005040 con 0x7f28a40fc870 2023-12-05T09:50:08.289 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:08.290+0000 7f28aa57a700 1 --2- 172.21.15.150:0/496343632 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28a40fc870 0x7f28a410ed40 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f28a0009330 tx=0x7f28a0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:50:08.289 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:08.290+0000 7f289affd700 1 -- 172.21.15.150:0/496343632 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f28a00096b0 con 0x7f28a40fc870 2023-12-05T09:50:08.289 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:08.290+0000 7f289affd700 1 -- 172.21.15.150:0/496343632 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f28a0009810 con 0x7f28a40fc870 2023-12-05T09:50:08.289 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:08.290+0000 7f28ac7de700 1 -- 172.21.15.150:0/496343632 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28a410f480 con 0x7f28a40fc870 2023-12-05T09:50:08.289 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:08.290+0000 7f289affd700 1 -- 172.21.15.150:0/496343632 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f28a001c5b0 con 0x7f28a40fc870 2023-12-05T09:50:08.289 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:08.291+0000 7f28ac7de700 1 -- 172.21.15.150:0/496343632 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28a410ffe0 con 0x7f28a40fc870 2023-12-05T09:50:08.290 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:08.291+0000 7f289affd700 1 -- 172.21.15.150:0/496343632 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) v1 ==== 43338+0+0 (secure 0 0 0) 0x7f28a0013420 con 0x7f28a40fc870 2023-12-05T09:50:08.290 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:08.292+0000 7f28ac7de700 1 -- 172.21.15.150:0/496343632 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28a404bb80 con 0x7f28a40fc870 2023-12-05T09:50:08.290 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:08.292+0000 7f289affd700 1 --2- 172.21.15.150:0/496343632 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f28900366d0 0x7f2890038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:50:08.290 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:08.292+0000 7f289affd700 1 -- 172.21.15.150:0/496343632 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f28a0049ac0 con 0x7f28a40fc870 2023-12-05T09:50:08.290 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:08.292+0000 7f28a9d79700 1 --2- 172.21.15.150:0/496343632 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f28900366d0 0x7f2890038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:50:08.290 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:08.293+0000 7f28a9d79700 1 --2- 172.21.15.150:0/496343632 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f28900366d0 0x7f2890038b80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2894009990 tx=0x7f2894006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:50:08.294 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:08.297+0000 7f289affd700 1 -- 172.21.15.150:0/496343632 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f28a00119c0 con 0x7f28a40fc870 2023-12-05T09:50:08.559 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:08.562+0000 7f28ac7de700 1 -- 172.21.15.150:0/496343632 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f28a4110170 con 0x7f28a40fc870 2023-12-05T09:50:08.559 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:08.562+0000 7f289affd700 1 -- 172.21.15.150:0/496343632 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f28a0011370 con 0x7f28a40fc870 2023-12-05T09:50:08.560 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:50:08.560 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":1,"fsid":"5b035ce6-9353-11ee-95a2-87774f69a715","modified":"2023-12-05T09:48:31.075826Z","created":"2023-12-05T09:48:31.075826Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi100","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-05T09:50:08.562 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:08.565+0000 7f28ac7de700 1 -- 172.21.15.150:0/496343632 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f28900366d0 msgr2=0x7f2890038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:50:08.562 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:08.565+0000 7f28ac7de700 1 --2- 172.21.15.150:0/496343632 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f28900366d0 0x7f2890038b80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2894009990 tx=0x7f2894006e40 comp rx=0 tx=0).stop 2023-12-05T09:50:08.562 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:08.565+0000 7f28ac7de700 1 -- 172.21.15.150:0/496343632 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28a40fc870 msgr2=0x7f28a410ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:50:08.562 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:08.565+0000 7f28ac7de700 1 --2- 172.21.15.150:0/496343632 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28a40fc870 0x7f28a410ed40 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f28a0009330 tx=0x7f28a0009e30 comp rx=0 tx=0).stop 2023-12-05T09:50:08.562 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:08.565+0000 7f28ac7de700 1 -- 172.21.15.150:0/496343632 shutdown_connections 2023-12-05T09:50:08.562 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:08.565+0000 7f28ac7de700 1 --2- 172.21.15.150:0/496343632 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f28900366d0 0x7f2890038b80 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:50:08.562 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:08.565+0000 7f28ac7de700 1 --2- 172.21.15.150:0/496343632 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28a40fc870 0x7f28a410ed40 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:50:08.562 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:08.565+0000 7f28ac7de700 1 -- 172.21.15.150:0/496343632 >> 172.21.15.150:0/496343632 conn(0x7f28a40f7f50 msgr2=0x7f28a406fef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:50:08.563 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:08.565+0000 7f28ac7de700 1 -- 172.21.15.150:0/496343632 shutdown_connections 2023-12-05T09:50:08.563 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:08.565+0000 7f28ac7de700 1 -- 172.21.15.150:0/496343632 wait complete. 2023-12-05T09:50:08.563 INFO:teuthology.orchestra.run.smithi150.stderr:dumped monmap epoch 1 2023-12-05T09:50:09.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:09 smithi100 ceph-mon[107145]: from='client.? 172.21.15.150:0/496343632' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T09:50:09.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:09 smithi100 ceph-mon[107145]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:50:09.927 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-05T09:50:09.927 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-05T09:50:10.345 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T09:50:10.433 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T09:50:11.527 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:11.529+0000 7f4a4a739700 1 -- 172.21.15.150:0/307759233 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a44071b60 msgr2=0x7f4a4406ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:50:11.527 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:11.529+0000 7f4a4a739700 1 --2- 172.21.15.150:0/307759233 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a44071b60 0x7f4a4406ffd0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4a400048c0 tx=0x7f4a40009e30 comp rx=0 tx=0).stop 2023-12-05T09:50:11.527 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:11.529+0000 7f4a4a739700 1 -- 172.21.15.150:0/307759233 shutdown_connections 2023-12-05T09:50:11.527 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:11.529+0000 7f4a4a739700 1 --2- 172.21.15.150:0/307759233 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a44071b60 0x7f4a4406ffd0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:50:11.527 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:11.529+0000 7f4a4a739700 1 -- 172.21.15.150:0/307759233 >> 172.21.15.150:0/307759233 conn(0x7f4a440f7d70 msgr2=0x7f4a440fa1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:50:11.527 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:11.529+0000 7f4a4a739700 1 -- 172.21.15.150:0/307759233 shutdown_connections 2023-12-05T09:50:11.528 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:11.529+0000 7f4a4a739700 1 -- 172.21.15.150:0/307759233 wait complete. 2023-12-05T09:50:11.528 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:11.530+0000 7f4a4a739700 1 Processor -- start 2023-12-05T09:50:11.528 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:11.530+0000 7f4a4a739700 1 -- start start 2023-12-05T09:50:11.528 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:11.531+0000 7f4a4a739700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a44071b60 0x7f4a4410ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:50:11.528 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:11.531+0000 7f4a4a739700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4410efc0 con 0x7f4a44071b60 2023-12-05T09:50:11.528 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:11.531+0000 7f4a49737700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a44071b60 0x7f4a4410ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:50:11.529 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:11.531+0000 7f4a49737700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a44071b60 0x7f4a4410ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.150:57748/0 (socket says 172.21.15.150:57748) 2023-12-05T09:50:11.529 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:11.531+0000 7f4a49737700 1 -- 172.21.15.150:0/1928978609 learned_addr learned my addr 172.21.15.150:0/1928978609 (peer_addr_for_me v2:172.21.15.150:0/0) 2023-12-05T09:50:11.529 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:11.532+0000 7f4a49737700 1 -- 172.21.15.150:0/1928978609 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a40005040 con 0x7f4a44071b60 2023-12-05T09:50:11.529 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:11.532+0000 7f4a49737700 1 --2- 172.21.15.150:0/1928978609 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a44071b60 0x7f4a4410ea80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4a40009040 tx=0x7f4a40009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:50:11.530 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:11.532+0000 7f4a39ffb700 1 -- 172.21.15.150:0/1928978609 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4a40009620 con 0x7f4a44071b60 2023-12-05T09:50:11.530 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:11.532+0000 7f4a4a739700 1 -- 172.21.15.150:0/1928978609 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a4410f1c0 con 0x7f4a44071b60 2023-12-05T09:50:11.530 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:11.532+0000 7f4a39ffb700 1 -- 172.21.15.150:0/1928978609 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4a40009780 con 0x7f4a44071b60 2023-12-05T09:50:11.530 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:11.532+0000 7f4a39ffb700 1 -- 172.21.15.150:0/1928978609 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4a4001c5b0 con 0x7f4a44071b60 2023-12-05T09:50:11.530 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:11.532+0000 7f4a4a739700 1 -- 172.21.15.150:0/1928978609 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a4410fe60 con 0x7f4a44071b60 2023-12-05T09:50:11.530 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:11.533+0000 7f4a4a739700 1 -- 172.21.15.150:0/1928978609 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a4405f270 con 0x7f4a44071b60 2023-12-05T09:50:11.530 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:11.533+0000 7f4a39ffb700 1 -- 172.21.15.150:0/1928978609 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) v1 ==== 43338+0+0 (secure 0 0 0) 0x7f4a40013a60 con 0x7f4a44071b60 2023-12-05T09:50:11.531 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:11.534+0000 7f4a39ffb700 1 --2- 172.21.15.150:0/1928978609 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f4a300366d0 0x7f4a30038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:50:11.531 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:11.534+0000 7f4a39ffb700 1 -- 172.21.15.150:0/1928978609 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f4a40049900 con 0x7f4a44071b60 2023-12-05T09:50:11.531 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:11.534+0000 7f4a48f36700 1 --2- 172.21.15.150:0/1928978609 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f4a300366d0 0x7f4a30038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:50:11.532 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:11.535+0000 7f4a48f36700 1 --2- 172.21.15.150:0/1928978609 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f4a300366d0 0x7f4a30038b80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4a34009990 tx=0x7f4a34006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:50:11.536 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:11.539+0000 7f4a39ffb700 1 -- 172.21.15.150:0/1928978609 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f4a400119c0 con 0x7f4a44071b60 2023-12-05T09:50:11.787 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:11 smithi100 ceph-mon[107145]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:50:11.802 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:11.805+0000 7f4a4a739700 1 -- 172.21.15.150:0/1928978609 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f4a441109b0 con 0x7f4a44071b60 2023-12-05T09:50:11.802 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:11.805+0000 7f4a39ffb700 1 -- 172.21.15.150:0/1928978609 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f4a40011370 con 0x7f4a44071b60 2023-12-05T09:50:11.803 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:50:11.803 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":1,"fsid":"5b035ce6-9353-11ee-95a2-87774f69a715","modified":"2023-12-05T09:48:31.075826Z","created":"2023-12-05T09:48:31.075826Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi100","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-05T09:50:11.805 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:11.808+0000 7f4a4a739700 1 -- 172.21.15.150:0/1928978609 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f4a300366d0 msgr2=0x7f4a30038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:50:11.805 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:11.808+0000 7f4a4a739700 1 --2- 172.21.15.150:0/1928978609 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f4a300366d0 0x7f4a30038b80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4a34009990 tx=0x7f4a34006e40 comp rx=0 tx=0).stop 2023-12-05T09:50:11.805 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:11.808+0000 7f4a4a739700 1 -- 172.21.15.150:0/1928978609 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a44071b60 msgr2=0x7f4a4410ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:50:11.805 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:11.808+0000 7f4a4a739700 1 --2- 172.21.15.150:0/1928978609 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a44071b60 0x7f4a4410ea80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4a40009040 tx=0x7f4a40009e30 comp rx=0 tx=0).stop 2023-12-05T09:50:11.805 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:11.808+0000 7f4a4a739700 1 -- 172.21.15.150:0/1928978609 shutdown_connections 2023-12-05T09:50:11.805 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:11.808+0000 7f4a4a739700 1 --2- 172.21.15.150:0/1928978609 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f4a300366d0 0x7f4a30038b80 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:50:11.805 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:11.808+0000 7f4a4a739700 1 --2- 172.21.15.150:0/1928978609 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a44071b60 0x7f4a4410ea80 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:50:11.806 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:11.808+0000 7f4a4a739700 1 -- 172.21.15.150:0/1928978609 >> 172.21.15.150:0/1928978609 conn(0x7f4a440f7d70 msgr2=0x7f4a440f8b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:50:11.806 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:11.808+0000 7f4a4a739700 1 -- 172.21.15.150:0/1928978609 shutdown_connections 2023-12-05T09:50:11.806 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:11.808+0000 7f4a4a739700 1 -- 172.21.15.150:0/1928978609 wait complete. 2023-12-05T09:50:11.806 INFO:teuthology.orchestra.run.smithi150.stderr:dumped monmap epoch 1 2023-12-05T09:50:12.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:12 smithi100 ceph-mon[107145]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:12.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:12 smithi100 ceph-mon[107145]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:12.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:12 smithi100 ceph-mon[107145]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:12.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:12 smithi100 ceph-mon[107145]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:12.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:12 smithi100 ceph-mon[107145]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:12.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:12 smithi100 ceph-mon[107145]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:12.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:12 smithi100 ceph-mon[107145]: Deploying daemon prometheus.smithi100 on smithi100 2023-12-05T09:50:12.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:12 smithi100 ceph-mon[107145]: from='client.? 172.21.15.150:0/1928978609' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T09:50:13.182 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-05T09:50:13.182 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-05T09:50:13.592 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T09:50:13.679 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T09:50:13.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:13 smithi100 ceph-mon[107145]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:50:13.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:13 smithi100 ceph-mon[107145]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:14.886 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:14.888+0000 7f4123d08700 1 -- 172.21.15.150:0/1384162174 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f411c0fc870 msgr2=0x7f411c0fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:50:14.887 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:14.888+0000 7f4123d08700 1 --2- 172.21.15.150:0/1384162174 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f411c0fc870 0x7f411c0fcc80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f41180048c0 tx=0x7f4118009e30 comp rx=0 tx=0).stop 2023-12-05T09:50:14.887 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:14.888+0000 7f4123d08700 1 -- 172.21.15.150:0/1384162174 shutdown_connections 2023-12-05T09:50:14.887 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:14.888+0000 7f4123d08700 1 --2- 172.21.15.150:0/1384162174 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f411c0fc870 0x7f411c0fcc80 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:50:14.887 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:14.888+0000 7f4123d08700 1 -- 172.21.15.150:0/1384162174 >> 172.21.15.150:0/1384162174 conn(0x7f411c0f7f50 msgr2=0x7f411c0fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:50:14.887 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:14.888+0000 7f4123d08700 1 -- 172.21.15.150:0/1384162174 shutdown_connections 2023-12-05T09:50:14.887 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:14.888+0000 7f4123d08700 1 -- 172.21.15.150:0/1384162174 wait complete. 2023-12-05T09:50:14.887 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:14.889+0000 7f4123d08700 1 Processor -- start 2023-12-05T09:50:14.887 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:14.889+0000 7f4123d08700 1 -- start start 2023-12-05T09:50:14.888 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:14.890+0000 7f4123d08700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f411c0fc870 0x7f411c10ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:50:14.888 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:14.890+0000 7f4123d08700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f411c10f270 con 0x7f411c0fc870 2023-12-05T09:50:14.888 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:14.890+0000 7f4121aa4700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f411c0fc870 0x7f411c10ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:50:14.888 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:14.890+0000 7f4121aa4700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f411c0fc870 0x7f411c10ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.150:57762/0 (socket says 172.21.15.150:57762) 2023-12-05T09:50:14.888 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:14.890+0000 7f4121aa4700 1 -- 172.21.15.150:0/308784742 learned_addr learned my addr 172.21.15.150:0/308784742 (peer_addr_for_me v2:172.21.15.150:0/0) 2023-12-05T09:50:14.889 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:14.890+0000 7f4121aa4700 1 -- 172.21.15.150:0/308784742 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4118005040 con 0x7f411c0fc870 2023-12-05T09:50:14.889 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:14.891+0000 7f4121aa4700 1 --2- 172.21.15.150:0/308784742 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f411c0fc870 0x7f411c10ed30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4118009330 tx=0x7f4118009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:50:14.889 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:14.891+0000 7f41127fc700 1 -- 172.21.15.150:0/308784742 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f41180096b0 con 0x7f411c0fc870 2023-12-05T09:50:14.889 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:14.891+0000 7f4123d08700 1 -- 172.21.15.150:0/308784742 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f411c10f470 con 0x7f411c0fc870 2023-12-05T09:50:14.889 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:14.891+0000 7f41127fc700 1 -- 172.21.15.150:0/308784742 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4118009810 con 0x7f411c0fc870 2023-12-05T09:50:14.889 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:14.891+0000 7f41127fc700 1 -- 172.21.15.150:0/308784742 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f411801c5b0 con 0x7f411c0fc870 2023-12-05T09:50:14.889 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:14.891+0000 7f4123d08700 1 -- 172.21.15.150:0/308784742 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f411c10ffd0 con 0x7f411c0fc870 2023-12-05T09:50:14.890 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:14.892+0000 7f41127fc700 1 -- 172.21.15.150:0/308784742 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) v1 ==== 43338+0+0 (secure 0 0 0) 0x7f4118013420 con 0x7f411c0fc870 2023-12-05T09:50:14.890 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:14.892+0000 7f4123d08700 1 -- 172.21.15.150:0/308784742 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f411c05f270 con 0x7f411c0fc870 2023-12-05T09:50:14.890 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:14.892+0000 7f41127fc700 1 --2- 172.21.15.150:0/308784742 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f41080366d0 0x7f4108038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:50:14.890 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:14.892+0000 7f41127fc700 1 -- 172.21.15.150:0/308784742 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f4118049ad0 con 0x7f411c0fc870 2023-12-05T09:50:14.890 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:14.893+0000 7f41212a3700 1 --2- 172.21.15.150:0/308784742 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f41080366d0 0x7f4108038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:50:14.890 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:14.893+0000 7f41212a3700 1 --2- 172.21.15.150:0/308784742 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f41080366d0 0x7f4108038b80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f410c009990 tx=0x7f410c006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:50:14.895 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:14.898+0000 7f41127fc700 1 -- 172.21.15.150:0/308784742 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f41180119c0 con 0x7f411c0fc870 2023-12-05T09:50:15.161 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:15.164+0000 7f4123d08700 1 -- 172.21.15.150:0/308784742 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f411c04bb80 con 0x7f411c0fc870 2023-12-05T09:50:15.161 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:15.164+0000 7f41127fc700 1 -- 172.21.15.150:0/308784742 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f4118011370 con 0x7f411c0fc870 2023-12-05T09:50:15.161 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:50:15.162 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":1,"fsid":"5b035ce6-9353-11ee-95a2-87774f69a715","modified":"2023-12-05T09:48:31.075826Z","created":"2023-12-05T09:48:31.075826Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi100","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-05T09:50:15.164 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:15.166+0000 7f4123d08700 1 -- 172.21.15.150:0/308784742 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f41080366d0 msgr2=0x7f4108038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:50:15.164 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:15.166+0000 7f4123d08700 1 --2- 172.21.15.150:0/308784742 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f41080366d0 0x7f4108038b80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f410c009990 tx=0x7f410c006e40 comp rx=0 tx=0).stop 2023-12-05T09:50:15.164 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:15.166+0000 7f4123d08700 1 -- 172.21.15.150:0/308784742 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f411c0fc870 msgr2=0x7f411c10ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:50:15.164 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:15.166+0000 7f4123d08700 1 --2- 172.21.15.150:0/308784742 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f411c0fc870 0x7f411c10ed30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4118009330 tx=0x7f4118009e30 comp rx=0 tx=0).stop 2023-12-05T09:50:15.164 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:15.166+0000 7f4123d08700 1 -- 172.21.15.150:0/308784742 shutdown_connections 2023-12-05T09:50:15.164 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:15.166+0000 7f4123d08700 1 --2- 172.21.15.150:0/308784742 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f41080366d0 0x7f4108038b80 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:50:15.164 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:15.166+0000 7f4123d08700 1 --2- 172.21.15.150:0/308784742 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f411c0fc870 0x7f411c10ed30 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:50:15.164 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:15.166+0000 7f4123d08700 1 -- 172.21.15.150:0/308784742 >> 172.21.15.150:0/308784742 conn(0x7f411c0f7f50 msgr2=0x7f411c06feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:50:15.164 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:15.167+0000 7f4123d08700 1 -- 172.21.15.150:0/308784742 shutdown_connections 2023-12-05T09:50:15.164 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:15.167+0000 7f4123d08700 1 -- 172.21.15.150:0/308784742 wait complete. 2023-12-05T09:50:15.165 INFO:teuthology.orchestra.run.smithi150.stderr:dumped monmap epoch 1 2023-12-05T09:50:16.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:15 smithi100 ceph-mon[107145]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:50:16.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:15 smithi100 ceph-mon[107145]: from='client.? 172.21.15.150:0/308784742' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T09:50:16.572 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-05T09:50:16.573 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-05T09:50:16.978 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T09:50:17.066 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T09:50:18.084 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:17 smithi100 ceph-mon[107145]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:50:18.243 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:18.245+0000 7f8e6d5a3700 1 -- 172.21.15.150:0/3206465983 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e680fc870 msgr2=0x7f8e680fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:50:18.243 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:18.245+0000 7f8e6d5a3700 1 --2- 172.21.15.150:0/3206465983 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e680fc870 0x7f8e680fcc80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8e580048c0 tx=0x7f8e58009e30 comp rx=0 tx=0).stop 2023-12-05T09:50:18.243 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:18.245+0000 7f8e6d5a3700 1 -- 172.21.15.150:0/3206465983 shutdown_connections 2023-12-05T09:50:18.243 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:18.245+0000 7f8e6d5a3700 1 --2- 172.21.15.150:0/3206465983 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e680fc870 0x7f8e680fcc80 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:50:18.243 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:18.245+0000 7f8e6d5a3700 1 -- 172.21.15.150:0/3206465983 >> 172.21.15.150:0/3206465983 conn(0x7f8e680f7f50 msgr2=0x7f8e680fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:50:18.243 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:18.245+0000 7f8e6d5a3700 1 -- 172.21.15.150:0/3206465983 shutdown_connections 2023-12-05T09:50:18.243 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:18.245+0000 7f8e6d5a3700 1 -- 172.21.15.150:0/3206465983 wait complete. 2023-12-05T09:50:18.244 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:18.246+0000 7f8e6d5a3700 1 Processor -- start 2023-12-05T09:50:18.244 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:18.246+0000 7f8e6d5a3700 1 -- start start 2023-12-05T09:50:18.244 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:18.247+0000 7f8e6d5a3700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e680fc870 0x7f8e6810ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:50:18.244 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:18.247+0000 7f8e6d5a3700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6810f270 con 0x7f8e680fc870 2023-12-05T09:50:18.244 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:18.247+0000 7f8e66ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e680fc870 0x7f8e6810ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:50:18.245 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:18.247+0000 7f8e66ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e680fc870 0x7f8e6810ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.150:39432/0 (socket says 172.21.15.150:39432) 2023-12-05T09:50:18.245 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:18.247+0000 7f8e66ffd700 1 -- 172.21.15.150:0/3495023192 learned_addr learned my addr 172.21.15.150:0/3495023192 (peer_addr_for_me v2:172.21.15.150:0/0) 2023-12-05T09:50:18.245 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:18.247+0000 7f8e66ffd700 1 -- 172.21.15.150:0/3495023192 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e58005040 con 0x7f8e680fc870 2023-12-05T09:50:18.245 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:18.248+0000 7f8e66ffd700 1 --2- 172.21.15.150:0/3495023192 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e680fc870 0x7f8e6810ed30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8e5800b690 tx=0x7f8e58009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:50:18.245 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:18.248+0000 7f8e4f7fe700 1 -- 172.21.15.150:0/3495023192 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8e58009650 con 0x7f8e680fc870 2023-12-05T09:50:18.245 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:18.248+0000 7f8e4f7fe700 1 -- 172.21.15.150:0/3495023192 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8e580097b0 con 0x7f8e680fc870 2023-12-05T09:50:18.246 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:18.248+0000 7f8e6d5a3700 1 -- 172.21.15.150:0/3495023192 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e6810f470 con 0x7f8e680fc870 2023-12-05T09:50:18.246 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:18.248+0000 7f8e4f7fe700 1 -- 172.21.15.150:0/3495023192 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8e5801c5d0 con 0x7f8e680fc870 2023-12-05T09:50:18.246 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:18.248+0000 7f8e6d5a3700 1 -- 172.21.15.150:0/3495023192 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e6810ffd0 con 0x7f8e680fc870 2023-12-05T09:50:18.246 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:18.249+0000 7f8e4f7fe700 1 -- 172.21.15.150:0/3495023192 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) v1 ==== 43338+0+0 (secure 0 0 0) 0x7f8e58013420 con 0x7f8e680fc870 2023-12-05T09:50:18.246 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:18.249+0000 7f8e6d5a3700 1 -- 172.21.15.150:0/3495023192 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e6804bb80 con 0x7f8e680fc870 2023-12-05T09:50:18.247 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:18.249+0000 7f8e4f7fe700 1 --2- 172.21.15.150:0/3495023192 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f8e50036720 0x7f8e50038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:50:18.247 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:18.249+0000 7f8e4f7fe700 1 -- 172.21.15.150:0/3495023192 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f8e580499e0 con 0x7f8e680fc870 2023-12-05T09:50:18.247 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:18.250+0000 7f8e667fc700 1 --2- 172.21.15.150:0/3495023192 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f8e50036720 0x7f8e50038bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:50:18.247 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:18.250+0000 7f8e667fc700 1 --2- 172.21.15.150:0/3495023192 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f8e50036720 0x7f8e50038bd0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c009990 tx=0x7f8e5c006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:50:18.251 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:18.254+0000 7f8e4f7fe700 1 -- 172.21.15.150:0/3495023192 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f8e58025400 con 0x7f8e680fc870 2023-12-05T09:50:18.516 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:18.519+0000 7f8e6d5a3700 1 -- 172.21.15.150:0/3495023192 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f8e68110160 con 0x7f8e680fc870 2023-12-05T09:50:18.516 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:18.519+0000 7f8e4f7fe700 1 -- 172.21.15.150:0/3495023192 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f8e58011370 con 0x7f8e680fc870 2023-12-05T09:50:18.517 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:50:18.517 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":1,"fsid":"5b035ce6-9353-11ee-95a2-87774f69a715","modified":"2023-12-05T09:48:31.075826Z","created":"2023-12-05T09:48:31.075826Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi100","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-05T09:50:18.519 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:18.522+0000 7f8e6d5a3700 1 -- 172.21.15.150:0/3495023192 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f8e50036720 msgr2=0x7f8e50038bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:50:18.519 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:18.522+0000 7f8e6d5a3700 1 --2- 172.21.15.150:0/3495023192 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f8e50036720 0x7f8e50038bd0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c009990 tx=0x7f8e5c006e40 comp rx=0 tx=0).stop 2023-12-05T09:50:18.519 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:18.522+0000 7f8e6d5a3700 1 -- 172.21.15.150:0/3495023192 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e680fc870 msgr2=0x7f8e6810ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:50:18.519 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:18.522+0000 7f8e6d5a3700 1 --2- 172.21.15.150:0/3495023192 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e680fc870 0x7f8e6810ed30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8e5800b690 tx=0x7f8e58009e30 comp rx=0 tx=0).stop 2023-12-05T09:50:18.519 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:18.522+0000 7f8e6d5a3700 1 -- 172.21.15.150:0/3495023192 shutdown_connections 2023-12-05T09:50:18.519 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:18.522+0000 7f8e6d5a3700 1 --2- 172.21.15.150:0/3495023192 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f8e50036720 0x7f8e50038bd0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:50:18.520 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:18.522+0000 7f8e6d5a3700 1 --2- 172.21.15.150:0/3495023192 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e680fc870 0x7f8e6810ed30 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:50:18.520 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:18.522+0000 7f8e6d5a3700 1 -- 172.21.15.150:0/3495023192 >> 172.21.15.150:0/3495023192 conn(0x7f8e680f7f50 msgr2=0x7f8e6806fe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:50:18.520 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:18.522+0000 7f8e6d5a3700 1 -- 172.21.15.150:0/3495023192 shutdown_connections 2023-12-05T09:50:18.520 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:18.522+0000 7f8e6d5a3700 1 -- 172.21.15.150:0/3495023192 wait complete. 2023-12-05T09:50:18.520 INFO:teuthology.orchestra.run.smithi150.stderr:dumped monmap epoch 1 2023-12-05T09:50:19.616 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:19 smithi100 ceph-mon[107145]: from='client.? 172.21.15.150:0/3495023192' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T09:50:19.616 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:19 smithi100 ceph-mon[107145]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:50:19.915 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-05T09:50:19.916 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-05T09:50:20.330 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T09:50:20.418 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T09:50:21.586 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:21.587+0000 7f8d8333e700 1 -- 172.21.15.150:0/2116288729 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d7c0fc870 msgr2=0x7f8d7c0fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:50:21.586 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:21.587+0000 7f8d8333e700 1 --2- 172.21.15.150:0/2116288729 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d7c0fc870 0x7f8d7c0fcc80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8d780048c0 tx=0x7f8d78009e30 comp rx=0 tx=0).stop 2023-12-05T09:50:21.586 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:21.587+0000 7f8d8333e700 1 -- 172.21.15.150:0/2116288729 shutdown_connections 2023-12-05T09:50:21.587 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:21.587+0000 7f8d8333e700 1 --2- 172.21.15.150:0/2116288729 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d7c0fc870 0x7f8d7c0fcc80 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:50:21.587 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:21.587+0000 7f8d8333e700 1 -- 172.21.15.150:0/2116288729 >> 172.21.15.150:0/2116288729 conn(0x7f8d7c0f7f50 msgr2=0x7f8d7c0fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:50:21.587 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:21.587+0000 7f8d8333e700 1 -- 172.21.15.150:0/2116288729 shutdown_connections 2023-12-05T09:50:21.587 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:21.587+0000 7f8d8333e700 1 -- 172.21.15.150:0/2116288729 wait complete. 2023-12-05T09:50:21.587 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:21.588+0000 7f8d8333e700 1 Processor -- start 2023-12-05T09:50:21.587 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:21.588+0000 7f8d8333e700 1 -- start start 2023-12-05T09:50:21.587 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:21.589+0000 7f8d8333e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d7c0fc870 0x7f8d7c10ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:50:21.587 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:21.589+0000 7f8d8333e700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7c10cfd0 con 0x7f8d7c0fc870 2023-12-05T09:50:21.589 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:21.589+0000 7f8d810da700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d7c0fc870 0x7f8d7c10ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:50:21.589 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:21.589+0000 7f8d810da700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d7c0fc870 0x7f8d7c10ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.150:39438/0 (socket says 172.21.15.150:39438) 2023-12-05T09:50:21.590 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:21.590+0000 7f8d810da700 1 -- 172.21.15.150:0/2910458506 learned_addr learned my addr 172.21.15.150:0/2910458506 (peer_addr_for_me v2:172.21.15.150:0/0) 2023-12-05T09:50:21.590 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:21.590+0000 7f8d810da700 1 -- 172.21.15.150:0/2910458506 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d78005040 con 0x7f8d7c0fc870 2023-12-05T09:50:21.590 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:21.590+0000 7f8d810da700 1 --2- 172.21.15.150:0/2910458506 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d7c0fc870 0x7f8d7c10ca90 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8d7800b690 tx=0x7f8d78009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:50:21.590 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:21.590+0000 7f8d71ffb700 1 -- 172.21.15.150:0/2910458506 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8d78009650 con 0x7f8d7c0fc870 2023-12-05T09:50:21.590 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:21.590+0000 7f8d71ffb700 1 -- 172.21.15.150:0/2910458506 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8d780097b0 con 0x7f8d7c0fc870 2023-12-05T09:50:21.590 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:21.590+0000 7f8d8333e700 1 -- 172.21.15.150:0/2910458506 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d7c10d1d0 con 0x7f8d7c0fc870 2023-12-05T09:50:21.590 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:21.590+0000 7f8d71ffb700 1 -- 172.21.15.150:0/2910458506 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8d7801c5d0 con 0x7f8d7c0fc870 2023-12-05T09:50:21.590 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:21.591+0000 7f8d8333e700 1 -- 172.21.15.150:0/2910458506 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d7c10de70 con 0x7f8d7c0fc870 2023-12-05T09:50:21.591 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:21.591+0000 7f8d8333e700 1 -- 172.21.15.150:0/2910458506 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d7c05f270 con 0x7f8d7c0fc870 2023-12-05T09:50:21.591 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:21.592+0000 7f8d71ffb700 1 -- 172.21.15.150:0/2910458506 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) v1 ==== 43338+0+0 (secure 0 0 0) 0x7f8d780139d0 con 0x7f8d7c0fc870 2023-12-05T09:50:21.591 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:21.592+0000 7f8d71ffb700 1 --2- 172.21.15.150:0/2910458506 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f8d680366d0 0x7f8d68038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:50:21.591 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:21.592+0000 7f8d71ffb700 1 -- 172.21.15.150:0/2910458506 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f8d78049960 con 0x7f8d7c0fc870 2023-12-05T09:50:21.591 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:21.592+0000 7f8d808d9700 1 --2- 172.21.15.150:0/2910458506 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f8d680366d0 0x7f8d68038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:50:21.592 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:21.593+0000 7f8d808d9700 1 --2- 172.21.15.150:0/2910458506 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f8d680366d0 0x7f8d68038b80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c009990 tx=0x7f8d6c006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:50:21.595 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:21.598+0000 7f8d71ffb700 1 -- 172.21.15.150:0/2910458506 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f8d78025400 con 0x7f8d7c0fc870 2023-12-05T09:50:21.805 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:21.808+0000 7f8d71ffb700 1 -- 172.21.15.150:0/2910458506 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mgrmap(e 14) v1 ==== 43352+0+0 (secure 0 0 0) 0x7f8d78025780 con 0x7f8d7c0fc870 2023-12-05T09:50:21.858 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:21.861+0000 7f8d8333e700 1 -- 172.21.15.150:0/2910458506 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f8d7c10e9c0 con 0x7f8d7c0fc870 2023-12-05T09:50:21.859 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:21.862+0000 7f8d71ffb700 1 -- 172.21.15.150:0/2910458506 <== mon.0 v2:172.21.15.100:3300/0 8 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f8d78025400 con 0x7f8d7c0fc870 2023-12-05T09:50:21.859 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:50:21.859 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":1,"fsid":"5b035ce6-9353-11ee-95a2-87774f69a715","modified":"2023-12-05T09:48:31.075826Z","created":"2023-12-05T09:48:31.075826Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi100","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-05T09:50:21.861 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:21.864+0000 7f8d8333e700 1 -- 172.21.15.150:0/2910458506 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f8d680366d0 msgr2=0x7f8d68038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:50:21.861 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:21.864+0000 7f8d8333e700 1 --2- 172.21.15.150:0/2910458506 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f8d680366d0 0x7f8d68038b80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c009990 tx=0x7f8d6c006e40 comp rx=0 tx=0).stop 2023-12-05T09:50:21.861 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:21.864+0000 7f8d8333e700 1 -- 172.21.15.150:0/2910458506 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d7c0fc870 msgr2=0x7f8d7c10ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:50:21.861 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:21.864+0000 7f8d8333e700 1 --2- 172.21.15.150:0/2910458506 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d7c0fc870 0x7f8d7c10ca90 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8d7800b690 tx=0x7f8d78009e30 comp rx=0 tx=0).stop 2023-12-05T09:50:21.861 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:21.864+0000 7f8d8333e700 1 -- 172.21.15.150:0/2910458506 shutdown_connections 2023-12-05T09:50:21.861 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:21.864+0000 7f8d8333e700 1 --2- 172.21.15.150:0/2910458506 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f8d680366d0 0x7f8d68038b80 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:50:21.862 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:21.864+0000 7f8d8333e700 1 --2- 172.21.15.150:0/2910458506 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d7c0fc870 0x7f8d7c10ca90 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:50:21.862 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:21.864+0000 7f8d8333e700 1 -- 172.21.15.150:0/2910458506 >> 172.21.15.150:0/2910458506 conn(0x7f8d7c0f7f50 msgr2=0x7f8d7c0f8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:50:21.862 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:21.864+0000 7f8d8333e700 1 -- 172.21.15.150:0/2910458506 shutdown_connections 2023-12-05T09:50:21.862 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:21.864+0000 7f8d8333e700 1 -- 172.21.15.150:0/2910458506 wait complete. 2023-12-05T09:50:21.862 INFO:teuthology.orchestra.run.smithi150.stderr:dumped monmap epoch 1 2023-12-05T09:50:22.074 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:21 smithi100 ceph-mon[107145]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:50:22.074 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:21 smithi100 ceph-mon[107145]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:22.074 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:21 smithi100 ceph-mon[107145]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:22.074 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:21 smithi100 ceph-mon[107145]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:22.074 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:21 smithi100 ceph-mon[107145]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2023-12-05T09:50:23.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:22 smithi100 ceph-mon[107145]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2023-12-05T09:50:23.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:22 smithi100 ceph-mon[107145]: mgrmap e14: smithi100.ehmuhg(active, since 53s) 2023-12-05T09:50:23.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:22 smithi100 ceph-mon[107145]: from='client.? 172.21.15.150:0/2910458506' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T09:50:23.263 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-05T09:50:23.263 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-05T09:50:23.677 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T09:50:23.766 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T09:50:24.858 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:24.860+0000 7fba4281a700 1 -- 172.21.15.150:0/254208510 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba3c0fc870 msgr2=0x7fba3c0fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:50:24.858 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:24.860+0000 7fba4281a700 1 --2- 172.21.15.150:0/254208510 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba3c0fc870 0x7fba3c0fcc80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fba2c0048c0 tx=0x7fba2c009e30 comp rx=0 tx=0).stop 2023-12-05T09:50:24.859 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:24.861+0000 7fba4281a700 1 -- 172.21.15.150:0/254208510 shutdown_connections 2023-12-05T09:50:24.859 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:24.861+0000 7fba4281a700 1 --2- 172.21.15.150:0/254208510 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba3c0fc870 0x7fba3c0fcc80 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:50:24.859 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:24.861+0000 7fba4281a700 1 -- 172.21.15.150:0/254208510 >> 172.21.15.150:0/254208510 conn(0x7fba3c0f7f50 msgr2=0x7fba3c0fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:50:24.859 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:24.861+0000 7fba4281a700 1 -- 172.21.15.150:0/254208510 shutdown_connections 2023-12-05T09:50:24.859 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:24.861+0000 7fba4281a700 1 -- 172.21.15.150:0/254208510 wait complete. 2023-12-05T09:50:24.860 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:24.862+0000 7fba4281a700 1 Processor -- start 2023-12-05T09:50:24.861 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:24.862+0000 7fba4281a700 1 -- start start 2023-12-05T09:50:24.861 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:24.862+0000 7fba4281a700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba3c0fc870 0x7fba3c071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:50:24.861 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:24.862+0000 7fba4281a700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba3c06ff90 con 0x7fba3c0fc870 2023-12-05T09:50:24.861 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:24.862+0000 7fba3bfff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba3c0fc870 0x7fba3c071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:50:24.861 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:24.862+0000 7fba3bfff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba3c0fc870 0x7fba3c071b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.150:39452/0 (socket says 172.21.15.150:39452) 2023-12-05T09:50:24.861 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:24.862+0000 7fba3bfff700 1 -- 172.21.15.150:0/3322621294 learned_addr learned my addr 172.21.15.150:0/3322621294 (peer_addr_for_me v2:172.21.15.150:0/0) 2023-12-05T09:50:24.861 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:24.863+0000 7fba3bfff700 1 -- 172.21.15.150:0/3322621294 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba2c005040 con 0x7fba3c0fc870 2023-12-05T09:50:24.861 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:24.863+0000 7fba3bfff700 1 --2- 172.21.15.150:0/3322621294 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba3c0fc870 0x7fba3c071b10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fba2c00b690 tx=0x7fba2c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:50:24.861 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:24.863+0000 7fba38ff9700 1 -- 172.21.15.150:0/3322621294 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fba2c009650 con 0x7fba3c0fc870 2023-12-05T09:50:24.861 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:24.863+0000 7fba38ff9700 1 -- 172.21.15.150:0/3322621294 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fba2c0097b0 con 0x7fba3c0fc870 2023-12-05T09:50:24.862 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:24.863+0000 7fba4281a700 1 -- 172.21.15.150:0/3322621294 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba3c070190 con 0x7fba3c0fc870 2023-12-05T09:50:24.862 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:24.863+0000 7fba38ff9700 1 -- 172.21.15.150:0/3322621294 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fba2c01c5d0 con 0x7fba3c0fc870 2023-12-05T09:50:24.862 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:24.863+0000 7fba4281a700 1 -- 172.21.15.150:0/3322621294 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba3c070680 con 0x7fba3c0fc870 2023-12-05T09:50:24.863 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:24.864+0000 7fba38ff9700 1 -- 172.21.15.150:0/3322621294 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 14) v1 ==== 43352+0+0 (secure 0 0 0) 0x7fba2c0139d0 con 0x7fba3c0fc870 2023-12-05T09:50:24.863 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:24.864+0000 7fba4281a700 1 -- 172.21.15.150:0/3322621294 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba3c106500 con 0x7fba3c0fc870 2023-12-05T09:50:24.863 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:24.865+0000 7fba38ff9700 1 --2- 172.21.15.150:0/3322621294 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7fba24036720 0x7fba24038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:50:24.863 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:24.865+0000 7fba38ff9700 1 -- 172.21.15.150:0/3322621294 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fba2c049aa0 con 0x7fba3c0fc870 2023-12-05T09:50:24.863 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:24.865+0000 7fba3b7fe700 1 -- 172.21.15.150:0/3322621294 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7fba24036720 msgr2=0x7fba24038bd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/2397627746 2023-12-05T09:50:24.863 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:24.865+0000 7fba3b7fe700 1 --2- 172.21.15.150:0/3322621294 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7fba24036720 0x7fba24038bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-05T09:50:24.867 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:24.870+0000 7fba38ff9700 1 -- 172.21.15.150:0/3322621294 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fba2c025400 con 0x7fba3c0fc870 2023-12-05T09:50:25.063 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:25.066+0000 7fba3b7fe700 1 -- 172.21.15.150:0/3322621294 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7fba24036720 msgr2=0x7fba24038bd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/2397627746 2023-12-05T09:50:25.063 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:25.066+0000 7fba3b7fe700 1 --2- 172.21.15.150:0/3322621294 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7fba24036720 0x7fba24038bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-05T09:50:25.128 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:25.131+0000 7fba4281a700 1 -- 172.21.15.150:0/3322621294 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fba3c04bb80 con 0x7fba3c0fc870 2023-12-05T09:50:25.129 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:25.132+0000 7fba38ff9700 1 -- 172.21.15.150:0/3322621294 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7fba2c011b60 con 0x7fba3c0fc870 2023-12-05T09:50:25.129 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:50:25.129 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":1,"fsid":"5b035ce6-9353-11ee-95a2-87774f69a715","modified":"2023-12-05T09:48:31.075826Z","created":"2023-12-05T09:48:31.075826Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi100","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-05T09:50:25.131 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:25.134+0000 7fba4281a700 1 -- 172.21.15.150:0/3322621294 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7fba24036720 msgr2=0x7fba24038bd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-05T09:50:25.131 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:25.134+0000 7fba4281a700 1 --2- 172.21.15.150:0/3322621294 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7fba24036720 0x7fba24038bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:50:25.131 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:25.134+0000 7fba4281a700 1 -- 172.21.15.150:0/3322621294 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba3c0fc870 msgr2=0x7fba3c071b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:50:25.131 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:25.134+0000 7fba4281a700 1 --2- 172.21.15.150:0/3322621294 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba3c0fc870 0x7fba3c071b10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fba2c00b690 tx=0x7fba2c009e30 comp rx=0 tx=0).stop 2023-12-05T09:50:25.131 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:25.134+0000 7fba4281a700 1 -- 172.21.15.150:0/3322621294 shutdown_connections 2023-12-05T09:50:25.132 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:25.134+0000 7fba4281a700 1 --2- 172.21.15.150:0/3322621294 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7fba24036720 0x7fba24038bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:50:25.132 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:25.134+0000 7fba4281a700 1 --2- 172.21.15.150:0/3322621294 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba3c0fc870 0x7fba3c071b10 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:50:25.132 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:25.134+0000 7fba4281a700 1 -- 172.21.15.150:0/3322621294 >> 172.21.15.150:0/3322621294 conn(0x7fba3c0f7f50 msgr2=0x7fba3c0f8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:50:25.132 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:25.134+0000 7fba4281a700 1 -- 172.21.15.150:0/3322621294 shutdown_connections 2023-12-05T09:50:25.132 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:25.134+0000 7fba4281a700 1 -- 172.21.15.150:0/3322621294 wait complete. 2023-12-05T09:50:25.132 INFO:teuthology.orchestra.run.smithi150.stderr:dumped monmap epoch 1 2023-12-05T09:50:25.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:25 smithi100 ceph-mon[107145]: from='client.? 172.21.15.150:0/3322621294' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T09:50:26.492 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-05T09:50:26.493 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-05T09:50:26.901 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T09:50:26.990 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T09:50:28.107 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:28.110+0000 7f22e3d93700 1 -- 172.21.15.150:0/3916913421 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22dc0fc870 msgr2=0x7f22dc0fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:50:28.107 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:28.110+0000 7f22e3d93700 1 --2- 172.21.15.150:0/3916913421 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22dc0fc870 0x7f22dc0fcc80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f22d80048c0 tx=0x7f22d8009e30 comp rx=0 tx=0).stop 2023-12-05T09:50:28.107 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:28.110+0000 7f22e3d93700 1 -- 172.21.15.150:0/3916913421 shutdown_connections 2023-12-05T09:50:28.107 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:28.110+0000 7f22e3d93700 1 --2- 172.21.15.150:0/3916913421 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22dc0fc870 0x7f22dc0fcc80 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:50:28.108 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:28.110+0000 7f22e3d93700 1 -- 172.21.15.150:0/3916913421 >> 172.21.15.150:0/3916913421 conn(0x7f22dc0f7f50 msgr2=0x7f22dc0fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:50:28.108 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:28.110+0000 7f22e3d93700 1 -- 172.21.15.150:0/3916913421 shutdown_connections 2023-12-05T09:50:28.108 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:28.110+0000 7f22e3d93700 1 -- 172.21.15.150:0/3916913421 wait complete. 2023-12-05T09:50:28.109 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:28.111+0000 7f22e3d93700 1 Processor -- start 2023-12-05T09:50:28.109 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:28.111+0000 7f22e3d93700 1 -- start start 2023-12-05T09:50:28.109 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:28.111+0000 7f22e3d93700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22dc0fc870 0x7f22dc10ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:50:28.109 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:28.111+0000 7f22e3d93700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22dc10f280 con 0x7f22dc0fc870 2023-12-05T09:50:28.109 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:28.111+0000 7f22e1b2f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22dc0fc870 0x7f22dc10ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:50:28.109 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:28.111+0000 7f22e1b2f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22dc0fc870 0x7f22dc10ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.150:32768/0 (socket says 172.21.15.150:32768) 2023-12-05T09:50:28.109 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:28.111+0000 7f22e1b2f700 1 -- 172.21.15.150:0/346059606 learned_addr learned my addr 172.21.15.150:0/346059606 (peer_addr_for_me v2:172.21.15.150:0/0) 2023-12-05T09:50:28.109 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:28.112+0000 7f22e1b2f700 1 -- 172.21.15.150:0/346059606 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22d8005040 con 0x7f22dc0fc870 2023-12-05T09:50:28.109 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:28.112+0000 7f22e1b2f700 1 --2- 172.21.15.150:0/346059606 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22dc0fc870 0x7f22dc10ed40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f22d800b690 tx=0x7f22d8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:50:28.110 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:28.112+0000 7f22d27fc700 1 -- 172.21.15.150:0/346059606 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f22d8009650 con 0x7f22dc0fc870 2023-12-05T09:50:28.110 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:28.112+0000 7f22d27fc700 1 -- 172.21.15.150:0/346059606 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f22d80097b0 con 0x7f22dc0fc870 2023-12-05T09:50:28.110 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:28.112+0000 7f22e3d93700 1 -- 172.21.15.150:0/346059606 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22dc10f480 con 0x7f22dc0fc870 2023-12-05T09:50:28.111 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:28.112+0000 7f22d27fc700 1 -- 172.21.15.150:0/346059606 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f22d801c5d0 con 0x7f22dc0fc870 2023-12-05T09:50:28.111 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:28.112+0000 7f22e3d93700 1 -- 172.21.15.150:0/346059606 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22dc10ffe0 con 0x7f22dc0fc870 2023-12-05T09:50:28.111 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:28.113+0000 7f22d27fc700 1 -- 172.21.15.150:0/346059606 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 14) v1 ==== 43352+0+0 (secure 0 0 0) 0x7f22d8013420 con 0x7f22dc0fc870 2023-12-05T09:50:28.111 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:28.113+0000 7f22e3d93700 1 -- 172.21.15.150:0/346059606 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22dc04bb80 con 0x7f22dc0fc870 2023-12-05T09:50:28.111 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:28.114+0000 7f22d27fc700 1 --2- 172.21.15.150:0/346059606 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f22c8036720 0x7f22c8038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:50:28.112 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:28.114+0000 7f22d27fc700 1 -- 172.21.15.150:0/346059606 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f22d8049a30 con 0x7f22dc0fc870 2023-12-05T09:50:28.112 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:28.114+0000 7f22e132e700 1 -- 172.21.15.150:0/346059606 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f22c8036720 msgr2=0x7f22c8038bd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/2397627746 2023-12-05T09:50:28.112 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:28.114+0000 7f22e132e700 1 --2- 172.21.15.150:0/346059606 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f22c8036720 0x7f22c8038bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-05T09:50:28.115 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:28.118+0000 7f22d27fc700 1 -- 172.21.15.150:0/346059606 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f22d8025400 con 0x7f22dc0fc870 2023-12-05T09:50:28.312 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:28.315+0000 7f22e132e700 1 -- 172.21.15.150:0/346059606 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f22c8036720 msgr2=0x7f22c8038bd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/2397627746 2023-12-05T09:50:28.312 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:28.315+0000 7f22e132e700 1 --2- 172.21.15.150:0/346059606 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f22c8036720 0x7f22c8038bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-05T09:50:28.384 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:28.387+0000 7f22e3d93700 1 -- 172.21.15.150:0/346059606 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f22dc110e60 con 0x7f22dc0fc870 2023-12-05T09:50:28.385 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:28.388+0000 7f22d27fc700 1 -- 172.21.15.150:0/346059606 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f22d8011370 con 0x7f22dc0fc870 2023-12-05T09:50:28.385 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:50:28.385 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":1,"fsid":"5b035ce6-9353-11ee-95a2-87774f69a715","modified":"2023-12-05T09:48:31.075826Z","created":"2023-12-05T09:48:31.075826Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi100","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-05T09:50:28.387 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:28.390+0000 7f22e3d93700 1 -- 172.21.15.150:0/346059606 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f22c8036720 msgr2=0x7f22c8038bd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-05T09:50:28.387 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:28.390+0000 7f22e3d93700 1 --2- 172.21.15.150:0/346059606 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f22c8036720 0x7f22c8038bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:50:28.387 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:28.390+0000 7f22e3d93700 1 -- 172.21.15.150:0/346059606 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22dc0fc870 msgr2=0x7f22dc10ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:50:28.387 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:28.390+0000 7f22e3d93700 1 --2- 172.21.15.150:0/346059606 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22dc0fc870 0x7f22dc10ed40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f22d800b690 tx=0x7f22d8009e30 comp rx=0 tx=0).stop 2023-12-05T09:50:28.387 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:28.390+0000 7f22e3d93700 1 -- 172.21.15.150:0/346059606 shutdown_connections 2023-12-05T09:50:28.387 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:28.390+0000 7f22e3d93700 1 --2- 172.21.15.150:0/346059606 >> [v2:172.21.15.100:6800/2397627746,v1:172.21.15.100:6801/2397627746] conn(0x7f22c8036720 0x7f22c8038bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:50:28.387 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:28.390+0000 7f22e3d93700 1 --2- 172.21.15.150:0/346059606 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22dc0fc870 0x7f22dc10ed40 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:50:28.388 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:28.390+0000 7f22e3d93700 1 -- 172.21.15.150:0/346059606 >> 172.21.15.150:0/346059606 conn(0x7f22dc0f7f50 msgr2=0x7f22dc0f8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:50:28.388 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:28.390+0000 7f22e3d93700 1 -- 172.21.15.150:0/346059606 shutdown_connections 2023-12-05T09:50:28.388 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:28.390+0000 7f22e3d93700 1 -- 172.21.15.150:0/346059606 wait complete. 2023-12-05T09:50:28.388 INFO:teuthology.orchestra.run.smithi150.stderr:dumped monmap epoch 1 2023-12-05T09:50:29.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:29 smithi100 ceph-mon[107145]: from='client.? 172.21.15.150:0/346059606' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T09:50:29.791 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-05T09:50:29.791 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-05T09:50:30.198 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T09:50:30.291 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T09:50:30.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:30 smithi100 ceph-mon[107145]: Active manager daemon smithi100.ehmuhg restarted 2023-12-05T09:50:30.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:30 smithi100 ceph-mon[107145]: Activating manager daemon smithi100.ehmuhg 2023-12-05T09:50:30.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:30 smithi100 ceph-mon[107145]: osdmap e5: 0 total, 0 up, 0 in 2023-12-05T09:50:30.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:30 smithi100 ceph-mon[107145]: mgrmap e15: smithi100.ehmuhg(active, starting, since 0.00329425s) 2023-12-05T09:50:30.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:30 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mon metadata", "id": "smithi100"}]: dispatch 2023-12-05T09:50:30.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:30 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mgr metadata", "who": "smithi100.ehmuhg", "id": "smithi100.ehmuhg"}]: dispatch 2023-12-05T09:50:30.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:30 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-05T09:50:30.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:30 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-05T09:50:30.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:30 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-05T09:50:30.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:30 smithi100 ceph-mon[107145]: Manager daemon smithi100.ehmuhg is now available 2023-12-05T09:50:30.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:30 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:50:30.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:30 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:50:30.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:30 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:30.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:30 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:50:30.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:30 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi100.ehmuhg/mirror_snapshot_schedule"}]: dispatch 2023-12-05T09:50:30.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:30 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi100.ehmuhg/trash_purge_schedule"}]: dispatch 2023-12-05T09:50:31.455 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:31.457+0000 7f6ecf0e3700 1 -- 172.21.15.150:0/4042417378 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ec80fc870 msgr2=0x7f6ec80fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:50:31.455 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:31.457+0000 7f6ecf0e3700 1 --2- 172.21.15.150:0/4042417378 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ec80fc870 0x7f6ec80fcc80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc0048c0 tx=0x7f6ebc009e30 comp rx=0 tx=0).stop 2023-12-05T09:50:31.455 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:31.457+0000 7f6ecf0e3700 1 -- 172.21.15.150:0/4042417378 shutdown_connections 2023-12-05T09:50:31.455 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:31.457+0000 7f6ecf0e3700 1 --2- 172.21.15.150:0/4042417378 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ec80fc870 0x7f6ec80fcc80 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:50:31.456 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:31.457+0000 7f6ecf0e3700 1 -- 172.21.15.150:0/4042417378 >> 172.21.15.150:0/4042417378 conn(0x7f6ec80f7f50 msgr2=0x7f6ec80fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:50:31.456 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:31.457+0000 7f6ecf0e3700 1 -- 172.21.15.150:0/4042417378 shutdown_connections 2023-12-05T09:50:31.456 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:31.457+0000 7f6ecf0e3700 1 -- 172.21.15.150:0/4042417378 wait complete. 2023-12-05T09:50:31.456 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:31.458+0000 7f6ecf0e3700 1 Processor -- start 2023-12-05T09:50:31.456 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:31.458+0000 7f6ecf0e3700 1 -- start start 2023-12-05T09:50:31.457 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:31.459+0000 7f6ecf0e3700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ec80fc870 0x7f6ec810ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:50:31.457 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:31.459+0000 7f6ecf0e3700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec810f270 con 0x7f6ec80fc870 2023-12-05T09:50:31.457 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:31.459+0000 7f6ecce7f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ec80fc870 0x7f6ec810ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:50:31.458 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:31.459+0000 7f6ecce7f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ec80fc870 0x7f6ec810ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.150:32792/0 (socket says 172.21.15.150:32792) 2023-12-05T09:50:31.458 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:31.459+0000 7f6ecce7f700 1 -- 172.21.15.150:0/656375900 learned_addr learned my addr 172.21.15.150:0/656375900 (peer_addr_for_me v2:172.21.15.150:0/0) 2023-12-05T09:50:31.458 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:31.459+0000 7f6ecce7f700 1 -- 172.21.15.150:0/656375900 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ebc005040 con 0x7f6ec80fc870 2023-12-05T09:50:31.458 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:31.460+0000 7f6ecce7f700 1 --2- 172.21.15.150:0/656375900 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ec80fc870 0x7f6ec810ed30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc00b690 tx=0x7f6ebc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:50:31.458 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:31.460+0000 7f6ec57fa700 1 -- 172.21.15.150:0/656375900 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6ebc009650 con 0x7f6ec80fc870 2023-12-05T09:50:31.458 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:31.460+0000 7f6ec57fa700 1 -- 172.21.15.150:0/656375900 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6ebc0097b0 con 0x7f6ec80fc870 2023-12-05T09:50:31.459 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:31.460+0000 7f6ecf0e3700 1 -- 172.21.15.150:0/656375900 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ec810f470 con 0x7f6ec80fc870 2023-12-05T09:50:31.459 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:31.460+0000 7f6ec57fa700 1 -- 172.21.15.150:0/656375900 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6ebc01c5d0 con 0x7f6ec80fc870 2023-12-05T09:50:31.459 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:31.460+0000 7f6ecf0e3700 1 -- 172.21.15.150:0/656375900 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ec810ffd0 con 0x7f6ec80fc870 2023-12-05T09:50:31.459 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:31.461+0000 7f6ecf0e3700 1 -- 172.21.15.150:0/656375900 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ec804bb80 con 0x7f6ec80fc870 2023-12-05T09:50:31.461 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:31.463+0000 7f6ec57fa700 1 -- 172.21.15.150:0/656375900 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) v1 ==== 43202+0+0 (secure 0 0 0) 0x7f6ebc0139d0 con 0x7f6ec80fc870 2023-12-05T09:50:31.461 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:31.463+0000 7f6ec57fa700 1 --2- 172.21.15.150:0/656375900 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f6eb80365b0 0x7f6eb8038a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:50:31.461 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:31.463+0000 7f6ec57fa700 1 -- 172.21.15.150:0/656375900 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f6ebc04a2f0 con 0x7f6ec80fc870 2023-12-05T09:50:31.462 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:31.464+0000 7f6ec7fff700 1 --2- 172.21.15.150:0/656375900 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f6eb80365b0 0x7f6eb8038a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:50:31.462 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:31.464+0000 7f6ec7fff700 1 --2- 172.21.15.150:0/656375900 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f6eb80365b0 0x7f6eb8038a60 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6eb4009990 tx=0x7f6eb4006e40 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:50:31.467 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:31.469+0000 7f6ec57fa700 1 -- 172.21.15.150:0/656375900 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f6ebc0246e0 con 0x7f6ec80fc870 2023-12-05T09:50:31.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:31 smithi100 ceph-mon[107145]: [05/Dec/2023:09:50:30] ENGINE Bus STARTING 2023-12-05T09:50:31.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:31 smithi100 ceph-mon[107145]: [05/Dec/2023:09:50:30] ENGINE Serving on https://172.21.15.100:7150 2023-12-05T09:50:31.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:31 smithi100 ceph-mon[107145]: [05/Dec/2023:09:50:30] ENGINE Bus STARTED 2023-12-05T09:50:31.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:31 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:31.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:31 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:31.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:31 smithi100 ceph-mon[107145]: mgrmap e16: smithi100.ehmuhg(active, since 1.00676s) 2023-12-05T09:50:31.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:31 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:31.748 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:31.750+0000 7f6ecf0e3700 1 -- 172.21.15.150:0/656375900 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f6ec8110160 con 0x7f6ec80fc870 2023-12-05T09:50:31.749 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:31.750+0000 7f6ec57fa700 1 -- 172.21.15.150:0/656375900 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f6ebc0248f0 con 0x7f6ec80fc870 2023-12-05T09:50:31.749 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:50:31.749 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":1,"fsid":"5b035ce6-9353-11ee-95a2-87774f69a715","modified":"2023-12-05T09:48:31.075826Z","created":"2023-12-05T09:48:31.075826Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi100","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-05T09:50:31.751 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:31.753+0000 7f6ecf0e3700 1 -- 172.21.15.150:0/656375900 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f6eb80365b0 msgr2=0x7f6eb8038a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:50:31.751 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:31.753+0000 7f6ecf0e3700 1 --2- 172.21.15.150:0/656375900 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f6eb80365b0 0x7f6eb8038a60 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6eb4009990 tx=0x7f6eb4006e40 comp rx=0 tx=0).stop 2023-12-05T09:50:31.751 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:31.753+0000 7f6ecf0e3700 1 -- 172.21.15.150:0/656375900 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ec80fc870 msgr2=0x7f6ec810ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:50:31.751 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:31.753+0000 7f6ecf0e3700 1 --2- 172.21.15.150:0/656375900 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ec80fc870 0x7f6ec810ed30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc00b690 tx=0x7f6ebc009e30 comp rx=0 tx=0).stop 2023-12-05T09:50:31.751 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:31.753+0000 7f6ecf0e3700 1 -- 172.21.15.150:0/656375900 shutdown_connections 2023-12-05T09:50:31.751 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:31.753+0000 7f6ecf0e3700 1 --2- 172.21.15.150:0/656375900 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f6eb80365b0 0x7f6eb8038a60 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:50:31.752 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:31.753+0000 7f6ecf0e3700 1 --2- 172.21.15.150:0/656375900 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ec80fc870 0x7f6ec810ed30 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:50:31.752 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:31.753+0000 7f6ecf0e3700 1 -- 172.21.15.150:0/656375900 >> 172.21.15.150:0/656375900 conn(0x7f6ec80f7f50 msgr2=0x7f6ec806fe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:50:31.752 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:31.753+0000 7f6ecf0e3700 1 -- 172.21.15.150:0/656375900 shutdown_connections 2023-12-05T09:50:31.752 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:31.753+0000 7f6ecf0e3700 1 -- 172.21.15.150:0/656375900 wait complete. 2023-12-05T09:50:31.752 INFO:teuthology.orchestra.run.smithi150.stderr:dumped monmap epoch 1 2023-12-05T09:50:32.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:32 smithi100 ceph-mon[107145]: from='client.? 172.21.15.150:0/656375900' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T09:50:33.109 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-05T09:50:33.109 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-05T09:50:33.792 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T09:50:33.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:33 smithi100 ceph-mon[107145]: mgrmap e17: smithi100.ehmuhg(active, since 2s) 2023-12-05T09:50:33.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:33 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:34.057 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T09:50:35.362 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:35.363+0000 7f63dd2d8700 1 -- 172.21.15.150:0/4211898568 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63d8071bc0 msgr2=0x7f63d8070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:50:35.363 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:35.363+0000 7f63dd2d8700 1 --2- 172.21.15.150:0/4211898568 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63d8071bc0 0x7f63d8070030 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f63c80048c0 tx=0x7f63c8009e30 comp rx=0 tx=0).stop 2023-12-05T09:50:35.363 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:35.363+0000 7f63dd2d8700 1 -- 172.21.15.150:0/4211898568 shutdown_connections 2023-12-05T09:50:35.363 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:35.363+0000 7f63dd2d8700 1 --2- 172.21.15.150:0/4211898568 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63d8071bc0 0x7f63d8070030 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:50:35.363 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:35.363+0000 7f63dd2d8700 1 -- 172.21.15.150:0/4211898568 >> 172.21.15.150:0/4211898568 conn(0x7f63d80f7f50 msgr2=0x7f63d80fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:50:35.363 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:35.364+0000 7f63dd2d8700 1 -- 172.21.15.150:0/4211898568 shutdown_connections 2023-12-05T09:50:35.363 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:35.364+0000 7f63dd2d8700 1 -- 172.21.15.150:0/4211898568 wait complete. 2023-12-05T09:50:35.363 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:35.364+0000 7f63dd2d8700 1 Processor -- start 2023-12-05T09:50:35.363 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:35.364+0000 7f63dd2d8700 1 -- start start 2023-12-05T09:50:35.364 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:35.365+0000 7f63dd2d8700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63d8071bc0 0x7f63d8113040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:50:35.364 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:35.365+0000 7f63dd2d8700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d8113580 con 0x7f63d8071bc0 2023-12-05T09:50:35.364 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:35.365+0000 7f63d6ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63d8071bc0 0x7f63d8113040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:50:35.364 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:35.365+0000 7f63d6ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63d8071bc0 0x7f63d8113040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.150:32800/0 (socket says 172.21.15.150:32800) 2023-12-05T09:50:35.364 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:35.365+0000 7f63d6ffd700 1 -- 172.21.15.150:0/2656870663 learned_addr learned my addr 172.21.15.150:0/2656870663 (peer_addr_for_me v2:172.21.15.150:0/0) 2023-12-05T09:50:35.364 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:35.366+0000 7f63d6ffd700 1 -- 172.21.15.150:0/2656870663 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c8005040 con 0x7f63d8071bc0 2023-12-05T09:50:35.364 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:35.366+0000 7f63d6ffd700 1 --2- 172.21.15.150:0/2656870663 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63d8071bc0 0x7f63d8113040 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f63c8009040 tx=0x7f63c8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:50:35.365 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:35.366+0000 7f63bf7fe700 1 -- 172.21.15.150:0/2656870663 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f63c8009620 con 0x7f63d8071bc0 2023-12-05T09:50:35.365 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:35.366+0000 7f63bf7fe700 1 -- 172.21.15.150:0/2656870663 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f63c8009780 con 0x7f63d8071bc0 2023-12-05T09:50:35.365 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:35.366+0000 7f63bf7fe700 1 -- 172.21.15.150:0/2656870663 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f63c801c5b0 con 0x7f63d8071bc0 2023-12-05T09:50:35.365 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:35.366+0000 7f63dd2d8700 1 -- 172.21.15.150:0/2656870663 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63d8113780 con 0x7f63d8071bc0 2023-12-05T09:50:35.365 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:35.366+0000 7f63dd2d8700 1 -- 172.21.15.150:0/2656870663 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63d8114420 con 0x7f63d8071bc0 2023-12-05T09:50:35.365 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:35.367+0000 7f63dd2d8700 1 -- 172.21.15.150:0/2656870663 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63d805f270 con 0x7f63d8071bc0 2023-12-05T09:50:35.366 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:35.368+0000 7f63bf7fe700 1 -- 172.21.15.150:0/2656870663 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) v1 ==== 43396+0+0 (secure 0 0 0) 0x7f63c8013a60 con 0x7f63d8071bc0 2023-12-05T09:50:35.367 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:35.369+0000 7f63bf7fe700 1 --2- 172.21.15.150:0/2656870663 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f63c0036810 0x7f63c0038cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:50:35.367 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:35.369+0000 7f63bf7fe700 1 -- 172.21.15.150:0/2656870663 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f63c8049cd0 con 0x7f63d8071bc0 2023-12-05T09:50:35.367 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:35.369+0000 7f63d67fc700 1 --2- 172.21.15.150:0/2656870663 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f63c0036810 0x7f63c0038cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:50:35.367 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:35.370+0000 7f63d67fc700 1 --2- 172.21.15.150:0/2656870663 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f63c0036810 0x7f63c0038cc0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f63cc009990 tx=0x7f63cc006e40 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:50:35.371 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:35.373+0000 7f63bf7fe700 1 -- 172.21.15.150:0/2656870663 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f63c8023310 con 0x7f63d8071bc0 2023-12-05T09:50:35.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:35 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:35.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:35 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:35.654 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:35.656+0000 7f63dd2d8700 1 -- 172.21.15.150:0/2656870663 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f63d8114f40 con 0x7f63d8071bc0 2023-12-05T09:50:35.655 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:35.657+0000 7f63bf7fe700 1 -- 172.21.15.150:0/2656870663 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f63c8011b60 con 0x7f63d8071bc0 2023-12-05T09:50:35.655 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:50:35.655 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":1,"fsid":"5b035ce6-9353-11ee-95a2-87774f69a715","modified":"2023-12-05T09:48:31.075826Z","created":"2023-12-05T09:48:31.075826Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi100","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-05T09:50:35.658 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:35.659+0000 7f63dd2d8700 1 -- 172.21.15.150:0/2656870663 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f63c0036810 msgr2=0x7f63c0038cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:50:35.658 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:35.659+0000 7f63dd2d8700 1 --2- 172.21.15.150:0/2656870663 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f63c0036810 0x7f63c0038cc0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f63cc009990 tx=0x7f63cc006e40 comp rx=0 tx=0).stop 2023-12-05T09:50:35.658 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:35.659+0000 7f63dd2d8700 1 -- 172.21.15.150:0/2656870663 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63d8071bc0 msgr2=0x7f63d8113040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:50:35.658 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:35.659+0000 7f63dd2d8700 1 --2- 172.21.15.150:0/2656870663 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63d8071bc0 0x7f63d8113040 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f63c8009040 tx=0x7f63c8009e30 comp rx=0 tx=0).stop 2023-12-05T09:50:35.658 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:35.659+0000 7f63dd2d8700 1 -- 172.21.15.150:0/2656870663 shutdown_connections 2023-12-05T09:50:35.658 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:35.659+0000 7f63dd2d8700 1 --2- 172.21.15.150:0/2656870663 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f63c0036810 0x7f63c0038cc0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:50:35.658 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:35.659+0000 7f63dd2d8700 1 --2- 172.21.15.150:0/2656870663 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63d8071bc0 0x7f63d8113040 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:50:35.658 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:35.659+0000 7f63dd2d8700 1 -- 172.21.15.150:0/2656870663 >> 172.21.15.150:0/2656870663 conn(0x7f63d80f7f50 msgr2=0x7f63d80f8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:50:35.658 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:35.660+0000 7f63dd2d8700 1 -- 172.21.15.150:0/2656870663 shutdown_connections 2023-12-05T09:50:35.658 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:35.660+0000 7f63dd2d8700 1 -- 172.21.15.150:0/2656870663 wait complete. 2023-12-05T09:50:35.659 INFO:teuthology.orchestra.run.smithi150.stderr:dumped monmap epoch 1 2023-12-05T09:50:36.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:36 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:36.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:36 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:36.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:36 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config rm", "who": "osd/host:smithi100", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:50:36.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:36 smithi100 ceph-mon[107145]: from='client.? 172.21.15.150:0/2656870663' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T09:50:37.113 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-05T09:50:37.114 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-05T09:50:37.549 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-05T09:50:37.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:37 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:37.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:37 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:37.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:37 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:37.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:37 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:37.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:37 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config rm", "who": "osd/host:smithi150", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:50:37.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:37 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:50:37.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:37 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:50:37.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:37 smithi100 ceph-mon[107145]: Updating smithi100:/etc/ceph/ceph.conf 2023-12-05T09:50:37.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:37 smithi100 ceph-mon[107145]: Updating smithi150:/etc/ceph/ceph.conf 2023-12-05T09:50:37.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:37 smithi100 ceph-mon[107145]: Updating smithi100:/var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-05T09:50:37.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:37 smithi100 ceph-mon[107145]: Updating smithi150:/var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-05T09:50:38.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:38 smithi100 ceph-mon[107145]: Updating smithi100:/etc/ceph/ceph.client.admin.keyring 2023-12-05T09:50:38.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:38 smithi100 ceph-mon[107145]: Updating smithi150:/etc/ceph/ceph.client.admin.keyring 2023-12-05T09:50:38.883 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:38.885+0000 7f32cdc95700 1 -- 172.21.15.150:0/949028196 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32c806ffe0 msgr2=0x7f32c80703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:50:38.883 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:38.885+0000 7f32cdc95700 1 --2- 172.21.15.150:0/949028196 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32c806ffe0 0x7f32c80703b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f32b80048c0 tx=0x7f32b8009e30 comp rx=0 tx=0).stop 2023-12-05T09:50:38.883 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:38.885+0000 7f32cdc95700 1 -- 172.21.15.150:0/949028196 shutdown_connections 2023-12-05T09:50:38.883 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:38.885+0000 7f32cdc95700 1 --2- 172.21.15.150:0/949028196 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32c806ffe0 0x7f32c80703b0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:50:38.884 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:38.885+0000 7f32cdc95700 1 -- 172.21.15.150:0/949028196 >> 172.21.15.150:0/949028196 conn(0x7f32c80f8410 msgr2=0x7f32c80fa820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:50:38.884 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:38.885+0000 7f32cdc95700 1 -- 172.21.15.150:0/949028196 shutdown_connections 2023-12-05T09:50:38.884 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:38.885+0000 7f32cdc95700 1 -- 172.21.15.150:0/949028196 wait complete. 2023-12-05T09:50:38.884 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:38.886+0000 7f32cdc95700 1 Processor -- start 2023-12-05T09:50:38.884 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:38.886+0000 7f32cdc95700 1 -- start start 2023-12-05T09:50:38.885 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:38.886+0000 7f32cdc95700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32c806ffe0 0x7f32c8114da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:50:38.885 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:38.886+0000 7f32cdc95700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c81152e0 con 0x7f32c806ffe0 2023-12-05T09:50:38.885 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:38.886+0000 7f32c77fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32c806ffe0 0x7f32c8114da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:50:38.885 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:38.887+0000 7f32c77fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32c806ffe0 0x7f32c8114da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.150:46440/0 (socket says 172.21.15.150:46440) 2023-12-05T09:50:38.885 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:38.887+0000 7f32c77fe700 1 -- 172.21.15.150:0/3177854910 learned_addr learned my addr 172.21.15.150:0/3177854910 (peer_addr_for_me v2:172.21.15.150:0/0) 2023-12-05T09:50:38.885 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:38.887+0000 7f32c77fe700 1 -- 172.21.15.150:0/3177854910 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b8005040 con 0x7f32c806ffe0 2023-12-05T09:50:38.886 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:38.887+0000 7f32c77fe700 1 --2- 172.21.15.150:0/3177854910 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32c806ffe0 0x7f32c8114da0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f32b8009040 tx=0x7f32b8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:50:38.886 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:38.887+0000 7f32affff700 1 -- 172.21.15.150:0/3177854910 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f32b8004e60 con 0x7f32c806ffe0 2023-12-05T09:50:38.886 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:38.887+0000 7f32affff700 1 -- 172.21.15.150:0/3177854910 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f32b8009650 con 0x7f32c806ffe0 2023-12-05T09:50:38.886 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:38.887+0000 7f32cdc95700 1 -- 172.21.15.150:0/3177854910 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32c81154e0 con 0x7f32c806ffe0 2023-12-05T09:50:38.886 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:38.887+0000 7f32affff700 1 -- 172.21.15.150:0/3177854910 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f32b801c3f0 con 0x7f32c806ffe0 2023-12-05T09:50:38.886 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:38.887+0000 7f32cdc95700 1 -- 172.21.15.150:0/3177854910 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32c8115950 con 0x7f32c806ffe0 2023-12-05T09:50:38.886 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:38.888+0000 7f32affff700 1 -- 172.21.15.150:0/3177854910 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) v1 ==== 43396+0+0 (secure 0 0 0) 0x7f32b801c6b0 con 0x7f32c806ffe0 2023-12-05T09:50:38.886 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:38.888+0000 7f32cdc95700 1 -- 172.21.15.150:0/3177854910 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32c805f270 con 0x7f32c806ffe0 2023-12-05T09:50:38.887 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:38.889+0000 7f32affff700 1 --2- 172.21.15.150:0/3177854910 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f32b00367c0 0x7f32b0038c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:50:38.887 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:38.889+0000 7f32affff700 1 -- 172.21.15.150:0/3177854910 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f32b8049a50 con 0x7f32c806ffe0 2023-12-05T09:50:38.887 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:38.889+0000 7f32c6ffd700 1 --2- 172.21.15.150:0/3177854910 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f32b00367c0 0x7f32b0038c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:50:38.888 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:38.890+0000 7f32c6ffd700 1 --2- 172.21.15.150:0/3177854910 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f32b00367c0 0x7f32b0038c70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f32bc009990 tx=0x7f32bc006e40 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:50:38.892 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:38.894+0000 7f32affff700 1 -- 172.21.15.150:0/3177854910 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f32b8025400 con 0x7f32c806ffe0 2023-12-05T09:50:39.206 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:39.207+0000 7f32cdc95700 1 -- 172.21.15.150:0/3177854910 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f32c8108c80 con 0x7f32c806ffe0 2023-12-05T09:50:39.206 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:39.208+0000 7f32affff700 1 -- 172.21.15.150:0/3177854910 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f32b8011b60 con 0x7f32c806ffe0 2023-12-05T09:50:39.206 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:50:39.207 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":1,"fsid":"5b035ce6-9353-11ee-95a2-87774f69a715","modified":"2023-12-05T09:48:31.075826Z","created":"2023-12-05T09:48:31.075826Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi100","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-05T09:50:39.209 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:39.210+0000 7f32cdc95700 1 -- 172.21.15.150:0/3177854910 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f32b00367c0 msgr2=0x7f32b0038c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:50:39.209 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:39.210+0000 7f32cdc95700 1 --2- 172.21.15.150:0/3177854910 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f32b00367c0 0x7f32b0038c70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f32bc009990 tx=0x7f32bc006e40 comp rx=0 tx=0).stop 2023-12-05T09:50:39.209 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:39.210+0000 7f32cdc95700 1 -- 172.21.15.150:0/3177854910 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32c806ffe0 msgr2=0x7f32c8114da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:50:39.209 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:39.210+0000 7f32cdc95700 1 --2- 172.21.15.150:0/3177854910 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32c806ffe0 0x7f32c8114da0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f32b8009040 tx=0x7f32b8009e30 comp rx=0 tx=0).stop 2023-12-05T09:50:39.209 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:39.210+0000 7f32cdc95700 1 -- 172.21.15.150:0/3177854910 shutdown_connections 2023-12-05T09:50:39.209 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:39.210+0000 7f32cdc95700 1 --2- 172.21.15.150:0/3177854910 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f32b00367c0 0x7f32b0038c70 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:50:39.210 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:39.210+0000 7f32cdc95700 1 --2- 172.21.15.150:0/3177854910 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32c806ffe0 0x7f32c8114da0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:50:39.210 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:39.210+0000 7f32cdc95700 1 -- 172.21.15.150:0/3177854910 >> 172.21.15.150:0/3177854910 conn(0x7f32c80f8410 msgr2=0x7f32c81033d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:50:39.210 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:39.211+0000 7f32cdc95700 1 -- 172.21.15.150:0/3177854910 shutdown_connections 2023-12-05T09:50:39.210 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:39.211+0000 7f32cdc95700 1 -- 172.21.15.150:0/3177854910 wait complete. 2023-12-05T09:50:39.210 INFO:teuthology.orchestra.run.smithi150.stderr:dumped monmap epoch 1 2023-12-05T09:50:39.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:39 smithi100 ceph-mon[107145]: Updating smithi100:/var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-05T09:50:39.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:39 smithi100 ceph-mon[107145]: Updating smithi150:/var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-05T09:50:39.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:39 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:39.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:39 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:39.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:39 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:39.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:39 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:39.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:39 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:39.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:39 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi150", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-05T09:50:39.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:39 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi150", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2023-12-05T09:50:39.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:39 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:50:39.897 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:39 smithi100 ceph-mon[107145]: Deploying daemon crash.smithi150 on smithi150 2023-12-05T09:50:39.897 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:39 smithi100 ceph-mon[107145]: from='client.? 172.21.15.150:0/3177854910' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T09:50:40.852 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-05T09:50:40.852 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-05T09:50:41.291 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-05T09:50:42.518 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:42.519+0000 7f3b1d89d700 1 -- 172.21.15.150:0/3336232963 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b1806ffe0 msgr2=0x7f3b180703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:50:42.518 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:42.519+0000 7f3b1d89d700 1 --2- 172.21.15.150:0/3336232963 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b1806ffe0 0x7f3b180703b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3b080048c0 tx=0x7f3b08009e30 comp rx=0 tx=0).stop 2023-12-05T09:50:42.518 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:42.520+0000 7f3b1d89d700 1 -- 172.21.15.150:0/3336232963 shutdown_connections 2023-12-05T09:50:42.518 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:42.520+0000 7f3b1d89d700 1 --2- 172.21.15.150:0/3336232963 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b1806ffe0 0x7f3b180703b0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:50:42.518 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:42.520+0000 7f3b1d89d700 1 -- 172.21.15.150:0/3336232963 >> 172.21.15.150:0/3336232963 conn(0x7f3b180f83f0 msgr2=0x7f3b180fa800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:50:42.518 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:42.520+0000 7f3b1d89d700 1 -- 172.21.15.150:0/3336232963 shutdown_connections 2023-12-05T09:50:42.519 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:42.520+0000 7f3b1d89d700 1 -- 172.21.15.150:0/3336232963 wait complete. 2023-12-05T09:50:42.519 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:42.521+0000 7f3b1d89d700 1 Processor -- start 2023-12-05T09:50:42.519 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:42.521+0000 7f3b1d89d700 1 -- start start 2023-12-05T09:50:42.519 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:42.521+0000 7f3b1d89d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b1806ffe0 0x7f3b18114e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:50:42.519 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:42.521+0000 7f3b1d89d700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b18115350 con 0x7f3b1806ffe0 2023-12-05T09:50:42.520 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:42.522+0000 7f3b16ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b1806ffe0 0x7f3b18114e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:50:42.520 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:42.522+0000 7f3b16ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b1806ffe0 0x7f3b18114e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.150:46464/0 (socket says 172.21.15.150:46464) 2023-12-05T09:50:42.520 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:42.522+0000 7f3b16ffd700 1 -- 172.21.15.150:0/1794480747 learned_addr learned my addr 172.21.15.150:0/1794480747 (peer_addr_for_me v2:172.21.15.150:0/0) 2023-12-05T09:50:42.520 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:42.522+0000 7f3b16ffd700 1 -- 172.21.15.150:0/1794480747 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b08005040 con 0x7f3b1806ffe0 2023-12-05T09:50:42.521 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:42.522+0000 7f3b16ffd700 1 --2- 172.21.15.150:0/1794480747 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b1806ffe0 0x7f3b18114e10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3b08009040 tx=0x7f3b08009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:50:42.521 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:42.523+0000 7f3aff7fe700 1 -- 172.21.15.150:0/1794480747 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3b08004e60 con 0x7f3b1806ffe0 2023-12-05T09:50:42.521 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:42.523+0000 7f3aff7fe700 1 -- 172.21.15.150:0/1794480747 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3b08009650 con 0x7f3b1806ffe0 2023-12-05T09:50:42.521 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:42.523+0000 7f3b1d89d700 1 -- 172.21.15.150:0/1794480747 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b18115550 con 0x7f3b1806ffe0 2023-12-05T09:50:42.521 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:42.523+0000 7f3aff7fe700 1 -- 172.21.15.150:0/1794480747 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3b0801c3f0 con 0x7f3b1806ffe0 2023-12-05T09:50:42.521 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:42.523+0000 7f3b1d89d700 1 -- 172.21.15.150:0/1794480747 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b181159c0 con 0x7f3b1806ffe0 2023-12-05T09:50:42.522 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:42.524+0000 7f3b1d89d700 1 -- 172.21.15.150:0/1794480747 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b1805f270 con 0x7f3b1806ffe0 2023-12-05T09:50:42.522 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:42.524+0000 7f3aff7fe700 1 -- 172.21.15.150:0/1794480747 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) v1 ==== 43396+0+0 (secure 0 0 0) 0x7f3b080097c0 con 0x7f3b1806ffe0 2023-12-05T09:50:42.522 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:42.524+0000 7f3aff7fe700 1 --2- 172.21.15.150:0/1794480747 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f3b00036810 0x7f3b00038cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:50:42.522 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:42.524+0000 7f3aff7fe700 1 -- 172.21.15.150:0/1794480747 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f3b08049a50 con 0x7f3b1806ffe0 2023-12-05T09:50:42.523 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:42.525+0000 7f3b167fc700 1 --2- 172.21.15.150:0/1794480747 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f3b00036810 0x7f3b00038cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:50:42.523 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:42.525+0000 7f3b167fc700 1 --2- 172.21.15.150:0/1794480747 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f3b00036810 0x7f3b00038cc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c009990 tx=0x7f3b0c006e40 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:50:42.527 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:42.529+0000 7f3aff7fe700 1 -- 172.21.15.150:0/1794480747 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f3b08011940 con 0x7f3b1806ffe0 2023-12-05T09:50:42.804 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:42.805+0000 7f3b1d89d700 1 -- 172.21.15.150:0/1794480747 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f3b18108c80 con 0x7f3b1806ffe0 2023-12-05T09:50:42.804 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:42.806+0000 7f3aff7fe700 1 -- 172.21.15.150:0/1794480747 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f3b08011370 con 0x7f3b1806ffe0 2023-12-05T09:50:42.805 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:50:42.805 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":1,"fsid":"5b035ce6-9353-11ee-95a2-87774f69a715","modified":"2023-12-05T09:48:31.075826Z","created":"2023-12-05T09:48:31.075826Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi100","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-05T09:50:42.807 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:42.809+0000 7f3b1d89d700 1 -- 172.21.15.150:0/1794480747 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f3b00036810 msgr2=0x7f3b00038cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:50:42.807 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:42.809+0000 7f3b1d89d700 1 --2- 172.21.15.150:0/1794480747 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f3b00036810 0x7f3b00038cc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c009990 tx=0x7f3b0c006e40 comp rx=0 tx=0).stop 2023-12-05T09:50:42.807 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:42.809+0000 7f3b1d89d700 1 -- 172.21.15.150:0/1794480747 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b1806ffe0 msgr2=0x7f3b18114e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:50:42.807 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:42.809+0000 7f3b1d89d700 1 --2- 172.21.15.150:0/1794480747 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b1806ffe0 0x7f3b18114e10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3b08009040 tx=0x7f3b08009e30 comp rx=0 tx=0).stop 2023-12-05T09:50:42.807 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:42.809+0000 7f3b1d89d700 1 -- 172.21.15.150:0/1794480747 shutdown_connections 2023-12-05T09:50:42.807 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:42.809+0000 7f3b1d89d700 1 --2- 172.21.15.150:0/1794480747 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f3b00036810 0x7f3b00038cc0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:50:42.807 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:42.809+0000 7f3b1d89d700 1 --2- 172.21.15.150:0/1794480747 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b1806ffe0 0x7f3b18114e10 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:50:42.808 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:42.809+0000 7f3b1d89d700 1 -- 172.21.15.150:0/1794480747 >> 172.21.15.150:0/1794480747 conn(0x7f3b180f83f0 msgr2=0x7f3b181033d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:50:42.808 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:42.809+0000 7f3b1d89d700 1 -- 172.21.15.150:0/1794480747 shutdown_connections 2023-12-05T09:50:42.808 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:42.809+0000 7f3b1d89d700 1 -- 172.21.15.150:0/1794480747 wait complete. 2023-12-05T09:50:42.808 INFO:teuthology.orchestra.run.smithi150.stderr:dumped monmap epoch 1 2023-12-05T09:50:43.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:43 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:43.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:43 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:43.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:43 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:43.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:43 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:43.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:43 smithi100 ceph-mon[107145]: Deploying daemon node-exporter.smithi150 on smithi150 2023-12-05T09:50:43.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:43 smithi100 ceph-mon[107145]: from='client.? 172.21.15.150:0/1794480747' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T09:50:44.215 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-05T09:50:44.215 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-05T09:50:44.626 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-05T09:50:46.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:46 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:46.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:46 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:50:46.623 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:46.624+0000 7ff275118700 1 -- 172.21.15.150:0/3465539589 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff2701028d0 msgr2=0x7ff270102ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:50:46.623 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:46.624+0000 7ff275118700 1 --2- 172.21.15.150:0/3465539589 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff2701028d0 0x7ff270102ca0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff2600048c0 tx=0x7ff260009e30 comp rx=0 tx=0).stop 2023-12-05T09:50:46.623 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:46.624+0000 7ff275118700 1 -- 172.21.15.150:0/3465539589 shutdown_connections 2023-12-05T09:50:46.623 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:46.624+0000 7ff275118700 1 --2- 172.21.15.150:0/3465539589 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff2701028d0 0x7ff270102ca0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:50:46.623 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:46.624+0000 7ff275118700 1 -- 172.21.15.150:0/3465539589 >> 172.21.15.150:0/3465539589 conn(0x7ff2700f8410 msgr2=0x7ff2700fa820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:50:46.623 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:46.624+0000 7ff275118700 1 -- 172.21.15.150:0/3465539589 shutdown_connections 2023-12-05T09:50:46.624 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:46.624+0000 7ff275118700 1 -- 172.21.15.150:0/3465539589 wait complete. 2023-12-05T09:50:46.624 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:46.625+0000 7ff275118700 1 Processor -- start 2023-12-05T09:50:46.624 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:46.625+0000 7ff275118700 1 -- start start 2023-12-05T09:50:46.624 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:46.625+0000 7ff275118700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff2701028d0 0x7ff27010a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:50:46.624 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:46.625+0000 7ff275118700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff270113a20 con 0x7ff2701028d0 2023-12-05T09:50:46.625 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:46.626+0000 7ff26ed9d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff2701028d0 0x7ff27010a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:50:46.625 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:46.626+0000 7ff26ed9d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff2701028d0 0x7ff27010a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.150:46494/0 (socket says 172.21.15.150:46494) 2023-12-05T09:50:46.625 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:46.626+0000 7ff26ed9d700 1 -- 172.21.15.150:0/1106583349 learned_addr learned my addr 172.21.15.150:0/1106583349 (peer_addr_for_me v2:172.21.15.150:0/0) 2023-12-05T09:50:46.625 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:46.626+0000 7ff26ed9d700 1 -- 172.21.15.150:0/1106583349 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff260005040 con 0x7ff2701028d0 2023-12-05T09:50:46.625 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:46.626+0000 7ff26ed9d700 1 --2- 172.21.15.150:0/1106583349 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff2701028d0 0x7ff27010a800 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff260009040 tx=0x7ff260009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:50:46.625 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:46.626+0000 7ff2577fe700 1 -- 172.21.15.150:0/1106583349 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff260004e60 con 0x7ff2701028d0 2023-12-05T09:50:46.625 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:46.626+0000 7ff2577fe700 1 -- 172.21.15.150:0/1106583349 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff260009650 con 0x7ff2701028d0 2023-12-05T09:50:46.625 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:46.627+0000 7ff275118700 1 -- 172.21.15.150:0/1106583349 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff270113c20 con 0x7ff2701028d0 2023-12-05T09:50:46.625 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:46.627+0000 7ff2577fe700 1 -- 172.21.15.150:0/1106583349 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff26001c3f0 con 0x7ff2701028d0 2023-12-05T09:50:46.626 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:46.627+0000 7ff275118700 1 -- 172.21.15.150:0/1106583349 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff27010af60 con 0x7ff2701028d0 2023-12-05T09:50:46.626 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:46.628+0000 7ff2577fe700 1 -- 172.21.15.150:0/1106583349 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) v1 ==== 43396+0+0 (secure 0 0 0) 0x7ff26001c660 con 0x7ff2701028d0 2023-12-05T09:50:46.626 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:46.628+0000 7ff275118700 1 -- 172.21.15.150:0/1106583349 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff27005f270 con 0x7ff2701028d0 2023-12-05T09:50:46.626 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:46.628+0000 7ff2577fe700 1 --2- 172.21.15.150:0/1106583349 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7ff258036810 0x7ff258038cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:50:46.627 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:46.628+0000 7ff2577fe700 1 -- 172.21.15.150:0/1106583349 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7ff260049990 con 0x7ff2701028d0 2023-12-05T09:50:46.627 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:46.629+0000 7ff26e59c700 1 --2- 172.21.15.150:0/1106583349 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7ff258036810 0x7ff258038cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:50:46.627 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:46.629+0000 7ff26e59c700 1 --2- 172.21.15.150:0/1106583349 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7ff258036810 0x7ff258038cc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff264009990 tx=0x7ff264006e40 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:50:46.632 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:46.634+0000 7ff2577fe700 1 -- 172.21.15.150:0/1106583349 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ff260025400 con 0x7ff2701028d0 2023-12-05T09:50:46.934 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:46.935+0000 7ff275118700 1 -- 172.21.15.150:0/1106583349 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ff27010b250 con 0x7ff2701028d0 2023-12-05T09:50:46.934 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:46.936+0000 7ff2577fe700 1 -- 172.21.15.150:0/1106583349 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7ff260011370 con 0x7ff2701028d0 2023-12-05T09:50:46.934 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:50:46.934 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":1,"fsid":"5b035ce6-9353-11ee-95a2-87774f69a715","modified":"2023-12-05T09:48:31.075826Z","created":"2023-12-05T09:48:31.075826Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi100","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-05T09:50:46.936 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:46.938+0000 7ff275118700 1 -- 172.21.15.150:0/1106583349 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7ff258036810 msgr2=0x7ff258038cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:50:46.936 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:46.938+0000 7ff275118700 1 --2- 172.21.15.150:0/1106583349 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7ff258036810 0x7ff258038cc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff264009990 tx=0x7ff264006e40 comp rx=0 tx=0).stop 2023-12-05T09:50:46.936 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:46.938+0000 7ff275118700 1 -- 172.21.15.150:0/1106583349 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff2701028d0 msgr2=0x7ff27010a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:50:46.937 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:46.938+0000 7ff275118700 1 --2- 172.21.15.150:0/1106583349 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff2701028d0 0x7ff27010a800 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff260009040 tx=0x7ff260009e30 comp rx=0 tx=0).stop 2023-12-05T09:50:46.937 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:46.938+0000 7ff275118700 1 -- 172.21.15.150:0/1106583349 shutdown_connections 2023-12-05T09:50:46.937 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:46.938+0000 7ff275118700 1 --2- 172.21.15.150:0/1106583349 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7ff258036810 0x7ff258038cc0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:50:46.937 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:46.938+0000 7ff275118700 1 --2- 172.21.15.150:0/1106583349 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff2701028d0 0x7ff27010a800 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:50:46.937 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:46.938+0000 7ff275118700 1 -- 172.21.15.150:0/1106583349 >> 172.21.15.150:0/1106583349 conn(0x7ff2700f8410 msgr2=0x7ff27006fe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:50:46.937 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:46.938+0000 7ff275118700 1 -- 172.21.15.150:0/1106583349 shutdown_connections 2023-12-05T09:50:46.937 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:46.938+0000 7ff275118700 1 -- 172.21.15.150:0/1106583349 wait complete. 2023-12-05T09:50:46.937 INFO:teuthology.orchestra.run.smithi150.stderr:dumped monmap epoch 1 2023-12-05T09:50:48.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:47 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:48.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:47 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:48.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:47 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:48.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:47 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:48.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:47 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi150.zkskag", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-05T09:50:48.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:47 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi150.zkskag", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-12-05T09:50:48.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:47 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-05T09:50:48.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:47 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:50:48.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:47 smithi100 ceph-mon[107145]: Deploying daemon mgr.smithi150.zkskag on smithi150 2023-12-05T09:50:48.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:47 smithi100 ceph-mon[107145]: from='client.? 172.21.15.150:0/1106583349' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T09:50:48.349 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-05T09:50:48.349 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-05T09:50:48.783 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-05T09:50:50.349 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:50.351+0000 7f0341718700 1 -- 172.21.15.150:0/1902956079 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f033c102720 msgr2=0x7f033c102af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:50:50.349 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:50.351+0000 7f0341718700 1 --2- 172.21.15.150:0/1902956079 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f033c102720 0x7f033c102af0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f032c0048c0 tx=0x7f032c009e30 comp rx=0 tx=0).stop 2023-12-05T09:50:50.349 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:50.351+0000 7f0341718700 1 -- 172.21.15.150:0/1902956079 shutdown_connections 2023-12-05T09:50:50.349 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:50.351+0000 7f0341718700 1 --2- 172.21.15.150:0/1902956079 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f033c102720 0x7f033c102af0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:50:50.349 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:50.351+0000 7f0341718700 1 -- 172.21.15.150:0/1902956079 >> 172.21.15.150:0/1902956079 conn(0x7f033c0f8260 msgr2=0x7f033c0fa670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:50:50.349 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:50.351+0000 7f0341718700 1 -- 172.21.15.150:0/1902956079 shutdown_connections 2023-12-05T09:50:50.349 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:50.351+0000 7f0341718700 1 -- 172.21.15.150:0/1902956079 wait complete. 2023-12-05T09:50:50.350 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:50.352+0000 7f0341718700 1 Processor -- start 2023-12-05T09:50:50.350 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:50.352+0000 7f0341718700 1 -- start start 2023-12-05T09:50:50.350 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:50.353+0000 7f0341718700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f033c102720 0x7f033c06ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:50:50.350 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:50.353+0000 7f0341718700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f033c070480 con 0x7f033c102720 2023-12-05T09:50:50.351 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:50.353+0000 7f033bfff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f033c102720 0x7f033c06ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:50:50.351 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:50.353+0000 7f033bfff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f033c102720 0x7f033c06ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.150:54296/0 (socket says 172.21.15.150:54296) 2023-12-05T09:50:50.351 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:50.353+0000 7f033bfff700 1 -- 172.21.15.150:0/1132200493 learned_addr learned my addr 172.21.15.150:0/1132200493 (peer_addr_for_me v2:172.21.15.150:0/0) 2023-12-05T09:50:50.351 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:50.354+0000 7f033bfff700 1 -- 172.21.15.150:0/1132200493 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f032c005040 con 0x7f033c102720 2023-12-05T09:50:50.352 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:50.354+0000 7f033bfff700 1 --2- 172.21.15.150:0/1132200493 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f033c102720 0x7f033c06ff40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f032c009040 tx=0x7f032c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:50:50.352 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:50.354+0000 7f0338ff9700 1 -- 172.21.15.150:0/1132200493 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f032c004e60 con 0x7f033c102720 2023-12-05T09:50:50.352 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:50.354+0000 7f0338ff9700 1 -- 172.21.15.150:0/1132200493 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f032c009650 con 0x7f033c102720 2023-12-05T09:50:50.352 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:50.354+0000 7f0338ff9700 1 -- 172.21.15.150:0/1132200493 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f032c01c3f0 con 0x7f033c102720 2023-12-05T09:50:50.352 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:50.354+0000 7f0341718700 1 -- 172.21.15.150:0/1132200493 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f033c070680 con 0x7f033c102720 2023-12-05T09:50:50.352 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:50.354+0000 7f0341718700 1 -- 172.21.15.150:0/1132200493 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f033c070af0 con 0x7f033c102720 2023-12-05T09:50:50.352 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:50.355+0000 7f0338ff9700 1 -- 172.21.15.150:0/1132200493 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) v1 ==== 43396+0+0 (secure 0 0 0) 0x7f032c0097c0 con 0x7f033c102720 2023-12-05T09:50:50.353 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:50.356+0000 7f0338ff9700 1 --2- 172.21.15.150:0/1132200493 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f03240367c0 0x7f0324038c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:50:50.353 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:50.356+0000 7f0338ff9700 1 -- 172.21.15.150:0/1132200493 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f032c049a80 con 0x7f033c102720 2023-12-05T09:50:50.354 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:50.356+0000 7f033b7fe700 1 --2- 172.21.15.150:0/1132200493 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f03240367c0 0x7f0324038c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:50:50.354 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:50.357+0000 7f0341718700 1 -- 172.21.15.150:0/1132200493 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f033c05f270 con 0x7f033c102720 2023-12-05T09:50:50.354 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:50.357+0000 7f033b7fe700 1 --2- 172.21.15.150:0/1132200493 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f03240367c0 0x7f0324038c70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0330009990 tx=0x7f0330006e40 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:50:50.360 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:50.363+0000 7f0338ff9700 1 -- 172.21.15.150:0/1132200493 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f032c011940 con 0x7f033c102720 2023-12-05T09:50:50.659 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:50.662+0000 7f0341718700 1 -- 172.21.15.150:0/1132200493 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f033c070d30 con 0x7f033c102720 2023-12-05T09:50:50.659 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:50.662+0000 7f0338ff9700 1 -- 172.21.15.150:0/1132200493 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f032c034090 con 0x7f033c102720 2023-12-05T09:50:50.660 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:50:50.660 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":1,"fsid":"5b035ce6-9353-11ee-95a2-87774f69a715","modified":"2023-12-05T09:48:31.075826Z","created":"2023-12-05T09:48:31.075826Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi100","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-05T09:50:50.662 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:50.665+0000 7f0341718700 1 -- 172.21.15.150:0/1132200493 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f03240367c0 msgr2=0x7f0324038c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:50:50.662 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:50.665+0000 7f0341718700 1 --2- 172.21.15.150:0/1132200493 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f03240367c0 0x7f0324038c70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0330009990 tx=0x7f0330006e40 comp rx=0 tx=0).stop 2023-12-05T09:50:50.662 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:50.665+0000 7f0341718700 1 -- 172.21.15.150:0/1132200493 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f033c102720 msgr2=0x7f033c06ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:50:50.662 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:50.665+0000 7f0341718700 1 --2- 172.21.15.150:0/1132200493 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f033c102720 0x7f033c06ff40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f032c009040 tx=0x7f032c009e30 comp rx=0 tx=0).stop 2023-12-05T09:50:50.662 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:50.665+0000 7f0341718700 1 -- 172.21.15.150:0/1132200493 shutdown_connections 2023-12-05T09:50:50.663 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:50.665+0000 7f0341718700 1 --2- 172.21.15.150:0/1132200493 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f03240367c0 0x7f0324038c70 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:50:50.663 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:50.665+0000 7f0341718700 1 --2- 172.21.15.150:0/1132200493 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f033c102720 0x7f033c06ff40 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:50:50.663 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:50.665+0000 7f0341718700 1 -- 172.21.15.150:0/1132200493 >> 172.21.15.150:0/1132200493 conn(0x7f033c0f8260 msgr2=0x7f033c0f9a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:50:50.663 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:50.665+0000 7f0341718700 1 -- 172.21.15.150:0/1132200493 shutdown_connections 2023-12-05T09:50:50.663 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:50.665+0000 7f0341718700 1 -- 172.21.15.150:0/1132200493 wait complete. 2023-12-05T09:50:50.663 INFO:teuthology.orchestra.run.smithi150.stderr:dumped monmap epoch 1 2023-12-05T09:50:51.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:50 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:51.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:50 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:51.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:50 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:51.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:50 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:51.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:50 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-05T09:50:51.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:50 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:50:51.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:50 smithi100 ceph-mon[107145]: Deploying daemon mon.smithi150 on smithi150 2023-12-05T09:50:51.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:50 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:51.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:50 smithi100 ceph-mon[107145]: from='client.? 172.21.15.150:0/1132200493' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T09:50:52.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:51 smithi100 ceph-mon[107145]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:50:52.503 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-05T09:50:52.504 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-05T09:50:52.796 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:52 smithi150 systemd[1]: Starting Ceph mon.smithi150 for 5b035ce6-9353-11ee-95a2-87774f69a715... 2023-12-05T09:50:53.334 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi150/config 2023-12-05T09:50:53.475 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 bash[116083]: 05fe70420b09117d693b2c179e4d0ad47f38abb7168d955e3c2fc7f99d41628c 2023-12-05T09:50:53.475 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 systemd[1]: Started Ceph mon.smithi150 for 5b035ce6-9353-11ee-95a2-87774f69a715. 2023-12-05T09:50:53.475 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: set uid:gid to 167:167 (ceph:ceph) 2023-12-05T09:50:53.475 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable), process ceph-mon, pid 7 2023-12-05T09:50:53.475 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: pidfile_write: ignore empty --pid-file 2023-12-05T09:50:53.475 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: load: jerasure load: lrc 2023-12-05T09:50:53.475 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: RocksDB version: 6.15.5 2023-12-05T09:50:53.475 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2023-12-05T09:50:53.475 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Compile date Dec 4 2023 2023-12-05T09:50:53.476 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: DB SUMMARY 2023-12-05T09:50:53.476 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: DB Session ID: Z97VV2JD8Q52LJXY3TXN 2023-12-05T09:50:53.476 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: CURRENT file: CURRENT 2023-12-05T09:50:53.476 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: IDENTITY file: IDENTITY 2023-12-05T09:50:53.476 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: MANIFEST file: MANIFEST-000003 size: 57 Bytes 2023-12-05T09:50:53.476 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi150/store.db dir, Total Num: 0, files: 2023-12-05T09:50:53.476 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi150/store.db: 000004.log size: 511 ; 2023-12-05T09:50:53.476 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.error_if_exists: 0 2023-12-05T09:50:53.476 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.create_if_missing: 0 2023-12-05T09:50:53.476 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.paranoid_checks: 1 2023-12-05T09:50:53.476 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-12-05T09:50:53.477 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.env: 0x55f1ec71ba80 2023-12-05T09:50:53.477 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.fs: Posix File System 2023-12-05T09:50:53.477 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.info_log: 0x55f1edd14780 2023-12-05T09:50:53.477 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.max_file_opening_threads: 16 2023-12-05T09:50:53.477 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.statistics: (nil) 2023-12-05T09:50:53.477 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.use_fsync: 0 2023-12-05T09:50:53.477 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.max_log_file_size: 0 2023-12-05T09:50:53.477 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-12-05T09:50:53.477 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.log_file_time_to_roll: 0 2023-12-05T09:50:53.477 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.keep_log_file_num: 1000 2023-12-05T09:50:53.477 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.recycle_log_file_num: 0 2023-12-05T09:50:53.477 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.allow_fallocate: 1 2023-12-05T09:50:53.478 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.allow_mmap_reads: 0 2023-12-05T09:50:53.478 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.allow_mmap_writes: 0 2023-12-05T09:50:53.478 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.use_direct_reads: 0 2023-12-05T09:50:53.478 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-12-05T09:50:53.478 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.create_missing_column_families: 0 2023-12-05T09:50:53.478 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.db_log_dir: 2023-12-05T09:50:53.478 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi150/store.db 2023-12-05T09:50:53.478 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.table_cache_numshardbits: 6 2023-12-05T09:50:53.478 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.WAL_ttl_seconds: 0 2023-12-05T09:50:53.478 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.WAL_size_limit_MB: 0 2023-12-05T09:50:53.478 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-12-05T09:50:53.478 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-12-05T09:50:53.478 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.is_fd_close_on_exec: 1 2023-12-05T09:50:53.479 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.advise_random_on_open: 1 2023-12-05T09:50:53.479 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.db_write_buffer_size: 0 2023-12-05T09:50:53.479 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.write_buffer_manager: 0x55f1eea84990 2023-12-05T09:50:53.479 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-12-05T09:50:53.479 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2023-12-05T09:50:53.479 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-12-05T09:50:53.479 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.use_adaptive_mutex: 0 2023-12-05T09:50:53.479 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.rate_limiter: (nil) 2023-12-05T09:50:53.479 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-12-05T09:50:53.479 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.wal_recovery_mode: 2 2023-12-05T09:50:53.479 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.enable_thread_tracking: 0 2023-12-05T09:50:53.479 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.enable_pipelined_write: 0 2023-12-05T09:50:53.479 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.unordered_write: 0 2023-12-05T09:50:53.479 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-12-05T09:50:53.479 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-12-05T09:50:53.480 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-12-05T09:50:53.480 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-12-05T09:50:53.480 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.row_cache: None 2023-12-05T09:50:53.480 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.wal_filter: None 2023-12-05T09:50:53.480 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-12-05T09:50:53.480 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.allow_ingest_behind: 0 2023-12-05T09:50:53.480 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.preserve_deletes: 0 2023-12-05T09:50:53.481 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.two_write_queues: 0 2023-12-05T09:50:53.481 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.manual_wal_flush: 0 2023-12-05T09:50:53.481 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.atomic_flush: 0 2023-12-05T09:50:53.481 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-12-05T09:50:53.481 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.persist_stats_to_disk: 0 2023-12-05T09:50:53.481 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.write_dbid_to_manifest: 0 2023-12-05T09:50:53.481 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.log_readahead_size: 0 2023-12-05T09:50:53.481 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-12-05T09:50:53.481 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.best_efforts_recovery: 0 2023-12-05T09:50:53.481 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-12-05T09:50:53.481 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-12-05T09:50:53.481 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.allow_data_in_errors: 0 2023-12-05T09:50:53.481 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.db_host_id: __hostname__ 2023-12-05T09:50:53.481 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.max_background_jobs: 2 2023-12-05T09:50:53.482 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.max_background_compactions: -1 2023-12-05T09:50:53.482 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.max_subcompactions: 1 2023-12-05T09:50:53.482 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-12-05T09:50:53.482 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-12-05T09:50:53.482 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.delayed_write_rate : 16777216 2023-12-05T09:50:53.482 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.max_total_wal_size: 0 2023-12-05T09:50:53.482 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-12-05T09:50:53.482 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.stats_dump_period_sec: 600 2023-12-05T09:50:53.482 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.stats_persist_period_sec: 600 2023-12-05T09:50:53.482 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-12-05T09:50:53.482 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.max_open_files: -1 2023-12-05T09:50:53.482 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.bytes_per_sync: 0 2023-12-05T09:50:53.482 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.wal_bytes_per_sync: 0 2023-12-05T09:50:53.483 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.strict_bytes_per_sync: 0 2023-12-05T09:50:53.483 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.compaction_readahead_size: 0 2023-12-05T09:50:53.483 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.max_background_flushes: -1 2023-12-05T09:50:53.483 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Compression algorithms supported: 2023-12-05T09:50:53.483 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-12-05T09:50:53.483 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: kZSTD supported: 0 2023-12-05T09:50:53.483 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: kXpressCompression supported: 0 2023-12-05T09:50:53.483 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: kLZ4HCCompression supported: 1 2023-12-05T09:50:53.483 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: kZlibCompression supported: 1 2023-12-05T09:50:53.483 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: kSnappyCompression supported: 1 2023-12-05T09:50:53.483 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: kLZ4Compression supported: 1 2023-12-05T09:50:53.483 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: kBZip2Compression supported: 0 2023-12-05T09:50:53.483 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Fast CRC32 supported: Supported on x86 2023-12-05T09:50:53.483 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi150/store.db/MANIFEST-000003 2023-12-05T09:50:53.483 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2023-12-05T09:50:53.484 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-12-05T09:50:53.484 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.merge_operator: 2023-12-05T09:50:53.484 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.compaction_filter: None 2023-12-05T09:50:53.484 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.compaction_filter_factory: None 2023-12-05T09:50:53.484 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.sst_partitioner_factory: None 2023-12-05T09:50:53.484 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.memtable_factory: SkipListFactory 2023-12-05T09:50:53.484 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.table_factory: BlockBasedTable 2023-12-05T09:50:53.484 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55f1edd64f90) 2023-12-05T09:50:53.484 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: cache_index_and_filter_blocks: 1 2023-12-05T09:50:53.484 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-12-05T09:50:53.484 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-12-05T09:50:53.484 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: pin_top_level_index_and_filter: 1 2023-12-05T09:50:53.485 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: index_type: 0 2023-12-05T09:50:53.485 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: data_block_index_type: 0 2023-12-05T09:50:53.485 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: index_shortening: 1 2023-12-05T09:50:53.485 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: data_block_hash_table_util_ratio: 0.750000 2023-12-05T09:50:53.485 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: hash_index_allow_collision: 1 2023-12-05T09:50:53.485 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: checksum: 1 2023-12-05T09:50:53.485 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: no_block_cache: 0 2023-12-05T09:50:53.485 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: block_cache: 0x55f1edd97090 2023-12-05T09:50:53.485 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: block_cache_name: BinnedLRUCache 2023-12-05T09:50:53.485 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: block_cache_options: 2023-12-05T09:50:53.485 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: capacity : 536870912 2023-12-05T09:50:53.485 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: num_shard_bits : 4 2023-12-05T09:50:53.485 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: strict_capacity_limit : 0 2023-12-05T09:50:53.485 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: high_pri_pool_ratio: 0.000 2023-12-05T09:50:53.485 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: block_cache_compressed: (nil) 2023-12-05T09:50:53.485 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: persistent_cache: (nil) 2023-12-05T09:50:53.486 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: block_size: 4096 2023-12-05T09:50:53.486 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: block_size_deviation: 10 2023-12-05T09:50:53.486 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: block_restart_interval: 16 2023-12-05T09:50:53.486 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: index_block_restart_interval: 1 2023-12-05T09:50:53.486 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: metadata_block_size: 4096 2023-12-05T09:50:53.486 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: partition_filters: 0 2023-12-05T09:50:53.486 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: use_delta_encoding: 1 2023-12-05T09:50:53.486 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2023-12-05T09:50:53.486 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: whole_key_filtering: 1 2023-12-05T09:50:53.486 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: verify_compression: 0 2023-12-05T09:50:53.487 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: read_amp_bytes_per_bit: 0 2023-12-05T09:50:53.487 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: format_version: 4 2023-12-05T09:50:53.487 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: enable_index_compression: 1 2023-12-05T09:50:53.487 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: block_align: 0 2023-12-05T09:50:53.487 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.write_buffer_size: 33554432 2023-12-05T09:50:53.487 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.max_write_buffer_number: 2 2023-12-05T09:50:53.487 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.compression: NoCompression 2023-12-05T09:50:53.487 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.bottommost_compression: Disabled 2023-12-05T09:50:53.487 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.prefix_extractor: nullptr 2023-12-05T09:50:53.487 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-12-05T09:50:53.487 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.num_levels: 7 2023-12-05T09:50:53.487 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-12-05T09:50:53.487 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-12-05T09:50:53.487 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-12-05T09:50:53.487 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-12-05T09:50:53.488 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-12-05T09:50:53.488 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-12-05T09:50:53.488 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-12-05T09:50:53.488 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-12-05T09:50:53.488 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-12-05T09:50:53.488 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-12-05T09:50:53.488 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.compression_opts.window_bits: -14 2023-12-05T09:50:53.488 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.compression_opts.level: 32767 2023-12-05T09:50:53.488 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.compression_opts.strategy: 0 2023-12-05T09:50:53.488 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-12-05T09:50:53.488 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-12-05T09:50:53.488 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-12-05T09:50:53.488 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.compression_opts.enabled: false 2023-12-05T09:50:53.489 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-12-05T09:50:53.489 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-12-05T09:50:53.489 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-12-05T09:50:53.489 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.target_file_size_base: 67108864 2023-12-05T09:50:53.489 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.target_file_size_multiplier: 1 2023-12-05T09:50:53.489 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-12-05T09:50:53.489 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-12-05T09:50:53.489 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-12-05T09:50:53.489 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-12-05T09:50:53.489 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-12-05T09:50:53.489 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-12-05T09:50:53.489 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-12-05T09:50:53.489 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-12-05T09:50:53.489 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-12-05T09:50:53.489 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-12-05T09:50:53.490 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-12-05T09:50:53.490 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-12-05T09:50:53.490 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.arena_block_size: 4194304 2023-12-05T09:50:53.490 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-12-05T09:50:53.490 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-12-05T09:50:53.490 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2023-12-05T09:50:53.490 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.disable_auto_compactions: 0 2023-12-05T09:50:53.490 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-12-05T09:50:53.490 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-12-05T09:50:53.490 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-12-05T09:50:53.490 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-12-05T09:50:53.490 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-12-05T09:50:53.490 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-12-05T09:50:53.491 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-12-05T09:50:53.492 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-12-05T09:50:53.492 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-12-05T09:50:53.492 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-12-05T09:50:53.492 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.table_properties_collectors: 2023-12-05T09:50:53.492 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.inplace_update_support: 0 2023-12-05T09:50:53.493 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.inplace_update_num_locks: 10000 2023-12-05T09:50:53.493 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-12-05T09:50:53.493 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-12-05T09:50:53.493 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.memtable_huge_page_size: 0 2023-12-05T09:50:53.493 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.bloom_locality: 0 2023-12-05T09:50:53.493 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.max_successive_merges: 0 2023-12-05T09:50:53.493 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.optimize_filters_for_hits: 0 2023-12-05T09:50:53.493 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.paranoid_file_checks: 0 2023-12-05T09:50:53.493 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.force_consistency_checks: 1 2023-12-05T09:50:53.493 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.report_bg_io_stats: 0 2023-12-05T09:50:53.493 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.ttl: 2592000 2023-12-05T09:50:53.493 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.periodic_compaction_seconds: 0 2023-12-05T09:50:53.494 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.enable_blob_files: false 2023-12-05T09:50:53.494 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.min_blob_size: 0 2023-12-05T09:50:53.494 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.blob_file_size: 268435456 2023-12-05T09:50:53.494 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.blob_compression_type: NoCompression 2023-12-05T09:50:53.494 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.enable_blob_garbage_collection: false 2023-12-05T09:50:53.494 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-12-05T09:50:53.494 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi150/store.db/MANIFEST-000003 succeeded,manifest_file_number is 3, next_file_number is 5, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-12-05T09:50:53.494 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 0 2023-12-05T09:50:53.494 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: [db/version_set.cc:4082] Creating manifest 7 2023-12-05T09:50:53.494 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: EVENT_LOG_v1 {"time_micros": 1701769853280299, "job": 1, "event": "recovery_started", "wal_files": [4]} 2023-12-05T09:50:53.494 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #4 mode 2 2023-12-05T09:50:53.494 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2023-12-05T09:50:53.494 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: EVENT_LOG_v1 {"time_micros": 1701769853280881, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1545, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1701769853, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "8144f002-811e-496c-99f3-b258df80b236", "db_session_id": "Z97VV2JD8Q52LJXY3TXN"}} 2023-12-05T09:50:53.494 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: [db/version_set.cc:4082] Creating manifest 9 2023-12-05T09:50:53.495 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: EVENT_LOG_v1 {"time_micros": 1701769853281462, "job": 1, "event": "recovery_finished"} 2023-12-05T09:50:53.495 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-smithi150/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-12-05T09:50:53.495 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x55f1edd2b180 2023-12-05T09:50:53.495 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: DB pointer 0x55f1ede00000 2023-12-05T09:50:53.495 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2023-12-05T09:50:53.495 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: rocksdb: [db/db_impl/db_impl.cc:903] 2023-12-05T09:50:53.495 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: ** DB Stats ** 2023-12-05T09:50:53.495 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-05T09:50:53.495 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-12-05T09:50:53.495 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-05T09:50:53.495 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-05T09:50:53.495 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-12-05T09:50:53.495 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2023-12-05T09:50:53.495 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-05T09:50:53.495 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: 2023-12-05T09:50:53.496 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: ** Compaction Stats [default] ** 2023-12-05T09:50:53.496 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-05T09:50:53.496 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-05T09:50:53.496 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: L0 1/0 1.51 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.7 0.00 0.00 1 0.001 0 0 2023-12-05T09:50:53.496 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: Sum 1/0 1.51 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.7 0.00 0.00 1 0.001 0 0 2023-12-05T09:50:53.496 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.7 0.00 0.00 1 0.001 0 0 2023-12-05T09:50:53.496 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: 2023-12-05T09:50:53.496 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: ** Compaction Stats [default] ** 2023-12-05T09:50:53.496 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-05T09:50:53.496 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-05T09:50:53.496 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.7 0.00 0.00 1 0.001 0 0 2023-12-05T09:50:53.496 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-05T09:50:53.496 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-12-05T09:50:53.496 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-05T09:50:53.496 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-05T09:50:53.497 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-05T09:50:53.497 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-05T09:50:53.497 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: Cumulative compaction: 0.00 GB write, 0.24 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-05T09:50:53.498 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: Interval compaction: 0.00 GB write, 0.24 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-05T09:50:53.498 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-05T09:50:53.498 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: 2023-12-05T09:50:53.498 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-05T09:50:53.498 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: 2023-12-05T09:50:53.498 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: ** Compaction Stats [default] ** 2023-12-05T09:50:53.498 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-05T09:50:53.498 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-05T09:50:53.498 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: L0 1/0 1.51 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.7 0.00 0.00 1 0.001 0 0 2023-12-05T09:50:53.498 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: Sum 1/0 1.51 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.7 0.00 0.00 1 0.001 0 0 2023-12-05T09:50:53.499 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2023-12-05T09:50:53.499 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: 2023-12-05T09:50:53.499 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: ** Compaction Stats [default] ** 2023-12-05T09:50:53.499 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-05T09:50:53.499 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-05T09:50:53.499 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.7 0.00 0.00 1 0.001 0 0 2023-12-05T09:50:53.499 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-05T09:50:53.499 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-12-05T09:50:53.499 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-05T09:50:53.499 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-05T09:50:53.499 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-05T09:50:53.499 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-05T09:50:53.499 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: Cumulative compaction: 0.00 GB write, 0.24 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-05T09:50:53.499 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-05T09:50:53.500 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-05T09:50:53.500 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: 2023-12-05T09:50:53.500 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-05T09:50:53.500 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: mon.smithi150 does not exist in monmap, will attempt to join an existing cluster 2023-12-05T09:50:53.500 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: using public_addr v2:172.21.15.150:0/0 -> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2023-12-05T09:50:53.500 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: starting mon.smithi150 rank -1 at public addrs [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] at bind addrs [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi150 fsid 5b035ce6-9353-11ee-95a2-87774f69a715 2023-12-05T09:50:53.500 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: mon.smithi150@-1(???) e0 preinit fsid 5b035ce6-9353-11ee-95a2-87774f69a715 2023-12-05T09:50:53.500 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: mon.smithi150@-1(synchronizing).mds e1 new map 2023-12-05T09:50:53.500 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: mon.smithi150@-1(synchronizing).mds e1 print_map 2023-12-05T09:50:53.500 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: e1 2023-12-05T09:50:53.501 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-12-05T09:50:53.501 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T09:50:53.501 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: legacy client fscid: -1 2023-12-05T09:50:53.501 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: 2023-12-05T09:50:53.501 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: No filesystems configured 2023-12-05T09:50:53.501 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: mon.smithi150@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2023-12-05T09:50:53.501 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: mon.smithi150@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2023-12-05T09:50:53.501 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: mon.smithi150@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2023-12-05T09:50:53.501 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: mon.smithi150@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2023-12-05T09:50:53.501 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: mon.smithi150@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2023-12-05T09:50:53.501 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: mon.smithi150@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2023-12-05T09:50:53.501 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: mon.smithi150@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2023-12-05T09:50:53.501 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: mon.smithi150@-1(synchronizing).osd e5 crush map has features 3314932999778484224, adjusting msgr requires 2023-12-05T09:50:53.501 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: mon.smithi150@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2023-12-05T09:50:53.501 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: mon.smithi150@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2023-12-05T09:50:53.502 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:50:53.502 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:53.502 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:53.502 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:53.502 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:53.502 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:53.502 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:53.502 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2023-12-05T09:50:53.502 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2023-12-05T09:50:53.502 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:53.502 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: Deploying daemon grafana.smithi100 on smithi100 2023-12-05T09:50:53.502 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='client.14192 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi100:172.21.15.100=smithi100;smithi150:172.21.15.150=smithi150", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:50:53.502 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: Saving service mon spec with placement smithi100:172.21.15.100=smithi100;smithi150:172.21.15.150=smithi150;count:2 2023-12-05T09:50:53.502 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:53.503 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:50:53.503 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:50:53.503 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:53.503 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='client.? 172.21.15.150:0/2567517796' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T09:50:53.503 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:50:53.503 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='client.? 172.21.15.150:0/372625948' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T09:50:53.503 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:50:53.503 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:50:53.503 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='client.? 172.21.15.150:0/817485587' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T09:50:53.503 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:50:53.503 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='client.? 172.21.15.150:0/496343632' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T09:50:53.503 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:50:53.503 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:50:53.503 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:53.503 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:53.503 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:53.504 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:53.504 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:53.504 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:53.504 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: Deploying daemon prometheus.smithi100 on smithi100 2023-12-05T09:50:53.504 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='client.? 172.21.15.150:0/1928978609' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T09:50:53.504 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:50:53.504 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:53.504 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:50:53.504 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='client.? 172.21.15.150:0/308784742' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T09:50:53.504 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:50:53.504 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='client.? 172.21.15.150:0/3495023192' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T09:50:53.504 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:50:53.504 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:50:53.504 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:53.504 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:53.504 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:53.505 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2023-12-05T09:50:53.505 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14160 172.21.15.100:0/781626070' entity='mgr.smithi100.ehmuhg' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2023-12-05T09:50:53.505 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: mgrmap e14: smithi100.ehmuhg(active, since 53s) 2023-12-05T09:50:53.505 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='client.? 172.21.15.150:0/2910458506' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T09:50:53.505 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='client.? 172.21.15.150:0/3322621294' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T09:50:53.505 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='client.? 172.21.15.150:0/346059606' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T09:50:53.505 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: Active manager daemon smithi100.ehmuhg restarted 2023-12-05T09:50:53.505 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: Activating manager daemon smithi100.ehmuhg 2023-12-05T09:50:53.505 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: osdmap e5: 0 total, 0 up, 0 in 2023-12-05T09:50:53.505 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: mgrmap e15: smithi100.ehmuhg(active, starting, since 0.00329425s) 2023-12-05T09:50:53.505 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mon metadata", "id": "smithi100"}]: dispatch 2023-12-05T09:50:53.505 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mgr metadata", "who": "smithi100.ehmuhg", "id": "smithi100.ehmuhg"}]: dispatch 2023-12-05T09:50:53.505 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-05T09:50:53.505 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-05T09:50:53.505 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-05T09:50:53.505 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: Manager daemon smithi100.ehmuhg is now available 2023-12-05T09:50:53.506 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:50:53.506 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:50:53.506 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:53.506 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:50:53.506 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi100.ehmuhg/mirror_snapshot_schedule"}]: dispatch 2023-12-05T09:50:53.506 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi100.ehmuhg/trash_purge_schedule"}]: dispatch 2023-12-05T09:50:53.506 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: [05/Dec/2023:09:50:30] ENGINE Bus STARTING 2023-12-05T09:50:53.506 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: [05/Dec/2023:09:50:30] ENGINE Serving on https://172.21.15.100:7150 2023-12-05T09:50:53.506 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: [05/Dec/2023:09:50:30] ENGINE Bus STARTED 2023-12-05T09:50:53.506 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:53.506 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:53.506 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: mgrmap e16: smithi100.ehmuhg(active, since 1.00676s) 2023-12-05T09:50:53.506 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:53.506 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='client.? 172.21.15.150:0/656375900' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T09:50:53.506 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: mgrmap e17: smithi100.ehmuhg(active, since 2s) 2023-12-05T09:50:53.507 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:53.507 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:53.507 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:53.507 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: mon.smithi150@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2023-12-05T09:50:53.507 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:53.507 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:53.507 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config rm", "who": "osd/host:smithi100", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:50:53.507 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='client.? 172.21.15.150:0/2656870663' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T09:50:53.507 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:53.507 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:53.507 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:53.507 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:53.507 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config rm", "who": "osd/host:smithi150", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:50:53.507 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:50:53.508 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:50:53.508 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: Updating smithi100:/etc/ceph/ceph.conf 2023-12-05T09:50:53.508 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: Updating smithi150:/etc/ceph/ceph.conf 2023-12-05T09:50:53.508 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: Updating smithi100:/var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-05T09:50:53.508 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: Updating smithi150:/var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-05T09:50:53.508 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: Updating smithi100:/etc/ceph/ceph.client.admin.keyring 2023-12-05T09:50:53.508 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: Updating smithi150:/etc/ceph/ceph.client.admin.keyring 2023-12-05T09:50:53.508 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: Updating smithi100:/var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-05T09:50:53.508 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: Updating smithi150:/var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-05T09:50:53.508 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:53.508 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:53.508 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:53.508 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:53.508 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:53.508 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi150", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-05T09:50:53.509 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi150", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2023-12-05T09:50:53.509 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:50:53.509 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: Deploying daemon crash.smithi150 on smithi150 2023-12-05T09:50:53.509 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='client.? 172.21.15.150:0/3177854910' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T09:50:53.509 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:53.509 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:53.509 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:53.509 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:53.509 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: Deploying daemon node-exporter.smithi150 on smithi150 2023-12-05T09:50:53.509 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='client.? 172.21.15.150:0/1794480747' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T09:50:53.509 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:53.509 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:50:53.509 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:53.509 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:53.509 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:53.510 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:53.510 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi150.zkskag", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-05T09:50:53.510 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi150.zkskag", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-12-05T09:50:53.510 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-05T09:50:53.510 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:50:53.510 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: Deploying daemon mgr.smithi150.zkskag on smithi150 2023-12-05T09:50:53.510 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='client.? 172.21.15.150:0/1106583349' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T09:50:53.510 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:53.510 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:53.510 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:53.510 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:53.510 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-05T09:50:53.510 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:50:53.511 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: Deploying daemon mon.smithi150 on smithi150 2023-12-05T09:50:53.511 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:53.511 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: from='client.? 172.21.15.150:0/1132200493' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T09:50:53.511 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:50:53.511 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: mon.smithi150@-1(synchronizing).paxosservice(auth 1..6) refresh upgraded, format 0 -> 3 2023-12-05T09:50:53.511 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:53 smithi150 ceph-mon[116142]: mon.smithi150@-1(synchronizing) e1 handle_conf_change mon_allow_pool_delete 2023-12-05T09:50:58.494 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:58 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mon metadata", "id": "smithi100"}]: dispatch 2023-12-05T09:50:58.495 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:58 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mon metadata", "id": "smithi150"}]: dispatch 2023-12-05T09:50:58.495 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:58 smithi150 ceph-mon[116142]: mon.smithi100 calling monitor election 2023-12-05T09:50:58.495 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:58 smithi150 ceph-mon[116142]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:50:58.495 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:58 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mon metadata", "id": "smithi150"}]: dispatch 2023-12-05T09:50:58.495 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:58 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mon metadata", "id": "smithi150"}]: dispatch 2023-12-05T09:50:58.495 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:58 smithi150 ceph-mon[116142]: mon.smithi150 calling monitor election 2023-12-05T09:50:58.495 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:58 smithi150 ceph-mon[116142]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:50:58.495 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:58 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mon metadata", "id": "smithi150"}]: dispatch 2023-12-05T09:50:58.495 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:58 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mon metadata", "id": "smithi150"}]: dispatch 2023-12-05T09:50:58.495 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:58 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mon metadata", "id": "smithi150"}]: dispatch 2023-12-05T09:50:58.495 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:58 smithi150 ceph-mon[116142]: mon.smithi100 is new leader, mons smithi100,smithi150 in quorum (ranks 0,1) 2023-12-05T09:50:58.495 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:58 smithi150 ceph-mon[116142]: monmap e2: 2 mons at {smithi100=[v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0],smithi150=[v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-05T09:50:58.495 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:58 smithi150 ceph-mon[116142]: fsmap 2023-12-05T09:50:58.495 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:58 smithi150 ceph-mon[116142]: osdmap e5: 0 total, 0 up, 0 in 2023-12-05T09:50:58.495 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:58 smithi150 ceph-mon[116142]: mgrmap e17: smithi100.ehmuhg(active, since 28s) 2023-12-05T09:50:58.496 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:58 smithi150 ceph-mon[116142]: overall HEALTH_OK 2023-12-05T09:50:58.496 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:58 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:58.496 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:58 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:58.496 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:58 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:58.496 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:58 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:58.496 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:58 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:58.496 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:58 smithi150 ceph-mon[116142]: Standby manager daemon smithi150.zkskag started 2023-12-05T09:50:58.496 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:58 smithi150 ceph-mon[116142]: from='mgr.? 172.21.15.150:0/90683143' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi150.zkskag/crt"}]: dispatch 2023-12-05T09:50:58.496 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:58 smithi150 ceph-mon[116142]: from='mgr.? 172.21.15.150:0/90683143' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-05T09:50:58.496 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:58 smithi150 ceph-mon[116142]: from='mgr.? 172.21.15.150:0/90683143' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi150.zkskag/key"}]: dispatch 2023-12-05T09:50:58.496 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:58 smithi150 ceph-mon[116142]: from='mgr.? 172.21.15.150:0/90683143' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-05T09:50:58.865 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:58.868+0000 7fdb32115700 1 -- 172.21.15.150:0/2088662525 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdb2c071c10 msgr2=0x7fdb140055d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:50:58.865 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:58.868+0000 7fdb32115700 1 --2- 172.21.15.150:0/2088662525 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdb2c071c10 0x7fdb140055d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c004a50 tx=0x7fdb1c002040 comp rx=0 tx=0).stop 2023-12-05T09:50:58.866 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:58.868+0000 7fdb32115700 1 -- 172.21.15.150:0/2088662525 shutdown_connections 2023-12-05T09:50:58.866 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:58.868+0000 7fdb32115700 1 --2- 172.21.15.150:0/2088662525 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdb2c071c10 0x7fdb140055d0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:50:58.866 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:58.868+0000 7fdb32115700 1 -- 172.21.15.150:0/2088662525 >> 172.21.15.150:0/2088662525 conn(0x7fdb2c0f8510 msgr2=0x7fdb2c0fa920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:50:58.866 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:58.868+0000 7fdb32115700 1 -- 172.21.15.150:0/2088662525 shutdown_connections 2023-12-05T09:50:58.866 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:58.868+0000 7fdb32115700 1 -- 172.21.15.150:0/2088662525 wait complete. 2023-12-05T09:50:58.866 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:58.869+0000 7fdb32115700 1 Processor -- start 2023-12-05T09:50:58.866 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:58.869+0000 7fdb32115700 1 -- start start 2023-12-05T09:50:58.867 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:58.870+0000 7fdb32115700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdb2c071c10 0x7fdb2c1192f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:50:58.867 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:58.870+0000 7fdb32115700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb2c119830 0x7fdb2c113190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:50:58.867 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:58.870+0000 7fdb32115700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb2c119e40 con 0x7fdb2c071c10 2023-12-05T09:50:58.867 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:58.870+0000 7fdb32115700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb2c1136d0 con 0x7fdb2c119830 2023-12-05T09:50:58.868 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:58.870+0000 7fdb2b7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdb2c071c10 0x7fdb2c1192f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:50:58.868 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:58.870+0000 7fdb2b7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdb2c071c10 0x7fdb2c1192f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.150:57214/0 (socket says 172.21.15.150:57214) 2023-12-05T09:50:58.868 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:58.870+0000 7fdb2b7fe700 1 -- 172.21.15.150:0/1772182568 learned_addr learned my addr 172.21.15.150:0/1772182568 (peer_addr_for_me v2:172.21.15.150:0/0) 2023-12-05T09:50:58.869 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:58.870+0000 7fdb2affd700 1 --2- 172.21.15.150:0/1772182568 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb2c119830 0x7fdb2c113190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:50:58.869 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:58.871+0000 7fdb2affd700 1 -- 172.21.15.150:0/1772182568 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb2c119830 msgr2=0x7fdb2c113190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2023-12-05T09:50:58.869 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:58.871+0000 7fdb2affd700 1 -- 172.21.15.150:0/1772182568 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb2c119830 msgr2=0x7fdb2c113190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-12-05T09:50:58.869 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:58.871+0000 7fdb2affd700 1 --2- 172.21.15.150:0/1772182568 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb2c119830 0x7fdb2c113190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-12-05T09:50:58.869 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:58.871+0000 7fdb2b7fe700 1 -- 172.21.15.150:0/1772182568 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb2c119830 msgr2=0x7fdb2c113190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:50:58.869 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:58.871+0000 7fdb2affd700 1 --2- 172.21.15.150:0/1772182568 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb2c119830 0x7fdb2c113190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-05T09:50:58.869 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:58.871+0000 7fdb2b7fe700 1 --2- 172.21.15.150:0/1772182568 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb2c119830 0x7fdb2c113190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:50:58.869 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:58.871+0000 7fdb2b7fe700 1 -- 172.21.15.150:0/1772182568 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb1c005040 con 0x7fdb2c071c10 2023-12-05T09:50:58.869 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:58.871+0000 7fdb2b7fe700 1 --2- 172.21.15.150:0/1772182568 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdb2c071c10 0x7fdb2c1192f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c004910 tx=0x7fdb1c002040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:50:58.869 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:58.871+0000 7fdb13fff700 1 -- 172.21.15.150:0/1772182568 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb1c016840 con 0x7fdb2c071c10 2023-12-05T09:50:58.869 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:58.871+0000 7fdb13fff700 1 -- 172.21.15.150:0/1772182568 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdb1c016e50 con 0x7fdb2c071c10 2023-12-05T09:50:58.869 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:58.871+0000 7fdb32115700 1 -- 172.21.15.150:0/1772182568 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb2c113950 con 0x7fdb2c071c10 2023-12-05T09:50:58.869 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:58.871+0000 7fdb13fff700 1 -- 172.21.15.150:0/1772182568 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb1c029e80 con 0x7fdb2c071c10 2023-12-05T09:50:58.869 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:58.871+0000 7fdb32115700 1 -- 172.21.15.150:0/1772182568 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb2c113e90 con 0x7fdb2c071c10 2023-12-05T09:50:58.870 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:58.872+0000 7fdb13fff700 1 -- 172.21.15.150:0/1772182568 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) v1 ==== 43396+0+0 (secure 0 0 0) 0x7fdb1c01d020 con 0x7fdb2c071c10 2023-12-05T09:50:58.870 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:58.872+0000 7fdb32115700 1 -- 172.21.15.150:0/1772182568 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb2c05f270 con 0x7fdb2c071c10 2023-12-05T09:50:58.870 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:58.873+0000 7fdb13fff700 1 --2- 172.21.15.150:0/1772182568 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fdb18036950 0x7fdb18038e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:50:58.870 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:58.873+0000 7fdb13fff700 1 -- 172.21.15.150:0/1772182568 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fdb1c04a260 con 0x7fdb2c071c10 2023-12-05T09:50:58.871 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:58.873+0000 7fdb2affd700 1 --2- 172.21.15.150:0/1772182568 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fdb18036950 0x7fdb18038e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:50:58.871 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:58.874+0000 7fdb2affd700 1 --2- 172.21.15.150:0/1772182568 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fdb18036950 0x7fdb18038e00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fdb20006f30 tx=0x7fdb20008040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:50:58.875 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:58.878+0000 7fdb13fff700 1 -- 172.21.15.150:0/1772182568 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fdb1c020420 con 0x7fdb2c071c10 2023-12-05T09:50:58.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:58 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mon metadata", "id": "smithi100"}]: dispatch 2023-12-05T09:50:58.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:58 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mon metadata", "id": "smithi150"}]: dispatch 2023-12-05T09:50:58.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:58 smithi100 ceph-mon[107145]: mon.smithi100 calling monitor election 2023-12-05T09:50:58.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:58 smithi100 ceph-mon[107145]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:50:58.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:58 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mon metadata", "id": "smithi150"}]: dispatch 2023-12-05T09:50:58.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:58 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mon metadata", "id": "smithi150"}]: dispatch 2023-12-05T09:50:58.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:58 smithi100 ceph-mon[107145]: mon.smithi150 calling monitor election 2023-12-05T09:50:58.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:58 smithi100 ceph-mon[107145]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:50:58.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:58 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mon metadata", "id": "smithi150"}]: dispatch 2023-12-05T09:50:58.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:58 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mon metadata", "id": "smithi150"}]: dispatch 2023-12-05T09:50:58.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:58 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mon metadata", "id": "smithi150"}]: dispatch 2023-12-05T09:50:58.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:58 smithi100 ceph-mon[107145]: mon.smithi100 is new leader, mons smithi100,smithi150 in quorum (ranks 0,1) 2023-12-05T09:50:58.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:58 smithi100 ceph-mon[107145]: monmap e2: 2 mons at {smithi100=[v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0],smithi150=[v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-05T09:50:58.897 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:58 smithi100 ceph-mon[107145]: fsmap 2023-12-05T09:50:58.897 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:58 smithi100 ceph-mon[107145]: osdmap e5: 0 total, 0 up, 0 in 2023-12-05T09:50:58.897 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:58 smithi100 ceph-mon[107145]: mgrmap e17: smithi100.ehmuhg(active, since 28s) 2023-12-05T09:50:58.897 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:58 smithi100 ceph-mon[107145]: overall HEALTH_OK 2023-12-05T09:50:58.897 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:58 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:58.897 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:58 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:58.897 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:58 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:58.897 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:58 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:58.897 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:58 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:50:58.897 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:58 smithi100 ceph-mon[107145]: Standby manager daemon smithi150.zkskag started 2023-12-05T09:50:58.897 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:58 smithi100 ceph-mon[107145]: from='mgr.? 172.21.15.150:0/90683143' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi150.zkskag/crt"}]: dispatch 2023-12-05T09:50:58.897 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:58 smithi100 ceph-mon[107145]: from='mgr.? 172.21.15.150:0/90683143' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-05T09:50:58.897 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:58 smithi100 ceph-mon[107145]: from='mgr.? 172.21.15.150:0/90683143' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi150.zkskag/key"}]: dispatch 2023-12-05T09:50:58.897 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:58 smithi100 ceph-mon[107145]: from='mgr.? 172.21.15.150:0/90683143' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-05T09:50:59.175 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:59.178+0000 7fdb32115700 1 -- 172.21.15.150:0/1772182568 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fdb2c1148d0 con 0x7fdb2c071c10 2023-12-05T09:50:59.176 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:59.178+0000 7fdb13fff700 1 -- 172.21.15.150:0/1772182568 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1021 (secure 0 0 0) 0x7fdb1c027340 con 0x7fdb2c071c10 2023-12-05T09:50:59.176 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-12-05T09:50:59.176 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":2,"fsid":"5b035ce6-9353-11ee-95a2-87774f69a715","modified":"2023-12-05T09:50:53.334723Z","created":"2023-12-05T09:48:31.075826Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi100","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi150","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2023-12-05T09:50:59.178 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:59.181+0000 7fdb32115700 1 -- 172.21.15.150:0/1772182568 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fdb18036950 msgr2=0x7fdb18038e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:50:59.178 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:59.181+0000 7fdb32115700 1 --2- 172.21.15.150:0/1772182568 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fdb18036950 0x7fdb18038e00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fdb20006f30 tx=0x7fdb20008040 comp rx=0 tx=0).stop 2023-12-05T09:50:59.178 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:59.181+0000 7fdb32115700 1 -- 172.21.15.150:0/1772182568 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdb2c071c10 msgr2=0x7fdb2c1192f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:50:59.178 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:59.181+0000 7fdb32115700 1 --2- 172.21.15.150:0/1772182568 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdb2c071c10 0x7fdb2c1192f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c004910 tx=0x7fdb1c002040 comp rx=0 tx=0).stop 2023-12-05T09:50:59.178 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:59.181+0000 7fdb32115700 1 -- 172.21.15.150:0/1772182568 shutdown_connections 2023-12-05T09:50:59.178 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:59.181+0000 7fdb32115700 1 --2- 172.21.15.150:0/1772182568 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fdb18036950 0x7fdb18038e00 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:50:59.178 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:59.181+0000 7fdb32115700 1 --2- 172.21.15.150:0/1772182568 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdb2c071c10 0x7fdb2c1192f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:50:59.179 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:59.181+0000 7fdb32115700 1 --2- 172.21.15.150:0/1772182568 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb2c119830 0x7fdb2c113190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:50:59.179 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:59.181+0000 7fdb32115700 1 -- 172.21.15.150:0/1772182568 >> 172.21.15.150:0/1772182568 conn(0x7fdb2c0f8510 msgr2=0x7fdb2c0fc6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:50:59.179 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:59.181+0000 7fdb32115700 1 -- 172.21.15.150:0/1772182568 shutdown_connections 2023-12-05T09:50:59.179 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:50:59.181+0000 7fdb32115700 1 -- 172.21.15.150:0/1772182568 wait complete. 2023-12-05T09:50:59.179 INFO:teuthology.orchestra.run.smithi150.stderr:dumped monmap epoch 2 2023-12-05T09:50:59.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:59 smithi150 ceph-mon[116142]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:50:59.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:59 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:50:59.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:59 smithi150 ceph-mon[116142]: from='client.? 172.21.15.150:0/1772182568' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T09:50:59.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:59 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mon metadata", "id": "smithi150"}]: dispatch 2023-12-05T09:50:59.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:59 smithi150 ceph-mon[116142]: mgrmap e18: smithi100.ehmuhg(active, since 29s), standbys: smithi150.zkskag 2023-12-05T09:50:59.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:50:59 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mgr metadata", "who": "smithi150.zkskag", "id": "smithi150.zkskag"}]: dispatch 2023-12-05T09:50:59.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:59 smithi100 ceph-mon[107145]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:50:59.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:59 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:50:59.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:59 smithi100 ceph-mon[107145]: from='client.? 172.21.15.150:0/1772182568' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T09:50:59.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:59 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mon metadata", "id": "smithi150"}]: dispatch 2023-12-05T09:50:59.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:59 smithi100 ceph-mon[107145]: mgrmap e18: smithi100.ehmuhg(active, since 29s), standbys: smithi150.zkskag 2023-12-05T09:50:59.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:50:59 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mgr metadata", "who": "smithi150.zkskag", "id": "smithi150.zkskag"}]: dispatch 2023-12-05T09:50:59.982 INFO:tasks.cephadm:Generating final ceph.conf file... 2023-12-05T09:50:59.982 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- ceph config generate-minimal-conf 2023-12-05T09:51:00.417 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi100/config 2023-12-05T09:51:00.596 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:00 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:51:00.596 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:00 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:00.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:00 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:51:00.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:00 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:01.782 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:01.783+0000 7f89bbb7d700 1 -- 172.21.15.100:0/4169104791 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89b4104ac0 msgr2=0x7f89b4104e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:51:01.782 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:01.783+0000 7f89bbb7d700 1 --2- 172.21.15.100:0/4169104791 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89b4104ac0 0x7f89b4104e90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f89b00048c0 tx=0x7f89b0009e30 comp rx=0 tx=0).stop 2023-12-05T09:51:01.782 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:01.783+0000 7f89bbb7d700 1 -- 172.21.15.100:0/4169104791 shutdown_connections 2023-12-05T09:51:01.782 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:01.783+0000 7f89bbb7d700 1 --2- 172.21.15.100:0/4169104791 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89b4104ac0 0x7f89b4104e90 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:51:01.782 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:01.783+0000 7f89bbb7d700 1 -- 172.21.15.100:0/4169104791 >> 172.21.15.100:0/4169104791 conn(0x7f89b40fa600 msgr2=0x7f89b40fca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:51:01.782 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:01.783+0000 7f89bbb7d700 1 -- 172.21.15.100:0/4169104791 shutdown_connections 2023-12-05T09:51:01.782 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:01.783+0000 7f89bbb7d700 1 -- 172.21.15.100:0/4169104791 wait complete. 2023-12-05T09:51:01.782 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:01.784+0000 7f89bbb7d700 1 Processor -- start 2023-12-05T09:51:01.782 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:01.784+0000 7f89bbb7d700 1 -- start start 2023-12-05T09:51:01.784 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:01.785+0000 7f89bbb7d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89b4104ac0 0x7f89b4114eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:51:01.784 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:01.785+0000 7f89bbb7d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89b41153f0 0x7f89b410ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:51:01.784 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:01.785+0000 7f89bbb7d700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b4115a00 con 0x7f89b4104ac0 2023-12-05T09:51:01.784 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:01.785+0000 7f89bbb7d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b410f290 con 0x7f89b41153f0 2023-12-05T09:51:01.784 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:01.785+0000 7f89b9919700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89b4104ac0 0x7f89b4114eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:51:01.784 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:01.785+0000 7f89b9919700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89b4104ac0 0x7f89b4114eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33294/0 (socket says 172.21.15.100:33294) 2023-12-05T09:51:01.784 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:01.785+0000 7f89b9919700 1 -- 172.21.15.100:0/2931990696 learned_addr learned my addr 172.21.15.100:0/2931990696 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:51:01.784 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:01.785+0000 7f89b9118700 1 --2- 172.21.15.100:0/2931990696 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89b41153f0 0x7f89b410ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:51:01.784 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:01.785+0000 7f89b9118700 1 -- 172.21.15.100:0/2931990696 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89b41153f0 msgr2=0x7f89b410ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2023-12-05T09:51:01.784 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:01.785+0000 7f89b9118700 1 -- 172.21.15.100:0/2931990696 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89b41153f0 msgr2=0x7f89b410ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-12-05T09:51:01.784 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:01.785+0000 7f89b9118700 1 --2- 172.21.15.100:0/2931990696 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89b41153f0 0x7f89b410ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-12-05T09:51:01.784 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:01.785+0000 7f89b9919700 1 -- 172.21.15.100:0/2931990696 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89b41153f0 msgr2=0x7f89b410ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:51:01.785 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:01.785+0000 7f89b9118700 1 --2- 172.21.15.100:0/2931990696 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89b41153f0 0x7f89b410ed50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-05T09:51:01.785 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:01.785+0000 7f89b9919700 1 --2- 172.21.15.100:0/2931990696 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89b41153f0 0x7f89b410ed50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:51:01.785 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:01.786+0000 7f89b9919700 1 -- 172.21.15.100:0/2931990696 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89b0005040 con 0x7f89b4104ac0 2023-12-05T09:51:01.785 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:01.786+0000 7f89b9919700 1 --2- 172.21.15.100:0/2931990696 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89b4104ac0 0x7f89b4114eb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f89b000bfe0 tx=0x7f89b0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:51:01.785 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:01.786+0000 7f89aa7fc700 1 -- 172.21.15.100:0/2931990696 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89b000e040 con 0x7f89b4104ac0 2023-12-05T09:51:01.785 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:01.786+0000 7f89aa7fc700 1 -- 172.21.15.100:0/2931990696 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f89b0013420 con 0x7f89b4104ac0 2023-12-05T09:51:01.785 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:01.786+0000 7f89bbb7d700 1 -- 172.21.15.100:0/2931990696 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89b410f510 con 0x7f89b4104ac0 2023-12-05T09:51:01.785 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:01.786+0000 7f89aa7fc700 1 -- 172.21.15.100:0/2931990696 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89b001c630 con 0x7f89b4104ac0 2023-12-05T09:51:01.785 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:01.786+0000 7f89bbb7d700 1 -- 172.21.15.100:0/2931990696 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89b410fad0 con 0x7f89b4104ac0 2023-12-05T09:51:01.786 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:01.787+0000 7f89bbb7d700 1 -- 172.21.15.100:0/2931990696 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89b405f270 con 0x7f89b4104ac0 2023-12-05T09:51:01.786 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:01.788+0000 7f89aa7fc700 1 -- 172.21.15.100:0/2931990696 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) v1 ==== 86393+0+0 (secure 0 0 0) 0x7f89b00139e0 con 0x7f89b4104ac0 2023-12-05T09:51:01.786 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:01.789+0000 7f89aa7fc700 1 --2- 172.21.15.100:0/2931990696 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f89a0069040 0x7f89a006b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:51:01.787 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:01.789+0000 7f89aa7fc700 1 -- 172.21.15.100:0/2931990696 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f89b0086f40 con 0x7f89b4104ac0 2023-12-05T09:51:01.787 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:01.789+0000 7f89b9118700 1 --2- 172.21.15.100:0/2931990696 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f89a0069040 0x7f89a006b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:51:01.787 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:01.790+0000 7f89b9118700 1 --2- 172.21.15.100:0/2931990696 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f89a0069040 0x7f89a006b4f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f89a4006f30 tx=0x7f89a4008040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:51:01.793 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:01.795+0000 7f89aa7fc700 1 -- 172.21.15.100:0/2931990696 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f89b0058020 con 0x7f89b4104ac0 2023-12-05T09:51:02.007 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:02.009+0000 7f89bbb7d700 1 -- 172.21.15.100:0/2931990696 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f89b4108c70 con 0x7f89b4104ac0 2023-12-05T09:51:02.007 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:02.009+0000 7f89aa7fc700 1 -- 172.21.15.100:0/2931990696 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+227 (secure 0 0 0) 0x7f89b4108c70 con 0x7f89b4104ac0 2023-12-05T09:51:02.007 INFO:teuthology.orchestra.run.smithi100.stdout:# minimal ceph.conf for 5b035ce6-9353-11ee-95a2-87774f69a715 2023-12-05T09:51:02.007 INFO:teuthology.orchestra.run.smithi100.stdout:[global] 2023-12-05T09:51:02.007 INFO:teuthology.orchestra.run.smithi100.stdout: fsid = 5b035ce6-9353-11ee-95a2-87774f69a715 2023-12-05T09:51:02.007 INFO:teuthology.orchestra.run.smithi100.stdout: mon_host = [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2023-12-05T09:51:02.009 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:02.011+0000 7f89bbb7d700 1 -- 172.21.15.100:0/2931990696 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f89a0069040 msgr2=0x7f89a006b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:51:02.009 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:02.011+0000 7f89bbb7d700 1 --2- 172.21.15.100:0/2931990696 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f89a0069040 0x7f89a006b4f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f89a4006f30 tx=0x7f89a4008040 comp rx=0 tx=0).stop 2023-12-05T09:51:02.009 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:02.011+0000 7f89bbb7d700 1 -- 172.21.15.100:0/2931990696 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89b4104ac0 msgr2=0x7f89b4114eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:51:02.010 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:02.011+0000 7f89bbb7d700 1 --2- 172.21.15.100:0/2931990696 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89b4104ac0 0x7f89b4114eb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f89b000bfe0 tx=0x7f89b0009e30 comp rx=0 tx=0).stop 2023-12-05T09:51:02.010 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:02.011+0000 7f89bbb7d700 1 -- 172.21.15.100:0/2931990696 shutdown_connections 2023-12-05T09:51:02.010 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:02.011+0000 7f89bbb7d700 1 --2- 172.21.15.100:0/2931990696 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f89a0069040 0x7f89a006b4f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:51:02.010 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:02.011+0000 7f89bbb7d700 1 --2- 172.21.15.100:0/2931990696 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89b4104ac0 0x7f89b4114eb0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:51:02.010 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:02.011+0000 7f89bbb7d700 1 --2- 172.21.15.100:0/2931990696 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89b41153f0 0x7f89b410ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:51:02.010 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:02.012+0000 7f89bbb7d700 1 -- 172.21.15.100:0/2931990696 >> 172.21.15.100:0/2931990696 conn(0x7f89b40fa600 msgr2=0x7f89b40fbc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:51:02.010 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:02.012+0000 7f89bbb7d700 1 -- 172.21.15.100:0/2931990696 shutdown_connections 2023-12-05T09:51:02.010 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:02.012+0000 7f89bbb7d700 1 -- 172.21.15.100:0/2931990696 wait complete. 2023-12-05T09:51:02.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:01 smithi100 ceph-mon[107145]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:51:02.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:01 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:02.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:01 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:02.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:01 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:51:02.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:01 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:51:02.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:01 smithi100 ceph-mon[107145]: Updating smithi100:/etc/ceph/ceph.conf 2023-12-05T09:51:02.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:01 smithi100 ceph-mon[107145]: Updating smithi150:/etc/ceph/ceph.conf 2023-12-05T09:51:02.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:01 smithi150 ceph-mon[116142]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:51:02.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:01 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:02.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:01 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:02.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:01 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:51:02.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:01 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:51:02.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:01 smithi150 ceph-mon[116142]: Updating smithi100:/etc/ceph/ceph.conf 2023-12-05T09:51:02.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:01 smithi150 ceph-mon[116142]: Updating smithi150:/etc/ceph/ceph.conf 2023-12-05T09:51:02.440 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2023-12-05T09:51:02.440 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-12-05T09:51:02.440 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/ceph/ceph.conf 2023-12-05T09:51:02.514 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-12-05T09:51:02.514 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-12-05T09:51:02.625 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-12-05T09:51:02.625 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/etc/ceph/ceph.conf 2023-12-05T09:51:02.700 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-12-05T09:51:02.700 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-12-05T09:51:02.809 INFO:tasks.cephadm:Deploying OSDs... 2023-12-05T09:51:02.810 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-12-05T09:51:02.810 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/scratch_devs of=/dev/stdout 2023-12-05T09:51:02.856 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-05T09:51:02.856 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_1 2023-12-05T09:51:02.945 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-05T09:51:02.945 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-05T09:51:02.945 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 444 Links: 1 2023-12-05T09:51:02.945 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-05T09:51:02.945 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2023-12-05T09:51:02.945 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2023-12-05 09:50:20.031409108 +0000 2023-12-05T09:51:02.945 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2023-12-05 09:42:23.167552726 +0000 2023-12-05T09:51:02.945 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2023-12-05 09:42:23.167552726 +0000 2023-12-05T09:51:02.945 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2023-12-05 09:42:23.140553438 +0000 2023-12-05T09:51:02.945 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-05T09:51:03.018 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2023-12-05T09:51:03.018 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2023-12-05T09:51:03.018 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000299143 s, 1.7 MB/s 2023-12-05T09:51:03.020 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-05T09:51:03.070 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_2 2023-12-05T09:51:03.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:02 smithi150 ceph-mon[116142]: Updating smithi100:/var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-05T09:51:03.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:02 smithi150 ceph-mon[116142]: Updating smithi150:/var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-05T09:51:03.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:02 smithi150 ceph-mon[116142]: from='client.? 172.21.15.100:0/2931990696' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:51:03.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:02 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:03.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:02 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:03.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:02 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:03.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:02 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:03.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:02 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:03.097 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:02 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-05T09:51:03.097 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:02 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-05T09:51:03.097 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:02 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:51:03.116 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-05T09:51:03.116 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-05T09:51:03.116 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 450 Links: 1 2023-12-05T09:51:03.116 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-05T09:51:03.117 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2023-12-05T09:51:03.117 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2023-12-05 09:50:20.031409108 +0000 2023-12-05T09:51:03.117 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2023-12-05 09:42:24.015530346 +0000 2023-12-05T09:51:03.117 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2023-12-05 09:42:24.015530346 +0000 2023-12-05T09:51:03.117 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2023-12-05 09:42:23.991530979 +0000 2023-12-05T09:51:03.117 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-05T09:51:03.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:02 smithi100 ceph-mon[107145]: Updating smithi100:/var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-05T09:51:03.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:02 smithi100 ceph-mon[107145]: Updating smithi150:/var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-05T09:51:03.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:02 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/2931990696' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:51:03.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:02 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:03.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:02 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:03.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:02 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:03.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:02 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:03.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:02 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:03.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:02 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-05T09:51:03.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:02 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-05T09:51:03.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:02 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:51:03.216 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2023-12-05T09:51:03.216 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2023-12-05T09:51:03.216 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000331762 s, 1.5 MB/s 2023-12-05T09:51:03.219 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-05T09:51:03.268 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_3 2023-12-05T09:51:03.313 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-05T09:51:03.314 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-05T09:51:03.314 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 456 Links: 1 2023-12-05T09:51:03.314 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-05T09:51:03.314 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2023-12-05T09:51:03.314 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2023-12-05 09:50:20.031409108 +0000 2023-12-05T09:51:03.314 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2023-12-05 09:42:24.874507675 +0000 2023-12-05T09:51:03.314 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2023-12-05 09:42:24.874507675 +0000 2023-12-05T09:51:03.314 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2023-12-05 09:42:24.850508309 +0000 2023-12-05T09:51:03.315 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-05T09:51:03.381 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2023-12-05T09:51:03.382 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2023-12-05T09:51:03.385 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.00032704 s, 1.6 MB/s 2023-12-05T09:51:03.386 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-05T09:51:03.435 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_4 2023-12-05T09:51:03.486 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-05T09:51:03.487 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-05T09:51:03.487 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 462 Links: 1 2023-12-05T09:51:03.487 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-05T09:51:03.487 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2023-12-05T09:51:03.487 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2023-12-05 09:50:20.031409108 +0000 2023-12-05T09:51:03.487 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2023-12-05 09:42:25.905480466 +0000 2023-12-05T09:51:03.487 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2023-12-05 09:42:25.905480466 +0000 2023-12-05T09:51:03.487 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2023-12-05 09:42:25.877481205 +0000 2023-12-05T09:51:03.487 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-05T09:51:03.558 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2023-12-05T09:51:03.559 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2023-12-05T09:51:03.559 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.00029425 s, 1.7 MB/s 2023-12-05T09:51:03.561 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-05T09:51:03.609 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-12-05T09:51:03.610 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/scratch_devs of=/dev/stdout 2023-12-05T09:51:03.661 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-05T09:51:03.662 DEBUG:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_1 2023-12-05T09:51:03.711 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-05T09:51:03.711 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-05T09:51:03.711 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 5h/5d Inode: 448 Links: 1 2023-12-05T09:51:03.711 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-05T09:51:03.711 INFO:teuthology.orchestra.run.smithi150.stdout:Context: system_u:object_r:device_t:s0 2023-12-05T09:51:03.712 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2023-12-05 09:50:52.646592302 +0000 2023-12-05T09:51:03.712 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2023-12-05 09:42:23.161814301 +0000 2023-12-05T09:51:03.712 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2023-12-05 09:42:23.161814301 +0000 2023-12-05T09:51:03.712 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: 2023-12-05 09:42:23.136814775 +0000 2023-12-05T09:51:03.712 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-05T09:51:03.781 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2023-12-05T09:51:03.781 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2023-12-05T09:51:03.781 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.000299494 s, 1.7 MB/s 2023-12-05T09:51:03.783 DEBUG:teuthology.orchestra.run.smithi150:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-05T09:51:03.832 DEBUG:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_2 2023-12-05T09:51:03.879 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-05T09:51:03.879 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-05T09:51:03.879 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 5h/5d Inode: 454 Links: 1 2023-12-05T09:51:03.879 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-05T09:51:03.880 INFO:teuthology.orchestra.run.smithi150.stdout:Context: system_u:object_r:device_t:s0 2023-12-05T09:51:03.880 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2023-12-05 09:50:52.646592302 +0000 2023-12-05T09:51:03.880 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2023-12-05 09:42:24.021797993 +0000 2023-12-05T09:51:03.880 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2023-12-05 09:42:24.021797993 +0000 2023-12-05T09:51:03.880 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: 2023-12-05 09:42:23.995798486 +0000 2023-12-05T09:51:03.880 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-05T09:51:03.986 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2023-12-05T09:51:03.987 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2023-12-05T09:51:03.987 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.000292673 s, 1.7 MB/s 2023-12-05T09:51:03.989 DEBUG:teuthology.orchestra.run.smithi150:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-05T09:51:04.038 DEBUG:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_3 2023-12-05T09:51:04.085 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-05T09:51:04.085 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-05T09:51:04.085 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 5h/5d Inode: 460 Links: 1 2023-12-05T09:51:04.086 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-05T09:51:04.086 INFO:teuthology.orchestra.run.smithi150.stdout:Context: system_u:object_r:device_t:s0 2023-12-05T09:51:04.086 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2023-12-05 09:50:52.646592302 +0000 2023-12-05T09:51:04.086 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2023-12-05 09:42:24.874781818 +0000 2023-12-05T09:51:04.086 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2023-12-05 09:42:24.874781818 +0000 2023-12-05T09:51:04.086 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: 2023-12-05 09:42:24.847782329 +0000 2023-12-05T09:51:04.087 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-05T09:51:04.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:03 smithi150 ceph-mon[116142]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:51:04.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:03 smithi150 ceph-mon[116142]: Reconfiguring mon.smithi100 (unknown last config time)... 2023-12-05T09:51:04.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:03 smithi150 ceph-mon[116142]: Reconfiguring daemon mon.smithi100 on smithi100 2023-12-05T09:51:04.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:03 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:04.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:03 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:04.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:03 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi100.ehmuhg", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-05T09:51:04.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:03 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-05T09:51:04.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:03 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:51:04.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:03 smithi100 ceph-mon[107145]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:51:04.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:03 smithi100 ceph-mon[107145]: Reconfiguring mon.smithi100 (unknown last config time)... 2023-12-05T09:51:04.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:03 smithi100 ceph-mon[107145]: Reconfiguring daemon mon.smithi100 on smithi100 2023-12-05T09:51:04.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:03 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:04.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:03 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:04.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:03 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi100.ehmuhg", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-05T09:51:04.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:03 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-05T09:51:04.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:03 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:51:04.163 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2023-12-05T09:51:04.163 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2023-12-05T09:51:04.163 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.000310457 s, 1.6 MB/s 2023-12-05T09:51:04.165 DEBUG:teuthology.orchestra.run.smithi150:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-05T09:51:04.213 DEBUG:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_4 2023-12-05T09:51:04.259 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-05T09:51:04.260 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-05T09:51:04.260 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 5h/5d Inode: 466 Links: 1 2023-12-05T09:51:04.260 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-05T09:51:04.260 INFO:teuthology.orchestra.run.smithi150.stdout:Context: system_u:object_r:device_t:s0 2023-12-05T09:51:04.260 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2023-12-05 09:50:52.646592302 +0000 2023-12-05T09:51:04.260 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2023-12-05 09:42:25.759765035 +0000 2023-12-05T09:51:04.260 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2023-12-05 09:42:25.759765035 +0000 2023-12-05T09:51:04.260 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: 2023-12-05 09:42:25.733765528 +0000 2023-12-05T09:51:04.260 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-05T09:51:04.367 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2023-12-05T09:51:04.367 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2023-12-05T09:51:04.367 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.000279432 s, 1.8 MB/s 2023-12-05T09:51:04.369 DEBUG:teuthology.orchestra.run.smithi150:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-05T09:51:04.418 INFO:tasks.cephadm:Deploying osd.0 on smithi100 with /dev/vg_nvme/lv_4... 2023-12-05T09:51:04.418 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-12-05T09:51:04.905 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi100/config 2023-12-05T09:51:05.074 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:04 smithi100 ceph-mon[107145]: Reconfiguring mgr.smithi100.ehmuhg (unknown last config time)... 2023-12-05T09:51:05.074 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:04 smithi100 ceph-mon[107145]: Reconfiguring daemon mgr.smithi100.ehmuhg on smithi100 2023-12-05T09:51:05.074 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:04 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:05.074 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:04 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:05.075 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:04 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi100", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-05T09:51:05.075 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:04 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:51:05.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:04 smithi150 ceph-mon[116142]: Reconfiguring mgr.smithi100.ehmuhg (unknown last config time)... 2023-12-05T09:51:05.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:04 smithi150 ceph-mon[116142]: Reconfiguring daemon mgr.smithi100.ehmuhg on smithi100 2023-12-05T09:51:05.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:04 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:05.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:04 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:05.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:04 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi100", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-05T09:51:05.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:04 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:51:06.101 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:05 smithi100 ceph-mon[107145]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:51:06.101 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:05 smithi100 ceph-mon[107145]: Reconfiguring crash.smithi100 (monmap changed)... 2023-12-05T09:51:06.101 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:05 smithi100 ceph-mon[107145]: Reconfiguring daemon crash.smithi100 on smithi100 2023-12-05T09:51:06.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:05 smithi150 ceph-mon[116142]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:51:06.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:05 smithi150 ceph-mon[116142]: Reconfiguring crash.smithi100 (monmap changed)... 2023-12-05T09:51:06.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:05 smithi150 ceph-mon[116142]: Reconfiguring daemon crash.smithi100 on smithi100 2023-12-05T09:51:06.827 INFO:teuthology.orchestra.run.smithi100.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-12-05T09:51:06.828 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-12-05T09:51:06.828 INFO:teuthology.orchestra.run.smithi100.stderr: stderr: 10+0 records in 2023-12-05T09:51:06.828 INFO:teuthology.orchestra.run.smithi100.stderr:10+0 records out 2023-12-05T09:51:06.828 INFO:teuthology.orchestra.run.smithi100.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0568774 s, 184 MB/s 2023-12-05T09:51:06.828 INFO:teuthology.orchestra.run.smithi100.stderr:--> Zapping successful for: 2023-12-05T09:51:07.252 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- ceph orch daemon add osd smithi100:vg_nvme/lv_4 2023-12-05T09:51:07.489 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:07 smithi100 ceph-mon[107145]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:51:07.489 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:07 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:07.489 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:07 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:07.489 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:07 smithi100 ceph-mon[107145]: Reconfiguring alertmanager.smithi100 (dependencies changed)... 2023-12-05T09:51:07.489 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:07 smithi100 ceph-mon[107145]: Reconfiguring daemon alertmanager.smithi100 on smithi100 2023-12-05T09:51:07.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:07 smithi150 ceph-mon[116142]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:51:07.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:07 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:07.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:07 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:07.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:07 smithi150 ceph-mon[116142]: Reconfiguring alertmanager.smithi100 (dependencies changed)... 2023-12-05T09:51:07.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:07 smithi150 ceph-mon[116142]: Reconfiguring daemon alertmanager.smithi100 on smithi100 2023-12-05T09:51:08.087 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi100/config 2023-12-05T09:51:09.465 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:09 smithi100 ceph-mon[107145]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:51:09.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:09 smithi150 ceph-mon[116142]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:51:09.889 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:09.891+0000 7f6955a14700 1 -- 172.21.15.100:0/557711198 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69500fd730 msgr2=0x7f69500ffb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:51:09.890 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:09.891+0000 7f6955a14700 1 --2- 172.21.15.100:0/557711198 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69500fd730 0x7f69500ffb10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6940004940 tx=0x7f6940009e30 comp rx=0 tx=0).stop 2023-12-05T09:51:09.890 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:09.891+0000 7f6955a14700 1 -- 172.21.15.100:0/557711198 shutdown_connections 2023-12-05T09:51:09.890 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:09.891+0000 7f6955a14700 1 --2- 172.21.15.100:0/557711198 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6950100050 0x7f6950102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:51:09.890 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:09.891+0000 7f6955a14700 1 --2- 172.21.15.100:0/557711198 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69500fd730 0x7f69500ffb10 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:51:09.890 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:09.891+0000 7f6955a14700 1 -- 172.21.15.100:0/557711198 >> 172.21.15.100:0/557711198 conn(0x7f69500f71d0 msgr2=0x7f69500f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:51:09.890 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:09.891+0000 7f6955a14700 1 -- 172.21.15.100:0/557711198 shutdown_connections 2023-12-05T09:51:09.890 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:09.892+0000 7f6955a14700 1 -- 172.21.15.100:0/557711198 wait complete. 2023-12-05T09:51:09.891 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:09.892+0000 7f6955a14700 1 Processor -- start 2023-12-05T09:51:09.891 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:09.892+0000 7f6955a14700 1 -- start start 2023-12-05T09:51:09.891 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:09.893+0000 7f6955a14700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69500fd730 0x7f69500fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:51:09.891 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:09.893+0000 7f6955a14700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6950100050 0x7f69500fb640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:51:09.891 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:09.893+0000 7f6955a14700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69500fbc40 con 0x7f6950100050 2023-12-05T09:51:09.891 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:09.893+0000 7f6955a14700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69500fbdb0 con 0x7f69500fd730 2023-12-05T09:51:09.891 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:09.893+0000 7f694e7fc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6950100050 0x7f69500fb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:51:09.891 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:09.893+0000 7f694e7fc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6950100050 0x7f69500fb640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39930/0 (socket says 172.21.15.100:39930) 2023-12-05T09:51:09.892 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:09.893+0000 7f694e7fc700 1 -- 172.21.15.100:0/1505305830 learned_addr learned my addr 172.21.15.100:0/1505305830 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:51:09.892 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:09.893+0000 7f694effd700 1 --2- 172.21.15.100:0/1505305830 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69500fd730 0x7f69500fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:51:09.892 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:09.894+0000 7f694e7fc700 1 -- 172.21.15.100:0/1505305830 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69500fd730 msgr2=0x7f69500fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:51:09.892 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:09.894+0000 7f694e7fc700 1 --2- 172.21.15.100:0/1505305830 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69500fd730 0x7f69500fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:51:09.892 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:09.894+0000 7f694e7fc700 1 -- 172.21.15.100:0/1505305830 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6940005040 con 0x7f6950100050 2023-12-05T09:51:09.892 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:09.894+0000 7f694e7fc700 1 --2- 172.21.15.100:0/1505305830 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6950100050 0x7f69500fb640 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f694400c830 tx=0x7f6944004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:51:09.893 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:09.894+0000 7f69377fe700 1 -- 172.21.15.100:0/1505305830 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69440106f0 con 0x7f6950100050 2023-12-05T09:51:09.893 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:09.894+0000 7f69377fe700 1 -- 172.21.15.100:0/1505305830 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6944010d00 con 0x7f6950100050 2023-12-05T09:51:09.893 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:09.894+0000 7f69377fe700 1 -- 172.21.15.100:0/1505305830 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6944012e90 con 0x7f6950100050 2023-12-05T09:51:09.893 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:09.894+0000 7f6955a14700 1 -- 172.21.15.100:0/1505305830 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69500fc090 con 0x7f6950100050 2023-12-05T09:51:09.893 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:09.894+0000 7f6955a14700 1 -- 172.21.15.100:0/1505305830 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6950115540 con 0x7f6950100050 2023-12-05T09:51:09.893 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:09.896+0000 7f6955a14700 1 -- 172.21.15.100:0/1505305830 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69501075c0 con 0x7f6950100050 2023-12-05T09:51:09.894 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:09.896+0000 7f69377fe700 1 -- 172.21.15.100:0/1505305830 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) v1 ==== 86393+0+0 (secure 0 0 0) 0x7f6944010850 con 0x7f6950100050 2023-12-05T09:51:09.895 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:09.897+0000 7f69377fe700 1 --2- 172.21.15.100:0/1505305830 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f6938068ed0 0x7f693806b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:51:09.895 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:09.898+0000 7f69377fe700 1 -- 172.21.15.100:0/1505305830 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f6944085d00 con 0x7f6950100050 2023-12-05T09:51:09.895 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:09.898+0000 7f694effd700 1 --2- 172.21.15.100:0/1505305830 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f6938068ed0 0x7f693806b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:51:09.896 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:09.899+0000 7f694effd700 1 --2- 172.21.15.100:0/1505305830 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f6938068ed0 0x7f693806b380 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f694000b7d0 tx=0x7f6940009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:51:09.900 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:09.902+0000 7f69377fe700 1 -- 172.21.15.100:0/1505305830 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f6944056ca0 con 0x7f6950100050 2023-12-05T09:51:10.111 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:10.113+0000 7f6955a14700 1 -- 172.21.15.100:0/1505305830 --> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f695002b150 con 0x7f6938068ed0 2023-12-05T09:51:10.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:10 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-05T09:51:10.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:10 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-05T09:51:10.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:10 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:51:10.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:10 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-05T09:51:10.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:10 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-05T09:51:10.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:10 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:51:11.806 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:11 smithi100 ceph-mon[107145]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:51:11.806 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:11 smithi100 ceph-mon[107145]: from='client.14246 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:51:11.807 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:11 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:11.807 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:11 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:11.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:11 smithi150 ceph-mon[116142]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:51:11.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:11 smithi150 ceph-mon[116142]: from='client.14246 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:51:11.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:11 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:11.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:11 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:12.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:12 smithi150 ceph-mon[116142]: Reconfiguring grafana.smithi100 (dependencies changed)... 2023-12-05T09:51:12.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:12 smithi150 ceph-mon[116142]: Reconfiguring daemon grafana.smithi100 on smithi100 2023-12-05T09:51:12.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:12 smithi100 ceph-mon[107145]: Reconfiguring grafana.smithi100 (dependencies changed)... 2023-12-05T09:51:12.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:12 smithi100 ceph-mon[107145]: Reconfiguring daemon grafana.smithi100 on smithi100 2023-12-05T09:51:13.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:13 smithi150 ceph-mon[116142]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:51:13.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:13 smithi150 ceph-mon[116142]: from='client.? 172.21.15.100:0/3230421235' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9f3faeed-8336-4509-9127-eafa0273ecea"}]: dispatch 2023-12-05T09:51:13.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:13 smithi150 ceph-mon[116142]: from='client.? 172.21.15.100:0/3230421235' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9f3faeed-8336-4509-9127-eafa0273ecea"}]': finished 2023-12-05T09:51:13.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:13 smithi150 ceph-mon[116142]: osdmap e6: 1 total, 0 up, 1 in 2023-12-05T09:51:13.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:13 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-05T09:51:13.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:13 smithi100 ceph-mon[107145]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:51:13.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:13 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/3230421235' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9f3faeed-8336-4509-9127-eafa0273ecea"}]: dispatch 2023-12-05T09:51:13.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:13 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/3230421235' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9f3faeed-8336-4509-9127-eafa0273ecea"}]': finished 2023-12-05T09:51:13.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:13 smithi100 ceph-mon[107145]: osdmap e6: 1 total, 0 up, 1 in 2023-12-05T09:51:13.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:13 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-05T09:51:14.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:14 smithi150 ceph-mon[116142]: from='client.? 172.21.15.100:0/1591193503' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-05T09:51:14.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:14 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/1591193503' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-05T09:51:15.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:15 smithi150 ceph-mon[116142]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:51:15.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:15 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:51:15.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:15 smithi100 ceph-mon[107145]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:51:15.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:15 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:51:17.688 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:17 smithi100 ceph-mon[107145]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:51:17.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:17 smithi150 ceph-mon[116142]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:51:19.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:19 smithi100 ceph-mon[107145]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:51:19.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:19 smithi150 ceph-mon[116142]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:51:21.850 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:21 smithi100 ceph-mon[107145]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:51:21.850 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:21 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:21.851 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:21 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:21.851 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:21 smithi100 ceph-mon[107145]: Reconfiguring prometheus.smithi100 (dependencies changed)... 2023-12-05T09:51:21.851 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:21 smithi100 ceph-mon[107145]: Reconfiguring daemon prometheus.smithi100 on smithi100 2023-12-05T09:51:22.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:21 smithi150 ceph-mon[116142]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:51:22.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:21 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:22.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:21 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:22.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:21 smithi150 ceph-mon[116142]: Reconfiguring prometheus.smithi100 (dependencies changed)... 2023-12-05T09:51:22.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:21 smithi150 ceph-mon[116142]: Reconfiguring daemon prometheus.smithi100 on smithi100 2023-12-05T09:51:22.877 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:22 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-05T09:51:22.877 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:22 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:51:23.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:22 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-05T09:51:23.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:22 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:51:23.743 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:23 smithi100 ceph-mon[107145]: Deploying daemon osd.0 on smithi100 2023-12-05T09:51:23.743 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:23 smithi100 ceph-mon[107145]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:51:24.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:23 smithi150 ceph-mon[116142]: Deploying daemon osd.0 on smithi100 2023-12-05T09:51:24.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:23 smithi150 ceph-mon[116142]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:51:25.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:25 smithi100 ceph-mon[107145]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:51:25.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:25 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:25.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:25 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:25.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:25 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi150", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-05T09:51:25.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:25 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:51:26.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:25 smithi150 ceph-mon[116142]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:51:26.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:25 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:26.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:25 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:26.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:25 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi150", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-05T09:51:26.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:25 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:51:26.842 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:26 smithi100 ceph-mon[107145]: Reconfiguring crash.smithi150 (monmap changed)... 2023-12-05T09:51:26.842 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:26 smithi100 ceph-mon[107145]: Reconfiguring daemon crash.smithi150 on smithi150 2023-12-05T09:51:26.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:26 smithi150 ceph-mon[116142]: Reconfiguring crash.smithi150 (monmap changed)... 2023-12-05T09:51:26.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:26 smithi150 ceph-mon[116142]: Reconfiguring daemon crash.smithi150 on smithi150 2023-12-05T09:51:28.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:27 smithi150 ceph-mon[116142]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:51:28.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:27 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:28.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:27 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:28.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:27 smithi150 ceph-mon[116142]: Reconfiguring mgr.smithi150.zkskag (monmap changed)... 2023-12-05T09:51:28.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:27 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi150.zkskag", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-05T09:51:28.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:27 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-05T09:51:28.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:27 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:51:28.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:27 smithi150 ceph-mon[116142]: Reconfiguring daemon mgr.smithi150.zkskag on smithi150 2023-12-05T09:51:28.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:27 smithi100 ceph-mon[107145]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:51:28.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:27 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:28.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:27 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:28.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:27 smithi100 ceph-mon[107145]: Reconfiguring mgr.smithi150.zkskag (monmap changed)... 2023-12-05T09:51:28.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:27 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi150.zkskag", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-05T09:51:28.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:27 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-05T09:51:28.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:27 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:51:28.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:27 smithi100 ceph-mon[107145]: Reconfiguring daemon mgr.smithi150.zkskag on smithi150 2023-12-05T09:51:29.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:28 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:29.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:28 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:29.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:28 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-05T09:51:29.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:28 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-05T09:51:29.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:28 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:51:29.228 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:28 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:29.228 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:28 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:29.228 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:28 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-05T09:51:29.228 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:28 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-05T09:51:29.228 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:28 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:51:30.314 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:29 smithi100 ceph-mon[107145]: Reconfiguring mon.smithi150 (monmap changed)... 2023-12-05T09:51:30.314 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:29 smithi100 ceph-mon[107145]: Reconfiguring daemon mon.smithi150 on smithi150 2023-12-05T09:51:30.314 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:29 smithi100 ceph-mon[107145]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:51:30.314 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:29 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:30.314 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:29 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:30.315 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:29 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-05T09:51:30.315 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:29 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi100.front.sepia.ceph.com:9093"}]: dispatch 2023-12-05T09:51:30.315 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:29 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:30.315 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:29 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-05T09:51:30.315 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:29 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi100.front.sepia.ceph.com:3000"}]: dispatch 2023-12-05T09:51:30.315 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:29 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:30.315 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:29 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-05T09:51:30.316 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:29 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi100.front.sepia.ceph.com:9095"}]: dispatch 2023-12-05T09:51:30.316 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:29 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:30.316 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:29 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:51:30.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:29 smithi150 ceph-mon[116142]: Reconfiguring mon.smithi150 (monmap changed)... 2023-12-05T09:51:30.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:29 smithi150 ceph-mon[116142]: Reconfiguring daemon mon.smithi150 on smithi150 2023-12-05T09:51:30.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:29 smithi150 ceph-mon[116142]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:51:30.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:29 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:30.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:29 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:30.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:29 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-05T09:51:30.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:29 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi100.front.sepia.ceph.com:9093"}]: dispatch 2023-12-05T09:51:30.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:29 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:30.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:29 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-05T09:51:30.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:29 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi100.front.sepia.ceph.com:3000"}]: dispatch 2023-12-05T09:51:30.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:29 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:30.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:29 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-05T09:51:30.347 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:29 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi100.front.sepia.ceph.com:9095"}]: dispatch 2023-12-05T09:51:30.347 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:29 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:30.347 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:29 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:51:31.136 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:30 smithi100 ceph-mon[107145]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-05T09:51:31.136 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:30 smithi100 ceph-mon[107145]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi100.front.sepia.ceph.com:9093"}]: dispatch 2023-12-05T09:51:31.136 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:30 smithi100 ceph-mon[107145]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-05T09:51:31.136 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:30 smithi100 ceph-mon[107145]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi100.front.sepia.ceph.com:3000"}]: dispatch 2023-12-05T09:51:31.136 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:30 smithi100 ceph-mon[107145]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-05T09:51:31.136 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:30 smithi100 ceph-mon[107145]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi100.front.sepia.ceph.com:9095"}]: dispatch 2023-12-05T09:51:31.136 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:30 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:31.136 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:30 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:31.136 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:30 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:51:31.136 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:30 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:31.137 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:30 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:31.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:30 smithi150 ceph-mon[116142]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-05T09:51:31.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:30 smithi150 ceph-mon[116142]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi100.front.sepia.ceph.com:9093"}]: dispatch 2023-12-05T09:51:31.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:30 smithi150 ceph-mon[116142]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-05T09:51:31.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:30 smithi150 ceph-mon[116142]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi100.front.sepia.ceph.com:3000"}]: dispatch 2023-12-05T09:51:31.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:30 smithi150 ceph-mon[116142]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-05T09:51:31.347 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:30 smithi150 ceph-mon[116142]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi100.front.sepia.ceph.com:9095"}]: dispatch 2023-12-05T09:51:31.347 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:30 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:31.347 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:30 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:31.347 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:30 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:51:31.347 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:30 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:31.347 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:30 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:32.091 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:31 smithi100 ceph-mon[107145]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:51:32.345 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:31 smithi150 ceph-mon[116142]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:51:33.128 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:33.130+0000 7f69377fe700 1 -- 172.21.15.100:0/1505305830 <== mgr.14210 v2:172.21.15.100:6800/1237547575 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f695002b150 con 0x7f6938068ed0 2023-12-05T09:51:33.128 INFO:teuthology.orchestra.run.smithi100.stdout:Created osd(s) 0 on host 'smithi100' 2023-12-05T09:51:33.130 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:33.132+0000 7f6955a14700 1 -- 172.21.15.100:0/1505305830 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f6938068ed0 msgr2=0x7f693806b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:51:33.131 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:33.132+0000 7f6955a14700 1 --2- 172.21.15.100:0/1505305830 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f6938068ed0 0x7f693806b380 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f694000b7d0 tx=0x7f6940009e30 comp rx=0 tx=0).stop 2023-12-05T09:51:33.131 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:33.133+0000 7f6955a14700 1 -- 172.21.15.100:0/1505305830 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6950100050 msgr2=0x7f69500fb640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:51:33.131 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:33.133+0000 7f6955a14700 1 --2- 172.21.15.100:0/1505305830 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6950100050 0x7f69500fb640 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f694400c830 tx=0x7f6944004470 comp rx=0 tx=0).stop 2023-12-05T09:51:33.131 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:33.133+0000 7f6955a14700 1 -- 172.21.15.100:0/1505305830 shutdown_connections 2023-12-05T09:51:33.131 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:33.133+0000 7f6955a14700 1 --2- 172.21.15.100:0/1505305830 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f6938068ed0 0x7f693806b380 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:51:33.131 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:33.133+0000 7f6955a14700 1 --2- 172.21.15.100:0/1505305830 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69500fd730 0x7f69500fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:51:33.131 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:33.133+0000 7f6955a14700 1 --2- 172.21.15.100:0/1505305830 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6950100050 0x7f69500fb640 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:51:33.131 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:33.133+0000 7f6955a14700 1 -- 172.21.15.100:0/1505305830 >> 172.21.15.100:0/1505305830 conn(0x7f69500f71d0 msgr2=0x7f69500f95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:51:33.131 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:33.133+0000 7f6955a14700 1 -- 172.21.15.100:0/1505305830 shutdown_connections 2023-12-05T09:51:33.131 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:33.133+0000 7f6955a14700 1 -- 172.21.15.100:0/1505305830 wait complete. 2023-12-05T09:51:33.345 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:32 smithi150 ceph-mon[116142]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:51:33.348 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:32 smithi100 ceph-mon[107145]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:51:33.867 DEBUG:teuthology.orchestra.run.smithi100:osd.0> sudo journalctl -f -n 0 -u ceph-5b035ce6-9353-11ee-95a2-87774f69a715@osd.0.service 2023-12-05T09:51:33.871 INFO:tasks.cephadm:Deploying osd.1 on smithi100 with /dev/vg_nvme/lv_3... 2023-12-05T09:51:33.872 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-12-05T09:51:33.944 INFO:journalctl@ceph.osd.0.smithi100.stdout:-- Logs begin at Tue 2023-12-05 09:30:11 UTC. -- 2023-12-05T09:51:34.116 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:34 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:34.116 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:34 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:34.116 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:34 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:34.116 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:34 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:34.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:34 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:34.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:34 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:34.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:34 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:34.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:34 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:34.379 INFO:journalctl@ceph.osd.0.smithi100.stdout:Dec 05 09:51:34 smithi100 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-0[130830]: 2023-12-05T09:51:34.117+0000 7f3135933540 -1 osd.0 0 log_to_monitors true 2023-12-05T09:51:34.943 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi100/config 2023-12-05T09:51:35.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:35 smithi150 ceph-mon[116142]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:51:35.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:35 smithi150 ceph-mon[116142]: from='osd.0 [v2:172.21.15.100:6802/2938979601,v1:172.21.15.100:6803/2938979601]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-12-05T09:51:35.350 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:35 smithi100 ceph-mon[107145]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:51:35.350 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:35 smithi100 ceph-mon[107145]: from='osd.0 [v2:172.21.15.100:6802/2938979601,v1:172.21.15.100:6803/2938979601]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-12-05T09:51:36.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:36 smithi100 ceph-mon[107145]: from='osd.0 [v2:172.21.15.100:6802/2938979601,v1:172.21.15.100:6803/2938979601]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-12-05T09:51:36.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:36 smithi100 ceph-mon[107145]: osdmap e7: 1 total, 0 up, 1 in 2023-12-05T09:51:36.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:36 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-05T09:51:36.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:36 smithi100 ceph-mon[107145]: from='osd.0 [v2:172.21.15.100:6802/2938979601,v1:172.21.15.100:6803/2938979601]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2023-12-05T09:51:36.397 INFO:journalctl@ceph.osd.0.smithi100.stdout:Dec 05 09:51:36 smithi100 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-0[130830]: 2023-12-05T09:51:36.105+0000 7f312d91b700 -1 osd.0 0 waiting for initial osdmap 2023-12-05T09:51:36.397 INFO:journalctl@ceph.osd.0.smithi100.stdout:Dec 05 09:51:36 smithi100 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-0[130830]: 2023-12-05T09:51:36.110+0000 7f3127714700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-05T09:51:36.595 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:36 smithi150 ceph-mon[116142]: from='osd.0 [v2:172.21.15.100:6802/2938979601,v1:172.21.15.100:6803/2938979601]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-12-05T09:51:36.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:36 smithi150 ceph-mon[116142]: osdmap e7: 1 total, 0 up, 1 in 2023-12-05T09:51:36.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:36 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-05T09:51:36.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:36 smithi150 ceph-mon[116142]: from='osd.0 [v2:172.21.15.100:6802/2938979601,v1:172.21.15.100:6803/2938979601]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2023-12-05T09:51:36.879 INFO:teuthology.orchestra.run.smithi100.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-12-05T09:51:36.879 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-12-05T09:51:36.879 INFO:teuthology.orchestra.run.smithi100.stderr: stderr: 10+0 records in 2023-12-05T09:51:36.879 INFO:teuthology.orchestra.run.smithi100.stderr:10+0 records out 2023-12-05T09:51:36.879 INFO:teuthology.orchestra.run.smithi100.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.042023 s, 250 MB/s 2023-12-05T09:51:36.879 INFO:teuthology.orchestra.run.smithi100.stderr:--> Zapping successful for: 2023-12-05T09:51:37.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:37 smithi100 ceph-mon[107145]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:51:37.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:37 smithi100 ceph-mon[107145]: from='osd.0 [v2:172.21.15.100:6802/2938979601,v1:172.21.15.100:6803/2938979601]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2023-12-05T09:51:37.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:37 smithi100 ceph-mon[107145]: osdmap e8: 1 total, 0 up, 1 in 2023-12-05T09:51:37.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:37 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-05T09:51:37.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:37 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-05T09:51:37.482 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- ceph orch daemon add osd smithi100:vg_nvme/lv_3 2023-12-05T09:51:37.595 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:37 smithi150 ceph-mon[116142]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:51:37.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:37 smithi150 ceph-mon[116142]: from='osd.0 [v2:172.21.15.100:6802/2938979601,v1:172.21.15.100:6803/2938979601]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2023-12-05T09:51:37.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:37 smithi150 ceph-mon[116142]: osdmap e8: 1 total, 0 up, 1 in 2023-12-05T09:51:37.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:37 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-05T09:51:37.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:37 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-05T09:51:38.024 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi100/config 2023-12-05T09:51:38.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:38 smithi100 ceph-mon[107145]: purged_snaps scrub starts 2023-12-05T09:51:38.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:38 smithi100 ceph-mon[107145]: purged_snaps scrub ok 2023-12-05T09:51:38.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:38 smithi100 ceph-mon[107145]: osd.0 [v2:172.21.15.100:6802/2938979601,v1:172.21.15.100:6803/2938979601] boot 2023-12-05T09:51:38.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:38 smithi100 ceph-mon[107145]: osdmap e9: 1 total, 1 up, 1 in 2023-12-05T09:51:38.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:38 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-05T09:51:38.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:38 smithi100 ceph-mon[107145]: Detected new or changed devices on smithi100 2023-12-05T09:51:38.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:38 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:38.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:38 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:38.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:38 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:51:38.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:38 smithi100 ceph-mon[107145]: Adjusting osd_memory_target on smithi100 to 13047M 2023-12-05T09:51:38.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:38 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:38.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:38 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:51:38.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:38 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:51:38.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:38 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:38.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:38 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:51:38.434 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:38 smithi150 ceph-mon[116142]: purged_snaps scrub starts 2023-12-05T09:51:38.434 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:38 smithi150 ceph-mon[116142]: purged_snaps scrub ok 2023-12-05T09:51:38.434 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:38 smithi150 ceph-mon[116142]: osd.0 [v2:172.21.15.100:6802/2938979601,v1:172.21.15.100:6803/2938979601] boot 2023-12-05T09:51:38.435 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:38 smithi150 ceph-mon[116142]: osdmap e9: 1 total, 1 up, 1 in 2023-12-05T09:51:38.435 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:38 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-05T09:51:38.435 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:38 smithi150 ceph-mon[116142]: Detected new or changed devices on smithi100 2023-12-05T09:51:38.435 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:38 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:38.435 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:38 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:38.435 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:38 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:51:38.435 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:38 smithi150 ceph-mon[116142]: Adjusting osd_memory_target on smithi100 to 13047M 2023-12-05T09:51:38.435 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:38 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:38.435 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:38 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:51:38.435 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:38 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:51:38.435 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:38 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:38.435 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:38 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:51:39.341 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:39.343+0000 7ff3eb9d9700 1 -- 172.21.15.100:0/980748663 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3e40fde00 msgr2=0x7ff3e40fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:51:39.341 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:39.343+0000 7ff3eb9d9700 1 --2- 172.21.15.100:0/980748663 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3e40fde00 0x7ff3e40fe250 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff3d4004940 tx=0x7ff3d4009e30 comp rx=0 tx=0).stop 2023-12-05T09:51:39.341 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:39.343+0000 7ff3eb9d9700 1 -- 172.21.15.100:0/980748663 shutdown_connections 2023-12-05T09:51:39.341 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:39.343+0000 7ff3eb9d9700 1 --2- 172.21.15.100:0/980748663 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3e40fde00 0x7ff3e40fe250 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:51:39.341 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:39.343+0000 7ff3eb9d9700 1 --2- 172.21.15.100:0/980748663 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3e40fcbf0 0x7ff3e40fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:51:39.341 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:39.343+0000 7ff3eb9d9700 1 -- 172.21.15.100:0/980748663 >> 172.21.15.100:0/980748663 conn(0x7ff3e40f82d0 msgr2=0x7ff3e40fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:51:39.341 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:39.343+0000 7ff3eb9d9700 1 -- 172.21.15.100:0/980748663 shutdown_connections 2023-12-05T09:51:39.341 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:39.343+0000 7ff3eb9d9700 1 -- 172.21.15.100:0/980748663 wait complete. 2023-12-05T09:51:39.343 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:39.344+0000 7ff3eb9d9700 1 Processor -- start 2023-12-05T09:51:39.343 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:39.344+0000 7ff3eb9d9700 1 -- start start 2023-12-05T09:51:39.343 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:39.344+0000 7ff3eb9d9700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3e40fcbf0 0x7ff3e410d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:51:39.343 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:39.344+0000 7ff3eb9d9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3e40fde00 0x7ff3e410da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:51:39.343 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:39.344+0000 7ff3eb9d9700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e410e030 con 0x7ff3e40fcbf0 2023-12-05T09:51:39.343 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:39.344+0000 7ff3eb9d9700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e410e8d0 con 0x7ff3e40fde00 2023-12-05T09:51:39.343 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:39.345+0000 7ff3e9775700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3e40fcbf0 0x7ff3e410d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:51:39.343 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:39.345+0000 7ff3e9775700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3e40fcbf0 0x7ff3e410d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34260/0 (socket says 172.21.15.100:34260) 2023-12-05T09:51:39.343 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:39.345+0000 7ff3e9775700 1 -- 172.21.15.100:0/1547125513 learned_addr learned my addr 172.21.15.100:0/1547125513 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:51:39.343 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:39.345+0000 7ff3e8f74700 1 --2- 172.21.15.100:0/1547125513 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3e40fde00 0x7ff3e410da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:51:39.343 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:39.345+0000 7ff3e9775700 1 -- 172.21.15.100:0/1547125513 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3e40fde00 msgr2=0x7ff3e410da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:51:39.344 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:39.345+0000 7ff3e9775700 1 --2- 172.21.15.100:0/1547125513 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3e40fde00 0x7ff3e410da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:51:39.344 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:39.345+0000 7ff3e9775700 1 -- 172.21.15.100:0/1547125513 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3d4005040 con 0x7ff3e40fcbf0 2023-12-05T09:51:39.344 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:39.345+0000 7ff3e9775700 1 --2- 172.21.15.100:0/1547125513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3e40fcbf0 0x7ff3e410d4f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff3e000eb70 tx=0x7ff3e000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:51:39.344 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:39.345+0000 7ff3d9ffb700 1 -- 172.21.15.100:0/1547125513 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff3e0007cc0 con 0x7ff3e40fcbf0 2023-12-05T09:51:39.344 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:39.345+0000 7ff3eb9d9700 1 -- 172.21.15.100:0/1547125513 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3e410eb50 con 0x7ff3e40fcbf0 2023-12-05T09:51:39.344 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:39.345+0000 7ff3d9ffb700 1 -- 172.21.15.100:0/1547125513 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff3e000f040 con 0x7ff3e40fcbf0 2023-12-05T09:51:39.344 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:39.346+0000 7ff3d9ffb700 1 -- 172.21.15.100:0/1547125513 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff3e000c9d0 con 0x7ff3e40fcbf0 2023-12-05T09:51:39.344 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:39.346+0000 7ff3eb9d9700 1 -- 172.21.15.100:0/1547125513 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3e410f090 con 0x7ff3e40fcbf0 2023-12-05T09:51:39.344 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:39.347+0000 7ff3eb9d9700 1 -- 172.21.15.100:0/1547125513 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3e404bb80 con 0x7ff3e40fcbf0 2023-12-05T09:51:39.345 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:39 smithi150 ceph-mon[116142]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:51:39.345 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:39 smithi150 ceph-mon[116142]: osdmap e10: 1 total, 1 up, 1 in 2023-12-05T09:51:39.346 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:39.349+0000 7ff3d9ffb700 1 -- 172.21.15.100:0/1547125513 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) v1 ==== 86393+0+0 (secure 0 0 0) 0x7ff3e000cc40 con 0x7ff3e40fcbf0 2023-12-05T09:51:39.347 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:39.349+0000 7ff3d9ffb700 1 --2- 172.21.15.100:0/1547125513 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7ff3d0068ed0 0x7ff3d006b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:51:39.347 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:39.350+0000 7ff3d9ffb700 1 -- 172.21.15.100:0/1547125513 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1978+0+0 (secure 0 0 0) 0x7ff3e00859a0 con 0x7ff3e40fcbf0 2023-12-05T09:51:39.347 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:39.350+0000 7ff3e8f74700 1 --2- 172.21.15.100:0/1547125513 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7ff3d0068ed0 0x7ff3d006b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:51:39.348 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:39.350+0000 7ff3e8f74700 1 --2- 172.21.15.100:0/1547125513 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7ff3d0068ed0 0x7ff3d006b380 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff3d4013680 tx=0x7ff3d4009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:51:39.351 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:39.354+0000 7ff3d9ffb700 1 -- 172.21.15.100:0/1547125513 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ff3e004da00 con 0x7ff3e40fcbf0 2023-12-05T09:51:39.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:39 smithi100 ceph-mon[107145]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:51:39.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:39 smithi100 ceph-mon[107145]: osdmap e10: 1 total, 1 up, 1 in 2023-12-05T09:51:39.564 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:39.566+0000 7ff3eb9d9700 1 -- 172.21.15.100:0/1547125513 --> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7ff3e410f6f0 con 0x7ff3d0068ed0 2023-12-05T09:51:40.552 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:40 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:40.552 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:40 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:40.552 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:40 smithi100 ceph-mon[107145]: from='client.14264 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:51:40.552 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:40 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-05T09:51:40.552 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:40 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-05T09:51:40.552 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:40 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:51:40.595 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:40 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:40.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:40 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:40.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:40 smithi150 ceph-mon[116142]: from='client.14264 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:51:40.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:40 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-05T09:51:40.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:40 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-05T09:51:40.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:40 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:51:41.503 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:41 smithi100 ceph-mon[107145]: pgmap v33: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-05T09:51:41.595 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:41 smithi150 ceph-mon[116142]: pgmap v33: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-05T09:51:43.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:43 smithi100 ceph-mon[107145]: pgmap v34: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-05T09:51:43.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:43 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:43.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:43 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:43.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:43 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/2232987744' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6ca8c1e2-e673-4dc4-b02d-c0805493bcf5"}]: dispatch 2023-12-05T09:51:43.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:43 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/2232987744' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6ca8c1e2-e673-4dc4-b02d-c0805493bcf5"}]': finished 2023-12-05T09:51:43.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:43 smithi100 ceph-mon[107145]: osdmap e11: 2 total, 1 up, 2 in 2023-12-05T09:51:43.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:43 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-05T09:51:43.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:43 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:51:43.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:43 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:51:43.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:43 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:43.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:43 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/461168273' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-05T09:51:44.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:43 smithi150 ceph-mon[116142]: pgmap v34: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-05T09:51:44.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:43 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:44.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:43 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:44.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:43 smithi150 ceph-mon[116142]: from='client.? 172.21.15.100:0/2232987744' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6ca8c1e2-e673-4dc4-b02d-c0805493bcf5"}]: dispatch 2023-12-05T09:51:44.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:43 smithi150 ceph-mon[116142]: from='client.? 172.21.15.100:0/2232987744' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6ca8c1e2-e673-4dc4-b02d-c0805493bcf5"}]': finished 2023-12-05T09:51:44.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:43 smithi150 ceph-mon[116142]: osdmap e11: 2 total, 1 up, 2 in 2023-12-05T09:51:44.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:43 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-05T09:51:44.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:43 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:51:44.097 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:43 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:51:44.097 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:43 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:44.097 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:43 smithi150 ceph-mon[116142]: from='client.? 172.21.15.100:0/461168273' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-05T09:51:45.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:45 smithi100 ceph-mon[107145]: pgmap v36: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-05T09:51:45.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:45 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:51:46.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:45 smithi150 ceph-mon[116142]: pgmap v36: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-05T09:51:46.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:45 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:51:47.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:47 smithi100 ceph-mon[107145]: pgmap v37: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-05T09:51:48.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:47 smithi150 ceph-mon[116142]: pgmap v37: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-05T09:51:49.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:49 smithi100 ceph-mon[107145]: pgmap v38: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-05T09:51:50.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:49 smithi150 ceph-mon[116142]: pgmap v38: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-05T09:51:50.865 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:50 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-05T09:51:50.865 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:50 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:51:50.865 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:50 smithi100 ceph-mon[107145]: Deploying daemon osd.1 on smithi100 2023-12-05T09:51:51.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:50 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-05T09:51:51.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:50 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:51:51.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:50 smithi150 ceph-mon[116142]: Deploying daemon osd.1 on smithi100 2023-12-05T09:51:51.833 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:51 smithi100 ceph-mon[107145]: pgmap v39: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-05T09:51:52.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:51 smithi150 ceph-mon[116142]: pgmap v39: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-05T09:51:53.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:53 smithi100 ceph-mon[107145]: pgmap v40: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-05T09:51:54.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:53 smithi150 ceph-mon[116142]: pgmap v40: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-05T09:51:55.690 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:55 smithi100 ceph-mon[107145]: pgmap v41: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-05T09:51:55.690 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:55 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:55.690 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:55 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:55.690 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:55 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:51:55.965 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:55 smithi150 ceph-mon[116142]: pgmap v41: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-05T09:51:55.965 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:55 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:55.965 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:55 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:55.965 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:55 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:51:57.879 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:57.882+0000 7ff3d9ffb700 1 -- 172.21.15.100:0/1547125513 <== mgr.14210 v2:172.21.15.100:6800/1237547575 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7ff3e410f6f0 con 0x7ff3d0068ed0 2023-12-05T09:51:57.880 INFO:teuthology.orchestra.run.smithi100.stdout:Created osd(s) 1 on host 'smithi100' 2023-12-05T09:51:57.882 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:57.884+0000 7ff3eb9d9700 1 -- 172.21.15.100:0/1547125513 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7ff3d0068ed0 msgr2=0x7ff3d006b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:51:57.882 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:57.884+0000 7ff3eb9d9700 1 --2- 172.21.15.100:0/1547125513 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7ff3d0068ed0 0x7ff3d006b380 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff3d4013680 tx=0x7ff3d4009e30 comp rx=0 tx=0).stop 2023-12-05T09:51:57.882 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:57.884+0000 7ff3eb9d9700 1 -- 172.21.15.100:0/1547125513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3e40fcbf0 msgr2=0x7ff3e410d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:51:57.882 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:57.884+0000 7ff3eb9d9700 1 --2- 172.21.15.100:0/1547125513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3e40fcbf0 0x7ff3e410d4f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff3e000eb70 tx=0x7ff3e000b040 comp rx=0 tx=0).stop 2023-12-05T09:51:57.882 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:57.884+0000 7ff3eb9d9700 1 -- 172.21.15.100:0/1547125513 shutdown_connections 2023-12-05T09:51:57.882 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:57.884+0000 7ff3eb9d9700 1 --2- 172.21.15.100:0/1547125513 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7ff3d0068ed0 0x7ff3d006b380 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:51:57.882 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:57.884+0000 7ff3eb9d9700 1 --2- 172.21.15.100:0/1547125513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3e40fcbf0 0x7ff3e410d4f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:51:57.882 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:57.884+0000 7ff3eb9d9700 1 --2- 172.21.15.100:0/1547125513 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3e40fde00 0x7ff3e410da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:51:57.882 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:57.884+0000 7ff3eb9d9700 1 -- 172.21.15.100:0/1547125513 >> 172.21.15.100:0/1547125513 conn(0x7ff3e40f82d0 msgr2=0x7ff3e4101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:51:57.882 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:57.884+0000 7ff3eb9d9700 1 -- 172.21.15.100:0/1547125513 shutdown_connections 2023-12-05T09:51:57.883 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:51:57.884+0000 7ff3eb9d9700 1 -- 172.21.15.100:0/1547125513 wait complete. 2023-12-05T09:51:58.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:57 smithi100 ceph-mon[107145]: pgmap v42: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-05T09:51:58.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:57 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:58.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:57 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:58.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:57 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:58.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:57 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:58.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:57 smithi150 ceph-mon[116142]: pgmap v42: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-05T09:51:58.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:57 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:58.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:57 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:58.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:57 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:58.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:57 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:51:58.455 DEBUG:teuthology.orchestra.run.smithi100:osd.1> sudo journalctl -f -n 0 -u ceph-5b035ce6-9353-11ee-95a2-87774f69a715@osd.1.service 2023-12-05T09:51:58.460 INFO:tasks.cephadm:Deploying osd.2 on smithi100 with /dev/vg_nvme/lv_2... 2023-12-05T09:51:58.460 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-12-05T09:51:58.541 INFO:journalctl@ceph.osd.1.smithi100.stdout:-- Logs begin at Tue 2023-12-05 09:30:11 UTC. -- 2023-12-05T09:51:59.065 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi100/config 2023-12-05T09:51:59.145 INFO:journalctl@ceph.osd.1.smithi100.stdout:Dec 05 09:51:59 smithi100 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-1[139483]: 2023-12-05T09:51:59.004+0000 7f4b41cfe540 -1 osd.1 0 log_to_monitors true 2023-12-05T09:52:00.190 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:59 smithi100 ceph-mon[107145]: pgmap v43: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-05T09:52:00.190 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:51:59 smithi100 ceph-mon[107145]: from='osd.1 [v2:172.21.15.100:6810/38684261,v1:172.21.15.100:6811/38684261]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-05T09:52:00.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:59 smithi150 ceph-mon[116142]: pgmap v43: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-05T09:52:00.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:51:59 smithi150 ceph-mon[116142]: from='osd.1 [v2:172.21.15.100:6810/38684261,v1:172.21.15.100:6811/38684261]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-05T09:52:01.283 INFO:teuthology.orchestra.run.smithi100.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-12-05T09:52:01.284 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-12-05T09:52:01.284 INFO:teuthology.orchestra.run.smithi100.stderr: stderr: 10+0 records in 2023-12-05T09:52:01.284 INFO:teuthology.orchestra.run.smithi100.stderr:10+0 records out 2023-12-05T09:52:01.284 INFO:teuthology.orchestra.run.smithi100.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0323055 s, 325 MB/s 2023-12-05T09:52:01.284 INFO:teuthology.orchestra.run.smithi100.stderr:--> Zapping successful for: 2023-12-05T09:52:01.325 INFO:journalctl@ceph.osd.1.smithi100.stdout:Dec 05 09:52:00 smithi100 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-1[139483]: 2023-12-05T09:52:00.905+0000 7f4b384e3700 -1 osd.1 0 waiting for initial osdmap 2023-12-05T09:52:01.326 INFO:journalctl@ceph.osd.1.smithi100.stdout:Dec 05 09:52:00 smithi100 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-1[139483]: 2023-12-05T09:52:00.915+0000 7f4b32add700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-05T09:52:01.326 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:00 smithi100 ceph-mon[107145]: from='osd.1 [v2:172.21.15.100:6810/38684261,v1:172.21.15.100:6811/38684261]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-12-05T09:52:01.326 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:00 smithi100 ceph-mon[107145]: osdmap e12: 2 total, 1 up, 2 in 2023-12-05T09:52:01.326 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:00 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-05T09:52:01.326 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:00 smithi100 ceph-mon[107145]: from='osd.1 [v2:172.21.15.100:6810/38684261,v1:172.21.15.100:6811/38684261]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2023-12-05T09:52:01.326 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:00 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:52:01.326 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:00 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:52:01.326 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:00 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:52:01.326 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:00 smithi100 ceph-mon[107145]: from='osd.1 [v2:172.21.15.100:6810/38684261,v1:172.21.15.100:6811/38684261]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2023-12-05T09:52:01.326 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:00 smithi100 ceph-mon[107145]: osdmap e13: 2 total, 1 up, 2 in 2023-12-05T09:52:01.326 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:00 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-05T09:52:01.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:00 smithi150 ceph-mon[116142]: from='osd.1 [v2:172.21.15.100:6810/38684261,v1:172.21.15.100:6811/38684261]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-12-05T09:52:01.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:00 smithi150 ceph-mon[116142]: osdmap e12: 2 total, 1 up, 2 in 2023-12-05T09:52:01.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:00 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-05T09:52:01.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:00 smithi150 ceph-mon[116142]: from='osd.1 [v2:172.21.15.100:6810/38684261,v1:172.21.15.100:6811/38684261]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2023-12-05T09:52:01.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:00 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:52:01.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:00 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:52:01.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:00 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:52:01.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:00 smithi150 ceph-mon[116142]: from='osd.1 [v2:172.21.15.100:6810/38684261,v1:172.21.15.100:6811/38684261]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2023-12-05T09:52:01.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:00 smithi150 ceph-mon[116142]: osdmap e13: 2 total, 1 up, 2 in 2023-12-05T09:52:01.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:00 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-05T09:52:01.880 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- ceph orch daemon add osd smithi100:vg_nvme/lv_2 2023-12-05T09:52:02.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:01 smithi100 ceph-mon[107145]: pgmap v45: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-05T09:52:02.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:01 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-05T09:52:02.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:01 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-05T09:52:02.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:01 smithi150 ceph-mon[116142]: pgmap v45: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-05T09:52:02.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:01 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-05T09:52:02.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:01 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-05T09:52:02.360 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi100/config 2023-12-05T09:52:03.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:02 smithi150 ceph-mon[116142]: purged_snaps scrub starts 2023-12-05T09:52:03.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:02 smithi150 ceph-mon[116142]: purged_snaps scrub ok 2023-12-05T09:52:03.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:02 smithi150 ceph-mon[116142]: osd.1 [v2:172.21.15.100:6810/38684261,v1:172.21.15.100:6811/38684261] boot 2023-12-05T09:52:03.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:02 smithi150 ceph-mon[116142]: osdmap e14: 2 total, 2 up, 2 in 2023-12-05T09:52:03.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:02 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-05T09:52:03.373 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:02 smithi100 ceph-mon[107145]: purged_snaps scrub starts 2023-12-05T09:52:03.373 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:02 smithi100 ceph-mon[107145]: purged_snaps scrub ok 2023-12-05T09:52:03.373 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:02 smithi100 ceph-mon[107145]: osd.1 [v2:172.21.15.100:6810/38684261,v1:172.21.15.100:6811/38684261] boot 2023-12-05T09:52:03.374 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:02 smithi100 ceph-mon[107145]: osdmap e14: 2 total, 2 up, 2 in 2023-12-05T09:52:03.374 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:02 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-05T09:52:03.637 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:52:03.639+0000 7fb8ab87a700 1 -- 172.21.15.100:0/125291042 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8a40fcbf0 msgr2=0x7fb8a40fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:52:03.637 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:52:03.639+0000 7fb8ab87a700 1 --2- 172.21.15.100:0/125291042 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8a40fcbf0 0x7fb8a40fd000 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb8a0004940 tx=0x7fb8a0009e30 comp rx=0 tx=0).stop 2023-12-05T09:52:03.637 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:52:03.639+0000 7fb8ab87a700 1 -- 172.21.15.100:0/125291042 shutdown_connections 2023-12-05T09:52:03.637 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:52:03.639+0000 7fb8ab87a700 1 --2- 172.21.15.100:0/125291042 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8a40fde00 0x7fb8a40fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:52:03.637 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:52:03.639+0000 7fb8ab87a700 1 --2- 172.21.15.100:0/125291042 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8a40fcbf0 0x7fb8a40fd000 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:52:03.637 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:52:03.639+0000 7fb8ab87a700 1 -- 172.21.15.100:0/125291042 >> 172.21.15.100:0/125291042 conn(0x7fb8a40f82d0 msgr2=0x7fb8a40fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:52:03.638 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:52:03.639+0000 7fb8ab87a700 1 -- 172.21.15.100:0/125291042 shutdown_connections 2023-12-05T09:52:03.638 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:52:03.639+0000 7fb8ab87a700 1 -- 172.21.15.100:0/125291042 wait complete. 2023-12-05T09:52:03.639 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:52:03.640+0000 7fb8ab87a700 1 Processor -- start 2023-12-05T09:52:03.639 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:52:03.640+0000 7fb8ab87a700 1 -- start start 2023-12-05T09:52:03.639 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:52:03.640+0000 7fb8ab87a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8a40fcbf0 0x7fb8a4071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:52:03.639 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:52:03.641+0000 7fb8ab87a700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8a40fde00 0x7fb8a406ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:52:03.639 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:52:03.641+0000 7fb8ab87a700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a4070590 con 0x7fb8a40fde00 2023-12-05T09:52:03.640 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:52:03.641+0000 7fb8ab87a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a4070700 con 0x7fb8a40fcbf0 2023-12-05T09:52:03.640 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:52:03.641+0000 7fb8a8e15700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8a40fde00 0x7fb8a406ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:52:03.640 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:52:03.641+0000 7fb8a8e15700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8a40fde00 0x7fb8a406ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39672/0 (socket says 172.21.15.100:39672) 2023-12-05T09:52:03.640 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:52:03.641+0000 7fb8a8e15700 1 -- 172.21.15.100:0/3012825324 learned_addr learned my addr 172.21.15.100:0/3012825324 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:52:03.640 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:52:03.641+0000 7fb8a9616700 1 --2- 172.21.15.100:0/3012825324 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8a40fcbf0 0x7fb8a4071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:52:03.640 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:52:03.641+0000 7fb8a8e15700 1 -- 172.21.15.100:0/3012825324 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8a40fcbf0 msgr2=0x7fb8a4071b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:52:03.640 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:52:03.641+0000 7fb8a8e15700 1 --2- 172.21.15.100:0/3012825324 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8a40fcbf0 0x7fb8a4071b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:52:03.640 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:52:03.641+0000 7fb8a8e15700 1 -- 172.21.15.100:0/3012825324 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a0005040 con 0x7fb8a40fde00 2023-12-05T09:52:03.640 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:52:03.641+0000 7fb8a8e15700 1 --2- 172.21.15.100:0/3012825324 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8a40fde00 0x7fb8a406ff90 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb894002a50 tx=0x7fb8940046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:52:03.640 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:52:03.642+0000 7fb899ffb700 1 -- 172.21.15.100:0/3012825324 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb894007cc0 con 0x7fb8a40fde00 2023-12-05T09:52:03.640 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:52:03.642+0000 7fb899ffb700 1 -- 172.21.15.100:0/3012825324 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb89400f040 con 0x7fb8a40fde00 2023-12-05T09:52:03.640 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:52:03.642+0000 7fb8ab87a700 1 -- 172.21.15.100:0/3012825324 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8a40709e0 con 0x7fb8a40fde00 2023-12-05T09:52:03.640 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:52:03.642+0000 7fb899ffb700 1 -- 172.21.15.100:0/3012825324 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb89400d9c0 con 0x7fb8a40fde00 2023-12-05T09:52:03.641 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:52:03.642+0000 7fb8ab87a700 1 -- 172.21.15.100:0/3012825324 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8a41155b0 con 0x7fb8a40fde00 2023-12-05T09:52:03.641 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:52:03.643+0000 7fb8ab87a700 1 -- 172.21.15.100:0/3012825324 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8a404bb80 con 0x7fb8a40fde00 2023-12-05T09:52:03.641 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:52:03.644+0000 7fb899ffb700 1 -- 172.21.15.100:0/3012825324 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) v1 ==== 86393+0+0 (secure 0 0 0) 0x7fb89400db20 con 0x7fb8a40fde00 2023-12-05T09:52:03.642 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:52:03.644+0000 7fb899ffb700 1 --2- 172.21.15.100:0/3012825324 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fb890068ed0 0x7fb89006b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:52:03.642 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:52:03.645+0000 7fb899ffb700 1 -- 172.21.15.100:0/3012825324 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2410+0+0 (secure 0 0 0) 0x7fb894085d80 con 0x7fb8a40fde00 2023-12-05T09:52:03.642 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:52:03.645+0000 7fb8a9616700 1 --2- 172.21.15.100:0/3012825324 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fb890068ed0 0x7fb89006b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:52:03.643 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:52:03.645+0000 7fb8a9616700 1 --2- 172.21.15.100:0/3012825324 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fb890068ed0 0x7fb89006b380 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb8a40718a0 tx=0x7fb8a0009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:52:03.646 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:52:03.649+0000 7fb899ffb700 1 -- 172.21.15.100:0/3012825324 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fb894056910 con 0x7fb8a40fde00 2023-12-05T09:52:03.858 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:52:03.857+0000 7fb8ab87a700 1 -- 172.21.15.100:0/3012825324 --> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fb8a4102770 con 0x7fb890068ed0 2023-12-05T09:52:04.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:03 smithi100 ceph-mon[107145]: pgmap v48: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-05T09:52:04.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:03 smithi100 ceph-mon[107145]: osdmap e15: 2 total, 2 up, 2 in 2023-12-05T09:52:04.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:03 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-05T09:52:04.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:03 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-05T09:52:04.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:03 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:52:04.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:03 smithi150 ceph-mon[116142]: pgmap v48: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-05T09:52:04.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:03 smithi150 ceph-mon[116142]: osdmap e15: 2 total, 2 up, 2 in 2023-12-05T09:52:04.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:03 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-05T09:52:04.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:03 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-05T09:52:04.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:03 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:52:05.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:04 smithi150 ceph-mon[116142]: from='client.14282 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:52:05.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:04 smithi150 ceph-mon[116142]: Detected new or changed devices on smithi100 2023-12-05T09:52:05.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:04 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:52:05.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:04 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:52:05.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:04 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:52:05.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:04 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:52:05.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:04 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:52:05.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:04 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:52:05.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:04 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:52:05.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:04 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:52:05.347 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:04 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:52:05.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:04 smithi100 ceph-mon[107145]: from='client.14282 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:52:05.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:04 smithi100 ceph-mon[107145]: Detected new or changed devices on smithi100 2023-12-05T09:52:05.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:04 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:52:05.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:04 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:52:05.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:04 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:52:05.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:04 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:52:05.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:04 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:52:05.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:04 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:52:05.397 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:04 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:52:05.397 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:04 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:52:05.397 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:04 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:52:06.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:05 smithi150 ceph-mon[116142]: Adjusting osd_memory_target on smithi100 to 6523M 2023-12-05T09:52:06.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:05 smithi150 ceph-mon[116142]: pgmap v50: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-05T09:52:06.242 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:05 smithi100 ceph-mon[107145]: Adjusting osd_memory_target on smithi100 to 6523M 2023-12-05T09:52:06.242 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:05 smithi100 ceph-mon[107145]: pgmap v50: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-05T09:52:07.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:06 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/1867025538' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "59a55cb9-28ae-4485-8cbf-e5f6224bd377"}]: dispatch 2023-12-05T09:52:07.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:06 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/1867025538' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "59a55cb9-28ae-4485-8cbf-e5f6224bd377"}]': finished 2023-12-05T09:52:07.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:06 smithi100 ceph-mon[107145]: osdmap e16: 3 total, 2 up, 3 in 2023-12-05T09:52:07.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:06 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-05T09:52:07.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:06 smithi150 ceph-mon[116142]: from='client.? 172.21.15.100:0/1867025538' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "59a55cb9-28ae-4485-8cbf-e5f6224bd377"}]: dispatch 2023-12-05T09:52:07.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:06 smithi150 ceph-mon[116142]: from='client.? 172.21.15.100:0/1867025538' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "59a55cb9-28ae-4485-8cbf-e5f6224bd377"}]': finished 2023-12-05T09:52:07.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:06 smithi150 ceph-mon[116142]: osdmap e16: 3 total, 2 up, 3 in 2023-12-05T09:52:07.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:06 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-05T09:52:08.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:07 smithi150 ceph-mon[116142]: pgmap v51: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-05T09:52:08.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:07 smithi150 ceph-mon[116142]: from='client.? 172.21.15.100:0/469870249' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-05T09:52:08.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:07 smithi100 ceph-mon[107145]: pgmap v51: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-05T09:52:08.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:07 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/469870249' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-05T09:52:09.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:09 smithi150 ceph-mon[116142]: pgmap v53: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-05T09:52:09.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:09 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:52:09.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:09 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:52:09.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:09 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:52:09.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:09 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:52:09.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:09 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:52:09.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:09 smithi100 ceph-mon[107145]: pgmap v53: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-05T09:52:09.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:09 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:52:09.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:09 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:52:09.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:09 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:52:09.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:09 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:52:09.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:09 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:52:11.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:11 smithi150 ceph-mon[116142]: pgmap v54: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-05T09:52:11.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:11 smithi100 ceph-mon[107145]: pgmap v54: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-05T09:52:13.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:13 smithi150 ceph-mon[116142]: pgmap v55: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-05T09:52:13.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:13 smithi100 ceph-mon[107145]: pgmap v55: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-05T09:52:14.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:14 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-05T09:52:14.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:14 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:52:14.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:14 smithi100 ceph-mon[107145]: Deploying daemon osd.2 on smithi100 2023-12-05T09:52:14.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:14 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-05T09:52:14.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:14 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:52:14.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:14 smithi150 ceph-mon[116142]: Deploying daemon osd.2 on smithi100 2023-12-05T09:52:15.844 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:15 smithi100 ceph-mon[107145]: pgmap v56: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-05T09:52:15.844 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:15 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:52:15.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:15 smithi150 ceph-mon[116142]: pgmap v56: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-05T09:52:15.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:15 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:52:17.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:17 smithi100 ceph-mon[107145]: pgmap v57: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-05T09:52:17.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:17 smithi150 ceph-mon[116142]: pgmap v57: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-05T09:52:19.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:19 smithi150 ceph-mon[116142]: pgmap v58: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-05T09:52:19.849 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:19 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:52:19.849 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:19 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:52:19.849 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:19 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:52:19.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:19 smithi100 ceph-mon[107145]: pgmap v58: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-05T09:52:19.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:19 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:52:19.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:19 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:52:19.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:19 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:52:21.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:21 smithi150 ceph-mon[116142]: pgmap v59: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-05T09:52:21.897 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:21 smithi100 ceph-mon[107145]: pgmap v59: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-05T09:52:22.165 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:52:22.167+0000 7fb899ffb700 1 -- 172.21.15.100:0/3012825324 <== mgr.14210 v2:172.21.15.100:6800/1237547575 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fb8a4102770 con 0x7fb890068ed0 2023-12-05T09:52:22.165 INFO:teuthology.orchestra.run.smithi100.stdout:Created osd(s) 2 on host 'smithi100' 2023-12-05T09:52:22.168 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:52:22.170+0000 7fb8ab87a700 1 -- 172.21.15.100:0/3012825324 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fb890068ed0 msgr2=0x7fb89006b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:52:22.169 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:52:22.170+0000 7fb8ab87a700 1 --2- 172.21.15.100:0/3012825324 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fb890068ed0 0x7fb89006b380 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb8a40718a0 tx=0x7fb8a0009e30 comp rx=0 tx=0).stop 2023-12-05T09:52:22.169 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:52:22.170+0000 7fb8ab87a700 1 -- 172.21.15.100:0/3012825324 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8a40fde00 msgr2=0x7fb8a406ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:52:22.169 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:52:22.170+0000 7fb8ab87a700 1 --2- 172.21.15.100:0/3012825324 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8a40fde00 0x7fb8a406ff90 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb894002a50 tx=0x7fb8940046b0 comp rx=0 tx=0).stop 2023-12-05T09:52:22.169 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:52:22.171+0000 7fb8ab87a700 1 -- 172.21.15.100:0/3012825324 shutdown_connections 2023-12-05T09:52:22.169 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:52:22.171+0000 7fb8ab87a700 1 --2- 172.21.15.100:0/3012825324 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fb890068ed0 0x7fb89006b380 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:52:22.169 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:52:22.171+0000 7fb8ab87a700 1 --2- 172.21.15.100:0/3012825324 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8a40fcbf0 0x7fb8a4071b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:52:22.169 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:52:22.171+0000 7fb8ab87a700 1 --2- 172.21.15.100:0/3012825324 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8a40fde00 0x7fb8a406ff90 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:52:22.169 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:52:22.171+0000 7fb8ab87a700 1 -- 172.21.15.100:0/3012825324 >> 172.21.15.100:0/3012825324 conn(0x7fb8a40f82d0 msgr2=0x7fb8a4101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:52:22.169 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:52:22.171+0000 7fb8ab87a700 1 -- 172.21.15.100:0/3012825324 shutdown_connections 2023-12-05T09:52:22.169 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:52:22.171+0000 7fb8ab87a700 1 -- 172.21.15.100:0/3012825324 wait complete. 2023-12-05T09:52:22.821 DEBUG:teuthology.orchestra.run.smithi100:osd.2> sudo journalctl -f -n 0 -u ceph-5b035ce6-9353-11ee-95a2-87774f69a715@osd.2.service 2023-12-05T09:52:22.825 INFO:tasks.cephadm:Deploying osd.3 on smithi150 with /dev/vg_nvme/lv_4... 2023-12-05T09:52:22.825 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-12-05T09:52:22.908 INFO:journalctl@ceph.osd.2.smithi100.stdout:-- Logs begin at Tue 2023-12-05 09:30:11 UTC. -- 2023-12-05T09:52:23.118 INFO:journalctl@ceph.osd.2.smithi100.stdout:Dec 05 09:52:23 smithi100 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-2[148987]: 2023-12-05T09:52:23.013+0000 7fc59d68a540 -1 osd.2 0 log_to_monitors true 2023-12-05T09:52:23.246 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi150/config 2023-12-05T09:52:23.345 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:23 smithi150 ceph-mon[116142]: pgmap v60: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-05T09:52:23.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:23 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:52:23.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:23 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:52:23.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:23 smithi150 ceph-mon[116142]: from='osd.2 [v2:172.21.15.100:6818/2128721915,v1:172.21.15.100:6819/2128721915]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-05T09:52:23.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:23 smithi100 ceph-mon[107145]: pgmap v60: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-05T09:52:23.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:23 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:52:23.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:23 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:52:23.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:23 smithi100 ceph-mon[107145]: from='osd.2 [v2:172.21.15.100:6818/2128721915,v1:172.21.15.100:6819/2128721915]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-05T09:52:24.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:24 smithi150 ceph-mon[116142]: from='osd.2 [v2:172.21.15.100:6818/2128721915,v1:172.21.15.100:6819/2128721915]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-12-05T09:52:24.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:24 smithi150 ceph-mon[116142]: osdmap e17: 3 total, 2 up, 3 in 2023-12-05T09:52:24.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:24 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-05T09:52:24.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:24 smithi150 ceph-mon[116142]: from='osd.2 [v2:172.21.15.100:6818/2128721915,v1:172.21.15.100:6819/2128721915]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2023-12-05T09:52:24.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:24 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:52:24.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:24 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:52:24.869 INFO:journalctl@ceph.osd.2.smithi100.stdout:Dec 05 09:52:24 smithi100 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-2[148987]: 2023-12-05T09:52:24.564+0000 7fc593e6f700 -1 osd.2 0 waiting for initial osdmap 2023-12-05T09:52:24.869 INFO:journalctl@ceph.osd.2.smithi100.stdout:Dec 05 09:52:24 smithi100 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-2[148987]: 2023-12-05T09:52:24.571+0000 7fc58ec6a700 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-05T09:52:24.869 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:24 smithi100 ceph-mon[107145]: from='osd.2 [v2:172.21.15.100:6818/2128721915,v1:172.21.15.100:6819/2128721915]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-12-05T09:52:24.869 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:24 smithi100 ceph-mon[107145]: osdmap e17: 3 total, 2 up, 3 in 2023-12-05T09:52:24.869 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:24 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-05T09:52:24.869 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:24 smithi100 ceph-mon[107145]: from='osd.2 [v2:172.21.15.100:6818/2128721915,v1:172.21.15.100:6819/2128721915]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2023-12-05T09:52:24.870 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:24 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:52:24.870 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:24 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:52:24.920 INFO:teuthology.orchestra.run.smithi150.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-12-05T09:52:24.920 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-12-05T09:52:24.921 INFO:teuthology.orchestra.run.smithi150.stderr: stderr: 10+0 records in 2023-12-05T09:52:24.921 INFO:teuthology.orchestra.run.smithi150.stderr:10+0 records out 2023-12-05T09:52:24.921 INFO:teuthology.orchestra.run.smithi150.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0459998 s, 228 MB/s 2023-12-05T09:52:24.921 INFO:teuthology.orchestra.run.smithi150.stderr:--> Zapping successful for: 2023-12-05T09:52:25.309 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- ceph orch daemon add osd smithi150:vg_nvme/lv_4 2023-12-05T09:52:25.726 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi150/config 2023-12-05T09:52:25.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:25 smithi150 ceph-mon[116142]: pgmap v62: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-05T09:52:25.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:25 smithi150 ceph-mon[116142]: from='osd.2 [v2:172.21.15.100:6818/2128721915,v1:172.21.15.100:6819/2128721915]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2023-12-05T09:52:25.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:25 smithi150 ceph-mon[116142]: osdmap e18: 3 total, 2 up, 3 in 2023-12-05T09:52:25.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:25 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-05T09:52:25.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:25 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-05T09:52:25.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:25 smithi100 ceph-mon[107145]: pgmap v62: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-05T09:52:25.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:25 smithi100 ceph-mon[107145]: from='osd.2 [v2:172.21.15.100:6818/2128721915,v1:172.21.15.100:6819/2128721915]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2023-12-05T09:52:25.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:25 smithi100 ceph-mon[107145]: osdmap e18: 3 total, 2 up, 3 in 2023-12-05T09:52:25.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:25 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-05T09:52:25.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:25 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-05T09:52:26.853 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:26.854+0000 7fe06bb77700 1 -- 172.21.15.150:0/1274352360 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0640fcbf0 msgr2=0x7fe0640fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:52:26.853 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:26.854+0000 7fe06bb77700 1 --2- 172.21.15.150:0/1274352360 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0640fcbf0 0x7fe0640fd000 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fe060004940 tx=0x7fe060009e30 comp rx=0 tx=0).stop 2023-12-05T09:52:26.853 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:26.854+0000 7fe06bb77700 1 -- 172.21.15.150:0/1274352360 shutdown_connections 2023-12-05T09:52:26.853 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:26.854+0000 7fe06bb77700 1 --2- 172.21.15.150:0/1274352360 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0640fde00 0x7fe0640fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:52:26.853 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:26.854+0000 7fe06bb77700 1 --2- 172.21.15.150:0/1274352360 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0640fcbf0 0x7fe0640fd000 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:52:26.853 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:26.854+0000 7fe06bb77700 1 -- 172.21.15.150:0/1274352360 >> 172.21.15.150:0/1274352360 conn(0x7fe0640f82d0 msgr2=0x7fe0640fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:52:26.853 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:26.854+0000 7fe06bb77700 1 -- 172.21.15.150:0/1274352360 shutdown_connections 2023-12-05T09:52:26.853 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:26.854+0000 7fe06bb77700 1 -- 172.21.15.150:0/1274352360 wait complete. 2023-12-05T09:52:26.853 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:26.855+0000 7fe06bb77700 1 Processor -- start 2023-12-05T09:52:26.854 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:26.855+0000 7fe06bb77700 1 -- start start 2023-12-05T09:52:26.855 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:26.855+0000 7fe06bb77700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0640fcbf0 0x7fe06410f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:52:26.855 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:26.855+0000 7fe06bb77700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0640fde00 0x7fe06410fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:52:26.855 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:26.855+0000 7fe06bb77700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0641102a0 con 0x7fe0640fde00 2023-12-05T09:52:26.855 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:26.855+0000 7fe06bb77700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe064110b40 con 0x7fe0640fcbf0 2023-12-05T09:52:26.855 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:26.856+0000 7fe069913700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0640fcbf0 0x7fe06410f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:52:26.855 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:26.856+0000 7fe069913700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0640fcbf0 0x7fe06410f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:56200/0 (socket says 172.21.15.150:56200) 2023-12-05T09:52:26.855 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:26.856+0000 7fe069913700 1 -- 172.21.15.150:0/121526811 learned_addr learned my addr 172.21.15.150:0/121526811 (peer_addr_for_me v2:172.21.15.150:0/0) 2023-12-05T09:52:26.855 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:26.856+0000 7fe069112700 1 --2- 172.21.15.150:0/121526811 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0640fde00 0x7fe06410fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:52:26.855 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:26.856+0000 7fe069913700 1 -- 172.21.15.150:0/121526811 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0640fde00 msgr2=0x7fe06410fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:52:26.855 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:26.856+0000 7fe069913700 1 --2- 172.21.15.150:0/121526811 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0640fde00 0x7fe06410fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:52:26.855 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:26.856+0000 7fe069913700 1 -- 172.21.15.150:0/121526811 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe060005040 con 0x7fe0640fcbf0 2023-12-05T09:52:26.855 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:26.856+0000 7fe069913700 1 --2- 172.21.15.150:0/121526811 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0640fcbf0 0x7fe06410f760 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fe060000c00 tx=0x7fe060009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:52:26.855 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:26.856+0000 7fe05a7fc700 1 -- 172.21.15.150:0/121526811 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe06000e040 con 0x7fe0640fcbf0 2023-12-05T09:52:26.855 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:26.857+0000 7fe05a7fc700 1 -- 172.21.15.150:0/121526811 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe060013420 con 0x7fe0640fcbf0 2023-12-05T09:52:26.856 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:26.857+0000 7fe06bb77700 1 -- 172.21.15.150:0/121526811 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe064110dc0 con 0x7fe0640fcbf0 2023-12-05T09:52:26.856 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:26.857+0000 7fe05a7fc700 1 -- 172.21.15.150:0/121526811 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe06001c630 con 0x7fe0640fcbf0 2023-12-05T09:52:26.856 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:26.857+0000 7fe06bb77700 1 -- 172.21.15.150:0/121526811 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe064111300 con 0x7fe0640fcbf0 2023-12-05T09:52:26.856 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:26.858+0000 7fe06bb77700 1 -- 172.21.15.150:0/121526811 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe064101ea0 con 0x7fe0640fcbf0 2023-12-05T09:52:26.857 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:26.859+0000 7fe05a7fc700 1 -- 172.21.15.150:0/121526811 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 18) v1 ==== 86393+0+0 (secure 0 0 0) 0x7fe060013590 con 0x7fe0640fcbf0 2023-12-05T09:52:26.858 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:26.860+0000 7fe05a7fc700 1 --2- 172.21.15.150:0/121526811 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fe050068ed0 0x7fe05006b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:52:26.858 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:26.860+0000 7fe05a7fc700 1 -- 172.21.15.150:0/121526811 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3217+0+0 (secure 0 0 0) 0x7fe060087620 con 0x7fe0640fcbf0 2023-12-05T09:52:26.858 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:26.860+0000 7fe069112700 1 --2- 172.21.15.150:0/121526811 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fe050068ed0 0x7fe05006b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:52:26.859 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:26.861+0000 7fe069112700 1 --2- 172.21.15.150:0/121526811 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fe050068ed0 0x7fe05006b380 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe054004f40 tx=0x7fe05400b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:52:26.863 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:26.865+0000 7fe05a7fc700 1 -- 172.21.15.150:0/121526811 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fe060057f00 con 0x7fe0640fcbf0 2023-12-05T09:52:27.059 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:27.060+0000 7fe06bb77700 1 -- 172.21.15.150:0/121526811 --> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi150:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fe0641116a0 con 0x7fe050068ed0 2023-12-05T09:52:27.084 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:26 smithi100 ceph-mon[107145]: purged_snaps scrub starts 2023-12-05T09:52:27.085 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:26 smithi100 ceph-mon[107145]: purged_snaps scrub ok 2023-12-05T09:52:27.085 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:26 smithi100 ceph-mon[107145]: osd.2 [v2:172.21.15.100:6818/2128721915,v1:172.21.15.100:6819/2128721915] boot 2023-12-05T09:52:27.085 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:26 smithi100 ceph-mon[107145]: osdmap e19: 3 total, 3 up, 3 in 2023-12-05T09:52:27.085 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:26 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-05T09:52:27.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:26 smithi150 ceph-mon[116142]: purged_snaps scrub starts 2023-12-05T09:52:27.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:26 smithi150 ceph-mon[116142]: purged_snaps scrub ok 2023-12-05T09:52:27.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:26 smithi150 ceph-mon[116142]: osd.2 [v2:172.21.15.100:6818/2128721915,v1:172.21.15.100:6819/2128721915] boot 2023-12-05T09:52:27.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:26 smithi150 ceph-mon[116142]: osdmap e19: 3 total, 3 up, 3 in 2023-12-05T09:52:27.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:26 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-05T09:52:28.056 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:27 smithi150 ceph-mon[116142]: pgmap v65: 0 pgs: ; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2023-12-05T09:52:28.056 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:27 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2023-12-05T09:52:28.056 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:27 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2023-12-05T09:52:28.056 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:27 smithi150 ceph-mon[116142]: osdmap e20: 3 total, 3 up, 3 in 2023-12-05T09:52:28.056 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:27 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-12-05T09:52:28.056 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:27 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-05T09:52:28.056 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:27 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-05T09:52:28.057 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:27 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:52:28.057 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:27 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:52:28.057 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:27 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:52:28.057 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:27 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:52:28.057 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:27 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:52:28.057 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:27 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:52:28.057 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:27 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:52:28.057 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:27 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:52:28.057 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:27 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:52:28.057 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:27 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:52:28.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:27 smithi100 ceph-mon[107145]: pgmap v65: 0 pgs: ; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2023-12-05T09:52:28.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:27 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2023-12-05T09:52:28.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:27 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2023-12-05T09:52:28.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:27 smithi100 ceph-mon[107145]: osdmap e20: 3 total, 3 up, 3 in 2023-12-05T09:52:28.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:27 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-12-05T09:52:28.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:27 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-05T09:52:28.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:27 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-05T09:52:28.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:27 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:52:28.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:27 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:52:28.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:27 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:52:28.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:27 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:52:28.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:27 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:52:28.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:27 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:52:28.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:27 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:52:28.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:27 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:52:28.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:27 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:52:28.147 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:27 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:52:28.645 INFO:journalctl@ceph.osd.0.smithi100.stdout:Dec 05 09:52:28 smithi100 sudo[154996]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-05T09:52:28.645 INFO:journalctl@ceph.osd.0.smithi100.stdout:Dec 05 09:52:28 smithi100 sudo[154996]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-05T09:52:28.645 INFO:journalctl@ceph.osd.0.smithi100.stdout:Dec 05 09:52:28 smithi100 sudo[154996]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-05T09:52:28.646 INFO:journalctl@ceph.osd.0.smithi100.stdout:Dec 05 09:52:28 smithi100 sudo[154996]: pam_unix(sudo:session): session closed for user root 2023-12-05T09:52:28.677 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:28.679+0000 7fe05a7fc700 1 -- 172.21.15.150:0/121526811 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7fe060054840 con 0x7fe0640fcbf0 2023-12-05T09:52:28.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:28 smithi150 ceph-mon[116142]: from='client.24141 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi150:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:52:28.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:28 smithi150 ceph-mon[116142]: Detected new or changed devices on smithi100 2023-12-05T09:52:28.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:28 smithi150 ceph-mon[116142]: Adjusting osd_memory_target on smithi100 to 4349M 2023-12-05T09:52:28.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:28 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-12-05T09:52:28.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:28 smithi150 ceph-mon[116142]: osdmap e21: 3 total, 3 up, 3 in 2023-12-05T09:52:28.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:28 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:52:28.937 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:28 smithi100 ceph-mon[107145]: from='client.24141 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi150:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:52:28.937 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:28 smithi100 ceph-mon[107145]: Detected new or changed devices on smithi100 2023-12-05T09:52:28.937 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:28 smithi100 ceph-mon[107145]: Adjusting osd_memory_target on smithi100 to 4349M 2023-12-05T09:52:28.937 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:28 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-12-05T09:52:28.937 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:28 smithi100 ceph-mon[107145]: osdmap e21: 3 total, 3 up, 3 in 2023-12-05T09:52:28.937 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:28 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:52:29.395 INFO:journalctl@ceph.osd.0.smithi100.stdout:Dec 05 09:52:28 smithi100 sudo[155069]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-05T09:52:29.395 INFO:journalctl@ceph.osd.0.smithi100.stdout:Dec 05 09:52:28 smithi100 sudo[155069]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-05T09:52:29.395 INFO:journalctl@ceph.osd.0.smithi100.stdout:Dec 05 09:52:28 smithi100 sudo[155069]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-05T09:52:29.395 INFO:journalctl@ceph.osd.0.smithi100.stdout:Dec 05 09:52:28 smithi100 sudo[155069]: pam_unix(sudo:session): session closed for user root 2023-12-05T09:52:29.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:29 smithi100 ceph-mon[107145]: pgmap v68: 1 pgs: 1 active+clean; 449 KiB data, 872 MiB used, 267 GiB / 268 GiB avail 2023-12-05T09:52:29.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:29 smithi100 ceph-mon[107145]: mgrmap e19: smithi100.ehmuhg(active, since 118s), standbys: smithi150.zkskag 2023-12-05T09:52:29.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:29 smithi100 ceph-mon[107145]: osdmap e22: 3 total, 3 up, 3 in 2023-12-05T09:52:29.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:29 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:52:29.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:29 smithi100 ceph-mon[107145]: from='client.? 172.21.15.150:0/673148438' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e12b505f-7f0c-4d6f-b039-5aa793f79db0"}]: dispatch 2023-12-05T09:52:29.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:29 smithi100 ceph-mon[107145]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e12b505f-7f0c-4d6f-b039-5aa793f79db0"}]: dispatch 2023-12-05T09:52:29.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:29 smithi100 ceph-mon[107145]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e12b505f-7f0c-4d6f-b039-5aa793f79db0"}]': finished 2023-12-05T09:52:29.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:29 smithi100 ceph-mon[107145]: osdmap e23: 4 total, 3 up, 4 in 2023-12-05T09:52:29.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:29 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-05T09:52:29.896 INFO:journalctl@ceph.osd.1.smithi100.stdout:Dec 05 09:52:29 smithi100 sudo[155174]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-05T09:52:29.896 INFO:journalctl@ceph.osd.1.smithi100.stdout:Dec 05 09:52:29 smithi100 sudo[155174]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-05T09:52:29.896 INFO:journalctl@ceph.osd.1.smithi100.stdout:Dec 05 09:52:29 smithi100 sudo[155174]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-05T09:52:29.896 INFO:journalctl@ceph.osd.1.smithi100.stdout:Dec 05 09:52:29 smithi100 sudo[155174]: pam_unix(sudo:session): session closed for user root 2023-12-05T09:52:30.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:29 smithi150 ceph-mon[116142]: pgmap v68: 1 pgs: 1 active+clean; 449 KiB data, 872 MiB used, 267 GiB / 268 GiB avail 2023-12-05T09:52:30.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:29 smithi150 ceph-mon[116142]: mgrmap e19: smithi100.ehmuhg(active, since 118s), standbys: smithi150.zkskag 2023-12-05T09:52:30.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:29 smithi150 ceph-mon[116142]: osdmap e22: 3 total, 3 up, 3 in 2023-12-05T09:52:30.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:29 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:52:30.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:29 smithi150 ceph-mon[116142]: from='client.? 172.21.15.150:0/673148438' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e12b505f-7f0c-4d6f-b039-5aa793f79db0"}]: dispatch 2023-12-05T09:52:30.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:29 smithi150 ceph-mon[116142]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e12b505f-7f0c-4d6f-b039-5aa793f79db0"}]: dispatch 2023-12-05T09:52:30.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:29 smithi150 ceph-mon[116142]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e12b505f-7f0c-4d6f-b039-5aa793f79db0"}]': finished 2023-12-05T09:52:30.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:29 smithi150 ceph-mon[116142]: osdmap e23: 4 total, 3 up, 4 in 2023-12-05T09:52:30.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:29 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-05T09:52:30.395 INFO:journalctl@ceph.osd.1.smithi100.stdout:Dec 05 09:52:30 smithi100 sudo[155247]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-05T09:52:30.395 INFO:journalctl@ceph.osd.1.smithi100.stdout:Dec 05 09:52:30 smithi100 sudo[155247]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-05T09:52:30.395 INFO:journalctl@ceph.osd.1.smithi100.stdout:Dec 05 09:52:30 smithi100 sudo[155247]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-05T09:52:30.395 INFO:journalctl@ceph.osd.1.smithi100.stdout:Dec 05 09:52:30 smithi100 sudo[155247]: pam_unix(sudo:session): session closed for user root 2023-12-05T09:52:31.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:30 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:52:31.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:30 smithi150 ceph-mon[116142]: from='client.? 172.21.15.150:0/1856823489' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-05T09:52:31.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:30 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:52:31.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:30 smithi100 ceph-mon[107145]: from='client.? 172.21.15.150:0/1856823489' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-05T09:52:31.146 INFO:journalctl@ceph.osd.2.smithi100.stdout:Dec 05 09:52:30 smithi100 sudo[155336]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-05T09:52:31.146 INFO:journalctl@ceph.osd.2.smithi100.stdout:Dec 05 09:52:30 smithi100 sudo[155336]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-05T09:52:31.146 INFO:journalctl@ceph.osd.2.smithi100.stdout:Dec 05 09:52:30 smithi100 sudo[155336]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-05T09:52:31.147 INFO:journalctl@ceph.osd.2.smithi100.stdout:Dec 05 09:52:30 smithi100 sudo[155336]: pam_unix(sudo:session): session closed for user root 2023-12-05T09:52:31.645 INFO:journalctl@ceph.osd.2.smithi100.stdout:Dec 05 09:52:31 smithi100 sudo[155406]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-05T09:52:31.645 INFO:journalctl@ceph.osd.2.smithi100.stdout:Dec 05 09:52:31 smithi100 sudo[155406]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-05T09:52:31.645 INFO:journalctl@ceph.osd.2.smithi100.stdout:Dec 05 09:52:31 smithi100 sudo[155406]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-05T09:52:31.645 INFO:journalctl@ceph.osd.2.smithi100.stdout:Dec 05 09:52:31 smithi100 sudo[155406]: pam_unix(sudo:session): session closed for user root 2023-12-05T09:52:32.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:31 smithi100 sudo[155492]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-05T09:52:32.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:31 smithi100 sudo[155492]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-05T09:52:32.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:31 smithi100 sudo[155492]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-05T09:52:32.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:31 smithi100 sudo[155492]: pam_unix(sudo:session): session closed for user root 2023-12-05T09:52:32.595 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:32 smithi150 ceph-mon[116142]: pgmap v71: 1 pgs: 1 active+clean; 449 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2023-12-05T09:52:32.595 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:32 smithi150 ceph-mon[116142]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-05T09:52:32.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:32 smithi100 sudo[155495]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-05T09:52:32.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:32 smithi100 sudo[155495]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-05T09:52:32.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:32 smithi100 sudo[155495]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-05T09:52:32.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:32 smithi100 sudo[155495]: pam_unix(sudo:session): session closed for user root 2023-12-05T09:52:32.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:32 smithi100 ceph-mon[107145]: pgmap v71: 1 pgs: 1 active+clean; 449 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2023-12-05T09:52:32.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:32 smithi100 ceph-mon[107145]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-05T09:52:33.345 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:32 smithi150 sudo[121337]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-05T09:52:33.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:32 smithi150 sudo[121337]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-05T09:52:33.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:32 smithi150 sudo[121337]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-05T09:52:33.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:32 smithi150 sudo[121337]: pam_unix(sudo:session): session closed for user root 2023-12-05T09:52:33.756 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:33 smithi150 sudo[121346]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-05T09:52:33.756 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:33 smithi150 sudo[121346]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-05T09:52:33.756 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:33 smithi150 sudo[121346]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-05T09:52:33.756 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:33 smithi150 sudo[121346]: pam_unix(sudo:session): session closed for user root 2023-12-05T09:52:33.756 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:33 smithi150 ceph-mon[116142]: pgmap v72: 1 pgs: 1 active+clean; 449 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2023-12-05T09:52:33.756 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:33 smithi150 ceph-mon[116142]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-05T09:52:33.756 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:33 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mon metadata", "id": "smithi100"}]: dispatch 2023-12-05T09:52:33.756 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:33 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mon metadata", "id": "smithi150"}]: dispatch 2023-12-05T09:52:33.756 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:33 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mon metadata", "id": "smithi100"}]: dispatch 2023-12-05T09:52:33.757 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:33 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mon metadata", "id": "smithi150"}]: dispatch 2023-12-05T09:52:33.757 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:33 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:52:33.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:33 smithi100 ceph-mon[107145]: pgmap v72: 1 pgs: 1 active+clean; 449 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2023-12-05T09:52:33.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:33 smithi100 ceph-mon[107145]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-05T09:52:33.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:33 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mon metadata", "id": "smithi100"}]: dispatch 2023-12-05T09:52:33.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:33 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mon metadata", "id": "smithi150"}]: dispatch 2023-12-05T09:52:33.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:33 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mon metadata", "id": "smithi100"}]: dispatch 2023-12-05T09:52:33.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:33 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mon metadata", "id": "smithi150"}]: dispatch 2023-12-05T09:52:33.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:33 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:52:34.678 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:34 smithi150 ceph-mon[116142]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-05T09:52:34.679 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:34 smithi150 ceph-mon[116142]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-05T09:52:34.679 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:34 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:52:34.679 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:34 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:52:34.679 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:34 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:52:34.679 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:34 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:52:34.679 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:34 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:52:34.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:34 smithi100 ceph-mon[107145]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-05T09:52:34.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:34 smithi100 ceph-mon[107145]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-05T09:52:34.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:34 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:52:34.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:34 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:52:34.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:34 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:52:34.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:34 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:52:34.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:34 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:52:35.699 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:35 smithi150 ceph-mon[116142]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.5 KiB/s rd, 87 KiB/s wr, 5 op/s 2023-12-05T09:52:35.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:35 smithi100 ceph-mon[107145]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.5 KiB/s rd, 87 KiB/s wr, 5 op/s 2023-12-05T09:52:36.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:36 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-05T09:52:36.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:36 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:52:36.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:36 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-05T09:52:36.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:36 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:52:37.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:37 smithi150 ceph-mon[116142]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.1 KiB/s rd, 65 KiB/s wr, 4 op/s 2023-12-05T09:52:37.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:37 smithi150 ceph-mon[116142]: Deploying daemon osd.3 on smithi150 2023-12-05T09:52:37.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:37 smithi100 ceph-mon[107145]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.1 KiB/s rd, 65 KiB/s wr, 4 op/s 2023-12-05T09:52:37.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:37 smithi100 ceph-mon[107145]: Deploying daemon osd.3 on smithi150 2023-12-05T09:52:39.779 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:39 smithi150 ceph-mon[116142]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.9 KiB/s rd, 139 KiB/s wr, 9 op/s 2023-12-05T09:52:39.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:39 smithi100 ceph-mon[107145]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.9 KiB/s rd, 139 KiB/s wr, 9 op/s 2023-12-05T09:52:41.595 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:41 smithi150 ceph-mon[116142]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.5 KiB/s rd, 123 KiB/s wr, 8 op/s 2023-12-05T09:52:41.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:41 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:52:41.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:41 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:52:41.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:41 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:52:41.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:41 smithi100 ceph-mon[107145]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.5 KiB/s rd, 123 KiB/s wr, 8 op/s 2023-12-05T09:52:41.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:41 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:52:41.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:41 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:52:41.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:41 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:52:43.579 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:43 smithi150 ceph-mon[116142]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-12-05T09:52:43.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:43 smithi100 ceph-mon[107145]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-12-05T09:52:44.423 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:44.425+0000 7fe05a7fc700 1 -- 172.21.15.150:0/121526811 <== mgr.14210 v2:172.21.15.100:6800/1237547575 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fe0641116a0 con 0x7fe050068ed0 2023-12-05T09:52:44.423 INFO:teuthology.orchestra.run.smithi150.stdout:Created osd(s) 3 on host 'smithi150' 2023-12-05T09:52:44.425 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:44.428+0000 7fe06bb77700 1 -- 172.21.15.150:0/121526811 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fe050068ed0 msgr2=0x7fe05006b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:52:44.425 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:44.428+0000 7fe06bb77700 1 --2- 172.21.15.150:0/121526811 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fe050068ed0 0x7fe05006b380 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe054004f40 tx=0x7fe05400b040 comp rx=0 tx=0).stop 2023-12-05T09:52:44.425 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:44.428+0000 7fe06bb77700 1 -- 172.21.15.150:0/121526811 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0640fcbf0 msgr2=0x7fe06410f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:52:44.426 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:44.428+0000 7fe06bb77700 1 --2- 172.21.15.150:0/121526811 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0640fcbf0 0x7fe06410f760 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fe060000c00 tx=0x7fe060009e30 comp rx=0 tx=0).stop 2023-12-05T09:52:44.426 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:44.428+0000 7fe06bb77700 1 -- 172.21.15.150:0/121526811 shutdown_connections 2023-12-05T09:52:44.426 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:44.428+0000 7fe06bb77700 1 --2- 172.21.15.150:0/121526811 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fe050068ed0 0x7fe05006b380 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:52:44.426 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:44.428+0000 7fe06bb77700 1 --2- 172.21.15.150:0/121526811 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0640fcbf0 0x7fe06410f760 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:52:44.426 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:44.428+0000 7fe06bb77700 1 --2- 172.21.15.150:0/121526811 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0640fde00 0x7fe06410fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:52:44.426 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:44.428+0000 7fe06bb77700 1 -- 172.21.15.150:0/121526811 >> 172.21.15.150:0/121526811 conn(0x7fe0640f82d0 msgr2=0x7fe0640ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:52:44.426 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:44.428+0000 7fe06bb77700 1 -- 172.21.15.150:0/121526811 shutdown_connections 2023-12-05T09:52:44.426 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:44.428+0000 7fe06bb77700 1 -- 172.21.15.150:0/121526811 wait complete. 2023-12-05T09:52:44.783 DEBUG:teuthology.orchestra.run.smithi150:osd.3> sudo journalctl -f -n 0 -u ceph-5b035ce6-9353-11ee-95a2-87774f69a715@osd.3.service 2023-12-05T09:52:44.788 INFO:tasks.cephadm:Deploying osd.4 on smithi150 with /dev/vg_nvme/lv_3... 2023-12-05T09:52:44.788 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-12-05T09:52:44.868 INFO:journalctl@ceph.osd.3.smithi150.stdout:-- Logs begin at Tue 2023-12-05 09:31:29 UTC. -- 2023-12-05T09:52:45.272 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi150/config 2023-12-05T09:52:45.420 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:45 smithi150 ceph-mon[116142]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-12-05T09:52:45.420 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:45 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:52:45.421 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:45 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:52:45.421 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:45 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:52:45.421 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:45 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:52:45.421 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:45 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:52:45.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:45 smithi100 ceph-mon[107145]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-12-05T09:52:45.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:45 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:52:45.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:45 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:52:45.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:45 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:52:45.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:45 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:52:45.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:45 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:52:45.698 INFO:journalctl@ceph.osd.3.smithi150.stdout:Dec 05 09:52:45 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-3[122418]: 2023-12-05T09:52:45.445+0000 7f45572cc540 -1 osd.3 0 log_to_monitors true 2023-12-05T09:52:46.345 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:46 smithi150 ceph-mon[116142]: from='osd.3 [v2:172.21.15.150:6800/1626769878,v1:172.21.15.150:6801/1626769878]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-05T09:52:46.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:46 smithi150 ceph-mon[116142]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-05T09:52:46.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:46 smithi100 ceph-mon[107145]: from='osd.3 [v2:172.21.15.150:6800/1626769878,v1:172.21.15.150:6801/1626769878]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-05T09:52:46.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:46 smithi100 ceph-mon[107145]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-05T09:52:47.176 INFO:teuthology.orchestra.run.smithi150.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-12-05T09:52:47.176 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-12-05T09:52:47.176 INFO:teuthology.orchestra.run.smithi150.stderr: stderr: 10+0 records in 2023-12-05T09:52:47.176 INFO:teuthology.orchestra.run.smithi150.stderr:10+0 records out 2023-12-05T09:52:47.177 INFO:teuthology.orchestra.run.smithi150.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0316684 s, 331 MB/s 2023-12-05T09:52:47.177 INFO:teuthology.orchestra.run.smithi150.stderr:--> Zapping successful for: 2023-12-05T09:52:47.346 INFO:journalctl@ceph.osd.3.smithi150.stdout:Dec 05 09:52:47 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-3[122418]: 2023-12-05T09:52:47.191+0000 7f454dab1700 -1 osd.3 0 waiting for initial osdmap 2023-12-05T09:52:47.346 INFO:journalctl@ceph.osd.3.smithi150.stdout:Dec 05 09:52:47 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-3[122418]: 2023-12-05T09:52:47.199+0000 7f45498ae700 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-05T09:52:47.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:47 smithi150 ceph-mon[116142]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2023-12-05T09:52:47.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:47 smithi150 ceph-mon[116142]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-12-05T09:52:47.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:47 smithi150 ceph-mon[116142]: osdmap e24: 4 total, 3 up, 4 in 2023-12-05T09:52:47.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:47 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-05T09:52:47.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:47 smithi150 ceph-mon[116142]: from='osd.3 [v2:172.21.15.150:6800/1626769878,v1:172.21.15.150:6801/1626769878]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2023-12-05T09:52:47.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:47 smithi150 ceph-mon[116142]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2023-12-05T09:52:47.587 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- ceph orch daemon add osd smithi150:vg_nvme/lv_3 2023-12-05T09:52:47.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:47 smithi100 ceph-mon[107145]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2023-12-05T09:52:47.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:47 smithi100 ceph-mon[107145]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-12-05T09:52:47.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:47 smithi100 ceph-mon[107145]: osdmap e24: 4 total, 3 up, 4 in 2023-12-05T09:52:47.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:47 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-05T09:52:47.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:47 smithi100 ceph-mon[107145]: from='osd.3 [v2:172.21.15.150:6800/1626769878,v1:172.21.15.150:6801/1626769878]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2023-12-05T09:52:47.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:47 smithi100 ceph-mon[107145]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2023-12-05T09:52:48.071 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi150/config 2023-12-05T09:52:48.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:48 smithi150 ceph-mon[116142]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]': finished 2023-12-05T09:52:48.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:48 smithi150 ceph-mon[116142]: osdmap e25: 4 total, 3 up, 4 in 2023-12-05T09:52:48.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:48 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-05T09:52:48.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:48 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-05T09:52:48.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:48 smithi150 ceph-mon[116142]: osd.3 [v2:172.21.15.150:6800/1626769878,v1:172.21.15.150:6801/1626769878] boot 2023-12-05T09:52:48.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:48 smithi150 ceph-mon[116142]: osdmap e26: 4 total, 4 up, 4 in 2023-12-05T09:52:48.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:48 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-05T09:52:48.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:48 smithi100 ceph-mon[107145]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]': finished 2023-12-05T09:52:48.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:48 smithi100 ceph-mon[107145]: osdmap e25: 4 total, 3 up, 4 in 2023-12-05T09:52:48.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:48 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-05T09:52:48.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:48 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-05T09:52:48.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:48 smithi100 ceph-mon[107145]: osd.3 [v2:172.21.15.150:6800/1626769878,v1:172.21.15.150:6801/1626769878] boot 2023-12-05T09:52:48.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:48 smithi100 ceph-mon[107145]: osdmap e26: 4 total, 4 up, 4 in 2023-12-05T09:52:48.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:48 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-05T09:52:49.499 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:49.498+0000 7f7c673be700 1 -- 172.21.15.150:0/2897738150 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c600fde00 msgr2=0x7f7c600fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:52:49.499 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:49.498+0000 7f7c673be700 1 --2- 172.21.15.150:0/2897738150 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c600fde00 0x7f7c600fe250 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7c50004940 tx=0x7f7c50009e30 comp rx=0 tx=0).stop 2023-12-05T09:52:49.499 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:49.498+0000 7f7c673be700 1 -- 172.21.15.150:0/2897738150 shutdown_connections 2023-12-05T09:52:49.499 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:49.498+0000 7f7c673be700 1 --2- 172.21.15.150:0/2897738150 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c600fde00 0x7f7c600fe250 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:52:49.500 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:49.498+0000 7f7c673be700 1 --2- 172.21.15.150:0/2897738150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c600fcbf0 0x7f7c600fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:52:49.500 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:49.498+0000 7f7c673be700 1 -- 172.21.15.150:0/2897738150 >> 172.21.15.150:0/2897738150 conn(0x7f7c600f82d0 msgr2=0x7f7c600fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:52:49.500 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:49.498+0000 7f7c673be700 1 -- 172.21.15.150:0/2897738150 shutdown_connections 2023-12-05T09:52:49.500 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:49.498+0000 7f7c673be700 1 -- 172.21.15.150:0/2897738150 wait complete. 2023-12-05T09:52:49.500 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:49.499+0000 7f7c673be700 1 Processor -- start 2023-12-05T09:52:49.500 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:49.499+0000 7f7c673be700 1 -- start start 2023-12-05T09:52:49.501 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:49.499+0000 7f7c673be700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c600fcbf0 0x7f7c6010f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:52:49.501 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:49.499+0000 7f7c673be700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c600fde00 0x7f7c6010fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:52:49.501 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:49.499+0000 7f7c673be700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c60110200 con 0x7f7c600fcbf0 2023-12-05T09:52:49.501 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:49.499+0000 7f7c673be700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c60110aa0 con 0x7f7c600fde00 2023-12-05T09:52:49.501 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:49.499+0000 7f7c64959700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c600fde00 0x7f7c6010fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:52:49.501 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:49.499+0000 7f7c64959700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c600fde00 0x7f7c6010fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:57634/0 (socket says 172.21.15.150:57634) 2023-12-05T09:52:49.502 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:49.499+0000 7f7c64959700 1 -- 172.21.15.150:0/286709882 learned_addr learned my addr 172.21.15.150:0/286709882 (peer_addr_for_me v2:172.21.15.150:0/0) 2023-12-05T09:52:49.502 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:49.500+0000 7f7c6515a700 1 --2- 172.21.15.150:0/286709882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c600fcbf0 0x7f7c6010f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:52:49.502 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:49.500+0000 7f7c64959700 1 -- 172.21.15.150:0/286709882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c600fcbf0 msgr2=0x7f7c6010f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:52:49.502 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:49.500+0000 7f7c64959700 1 --2- 172.21.15.150:0/286709882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c600fcbf0 0x7f7c6010f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:52:49.502 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:49.500+0000 7f7c64959700 1 -- 172.21.15.150:0/286709882 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c50005040 con 0x7f7c600fde00 2023-12-05T09:52:49.502 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:49.500+0000 7f7c6515a700 1 --2- 172.21.15.150:0/286709882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c600fcbf0 0x7f7c6010f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-05T09:52:49.503 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:49.500+0000 7f7c64959700 1 --2- 172.21.15.150:0/286709882 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c600fde00 0x7f7c6010fc00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7c50008f90 tx=0x7f7c50009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:52:49.503 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:49.500+0000 7f7c55ffb700 1 -- 172.21.15.150:0/286709882 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c50021070 con 0x7f7c600fde00 2023-12-05T09:52:49.503 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:49.500+0000 7f7c55ffb700 1 -- 172.21.15.150:0/286709882 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7c5001c400 con 0x7f7c600fde00 2023-12-05T09:52:49.503 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:49.500+0000 7f7c673be700 1 -- 172.21.15.150:0/286709882 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c60110d20 con 0x7f7c600fde00 2023-12-05T09:52:49.503 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:49.500+0000 7f7c55ffb700 1 -- 172.21.15.150:0/286709882 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c5000e030 con 0x7f7c600fde00 2023-12-05T09:52:49.503 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:49.501+0000 7f7c673be700 1 -- 172.21.15.150:0/286709882 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c60111260 con 0x7f7c600fde00 2023-12-05T09:52:49.504 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:49.502+0000 7f7c673be700 1 -- 172.21.15.150:0/286709882 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c60101ea0 con 0x7f7c600fde00 2023-12-05T09:52:49.505 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:49.503+0000 7f7c55ffb700 1 -- 172.21.15.150:0/286709882 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f7c5001ca00 con 0x7f7c600fde00 2023-12-05T09:52:49.505 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:49.503+0000 7f7c55ffb700 1 --2- 172.21.15.150:0/286709882 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f7c4c068f70 0x7f7c4c06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:52:49.506 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:49.503+0000 7f7c55ffb700 1 -- 172.21.15.150:0/286709882 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 3799+0+0 (secure 0 0 0) 0x7f7c50087b10 con 0x7f7c600fde00 2023-12-05T09:52:49.506 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:49.504+0000 7f7c6515a700 1 --2- 172.21.15.150:0/286709882 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f7c4c068f70 0x7f7c4c06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:52:49.506 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:49.504+0000 7f7c6515a700 1 --2- 172.21.15.150:0/286709882 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f7c4c068f70 0x7f7c4c06b420 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c009b80 tx=0x7f7c5c00b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:52:49.506 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:49.508+0000 7f7c55ffb700 1 -- 172.21.15.150:0/286709882 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f7c50058050 con 0x7f7c600fde00 2023-12-05T09:52:49.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:49 smithi150 ceph-mon[116142]: purged_snaps scrub starts 2023-12-05T09:52:49.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:49 smithi150 ceph-mon[116142]: purged_snaps scrub ok 2023-12-05T09:52:49.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:49 smithi150 ceph-mon[116142]: pgmap v82: 1 pgs: 1 peering; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2023-12-05T09:52:49.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:49 smithi150 ceph-mon[116142]: osdmap e27: 4 total, 4 up, 4 in 2023-12-05T09:52:49.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:49 smithi150 ceph-mon[116142]: Detected new or changed devices on smithi150 2023-12-05T09:52:49.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:49 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:52:49.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:49 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:52:49.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:49 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:52:49.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:49 smithi150 ceph-mon[116142]: Adjusting osd_memory_target on smithi150 to 16119M 2023-12-05T09:52:49.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:49 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:52:49.597 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:49 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:52:49.597 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:49 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:52:49.597 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:49 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:52:49.597 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:49 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:52:49.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:49 smithi100 ceph-mon[107145]: purged_snaps scrub starts 2023-12-05T09:52:49.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:49 smithi100 ceph-mon[107145]: purged_snaps scrub ok 2023-12-05T09:52:49.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:49 smithi100 ceph-mon[107145]: pgmap v82: 1 pgs: 1 peering; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2023-12-05T09:52:49.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:49 smithi100 ceph-mon[107145]: osdmap e27: 4 total, 4 up, 4 in 2023-12-05T09:52:49.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:49 smithi100 ceph-mon[107145]: Detected new or changed devices on smithi150 2023-12-05T09:52:49.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:49 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:52:49.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:49 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:52:49.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:49 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:52:49.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:49 smithi100 ceph-mon[107145]: Adjusting osd_memory_target on smithi150 to 16119M 2023-12-05T09:52:49.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:49 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:52:49.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:49 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:52:49.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:49 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:52:49.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:49 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:52:49.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:49 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:52:49.704 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:52:49.707+0000 7f7c673be700 1 -- 172.21.15.150:0/286709882 --> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi150:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f7c60111540 con 0x7f7c4c068f70 2023-12-05T09:52:50.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:50 smithi100 ceph-mon[107145]: osdmap e28: 4 total, 4 up, 4 in 2023-12-05T09:52:50.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:50 smithi100 ceph-mon[107145]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi150:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:52:50.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:50 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-05T09:52:50.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:50 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-05T09:52:50.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:50 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:52:50.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:50 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:52:50.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:50 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:52:50.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:50 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:52:50.678 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:50 smithi150 ceph-mon[116142]: osdmap e28: 4 total, 4 up, 4 in 2023-12-05T09:52:50.678 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:50 smithi150 ceph-mon[116142]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi150:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:52:50.678 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:50 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-05T09:52:50.678 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:50 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-05T09:52:50.678 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:50 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:52:50.678 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:50 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:52:50.679 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:50 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:52:50.679 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:50 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:52:51.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:51 smithi100 ceph-mon[107145]: pgmap v86: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-05T09:52:51.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:51 smithi100 ceph-mon[107145]: osdmap e29: 4 total, 4 up, 4 in 2023-12-05T09:52:51.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:51 smithi150 ceph-mon[116142]: pgmap v86: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-05T09:52:51.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:51 smithi150 ceph-mon[116142]: osdmap e29: 4 total, 4 up, 4 in 2023-12-05T09:52:52.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:52 smithi100 ceph-mon[107145]: osdmap e30: 4 total, 4 up, 4 in 2023-12-05T09:52:52.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:52 smithi100 ceph-mon[107145]: from='client.? 172.21.15.150:0/1377456500' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "33fbbf55-86ba-4e7f-a66b-e958dce72283"}]: dispatch 2023-12-05T09:52:52.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:52 smithi100 ceph-mon[107145]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "33fbbf55-86ba-4e7f-a66b-e958dce72283"}]: dispatch 2023-12-05T09:52:52.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:52 smithi100 ceph-mon[107145]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "33fbbf55-86ba-4e7f-a66b-e958dce72283"}]': finished 2023-12-05T09:52:52.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:52 smithi100 ceph-mon[107145]: osdmap e31: 5 total, 4 up, 5 in 2023-12-05T09:52:52.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:52 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-05T09:52:52.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:52 smithi150 ceph-mon[116142]: osdmap e30: 4 total, 4 up, 4 in 2023-12-05T09:52:52.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:52 smithi150 ceph-mon[116142]: from='client.? 172.21.15.150:0/1377456500' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "33fbbf55-86ba-4e7f-a66b-e958dce72283"}]: dispatch 2023-12-05T09:52:52.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:52 smithi150 ceph-mon[116142]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "33fbbf55-86ba-4e7f-a66b-e958dce72283"}]: dispatch 2023-12-05T09:52:52.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:52 smithi150 ceph-mon[116142]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "33fbbf55-86ba-4e7f-a66b-e958dce72283"}]': finished 2023-12-05T09:52:52.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:52 smithi150 ceph-mon[116142]: osdmap e31: 5 total, 4 up, 5 in 2023-12-05T09:52:52.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:52 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-05T09:52:53.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:53 smithi100 ceph-mon[107145]: pgmap v90: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-05T09:52:53.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:53 smithi100 ceph-mon[107145]: from='client.? 172.21.15.150:0/666521888' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-05T09:52:53.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:53 smithi150 ceph-mon[116142]: pgmap v90: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-05T09:52:53.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:53 smithi150 ceph-mon[116142]: from='client.? 172.21.15.150:0/666521888' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-05T09:52:55.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:55 smithi100 ceph-mon[107145]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 122 KiB/s, 0 objects/s recovering 2023-12-05T09:52:55.699 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:55 smithi150 ceph-mon[116142]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 122 KiB/s, 0 objects/s recovering 2023-12-05T09:52:57.595 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:57 smithi150 ceph-mon[116142]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-12-05T09:52:57.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:57 smithi100 ceph-mon[107145]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-12-05T09:52:59.681 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:59 smithi150 ceph-mon[116142]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 75 KiB/s, 0 objects/s recovering 2023-12-05T09:52:59.681 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:59 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-05T09:52:59.681 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:52:59 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:52:59.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:59 smithi100 ceph-mon[107145]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 75 KiB/s, 0 objects/s recovering 2023-12-05T09:52:59.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:59 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-05T09:52:59.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:52:59 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:53:00.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:00 smithi150 ceph-mon[116142]: Deploying daemon osd.4 on smithi150 2023-12-05T09:53:00.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:00 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:53:00.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:00 smithi100 ceph-mon[107145]: Deploying daemon osd.4 on smithi150 2023-12-05T09:53:00.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:00 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:53:01.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:01 smithi150 ceph-mon[116142]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 66 KiB/s, 0 objects/s recovering 2023-12-05T09:53:01.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:01 smithi100 ceph-mon[107145]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 66 KiB/s, 0 objects/s recovering 2023-12-05T09:53:03.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:03 smithi150 ceph-mon[116142]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 57 KiB/s, 0 objects/s recovering 2023-12-05T09:53:03.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:03 smithi100 ceph-mon[107145]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 57 KiB/s, 0 objects/s recovering 2023-12-05T09:53:05.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:05 smithi100 ceph-mon[107145]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-12-05T09:53:05.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:05 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:53:05.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:05 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:53:05.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:05 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:53:05.477 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:05 smithi150 ceph-mon[116142]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-12-05T09:53:05.477 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:05 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:53:05.477 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:05 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:53:05.477 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:05 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:53:06.972 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:06.974+0000 7f7c55ffb700 1 -- 172.21.15.150:0/286709882 <== mgr.14210 v2:172.21.15.100:6800/1237547575 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f7c60111540 con 0x7f7c4c068f70 2023-12-05T09:53:06.972 INFO:teuthology.orchestra.run.smithi150.stdout:Created osd(s) 4 on host 'smithi150' 2023-12-05T09:53:06.974 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:06.976+0000 7f7c673be700 1 -- 172.21.15.150:0/286709882 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f7c4c068f70 msgr2=0x7f7c4c06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:53:06.975 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:06.976+0000 7f7c673be700 1 --2- 172.21.15.150:0/286709882 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f7c4c068f70 0x7f7c4c06b420 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c009b80 tx=0x7f7c5c00b040 comp rx=0 tx=0).stop 2023-12-05T09:53:06.975 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:06.976+0000 7f7c673be700 1 -- 172.21.15.150:0/286709882 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c600fde00 msgr2=0x7f7c6010fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:53:06.975 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:06.976+0000 7f7c673be700 1 --2- 172.21.15.150:0/286709882 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c600fde00 0x7f7c6010fc00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7c50008f90 tx=0x7f7c50009e30 comp rx=0 tx=0).stop 2023-12-05T09:53:06.975 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:06.976+0000 7f7c673be700 1 -- 172.21.15.150:0/286709882 shutdown_connections 2023-12-05T09:53:06.975 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:06.976+0000 7f7c673be700 1 --2- 172.21.15.150:0/286709882 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f7c4c068f70 0x7f7c4c06b420 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:06.975 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:06.976+0000 7f7c673be700 1 --2- 172.21.15.150:0/286709882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c600fcbf0 0x7f7c6010f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:06.975 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:06.976+0000 7f7c673be700 1 --2- 172.21.15.150:0/286709882 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c600fde00 0x7f7c6010fc00 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:06.975 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:06.976+0000 7f7c673be700 1 -- 172.21.15.150:0/286709882 >> 172.21.15.150:0/286709882 conn(0x7f7c600f82d0 msgr2=0x7f7c600ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:53:06.975 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:06.976+0000 7f7c673be700 1 -- 172.21.15.150:0/286709882 shutdown_connections 2023-12-05T09:53:06.975 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:06.977+0000 7f7c673be700 1 -- 172.21.15.150:0/286709882 wait complete. 2023-12-05T09:53:07.187 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:07 smithi150 ceph-mon[116142]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-05T09:53:07.225 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:07 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:53:07.225 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:07 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:53:07.225 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:07 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:53:07.225 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:07 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:53:07.376 DEBUG:teuthology.orchestra.run.smithi150:osd.4> sudo journalctl -f -n 0 -u ceph-5b035ce6-9353-11ee-95a2-87774f69a715@osd.4.service 2023-12-05T09:53:07.380 INFO:tasks.cephadm:Deploying osd.5 on smithi150 with /dev/vg_nvme/lv_2... 2023-12-05T09:53:07.381 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-12-05T09:53:07.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:07 smithi100 ceph-mon[107145]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-05T09:53:07.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:07 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:53:07.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:07 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:53:07.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:07 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:53:07.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:07 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:53:07.465 INFO:journalctl@ceph.osd.4.smithi150.stdout:-- Logs begin at Tue 2023-12-05 09:31:29 UTC. -- 2023-12-05T09:53:08.509 INFO:journalctl@ceph.osd.4.smithi150.stdout:Dec 05 09:53:08 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-4[130375]: 2023-12-05T09:53:08.157+0000 7f88b342f540 -1 osd.4 0 log_to_monitors true 2023-12-05T09:53:08.558 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi150/config 2023-12-05T09:53:09.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:09 smithi100 ceph-mon[107145]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-05T09:53:09.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:09 smithi100 ceph-mon[107145]: from='osd.4 [v2:172.21.15.150:6808/2589618062,v1:172.21.15.150:6809/2589618062]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-05T09:53:09.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:09 smithi100 ceph-mon[107145]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-05T09:53:09.459 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:09 smithi150 ceph-mon[116142]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-05T09:53:09.459 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:09 smithi150 ceph-mon[116142]: from='osd.4 [v2:172.21.15.150:6808/2589618062,v1:172.21.15.150:6809/2589618062]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-05T09:53:09.459 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:09 smithi150 ceph-mon[116142]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-05T09:53:10.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:10 smithi100 ceph-mon[107145]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-12-05T09:53:10.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:10 smithi100 ceph-mon[107145]: osdmap e32: 5 total, 4 up, 5 in 2023-12-05T09:53:10.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:10 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-05T09:53:10.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:10 smithi100 ceph-mon[107145]: from='osd.4 [v2:172.21.15.150:6808/2589618062,v1:172.21.15.150:6809/2589618062]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2023-12-05T09:53:10.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:10 smithi100 ceph-mon[107145]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2023-12-05T09:53:10.399 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:10 smithi150 ceph-mon[116142]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-12-05T09:53:10.399 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:10 smithi150 ceph-mon[116142]: osdmap e32: 5 total, 4 up, 5 in 2023-12-05T09:53:10.399 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:10 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-05T09:53:10.399 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:10 smithi150 ceph-mon[116142]: from='osd.4 [v2:172.21.15.150:6808/2589618062,v1:172.21.15.150:6809/2589618062]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2023-12-05T09:53:10.399 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:10 smithi150 ceph-mon[116142]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2023-12-05T09:53:10.400 INFO:journalctl@ceph.osd.4.smithi150.stdout:Dec 05 09:53:10 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-4[130375]: 2023-12-05T09:53:10.144+0000 7f88a9c14700 -1 osd.4 0 waiting for initial osdmap 2023-12-05T09:53:10.400 INFO:journalctl@ceph.osd.4.smithi150.stdout:Dec 05 09:53:10 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-4[130375]: 2023-12-05T09:53:10.155+0000 7f88a420e700 -1 osd.4 33 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-05T09:53:10.505 INFO:teuthology.orchestra.run.smithi150.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-12-05T09:53:10.505 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-12-05T09:53:10.505 INFO:teuthology.orchestra.run.smithi150.stderr: stderr: 10+0 records in 2023-12-05T09:53:10.505 INFO:teuthology.orchestra.run.smithi150.stderr:10+0 records out 2023-12-05T09:53:10.506 INFO:teuthology.orchestra.run.smithi150.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0348491 s, 301 MB/s 2023-12-05T09:53:10.506 INFO:teuthology.orchestra.run.smithi150.stderr:--> Zapping successful for: 2023-12-05T09:53:10.932 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- ceph orch daemon add osd smithi150:vg_nvme/lv_2 2023-12-05T09:53:11.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:11 smithi150 ceph-mon[116142]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-05T09:53:11.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:11 smithi150 ceph-mon[116142]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]': finished 2023-12-05T09:53:11.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:11 smithi150 ceph-mon[116142]: osdmap e33: 5 total, 4 up, 5 in 2023-12-05T09:53:11.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:11 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-05T09:53:11.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:11 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-05T09:53:11.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:11 smithi150 ceph-mon[116142]: Detected new or changed devices on smithi150 2023-12-05T09:53:11.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:11 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:53:11.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:11 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:53:11.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:11 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:53:11.347 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:11 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:53:11.347 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:11 smithi150 ceph-mon[116142]: Adjusting osd_memory_target on smithi150 to 8059M 2023-12-05T09:53:11.347 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:11 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:53:11.347 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:11 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:53:11.347 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:11 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:53:11.347 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:11 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:53:11.347 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:11 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:53:11.347 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:11 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:53:11.347 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:11 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:53:11.347 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:11 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:53:11.347 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:11 smithi150 ceph-mon[116142]: osd.4 [v2:172.21.15.150:6808/2589618062,v1:172.21.15.150:6809/2589618062] boot 2023-12-05T09:53:11.347 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:11 smithi150 ceph-mon[116142]: osdmap e34: 5 total, 5 up, 5 in 2023-12-05T09:53:11.347 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:11 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-05T09:53:11.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:11 smithi100 ceph-mon[107145]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-05T09:53:11.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:11 smithi100 ceph-mon[107145]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]': finished 2023-12-05T09:53:11.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:11 smithi100 ceph-mon[107145]: osdmap e33: 5 total, 4 up, 5 in 2023-12-05T09:53:11.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:11 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-05T09:53:11.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:11 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-05T09:53:11.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:11 smithi100 ceph-mon[107145]: Detected new or changed devices on smithi150 2023-12-05T09:53:11.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:11 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:53:11.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:11 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:53:11.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:11 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:53:11.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:11 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:53:11.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:11 smithi100 ceph-mon[107145]: Adjusting osd_memory_target on smithi150 to 8059M 2023-12-05T09:53:11.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:11 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:53:11.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:11 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:53:11.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:11 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:53:11.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:11 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:53:11.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:11 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:53:11.397 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:11 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:53:11.397 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:11 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:53:11.397 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:11 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:53:11.397 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:11 smithi100 ceph-mon[107145]: osd.4 [v2:172.21.15.150:6808/2589618062,v1:172.21.15.150:6809/2589618062] boot 2023-12-05T09:53:11.397 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:11 smithi100 ceph-mon[107145]: osdmap e34: 5 total, 5 up, 5 in 2023-12-05T09:53:11.397 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:11 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-05T09:53:11.401 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi150/config 2023-12-05T09:53:12.331 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:12 smithi150 ceph-mon[116142]: purged_snaps scrub starts 2023-12-05T09:53:12.331 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:12 smithi150 ceph-mon[116142]: purged_snaps scrub ok 2023-12-05T09:53:12.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:12 smithi100 ceph-mon[107145]: purged_snaps scrub starts 2023-12-05T09:53:12.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:12 smithi100 ceph-mon[107145]: purged_snaps scrub ok 2023-12-05T09:53:12.566 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:12.568+0000 7f7bf676b700 1 -- 172.21.15.150:0/2509065396 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7bf0071bc0 msgr2=0x7f7bf0070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:53:12.567 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:12.568+0000 7f7bf676b700 1 --2- 172.21.15.150:0/2509065396 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7bf0071bc0 0x7f7bf0070030 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7be0004940 tx=0x7f7be0009e30 comp rx=0 tx=0).stop 2023-12-05T09:53:12.567 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:12.568+0000 7f7bf676b700 1 -- 172.21.15.150:0/2509065396 shutdown_connections 2023-12-05T09:53:12.567 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:12.568+0000 7f7bf676b700 1 --2- 172.21.15.150:0/2509065396 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bf0070570 0x7f7bf00709c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:12.567 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:12.568+0000 7f7bf676b700 1 --2- 172.21.15.150:0/2509065396 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7bf0071bc0 0x7f7bf0070030 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:12.567 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:12.568+0000 7f7bf676b700 1 -- 172.21.15.150:0/2509065396 >> 172.21.15.150:0/2509065396 conn(0x7f7bf00f82d0 msgr2=0x7f7bf00fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:53:12.567 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:12.568+0000 7f7bf676b700 1 -- 172.21.15.150:0/2509065396 shutdown_connections 2023-12-05T09:53:12.567 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:12.568+0000 7f7bf676b700 1 -- 172.21.15.150:0/2509065396 wait complete. 2023-12-05T09:53:12.569 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:12.569+0000 7f7bf676b700 1 Processor -- start 2023-12-05T09:53:12.569 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:12.569+0000 7f7bf676b700 1 -- start start 2023-12-05T09:53:12.569 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:12.569+0000 7f7bf676b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7bf0070570 0x7f7bf010f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:53:12.569 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:12.569+0000 7f7bf676b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bf0071bc0 0x7f7bf010fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:53:12.570 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:12.569+0000 7f7bf676b700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf0110210 con 0x7f7bf0071bc0 2023-12-05T09:53:12.570 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:12.569+0000 7f7bf676b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf0110ab0 con 0x7f7bf0070570 2023-12-05T09:53:12.570 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:12.569+0000 7f7beffff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7bf0070570 0x7f7bf010f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:53:12.570 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:12.570+0000 7f7beffff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7bf0070570 0x7f7bf010f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:58232/0 (socket says 172.21.15.150:58232) 2023-12-05T09:53:12.570 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:12.570+0000 7f7beffff700 1 -- 172.21.15.150:0/852412306 learned_addr learned my addr 172.21.15.150:0/852412306 (peer_addr_for_me v2:172.21.15.150:0/0) 2023-12-05T09:53:12.570 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:12.570+0000 7f7bef7fe700 1 --2- 172.21.15.150:0/852412306 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bf0071bc0 0x7f7bf010fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:53:12.570 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:12.570+0000 7f7beffff700 1 -- 172.21.15.150:0/852412306 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bf0071bc0 msgr2=0x7f7bf010fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:53:12.570 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:12.570+0000 7f7beffff700 1 --2- 172.21.15.150:0/852412306 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bf0071bc0 0x7f7bf010fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:12.570 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:12.570+0000 7f7beffff700 1 -- 172.21.15.150:0/852412306 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be0005040 con 0x7f7bf0070570 2023-12-05T09:53:12.570 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:12.570+0000 7f7beffff700 1 --2- 172.21.15.150:0/852412306 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7bf0070570 0x7f7bf010f6d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7be0009040 tx=0x7f7be0009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:53:12.571 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:12.570+0000 7f7becff9700 1 -- 172.21.15.150:0/852412306 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7be000e040 con 0x7f7bf0070570 2023-12-05T09:53:12.571 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:12.570+0000 7f7becff9700 1 -- 172.21.15.150:0/852412306 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7be0004290 con 0x7f7bf0070570 2023-12-05T09:53:12.571 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:12.570+0000 7f7bf676b700 1 -- 172.21.15.150:0/852412306 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bf0110d30 con 0x7f7bf0070570 2023-12-05T09:53:12.571 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:12.570+0000 7f7becff9700 1 -- 172.21.15.150:0/852412306 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7be001c630 con 0x7f7bf0070570 2023-12-05T09:53:12.571 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:12.571+0000 7f7bf676b700 1 -- 172.21.15.150:0/852412306 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bf0111270 con 0x7f7bf0070570 2023-12-05T09:53:12.572 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:12.572+0000 7f7bf676b700 1 -- 172.21.15.150:0/852412306 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bf0109700 con 0x7f7bf0070570 2023-12-05T09:53:12.572 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:12.573+0000 7f7becff9700 1 -- 172.21.15.150:0/852412306 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f7be000bc50 con 0x7f7bf0070570 2023-12-05T09:53:12.573 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:12.575+0000 7f7becff9700 1 --2- 172.21.15.150:0/852412306 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f7bd8068f70 0x7f7bd806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:53:12.573 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:12.575+0000 7f7becff9700 1 -- 172.21.15.150:0/852412306 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4202+0+0 (secure 0 0 0) 0x7f7be0087da0 con 0x7f7bf0070570 2023-12-05T09:53:12.573 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:12.575+0000 7f7bef7fe700 1 --2- 172.21.15.150:0/852412306 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f7bd8068f70 0x7f7bd806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:53:12.574 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:12.576+0000 7f7bef7fe700 1 --2- 172.21.15.150:0/852412306 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f7bd8068f70 0x7f7bd806b420 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7be4004f40 tx=0x7f7be400b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:53:12.577 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:12.579+0000 7f7becff9700 1 -- 172.21.15.150:0/852412306 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f7be00581f0 con 0x7f7bf0070570 2023-12-05T09:53:12.776 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:12.778+0000 7f7bf676b700 1 -- 172.21.15.150:0/852412306 --> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi150:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f7bf002b150 con 0x7f7bd8068f70 2023-12-05T09:53:13.431 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:13 smithi150 ceph-mon[116142]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-05T09:53:13.431 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:13 smithi150 ceph-mon[116142]: osdmap e35: 5 total, 5 up, 5 in 2023-12-05T09:53:13.431 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:13 smithi150 ceph-mon[116142]: from='client.24181 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi150:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:53:13.431 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:13 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-05T09:53:13.431 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:13 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-05T09:53:13.431 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:13 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:53:13.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:13 smithi100 ceph-mon[107145]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-05T09:53:13.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:13 smithi100 ceph-mon[107145]: osdmap e35: 5 total, 5 up, 5 in 2023-12-05T09:53:13.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:13 smithi100 ceph-mon[107145]: from='client.24181 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi150:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:53:13.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:13 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-05T09:53:13.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:13 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-05T09:53:13.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:13 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:53:15.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:15 smithi100 ceph-mon[107145]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-05T09:53:15.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:15 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:53:15.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:15 smithi100 ceph-mon[107145]: from='client.? 172.21.15.150:0/1598755375' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "93b2d10b-0410-4390-9283-b4129c0439d8"}]: dispatch 2023-12-05T09:53:15.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:15 smithi100 ceph-mon[107145]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "93b2d10b-0410-4390-9283-b4129c0439d8"}]: dispatch 2023-12-05T09:53:15.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:15 smithi100 ceph-mon[107145]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "93b2d10b-0410-4390-9283-b4129c0439d8"}]': finished 2023-12-05T09:53:15.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:15 smithi100 ceph-mon[107145]: osdmap e36: 6 total, 5 up, 6 in 2023-12-05T09:53:15.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:15 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-05T09:53:15.700 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:15 smithi150 ceph-mon[116142]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-05T09:53:15.700 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:15 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:53:15.700 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:15 smithi150 ceph-mon[116142]: from='client.? 172.21.15.150:0/1598755375' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "93b2d10b-0410-4390-9283-b4129c0439d8"}]: dispatch 2023-12-05T09:53:15.700 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:15 smithi150 ceph-mon[116142]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "93b2d10b-0410-4390-9283-b4129c0439d8"}]: dispatch 2023-12-05T09:53:15.700 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:15 smithi150 ceph-mon[116142]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "93b2d10b-0410-4390-9283-b4129c0439d8"}]': finished 2023-12-05T09:53:15.701 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:15 smithi150 ceph-mon[116142]: osdmap e36: 6 total, 5 up, 6 in 2023-12-05T09:53:15.701 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:15 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-05T09:53:16.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:16 smithi100 ceph-mon[107145]: from='client.? 172.21.15.150:0/1094745259' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-05T09:53:16.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:16 smithi150 ceph-mon[116142]: from='client.? 172.21.15.150:0/1094745259' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-05T09:53:17.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:17 smithi100 ceph-mon[107145]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-05T09:53:17.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:17 smithi150 ceph-mon[116142]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-05T09:53:19.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:19 smithi150 ceph-mon[116142]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-05T09:53:19.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:19 smithi100 ceph-mon[107145]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-05T09:53:21.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:21 smithi150 ceph-mon[116142]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-05T09:53:21.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:21 smithi100 ceph-mon[107145]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-05T09:53:22.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:22 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-05T09:53:22.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:22 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:53:22.840 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:22 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-05T09:53:22.841 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:22 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:53:23.595 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:23 smithi150 ceph-mon[116142]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-05T09:53:23.595 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:23 smithi150 ceph-mon[116142]: Deploying daemon osd.5 on smithi150 2023-12-05T09:53:23.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:23 smithi100 ceph-mon[107145]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-05T09:53:23.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:23 smithi100 ceph-mon[107145]: Deploying daemon osd.5 on smithi150 2023-12-05T09:53:25.699 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:25 smithi150 ceph-mon[116142]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-05T09:53:25.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:25 smithi100 ceph-mon[107145]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-05T09:53:27.595 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:27 smithi150 ceph-mon[116142]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-05T09:53:27.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:27 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:53:27.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:27 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:53:27.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:27 smithi100 ceph-mon[107145]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-05T09:53:27.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:27 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:53:27.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:27 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:53:28.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:28 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:53:28.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:28 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:53:29.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:29 smithi150 ceph-mon[116142]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-05T09:53:29.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:29 smithi100 ceph-mon[107145]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-05T09:53:30.557 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:30 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:53:30.557 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:30 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:53:30.557 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:30 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:53:30.557 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:30 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:53:30.558 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:30 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:53:30.558 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:30 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:53:30.600 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:30.603+0000 7f7becff9700 1 -- 172.21.15.150:0/852412306 <== mgr.14210 v2:172.21.15.100:6800/1237547575 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f7bf002b150 con 0x7f7bd8068f70 2023-12-05T09:53:30.600 INFO:teuthology.orchestra.run.smithi150.stdout:Created osd(s) 5 on host 'smithi150' 2023-12-05T09:53:30.603 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:30.606+0000 7f7bf676b700 1 -- 172.21.15.150:0/852412306 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f7bd8068f70 msgr2=0x7f7bd806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:53:30.604 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:30.606+0000 7f7bf676b700 1 --2- 172.21.15.150:0/852412306 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f7bd8068f70 0x7f7bd806b420 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7be4004f40 tx=0x7f7be400b040 comp rx=0 tx=0).stop 2023-12-05T09:53:30.604 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:30.606+0000 7f7bf676b700 1 -- 172.21.15.150:0/852412306 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7bf0070570 msgr2=0x7f7bf010f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:53:30.604 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:30.606+0000 7f7bf676b700 1 --2- 172.21.15.150:0/852412306 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7bf0070570 0x7f7bf010f6d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7be0009040 tx=0x7f7be0009e30 comp rx=0 tx=0).stop 2023-12-05T09:53:30.604 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:30.606+0000 7f7bf676b700 1 -- 172.21.15.150:0/852412306 shutdown_connections 2023-12-05T09:53:30.604 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:30.606+0000 7f7bf676b700 1 --2- 172.21.15.150:0/852412306 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f7bd8068f70 0x7f7bd806b420 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:30.604 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:30.606+0000 7f7bf676b700 1 --2- 172.21.15.150:0/852412306 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7bf0070570 0x7f7bf010f6d0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:30.604 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:30.606+0000 7f7bf676b700 1 --2- 172.21.15.150:0/852412306 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bf0071bc0 0x7f7bf010fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:30.604 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:30.606+0000 7f7bf676b700 1 -- 172.21.15.150:0/852412306 >> 172.21.15.150:0/852412306 conn(0x7f7bf00f82d0 msgr2=0x7f7bf00fa610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:53:30.604 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:30.607+0000 7f7bf676b700 1 -- 172.21.15.150:0/852412306 shutdown_connections 2023-12-05T09:53:30.604 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:30.607+0000 7f7bf676b700 1 -- 172.21.15.150:0/852412306 wait complete. 2023-12-05T09:53:30.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:30 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:53:30.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:30 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:53:30.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:30 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:53:30.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:30 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:53:30.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:30 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:53:30.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:30 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:53:31.012 DEBUG:teuthology.orchestra.run.smithi150:osd.5> sudo journalctl -f -n 0 -u ceph-5b035ce6-9353-11ee-95a2-87774f69a715@osd.5.service 2023-12-05T09:53:31.018 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2023-12-05T09:53:31.018 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- ceph osd stat -f json 2023-12-05T09:53:31.096 INFO:journalctl@ceph.osd.5.smithi150.stdout:-- Logs begin at Tue 2023-12-05 09:31:29 UTC. -- 2023-12-05T09:53:31.444 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi100/config 2023-12-05T09:53:31.681 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:31 smithi150 ceph-mon[116142]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-05T09:53:31.681 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:31 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:53:31.681 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:31 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:53:31.681 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:31 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:53:31.681 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:31 smithi150 ceph-mon[116142]: from='osd.5 [v2:172.21.15.150:6816/4116522433,v1:172.21.15.150:6817/4116522433]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-05T09:53:31.682 INFO:journalctl@ceph.osd.5.smithi150.stdout:Dec 05 09:53:31 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-5[138231]: 2023-12-05T09:53:31.460+0000 7fa9c1cb4540 -1 osd.5 0 log_to_monitors true 2023-12-05T09:53:31.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:31 smithi100 ceph-mon[107145]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-05T09:53:31.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:31 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:53:31.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:31 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:53:31.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:31 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:53:31.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:31 smithi100 ceph-mon[107145]: from='osd.5 [v2:172.21.15.150:6816/4116522433,v1:172.21.15.150:6817/4116522433]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-05T09:53:32.704 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:32.706+0000 7f4061f32700 1 -- 172.21.15.100:0/3418111229 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f405c071bc0 msgr2=0x7f405c070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:53:32.704 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:32.706+0000 7f4061f32700 1 --2- 172.21.15.100:0/3418111229 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f405c071bc0 0x7f405c070030 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f404c004940 tx=0x7f404c009e30 comp rx=0 tx=0).stop 2023-12-05T09:53:32.704 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:32.706+0000 7f4061f32700 1 -- 172.21.15.100:0/3418111229 shutdown_connections 2023-12-05T09:53:32.704 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:32.706+0000 7f4061f32700 1 --2- 172.21.15.100:0/3418111229 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f405c070570 0x7f405c0709c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:32.704 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:32.706+0000 7f4061f32700 1 --2- 172.21.15.100:0/3418111229 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f405c071bc0 0x7f405c070030 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:32.704 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:32.706+0000 7f4061f32700 1 -- 172.21.15.100:0/3418111229 >> 172.21.15.100:0/3418111229 conn(0x7f405c0f82d0 msgr2=0x7f405c0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:53:32.704 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:32.706+0000 7f4061f32700 1 -- 172.21.15.100:0/3418111229 shutdown_connections 2023-12-05T09:53:32.704 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:32.706+0000 7f4061f32700 1 -- 172.21.15.100:0/3418111229 wait complete. 2023-12-05T09:53:32.705 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:32.707+0000 7f4061f32700 1 Processor -- start 2023-12-05T09:53:32.705 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:32.707+0000 7f4061f32700 1 -- start start 2023-12-05T09:53:32.705 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:32.707+0000 7f4061f32700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f405c070570 0x7f405c10f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:53:32.705 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:32.708+0000 7f4061f32700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f405c071bc0 0x7f405c10fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:53:32.706 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:32.708+0000 7f4061f32700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f405c110420 con 0x7f405c070570 2023-12-05T09:53:32.706 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:32.708+0000 7f4061f32700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f405c110cc0 con 0x7f405c071bc0 2023-12-05T09:53:32.706 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:32.708+0000 7f405b7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f405c070570 0x7f405c10f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:53:32.706 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:32.708+0000 7f405affd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f405c071bc0 0x7f405c10fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:53:32.706 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:32.708+0000 7f405affd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f405c071bc0 0x7f405c10fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.100:54756/0 (socket says 172.21.15.100:54756) 2023-12-05T09:53:32.706 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:32.708+0000 7f405b7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f405c070570 0x7f405c10f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37166/0 (socket says 172.21.15.100:37166) 2023-12-05T09:53:32.706 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:32.708+0000 7f405affd700 1 -- 172.21.15.100:0/2524039455 learned_addr learned my addr 172.21.15.100:0/2524039455 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:53:32.707 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:32.708+0000 7f405affd700 1 -- 172.21.15.100:0/2524039455 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f405c070570 msgr2=0x7f405c10f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:53:32.707 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:32.708+0000 7f405affd700 1 --2- 172.21.15.100:0/2524039455 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f405c070570 0x7f405c10f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:32.707 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:32.708+0000 7f405affd700 1 -- 172.21.15.100:0/2524039455 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f404c005040 con 0x7f405c071bc0 2023-12-05T09:53:32.707 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:32.708+0000 7f405affd700 1 --2- 172.21.15.100:0/2524039455 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f405c071bc0 0x7f405c10fe20 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f405000eb40 tx=0x7f405000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:53:32.707 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:32.709+0000 7f4043fff700 1 -- 172.21.15.100:0/2524039455 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4050007cc0 con 0x7f405c071bc0 2023-12-05T09:53:32.707 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:32.709+0000 7f4061f32700 1 -- 172.21.15.100:0/2524039455 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f405c110f40 con 0x7f405c071bc0 2023-12-05T09:53:32.707 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:32.709+0000 7f4043fff700 1 -- 172.21.15.100:0/2524039455 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f405000f040 con 0x7f405c071bc0 2023-12-05T09:53:32.707 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:32.709+0000 7f4043fff700 1 -- 172.21.15.100:0/2524039455 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f405000c990 con 0x7f405c071bc0 2023-12-05T09:53:32.707 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:32.709+0000 7f4061f32700 1 -- 172.21.15.100:0/2524039455 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f405c111480 con 0x7f405c071bc0 2023-12-05T09:53:32.708 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:32.710+0000 7f4061f32700 1 -- 172.21.15.100:0/2524039455 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f405c1096f0 con 0x7f405c071bc0 2023-12-05T09:53:32.708 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:32.711+0000 7f4043fff700 1 -- 172.21.15.100:0/2524039455 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f405000cc00 con 0x7f405c071bc0 2023-12-05T09:53:32.709 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:32.712+0000 7f4043fff700 1 --2- 172.21.15.100:0/2524039455 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f4044068f70 0x7f404406b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:53:32.709 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:32.712+0000 7f4043fff700 1 -- 172.21.15.100:0/2524039455 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4354+0+0 (secure 0 0 0) 0x7f40500865f0 con 0x7f405c071bc0 2023-12-05T09:53:32.709 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:32.712+0000 7f405b7fe700 1 --2- 172.21.15.100:0/2524039455 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f4044068f70 0x7f404406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:53:32.710 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:32.712+0000 7f405b7fe700 1 --2- 172.21.15.100:0/2524039455 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f4044068f70 0x7f404406b420 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f404c013600 tx=0x7f404c009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:53:32.714 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:32.716+0000 7f4043fff700 1 -- 172.21.15.100:0/2524039455 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f405004da00 con 0x7f405c071bc0 2023-12-05T09:53:32.846 INFO:journalctl@ceph.osd.5.smithi150.stdout:Dec 05 09:53:32 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-5[138231]: 2023-12-05T09:53:32.599+0000 7fa9b8499700 -1 osd.5 0 waiting for initial osdmap 2023-12-05T09:53:32.846 INFO:journalctl@ceph.osd.5.smithi150.stdout:Dec 05 09:53:32 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-5[138231]: 2023-12-05T09:53:32.609+0000 7fa9b2292700 -1 osd.5 38 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-05T09:53:32.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:32 smithi150 ceph-mon[116142]: from='osd.5 [v2:172.21.15.150:6816/4116522433,v1:172.21.15.150:6817/4116522433]' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-12-05T09:53:32.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:32 smithi150 ceph-mon[116142]: osdmap e37: 6 total, 5 up, 6 in 2023-12-05T09:53:32.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:32 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-05T09:53:32.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:32 smithi150 ceph-mon[116142]: from='osd.5 [v2:172.21.15.150:6816/4116522433,v1:172.21.15.150:6817/4116522433]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2023-12-05T09:53:32.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:32 smithi100 ceph-mon[107145]: from='osd.5 [v2:172.21.15.150:6816/4116522433,v1:172.21.15.150:6817/4116522433]' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-12-05T09:53:32.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:32 smithi100 ceph-mon[107145]: osdmap e37: 6 total, 5 up, 6 in 2023-12-05T09:53:32.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:32 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-05T09:53:32.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:32 smithi100 ceph-mon[107145]: from='osd.5 [v2:172.21.15.150:6816/4116522433,v1:172.21.15.150:6817/4116522433]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2023-12-05T09:53:32.905 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:32.907+0000 7f4061f32700 1 -- 172.21.15.100:0/2524039455 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f405c107900 con 0x7f405c071bc0 2023-12-05T09:53:32.906 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:32.908+0000 7f4043fff700 1 -- 172.21.15.100:0/2524039455 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v38) v1 ==== 74+0+130 (secure 0 0 0) 0x7f4050056930 con 0x7f405c071bc0 2023-12-05T09:53:32.906 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:53:32.908 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:32.911+0000 7f4061f32700 1 -- 172.21.15.100:0/2524039455 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f4044068f70 msgr2=0x7f404406b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:53:32.908 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:32.911+0000 7f4061f32700 1 --2- 172.21.15.100:0/2524039455 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f4044068f70 0x7f404406b420 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f404c013600 tx=0x7f404c009e30 comp rx=0 tx=0).stop 2023-12-05T09:53:32.908 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:32.911+0000 7f4061f32700 1 -- 172.21.15.100:0/2524039455 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f405c071bc0 msgr2=0x7f405c10fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:53:32.909 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:32.911+0000 7f4061f32700 1 --2- 172.21.15.100:0/2524039455 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f405c071bc0 0x7f405c10fe20 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f405000eb40 tx=0x7f405000b040 comp rx=0 tx=0).stop 2023-12-05T09:53:32.909 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:32.911+0000 7f4061f32700 1 -- 172.21.15.100:0/2524039455 shutdown_connections 2023-12-05T09:53:32.909 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:32.911+0000 7f4061f32700 1 --2- 172.21.15.100:0/2524039455 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f4044068f70 0x7f404406b420 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:32.909 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:32.911+0000 7f4061f32700 1 --2- 172.21.15.100:0/2524039455 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f405c070570 0x7f405c10f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:32.909 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:32.911+0000 7f4061f32700 1 --2- 172.21.15.100:0/2524039455 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f405c071bc0 0x7f405c10fe20 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:32.909 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:32.911+0000 7f4061f32700 1 -- 172.21.15.100:0/2524039455 >> 172.21.15.100:0/2524039455 conn(0x7f405c0f82d0 msgr2=0x7f405c103310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:53:32.909 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:32.911+0000 7f4061f32700 1 -- 172.21.15.100:0/2524039455 shutdown_connections 2023-12-05T09:53:32.909 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:32.911+0000 7f4061f32700 1 -- 172.21.15.100:0/2524039455 wait complete. 2023-12-05T09:53:33.312 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":38,"num_osds":6,"num_up_osds":5,"osd_up_since":1701769991,"num_in_osds":6,"osd_in_since":1701769995,"num_remapped_pgs":0} 2023-12-05T09:53:33.745 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:33 smithi150 ceph-mon[116142]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-05T09:53:33.745 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:33 smithi150 ceph-mon[116142]: from='osd.5 [v2:172.21.15.150:6816/4116522433,v1:172.21.15.150:6817/4116522433]' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]': finished 2023-12-05T09:53:33.745 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:33 smithi150 ceph-mon[116142]: osdmap e38: 6 total, 5 up, 6 in 2023-12-05T09:53:33.746 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:33 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-05T09:53:33.746 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:33 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-05T09:53:33.746 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:33 smithi150 ceph-mon[116142]: from='client.? 172.21.15.100:0/2524039455' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-05T09:53:33.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:33 smithi100 ceph-mon[107145]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-05T09:53:33.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:33 smithi100 ceph-mon[107145]: from='osd.5 [v2:172.21.15.150:6816/4116522433,v1:172.21.15.150:6817/4116522433]' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]': finished 2023-12-05T09:53:33.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:33 smithi100 ceph-mon[107145]: osdmap e38: 6 total, 5 up, 6 in 2023-12-05T09:53:33.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:33 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-05T09:53:33.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:33 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-05T09:53:33.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:33 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/2524039455' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-05T09:53:34.314 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- ceph osd stat -f json 2023-12-05T09:53:34.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:34 smithi100 ceph-mon[107145]: purged_snaps scrub starts 2023-12-05T09:53:34.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:34 smithi100 ceph-mon[107145]: purged_snaps scrub ok 2023-12-05T09:53:34.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:34 smithi100 ceph-mon[107145]: osd.5 [v2:172.21.15.150:6816/4116522433,v1:172.21.15.150:6817/4116522433] boot 2023-12-05T09:53:34.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:34 smithi100 ceph-mon[107145]: osdmap e39: 6 total, 6 up, 6 in 2023-12-05T09:53:34.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:34 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-05T09:53:34.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:34 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:53:34.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:34 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:53:34.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:34 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:53:34.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:34 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:53:34.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:34 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:53:34.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:34 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:53:34.647 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:34 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:53:34.647 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:34 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:53:34.647 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:34 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:53:34.738 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi100/config 2023-12-05T09:53:35.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:34 smithi150 ceph-mon[116142]: purged_snaps scrub starts 2023-12-05T09:53:35.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:34 smithi150 ceph-mon[116142]: purged_snaps scrub ok 2023-12-05T09:53:35.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:34 smithi150 ceph-mon[116142]: osd.5 [v2:172.21.15.150:6816/4116522433,v1:172.21.15.150:6817/4116522433] boot 2023-12-05T09:53:35.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:34 smithi150 ceph-mon[116142]: osdmap e39: 6 total, 6 up, 6 in 2023-12-05T09:53:35.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:34 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-05T09:53:35.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:34 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:53:35.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:34 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:53:35.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:34 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:53:35.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:34 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:53:35.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:34 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:53:35.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:34 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:53:35.097 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:34 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:53:35.097 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:34 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:53:35.097 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:34 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:53:35.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:35 smithi100 ceph-mon[107145]: Detected new or changed devices on smithi150 2023-12-05T09:53:35.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:35 smithi100 ceph-mon[107145]: Adjusting osd_memory_target on smithi150 to 5373M 2023-12-05T09:53:35.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:35 smithi100 ceph-mon[107145]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-05T09:53:35.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:35 smithi100 ceph-mon[107145]: osdmap e40: 6 total, 6 up, 6 in 2023-12-05T09:53:35.983 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:35.985+0000 7f61ff471700 1 -- 172.21.15.100:0/3255188549 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61f8071bc0 msgr2=0x7f61f8070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:53:35.983 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:35.985+0000 7f61ff471700 1 --2- 172.21.15.100:0/3255188549 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61f8071bc0 0x7f61f8070030 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f61f4004940 tx=0x7f61f4009e30 comp rx=0 tx=0).stop 2023-12-05T09:53:35.983 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:35.985+0000 7f61ff471700 1 -- 172.21.15.100:0/3255188549 shutdown_connections 2023-12-05T09:53:35.983 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:35.985+0000 7f61ff471700 1 --2- 172.21.15.100:0/3255188549 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61f8070570 0x7f61f80709c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:35.983 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:35.985+0000 7f61ff471700 1 --2- 172.21.15.100:0/3255188549 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61f8071bc0 0x7f61f8070030 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:35.983 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:35.985+0000 7f61ff471700 1 -- 172.21.15.100:0/3255188549 >> 172.21.15.100:0/3255188549 conn(0x7f61f80f82d0 msgr2=0x7f61f80fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:53:35.983 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:35.985+0000 7f61ff471700 1 -- 172.21.15.100:0/3255188549 shutdown_connections 2023-12-05T09:53:35.983 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:35.985+0000 7f61ff471700 1 -- 172.21.15.100:0/3255188549 wait complete. 2023-12-05T09:53:35.985 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:35.986+0000 7f61ff471700 1 Processor -- start 2023-12-05T09:53:35.985 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:35.986+0000 7f61ff471700 1 -- start start 2023-12-05T09:53:35.985 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:35.987+0000 7f61ff471700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61f8070570 0x7f61f810f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:53:35.985 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:35.987+0000 7f61ff471700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61f8071bc0 0x7f61f810fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:53:35.985 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:35.987+0000 7f61ff471700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f8110420 con 0x7f61f8070570 2023-12-05T09:53:35.985 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:35.987+0000 7f61ff471700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f8110cc0 con 0x7f61f8071bc0 2023-12-05T09:53:35.985 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:35.987+0000 7f61fd20d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61f8070570 0x7f61f810f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:53:35.985 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:35.987+0000 7f61fd20d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61f8070570 0x7f61f810f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37176/0 (socket says 172.21.15.100:37176) 2023-12-05T09:53:35.985 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:35.987+0000 7f61fd20d700 1 -- 172.21.15.100:0/3997577452 learned_addr learned my addr 172.21.15.100:0/3997577452 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:53:35.985 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:35.987+0000 7f61fca0c700 1 --2- 172.21.15.100:0/3997577452 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61f8071bc0 0x7f61f810fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:53:35.986 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:35.987+0000 7f61fd20d700 1 -- 172.21.15.100:0/3997577452 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61f8071bc0 msgr2=0x7f61f810fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:53:35.986 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:35.987+0000 7f61fd20d700 1 --2- 172.21.15.100:0/3997577452 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61f8071bc0 0x7f61f810fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:35.986 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:35.987+0000 7f61fd20d700 1 -- 172.21.15.100:0/3997577452 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61f4005040 con 0x7f61f8070570 2023-12-05T09:53:35.986 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:35.987+0000 7f61fd20d700 1 --2- 172.21.15.100:0/3997577452 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61f8070570 0x7f61f810f8e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f61f4000c00 tx=0x7f61f4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:53:35.986 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:35.988+0000 7f61edffb700 1 -- 172.21.15.100:0/3997577452 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61f400e040 con 0x7f61f8070570 2023-12-05T09:53:35.987 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:35.988+0000 7f61edffb700 1 -- 172.21.15.100:0/3997577452 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f61f4004290 con 0x7f61f8070570 2023-12-05T09:53:35.987 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:35.988+0000 7f61edffb700 1 -- 172.21.15.100:0/3997577452 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61f401c3f0 con 0x7f61f8070570 2023-12-05T09:53:35.987 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:35.988+0000 7f61ff471700 1 -- 172.21.15.100:0/3997577452 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61f8110f40 con 0x7f61f8070570 2023-12-05T09:53:35.987 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:35.988+0000 7f61ff471700 1 -- 172.21.15.100:0/3997577452 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61f8111480 con 0x7f61f8070570 2023-12-05T09:53:35.987 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:35.989+0000 7f61ff471700 1 -- 172.21.15.100:0/3997577452 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61f81096f0 con 0x7f61f8070570 2023-12-05T09:53:35.987 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:35.990+0000 7f61edffb700 1 -- 172.21.15.100:0/3997577452 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f61f400bbf0 con 0x7f61f8070570 2023-12-05T09:53:35.988 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:35.991+0000 7f61edffb700 1 --2- 172.21.15.100:0/3997577452 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f61e4068f60 0x7f61e406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:53:35.988 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:35.991+0000 7f61edffb700 1 -- 172.21.15.100:0/3997577452 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f61f4087da0 con 0x7f61f8070570 2023-12-05T09:53:35.989 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:35.991+0000 7f61fca0c700 1 --2- 172.21.15.100:0/3997577452 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f61e4068f60 0x7f61e406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:53:35.989 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:35.992+0000 7f61fca0c700 1 --2- 172.21.15.100:0/3997577452 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f61e4068f60 0x7f61e406b410 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f61e8007fd0 tx=0x7f61e8009040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:53:35.993 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:35.996+0000 7f61edffb700 1 -- 172.21.15.100:0/3997577452 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f61f40580e0 con 0x7f61f8070570 2023-12-05T09:53:36.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:35 smithi150 ceph-mon[116142]: Detected new or changed devices on smithi150 2023-12-05T09:53:36.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:35 smithi150 ceph-mon[116142]: Adjusting osd_memory_target on smithi150 to 5373M 2023-12-05T09:53:36.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:35 smithi150 ceph-mon[116142]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-05T09:53:36.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:35 smithi150 ceph-mon[116142]: osdmap e40: 6 total, 6 up, 6 in 2023-12-05T09:53:36.187 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:36.189+0000 7f61ff471700 1 -- 172.21.15.100:0/3997577452 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f61f8109110 con 0x7f61f8070570 2023-12-05T09:53:36.187 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:36.190+0000 7f61edffb700 1 -- 172.21.15.100:0/3997577452 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v40) v1 ==== 74+0+130 (secure 0 0 0) 0x7f61f4057c70 con 0x7f61f8070570 2023-12-05T09:53:36.188 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:53:36.190 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:36.192+0000 7f61ff471700 1 -- 172.21.15.100:0/3997577452 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f61e4068f60 msgr2=0x7f61e406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:53:36.190 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:36.192+0000 7f61ff471700 1 --2- 172.21.15.100:0/3997577452 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f61e4068f60 0x7f61e406b410 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f61e8007fd0 tx=0x7f61e8009040 comp rx=0 tx=0).stop 2023-12-05T09:53:36.190 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:36.192+0000 7f61ff471700 1 -- 172.21.15.100:0/3997577452 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61f8070570 msgr2=0x7f61f810f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:53:36.190 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:36.192+0000 7f61ff471700 1 --2- 172.21.15.100:0/3997577452 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61f8070570 0x7f61f810f8e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f61f4000c00 tx=0x7f61f4009e30 comp rx=0 tx=0).stop 2023-12-05T09:53:36.190 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:36.192+0000 7f61ff471700 1 -- 172.21.15.100:0/3997577452 shutdown_connections 2023-12-05T09:53:36.190 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:36.192+0000 7f61ff471700 1 --2- 172.21.15.100:0/3997577452 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f61e4068f60 0x7f61e406b410 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:36.190 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:36.192+0000 7f61ff471700 1 --2- 172.21.15.100:0/3997577452 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61f8070570 0x7f61f810f8e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:36.190 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:36.192+0000 7f61ff471700 1 --2- 172.21.15.100:0/3997577452 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61f8071bc0 0x7f61f810fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:36.190 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:36.192+0000 7f61ff471700 1 -- 172.21.15.100:0/3997577452 >> 172.21.15.100:0/3997577452 conn(0x7f61f80f82d0 msgr2=0x7f61f8103310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:53:36.190 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:36.192+0000 7f61ff471700 1 -- 172.21.15.100:0/3997577452 shutdown_connections 2023-12-05T09:53:36.191 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:36.192+0000 7f61ff471700 1 -- 172.21.15.100:0/3997577452 wait complete. 2023-12-05T09:53:36.574 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":40,"num_osds":6,"num_up_osds":6,"osd_up_since":1701770013,"num_in_osds":6,"osd_in_since":1701769995,"num_remapped_pgs":0} 2023-12-05T09:53:36.574 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- ceph osd dump --format=json 2023-12-05T09:53:36.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:36 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/3997577452' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-05T09:53:36.997 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi100/config 2023-12-05T09:53:37.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:36 smithi150 ceph-mon[116142]: from='client.? 172.21.15.100:0/3997577452' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-05T09:53:37.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:37 smithi100 ceph-mon[107145]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:53:38.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:37 smithi150 ceph-mon[116142]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:53:38.249 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:38.251+0000 7f37e60ef700 1 -- 172.21.15.100:0/3447376925 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37e01035a0 msgr2=0x7f37e00fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:53:38.249 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:38.251+0000 7f37e60ef700 1 --2- 172.21.15.100:0/3447376925 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37e01035a0 0x7f37e00fcc10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f37d4004940 tx=0x7f37d4009e30 comp rx=0 tx=0).stop 2023-12-05T09:53:38.249 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:38.251+0000 7f37e60ef700 1 -- 172.21.15.100:0/3447376925 shutdown_connections 2023-12-05T09:53:38.249 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:38.251+0000 7f37e60ef700 1 --2- 172.21.15.100:0/3447376925 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37e01035a0 0x7f37e00fcc10 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:38.249 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:38.251+0000 7f37e60ef700 1 --2- 172.21.15.100:0/3447376925 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37e0102c00 0x7f37e0102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:38.249 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:38.251+0000 7f37e60ef700 1 -- 172.21.15.100:0/3447376925 >> 172.21.15.100:0/3447376925 conn(0x7f37e00f8790 msgr2=0x7f37e00faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:53:38.249 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:38.251+0000 7f37e60ef700 1 -- 172.21.15.100:0/3447376925 shutdown_connections 2023-12-05T09:53:38.249 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:38.251+0000 7f37e60ef700 1 -- 172.21.15.100:0/3447376925 wait complete. 2023-12-05T09:53:38.251 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:38.252+0000 7f37e60ef700 1 Processor -- start 2023-12-05T09:53:38.251 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:38.252+0000 7f37e60ef700 1 -- start start 2023-12-05T09:53:38.251 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:38.252+0000 7f37e60ef700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37e0102c00 0x7f37e006ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:53:38.251 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:38.252+0000 7f37e60ef700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37e01035a0 0x7f37e00704a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:53:38.251 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:38.252+0000 7f37e60ef700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37e0070af0 con 0x7f37e0102c00 2023-12-05T09:53:38.251 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:38.252+0000 7f37e60ef700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37e0070c60 con 0x7f37e01035a0 2023-12-05T09:53:38.251 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:38.252+0000 7f37df7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37e0102c00 0x7f37e006ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:53:38.251 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:38.252+0000 7f37df7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37e0102c00 0x7f37e006ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37192/0 (socket says 172.21.15.100:37192) 2023-12-05T09:53:38.251 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:38.252+0000 7f37df7fe700 1 -- 172.21.15.100:0/1978558770 learned_addr learned my addr 172.21.15.100:0/1978558770 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:53:38.251 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:38.253+0000 7f37deffd700 1 --2- 172.21.15.100:0/1978558770 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37e01035a0 0x7f37e00704a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:53:38.251 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:38.253+0000 7f37df7fe700 1 -- 172.21.15.100:0/1978558770 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37e01035a0 msgr2=0x7f37e00704a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:53:38.251 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:38.253+0000 7f37df7fe700 1 --2- 172.21.15.100:0/1978558770 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37e01035a0 0x7f37e00704a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:38.252 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:38.253+0000 7f37df7fe700 1 -- 172.21.15.100:0/1978558770 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37d4005040 con 0x7f37e0102c00 2023-12-05T09:53:38.252 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:38.253+0000 7f37df7fe700 1 --2- 172.21.15.100:0/1978558770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37e0102c00 0x7f37e006ff40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f37d0002a50 tx=0x7f37d00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:53:38.252 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:38.253+0000 7f37c7fff700 1 -- 172.21.15.100:0/1978558770 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f37d0007cc0 con 0x7f37e0102c00 2023-12-05T09:53:38.252 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:38.253+0000 7f37c7fff700 1 -- 172.21.15.100:0/1978558770 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f37d000f040 con 0x7f37e0102c00 2023-12-05T09:53:38.252 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:38.253+0000 7f37c7fff700 1 -- 172.21.15.100:0/1978558770 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f37d000d9c0 con 0x7f37e0102c00 2023-12-05T09:53:38.252 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:38.253+0000 7f37e60ef700 1 -- 172.21.15.100:0/1978558770 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37e0119880 con 0x7f37e0102c00 2023-12-05T09:53:38.252 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:38.253+0000 7f37e60ef700 1 -- 172.21.15.100:0/1978558770 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37e0119dc0 con 0x7f37e0102c00 2023-12-05T09:53:38.252 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:38.255+0000 7f37e60ef700 1 -- 172.21.15.100:0/1978558770 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37e01050d0 con 0x7f37e0102c00 2023-12-05T09:53:38.253 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:38.255+0000 7f37c7fff700 1 -- 172.21.15.100:0/1978558770 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f37d000db20 con 0x7f37e0102c00 2023-12-05T09:53:38.254 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:38.256+0000 7f37c7fff700 1 --2- 172.21.15.100:0/1978558770 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f37c8068f70 0x7f37c806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:53:38.254 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:38.256+0000 7f37c7fff700 1 -- 172.21.15.100:0/1978558770 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f37d0086750 con 0x7f37e0102c00 2023-12-05T09:53:38.254 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:38.256+0000 7f37deffd700 1 --2- 172.21.15.100:0/1978558770 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f37c8068f70 0x7f37c806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:53:38.254 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:38.257+0000 7f37deffd700 1 --2- 172.21.15.100:0/1978558770 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f37c8068f70 0x7f37c806b420 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f37e0071940 tx=0x7f37d4009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:53:38.258 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:38.261+0000 7f37c7fff700 1 -- 172.21.15.100:0/1978558770 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f37d0052ec0 con 0x7f37e0102c00 2023-12-05T09:53:38.454 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:38.455+0000 7f37e60ef700 1 -- 172.21.15.100:0/1978558770 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f37e00fc390 con 0x7f37e0102c00 2023-12-05T09:53:38.454 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:38.456+0000 7f37c7fff700 1 -- 172.21.15.100:0/1978558770 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11121 (secure 0 0 0) 0x7f37d00564e0 con 0x7f37e0102c00 2023-12-05T09:53:38.454 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:53:38.454 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":40,"fsid":"5b035ce6-9353-11ee-95a2-87774f69a715","created":"2023-12-05T09:48:33.718763+0000","modified":"2023-12-05T09:53:34.991888+0000","last_up_change":"2023-12-05T09:53:33.596224+0000","last_in_change":"2023-12-05T09:53:15.176570+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-05T09:52:26.650134+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"9f3faeed-8336-4509-9127-eafa0273ecea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2938979601},{"type":"v1","addr":"172.21.15.100:6803","nonce":2938979601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2938979601},{"type":"v1","addr":"172.21.15.100:6805","nonce":2938979601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":2938979601},{"type":"v1","addr":"172.21.15.100:6809","nonce":2938979601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2938979601},{"type":"v1","addr":"172.21.15.100:6807","nonce":2938979601}]},"public_addr":"172.21.15.100:6803/2938979601","cluster_addr":"172.21.15.100:6805/2938979601","heartbeat_back_addr":"172.21.15.100:6809/2938979601","heartbeat_front_addr":"172.21.15.100:6807/2938979601","state":["exists","up"]},{"osd":1,"uuid":"6ca8c1e2-e673-4dc4-b02d-c0805493bcf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":38684261},{"type":"v1","addr":"172.21.15.100:6811","nonce":38684261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":38684261},{"type":"v1","addr":"172.21.15.100:6813","nonce":38684261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":38684261},{"type":"v1","addr":"172.21.15.100:6817","nonce":38684261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":38684261},{"type":"v1","addr":"172.21.15.100:6815","nonce":38684261}]},"public_addr":"172.21.15.100:6811/38684261","cluster_addr":"172.21.15.100:6813/38684261","heartbeat_back_addr":"172.21.15.100:6817/38684261","heartbeat_front_addr":"172.21.15.100:6815/38684261","state":["exists","up"]},{"osd":2,"uuid":"59a55cb9-28ae-4485-8cbf-e5f6224bd377","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":2128721915},{"type":"v1","addr":"172.21.15.100:6819","nonce":2128721915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2128721915},{"type":"v1","addr":"172.21.15.100:6821","nonce":2128721915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":2128721915},{"type":"v1","addr":"172.21.15.100:6825","nonce":2128721915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":2128721915},{"type":"v1","addr":"172.21.15.100:6823","nonce":2128721915}]},"public_addr":"172.21.15.100:6819/2128721915","cluster_addr":"172.21.15.100:6821/2128721915","heartbeat_back_addr":"172.21.15.100:6825/2128721915","heartbeat_front_addr":"172.21.15.100:6823/2128721915","state":["exists","up"]},{"osd":3,"uuid":"e12b505f-7f0c-4d6f-b039-5aa793f79db0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":1626769878},{"type":"v1","addr":"172.21.15.150:6801","nonce":1626769878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":1626769878},{"type":"v1","addr":"172.21.15.150:6803","nonce":1626769878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":1626769878},{"type":"v1","addr":"172.21.15.150:6807","nonce":1626769878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":1626769878},{"type":"v1","addr":"172.21.15.150:6805","nonce":1626769878}]},"public_addr":"172.21.15.150:6801/1626769878","cluster_addr":"172.21.15.150:6803/1626769878","heartbeat_back_addr":"172.21.15.150:6807/1626769878","heartbeat_front_addr":"172.21.15.150:6805/1626769878","state":["exists","up"]},{"osd":4,"uuid":"33fbbf55-86ba-4e7f-a66b-e958dce72283","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":2589618062},{"type":"v1","addr":"172.21.15.150:6809","nonce":2589618062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":2589618062},{"type":"v1","addr":"172.21.15.150:6811","nonce":2589618062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":2589618062},{"type":"v1","addr":"172.21.15.150:6815","nonce":2589618062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":2589618062},{"type":"v1","addr":"172.21.15.150:6813","nonce":2589618062}]},"public_addr":"172.21.15.150:6809/2589618062","cluster_addr":"172.21.15.150:6811/2589618062","heartbeat_back_addr":"172.21.15.150:6815/2589618062","heartbeat_front_addr":"172.21.15.150:6813/2589618062","state":["exists","up"]},{"osd":5,"uuid":"93b2d10b-0410-4390-9283-b4129c0439d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":4116522433},{"type":"v1","addr":"172.21.15.150:6817","nonce":4116522433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":4116522433},{"type":"v1","addr":"172.21.15.150:6819","nonce":4116522433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":4116522433},{"type":"v1","addr":"172.21.15.150:6823","nonce":4116522433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":4116522433},{"type":"v1","addr":"172.21.15.150:6821","nonce":4116522433}]},"public_addr":"172.21.15.150:6817/4116522433","cluster_addr":"172.21.15.150:6819/4116522433","heartbeat_back_addr":"172.21.15.150:6823/4116522433","heartbeat_front_addr":"172.21.15.150:6821/4116522433","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T09:51:35.123538+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T09:51:59.961993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T09:52:23.976682+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T09:52:46.493238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T09:53:09.121783+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T09:53:32.450910+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:0/2826914555":"2023-12-06T09:50:30.059721+0000","172.21.15.100:6801/2397627746":"2023-12-06T09:50:30.059721+0000","172.21.15.100:0/737517101":"2023-12-06T09:50:30.059721+0000","172.21.15.100:0/1529397750":"2023-12-06T09:49:28.559106+0000","172.21.15.100:0/2992397636":"2023-12-06T09:49:01.007941+0000","172.21.15.100:6801/2647899624":"2023-12-06T09:49:28.559106+0000","172.21.15.100:6800/2647899624":"2023-12-06T09:49:28.559106+0000","172.21.15.100:0/556453695":"2023-12-06T09:49:28.559106+0000","172.21.15.100:0/567522562":"2023-12-06T09:49:01.007941+0000","172.21.15.100:6800/2397627746":"2023-12-06T09:50:30.059721+0000","172.21.15.100:0/4197065049":"2023-12-06T09:50:30.059721+0000","172.21.15.100:6800/3606837497":"2023-12-06T09:49:01.007941+0000","172.21.15.100:0/3942224339":"2023-12-06T09:49:28.559106+0000","172.21.15.100:0/2400356084":"2023-12-06T09:49:01.007941+0000","172.21.15.100:6801/3606837497":"2023-12-06T09:49:01.007941+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-05T09:53:38.456 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:38.458+0000 7f37e60ef700 1 -- 172.21.15.100:0/1978558770 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f37c8068f70 msgr2=0x7f37c806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:53:38.456 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:38.458+0000 7f37e60ef700 1 --2- 172.21.15.100:0/1978558770 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f37c8068f70 0x7f37c806b420 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f37e0071940 tx=0x7f37d4009e30 comp rx=0 tx=0).stop 2023-12-05T09:53:38.456 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:38.458+0000 7f37e60ef700 1 -- 172.21.15.100:0/1978558770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37e0102c00 msgr2=0x7f37e006ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:53:38.456 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:38.458+0000 7f37e60ef700 1 --2- 172.21.15.100:0/1978558770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37e0102c00 0x7f37e006ff40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f37d0002a50 tx=0x7f37d00046b0 comp rx=0 tx=0).stop 2023-12-05T09:53:38.457 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:38.458+0000 7f37e60ef700 1 -- 172.21.15.100:0/1978558770 shutdown_connections 2023-12-05T09:53:38.457 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:38.458+0000 7f37e60ef700 1 --2- 172.21.15.100:0/1978558770 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f37c8068f70 0x7f37c806b420 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:38.457 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:38.458+0000 7f37e60ef700 1 --2- 172.21.15.100:0/1978558770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37e0102c00 0x7f37e006ff40 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:38.457 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:38.458+0000 7f37e60ef700 1 --2- 172.21.15.100:0/1978558770 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37e01035a0 0x7f37e00704a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:38.457 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:38.458+0000 7f37e60ef700 1 -- 172.21.15.100:0/1978558770 >> 172.21.15.100:0/1978558770 conn(0x7f37e00f8790 msgr2=0x7f37e00fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:53:38.457 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:38.458+0000 7f37e60ef700 1 -- 172.21.15.100:0/1978558770 shutdown_connections 2023-12-05T09:53:38.457 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:38.458+0000 7f37e60ef700 1 -- 172.21.15.100:0/1978558770 wait complete. 2023-12-05T09:53:38.825 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-05T09:52:26.650134+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-12-05T09:53:38.825 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- ceph osd pool get .mgr pg_num 2023-12-05T09:53:39.246 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi100/config 2023-12-05T09:53:39.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:39 smithi100 ceph-mon[107145]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:53:39.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:39 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/1978558770' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-05T09:53:39.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:39 smithi150 ceph-mon[116142]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:53:39.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:39 smithi150 ceph-mon[116142]: from='client.? 172.21.15.100:0/1978558770' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-05T09:53:40.413 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:40.415+0000 7f1143959700 1 -- 172.21.15.100:0/990976775 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f113c1035a0 msgr2=0x7f113c0fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:53:40.413 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:40.415+0000 7f1143959700 1 --2- 172.21.15.100:0/990976775 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f113c1035a0 0x7f113c0fcc10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f112c004940 tx=0x7f112c009e30 comp rx=0 tx=0).stop 2023-12-05T09:53:40.413 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:40.415+0000 7f1143959700 1 -- 172.21.15.100:0/990976775 shutdown_connections 2023-12-05T09:53:40.413 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:40.415+0000 7f1143959700 1 --2- 172.21.15.100:0/990976775 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f113c1035a0 0x7f113c0fcc10 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:40.413 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:40.415+0000 7f1143959700 1 --2- 172.21.15.100:0/990976775 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f113c102c00 0x7f113c102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:40.413 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:40.415+0000 7f1143959700 1 -- 172.21.15.100:0/990976775 >> 172.21.15.100:0/990976775 conn(0x7f113c0f8790 msgr2=0x7f113c0faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:53:40.413 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:40.415+0000 7f1143959700 1 -- 172.21.15.100:0/990976775 shutdown_connections 2023-12-05T09:53:40.413 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:40.415+0000 7f1143959700 1 -- 172.21.15.100:0/990976775 wait complete. 2023-12-05T09:53:40.417 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:40.416+0000 7f1143959700 1 Processor -- start 2023-12-05T09:53:40.417 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:40.416+0000 7f1143959700 1 -- start start 2023-12-05T09:53:40.417 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:40.416+0000 7f1143959700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f113c102c00 0x7f113c10a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:53:40.418 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:40.416+0000 7f1143959700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f113c1035a0 0x7f113c10a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:53:40.418 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:40.416+0000 7f1143959700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f113c10aeb0 con 0x7f113c1035a0 2023-12-05T09:53:40.418 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:40.416+0000 7f1143959700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f113c10aff0 con 0x7f113c102c00 2023-12-05T09:53:40.418 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:40.416+0000 7f1140ef4700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f113c1035a0 0x7f113c10a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:53:40.418 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:40.416+0000 7f1140ef4700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f113c1035a0 0x7f113c10a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55956/0 (socket says 172.21.15.100:55956) 2023-12-05T09:53:40.419 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:40.416+0000 7f1140ef4700 1 -- 172.21.15.100:0/1157065828 learned_addr learned my addr 172.21.15.100:0/1157065828 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:53:40.419 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:40.416+0000 7f11416f5700 1 --2- 172.21.15.100:0/1157065828 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f113c102c00 0x7f113c10a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:53:40.419 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:40.417+0000 7f1140ef4700 1 -- 172.21.15.100:0/1157065828 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f113c102c00 msgr2=0x7f113c10a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:53:40.419 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:40.417+0000 7f1140ef4700 1 --2- 172.21.15.100:0/1157065828 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f113c102c00 0x7f113c10a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:40.419 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:40.417+0000 7f1140ef4700 1 -- 172.21.15.100:0/1157065828 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f112c005040 con 0x7f113c1035a0 2023-12-05T09:53:40.419 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:40.417+0000 7f1140ef4700 1 --2- 172.21.15.100:0/1157065828 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f113c1035a0 0x7f113c10a970 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f112c009360 tx=0x7f112c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:53:40.420 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:40.417+0000 7f1131ffb700 1 -- 172.21.15.100:0/1157065828 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f112c00e040 con 0x7f113c1035a0 2023-12-05T09:53:40.420 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:40.417+0000 7f1131ffb700 1 -- 172.21.15.100:0/1157065828 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f112c013420 con 0x7f113c1035a0 2023-12-05T09:53:40.420 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:40.417+0000 7f1143959700 1 -- 172.21.15.100:0/1157065828 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f113c10b270 con 0x7f113c1035a0 2023-12-05T09:53:40.420 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:40.417+0000 7f1131ffb700 1 -- 172.21.15.100:0/1157065828 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f112c01c610 con 0x7f113c1035a0 2023-12-05T09:53:40.420 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:40.417+0000 7f1143959700 1 -- 172.21.15.100:0/1157065828 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f113c11e180 con 0x7f113c1035a0 2023-12-05T09:53:40.420 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:40.418+0000 7f1143959700 1 -- 172.21.15.100:0/1157065828 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f113c0fc390 con 0x7f113c1035a0 2023-12-05T09:53:40.421 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:40.419+0000 7f1131ffb700 1 -- 172.21.15.100:0/1157065828 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f112c013590 con 0x7f113c1035a0 2023-12-05T09:53:40.422 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:40.420+0000 7f1131ffb700 1 --2- 172.21.15.100:0/1157065828 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f1128068f70 0x7f112806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:53:40.422 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:40.420+0000 7f1131ffb700 1 -- 172.21.15.100:0/1157065828 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f112c087c90 con 0x7f113c1035a0 2023-12-05T09:53:40.423 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:40.420+0000 7f11416f5700 1 --2- 172.21.15.100:0/1157065828 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f1128068f70 0x7f112806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:53:40.423 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:40.421+0000 7f11416f5700 1 --2- 172.21.15.100:0/1157065828 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f1128068f70 0x7f112806b420 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1138004f40 tx=0x7f113800b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:53:40.423 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:40.425+0000 7f1131ffb700 1 -- 172.21.15.100:0/1157065828 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f112c054400 con 0x7f113c1035a0 2023-12-05T09:53:40.611 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:40.613+0000 7f1143959700 1 -- 172.21.15.100:0/1157065828 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f113c10bc10 con 0x7f113c1035a0 2023-12-05T09:53:40.611 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:40.613+0000 7f1131ffb700 1 -- 172.21.15.100:0/1157065828 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7f112c057a20 con 0x7f113c1035a0 2023-12-05T09:53:40.611 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2023-12-05T09:53:40.613 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:40.615+0000 7f1143959700 1 -- 172.21.15.100:0/1157065828 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f1128068f70 msgr2=0x7f112806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:53:40.613 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:40.615+0000 7f1143959700 1 --2- 172.21.15.100:0/1157065828 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f1128068f70 0x7f112806b420 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1138004f40 tx=0x7f113800b040 comp rx=0 tx=0).stop 2023-12-05T09:53:40.613 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:40.615+0000 7f1143959700 1 -- 172.21.15.100:0/1157065828 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f113c1035a0 msgr2=0x7f113c10a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:53:40.613 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:40.615+0000 7f1143959700 1 --2- 172.21.15.100:0/1157065828 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f113c1035a0 0x7f113c10a970 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f112c009360 tx=0x7f112c009e30 comp rx=0 tx=0).stop 2023-12-05T09:53:40.613 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:40.615+0000 7f1143959700 1 -- 172.21.15.100:0/1157065828 shutdown_connections 2023-12-05T09:53:40.613 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:40.616+0000 7f1143959700 1 --2- 172.21.15.100:0/1157065828 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f1128068f70 0x7f112806b420 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:40.613 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:40.616+0000 7f1143959700 1 --2- 172.21.15.100:0/1157065828 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f113c102c00 0x7f113c10a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:40.614 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:40.616+0000 7f1143959700 1 --2- 172.21.15.100:0/1157065828 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f113c1035a0 0x7f113c10a970 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:40.614 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:40.616+0000 7f1143959700 1 -- 172.21.15.100:0/1157065828 >> 172.21.15.100:0/1157065828 conn(0x7f113c0f8790 msgr2=0x7f113c0fa150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:53:40.614 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:40.616+0000 7f1143959700 1 -- 172.21.15.100:0/1157065828 shutdown_connections 2023-12-05T09:53:40.614 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:40.616+0000 7f1143959700 1 -- 172.21.15.100:0/1157065828 wait complete. 2023-12-05T09:53:41.046 INFO:tasks.cephadm:Setting up client nodes... 2023-12-05T09:53:41.046 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2023-12-05T09:53:41.469 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi100/config 2023-12-05T09:53:41.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:41 smithi100 ceph-mon[107145]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:53:41.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:41 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/1157065828' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-05T09:53:41.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:41 smithi150 ceph-mon[116142]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:53:41.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:41 smithi150 ceph-mon[116142]: from='client.? 172.21.15.100:0/1157065828' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-05T09:53:42.611 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:42.612+0000 7fed0116d700 1 -- 172.21.15.100:0/579293400 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecfc0fde00 msgr2=0x7fecfc0fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:53:42.611 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:42.612+0000 7fed0116d700 1 --2- 172.21.15.100:0/579293400 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecfc0fde00 0x7fecfc0fe250 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fecf0004940 tx=0x7fecf0009e30 comp rx=0 tx=0).stop 2023-12-05T09:53:42.612 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:42.612+0000 7fed0116d700 1 -- 172.21.15.100:0/579293400 shutdown_connections 2023-12-05T09:53:42.612 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:42.612+0000 7fed0116d700 1 --2- 172.21.15.100:0/579293400 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecfc0fde00 0x7fecfc0fe250 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:42.612 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:42.612+0000 7fed0116d700 1 --2- 172.21.15.100:0/579293400 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fecfc0fcbf0 0x7fecfc0fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:42.612 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:42.612+0000 7fed0116d700 1 -- 172.21.15.100:0/579293400 >> 172.21.15.100:0/579293400 conn(0x7fecfc0f82d0 msgr2=0x7fecfc0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:53:42.612 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:42.612+0000 7fed0116d700 1 -- 172.21.15.100:0/579293400 shutdown_connections 2023-12-05T09:53:42.612 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:42.612+0000 7fed0116d700 1 -- 172.21.15.100:0/579293400 wait complete. 2023-12-05T09:53:42.612 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:42.613+0000 7fed0116d700 1 Processor -- start 2023-12-05T09:53:42.612 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:42.613+0000 7fed0116d700 1 -- start start 2023-12-05T09:53:42.612 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:42.614+0000 7fed0116d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fecfc0fcbf0 0x7fecfc10d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:53:42.612 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:42.614+0000 7fed0116d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecfc0fde00 0x7fecfc10da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:53:42.613 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:42.614+0000 7fed0116d700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecfc10e030 con 0x7fecfc0fde00 2023-12-05T09:53:42.613 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:42.614+0000 7fed0116d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecfc10e8d0 con 0x7fecfc0fcbf0 2023-12-05T09:53:42.613 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:42.614+0000 7fecfa59c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecfc0fde00 0x7fecfc10da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:53:42.613 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:42.614+0000 7fecfa59c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecfc0fde00 0x7fecfc10da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55972/0 (socket says 172.21.15.100:55972) 2023-12-05T09:53:42.613 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:42.614+0000 7fecfa59c700 1 -- 172.21.15.100:0/3428249431 learned_addr learned my addr 172.21.15.100:0/3428249431 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:53:42.613 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:42.614+0000 7fecfad9d700 1 --2- 172.21.15.100:0/3428249431 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fecfc0fcbf0 0x7fecfc10d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:53:42.613 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:42.614+0000 7fecfa59c700 1 -- 172.21.15.100:0/3428249431 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fecfc0fcbf0 msgr2=0x7fecfc10d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:53:42.613 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:42.614+0000 7fecfa59c700 1 --2- 172.21.15.100:0/3428249431 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fecfc0fcbf0 0x7fecfc10d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:42.613 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:42.614+0000 7fecfa59c700 1 -- 172.21.15.100:0/3428249431 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf0005040 con 0x7fecfc0fde00 2023-12-05T09:53:42.614 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:42.614+0000 7fecfa59c700 1 --2- 172.21.15.100:0/3428249431 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecfc0fde00 0x7fecfc10da30 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fecf0008f90 tx=0x7fecf0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:53:42.614 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:42.615+0000 7fece37fe700 1 -- 172.21.15.100:0/3428249431 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fecf0021070 con 0x7fecfc0fde00 2023-12-05T09:53:42.614 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:42.615+0000 7fece37fe700 1 -- 172.21.15.100:0/3428249431 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fecf001c400 con 0x7fecfc0fde00 2023-12-05T09:53:42.614 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:42.615+0000 7fed0116d700 1 -- 172.21.15.100:0/3428249431 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecfc10eb50 con 0x7fecfc0fde00 2023-12-05T09:53:42.614 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:42.615+0000 7fece37fe700 1 -- 172.21.15.100:0/3428249431 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fecf000e030 con 0x7fecfc0fde00 2023-12-05T09:53:42.614 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:42.615+0000 7fed0116d700 1 -- 172.21.15.100:0/3428249431 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecfc10f090 con 0x7fecfc0fde00 2023-12-05T09:53:42.614 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:42.616+0000 7fed0116d700 1 -- 172.21.15.100:0/3428249431 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecfc04bb80 con 0x7fecfc0fde00 2023-12-05T09:53:42.615 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:42.617+0000 7fece37fe700 1 -- 172.21.15.100:0/3428249431 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7fecf001ca00 con 0x7fecfc0fde00 2023-12-05T09:53:42.615 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:42.618+0000 7fece37fe700 1 --2- 172.21.15.100:0/3428249431 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fece4068f70 0x7fece406b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:53:42.615 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:42.618+0000 7fece37fe700 1 -- 172.21.15.100:0/3428249431 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fecf0087f00 con 0x7fecfc0fde00 2023-12-05T09:53:42.615 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:42.618+0000 7fecfad9d700 1 --2- 172.21.15.100:0/3428249431 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fece4068f70 0x7fece406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:53:42.616 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:42.618+0000 7fecfad9d700 1 --2- 172.21.15.100:0/3428249431 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fece4068f70 0x7fece406b420 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fecec004600 tx=0x7fecec00b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:53:42.619 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:42.622+0000 7fece37fe700 1 -- 172.21.15.100:0/3428249431 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fecf0058100 con 0x7fecfc0fde00 2023-12-05T09:53:42.885 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:42.887+0000 7fed0116d700 1 -- 172.21.15.100:0/3428249431 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fecfc105590 con 0x7fecfc0fde00 2023-12-05T09:53:42.889 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:42.891+0000 7fece37fe700 1 -- 172.21.15.100:0/3428249431 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v14) v1 ==== 170+0+59 (secure 0 0 0) 0x7fecf0057c90 con 0x7fecfc0fde00 2023-12-05T09:53:42.889 INFO:teuthology.orchestra.run.smithi100.stdout:[client.0] 2023-12-05T09:53:42.890 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQAm825lJ5j+NBAArR0MmF8hWp56p0/oRS2oMg== 2023-12-05T09:53:42.892 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:42.894+0000 7fed0116d700 1 -- 172.21.15.100:0/3428249431 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fece4068f70 msgr2=0x7fece406b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:53:42.892 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:42.894+0000 7fed0116d700 1 --2- 172.21.15.100:0/3428249431 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fece4068f70 0x7fece406b420 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fecec004600 tx=0x7fecec00b040 comp rx=0 tx=0).stop 2023-12-05T09:53:42.892 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:42.894+0000 7fed0116d700 1 -- 172.21.15.100:0/3428249431 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecfc0fde00 msgr2=0x7fecfc10da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:53:42.892 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:42.894+0000 7fed0116d700 1 --2- 172.21.15.100:0/3428249431 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecfc0fde00 0x7fecfc10da30 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fecf0008f90 tx=0x7fecf0009e30 comp rx=0 tx=0).stop 2023-12-05T09:53:42.892 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:42.894+0000 7fed0116d700 1 -- 172.21.15.100:0/3428249431 shutdown_connections 2023-12-05T09:53:42.892 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:42.894+0000 7fed0116d700 1 --2- 172.21.15.100:0/3428249431 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fece4068f70 0x7fece406b420 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:42.892 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:42.894+0000 7fed0116d700 1 --2- 172.21.15.100:0/3428249431 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fecfc0fcbf0 0x7fecfc10d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:42.892 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:42.894+0000 7fed0116d700 1 --2- 172.21.15.100:0/3428249431 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecfc0fde00 0x7fecfc10da30 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:42.892 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:42.894+0000 7fed0116d700 1 -- 172.21.15.100:0/3428249431 >> 172.21.15.100:0/3428249431 conn(0x7fecfc0f82d0 msgr2=0x7fecfc101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:53:42.892 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:42.894+0000 7fed0116d700 1 -- 172.21.15.100:0/3428249431 shutdown_connections 2023-12-05T09:53:42.892 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:42.894+0000 7fed0116d700 1 -- 172.21.15.100:0/3428249431 wait complete. 2023-12-05T09:53:43.251 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-12-05T09:53:43.251 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2023-12-05T09:53:43.251 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-12-05T09:53:43.351 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2023-12-05T09:53:43.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:43 smithi100 ceph-mon[107145]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:53:43.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:43 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/3428249431' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-05T09:53:43.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:43 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/3428249431' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-12-05T09:53:43.784 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi150/config 2023-12-05T09:53:43.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:43 smithi150 ceph-mon[116142]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:53:43.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:43 smithi150 ceph-mon[116142]: from='client.? 172.21.15.100:0/3428249431' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-05T09:53:43.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:43 smithi150 ceph-mon[116142]: from='client.? 172.21.15.100:0/3428249431' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-12-05T09:53:44.960 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:44.962+0000 7f9d0b3a1700 1 -- 172.21.15.150:0/2953087711 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d040fde00 msgr2=0x7f9d040fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:53:44.960 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:44.962+0000 7f9d0b3a1700 1 --2- 172.21.15.150:0/2953087711 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d040fde00 0x7f9d040fe250 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9cf4004940 tx=0x7f9cf4009e30 comp rx=0 tx=0).stop 2023-12-05T09:53:44.960 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:44.962+0000 7f9d0b3a1700 1 -- 172.21.15.150:0/2953087711 shutdown_connections 2023-12-05T09:53:44.960 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:44.962+0000 7f9d0b3a1700 1 --2- 172.21.15.150:0/2953087711 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d040fde00 0x7f9d040fe250 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:44.960 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:44.962+0000 7f9d0b3a1700 1 --2- 172.21.15.150:0/2953087711 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d040fcbf0 0x7f9d040fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:44.960 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:44.962+0000 7f9d0b3a1700 1 -- 172.21.15.150:0/2953087711 >> 172.21.15.150:0/2953087711 conn(0x7f9d040f82d0 msgr2=0x7f9d040fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:53:44.960 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:44.962+0000 7f9d0b3a1700 1 -- 172.21.15.150:0/2953087711 shutdown_connections 2023-12-05T09:53:44.960 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:44.962+0000 7f9d0b3a1700 1 -- 172.21.15.150:0/2953087711 wait complete. 2023-12-05T09:53:44.961 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:44.963+0000 7f9d0b3a1700 1 Processor -- start 2023-12-05T09:53:44.961 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:44.963+0000 7f9d0b3a1700 1 -- start start 2023-12-05T09:53:44.961 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:44.964+0000 7f9d0b3a1700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d040fcbf0 0x7f9d04071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:53:44.961 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:44.964+0000 7f9d0b3a1700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d040fde00 0x7f9d0406ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:53:44.961 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:44.964+0000 7f9d0b3a1700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d04070590 con 0x7f9d040fcbf0 2023-12-05T09:53:44.962 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:44.964+0000 7f9d0b3a1700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d04070700 con 0x7f9d040fde00 2023-12-05T09:53:44.962 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:44.964+0000 7f9d0893c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d040fde00 0x7f9d0406ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:53:44.962 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:44.964+0000 7f9d0913d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d040fcbf0 0x7f9d04071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:53:44.962 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:44.964+0000 7f9d0913d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d040fcbf0 0x7f9d04071b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.150:33020/0 (socket says 172.21.15.150:33020) 2023-12-05T09:53:44.962 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:44.964+0000 7f9d0893c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d040fde00 0x7f9d0406ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:54450/0 (socket says 172.21.15.150:54450) 2023-12-05T09:53:44.962 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:44.964+0000 7f9d0913d700 1 -- 172.21.15.150:0/682742784 learned_addr learned my addr 172.21.15.150:0/682742784 (peer_addr_for_me v2:172.21.15.150:0/0) 2023-12-05T09:53:44.963 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:44.965+0000 7f9d0893c700 1 -- 172.21.15.150:0/682742784 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d040fcbf0 msgr2=0x7f9d04071b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:53:44.963 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:44.965+0000 7f9d0893c700 1 --2- 172.21.15.150:0/682742784 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d040fcbf0 0x7f9d04071b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:44.963 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:44.965+0000 7f9d0893c700 1 -- 172.21.15.150:0/682742784 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf4005040 con 0x7f9d040fde00 2023-12-05T09:53:44.964 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:44.965+0000 7f9d0913d700 1 --2- 172.21.15.150:0/682742784 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d040fcbf0 0x7f9d04071b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-05T09:53:44.964 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:44.965+0000 7f9d0893c700 1 --2- 172.21.15.150:0/682742784 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d040fde00 0x7f9d0406ff90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9cf4009fd0 tx=0x7f9cf4009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:53:44.964 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:44.965+0000 7f9cf9ffb700 1 -- 172.21.15.150:0/682742784 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9cf400e040 con 0x7f9d040fde00 2023-12-05T09:53:44.964 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:44.965+0000 7f9cf9ffb700 1 -- 172.21.15.150:0/682742784 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9cf4004290 con 0x7f9d040fde00 2023-12-05T09:53:44.964 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:44.965+0000 7f9d0b3a1700 1 -- 172.21.15.150:0/682742784 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d04070980 con 0x7f9d040fde00 2023-12-05T09:53:44.964 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:44.965+0000 7f9cf9ffb700 1 -- 172.21.15.150:0/682742784 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9cf401c3f0 con 0x7f9d040fde00 2023-12-05T09:53:44.964 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:44.965+0000 7f9d0b3a1700 1 -- 172.21.15.150:0/682742784 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d041155a0 con 0x7f9d040fde00 2023-12-05T09:53:44.966 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:44.967+0000 7f9d0b3a1700 1 -- 172.21.15.150:0/682742784 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d0404bb80 con 0x7f9d040fde00 2023-12-05T09:53:44.966 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:44.967+0000 7f9cf9ffb700 1 -- 172.21.15.150:0/682742784 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f9cf4013420 con 0x7f9d040fde00 2023-12-05T09:53:44.966 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:44.968+0000 7f9cf9ffb700 1 --2- 172.21.15.150:0/682742784 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f9cf0068f70 0x7f9cf006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:53:44.966 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:44.968+0000 7f9cf9ffb700 1 -- 172.21.15.150:0/682742784 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f9cf4087d00 con 0x7f9d040fde00 2023-12-05T09:53:44.967 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:44.969+0000 7f9d0913d700 1 --2- 172.21.15.150:0/682742784 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f9cf0068f70 0x7f9cf006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:53:44.967 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:44.969+0000 7f9d0913d700 1 --2- 172.21.15.150:0/682742784 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f9cf0068f70 0x7f9cf006b420 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9d040718a0 tx=0x7f9d0000b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:53:44.970 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:44.973+0000 7f9cf9ffb700 1 -- 172.21.15.150:0/682742784 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f9cf408b030 con 0x7f9d040fde00 2023-12-05T09:53:45.233 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:45.236+0000 7f9d0b3a1700 1 -- 172.21.15.150:0/682742784 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f9d04105590 con 0x7f9d040fde00 2023-12-05T09:53:45.239 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:45.242+0000 7f9cf9ffb700 1 -- 172.21.15.150:0/682742784 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v15) v1 ==== 170+0+59 (secure 0 0 0) 0x7f9cf4057db0 con 0x7f9d040fde00 2023-12-05T09:53:45.239 INFO:teuthology.orchestra.run.smithi150.stdout:[client.1] 2023-12-05T09:53:45.239 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAp825loFcvDhAAF7N1hmNQbCtv4itG5II/SQ== 2023-12-05T09:53:45.242 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:45.244+0000 7f9d0b3a1700 1 -- 172.21.15.150:0/682742784 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f9cf0068f70 msgr2=0x7f9cf006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:53:45.242 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:45.244+0000 7f9d0b3a1700 1 --2- 172.21.15.150:0/682742784 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f9cf0068f70 0x7f9cf006b420 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9d040718a0 tx=0x7f9d0000b040 comp rx=0 tx=0).stop 2023-12-05T09:53:45.242 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:45.244+0000 7f9d0b3a1700 1 -- 172.21.15.150:0/682742784 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d040fde00 msgr2=0x7f9d0406ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:53:45.242 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:45.244+0000 7f9d0b3a1700 1 --2- 172.21.15.150:0/682742784 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d040fde00 0x7f9d0406ff90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9cf4009fd0 tx=0x7f9cf4009e30 comp rx=0 tx=0).stop 2023-12-05T09:53:45.242 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:45.244+0000 7f9d0b3a1700 1 -- 172.21.15.150:0/682742784 shutdown_connections 2023-12-05T09:53:45.242 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:45.244+0000 7f9d0b3a1700 1 --2- 172.21.15.150:0/682742784 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f9cf0068f70 0x7f9cf006b420 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:45.243 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:45.244+0000 7f9d0b3a1700 1 --2- 172.21.15.150:0/682742784 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d040fcbf0 0x7f9d04071b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:45.243 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:45.244+0000 7f9d0b3a1700 1 --2- 172.21.15.150:0/682742784 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d040fde00 0x7f9d0406ff90 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:45.243 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:45.244+0000 7f9d0b3a1700 1 -- 172.21.15.150:0/682742784 >> 172.21.15.150:0/682742784 conn(0x7f9d040f82d0 msgr2=0x7f9d04101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:53:45.243 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:45.244+0000 7f9d0b3a1700 1 -- 172.21.15.150:0/682742784 shutdown_connections 2023-12-05T09:53:45.243 INFO:teuthology.orchestra.run.smithi150.stderr:2023-12-05T09:53:45.244+0000 7f9d0b3a1700 1 -- 172.21.15.150:0/682742784 wait complete. 2023-12-05T09:53:45.574 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:45 smithi150 ceph-mon[116142]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:53:45.574 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:45 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:53:45.574 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:45 smithi150 ceph-mon[116142]: from='client.? 172.21.15.150:0/682742784' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-05T09:53:45.574 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:45 smithi150 ceph-mon[116142]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-05T09:53:45.574 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:45 smithi150 ceph-mon[116142]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-12-05T09:53:45.601 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-12-05T09:53:45.602 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2023-12-05T09:53:45.602 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-12-05T09:53:45.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:45 smithi100 ceph-mon[107145]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:53:45.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:45 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:53:45.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:45 smithi100 ceph-mon[107145]: from='client.? 172.21.15.150:0/682742784' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-05T09:53:45.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:45 smithi100 ceph-mon[107145]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-05T09:53:45.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:45 smithi100 ceph-mon[107145]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-12-05T09:53:45.700 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-12-05T09:53:45.701 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2023-12-05T09:53:45.701 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- ceph mgr dump --format=json 2023-12-05T09:53:46.133 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi100/config 2023-12-05T09:53:47.351 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:47.352+0000 7f820f4de700 1 -- 172.21.15.100:0/317830247 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8208102c00 msgr2=0x7f8208102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:53:47.351 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:47.352+0000 7f820f4de700 1 --2- 172.21.15.100:0/317830247 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8208102c00 0x7f8208102fd0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8204004940 tx=0x7f8204009e30 comp rx=0 tx=0).stop 2023-12-05T09:53:47.351 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:47.352+0000 7f820f4de700 1 -- 172.21.15.100:0/317830247 shutdown_connections 2023-12-05T09:53:47.351 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:47.352+0000 7f820f4de700 1 --2- 172.21.15.100:0/317830247 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82081035a0 0x7f82080fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:47.351 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:47.352+0000 7f820f4de700 1 --2- 172.21.15.100:0/317830247 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8208102c00 0x7f8208102fd0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:47.351 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:47.352+0000 7f820f4de700 1 -- 172.21.15.100:0/317830247 >> 172.21.15.100:0/317830247 conn(0x7f82080f8790 msgr2=0x7f82080faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:53:47.351 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:47.352+0000 7f820f4de700 1 -- 172.21.15.100:0/317830247 shutdown_connections 2023-12-05T09:53:47.351 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:47.352+0000 7f820f4de700 1 -- 172.21.15.100:0/317830247 wait complete. 2023-12-05T09:53:47.351 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:47.353+0000 7f820f4de700 1 Processor -- start 2023-12-05T09:53:47.352 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:47.353+0000 7f820f4de700 1 -- start start 2023-12-05T09:53:47.353 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:47.354+0000 7f820f4de700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8208102c00 0x7f8208115820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:53:47.353 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:47.354+0000 7f820f4de700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82081035a0 0x7f8208115d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:53:47.353 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:47.354+0000 7f820f4de700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82081163b0 con 0x7f82081035a0 2023-12-05T09:53:47.353 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:47.354+0000 7f820f4de700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f820810f6e0 con 0x7f8208102c00 2023-12-05T09:53:47.353 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:47.354+0000 7f820ca79700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82081035a0 0x7f8208115d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:53:47.353 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:47.354+0000 7f820ca79700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82081035a0 0x7f8208115d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55986/0 (socket says 172.21.15.100:55986) 2023-12-05T09:53:47.353 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:47.354+0000 7f820ca79700 1 -- 172.21.15.100:0/1356584265 learned_addr learned my addr 172.21.15.100:0/1356584265 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:53:47.353 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:47.354+0000 7f820ca79700 1 -- 172.21.15.100:0/1356584265 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8208102c00 msgr2=0x7f8208115820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:53:47.353 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:47.354+0000 7f820d27a700 1 --2- 172.21.15.100:0/1356584265 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8208102c00 0x7f8208115820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:53:47.353 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:47.354+0000 7f820ca79700 1 --2- 172.21.15.100:0/1356584265 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8208102c00 0x7f8208115820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:47.354 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:47.354+0000 7f820ca79700 1 -- 172.21.15.100:0/1356584265 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8204005040 con 0x7f82081035a0 2023-12-05T09:53:47.354 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:47.354+0000 7f820d27a700 1 --2- 172.21.15.100:0/1356584265 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8208102c00 0x7f8208115820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-05T09:53:47.354 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:47.355+0000 7f820ca79700 1 --2- 172.21.15.100:0/1356584265 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82081035a0 0x7f8208115d60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f81f8002a50 tx=0x7f81f8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:53:47.354 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:47.355+0000 7f81fdffb700 1 -- 172.21.15.100:0/1356584265 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81f8007cc0 con 0x7f82081035a0 2023-12-05T09:53:47.354 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:47.355+0000 7f81fdffb700 1 -- 172.21.15.100:0/1356584265 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f81f800f040 con 0x7f82081035a0 2023-12-05T09:53:47.354 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:47.355+0000 7f81fdffb700 1 -- 172.21.15.100:0/1356584265 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81f800d9a0 con 0x7f82081035a0 2023-12-05T09:53:47.354 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:47.355+0000 7f820f4de700 1 -- 172.21.15.100:0/1356584265 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f820810f9c0 con 0x7f82081035a0 2023-12-05T09:53:47.354 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:47.355+0000 7f820f4de700 1 -- 172.21.15.100:0/1356584265 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f820810ff00 con 0x7f82081035a0 2023-12-05T09:53:47.354 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:47.356+0000 7f820f4de700 1 -- 172.21.15.100:0/1356584265 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82080fc390 con 0x7f82081035a0 2023-12-05T09:53:47.355 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:47.357+0000 7f81fdffb700 1 -- 172.21.15.100:0/1356584265 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f81f800dc10 con 0x7f82081035a0 2023-12-05T09:53:47.355 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:47.358+0000 7f81fdffb700 1 --2- 172.21.15.100:0/1356584265 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f81f4068f70 0x7f81f406b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:53:47.355 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:47.358+0000 7f81fdffb700 1 -- 172.21.15.100:0/1356584265 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f81f8086880 con 0x7f82081035a0 2023-12-05T09:53:47.355 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:47.358+0000 7f820d27a700 1 --2- 172.21.15.100:0/1356584265 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f81f4068f70 0x7f81f406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:53:47.356 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:47.359+0000 7f820d27a700 1 --2- 172.21.15.100:0/1356584265 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f81f4068f70 0x7f81f406b420 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f820400b840 tx=0x7f8204009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:53:47.359 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:47.362+0000 7f81fdffb700 1 -- 172.21.15.100:0/1356584265 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f81f8056a80 con 0x7f82081035a0 2023-12-05T09:53:47.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:47 smithi100 ceph-mon[107145]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:53:47.604 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:47.607+0000 7f820f4de700 1 -- 172.21.15.100:0/1356584265 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f820804bb80 con 0x7f82081035a0 2023-12-05T09:53:47.607 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:47.610+0000 7f81fdffb700 1 -- 172.21.15.100:0/1356584265 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+166785 (secure 0 0 0) 0x7f81f8056610 con 0x7f82081035a0 2023-12-05T09:53:47.610 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:53:47.611 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:47.613+0000 7f820f4de700 1 -- 172.21.15.100:0/1356584265 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f81f4068f70 msgr2=0x7f81f406b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:53:47.611 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:47.613+0000 7f820f4de700 1 --2- 172.21.15.100:0/1356584265 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f81f4068f70 0x7f81f406b420 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f820400b840 tx=0x7f8204009e30 comp rx=0 tx=0).stop 2023-12-05T09:53:47.611 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:47.613+0000 7f820f4de700 1 -- 172.21.15.100:0/1356584265 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82081035a0 msgr2=0x7f8208115d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:53:47.611 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:47.613+0000 7f820f4de700 1 --2- 172.21.15.100:0/1356584265 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82081035a0 0x7f8208115d60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f81f8002a50 tx=0x7f81f8004600 comp rx=0 tx=0).stop 2023-12-05T09:53:47.612 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:47.613+0000 7f820f4de700 1 -- 172.21.15.100:0/1356584265 shutdown_connections 2023-12-05T09:53:47.612 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:47.613+0000 7f820f4de700 1 --2- 172.21.15.100:0/1356584265 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f81f4068f70 0x7f81f406b420 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:47.612 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:47.613+0000 7f820f4de700 1 --2- 172.21.15.100:0/1356584265 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8208102c00 0x7f8208115820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:47.612 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:47.613+0000 7f820f4de700 1 --2- 172.21.15.100:0/1356584265 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82081035a0 0x7f8208115d60 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:47.612 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:47.613+0000 7f820f4de700 1 -- 172.21.15.100:0/1356584265 >> 172.21.15.100:0/1356584265 conn(0x7f82080f8790 msgr2=0x7f82080fa0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:53:47.612 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:47.613+0000 7f820f4de700 1 -- 172.21.15.100:0/1356584265 shutdown_connections 2023-12-05T09:53:47.612 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:47.613+0000 7f820f4de700 1 -- 172.21.15.100:0/1356584265 wait complete. 2023-12-05T09:53:47.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:47 smithi150 ceph-mon[116142]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:53:48.026 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":19,"active_gid":14210,"active_name":"smithi100.ehmuhg","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1237547575},{"type":"v1","addr":"172.21.15.100:6801","nonce":1237547575}]},"active_addr":"172.21.15.100:6801/1237547575","active_change":"2023-12-05T09:50:30.059830+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":14232,"name":"smithi150.zkskag","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.100:8443/","prometheus":"http://172.21.15.100:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.100:0","nonce":485886590}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.100:0","nonce":3456039235}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.100:0","nonce":2280374959}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.100:0","nonce":2175139133}]}]} 2023-12-05T09:53:48.030 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2023-12-05T09:53:48.030 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2023-12-05T09:53:48.030 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- ceph osd dump --format=json 2023-12-05T09:53:48.453 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi100/config 2023-12-05T09:53:48.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:48 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/1356584265' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-12-05T09:53:48.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:48 smithi150 ceph-mon[116142]: from='client.? 172.21.15.100:0/1356584265' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-12-05T09:53:49.575 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:49.578+0000 7f2288324700 1 -- 172.21.15.100:0/1858369638 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22801035a0 msgr2=0x7f22800fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:53:49.576 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:49.578+0000 7f2288324700 1 --2- 172.21.15.100:0/1858369638 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22801035a0 0x7f22800fcc10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2270004940 tx=0x7f2270009e30 comp rx=0 tx=0).stop 2023-12-05T09:53:49.576 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:49.578+0000 7f2288324700 1 -- 172.21.15.100:0/1858369638 shutdown_connections 2023-12-05T09:53:49.576 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:49.578+0000 7f2288324700 1 --2- 172.21.15.100:0/1858369638 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22801035a0 0x7f22800fcc10 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:49.576 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:49.578+0000 7f2288324700 1 --2- 172.21.15.100:0/1858369638 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2280102c00 0x7f2280102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:49.576 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:49.578+0000 7f2288324700 1 -- 172.21.15.100:0/1858369638 >> 172.21.15.100:0/1858369638 conn(0x7f22800f8790 msgr2=0x7f22800faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:53:49.576 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:49.578+0000 7f2288324700 1 -- 172.21.15.100:0/1858369638 shutdown_connections 2023-12-05T09:53:49.576 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:49.578+0000 7f2288324700 1 -- 172.21.15.100:0/1858369638 wait complete. 2023-12-05T09:53:49.577 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:49.579+0000 7f2288324700 1 Processor -- start 2023-12-05T09:53:49.577 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:49.579+0000 7f2288324700 1 -- start start 2023-12-05T09:53:49.577 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:49.579+0000 7f2288324700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2280102c00 0x7f22801135d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:53:49.577 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:49.579+0000 7f2288324700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22801035a0 0x7f2280113b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:53:49.578 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:49.579+0000 7f2288324700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2280114160 con 0x7f22801035a0 2023-12-05T09:53:49.578 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:49.579+0000 7f2288324700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f228010d490 con 0x7f2280102c00 2023-12-05T09:53:49.578 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:49.579+0000 7f22858bf700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22801035a0 0x7f2280113b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:53:49.578 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:49.580+0000 7f22858bf700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22801035a0 0x7f2280113b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56004/0 (socket says 172.21.15.100:56004) 2023-12-05T09:53:49.578 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:49.580+0000 7f22858bf700 1 -- 172.21.15.100:0/1218152842 learned_addr learned my addr 172.21.15.100:0/1218152842 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:53:49.578 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:49.580+0000 7f22860c0700 1 --2- 172.21.15.100:0/1218152842 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2280102c00 0x7f22801135d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:53:49.578 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:49.580+0000 7f22858bf700 1 -- 172.21.15.100:0/1218152842 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2280102c00 msgr2=0x7f22801135d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:53:49.578 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:49.580+0000 7f22858bf700 1 --2- 172.21.15.100:0/1218152842 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2280102c00 0x7f22801135d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:49.578 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:49.580+0000 7f22858bf700 1 -- 172.21.15.100:0/1218152842 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2270005040 con 0x7f22801035a0 2023-12-05T09:53:49.578 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:49.580+0000 7f22858bf700 1 --2- 172.21.15.100:0/1218152842 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22801035a0 0x7f2280113b10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2270009380 tx=0x7f2270009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:53:49.579 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:49.580+0000 7f2276ffd700 1 -- 172.21.15.100:0/1218152842 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f227000e040 con 0x7f22801035a0 2023-12-05T09:53:49.579 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:49.580+0000 7f2276ffd700 1 -- 172.21.15.100:0/1218152842 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f227000bc50 con 0x7f22801035a0 2023-12-05T09:53:49.579 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:49.580+0000 7f2288324700 1 -- 172.21.15.100:0/1218152842 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f228010d710 con 0x7f22801035a0 2023-12-05T09:53:49.579 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:49.580+0000 7f2276ffd700 1 -- 172.21.15.100:0/1218152842 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f227001c3f0 con 0x7f22801035a0 2023-12-05T09:53:49.579 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:49.580+0000 7f2288324700 1 -- 172.21.15.100:0/1218152842 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f228010dc50 con 0x7f22801035a0 2023-12-05T09:53:49.579 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:49.582+0000 7f2288324700 1 -- 172.21.15.100:0/1218152842 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22800fc390 con 0x7f22801035a0 2023-12-05T09:53:49.580 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:49.582+0000 7f2276ffd700 1 -- 172.21.15.100:0/1218152842 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f2270013420 con 0x7f22801035a0 2023-12-05T09:53:49.581 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:49.583+0000 7f2276ffd700 1 --2- 172.21.15.100:0/1218152842 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f226c068f60 0x7f226c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:53:49.581 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:49.583+0000 7f2276ffd700 1 -- 172.21.15.100:0/1218152842 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f2270087e70 con 0x7f22801035a0 2023-12-05T09:53:49.581 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:49.583+0000 7f22860c0700 1 --2- 172.21.15.100:0/1218152842 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f226c068f60 0x7f226c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:53:49.581 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:49.584+0000 7f22860c0700 1 --2- 172.21.15.100:0/1218152842 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f226c068f60 0x7f226c06b410 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f227c009fd0 tx=0x7f227c009f60 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:53:49.585 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:49.588+0000 7f2276ffd700 1 -- 172.21.15.100:0/1218152842 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f22700580f0 con 0x7f22801035a0 2023-12-05T09:53:49.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:49 smithi100 ceph-mon[107145]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:53:49.778 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:49.780+0000 7f2288324700 1 -- 172.21.15.100:0/1218152842 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f228010ebb0 con 0x7f22801035a0 2023-12-05T09:53:49.779 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:49.781+0000 7f2276ffd700 1 -- 172.21.15.100:0/1218152842 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11121 (secure 0 0 0) 0x7f2270057c80 con 0x7f22801035a0 2023-12-05T09:53:49.779 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:53:49.779 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":40,"fsid":"5b035ce6-9353-11ee-95a2-87774f69a715","created":"2023-12-05T09:48:33.718763+0000","modified":"2023-12-05T09:53:34.991888+0000","last_up_change":"2023-12-05T09:53:33.596224+0000","last_in_change":"2023-12-05T09:53:15.176570+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-05T09:52:26.650134+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"9f3faeed-8336-4509-9127-eafa0273ecea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2938979601},{"type":"v1","addr":"172.21.15.100:6803","nonce":2938979601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2938979601},{"type":"v1","addr":"172.21.15.100:6805","nonce":2938979601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":2938979601},{"type":"v1","addr":"172.21.15.100:6809","nonce":2938979601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2938979601},{"type":"v1","addr":"172.21.15.100:6807","nonce":2938979601}]},"public_addr":"172.21.15.100:6803/2938979601","cluster_addr":"172.21.15.100:6805/2938979601","heartbeat_back_addr":"172.21.15.100:6809/2938979601","heartbeat_front_addr":"172.21.15.100:6807/2938979601","state":["exists","up"]},{"osd":1,"uuid":"6ca8c1e2-e673-4dc4-b02d-c0805493bcf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":38684261},{"type":"v1","addr":"172.21.15.100:6811","nonce":38684261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":38684261},{"type":"v1","addr":"172.21.15.100:6813","nonce":38684261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":38684261},{"type":"v1","addr":"172.21.15.100:6817","nonce":38684261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":38684261},{"type":"v1","addr":"172.21.15.100:6815","nonce":38684261}]},"public_addr":"172.21.15.100:6811/38684261","cluster_addr":"172.21.15.100:6813/38684261","heartbeat_back_addr":"172.21.15.100:6817/38684261","heartbeat_front_addr":"172.21.15.100:6815/38684261","state":["exists","up"]},{"osd":2,"uuid":"59a55cb9-28ae-4485-8cbf-e5f6224bd377","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":2128721915},{"type":"v1","addr":"172.21.15.100:6819","nonce":2128721915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2128721915},{"type":"v1","addr":"172.21.15.100:6821","nonce":2128721915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":2128721915},{"type":"v1","addr":"172.21.15.100:6825","nonce":2128721915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":2128721915},{"type":"v1","addr":"172.21.15.100:6823","nonce":2128721915}]},"public_addr":"172.21.15.100:6819/2128721915","cluster_addr":"172.21.15.100:6821/2128721915","heartbeat_back_addr":"172.21.15.100:6825/2128721915","heartbeat_front_addr":"172.21.15.100:6823/2128721915","state":["exists","up"]},{"osd":3,"uuid":"e12b505f-7f0c-4d6f-b039-5aa793f79db0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":1626769878},{"type":"v1","addr":"172.21.15.150:6801","nonce":1626769878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":1626769878},{"type":"v1","addr":"172.21.15.150:6803","nonce":1626769878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":1626769878},{"type":"v1","addr":"172.21.15.150:6807","nonce":1626769878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":1626769878},{"type":"v1","addr":"172.21.15.150:6805","nonce":1626769878}]},"public_addr":"172.21.15.150:6801/1626769878","cluster_addr":"172.21.15.150:6803/1626769878","heartbeat_back_addr":"172.21.15.150:6807/1626769878","heartbeat_front_addr":"172.21.15.150:6805/1626769878","state":["exists","up"]},{"osd":4,"uuid":"33fbbf55-86ba-4e7f-a66b-e958dce72283","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":2589618062},{"type":"v1","addr":"172.21.15.150:6809","nonce":2589618062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":2589618062},{"type":"v1","addr":"172.21.15.150:6811","nonce":2589618062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":2589618062},{"type":"v1","addr":"172.21.15.150:6815","nonce":2589618062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":2589618062},{"type":"v1","addr":"172.21.15.150:6813","nonce":2589618062}]},"public_addr":"172.21.15.150:6809/2589618062","cluster_addr":"172.21.15.150:6811/2589618062","heartbeat_back_addr":"172.21.15.150:6815/2589618062","heartbeat_front_addr":"172.21.15.150:6813/2589618062","state":["exists","up"]},{"osd":5,"uuid":"93b2d10b-0410-4390-9283-b4129c0439d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":4116522433},{"type":"v1","addr":"172.21.15.150:6817","nonce":4116522433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":4116522433},{"type":"v1","addr":"172.21.15.150:6819","nonce":4116522433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":4116522433},{"type":"v1","addr":"172.21.15.150:6823","nonce":4116522433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":4116522433},{"type":"v1","addr":"172.21.15.150:6821","nonce":4116522433}]},"public_addr":"172.21.15.150:6817/4116522433","cluster_addr":"172.21.15.150:6819/4116522433","heartbeat_back_addr":"172.21.15.150:6823/4116522433","heartbeat_front_addr":"172.21.15.150:6821/4116522433","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T09:51:35.123538+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T09:51:59.961993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T09:52:23.976682+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T09:52:46.493238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T09:53:09.121783+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T09:53:32.450910+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:0/2826914555":"2023-12-06T09:50:30.059721+0000","172.21.15.100:6801/2397627746":"2023-12-06T09:50:30.059721+0000","172.21.15.100:0/737517101":"2023-12-06T09:50:30.059721+0000","172.21.15.100:0/1529397750":"2023-12-06T09:49:28.559106+0000","172.21.15.100:0/2992397636":"2023-12-06T09:49:01.007941+0000","172.21.15.100:6801/2647899624":"2023-12-06T09:49:28.559106+0000","172.21.15.100:6800/2647899624":"2023-12-06T09:49:28.559106+0000","172.21.15.100:0/556453695":"2023-12-06T09:49:28.559106+0000","172.21.15.100:0/567522562":"2023-12-06T09:49:01.007941+0000","172.21.15.100:6800/2397627746":"2023-12-06T09:50:30.059721+0000","172.21.15.100:0/4197065049":"2023-12-06T09:50:30.059721+0000","172.21.15.100:6800/3606837497":"2023-12-06T09:49:01.007941+0000","172.21.15.100:0/3942224339":"2023-12-06T09:49:28.559106+0000","172.21.15.100:0/2400356084":"2023-12-06T09:49:01.007941+0000","172.21.15.100:6801/3606837497":"2023-12-06T09:49:01.007941+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-05T09:53:49.781 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:49.783+0000 7f2288324700 1 -- 172.21.15.100:0/1218152842 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f226c068f60 msgr2=0x7f226c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:53:49.781 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:49.783+0000 7f2288324700 1 --2- 172.21.15.100:0/1218152842 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f226c068f60 0x7f226c06b410 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f227c009fd0 tx=0x7f227c009f60 comp rx=0 tx=0).stop 2023-12-05T09:53:49.781 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:49.783+0000 7f2288324700 1 -- 172.21.15.100:0/1218152842 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22801035a0 msgr2=0x7f2280113b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:53:49.781 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:49.783+0000 7f2288324700 1 --2- 172.21.15.100:0/1218152842 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22801035a0 0x7f2280113b10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2270009380 tx=0x7f2270009e30 comp rx=0 tx=0).stop 2023-12-05T09:53:49.781 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:49.783+0000 7f2288324700 1 -- 172.21.15.100:0/1218152842 shutdown_connections 2023-12-05T09:53:49.781 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:49.783+0000 7f2288324700 1 --2- 172.21.15.100:0/1218152842 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f226c068f60 0x7f226c06b410 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:49.782 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:49.783+0000 7f2288324700 1 --2- 172.21.15.100:0/1218152842 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2280102c00 0x7f22801135d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:49.782 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:49.783+0000 7f2288324700 1 --2- 172.21.15.100:0/1218152842 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22801035a0 0x7f2280113b10 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:49.782 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:49.783+0000 7f2288324700 1 -- 172.21.15.100:0/1218152842 >> 172.21.15.100:0/1218152842 conn(0x7f22800f8790 msgr2=0x7f22800fa240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:53:49.782 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:49.784+0000 7f2288324700 1 -- 172.21.15.100:0/1218152842 shutdown_connections 2023-12-05T09:53:49.782 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:49.784+0000 7f2288324700 1 -- 172.21.15.100:0/1218152842 wait complete. 2023-12-05T09:53:49.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:49 smithi150 ceph-mon[116142]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:53:50.261 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2023-12-05T09:53:50.261 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- ceph osd dump --format=json 2023-12-05T09:53:50.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:50 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/1218152842' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-05T09:53:50.683 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi100/config 2023-12-05T09:53:50.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:50 smithi150 ceph-mon[116142]: from='client.? 172.21.15.100:0/1218152842' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-05T09:53:51.612 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:51 smithi100 ceph-mon[107145]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:53:51.840 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:51.842+0000 7f8aa692d700 1 -- 172.21.15.100:0/3329019825 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8aa01035a0 msgr2=0x7f8aa00fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:53:51.840 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:51.842+0000 7f8aa692d700 1 --2- 172.21.15.100:0/3329019825 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8aa01035a0 0x7f8aa00fcc10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8a94004940 tx=0x7f8a94009e30 comp rx=0 tx=0).stop 2023-12-05T09:53:51.840 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:51.842+0000 7f8aa692d700 1 -- 172.21.15.100:0/3329019825 shutdown_connections 2023-12-05T09:53:51.840 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:51.842+0000 7f8aa692d700 1 --2- 172.21.15.100:0/3329019825 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8aa01035a0 0x7f8aa00fcc10 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:51.840 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:51.842+0000 7f8aa692d700 1 --2- 172.21.15.100:0/3329019825 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8aa0102c00 0x7f8aa0102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:51.840 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:51.842+0000 7f8aa692d700 1 -- 172.21.15.100:0/3329019825 >> 172.21.15.100:0/3329019825 conn(0x7f8aa00f8790 msgr2=0x7f8aa00faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:53:51.840 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:51.842+0000 7f8aa692d700 1 -- 172.21.15.100:0/3329019825 shutdown_connections 2023-12-05T09:53:51.840 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:51.842+0000 7f8aa692d700 1 -- 172.21.15.100:0/3329019825 wait complete. 2023-12-05T09:53:51.842 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:51.843+0000 7f8aa692d700 1 Processor -- start 2023-12-05T09:53:51.842 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:51.843+0000 7f8aa692d700 1 -- start start 2023-12-05T09:53:51.842 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:51.843+0000 7f8aa692d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8aa0102c00 0x7f8aa0115830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:53:51.842 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:51.843+0000 7f8aa692d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8aa01035a0 0x7f8aa0115d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:53:51.842 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:51.843+0000 7f8aa692d700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa01163c0 con 0x7f8aa0102c00 2023-12-05T09:53:51.842 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:51.843+0000 7f8aa692d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa010f6f0 con 0x7f8aa01035a0 2023-12-05T09:53:51.842 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:51.843+0000 7f8a9ffff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8aa0102c00 0x7f8aa0115830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:53:51.842 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:51.843+0000 7f8a9ffff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8aa0102c00 0x7f8aa0115830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52800/0 (socket says 172.21.15.100:52800) 2023-12-05T09:53:51.842 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:51.843+0000 7f8a9ffff700 1 -- 172.21.15.100:0/2043475621 learned_addr learned my addr 172.21.15.100:0/2043475621 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:53:51.842 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:51.844+0000 7f8a9f7fe700 1 --2- 172.21.15.100:0/2043475621 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8aa01035a0 0x7f8aa0115d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:53:51.843 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:51.844+0000 7f8a9ffff700 1 -- 172.21.15.100:0/2043475621 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8aa01035a0 msgr2=0x7f8aa0115d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:53:51.843 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:51.844+0000 7f8a9ffff700 1 --2- 172.21.15.100:0/2043475621 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8aa01035a0 0x7f8aa0115d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:51.843 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:51.844+0000 7f8a9ffff700 1 -- 172.21.15.100:0/2043475621 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a94005040 con 0x7f8aa0102c00 2023-12-05T09:53:51.843 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:51.844+0000 7f8a9ffff700 1 --2- 172.21.15.100:0/2043475621 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8aa0102c00 0x7f8aa0115830 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8a90002a50 tx=0x7f8a900046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:53:51.843 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:51.844+0000 7f8a9cff9700 1 -- 172.21.15.100:0/2043475621 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a90007cc0 con 0x7f8aa0102c00 2023-12-05T09:53:51.843 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:51.844+0000 7f8a9cff9700 1 -- 172.21.15.100:0/2043475621 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8a9000f040 con 0x7f8aa0102c00 2023-12-05T09:53:51.843 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:51.844+0000 7f8aa692d700 1 -- 172.21.15.100:0/2043475621 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8aa010f9d0 con 0x7f8aa0102c00 2023-12-05T09:53:51.843 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:51.844+0000 7f8a9cff9700 1 -- 172.21.15.100:0/2043475621 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a90009540 con 0x7f8aa0102c00 2023-12-05T09:53:51.843 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:51.844+0000 7f8aa692d700 1 -- 172.21.15.100:0/2043475621 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8aa010ff10 con 0x7f8aa0102c00 2023-12-05T09:53:51.844 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:51.845+0000 7f8aa692d700 1 -- 172.21.15.100:0/2043475621 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8aa00fc390 con 0x7f8aa0102c00 2023-12-05T09:53:51.844 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:51.846+0000 7f8a9cff9700 1 -- 172.21.15.100:0/2043475621 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f8a900096a0 con 0x7f8aa0102c00 2023-12-05T09:53:51.845 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:51.848+0000 7f8a9cff9700 1 --2- 172.21.15.100:0/2043475621 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f8a88068f70 0x7f8a8806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:53:51.845 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:51.848+0000 7f8a9cff9700 1 -- 172.21.15.100:0/2043475621 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f8a90086940 con 0x7f8aa0102c00 2023-12-05T09:53:51.845 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:51.848+0000 7f8a9f7fe700 1 --2- 172.21.15.100:0/2043475621 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f8a88068f70 0x7f8a8806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:53:51.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:51 smithi150 ceph-mon[116142]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:53:51.846 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:51.848+0000 7f8a9f7fe700 1 --2- 172.21.15.100:0/2043475621 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f8a88068f70 0x7f8a8806b420 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8aa0111060 tx=0x7f8a94009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:53:51.849 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:51.851+0000 7f8a9cff9700 1 -- 172.21.15.100:0/2043475621 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f8a90056ac0 con 0x7f8aa0102c00 2023-12-05T09:53:52.045 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:52.047+0000 7f8aa692d700 1 -- 172.21.15.100:0/2043475621 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8aa0110e10 con 0x7f8aa0102c00 2023-12-05T09:53:52.045 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:52.048+0000 7f8a9cff9700 1 -- 172.21.15.100:0/2043475621 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11121 (secure 0 0 0) 0x7f8a90056650 con 0x7f8aa0102c00 2023-12-05T09:53:52.046 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:53:52.046 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":40,"fsid":"5b035ce6-9353-11ee-95a2-87774f69a715","created":"2023-12-05T09:48:33.718763+0000","modified":"2023-12-05T09:53:34.991888+0000","last_up_change":"2023-12-05T09:53:33.596224+0000","last_in_change":"2023-12-05T09:53:15.176570+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-05T09:52:26.650134+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"9f3faeed-8336-4509-9127-eafa0273ecea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2938979601},{"type":"v1","addr":"172.21.15.100:6803","nonce":2938979601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2938979601},{"type":"v1","addr":"172.21.15.100:6805","nonce":2938979601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":2938979601},{"type":"v1","addr":"172.21.15.100:6809","nonce":2938979601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2938979601},{"type":"v1","addr":"172.21.15.100:6807","nonce":2938979601}]},"public_addr":"172.21.15.100:6803/2938979601","cluster_addr":"172.21.15.100:6805/2938979601","heartbeat_back_addr":"172.21.15.100:6809/2938979601","heartbeat_front_addr":"172.21.15.100:6807/2938979601","state":["exists","up"]},{"osd":1,"uuid":"6ca8c1e2-e673-4dc4-b02d-c0805493bcf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":38684261},{"type":"v1","addr":"172.21.15.100:6811","nonce":38684261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":38684261},{"type":"v1","addr":"172.21.15.100:6813","nonce":38684261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":38684261},{"type":"v1","addr":"172.21.15.100:6817","nonce":38684261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":38684261},{"type":"v1","addr":"172.21.15.100:6815","nonce":38684261}]},"public_addr":"172.21.15.100:6811/38684261","cluster_addr":"172.21.15.100:6813/38684261","heartbeat_back_addr":"172.21.15.100:6817/38684261","heartbeat_front_addr":"172.21.15.100:6815/38684261","state":["exists","up"]},{"osd":2,"uuid":"59a55cb9-28ae-4485-8cbf-e5f6224bd377","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":2128721915},{"type":"v1","addr":"172.21.15.100:6819","nonce":2128721915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2128721915},{"type":"v1","addr":"172.21.15.100:6821","nonce":2128721915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":2128721915},{"type":"v1","addr":"172.21.15.100:6825","nonce":2128721915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":2128721915},{"type":"v1","addr":"172.21.15.100:6823","nonce":2128721915}]},"public_addr":"172.21.15.100:6819/2128721915","cluster_addr":"172.21.15.100:6821/2128721915","heartbeat_back_addr":"172.21.15.100:6825/2128721915","heartbeat_front_addr":"172.21.15.100:6823/2128721915","state":["exists","up"]},{"osd":3,"uuid":"e12b505f-7f0c-4d6f-b039-5aa793f79db0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":1626769878},{"type":"v1","addr":"172.21.15.150:6801","nonce":1626769878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":1626769878},{"type":"v1","addr":"172.21.15.150:6803","nonce":1626769878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":1626769878},{"type":"v1","addr":"172.21.15.150:6807","nonce":1626769878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":1626769878},{"type":"v1","addr":"172.21.15.150:6805","nonce":1626769878}]},"public_addr":"172.21.15.150:6801/1626769878","cluster_addr":"172.21.15.150:6803/1626769878","heartbeat_back_addr":"172.21.15.150:6807/1626769878","heartbeat_front_addr":"172.21.15.150:6805/1626769878","state":["exists","up"]},{"osd":4,"uuid":"33fbbf55-86ba-4e7f-a66b-e958dce72283","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":2589618062},{"type":"v1","addr":"172.21.15.150:6809","nonce":2589618062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":2589618062},{"type":"v1","addr":"172.21.15.150:6811","nonce":2589618062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":2589618062},{"type":"v1","addr":"172.21.15.150:6815","nonce":2589618062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":2589618062},{"type":"v1","addr":"172.21.15.150:6813","nonce":2589618062}]},"public_addr":"172.21.15.150:6809/2589618062","cluster_addr":"172.21.15.150:6811/2589618062","heartbeat_back_addr":"172.21.15.150:6815/2589618062","heartbeat_front_addr":"172.21.15.150:6813/2589618062","state":["exists","up"]},{"osd":5,"uuid":"93b2d10b-0410-4390-9283-b4129c0439d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":4116522433},{"type":"v1","addr":"172.21.15.150:6817","nonce":4116522433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":4116522433},{"type":"v1","addr":"172.21.15.150:6819","nonce":4116522433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":4116522433},{"type":"v1","addr":"172.21.15.150:6823","nonce":4116522433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":4116522433},{"type":"v1","addr":"172.21.15.150:6821","nonce":4116522433}]},"public_addr":"172.21.15.150:6817/4116522433","cluster_addr":"172.21.15.150:6819/4116522433","heartbeat_back_addr":"172.21.15.150:6823/4116522433","heartbeat_front_addr":"172.21.15.150:6821/4116522433","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T09:51:35.123538+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T09:51:59.961993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T09:52:23.976682+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T09:52:46.493238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T09:53:09.121783+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T09:53:32.450910+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:0/2826914555":"2023-12-06T09:50:30.059721+0000","172.21.15.100:6801/2397627746":"2023-12-06T09:50:30.059721+0000","172.21.15.100:0/737517101":"2023-12-06T09:50:30.059721+0000","172.21.15.100:0/1529397750":"2023-12-06T09:49:28.559106+0000","172.21.15.100:0/2992397636":"2023-12-06T09:49:01.007941+0000","172.21.15.100:6801/2647899624":"2023-12-06T09:49:28.559106+0000","172.21.15.100:6800/2647899624":"2023-12-06T09:49:28.559106+0000","172.21.15.100:0/556453695":"2023-12-06T09:49:28.559106+0000","172.21.15.100:0/567522562":"2023-12-06T09:49:01.007941+0000","172.21.15.100:6800/2397627746":"2023-12-06T09:50:30.059721+0000","172.21.15.100:0/4197065049":"2023-12-06T09:50:30.059721+0000","172.21.15.100:6800/3606837497":"2023-12-06T09:49:01.007941+0000","172.21.15.100:0/3942224339":"2023-12-06T09:49:28.559106+0000","172.21.15.100:0/2400356084":"2023-12-06T09:49:01.007941+0000","172.21.15.100:6801/3606837497":"2023-12-06T09:49:01.007941+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-05T09:53:52.048 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:52.051+0000 7f8aa692d700 1 -- 172.21.15.100:0/2043475621 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f8a88068f70 msgr2=0x7f8a8806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:53:52.048 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:52.051+0000 7f8aa692d700 1 --2- 172.21.15.100:0/2043475621 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f8a88068f70 0x7f8a8806b420 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8aa0111060 tx=0x7f8a94009e30 comp rx=0 tx=0).stop 2023-12-05T09:53:52.048 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:52.051+0000 7f8aa692d700 1 -- 172.21.15.100:0/2043475621 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8aa0102c00 msgr2=0x7f8aa0115830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:53:52.048 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:52.051+0000 7f8aa692d700 1 --2- 172.21.15.100:0/2043475621 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8aa0102c00 0x7f8aa0115830 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8a90002a50 tx=0x7f8a900046b0 comp rx=0 tx=0).stop 2023-12-05T09:53:52.048 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:52.051+0000 7f8aa692d700 1 -- 172.21.15.100:0/2043475621 shutdown_connections 2023-12-05T09:53:52.048 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:52.051+0000 7f8aa692d700 1 --2- 172.21.15.100:0/2043475621 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f8a88068f70 0x7f8a8806b420 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:52.049 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:52.051+0000 7f8aa692d700 1 --2- 172.21.15.100:0/2043475621 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8aa0102c00 0x7f8aa0115830 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:52.049 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:52.051+0000 7f8aa692d700 1 --2- 172.21.15.100:0/2043475621 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8aa01035a0 0x7f8aa0115d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:52.049 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:52.051+0000 7f8aa692d700 1 -- 172.21.15.100:0/2043475621 >> 172.21.15.100:0/2043475621 conn(0x7f8aa00f8790 msgr2=0x7f8aa00fa1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:53:52.049 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:52.051+0000 7f8aa692d700 1 -- 172.21.15.100:0/2043475621 shutdown_connections 2023-12-05T09:53:52.049 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:52.051+0000 7f8aa692d700 1 -- 172.21.15.100:0/2043475621 wait complete. 2023-12-05T09:53:52.448 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- ceph tell osd.0 flush_pg_stats 2023-12-05T09:53:52.448 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- ceph tell osd.1 flush_pg_stats 2023-12-05T09:53:52.449 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- ceph tell osd.2 flush_pg_stats 2023-12-05T09:53:52.449 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- ceph tell osd.3 flush_pg_stats 2023-12-05T09:53:52.449 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- ceph tell osd.4 flush_pg_stats 2023-12-05T09:53:52.450 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- ceph tell osd.5 flush_pg_stats 2023-12-05T09:53:52.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:52 smithi150 ceph-mon[116142]: from='client.? 172.21.15.100:0/2043475621' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-05T09:53:52.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:52 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/2043475621' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-05T09:53:52.973 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi100/config 2023-12-05T09:53:53.025 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi100/config 2023-12-05T09:53:53.447 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:53 smithi100 ceph-mon[107145]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:53:53.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:53 smithi150 ceph-mon[116142]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:53:54.509 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi100/config 2023-12-05T09:53:54.582 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi100/config 2023-12-05T09:53:54.625 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi100/config 2023-12-05T09:53:54.699 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:54.701+0000 7faa79af6700 1 -- 172.21.15.100:0/2451444104 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa741035a0 msgr2=0x7faa740fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:53:54.699 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:54.701+0000 7faa79af6700 1 --2- 172.21.15.100:0/2451444104 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa741035a0 0x7faa740fcc10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7faa68004940 tx=0x7faa68009e30 comp rx=0 tx=0).stop 2023-12-05T09:53:54.699 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:54.701+0000 7faa79af6700 1 -- 172.21.15.100:0/2451444104 shutdown_connections 2023-12-05T09:53:54.699 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:54.701+0000 7faa79af6700 1 --2- 172.21.15.100:0/2451444104 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa741035a0 0x7faa740fcc10 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:54.699 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:54.701+0000 7faa79af6700 1 --2- 172.21.15.100:0/2451444104 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa74102c00 0x7faa74102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:54.699 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:54.701+0000 7faa79af6700 1 -- 172.21.15.100:0/2451444104 >> 172.21.15.100:0/2451444104 conn(0x7faa740f8790 msgr2=0x7faa740faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:53:54.699 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:54.701+0000 7faa79af6700 1 -- 172.21.15.100:0/2451444104 shutdown_connections 2023-12-05T09:53:54.699 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:54.701+0000 7faa79af6700 1 -- 172.21.15.100:0/2451444104 wait complete. 2023-12-05T09:53:54.700 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:54.702+0000 7faa79af6700 1 Processor -- start 2023-12-05T09:53:54.700 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:54.702+0000 7faa79af6700 1 -- start start 2023-12-05T09:53:54.701 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:54.702+0000 7faa79af6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa74102c00 0x7faa74115890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:53:54.701 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:54.702+0000 7faa79af6700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa741035a0 0x7faa74115dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:53:54.701 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:54.702+0000 7faa79af6700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa74116420 con 0x7faa741035a0 2023-12-05T09:53:54.701 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:54.702+0000 7faa79af6700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa7410f750 con 0x7faa74102c00 2023-12-05T09:53:54.701 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:54.703+0000 7faa72ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa741035a0 0x7faa74115dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:53:54.701 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:54.703+0000 7faa72ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa741035a0 0x7faa74115dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52818/0 (socket says 172.21.15.100:52818) 2023-12-05T09:53:54.701 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:54.703+0000 7faa72ffd700 1 -- 172.21.15.100:0/1148525587 learned_addr learned my addr 172.21.15.100:0/1148525587 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:53:54.701 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:54.703+0000 7faa737fe700 1 --2- 172.21.15.100:0/1148525587 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa74102c00 0x7faa74115890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:53:54.701 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:54.703+0000 7faa72ffd700 1 -- 172.21.15.100:0/1148525587 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa74102c00 msgr2=0x7faa74115890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:53:54.701 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:54.703+0000 7faa72ffd700 1 --2- 172.21.15.100:0/1148525587 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa74102c00 0x7faa74115890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:54.701 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:54.703+0000 7faa72ffd700 1 -- 172.21.15.100:0/1148525587 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa68005040 con 0x7faa741035a0 2023-12-05T09:53:54.701 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:54.703+0000 7faa72ffd700 1 --2- 172.21.15.100:0/1148525587 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa741035a0 0x7faa74115dd0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7faa68009180 tx=0x7faa68009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:53:54.702 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:54.703+0000 7faa5bfff700 1 -- 172.21.15.100:0/1148525587 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa6800e040 con 0x7faa741035a0 2023-12-05T09:53:54.702 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:54.704+0000 7faa79af6700 1 -- 172.21.15.100:0/1148525587 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa7410f9d0 con 0x7faa741035a0 2023-12-05T09:53:54.702 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:54.704+0000 7faa5bfff700 1 -- 172.21.15.100:0/1148525587 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7faa68004290 con 0x7faa741035a0 2023-12-05T09:53:54.702 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:54.704+0000 7faa5bfff700 1 -- 172.21.15.100:0/1148525587 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa6801c3f0 con 0x7faa741035a0 2023-12-05T09:53:54.702 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:54.704+0000 7faa79af6700 1 -- 172.21.15.100:0/1148525587 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa7410ff10 con 0x7faa741035a0 2023-12-05T09:53:54.702 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:54.705+0000 7faa79af6700 1 -- 172.21.15.100:0/1148525587 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7faa741104c0 con 0x7faa741035a0 2023-12-05T09:53:54.703 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:54.706+0000 7faa5bfff700 1 -- 172.21.15.100:0/1148525587 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7faa68013770 con 0x7faa741035a0 2023-12-05T09:53:54.704 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:54.706+0000 7faa5bfff700 1 --2- 172.21.15.100:0/1148525587 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7faa5c068f70 0x7faa5c06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:53:54.704 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:54.707+0000 7faa5bfff700 1 -- 172.21.15.100:0/1148525587 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7faa68087cd0 con 0x7faa741035a0 2023-12-05T09:53:54.704 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:54.707+0000 7faa737fe700 1 --2- 172.21.15.100:0/1148525587 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7faa5c068f70 0x7faa5c06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:53:54.705 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:54.707+0000 7faa5bfff700 1 --2- 172.21.15.100:0/1148525587 >> [v2:172.21.15.100:6802/2938979601,v1:172.21.15.100:6803/2938979601] conn(0x7faa5c06ec40 0x7faa5c071050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:53:54.705 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:54.707+0000 7faa5bfff700 1 -- 172.21.15.100:0/1148525587 --> [v2:172.21.15.100:6802/2938979601,v1:172.21.15.100:6803/2938979601] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faa5c071700 con 0x7faa5c06ec40 2023-12-05T09:53:54.705 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:54.707+0000 7faa5bfff700 1 -- 172.21.15.100:0/1148525587 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa6808a220 con 0x7faa741035a0 2023-12-05T09:53:54.705 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:54.707+0000 7faa73fff700 1 --2- 172.21.15.100:0/1148525587 >> [v2:172.21.15.100:6802/2938979601,v1:172.21.15.100:6803/2938979601] conn(0x7faa5c06ec40 0x7faa5c071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:53:54.705 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:54.707+0000 7faa737fe700 1 --2- 172.21.15.100:0/1148525587 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7faa5c068f70 0x7faa5c06b420 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7faa64004f40 tx=0x7faa6400b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:53:54.705 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:54.708+0000 7faa73fff700 1 --2- 172.21.15.100:0/1148525587 >> [v2:172.21.15.100:6802/2938979601,v1:172.21.15.100:6803/2938979601] conn(0x7faa5c06ec40 0x7faa5c071050 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:53:54.706 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:54.709+0000 7faa5bfff700 1 -- 172.21.15.100:0/1148525587 <== osd.0 v2:172.21.15.100:6802/2938979601 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7faa5c071700 con 0x7faa5c06ec40 2023-12-05T09:53:54.722 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:54.724+0000 7faa79af6700 1 -- 172.21.15.100:0/1148525587 --> [v2:172.21.15.100:6802/2938979601,v1:172.21.15.100:6803/2938979601] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7faa740faaa0 con 0x7faa5c06ec40 2023-12-05T09:53:54.723 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:54.725+0000 7faa5bfff700 1 -- 172.21.15.100:0/1148525587 <== osd.0 v2:172.21.15.100:6802/2938979601 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7faa740faaa0 con 0x7faa5c06ec40 2023-12-05T09:53:54.723 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:54.725+0000 7faa79af6700 1 -- 172.21.15.100:0/1148525587 >> [v2:172.21.15.100:6802/2938979601,v1:172.21.15.100:6803/2938979601] conn(0x7faa5c06ec40 msgr2=0x7faa5c071050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:53:54.723 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:54.725+0000 7faa79af6700 1 --2- 172.21.15.100:0/1148525587 >> [v2:172.21.15.100:6802/2938979601,v1:172.21.15.100:6803/2938979601] conn(0x7faa5c06ec40 0x7faa5c071050 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:54.726 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:54.725+0000 7faa79af6700 1 -- 172.21.15.100:0/1148525587 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7faa5c068f70 msgr2=0x7faa5c06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:53:54.726 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:54.725+0000 7faa79af6700 1 --2- 172.21.15.100:0/1148525587 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7faa5c068f70 0x7faa5c06b420 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7faa64004f40 tx=0x7faa6400b040 comp rx=0 tx=0).stop 2023-12-05T09:53:54.726 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:54.725+0000 7faa79af6700 1 -- 172.21.15.100:0/1148525587 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa741035a0 msgr2=0x7faa74115dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:53:54.726 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:54.725+0000 7faa79af6700 1 --2- 172.21.15.100:0/1148525587 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa741035a0 0x7faa74115dd0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7faa68009180 tx=0x7faa68009e30 comp rx=0 tx=0).stop 2023-12-05T09:53:54.726 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:54.725+0000 7faa79af6700 1 -- 172.21.15.100:0/1148525587 shutdown_connections 2023-12-05T09:53:54.726 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:54.725+0000 7faa79af6700 1 --2- 172.21.15.100:0/1148525587 >> [v2:172.21.15.100:6802/2938979601,v1:172.21.15.100:6803/2938979601] conn(0x7faa5c06ec40 0x7faa5c071050 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:54.726 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:54.725+0000 7faa79af6700 1 --2- 172.21.15.100:0/1148525587 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7faa5c068f70 0x7faa5c06b420 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:54.726 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:54.725+0000 7faa79af6700 1 --2- 172.21.15.100:0/1148525587 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa74102c00 0x7faa74115890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:54.726 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:54.725+0000 7faa79af6700 1 --2- 172.21.15.100:0/1148525587 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa741035a0 0x7faa74115dd0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:54.726 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:54.725+0000 7faa79af6700 1 -- 172.21.15.100:0/1148525587 >> 172.21.15.100:0/1148525587 conn(0x7faa740f8790 msgr2=0x7faa740fa150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:53:54.727 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:54.725+0000 7faa79af6700 1 -- 172.21.15.100:0/1148525587 shutdown_connections 2023-12-05T09:53:54.727 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:54.725+0000 7faa79af6700 1 -- 172.21.15.100:0/1148525587 wait complete. 2023-12-05T09:53:55.340 INFO:teuthology.orchestra.run.smithi100.stdout:38654705693 2023-12-05T09:53:55.341 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- ceph osd last-stat-seq osd.0 2023-12-05T09:53:55.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:55 smithi100 ceph-mon[107145]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:53:55.699 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:55 smithi150 ceph-mon[116142]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:53:55.767 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi100/config 2023-12-05T09:53:56.218 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:56.220+0000 7f7c59d28700 1 -- 172.21.15.100:0/315213252 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c54102c00 msgr2=0x7f7c54102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:53:56.218 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:56.220+0000 7f7c59d28700 1 --2- 172.21.15.100:0/315213252 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c54102c00 0x7f7c54102fd0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7c44004940 tx=0x7f7c44009e30 comp rx=0 tx=0).stop 2023-12-05T09:53:56.218 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:56.220+0000 7f7c59d28700 1 -- 172.21.15.100:0/315213252 shutdown_connections 2023-12-05T09:53:56.219 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:56.220+0000 7f7c59d28700 1 --2- 172.21.15.100:0/315213252 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c541035a0 0x7f7c540fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:56.219 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:56.220+0000 7f7c59d28700 1 --2- 172.21.15.100:0/315213252 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c54102c00 0x7f7c54102fd0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:56.219 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:56.220+0000 7f7c59d28700 1 -- 172.21.15.100:0/315213252 >> 172.21.15.100:0/315213252 conn(0x7f7c540f8790 msgr2=0x7f7c540faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:53:56.220 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:56.220+0000 7f7c59d28700 1 -- 172.21.15.100:0/315213252 shutdown_connections 2023-12-05T09:53:56.220 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:56.220+0000 7f7c59d28700 1 -- 172.21.15.100:0/315213252 wait complete. 2023-12-05T09:53:56.220 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:56.221+0000 7f7c59d28700 1 Processor -- start 2023-12-05T09:53:56.220 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:56.222+0000 7f7c59d28700 1 -- start start 2023-12-05T09:53:56.220 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:56.222+0000 7f7c59d28700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c54102c00 0x7f7c54115820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:53:56.220 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:56.222+0000 7f7c59d28700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c541035a0 0x7f7c54115d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:53:56.220 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:56.222+0000 7f7c59d28700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c541163b0 con 0x7f7c541035a0 2023-12-05T09:53:56.220 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:56.222+0000 7f7c59d28700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5410f6e0 con 0x7f7c54102c00 2023-12-05T09:53:56.221 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:56.222+0000 7f7c52ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c541035a0 0x7f7c54115d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:53:56.221 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:56.222+0000 7f7c52ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c541035a0 0x7f7c54115d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52830/0 (socket says 172.21.15.100:52830) 2023-12-05T09:53:56.221 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:56.222+0000 7f7c52ffd700 1 -- 172.21.15.100:0/2752109776 learned_addr learned my addr 172.21.15.100:0/2752109776 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:53:56.221 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:56.222+0000 7f7c537fe700 1 --2- 172.21.15.100:0/2752109776 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c54102c00 0x7f7c54115820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:53:56.221 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:56.223+0000 7f7c52ffd700 1 -- 172.21.15.100:0/2752109776 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c54102c00 msgr2=0x7f7c54115820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:53:56.221 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:56.223+0000 7f7c52ffd700 1 --2- 172.21.15.100:0/2752109776 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c54102c00 0x7f7c54115820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:56.221 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:56.223+0000 7f7c52ffd700 1 -- 172.21.15.100:0/2752109776 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c44005040 con 0x7f7c541035a0 2023-12-05T09:53:56.222 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:56.223+0000 7f7c52ffd700 1 --2- 172.21.15.100:0/2752109776 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c541035a0 0x7f7c54115d60 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7c4800c800 tx=0x7f7c48004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:53:56.222 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:56.223+0000 7f7c3bfff700 1 -- 172.21.15.100:0/2752109776 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c480106f0 con 0x7f7c541035a0 2023-12-05T09:53:56.222 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:56.223+0000 7f7c59d28700 1 -- 172.21.15.100:0/2752109776 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c5410f9c0 con 0x7f7c541035a0 2023-12-05T09:53:56.222 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:56.223+0000 7f7c3bfff700 1 -- 172.21.15.100:0/2752109776 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7c48010d00 con 0x7f7c541035a0 2023-12-05T09:53:56.222 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:56.223+0000 7f7c3bfff700 1 -- 172.21.15.100:0/2752109776 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c480113a0 con 0x7f7c541035a0 2023-12-05T09:53:56.222 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:56.223+0000 7f7c59d28700 1 -- 172.21.15.100:0/2752109776 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c5410ff00 con 0x7f7c541035a0 2023-12-05T09:53:56.222 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:56.224+0000 7f7c59d28700 1 -- 172.21.15.100:0/2752109776 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7c54110480 con 0x7f7c541035a0 2023-12-05T09:53:56.222 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:56.225+0000 7f7c3bfff700 1 -- 172.21.15.100:0/2752109776 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f7c48012400 con 0x7f7c541035a0 2023-12-05T09:53:56.224 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:56.226+0000 7f7c3bfff700 1 --2- 172.21.15.100:0/2752109776 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f7c3c068f60 0x7f7c3c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:53:56.224 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:56.226+0000 7f7c3bfff700 1 -- 172.21.15.100:0/2752109776 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f7c48086aa0 con 0x7f7c541035a0 2023-12-05T09:53:56.224 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:56.226+0000 7f7c537fe700 1 --2- 172.21.15.100:0/2752109776 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f7c3c068f60 0x7f7c3c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:53:56.224 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:56.226+0000 7f7c3bfff700 1 --2- 172.21.15.100:0/2752109776 >> [v2:172.21.15.150:6816/4116522433,v1:172.21.15.150:6817/4116522433] conn(0x7f7c3c06ec30 0x7f7c3c071040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:53:56.224 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:56.226+0000 7f7c3bfff700 1 -- 172.21.15.100:0/2752109776 --> [v2:172.21.15.150:6816/4116522433,v1:172.21.15.150:6817/4116522433] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7c3c0716f0 con 0x7f7c3c06ec30 2023-12-05T09:53:56.224 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:56.226+0000 7f7c3bfff700 1 -- 172.21.15.100:0/2752109776 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7c4808b220 con 0x7f7c541035a0 2023-12-05T09:53:56.225 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:56.227+0000 7f7c537fe700 1 --2- 172.21.15.100:0/2752109776 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f7c3c068f60 0x7f7c3c06b410 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7c44004f90 tx=0x7f7c44009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:53:56.225 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:56.227+0000 7f7c53fff700 1 --2- 172.21.15.100:0/2752109776 >> [v2:172.21.15.150:6816/4116522433,v1:172.21.15.150:6817/4116522433] conn(0x7f7c3c06ec30 0x7f7c3c071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:53:56.225 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:56.228+0000 7f7c53fff700 1 --2- 172.21.15.100:0/2752109776 >> [v2:172.21.15.150:6816/4116522433,v1:172.21.15.150:6817/4116522433] conn(0x7f7c3c06ec30 0x7f7c3c071040 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:53:56.226 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:56.229+0000 7f7c3bfff700 1 -- 172.21.15.100:0/2752109776 <== osd.5 v2:172.21.15.150:6816/4116522433 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f7c3c0716f0 con 0x7f7c3c06ec30 2023-12-05T09:53:56.241 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:56.244+0000 7f7c59d28700 1 -- 172.21.15.100:0/2752109776 --> [v2:172.21.15.150:6816/4116522433,v1:172.21.15.150:6817/4116522433] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7c540faaa0 con 0x7f7c3c06ec30 2023-12-05T09:53:56.242 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:56.245+0000 7f7c3bfff700 1 -- 172.21.15.100:0/2752109776 <== osd.5 v2:172.21.15.150:6816/4116522433 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f7c540faaa0 con 0x7f7c3c06ec30 2023-12-05T09:53:56.243 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:56.245+0000 7f7c59d28700 1 -- 172.21.15.100:0/2752109776 >> [v2:172.21.15.150:6816/4116522433,v1:172.21.15.150:6817/4116522433] conn(0x7f7c3c06ec30 msgr2=0x7f7c3c071040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:53:56.243 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:56.245+0000 7f7c59d28700 1 --2- 172.21.15.100:0/2752109776 >> [v2:172.21.15.150:6816/4116522433,v1:172.21.15.150:6817/4116522433] conn(0x7f7c3c06ec30 0x7f7c3c071040 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:56.243 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:56.245+0000 7f7c59d28700 1 -- 172.21.15.100:0/2752109776 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f7c3c068f60 msgr2=0x7f7c3c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:53:56.243 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:56.245+0000 7f7c59d28700 1 --2- 172.21.15.100:0/2752109776 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f7c3c068f60 0x7f7c3c06b410 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7c44004f90 tx=0x7f7c44009e30 comp rx=0 tx=0).stop 2023-12-05T09:53:56.243 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:56.245+0000 7f7c59d28700 1 -- 172.21.15.100:0/2752109776 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c541035a0 msgr2=0x7f7c54115d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:53:56.243 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:56.245+0000 7f7c59d28700 1 --2- 172.21.15.100:0/2752109776 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c541035a0 0x7f7c54115d60 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7c4800c800 tx=0x7f7c48004470 comp rx=0 tx=0).stop 2023-12-05T09:53:56.243 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:56.245+0000 7f7c59d28700 1 -- 172.21.15.100:0/2752109776 shutdown_connections 2023-12-05T09:53:56.243 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:56.245+0000 7f7c59d28700 1 --2- 172.21.15.100:0/2752109776 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f7c3c068f60 0x7f7c3c06b410 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:56.244 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:56.245+0000 7f7c59d28700 1 --2- 172.21.15.100:0/2752109776 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c54102c00 0x7f7c54115820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:56.244 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:56.245+0000 7f7c59d28700 1 --2- 172.21.15.100:0/2752109776 >> [v2:172.21.15.150:6816/4116522433,v1:172.21.15.150:6817/4116522433] conn(0x7f7c3c06ec30 0x7f7c3c071040 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:56.244 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:56.245+0000 7f7c59d28700 1 --2- 172.21.15.100:0/2752109776 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c541035a0 0x7f7c54115d60 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:56.244 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:56.245+0000 7f7c59d28700 1 -- 172.21.15.100:0/2752109776 >> 172.21.15.100:0/2752109776 conn(0x7f7c540f8790 msgr2=0x7f7c540fa0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:53:56.244 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:56.245+0000 7f7c59d28700 1 -- 172.21.15.100:0/2752109776 shutdown_connections 2023-12-05T09:53:56.244 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:56.245+0000 7f7c59d28700 1 -- 172.21.15.100:0/2752109776 wait complete. 2023-12-05T09:53:56.925 INFO:teuthology.orchestra.run.smithi100.stdout:167503724552 2023-12-05T09:53:56.925 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- ceph osd last-stat-seq osd.5 2023-12-05T09:53:57.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:57 smithi100 ceph-mon[107145]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:53:57.841 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:57.843+0000 7f3b67bb5700 1 -- 172.21.15.100:0/3177578510 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b60070520 msgr2=0x7f3b60070990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:53:57.841 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:57.843+0000 7f3b67bb5700 1 --2- 172.21.15.100:0/3177578510 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b60070520 0x7f3b60070990 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3b50004970 tx=0x7f3b50009e30 comp rx=0 tx=0).stop 2023-12-05T09:53:57.841 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:57.843+0000 7f3b67bb5700 1 -- 172.21.15.100:0/3177578510 shutdown_connections 2023-12-05T09:53:57.842 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:57.843+0000 7f3b67bb5700 1 --2- 172.21.15.100:0/3177578510 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b60070520 0x7f3b60070990 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:57.842 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:57.843+0000 7f3b67bb5700 1 --2- 172.21.15.100:0/3177578510 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b60071c10 0x7f3b6006ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:57.842 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:57.843+0000 7f3b67bb5700 1 -- 172.21.15.100:0/3177578510 >> 172.21.15.100:0/3177578510 conn(0x7f3b600f8790 msgr2=0x7f3b600faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:53:57.842 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:57.843+0000 7f3b67bb5700 1 -- 172.21.15.100:0/3177578510 shutdown_connections 2023-12-05T09:53:57.842 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:57.843+0000 7f3b67bb5700 1 -- 172.21.15.100:0/3177578510 wait complete. 2023-12-05T09:53:57.843 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:57.844+0000 7f3b67bb5700 1 Processor -- start 2023-12-05T09:53:57.843 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:57.844+0000 7f3b67bb5700 1 -- start start 2023-12-05T09:53:57.843 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:57.845+0000 7f3b67bb5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b60070520 0x7f3b60119c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:53:57.843 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:57.845+0000 7f3b67bb5700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b60071c10 0x7f3b6011a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:53:57.843 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:57.845+0000 7f3b67bb5700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b6011a790 con 0x7f3b60071c10 2023-12-05T09:53:57.843 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:57.845+0000 7f3b67bb5700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b60113ac0 con 0x7f3b60070520 2023-12-05T09:53:57.843 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:57.845+0000 7f3b65150700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b60071c10 0x7f3b6011a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:53:57.843 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:57.845+0000 7f3b65150700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b60071c10 0x7f3b6011a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52844/0 (socket says 172.21.15.100:52844) 2023-12-05T09:53:57.843 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:57.845+0000 7f3b65150700 1 -- 172.21.15.100:0/2232889244 learned_addr learned my addr 172.21.15.100:0/2232889244 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:53:57.844 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:57.846+0000 7f3b65150700 1 -- 172.21.15.100:0/2232889244 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b60070520 msgr2=0x7f3b60119c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:53:57.844 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:57.846+0000 7f3b65150700 1 --2- 172.21.15.100:0/2232889244 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b60070520 0x7f3b60119c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:57.844 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:57.846+0000 7f3b65150700 1 -- 172.21.15.100:0/2232889244 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b50005040 con 0x7f3b60071c10 2023-12-05T09:53:57.844 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:57.846+0000 7f3b65150700 1 --2- 172.21.15.100:0/2232889244 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b60071c10 0x7f3b6011a140 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3b50000c00 tx=0x7f3b50009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:53:57.844 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:57.846+0000 7f3b567fc700 1 -- 172.21.15.100:0/2232889244 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b5000e040 con 0x7f3b60071c10 2023-12-05T09:53:57.844 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:57.846+0000 7f3b67bb5700 1 -- 172.21.15.100:0/2232889244 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b60113d40 con 0x7f3b60071c10 2023-12-05T09:53:57.844 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:57.846+0000 7f3b567fc700 1 -- 172.21.15.100:0/2232889244 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3b50013420 con 0x7f3b60071c10 2023-12-05T09:53:57.844 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:57.846+0000 7f3b567fc700 1 -- 172.21.15.100:0/2232889244 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b5001c630 con 0x7f3b60071c10 2023-12-05T09:53:57.845 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:57.846+0000 7f3b67bb5700 1 -- 172.21.15.100:0/2232889244 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b60114280 con 0x7f3b60071c10 2023-12-05T09:53:57.845 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:57.847+0000 7f3b4bfff700 1 -- 172.21.15.100:0/2232889244 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3b60114720 con 0x7f3b60071c10 2023-12-05T09:53:57.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:57 smithi150 ceph-mon[116142]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:53:57.846 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:57.848+0000 7f3b567fc700 1 -- 172.21.15.100:0/2232889244 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f3b50013590 con 0x7f3b60071c10 2023-12-05T09:53:57.847 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:57.849+0000 7f3b567fc700 1 --2- 172.21.15.100:0/2232889244 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f3b4c068f70 0x7f3b4c06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:53:57.847 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:57.850+0000 7f3b567fc700 1 -- 172.21.15.100:0/2232889244 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f3b50087e70 con 0x7f3b60071c10 2023-12-05T09:53:57.847 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:57.850+0000 7f3b65951700 1 --2- 172.21.15.100:0/2232889244 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f3b4c068f70 0x7f3b4c06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:53:57.847 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:57.850+0000 7f3b567fc700 1 --2- 172.21.15.100:0/2232889244 >> [v2:172.21.15.100:6818/2128721915,v1:172.21.15.100:6819/2128721915] conn(0x7f3b4c06ec40 0x7f3b4c071050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:53:57.848 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:57.850+0000 7f3b567fc700 1 -- 172.21.15.100:0/2232889244 --> [v2:172.21.15.100:6818/2128721915,v1:172.21.15.100:6819/2128721915] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3b4c071700 con 0x7f3b4c06ec40 2023-12-05T09:53:57.848 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:57.850+0000 7f3b567fc700 1 -- 172.21.15.100:0/2232889244 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3b5008d3e0 con 0x7f3b60071c10 2023-12-05T09:53:57.848 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:57.850+0000 7f3b66152700 1 --2- 172.21.15.100:0/2232889244 >> [v2:172.21.15.100:6818/2128721915,v1:172.21.15.100:6819/2128721915] conn(0x7f3b4c06ec40 0x7f3b4c071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:53:57.848 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:57.851+0000 7f3b65951700 1 --2- 172.21.15.100:0/2232889244 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f3b4c068f70 0x7f3b4c06b420 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c009fd0 tx=0x7f3b5c00b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:53:57.848 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:57.851+0000 7f3b66152700 1 --2- 172.21.15.100:0/2232889244 >> [v2:172.21.15.100:6818/2128721915,v1:172.21.15.100:6819/2128721915] conn(0x7f3b4c06ec40 0x7f3b4c071050 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:53:57.850 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:57.852+0000 7f3b567fc700 1 -- 172.21.15.100:0/2232889244 <== osd.2 v2:172.21.15.100:6818/2128721915 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f3b4c071700 con 0x7f3b4c06ec40 2023-12-05T09:53:57.868 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:57.870+0000 7f3b4bfff700 1 -- 172.21.15.100:0/2232889244 --> [v2:172.21.15.100:6818/2128721915,v1:172.21.15.100:6819/2128721915] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3b6005e340 con 0x7f3b4c06ec40 2023-12-05T09:53:57.868 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:57.870+0000 7f3b567fc700 1 -- 172.21.15.100:0/2232889244 <== osd.2 v2:172.21.15.100:6818/2128721915 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3b6005e340 con 0x7f3b4c06ec40 2023-12-05T09:53:57.868 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:57.871+0000 7f3b4bfff700 1 -- 172.21.15.100:0/2232889244 >> [v2:172.21.15.100:6818/2128721915,v1:172.21.15.100:6819/2128721915] conn(0x7f3b4c06ec40 msgr2=0x7f3b4c071050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:53:57.869 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:57.871+0000 7f3b4bfff700 1 --2- 172.21.15.100:0/2232889244 >> [v2:172.21.15.100:6818/2128721915,v1:172.21.15.100:6819/2128721915] conn(0x7f3b4c06ec40 0x7f3b4c071050 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:57.869 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:57.871+0000 7f3b4bfff700 1 -- 172.21.15.100:0/2232889244 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f3b4c068f70 msgr2=0x7f3b4c06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:53:57.869 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:57.871+0000 7f3b4bfff700 1 --2- 172.21.15.100:0/2232889244 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f3b4c068f70 0x7f3b4c06b420 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c009fd0 tx=0x7f3b5c00b040 comp rx=0 tx=0).stop 2023-12-05T09:53:57.870 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:57.871+0000 7f3b4bfff700 1 -- 172.21.15.100:0/2232889244 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b60071c10 msgr2=0x7f3b6011a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:53:57.870 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:57.871+0000 7f3b4bfff700 1 --2- 172.21.15.100:0/2232889244 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b60071c10 0x7f3b6011a140 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3b50000c00 tx=0x7f3b50009e30 comp rx=0 tx=0).stop 2023-12-05T09:53:57.870 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:57.872+0000 7f3b4bfff700 1 -- 172.21.15.100:0/2232889244 shutdown_connections 2023-12-05T09:53:57.870 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:57.872+0000 7f3b4bfff700 1 --2- 172.21.15.100:0/2232889244 >> [v2:172.21.15.100:6818/2128721915,v1:172.21.15.100:6819/2128721915] conn(0x7f3b4c06ec40 0x7f3b4c071050 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:57.870 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:57.872+0000 7f3b4bfff700 1 --2- 172.21.15.100:0/2232889244 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f3b4c068f70 0x7f3b4c06b420 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:57.870 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:57.872+0000 7f3b4bfff700 1 --2- 172.21.15.100:0/2232889244 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b60070520 0x7f3b60119c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:57.870 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:57.872+0000 7f3b4bfff700 1 --2- 172.21.15.100:0/2232889244 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b60071c10 0x7f3b6011a140 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:57.870 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:57.872+0000 7f3b4bfff700 1 -- 172.21.15.100:0/2232889244 >> 172.21.15.100:0/2232889244 conn(0x7f3b600f8790 msgr2=0x7f3b600fa4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:53:57.870 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:57.872+0000 7f3b4bfff700 1 -- 172.21.15.100:0/2232889244 shutdown_connections 2023-12-05T09:53:57.870 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:57.872+0000 7f3b4bfff700 1 -- 172.21.15.100:0/2232889244 wait complete. 2023-12-05T09:53:58.041 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:57.998+0000 7f9a69f11700 1 -- 172.21.15.100:0/2555271078 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a641035a0 msgr2=0x7f9a640fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:53:58.041 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:57.998+0000 7f9a69f11700 1 --2- 172.21.15.100:0/2555271078 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a641035a0 0x7f9a640fcc10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9a58004880 tx=0x7f9a58009e30 comp rx=0 tx=0).stop 2023-12-05T09:53:58.041 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:57.998+0000 7f9a69f11700 1 -- 172.21.15.100:0/2555271078 shutdown_connections 2023-12-05T09:53:58.041 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:57.998+0000 7f9a69f11700 1 --2- 172.21.15.100:0/2555271078 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a641035a0 0x7f9a640fcc10 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:58.041 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:57.998+0000 7f9a69f11700 1 --2- 172.21.15.100:0/2555271078 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a64102c00 0x7f9a64102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:58.041 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:57.998+0000 7f9a69f11700 1 -- 172.21.15.100:0/2555271078 >> 172.21.15.100:0/2555271078 conn(0x7f9a640f8790 msgr2=0x7f9a640faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:53:58.041 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:57.999+0000 7f9a69f11700 1 -- 172.21.15.100:0/2555271078 shutdown_connections 2023-12-05T09:53:58.041 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:57.999+0000 7f9a69f11700 1 -- 172.21.15.100:0/2555271078 wait complete. 2023-12-05T09:53:58.041 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.000+0000 7f9a69f11700 1 Processor -- start 2023-12-05T09:53:58.042 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.000+0000 7f9a69f11700 1 -- start start 2023-12-05T09:53:58.042 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.000+0000 7f9a69f11700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a64102c00 0x7f9a641157b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:53:58.042 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.000+0000 7f9a69f11700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a641035a0 0x7f9a64115cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:53:58.042 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.000+0000 7f9a69f11700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a64116340 con 0x7f9a641035a0 2023-12-05T09:53:58.042 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.000+0000 7f9a69f11700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6410f670 con 0x7f9a64102c00 2023-12-05T09:53:58.042 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.000+0000 7f9a62ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a641035a0 0x7f9a64115cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:53:58.042 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.001+0000 7f9a62ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a641035a0 0x7f9a64115cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52874/0 (socket says 172.21.15.100:52874) 2023-12-05T09:53:58.042 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.001+0000 7f9a62ffd700 1 -- 172.21.15.100:0/3309271831 learned_addr learned my addr 172.21.15.100:0/3309271831 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:53:58.042 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.001+0000 7f9a637fe700 1 --2- 172.21.15.100:0/3309271831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a64102c00 0x7f9a641157b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:53:58.042 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.001+0000 7f9a62ffd700 1 -- 172.21.15.100:0/3309271831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a64102c00 msgr2=0x7f9a641157b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:53:58.042 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.001+0000 7f9a62ffd700 1 --2- 172.21.15.100:0/3309271831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a64102c00 0x7f9a641157b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:58.042 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.001+0000 7f9a62ffd700 1 -- 172.21.15.100:0/3309271831 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a58005040 con 0x7f9a641035a0 2023-12-05T09:53:58.042 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.001+0000 7f9a62ffd700 1 --2- 172.21.15.100:0/3309271831 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a641035a0 0x7f9a64115cf0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9a580134d0 tx=0x7f9a58009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:53:58.042 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.002+0000 7f9a4bfff700 1 -- 172.21.15.100:0/3309271831 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a5800e030 con 0x7f9a641035a0 2023-12-05T09:53:58.043 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.002+0000 7f9a4bfff700 1 -- 172.21.15.100:0/3309271831 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9a5801c400 con 0x7f9a641035a0 2023-12-05T09:53:58.043 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.002+0000 7f9a69f11700 1 -- 172.21.15.100:0/3309271831 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a6410f8f0 con 0x7f9a641035a0 2023-12-05T09:53:58.043 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.002+0000 7f9a69f11700 1 -- 172.21.15.100:0/3309271831 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a6410fe30 con 0x7f9a641035a0 2023-12-05T09:53:58.043 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.002+0000 7f9a4bfff700 1 -- 172.21.15.100:0/3309271831 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a58012600 con 0x7f9a641035a0 2023-12-05T09:53:58.043 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.005+0000 7f9a69f11700 1 -- 172.21.15.100:0/3309271831 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9a50001000 con 0x7f9a641035a0 2023-12-05T09:53:58.043 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.005+0000 7f9a4bfff700 1 -- 172.21.15.100:0/3309271831 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f9a58013a20 con 0x7f9a641035a0 2023-12-05T09:53:58.043 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.006+0000 7f9a4bfff700 1 --2- 172.21.15.100:0/3309271831 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f9a4c068f70 0x7f9a4c06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:53:58.043 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.007+0000 7f9a4bfff700 1 -- 172.21.15.100:0/3309271831 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f9a580882b0 con 0x7f9a641035a0 2023-12-05T09:53:58.043 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.007+0000 7f9a4bfff700 1 --2- 172.21.15.100:0/3309271831 >> [v2:172.21.15.150:6800/1626769878,v1:172.21.15.150:6801/1626769878] conn(0x7f9a4c06ec40 0x7f9a4c071050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:53:58.043 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.007+0000 7f9a4bfff700 1 -- 172.21.15.100:0/3309271831 --> [v2:172.21.15.150:6800/1626769878,v1:172.21.15.150:6801/1626769878] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9a4c071700 con 0x7f9a4c06ec40 2023-12-05T09:53:58.043 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.007+0000 7f9a637fe700 1 --2- 172.21.15.100:0/3309271831 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f9a4c068f70 0x7f9a4c06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:53:58.043 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.007+0000 7f9a4bfff700 1 -- 172.21.15.100:0/3309271831 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9a5808a920 con 0x7f9a641035a0 2023-12-05T09:53:58.043 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.007+0000 7f9a637fe700 1 --2- 172.21.15.100:0/3309271831 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f9a4c068f70 0x7f9a4c06b420 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9a54009b80 tx=0x7f9a5400b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:53:58.043 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.008+0000 7f9a63fff700 1 --2- 172.21.15.100:0/3309271831 >> [v2:172.21.15.150:6800/1626769878,v1:172.21.15.150:6801/1626769878] conn(0x7f9a4c06ec40 0x7f9a4c071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:53:58.044 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.009+0000 7f9a63fff700 1 --2- 172.21.15.100:0/3309271831 >> [v2:172.21.15.150:6800/1626769878,v1:172.21.15.150:6801/1626769878] conn(0x7f9a4c06ec40 0x7f9a4c071050 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:53:58.044 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.010+0000 7f9a4bfff700 1 -- 172.21.15.100:0/3309271831 <== osd.3 v2:172.21.15.150:6800/1626769878 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f9a4c071700 con 0x7f9a4c06ec40 2023-12-05T09:53:58.044 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.026+0000 7f9a69f11700 1 -- 172.21.15.100:0/3309271831 --> [v2:172.21.15.150:6800/1626769878,v1:172.21.15.150:6801/1626769878] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9a50002d60 con 0x7f9a4c06ec40 2023-12-05T09:53:58.044 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.026+0000 7f9a4bfff700 1 -- 172.21.15.100:0/3309271831 <== osd.3 v2:172.21.15.150:6800/1626769878 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f9a50002d60 con 0x7f9a4c06ec40 2023-12-05T09:53:58.044 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.027+0000 7f9a69f11700 1 -- 172.21.15.100:0/3309271831 >> [v2:172.21.15.150:6800/1626769878,v1:172.21.15.150:6801/1626769878] conn(0x7f9a4c06ec40 msgr2=0x7f9a4c071050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:53:58.044 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.027+0000 7f9a69f11700 1 --2- 172.21.15.100:0/3309271831 >> [v2:172.21.15.150:6800/1626769878,v1:172.21.15.150:6801/1626769878] conn(0x7f9a4c06ec40 0x7f9a4c071050 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:58.044 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.027+0000 7f9a69f11700 1 -- 172.21.15.100:0/3309271831 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f9a4c068f70 msgr2=0x7f9a4c06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:53:58.044 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.027+0000 7f9a69f11700 1 --2- 172.21.15.100:0/3309271831 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f9a4c068f70 0x7f9a4c06b420 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9a54009b80 tx=0x7f9a5400b040 comp rx=0 tx=0).stop 2023-12-05T09:53:58.045 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.027+0000 7f9a69f11700 1 -- 172.21.15.100:0/3309271831 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a641035a0 msgr2=0x7f9a64115cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:53:58.045 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.027+0000 7f9a69f11700 1 --2- 172.21.15.100:0/3309271831 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a641035a0 0x7f9a64115cf0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9a580134d0 tx=0x7f9a58009e30 comp rx=0 tx=0).stop 2023-12-05T09:53:58.045 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.027+0000 7f9a69f11700 1 -- 172.21.15.100:0/3309271831 shutdown_connections 2023-12-05T09:53:58.045 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.027+0000 7f9a69f11700 1 --2- 172.21.15.100:0/3309271831 >> [v2:172.21.15.150:6800/1626769878,v1:172.21.15.150:6801/1626769878] conn(0x7f9a4c06ec40 0x7f9a4c071050 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:58.045 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.027+0000 7f9a69f11700 1 --2- 172.21.15.100:0/3309271831 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f9a4c068f70 0x7f9a4c06b420 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:58.045 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.027+0000 7f9a69f11700 1 --2- 172.21.15.100:0/3309271831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a64102c00 0x7f9a641157b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:58.045 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.027+0000 7f9a69f11700 1 --2- 172.21.15.100:0/3309271831 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a641035a0 0x7f9a64115cf0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:58.045 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.027+0000 7f9a69f11700 1 -- 172.21.15.100:0/3309271831 >> 172.21.15.100:0/3309271831 conn(0x7f9a640f8790 msgr2=0x7f9a640fa100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:53:58.045 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.027+0000 7f9a69f11700 1 -- 172.21.15.100:0/3309271831 shutdown_connections 2023-12-05T09:53:58.046 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.027+0000 7f9a69f11700 1 -- 172.21.15.100:0/3309271831 wait complete. 2023-12-05T09:53:58.657 INFO:teuthology.orchestra.run.smithi100.stdout:81604378645 2023-12-05T09:53:58.657 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- ceph osd last-stat-seq osd.2 2023-12-05T09:53:58.683 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.326+0000 7fe7eca28700 1 -- 172.21.15.100:0/1053446324 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7e8102c20 msgr2=0x7fe7e8102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:53:58.683 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.326+0000 7fe7eca28700 1 --2- 172.21.15.100:0/1053446324 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7e8102c20 0x7fe7e8102ff0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe7d8004940 tx=0x7fe7d8009e30 comp rx=0 tx=0).stop 2023-12-05T09:53:58.683 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.327+0000 7fe7eca28700 1 -- 172.21.15.100:0/1053446324 shutdown_connections 2023-12-05T09:53:58.683 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.327+0000 7fe7eca28700 1 --2- 172.21.15.100:0/1053446324 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7e8065390 0x7fe7e8065800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:58.683 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.327+0000 7fe7eca28700 1 --2- 172.21.15.100:0/1053446324 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7e8102c20 0x7fe7e8102ff0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:58.683 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.327+0000 7fe7eca28700 1 -- 172.21.15.100:0/1053446324 >> 172.21.15.100:0/1053446324 conn(0x7fe7e80719b0 msgr2=0x7fe7e8071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:53:58.683 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.327+0000 7fe7eca28700 1 -- 172.21.15.100:0/1053446324 shutdown_connections 2023-12-05T09:53:58.683 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.327+0000 7fe7eca28700 1 -- 172.21.15.100:0/1053446324 wait complete. 2023-12-05T09:53:58.683 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.327+0000 7fe7eca28700 1 Processor -- start 2023-12-05T09:53:58.683 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.328+0000 7fe7eca28700 1 -- start start 2023-12-05T09:53:58.683 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.328+0000 7fe7eca28700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7e8065390 0x7fe7e8115800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:53:58.684 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.328+0000 7fe7eca28700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7e8102c20 0x7fe7e8115d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:53:58.684 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.328+0000 7fe7eca28700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e8116390 con 0x7fe7e8065390 2023-12-05T09:53:58.684 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.328+0000 7fe7eca28700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e810f6c0 con 0x7fe7e8102c20 2023-12-05T09:53:58.684 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.328+0000 7fe7e659c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7e8065390 0x7fe7e8115800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:53:58.684 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.328+0000 7fe7e659c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7e8065390 0x7fe7e8115800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52892/0 (socket says 172.21.15.100:52892) 2023-12-05T09:53:58.684 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.328+0000 7fe7e659c700 1 -- 172.21.15.100:0/511797275 learned_addr learned my addr 172.21.15.100:0/511797275 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:53:58.684 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.328+0000 7fe7e5d9b700 1 --2- 172.21.15.100:0/511797275 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7e8102c20 0x7fe7e8115d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:53:58.684 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.328+0000 7fe7e659c700 1 -- 172.21.15.100:0/511797275 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7e8102c20 msgr2=0x7fe7e8115d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:53:58.684 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.328+0000 7fe7e659c700 1 --2- 172.21.15.100:0/511797275 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7e8102c20 0x7fe7e8115d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:58.684 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.329+0000 7fe7e659c700 1 -- 172.21.15.100:0/511797275 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7d8005040 con 0x7fe7e8065390 2023-12-05T09:53:58.684 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.329+0000 7fe7e5d9b700 1 --2- 172.21.15.100:0/511797275 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7e8102c20 0x7fe7e8115d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-05T09:53:58.684 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.329+0000 7fe7e659c700 1 --2- 172.21.15.100:0/511797275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7e8065390 0x7fe7e8115800 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe7d80040d0 tx=0x7fe7d8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:53:58.684 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.329+0000 7fe7d6ffd700 1 -- 172.21.15.100:0/511797275 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7d8021070 con 0x7fe7e8065390 2023-12-05T09:53:58.684 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.329+0000 7fe7d6ffd700 1 -- 172.21.15.100:0/511797275 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe7d801c400 con 0x7fe7e8065390 2023-12-05T09:53:58.685 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.329+0000 7fe7eca28700 1 -- 172.21.15.100:0/511797275 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7e810f940 con 0x7fe7e8065390 2023-12-05T09:53:58.685 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.329+0000 7fe7d6ffd700 1 -- 172.21.15.100:0/511797275 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7d800e070 con 0x7fe7e8065390 2023-12-05T09:53:58.685 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.329+0000 7fe7eca28700 1 -- 172.21.15.100:0/511797275 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7e810fe80 con 0x7fe7e8065390 2023-12-05T09:53:58.685 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.330+0000 7fe7eca28700 1 -- 172.21.15.100:0/511797275 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe7e8110370 con 0x7fe7e8065390 2023-12-05T09:53:58.685 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.331+0000 7fe7d6ffd700 1 -- 172.21.15.100:0/511797275 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7fe7d801c9c0 con 0x7fe7e8065390 2023-12-05T09:53:58.685 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.332+0000 7fe7d6ffd700 1 --2- 172.21.15.100:0/511797275 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fe7d0068f70 0x7fe7d006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:53:58.685 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.332+0000 7fe7d6ffd700 1 -- 172.21.15.100:0/511797275 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fe7d8087ca0 con 0x7fe7e8065390 2023-12-05T09:53:58.685 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.332+0000 7fe7e5d9b700 1 --2- 172.21.15.100:0/511797275 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fe7d0068f70 0x7fe7d006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:53:58.685 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.332+0000 7fe7d6ffd700 1 --2- 172.21.15.100:0/511797275 >> [v2:172.21.15.150:6808/2589618062,v1:172.21.15.150:6809/2589618062] conn(0x7fe7d006ec40 0x7fe7d0071050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:53:58.685 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.333+0000 7fe7d6ffd700 1 -- 172.21.15.100:0/511797275 --> [v2:172.21.15.150:6808/2589618062,v1:172.21.15.150:6809/2589618062] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe7d0071700 con 0x7fe7d006ec40 2023-12-05T09:53:58.685 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.333+0000 7fe7d6ffd700 1 -- 172.21.15.100:0/511797275 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe7d808a250 con 0x7fe7e8065390 2023-12-05T09:53:58.685 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.333+0000 7fe7e5d9b700 1 --2- 172.21.15.100:0/511797275 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fe7d0068f70 0x7fe7d006b420 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe7e8111030 tx=0x7fe7dc00b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:53:58.685 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.333+0000 7fe7e6d9d700 1 --2- 172.21.15.100:0/511797275 >> [v2:172.21.15.150:6808/2589618062,v1:172.21.15.150:6809/2589618062] conn(0x7fe7d006ec40 0x7fe7d0071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:53:58.686 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.334+0000 7fe7e6d9d700 1 --2- 172.21.15.100:0/511797275 >> [v2:172.21.15.150:6808/2589618062,v1:172.21.15.150:6809/2589618062] conn(0x7fe7d006ec40 0x7fe7d0071050 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:53:58.686 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.335+0000 7fe7d6ffd700 1 -- 172.21.15.100:0/511797275 <== osd.4 v2:172.21.15.150:6808/2589618062 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fe7d0071700 con 0x7fe7d006ec40 2023-12-05T09:53:58.686 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.363+0000 7fe7eca28700 1 -- 172.21.15.100:0/511797275 --> [v2:172.21.15.150:6808/2589618062,v1:172.21.15.150:6809/2589618062] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe7e81104e0 con 0x7fe7d006ec40 2023-12-05T09:53:58.686 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.363+0000 7fe7d6ffd700 1 -- 172.21.15.100:0/511797275 <== osd.4 v2:172.21.15.150:6808/2589618062 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fe7e81104e0 con 0x7fe7d006ec40 2023-12-05T09:53:58.686 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.364+0000 7fe7eca28700 1 -- 172.21.15.100:0/511797275 >> [v2:172.21.15.150:6808/2589618062,v1:172.21.15.150:6809/2589618062] conn(0x7fe7d006ec40 msgr2=0x7fe7d0071050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:53:58.686 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.364+0000 7fe7eca28700 1 --2- 172.21.15.100:0/511797275 >> [v2:172.21.15.150:6808/2589618062,v1:172.21.15.150:6809/2589618062] conn(0x7fe7d006ec40 0x7fe7d0071050 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:58.686 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.364+0000 7fe7eca28700 1 -- 172.21.15.100:0/511797275 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fe7d0068f70 msgr2=0x7fe7d006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:53:58.687 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.364+0000 7fe7eca28700 1 --2- 172.21.15.100:0/511797275 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fe7d0068f70 0x7fe7d006b420 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe7e8111030 tx=0x7fe7dc00b040 comp rx=0 tx=0).stop 2023-12-05T09:53:58.687 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.364+0000 7fe7eca28700 1 -- 172.21.15.100:0/511797275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7e8065390 msgr2=0x7fe7e8115800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:53:58.687 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.364+0000 7fe7eca28700 1 --2- 172.21.15.100:0/511797275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7e8065390 0x7fe7e8115800 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe7d80040d0 tx=0x7fe7d8009e30 comp rx=0 tx=0).stop 2023-12-05T09:53:58.687 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.364+0000 7fe7eca28700 1 -- 172.21.15.100:0/511797275 shutdown_connections 2023-12-05T09:53:58.687 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.364+0000 7fe7eca28700 1 --2- 172.21.15.100:0/511797275 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fe7d0068f70 0x7fe7d006b420 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:58.687 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.364+0000 7fe7eca28700 1 --2- 172.21.15.100:0/511797275 >> [v2:172.21.15.150:6808/2589618062,v1:172.21.15.150:6809/2589618062] conn(0x7fe7d006ec40 0x7fe7d0071050 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:58.687 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.364+0000 7fe7eca28700 1 --2- 172.21.15.100:0/511797275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7e8065390 0x7fe7e8115800 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:58.687 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.364+0000 7fe7eca28700 1 --2- 172.21.15.100:0/511797275 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7e8102c20 0x7fe7e8115d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:58.687 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.364+0000 7fe7eca28700 1 -- 172.21.15.100:0/511797275 >> 172.21.15.100:0/511797275 conn(0x7fe7e80719b0 msgr2=0x7fe7e80fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:53:58.687 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.364+0000 7fe7eca28700 1 -- 172.21.15.100:0/511797275 shutdown_connections 2023-12-05T09:53:58.687 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:58.364+0000 7fe7eca28700 1 -- 172.21.15.100:0/511797275 wait complete. 2023-12-05T09:53:58.910 INFO:teuthology.orchestra.run.smithi100.stdout:111669149712 2023-12-05T09:53:58.910 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- ceph osd last-stat-seq osd.3 2023-12-05T09:53:58.983 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi100/config 2023-12-05T09:53:59.093 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi100/config 2023-12-05T09:53:59.097 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:59.100+0000 7ff146245700 1 -- 172.21.15.100:0/192837117 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1400fcba0 msgr2=0x7ff1400fd010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:53:59.097 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:59.100+0000 7ff146245700 1 --2- 172.21.15.100:0/192837117 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1400fcba0 0x7ff1400fd010 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff134004940 tx=0x7ff134009e30 comp rx=0 tx=0).stop 2023-12-05T09:53:59.098 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:59.100+0000 7ff146245700 1 -- 172.21.15.100:0/192837117 shutdown_connections 2023-12-05T09:53:59.098 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:59.100+0000 7ff146245700 1 --2- 172.21.15.100:0/192837117 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1400fcba0 0x7ff1400fd010 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:59.098 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:59.100+0000 7ff146245700 1 --2- 172.21.15.100:0/192837117 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1400fda20 0x7ff1400fc5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:59.098 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:59.100+0000 7ff146245700 1 -- 172.21.15.100:0/192837117 >> 172.21.15.100:0/192837117 conn(0x7ff1400719b0 msgr2=0x7ff140071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:53:59.098 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:59.100+0000 7ff146245700 1 -- 172.21.15.100:0/192837117 shutdown_connections 2023-12-05T09:53:59.098 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:59.100+0000 7ff146245700 1 -- 172.21.15.100:0/192837117 wait complete. 2023-12-05T09:53:59.098 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:59.101+0000 7ff146245700 1 Processor -- start 2023-12-05T09:53:59.099 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:59.101+0000 7ff146245700 1 -- start start 2023-12-05T09:53:59.100 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:59.102+0000 7ff146245700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1400fcba0 0x7ff140119d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:53:59.100 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:59.102+0000 7ff146245700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1400fda20 0x7ff14011a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:53:59.100 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:59.102+0000 7ff146245700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff14011a980 con 0x7ff1400fda20 2023-12-05T09:53:59.100 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:59.102+0000 7ff146245700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff140113c00 con 0x7ff1400fcba0 2023-12-05T09:53:59.100 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:59.103+0000 7ff13f7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1400fcba0 0x7ff140119d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:53:59.101 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:59.103+0000 7ff13f7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1400fcba0 0x7ff140119d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.100:47344/0 (socket says 172.21.15.100:47344) 2023-12-05T09:53:59.101 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:59.103+0000 7ff13f7fe700 1 -- 172.21.15.100:0/260915874 learned_addr learned my addr 172.21.15.100:0/260915874 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:53:59.101 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:59.103+0000 7ff13effd700 1 --2- 172.21.15.100:0/260915874 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1400fda20 0x7ff14011a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:53:59.101 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:59.103+0000 7ff13f7fe700 1 -- 172.21.15.100:0/260915874 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1400fda20 msgr2=0x7ff14011a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:53:59.101 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:59.103+0000 7ff13f7fe700 1 --2- 172.21.15.100:0/260915874 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1400fda20 0x7ff14011a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:59.101 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:59.103+0000 7ff13f7fe700 1 -- 172.21.15.100:0/260915874 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff134005040 con 0x7ff1400fcba0 2023-12-05T09:53:59.101 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:59.103+0000 7ff13effd700 1 --2- 172.21.15.100:0/260915874 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1400fda20 0x7ff14011a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-05T09:53:59.102 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:59.104+0000 7ff13f7fe700 1 --2- 172.21.15.100:0/260915874 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1400fcba0 0x7ff140119d60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff13000b790 tx=0x7ff130009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:53:59.102 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:59.104+0000 7ff127fff700 1 -- 172.21.15.100:0/260915874 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff13000f770 con 0x7ff1400fcba0 2023-12-05T09:53:59.102 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:59.104+0000 7ff146245700 1 -- 172.21.15.100:0/260915874 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff140113e80 con 0x7ff1400fcba0 2023-12-05T09:53:59.103 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:59.104+0000 7ff146245700 1 -- 172.21.15.100:0/260915874 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1401143c0 con 0x7ff1400fcba0 2023-12-05T09:53:59.103 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:59.104+0000 7ff127fff700 1 -- 172.21.15.100:0/260915874 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff13000fd80 con 0x7ff1400fcba0 2023-12-05T09:53:59.103 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:59.105+0000 7ff127fff700 1 -- 172.21.15.100:0/260915874 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff13000d310 con 0x7ff1400fcba0 2023-12-05T09:53:59.103 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:59.105+0000 7ff146245700 1 -- 172.21.15.100:0/260915874 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff12c001000 con 0x7ff1400fcba0 2023-12-05T09:53:59.106 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:59.108+0000 7ff127fff700 1 -- 172.21.15.100:0/260915874 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7ff13000f8d0 con 0x7ff1400fcba0 2023-12-05T09:53:59.107 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:59.109+0000 7ff127fff700 1 --2- 172.21.15.100:0/260915874 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7ff128068f70 0x7ff12806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:53:59.107 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:59.110+0000 7ff127fff700 1 -- 172.21.15.100:0/260915874 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7ff1300868a0 con 0x7ff1400fcba0 2023-12-05T09:53:59.107 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:59.110+0000 7ff127fff700 1 --2- 172.21.15.100:0/260915874 >> [v2:172.21.15.100:6810/38684261,v1:172.21.15.100:6811/38684261] conn(0x7ff12806ec40 0x7ff128071050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:53:59.107 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:59.110+0000 7ff127fff700 1 -- 172.21.15.100:0/260915874 --> [v2:172.21.15.100:6810/38684261,v1:172.21.15.100:6811/38684261] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff128071700 con 0x7ff12806ec40 2023-12-05T09:53:59.108 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:59.110+0000 7ff127fff700 1 -- 172.21.15.100:0/260915874 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff13000fef0 con 0x7ff1400fcba0 2023-12-05T09:53:59.108 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:59.110+0000 7ff13ffff700 1 --2- 172.21.15.100:0/260915874 >> [v2:172.21.15.100:6810/38684261,v1:172.21.15.100:6811/38684261] conn(0x7ff12806ec40 0x7ff128071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:53:59.108 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:59.111+0000 7ff13effd700 1 --2- 172.21.15.100:0/260915874 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7ff128068f70 0x7ff12806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:53:59.109 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:59.111+0000 7ff13ffff700 1 --2- 172.21.15.100:0/260915874 >> [v2:172.21.15.100:6810/38684261,v1:172.21.15.100:6811/38684261] conn(0x7ff12806ec40 0x7ff128071050 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:53:59.109 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:59.111+0000 7ff13effd700 1 --2- 172.21.15.100:0/260915874 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7ff128068f70 0x7ff12806b420 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff140115600 tx=0x7ff134009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:53:59.110 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:59.113+0000 7ff127fff700 1 -- 172.21.15.100:0/260915874 <== osd.1 v2:172.21.15.100:6810/38684261 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7ff128071700 con 0x7ff12806ec40 2023-12-05T09:53:59.127 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:59.130+0000 7ff146245700 1 -- 172.21.15.100:0/260915874 --> [v2:172.21.15.100:6810/38684261,v1:172.21.15.100:6811/38684261] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff12c002d60 con 0x7ff12806ec40 2023-12-05T09:53:59.128 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:59.130+0000 7ff127fff700 1 -- 172.21.15.100:0/260915874 <== osd.1 v2:172.21.15.100:6810/38684261 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff12c002d60 con 0x7ff12806ec40 2023-12-05T09:53:59.128 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:59.131+0000 7ff146245700 1 -- 172.21.15.100:0/260915874 >> [v2:172.21.15.100:6810/38684261,v1:172.21.15.100:6811/38684261] conn(0x7ff12806ec40 msgr2=0x7ff128071050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:53:59.128 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:59.131+0000 7ff146245700 1 --2- 172.21.15.100:0/260915874 >> [v2:172.21.15.100:6810/38684261,v1:172.21.15.100:6811/38684261] conn(0x7ff12806ec40 0x7ff128071050 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:59.129 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:59.131+0000 7ff146245700 1 -- 172.21.15.100:0/260915874 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7ff128068f70 msgr2=0x7ff12806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:53:59.129 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:59.131+0000 7ff146245700 1 --2- 172.21.15.100:0/260915874 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7ff128068f70 0x7ff12806b420 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff140115600 tx=0x7ff134009e30 comp rx=0 tx=0).stop 2023-12-05T09:53:59.129 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:59.131+0000 7ff146245700 1 -- 172.21.15.100:0/260915874 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1400fcba0 msgr2=0x7ff140119d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:53:59.129 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:59.131+0000 7ff146245700 1 --2- 172.21.15.100:0/260915874 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1400fcba0 0x7ff140119d60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff13000b790 tx=0x7ff130009250 comp rx=0 tx=0).stop 2023-12-05T09:53:59.129 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:59.132+0000 7ff146245700 1 -- 172.21.15.100:0/260915874 shutdown_connections 2023-12-05T09:53:59.129 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:59.132+0000 7ff146245700 1 --2- 172.21.15.100:0/260915874 >> [v2:172.21.15.100:6810/38684261,v1:172.21.15.100:6811/38684261] conn(0x7ff12806ec40 0x7ff128071050 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:59.130 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:59.132+0000 7ff146245700 1 --2- 172.21.15.100:0/260915874 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7ff128068f70 0x7ff12806b420 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:59.130 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:59.132+0000 7ff146245700 1 --2- 172.21.15.100:0/260915874 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1400fcba0 0x7ff140119d60 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:59.130 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:59.132+0000 7ff146245700 1 --2- 172.21.15.100:0/260915874 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1400fda20 0x7ff14011a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:53:59.130 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:59.132+0000 7ff146245700 1 -- 172.21.15.100:0/260915874 >> 172.21.15.100:0/260915874 conn(0x7ff1400719b0 msgr2=0x7ff1400f9d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:53:59.130 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:59.132+0000 7ff146245700 1 -- 172.21.15.100:0/260915874 shutdown_connections 2023-12-05T09:53:59.130 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:53:59.132+0000 7ff146245700 1 -- 172.21.15.100:0/260915874 wait complete. 2023-12-05T09:53:59.395 INFO:teuthology.orchestra.run.smithi100.stdout:146028888076 2023-12-05T09:53:59.395 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- ceph osd last-stat-seq osd.4 2023-12-05T09:53:59.633 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:53:59 smithi100 ceph-mon[107145]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:53:59.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:53:59 smithi150 ceph-mon[116142]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:53:59.893 INFO:teuthology.orchestra.run.smithi100.stdout:60129542170 2023-12-05T09:53:59.893 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- ceph osd last-stat-seq osd.1 2023-12-05T09:54:00.773 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:00 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:54:00.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:00 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:54:00.915 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi100/config 2023-12-05T09:54:00.969 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi100/config 2023-12-05T09:54:01.024 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.026+0000 7f7b14cc2700 1 -- 172.21.15.100:0/391517004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b101035a0 msgr2=0x7f7b100fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:01.024 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.026+0000 7f7b14cc2700 1 --2- 172.21.15.100:0/391517004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b101035a0 0x7f7b100fcc10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7b04004940 tx=0x7f7b04009e30 comp rx=0 tx=0).stop 2023-12-05T09:54:01.024 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.026+0000 7f7b14cc2700 1 -- 172.21.15.100:0/391517004 shutdown_connections 2023-12-05T09:54:01.025 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.026+0000 7f7b14cc2700 1 --2- 172.21.15.100:0/391517004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b101035a0 0x7f7b100fcc10 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:01.028 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.026+0000 7f7b14cc2700 1 --2- 172.21.15.100:0/391517004 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b10102c00 0x7f7b10102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:01.028 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.026+0000 7f7b14cc2700 1 -- 172.21.15.100:0/391517004 >> 172.21.15.100:0/391517004 conn(0x7f7b100f8790 msgr2=0x7f7b100faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:54:01.028 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.026+0000 7f7b14cc2700 1 -- 172.21.15.100:0/391517004 shutdown_connections 2023-12-05T09:54:01.028 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.026+0000 7f7b14cc2700 1 -- 172.21.15.100:0/391517004 wait complete. 2023-12-05T09:54:01.028 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.027+0000 7f7b14cc2700 1 Processor -- start 2023-12-05T09:54:01.028 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.027+0000 7f7b14cc2700 1 -- start start 2023-12-05T09:54:01.028 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.027+0000 7f7b14cc2700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b10102c00 0x7f7b1006ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:01.029 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.027+0000 7f7b14cc2700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b101035a0 0x7f7b10070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:01.029 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.027+0000 7f7b14cc2700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b10070a80 con 0x7f7b10102c00 2023-12-05T09:54:01.029 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.027+0000 7f7b14cc2700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b10070bf0 con 0x7f7b101035a0 2023-12-05T09:54:01.029 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.028+0000 7f7b0e59c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b10102c00 0x7f7b1006ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:01.029 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.028+0000 7f7b0e59c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b10102c00 0x7f7b1006ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34360/0 (socket says 172.21.15.100:34360) 2023-12-05T09:54:01.029 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.028+0000 7f7b0e59c700 1 -- 172.21.15.100:0/2055427510 learned_addr learned my addr 172.21.15.100:0/2055427510 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:54:01.029 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.028+0000 7f7b0e59c700 1 -- 172.21.15.100:0/2055427510 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b101035a0 msgr2=0x7f7b10070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:01.030 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.028+0000 7f7b0e59c700 1 --2- 172.21.15.100:0/2055427510 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b101035a0 0x7f7b10070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:01.030 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.028+0000 7f7b0e59c700 1 -- 172.21.15.100:0/2055427510 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b04005040 con 0x7f7b10102c00 2023-12-05T09:54:01.030 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.028+0000 7f7b0e59c700 1 --2- 172.21.15.100:0/2055427510 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b10102c00 0x7f7b1006ff40 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7b0000eb40 tx=0x7f7b0000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:54:01.030 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.028+0000 7f7afeffd700 1 -- 172.21.15.100:0/2055427510 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b00007cc0 con 0x7f7b10102c00 2023-12-05T09:54:01.030 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.029+0000 7f7afeffd700 1 -- 172.21.15.100:0/2055427510 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7b0000f040 con 0x7f7b10102c00 2023-12-05T09:54:01.030 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.029+0000 7f7afeffd700 1 -- 172.21.15.100:0/2055427510 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b00009570 con 0x7f7b10102c00 2023-12-05T09:54:01.031 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.029+0000 7f7b14cc2700 1 -- 172.21.15.100:0/2055427510 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b10119810 con 0x7f7b10102c00 2023-12-05T09:54:01.031 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.029+0000 7f7b14cc2700 1 -- 172.21.15.100:0/2055427510 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b10119c70 con 0x7f7b10102c00 2023-12-05T09:54:01.032 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.030+0000 7f7b14cc2700 1 -- 172.21.15.100:0/2055427510 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b100fc390 con 0x7f7b10102c00 2023-12-05T09:54:01.032 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.031+0000 7f7afeffd700 1 -- 172.21.15.100:0/2055427510 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f7b000096d0 con 0x7f7b10102c00 2023-12-05T09:54:01.033 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.032+0000 7f7afeffd700 1 --2- 172.21.15.100:0/2055427510 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f7af8068f70 0x7f7af806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:01.033 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.032+0000 7f7afeffd700 1 -- 172.21.15.100:0/2055427510 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f7b000866f0 con 0x7f7b10102c00 2023-12-05T09:54:01.033 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.032+0000 7f7b0dd9b700 1 --2- 172.21.15.100:0/2055427510 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f7af8068f70 0x7f7af806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:01.033 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.034+0000 7f7b0dd9b700 1 --2- 172.21.15.100:0/2055427510 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f7af8068f70 0x7f7af806b420 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7b0400b0d0 tx=0x7f7b04009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:54:01.035 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.038+0000 7f7afeffd700 1 -- 172.21.15.100:0/2055427510 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f7b0004da00 con 0x7f7b10102c00 2023-12-05T09:54:01.259 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.261+0000 7f7b14cc2700 1 -- 172.21.15.100:0/2055427510 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f7b10071720 con 0x7f7b10102c00 2023-12-05T09:54:01.259 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.262+0000 7f7afeffd700 1 -- 172.21.15.100:0/2055427510 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7b00052f10 con 0x7f7b10102c00 2023-12-05T09:54:01.259 INFO:teuthology.orchestra.run.smithi100.stdout:167503724553 2023-12-05T09:54:01.262 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.264+0000 7f7b14cc2700 1 -- 172.21.15.100:0/2055427510 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f7af8068f70 msgr2=0x7f7af806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:01.262 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.264+0000 7f7b14cc2700 1 --2- 172.21.15.100:0/2055427510 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f7af8068f70 0x7f7af806b420 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7b0400b0d0 tx=0x7f7b04009e30 comp rx=0 tx=0).stop 2023-12-05T09:54:01.262 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.264+0000 7f7b14cc2700 1 -- 172.21.15.100:0/2055427510 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b10102c00 msgr2=0x7f7b1006ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:01.262 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.264+0000 7f7b14cc2700 1 --2- 172.21.15.100:0/2055427510 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b10102c00 0x7f7b1006ff40 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7b0000eb40 tx=0x7f7b0000b040 comp rx=0 tx=0).stop 2023-12-05T09:54:01.262 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.264+0000 7f7b14cc2700 1 -- 172.21.15.100:0/2055427510 shutdown_connections 2023-12-05T09:54:01.262 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.264+0000 7f7b14cc2700 1 --2- 172.21.15.100:0/2055427510 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f7af8068f70 0x7f7af806b420 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:01.262 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.264+0000 7f7b14cc2700 1 --2- 172.21.15.100:0/2055427510 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b10102c00 0x7f7b1006ff40 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:01.263 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.264+0000 7f7b14cc2700 1 --2- 172.21.15.100:0/2055427510 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b101035a0 0x7f7b10070480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:01.263 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.264+0000 7f7b14cc2700 1 -- 172.21.15.100:0/2055427510 >> 172.21.15.100:0/2055427510 conn(0x7f7b100f8790 msgr2=0x7f7b100fa240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:54:01.263 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.264+0000 7f7b14cc2700 1 -- 172.21.15.100:0/2055427510 shutdown_connections 2023-12-05T09:54:01.263 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.264+0000 7f7b14cc2700 1 -- 172.21.15.100:0/2055427510 wait complete. 2023-12-05T09:54:01.667 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.669+0000 7fb89a585700 1 -- 172.21.15.100:0/1734276395 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb894102c00 msgr2=0x7fb894102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:01.667 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.669+0000 7fb89a585700 1 --2- 172.21.15.100:0/1734276395 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb894102c00 0x7fb894102fd0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb884004940 tx=0x7fb884009e30 comp rx=0 tx=0).stop 2023-12-05T09:54:01.667 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.669+0000 7fb89a585700 1 -- 172.21.15.100:0/1734276395 shutdown_connections 2023-12-05T09:54:01.667 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.669+0000 7fb89a585700 1 --2- 172.21.15.100:0/1734276395 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8941035a0 0x7fb8940fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:01.667 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.669+0000 7fb89a585700 1 --2- 172.21.15.100:0/1734276395 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb894102c00 0x7fb894102fd0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:01.667 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.669+0000 7fb89a585700 1 -- 172.21.15.100:0/1734276395 >> 172.21.15.100:0/1734276395 conn(0x7fb8940f8790 msgr2=0x7fb8940faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:54:01.668 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.669+0000 7fb89a585700 1 -- 172.21.15.100:0/1734276395 shutdown_connections 2023-12-05T09:54:01.668 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.669+0000 7fb89a585700 1 -- 172.21.15.100:0/1734276395 wait complete. 2023-12-05T09:54:01.669 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.670+0000 7fb89a585700 1 Processor -- start 2023-12-05T09:54:01.669 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.670+0000 7fb89a585700 1 -- start start 2023-12-05T09:54:01.669 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.671+0000 7fb89a585700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb894102c00 0x7fb894113610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:01.669 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.671+0000 7fb89a585700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8941035a0 0x7fb894113b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:01.669 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.671+0000 7fb89a585700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8941141e0 con 0x7fb894102c00 2023-12-05T09:54:01.669 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.671+0000 7fb89a585700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb89410d4d0 con 0x7fb8941035a0 2023-12-05T09:54:01.669 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.671+0000 7fb893fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb894102c00 0x7fb894113610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:01.669 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.671+0000 7fb893fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb894102c00 0x7fb894113610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34392/0 (socket says 172.21.15.100:34392) 2023-12-05T09:54:01.670 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.671+0000 7fb893fff700 1 -- 172.21.15.100:0/4192746533 learned_addr learned my addr 172.21.15.100:0/4192746533 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:54:01.670 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.671+0000 7fb893fff700 1 -- 172.21.15.100:0/4192746533 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8941035a0 msgr2=0x7fb894113b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:01.670 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.671+0000 7fb893fff700 1 --2- 172.21.15.100:0/4192746533 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8941035a0 0x7fb894113b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:01.670 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.671+0000 7fb893fff700 1 -- 172.21.15.100:0/4192746533 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb884005040 con 0x7fb894102c00 2023-12-05T09:54:01.670 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.671+0000 7fb893fff700 1 --2- 172.21.15.100:0/4192746533 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb894102c00 0x7fb894113610 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb884009fd0 tx=0x7fb884009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:54:01.670 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.672+0000 7fb890ff9700 1 -- 172.21.15.100:0/4192746533 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb88400e040 con 0x7fb894102c00 2023-12-05T09:54:01.670 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.672+0000 7fb890ff9700 1 -- 172.21.15.100:0/4192746533 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb88400bc50 con 0x7fb894102c00 2023-12-05T09:54:01.670 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.672+0000 7fb89a585700 1 -- 172.21.15.100:0/4192746533 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb89410d700 con 0x7fb894102c00 2023-12-05T09:54:01.670 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.672+0000 7fb890ff9700 1 -- 172.21.15.100:0/4192746533 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb884013ea0 con 0x7fb894102c00 2023-12-05T09:54:01.670 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.672+0000 7fb89a585700 1 -- 172.21.15.100:0/4192746533 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb89410dc40 con 0x7fb894102c00 2023-12-05T09:54:01.671 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.673+0000 7fb89a585700 1 -- 172.21.15.100:0/4192746533 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8940fff10 con 0x7fb894102c00 2023-12-05T09:54:01.671 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.674+0000 7fb890ff9700 1 -- 172.21.15.100:0/4192746533 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7fb884013420 con 0x7fb894102c00 2023-12-05T09:54:01.673 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.676+0000 7fb890ff9700 1 --2- 172.21.15.100:0/4192746533 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fb87c068f70 0x7fb87c06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:01.673 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.676+0000 7fb890ff9700 1 -- 172.21.15.100:0/4192746533 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fb884088070 con 0x7fb894102c00 2023-12-05T09:54:01.673 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.676+0000 7fb8937fe700 1 --2- 172.21.15.100:0/4192746533 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fb87c068f70 0x7fb87c06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:01.674 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.676+0000 7fb8937fe700 1 --2- 172.21.15.100:0/4192746533 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fb87c068f70 0x7fb87c06b420 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb89410eeb0 tx=0x7fb888007cc0 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:54:01.677 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.680+0000 7fb890ff9700 1 -- 172.21.15.100:0/4192746533 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fb8840581f0 con 0x7fb894102c00 2023-12-05T09:54:01.757 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:01 smithi100 ceph-mon[107145]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:54:01.758 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:01 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/2055427510' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-12-05T09:54:01.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:01 smithi150 ceph-mon[116142]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:54:01.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:01 smithi150 ceph-mon[116142]: from='client.? 172.21.15.100:0/2055427510' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-12-05T09:54:01.887 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.889+0000 7fb89a585700 1 -- 172.21.15.100:0/4192746533 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb89410ebf0 con 0x7fb894102c00 2023-12-05T09:54:01.887 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.889+0000 7fb890ff9700 1 -- 172.21.15.100:0/4192746533 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb884057d80 con 0x7fb894102c00 2023-12-05T09:54:01.888 INFO:teuthology.orchestra.run.smithi100.stdout:38654705694 2023-12-05T09:54:01.889 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.892+0000 7fb89a585700 1 -- 172.21.15.100:0/4192746533 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fb87c068f70 msgr2=0x7fb87c06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:01.889 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.892+0000 7fb89a585700 1 --2- 172.21.15.100:0/4192746533 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fb87c068f70 0x7fb87c06b420 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb89410eeb0 tx=0x7fb888007cc0 comp rx=0 tx=0).stop 2023-12-05T09:54:01.890 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.892+0000 7fb89a585700 1 -- 172.21.15.100:0/4192746533 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb894102c00 msgr2=0x7fb894113610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:01.890 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.892+0000 7fb89a585700 1 --2- 172.21.15.100:0/4192746533 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb894102c00 0x7fb894113610 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb884009fd0 tx=0x7fb884009e30 comp rx=0 tx=0).stop 2023-12-05T09:54:01.890 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.892+0000 7fb89a585700 1 -- 172.21.15.100:0/4192746533 shutdown_connections 2023-12-05T09:54:01.890 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.892+0000 7fb89a585700 1 --2- 172.21.15.100:0/4192746533 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fb87c068f70 0x7fb87c06b420 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:01.890 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.892+0000 7fb89a585700 1 --2- 172.21.15.100:0/4192746533 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb894102c00 0x7fb894113610 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:01.891 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.892+0000 7fb89a585700 1 --2- 172.21.15.100:0/4192746533 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8941035a0 0x7fb894113b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:01.891 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.892+0000 7fb89a585700 1 -- 172.21.15.100:0/4192746533 >> 172.21.15.100:0/4192746533 conn(0x7fb8940f8790 msgr2=0x7fb8940fa2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:54:01.891 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.892+0000 7fb89a585700 1 -- 172.21.15.100:0/4192746533 shutdown_connections 2023-12-05T09:54:01.891 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:01.893+0000 7fb89a585700 1 -- 172.21.15.100:0/4192746533 wait complete. 2023-12-05T09:54:02.445 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi100/config 2023-12-05T09:54:02.800 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:02 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/4192746533' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-12-05T09:54:02.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:02 smithi150 ceph-mon[116142]: from='client.? 172.21.15.100:0/4192746533' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-12-05T09:54:02.948 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi100/config 2023-12-05T09:54:02.981 INFO:tasks.cephadm.ceph_manager.ceph:need seq 167503724552 got 167503724553 for osd.5 2023-12-05T09:54:02.981 DEBUG:teuthology.parallel:result is None 2023-12-05T09:54:03.027 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705693 got 38654705694 for osd.0 2023-12-05T09:54:03.027 DEBUG:teuthology.parallel:result is None 2023-12-05T09:54:03.710 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:03 smithi100 ceph-mon[107145]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:54:03.761 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:03.763+0000 7f5e4126c700 1 -- 172.21.15.100:0/2110770852 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e3c1035a0 msgr2=0x7f5e3c0fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:03.761 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:03.763+0000 7f5e4126c700 1 --2- 172.21.15.100:0/2110770852 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e3c1035a0 0x7f5e3c0fcc10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5e30004940 tx=0x7f5e30009e30 comp rx=0 tx=0).stop 2023-12-05T09:54:03.761 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:03.763+0000 7f5e4126c700 1 -- 172.21.15.100:0/2110770852 shutdown_connections 2023-12-05T09:54:03.761 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:03.763+0000 7f5e4126c700 1 --2- 172.21.15.100:0/2110770852 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e3c1035a0 0x7f5e3c0fcc10 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:03.761 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:03.763+0000 7f5e4126c700 1 --2- 172.21.15.100:0/2110770852 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e3c102c00 0x7f5e3c102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:03.761 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:03.763+0000 7f5e4126c700 1 -- 172.21.15.100:0/2110770852 >> 172.21.15.100:0/2110770852 conn(0x7f5e3c0f8790 msgr2=0x7f5e3c0faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:54:03.761 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:03.763+0000 7f5e4126c700 1 -- 172.21.15.100:0/2110770852 shutdown_connections 2023-12-05T09:54:03.761 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:03.763+0000 7f5e4126c700 1 -- 172.21.15.100:0/2110770852 wait complete. 2023-12-05T09:54:03.763 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:03.764+0000 7f5e4126c700 1 Processor -- start 2023-12-05T09:54:03.763 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:03.764+0000 7f5e4126c700 1 -- start start 2023-12-05T09:54:03.763 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:03.764+0000 7f5e4126c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e3c102c00 0x7f5e3c1157b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:03.763 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:03.764+0000 7f5e4126c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e3c1035a0 0x7f5e3c115cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:03.763 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:03.764+0000 7f5e4126c700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3c116340 con 0x7f5e3c1035a0 2023-12-05T09:54:03.763 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:03.764+0000 7f5e4126c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3c10f670 con 0x7f5e3c102c00 2023-12-05T09:54:03.763 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:03.765+0000 7f5e3a7fc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e3c1035a0 0x7f5e3c115cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:03.763 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:03.765+0000 7f5e3a7fc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e3c1035a0 0x7f5e3c115cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34408/0 (socket says 172.21.15.100:34408) 2023-12-05T09:54:03.763 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:03.765+0000 7f5e3a7fc700 1 -- 172.21.15.100:0/2516234212 learned_addr learned my addr 172.21.15.100:0/2516234212 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:54:03.764 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:03.765+0000 7f5e3affd700 1 --2- 172.21.15.100:0/2516234212 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e3c102c00 0x7f5e3c1157b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:03.764 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:03.765+0000 7f5e3a7fc700 1 -- 172.21.15.100:0/2516234212 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e3c102c00 msgr2=0x7f5e3c1157b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:03.764 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:03.765+0000 7f5e3a7fc700 1 --2- 172.21.15.100:0/2516234212 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e3c102c00 0x7f5e3c1157b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:03.764 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:03.765+0000 7f5e3a7fc700 1 -- 172.21.15.100:0/2516234212 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e30005040 con 0x7f5e3c1035a0 2023-12-05T09:54:03.764 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:03.765+0000 7f5e3a7fc700 1 --2- 172.21.15.100:0/2516234212 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e3c1035a0 0x7f5e3c115cf0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5e30009360 tx=0x7f5e30009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:54:03.764 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:03.765+0000 7f5e237fe700 1 -- 172.21.15.100:0/2516234212 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e3000e040 con 0x7f5e3c1035a0 2023-12-05T09:54:03.764 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:03.765+0000 7f5e237fe700 1 -- 172.21.15.100:0/2516234212 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5e30013420 con 0x7f5e3c1035a0 2023-12-05T09:54:03.764 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:03.765+0000 7f5e4126c700 1 -- 172.21.15.100:0/2516234212 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e3c10f8f0 con 0x7f5e3c1035a0 2023-12-05T09:54:03.764 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:03.765+0000 7f5e237fe700 1 -- 172.21.15.100:0/2516234212 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e3001c610 con 0x7f5e3c1035a0 2023-12-05T09:54:03.765 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:03.766+0000 7f5e4126c700 1 -- 172.21.15.100:0/2516234212 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e3c10fe30 con 0x7f5e3c1035a0 2023-12-05T09:54:03.765 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:03.767+0000 7f5e4126c700 1 -- 172.21.15.100:0/2516234212 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e3c0fc390 con 0x7f5e3c1035a0 2023-12-05T09:54:03.765 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:03.768+0000 7f5e237fe700 1 -- 172.21.15.100:0/2516234212 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f5e30013590 con 0x7f5e3c1035a0 2023-12-05T09:54:03.766 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:03.768+0000 7f5e237fe700 1 --2- 172.21.15.100:0/2516234212 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f5e24068f70 0x7f5e2406b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:03.766 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:03.768+0000 7f5e237fe700 1 -- 172.21.15.100:0/2516234212 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f5e30087ce0 con 0x7f5e3c1035a0 2023-12-05T09:54:03.766 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:03.769+0000 7f5e3affd700 1 --2- 172.21.15.100:0/2516234212 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f5e24068f70 0x7f5e2406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:03.767 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:03.769+0000 7f5e3affd700 1 --2- 172.21.15.100:0/2516234212 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f5e24068f70 0x7f5e2406b420 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c009fd0 tx=0x7f5e2c00b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:54:03.771 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:03.773+0000 7f5e237fe700 1 -- 172.21.15.100:0/2516234212 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f5e30057ee0 con 0x7f5e3c1035a0 2023-12-05T09:54:03.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:03 smithi150 ceph-mon[116142]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:54:03.972 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:03.975+0000 7f5e4126c700 1 -- 172.21.15.100:0/2516234212 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5e3c04bb80 con 0x7f5e3c1035a0 2023-12-05T09:54:03.973 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:03.975+0000 7f5e237fe700 1 -- 172.21.15.100:0/2516234212 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5e30057a70 con 0x7f5e3c1035a0 2023-12-05T09:54:03.973 INFO:teuthology.orchestra.run.smithi100.stdout:81604378646 2023-12-05T09:54:03.975 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:03.978+0000 7f5e4126c700 1 -- 172.21.15.100:0/2516234212 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f5e24068f70 msgr2=0x7f5e2406b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:03.975 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:03.978+0000 7f5e4126c700 1 --2- 172.21.15.100:0/2516234212 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f5e24068f70 0x7f5e2406b420 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c009fd0 tx=0x7f5e2c00b040 comp rx=0 tx=0).stop 2023-12-05T09:54:03.975 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:03.978+0000 7f5e4126c700 1 -- 172.21.15.100:0/2516234212 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e3c1035a0 msgr2=0x7f5e3c115cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:03.975 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:03.978+0000 7f5e4126c700 1 --2- 172.21.15.100:0/2516234212 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e3c1035a0 0x7f5e3c115cf0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5e30009360 tx=0x7f5e30009e30 comp rx=0 tx=0).stop 2023-12-05T09:54:03.976 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:03.978+0000 7f5e4126c700 1 -- 172.21.15.100:0/2516234212 shutdown_connections 2023-12-05T09:54:03.976 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:03.978+0000 7f5e4126c700 1 --2- 172.21.15.100:0/2516234212 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f5e24068f70 0x7f5e2406b420 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:03.976 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:03.978+0000 7f5e4126c700 1 --2- 172.21.15.100:0/2516234212 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e3c102c00 0x7f5e3c1157b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:03.976 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:03.978+0000 7f5e4126c700 1 --2- 172.21.15.100:0/2516234212 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e3c1035a0 0x7f5e3c115cf0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:03.976 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:03.978+0000 7f5e4126c700 1 -- 172.21.15.100:0/2516234212 >> 172.21.15.100:0/2516234212 conn(0x7f5e3c0f8790 msgr2=0x7f5e3c0fa0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:54:03.976 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:03.978+0000 7f5e4126c700 1 -- 172.21.15.100:0/2516234212 shutdown_connections 2023-12-05T09:54:03.976 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:03.978+0000 7f5e4126c700 1 -- 172.21.15.100:0/2516234212 wait complete. 2023-12-05T09:54:04.473 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378645 got 81604378646 for osd.2 2023-12-05T09:54:04.474 DEBUG:teuthology.parallel:result is None 2023-12-05T09:54:04.639 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:04.641+0000 7f9524b61700 1 -- 172.21.15.100:0/3033607204 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f952006ff60 msgr2=0x7f9520070330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:04.639 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:04.641+0000 7f9524b61700 1 --2- 172.21.15.100:0/3033607204 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f952006ff60 0x7f9520070330 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9510004940 tx=0x7f9510009e30 comp rx=0 tx=0).stop 2023-12-05T09:54:04.639 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:04.641+0000 7f9524b61700 1 -- 172.21.15.100:0/3033607204 shutdown_connections 2023-12-05T09:54:04.639 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:04.641+0000 7f9524b61700 1 --2- 172.21.15.100:0/3033607204 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9520070870 0x7f9520108f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:04.639 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:04.641+0000 7f9524b61700 1 --2- 172.21.15.100:0/3033607204 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f952006ff60 0x7f9520070330 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:04.639 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:04.641+0000 7f9524b61700 1 -- 172.21.15.100:0/3033607204 >> 172.21.15.100:0/3033607204 conn(0x7f95200f8790 msgr2=0x7f95200faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:54:04.639 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:04.641+0000 7f9524b61700 1 -- 172.21.15.100:0/3033607204 shutdown_connections 2023-12-05T09:54:04.639 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:04.641+0000 7f9524b61700 1 -- 172.21.15.100:0/3033607204 wait complete. 2023-12-05T09:54:04.640 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:04.642+0000 7f9524b61700 1 Processor -- start 2023-12-05T09:54:04.640 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:04.642+0000 7f9524b61700 1 -- start start 2023-12-05T09:54:04.640 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:04.643+0000 7f9524b61700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f952006ff60 0x7f9520115900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:04.641 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:04.643+0000 7f9524b61700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9520070870 0x7f9520115e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:04.641 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:04.643+0000 7f9524b61700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9520116490 con 0x7f9520070870 2023-12-05T09:54:04.641 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:04.643+0000 7f9524b61700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f952010f7c0 con 0x7f952006ff60 2023-12-05T09:54:04.641 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:04.643+0000 7f951dd9b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9520070870 0x7f9520115e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:04.641 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:04.643+0000 7f951dd9b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9520070870 0x7f9520115e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34418/0 (socket says 172.21.15.100:34418) 2023-12-05T09:54:04.641 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:04.643+0000 7f951dd9b700 1 -- 172.21.15.100:0/982503959 learned_addr learned my addr 172.21.15.100:0/982503959 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:54:04.641 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:04.643+0000 7f951e59c700 1 --2- 172.21.15.100:0/982503959 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f952006ff60 0x7f9520115900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:04.642 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:04.643+0000 7f951dd9b700 1 -- 172.21.15.100:0/982503959 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f952006ff60 msgr2=0x7f9520115900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:04.642 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:04.643+0000 7f951dd9b700 1 --2- 172.21.15.100:0/982503959 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f952006ff60 0x7f9520115900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:04.642 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:04.643+0000 7f951dd9b700 1 -- 172.21.15.100:0/982503959 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9510005040 con 0x7f9520070870 2023-12-05T09:54:04.642 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:04.643+0000 7f951dd9b700 1 --2- 172.21.15.100:0/982503959 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9520070870 0x7f9520115e40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f951400c8c0 tx=0x7f95140044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:54:04.642 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:04.644+0000 7f950effd700 1 -- 172.21.15.100:0/982503959 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f951400a760 con 0x7f9520070870 2023-12-05T09:54:04.642 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:04.644+0000 7f950effd700 1 -- 172.21.15.100:0/982503959 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f951400ad70 con 0x7f9520070870 2023-12-05T09:54:04.642 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:04.644+0000 7f9524b61700 1 -- 172.21.15.100:0/982503959 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f952010faa0 con 0x7f9520070870 2023-12-05T09:54:04.642 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:04.644+0000 7f950effd700 1 -- 172.21.15.100:0/982503959 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f95140113a0 con 0x7f9520070870 2023-12-05T09:54:04.642 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:04.644+0000 7f9524b61700 1 -- 172.21.15.100:0/982503959 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f952010ffe0 con 0x7f9520070870 2023-12-05T09:54:04.643 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:04.645+0000 7f9524b61700 1 -- 172.21.15.100:0/982503959 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9520106650 con 0x7f9520070870 2023-12-05T09:54:04.643 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:04.646+0000 7f950effd700 1 -- 172.21.15.100:0/982503959 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f9514012400 con 0x7f9520070870 2023-12-05T09:54:04.644 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:04.647+0000 7f950effd700 1 --2- 172.21.15.100:0/982503959 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f9508068f70 0x7f950806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:04.645 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:04.647+0000 7f950effd700 1 -- 172.21.15.100:0/982503959 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f9514086aa0 con 0x7f9520070870 2023-12-05T09:54:04.645 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:04.647+0000 7f951e59c700 1 --2- 172.21.15.100:0/982503959 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f9508068f70 0x7f950806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:04.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:04 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/2516234212' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-12-05T09:54:04.645 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:04.648+0000 7f951e59c700 1 --2- 172.21.15.100:0/982503959 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f9508068f70 0x7f950806b420 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f95100043d0 tx=0x7f9510009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:54:04.649 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:04.651+0000 7f950effd700 1 -- 172.21.15.100:0/982503959 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f9514056d20 con 0x7f9520070870 2023-12-05T09:54:04.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:04 smithi150 ceph-mon[116142]: from='client.? 172.21.15.100:0/2516234212' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-12-05T09:54:04.878 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:04.880+0000 7f9524b61700 1 -- 172.21.15.100:0/982503959 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9520110ee0 con 0x7f9520070870 2023-12-05T09:54:04.878 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:04.881+0000 7f950effd700 1 -- 172.21.15.100:0/982503959 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f95140568b0 con 0x7f9520070870 2023-12-05T09:54:04.879 INFO:teuthology.orchestra.run.smithi100.stdout:111669149714 2023-12-05T09:54:04.881 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:04.883+0000 7f9524b61700 1 -- 172.21.15.100:0/982503959 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f9508068f70 msgr2=0x7f950806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:04.881 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:04.883+0000 7f9524b61700 1 --2- 172.21.15.100:0/982503959 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f9508068f70 0x7f950806b420 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f95100043d0 tx=0x7f9510009e30 comp rx=0 tx=0).stop 2023-12-05T09:54:04.881 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:04.883+0000 7f9524b61700 1 -- 172.21.15.100:0/982503959 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9520070870 msgr2=0x7f9520115e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:04.881 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:04.883+0000 7f9524b61700 1 --2- 172.21.15.100:0/982503959 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9520070870 0x7f9520115e40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f951400c8c0 tx=0x7f95140044c0 comp rx=0 tx=0).stop 2023-12-05T09:54:04.881 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:04.883+0000 7f9524b61700 1 -- 172.21.15.100:0/982503959 shutdown_connections 2023-12-05T09:54:04.881 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:04.883+0000 7f9524b61700 1 --2- 172.21.15.100:0/982503959 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f9508068f70 0x7f950806b420 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:04.881 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:04.883+0000 7f9524b61700 1 --2- 172.21.15.100:0/982503959 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f952006ff60 0x7f9520115900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:04.881 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:04.883+0000 7f9524b61700 1 --2- 172.21.15.100:0/982503959 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9520070870 0x7f9520115e40 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:04.881 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:04.883+0000 7f9524b61700 1 -- 172.21.15.100:0/982503959 >> 172.21.15.100:0/982503959 conn(0x7f95200f8790 msgr2=0x7f95201037d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:54:04.881 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:04.883+0000 7f9524b61700 1 -- 172.21.15.100:0/982503959 shutdown_connections 2023-12-05T09:54:04.881 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:04.883+0000 7f9524b61700 1 -- 172.21.15.100:0/982503959 wait complete. 2023-12-05T09:54:05.314 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149712 got 111669149714 for osd.3 2023-12-05T09:54:05.314 DEBUG:teuthology.parallel:result is None 2023-12-05T09:54:05.504 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.506+0000 7f4e0f5a6700 1 -- 172.21.15.100:0/1056436911 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e081035a0 msgr2=0x7f4e080fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:05.504 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.506+0000 7f4e0f5a6700 1 --2- 172.21.15.100:0/1056436911 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e081035a0 0x7f4e080fcc10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4df8004940 tx=0x7f4df8009e30 comp rx=0 tx=0).stop 2023-12-05T09:54:05.505 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.507+0000 7f4e0f5a6700 1 -- 172.21.15.100:0/1056436911 shutdown_connections 2023-12-05T09:54:05.505 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.507+0000 7f4e0f5a6700 1 --2- 172.21.15.100:0/1056436911 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e081035a0 0x7f4e080fcc10 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:05.505 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.507+0000 7f4e0f5a6700 1 --2- 172.21.15.100:0/1056436911 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4e08102c00 0x7f4e08102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:05.505 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.507+0000 7f4e0f5a6700 1 -- 172.21.15.100:0/1056436911 >> 172.21.15.100:0/1056436911 conn(0x7f4e080f8790 msgr2=0x7f4e080faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:54:05.505 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.507+0000 7f4e0f5a6700 1 -- 172.21.15.100:0/1056436911 shutdown_connections 2023-12-05T09:54:05.505 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.507+0000 7f4e0f5a6700 1 -- 172.21.15.100:0/1056436911 wait complete. 2023-12-05T09:54:05.506 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.507+0000 7f4e0f5a6700 1 Processor -- start 2023-12-05T09:54:05.506 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.508+0000 7f4e0f5a6700 1 -- start start 2023-12-05T09:54:05.506 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.508+0000 7f4e0f5a6700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e08102c00 0x7f4e081158b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:05.506 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.508+0000 7f4e0f5a6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4e081035a0 0x7f4e08115df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:05.506 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.508+0000 7f4e0f5a6700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e08116440 con 0x7f4e08102c00 2023-12-05T09:54:05.507 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.508+0000 7f4e0f5a6700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0810f770 con 0x7f4e081035a0 2023-12-05T09:54:05.507 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.508+0000 7f4e0d342700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e08102c00 0x7f4e081158b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:05.507 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.508+0000 7f4e0d342700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e08102c00 0x7f4e081158b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34428/0 (socket says 172.21.15.100:34428) 2023-12-05T09:54:05.507 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.508+0000 7f4e0d342700 1 -- 172.21.15.100:0/436416146 learned_addr learned my addr 172.21.15.100:0/436416146 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:54:05.507 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.508+0000 7f4e0cb41700 1 --2- 172.21.15.100:0/436416146 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4e081035a0 0x7f4e08115df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:05.507 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.509+0000 7f4e0d342700 1 -- 172.21.15.100:0/436416146 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4e081035a0 msgr2=0x7f4e08115df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:05.507 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.509+0000 7f4e0d342700 1 --2- 172.21.15.100:0/436416146 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4e081035a0 0x7f4e08115df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:05.507 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.509+0000 7f4e0d342700 1 -- 172.21.15.100:0/436416146 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4df8005040 con 0x7f4e08102c00 2023-12-05T09:54:05.507 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.509+0000 7f4e0d342700 1 --2- 172.21.15.100:0/436416146 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e08102c00 0x7f4e081158b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4e04002a50 tx=0x7f4e040046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:54:05.508 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.509+0000 7f4dfdffb700 1 -- 172.21.15.100:0/436416146 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e04007cc0 con 0x7f4e08102c00 2023-12-05T09:54:05.508 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.509+0000 7f4dfdffb700 1 -- 172.21.15.100:0/436416146 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4e0400f040 con 0x7f4e08102c00 2023-12-05T09:54:05.508 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.509+0000 7f4e0f5a6700 1 -- 172.21.15.100:0/436416146 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e0810fa50 con 0x7f4e08102c00 2023-12-05T09:54:05.508 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.509+0000 7f4dfdffb700 1 -- 172.21.15.100:0/436416146 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e0400d9c0 con 0x7f4e08102c00 2023-12-05T09:54:05.508 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.509+0000 7f4e0f5a6700 1 -- 172.21.15.100:0/436416146 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e0810ff60 con 0x7f4e08102c00 2023-12-05T09:54:05.508 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.510+0000 7f4e0f5a6700 1 -- 172.21.15.100:0/436416146 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e080fc390 con 0x7f4e08102c00 2023-12-05T09:54:05.508 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.511+0000 7f4dfdffb700 1 -- 172.21.15.100:0/436416146 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f4e0400db60 con 0x7f4e08102c00 2023-12-05T09:54:05.510 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.512+0000 7f4dfdffb700 1 --2- 172.21.15.100:0/436416146 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f4df4068f70 0x7f4df406b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:05.510 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.513+0000 7f4dfdffb700 1 -- 172.21.15.100:0/436416146 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f4e04086030 con 0x7f4e08102c00 2023-12-05T09:54:05.510 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.513+0000 7f4e0cb41700 1 --2- 172.21.15.100:0/436416146 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f4df4068f70 0x7f4df406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:05.510 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.513+0000 7f4e0cb41700 1 --2- 172.21.15.100:0/436416146 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f4df4068f70 0x7f4df406b420 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4e08110aa0 tx=0x7f4df8009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:54:05.514 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.517+0000 7f4dfdffb700 1 -- 172.21.15.100:0/436416146 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f4e0404ca00 con 0x7f4e08102c00 2023-12-05T09:54:05.699 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:05 smithi150 ceph-mon[116142]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:54:05.699 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:05 smithi150 ceph-mon[116142]: from='client.? 172.21.15.100:0/982503959' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-12-05T09:54:05.722 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.725+0000 7f4e0f5a6700 1 -- 172.21.15.100:0/436416146 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4e08110e90 con 0x7f4e08102c00 2023-12-05T09:54:05.723 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.725+0000 7f4dfdffb700 1 -- 172.21.15.100:0/436416146 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4e040562d0 con 0x7f4e08102c00 2023-12-05T09:54:05.723 INFO:teuthology.orchestra.run.smithi100.stdout:60129542171 2023-12-05T09:54:05.725 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.727+0000 7f4e0f5a6700 1 -- 172.21.15.100:0/436416146 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f4df4068f70 msgr2=0x7f4df406b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:05.725 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.727+0000 7f4e0f5a6700 1 --2- 172.21.15.100:0/436416146 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f4df4068f70 0x7f4df406b420 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4e08110aa0 tx=0x7f4df8009e30 comp rx=0 tx=0).stop 2023-12-05T09:54:05.725 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.728+0000 7f4e0f5a6700 1 -- 172.21.15.100:0/436416146 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e08102c00 msgr2=0x7f4e081158b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:05.725 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.728+0000 7f4e0f5a6700 1 --2- 172.21.15.100:0/436416146 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e08102c00 0x7f4e081158b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4e04002a50 tx=0x7f4e040046b0 comp rx=0 tx=0).stop 2023-12-05T09:54:05.725 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.728+0000 7f4e0f5a6700 1 -- 172.21.15.100:0/436416146 shutdown_connections 2023-12-05T09:54:05.726 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.728+0000 7f4e0f5a6700 1 --2- 172.21.15.100:0/436416146 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f4df4068f70 0x7f4df406b420 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:05.726 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.728+0000 7f4e0f5a6700 1 --2- 172.21.15.100:0/436416146 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e08102c00 0x7f4e081158b0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:05.726 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.728+0000 7f4e0f5a6700 1 --2- 172.21.15.100:0/436416146 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4e081035a0 0x7f4e08115df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:05.726 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.728+0000 7f4e0f5a6700 1 -- 172.21.15.100:0/436416146 >> 172.21.15.100:0/436416146 conn(0x7f4e080f8790 msgr2=0x7f4e080fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:54:05.726 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.728+0000 7f4e0f5a6700 1 -- 172.21.15.100:0/436416146 shutdown_connections 2023-12-05T09:54:05.726 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.728+0000 7f4e0f5a6700 1 -- 172.21.15.100:0/436416146 wait complete. 2023-12-05T09:54:05.747 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:05 smithi100 ceph-mon[107145]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:54:05.747 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:05 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/982503959' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-12-05T09:54:05.806 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.808+0000 7f6ab647e700 1 -- 172.21.15.100:0/4213007916 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6ab006ffe0 msgr2=0x7f6ab00703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:05.807 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.808+0000 7f6ab647e700 1 --2- 172.21.15.100:0/4213007916 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6ab006ffe0 0x7f6ab00703b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6aa0004880 tx=0x7f6aa0009e30 comp rx=0 tx=0).stop 2023-12-05T09:54:05.807 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.809+0000 7f6ab647e700 1 -- 172.21.15.100:0/4213007916 shutdown_connections 2023-12-05T09:54:05.807 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.809+0000 7f6ab647e700 1 --2- 172.21.15.100:0/4213007916 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ab00708f0 0x7f6ab0108f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:05.807 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.809+0000 7f6ab647e700 1 --2- 172.21.15.100:0/4213007916 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6ab006ffe0 0x7f6ab00703b0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:05.807 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.809+0000 7f6ab647e700 1 -- 172.21.15.100:0/4213007916 >> 172.21.15.100:0/4213007916 conn(0x7f6ab00f8790 msgr2=0x7f6ab00faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:54:05.807 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.809+0000 7f6ab647e700 1 -- 172.21.15.100:0/4213007916 shutdown_connections 2023-12-05T09:54:05.807 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.809+0000 7f6ab647e700 1 -- 172.21.15.100:0/4213007916 wait complete. 2023-12-05T09:54:05.808 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.810+0000 7f6ab647e700 1 Processor -- start 2023-12-05T09:54:05.808 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.810+0000 7f6ab647e700 1 -- start start 2023-12-05T09:54:05.808 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.811+0000 7f6ab647e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6ab006ffe0 0x7f6ab01157e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:05.808 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.811+0000 7f6ab647e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ab00708f0 0x7f6ab0115d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:05.809 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.811+0000 7f6ab647e700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab0116370 con 0x7f6ab00708f0 2023-12-05T09:54:05.809 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.811+0000 7f6ab647e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab010f6a0 con 0x7f6ab006ffe0 2023-12-05T09:54:05.809 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.811+0000 7f6aaf7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ab00708f0 0x7f6ab0115d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:05.809 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.811+0000 7f6aaf7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ab00708f0 0x7f6ab0115d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34450/0 (socket says 172.21.15.100:34450) 2023-12-05T09:54:05.809 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.811+0000 7f6aaf7fe700 1 -- 172.21.15.100:0/1004478902 learned_addr learned my addr 172.21.15.100:0/1004478902 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:54:05.809 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.811+0000 7f6aaffff700 1 --2- 172.21.15.100:0/1004478902 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6ab006ffe0 0x7f6ab01157e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:05.810 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.811+0000 7f6aaf7fe700 1 -- 172.21.15.100:0/1004478902 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6ab006ffe0 msgr2=0x7f6ab01157e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:05.810 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.811+0000 7f6aaf7fe700 1 --2- 172.21.15.100:0/1004478902 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6ab006ffe0 0x7f6ab01157e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:05.810 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.811+0000 7f6aaf7fe700 1 -- 172.21.15.100:0/1004478902 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aa4005040 con 0x7f6ab00708f0 2023-12-05T09:54:05.810 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.812+0000 7f6aaf7fe700 1 --2- 172.21.15.100:0/1004478902 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ab00708f0 0x7f6ab0115d20 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6aa40096b0 tx=0x7f6aa4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:54:05.810 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.812+0000 7f6aacff9700 1 -- 172.21.15.100:0/1004478902 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6aa4017070 con 0x7f6ab00708f0 2023-12-05T09:54:05.810 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.812+0000 7f6aacff9700 1 -- 172.21.15.100:0/1004478902 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6aa400f040 con 0x7f6ab00708f0 2023-12-05T09:54:05.810 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.812+0000 7f6ab647e700 1 -- 172.21.15.100:0/1004478902 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6aa0005040 con 0x7f6ab00708f0 2023-12-05T09:54:05.810 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.812+0000 7f6aacff9700 1 -- 172.21.15.100:0/1004478902 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6aa4013b30 con 0x7f6ab00708f0 2023-12-05T09:54:05.810 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.812+0000 7f6ab647e700 1 -- 172.21.15.100:0/1004478902 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ab010fcd0 con 0x7f6ab00708f0 2023-12-05T09:54:05.811 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.814+0000 7f6ab647e700 1 -- 172.21.15.100:0/1004478902 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ab01065d0 con 0x7f6ab00708f0 2023-12-05T09:54:05.812 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.814+0000 7f6aacff9700 1 -- 172.21.15.100:0/1004478902 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f6aa400e840 con 0x7f6ab00708f0 2023-12-05T09:54:05.813 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.815+0000 7f6aacff9700 1 --2- 172.21.15.100:0/1004478902 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f6a98068f70 0x7f6a9806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:05.813 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.816+0000 7f6aacff9700 1 -- 172.21.15.100:0/1004478902 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f6aa4086860 con 0x7f6ab00708f0 2023-12-05T09:54:05.813 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.816+0000 7f6aaffff700 1 --2- 172.21.15.100:0/1004478902 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f6a98068f70 0x7f6a9806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:05.814 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.816+0000 7f6aaffff700 1 --2- 172.21.15.100:0/1004478902 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f6a98068f70 0x7f6a9806b420 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6aa0009fd0 tx=0x7f6aa0009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:54:05.817 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:05.819+0000 7f6aacff9700 1 -- 172.21.15.100:0/1004478902 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f6aa4056b00 con 0x7f6ab00708f0 2023-12-05T09:54:06.022 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:06.024+0000 7f6ab647e700 1 -- 172.21.15.100:0/1004478902 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f6ab0110e30 con 0x7f6ab00708f0 2023-12-05T09:54:06.023 INFO:teuthology.orchestra.run.smithi100.stdout:146028888077 2023-12-05T09:54:06.023 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:06.025+0000 7f6aacff9700 1 -- 172.21.15.100:0/1004478902 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6ab0110e30 con 0x7f6ab00708f0 2023-12-05T09:54:06.025 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:06.027+0000 7f6ab647e700 1 -- 172.21.15.100:0/1004478902 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f6a98068f70 msgr2=0x7f6a9806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:06.025 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:06.027+0000 7f6ab647e700 1 --2- 172.21.15.100:0/1004478902 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f6a98068f70 0x7f6a9806b420 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6aa0009fd0 tx=0x7f6aa0009e30 comp rx=0 tx=0).stop 2023-12-05T09:54:06.025 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:06.027+0000 7f6ab647e700 1 -- 172.21.15.100:0/1004478902 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ab00708f0 msgr2=0x7f6ab0115d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:06.025 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:06.027+0000 7f6ab647e700 1 --2- 172.21.15.100:0/1004478902 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ab00708f0 0x7f6ab0115d20 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6aa40096b0 tx=0x7f6aa4009e30 comp rx=0 tx=0).stop 2023-12-05T09:54:06.025 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:06.027+0000 7f6ab647e700 1 -- 172.21.15.100:0/1004478902 shutdown_connections 2023-12-05T09:54:06.025 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:06.027+0000 7f6ab647e700 1 --2- 172.21.15.100:0/1004478902 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f6a98068f70 0x7f6a9806b420 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:06.025 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:06.027+0000 7f6ab647e700 1 --2- 172.21.15.100:0/1004478902 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6ab006ffe0 0x7f6ab01157e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:06.025 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:06.027+0000 7f6ab647e700 1 --2- 172.21.15.100:0/1004478902 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ab00708f0 0x7f6ab0115d20 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:06.025 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:06.027+0000 7f6ab647e700 1 -- 172.21.15.100:0/1004478902 >> 172.21.15.100:0/1004478902 conn(0x7f6ab00f8790 msgr2=0x7f6ab0103750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:54:06.025 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:06.027+0000 7f6ab647e700 1 -- 172.21.15.100:0/1004478902 shutdown_connections 2023-12-05T09:54:06.025 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:06.027+0000 7f6ab647e700 1 -- 172.21.15.100:0/1004478902 wait complete. 2023-12-05T09:54:06.298 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542170 got 60129542171 for osd.1 2023-12-05T09:54:06.299 DEBUG:teuthology.parallel:result is None 2023-12-05T09:54:06.574 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888076 got 146028888077 for osd.4 2023-12-05T09:54:06.575 DEBUG:teuthology.parallel:result is None 2023-12-05T09:54:06.575 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2023-12-05T09:54:06.575 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- ceph pg dump --format=json 2023-12-05T09:54:06.639 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:06 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/436416146' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-12-05T09:54:06.639 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:06 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/1004478902' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-12-05T09:54:06.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:06 smithi150 ceph-mon[116142]: from='client.? 172.21.15.100:0/436416146' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-12-05T09:54:06.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:06 smithi150 ceph-mon[116142]: from='client.? 172.21.15.100:0/1004478902' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-12-05T09:54:06.998 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi100/config 2023-12-05T09:54:07.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:07 smithi150 ceph-mon[116142]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:54:07.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:07 smithi100 ceph-mon[107145]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:54:08.187 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:08.189+0000 7f0571850700 1 -- 172.21.15.100:0/1422746960 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f056c0708f0 msgr2=0x7f056c108d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:08.187 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:08.189+0000 7f0571850700 1 --2- 172.21.15.100:0/1422746960 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f056c0708f0 0x7f056c108d00 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0558004970 tx=0x7f0558009e30 comp rx=0 tx=0).stop 2023-12-05T09:54:08.187 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:08.189+0000 7f0571850700 1 -- 172.21.15.100:0/1422746960 shutdown_connections 2023-12-05T09:54:08.188 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:08.189+0000 7f0571850700 1 --2- 172.21.15.100:0/1422746960 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f056c0708f0 0x7f056c108d00 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:08.188 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:08.189+0000 7f0571850700 1 --2- 172.21.15.100:0/1422746960 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f056c06ffe0 0x7f056c0703b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:08.188 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:08.189+0000 7f0571850700 1 -- 172.21.15.100:0/1422746960 >> 172.21.15.100:0/1422746960 conn(0x7f056c0f8560 msgr2=0x7f056c0fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:54:08.188 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:08.189+0000 7f0571850700 1 -- 172.21.15.100:0/1422746960 shutdown_connections 2023-12-05T09:54:08.188 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:08.190+0000 7f0571850700 1 -- 172.21.15.100:0/1422746960 wait complete. 2023-12-05T09:54:08.190 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:08.190+0000 7f0571850700 1 Processor -- start 2023-12-05T09:54:08.190 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:08.190+0000 7f0571850700 1 -- start start 2023-12-05T09:54:08.190 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:08.191+0000 7f0571850700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f056c06ffe0 0x7f056c115620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:08.190 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:08.191+0000 7f0571850700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f056c0708f0 0x7f056c115ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:08.190 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:08.191+0000 7f0571850700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f056c10f4e0 con 0x7f056c06ffe0 2023-12-05T09:54:08.190 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:08.191+0000 7f0571850700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f056c10f650 con 0x7f056c0708f0 2023-12-05T09:54:08.190 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:08.191+0000 7f057084e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f056c06ffe0 0x7f056c115620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:08.190 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:08.191+0000 7f057084e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f056c06ffe0 0x7f056c115620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34470/0 (socket says 172.21.15.100:34470) 2023-12-05T09:54:08.190 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:08.191+0000 7f057084e700 1 -- 172.21.15.100:0/1195613315 learned_addr learned my addr 172.21.15.100:0/1195613315 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:54:08.190 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:08.191+0000 7f057084e700 1 -- 172.21.15.100:0/1195613315 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f056c0708f0 msgr2=0x7f056c115ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:08.190 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:08.191+0000 7f057084e700 1 --2- 172.21.15.100:0/1195613315 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f056c0708f0 0x7f056c115ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:08.190 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:08.191+0000 7f057084e700 1 -- 172.21.15.100:0/1195613315 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0558005040 con 0x7f056c06ffe0 2023-12-05T09:54:08.191 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:08.192+0000 7f057084e700 1 --2- 172.21.15.100:0/1195613315 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f056c06ffe0 0x7f056c115620 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f056000b790 tx=0x7f0560009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:54:08.191 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:08.192+0000 7f05697fa700 1 -- 172.21.15.100:0/1195613315 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f056000f770 con 0x7f056c06ffe0 2023-12-05T09:54:08.191 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:08.192+0000 7f0571850700 1 -- 172.21.15.100:0/1195613315 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f056c10f930 con 0x7f056c06ffe0 2023-12-05T09:54:08.191 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:08.192+0000 7f05697fa700 1 -- 172.21.15.100:0/1195613315 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f056000fd80 con 0x7f056c06ffe0 2023-12-05T09:54:08.191 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:08.192+0000 7f05697fa700 1 -- 172.21.15.100:0/1195613315 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f056000d310 con 0x7f056c06ffe0 2023-12-05T09:54:08.191 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:08.192+0000 7f0571850700 1 -- 172.21.15.100:0/1195613315 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f056c10fe70 con 0x7f056c06ffe0 2023-12-05T09:54:08.191 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:08.193+0000 7f0571850700 1 -- 172.21.15.100:0/1195613315 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f056c1063c0 con 0x7f056c06ffe0 2023-12-05T09:54:08.192 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:08.194+0000 7f05697fa700 1 -- 172.21.15.100:0/1195613315 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f0560010420 con 0x7f056c06ffe0 2023-12-05T09:54:08.193 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:08.195+0000 7f05697fa700 1 --2- 172.21.15.100:0/1195613315 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f055c068f70 0x7f055c06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:08.193 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:08.195+0000 7f05697fa700 1 -- 172.21.15.100:0/1195613315 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f0560086af0 con 0x7f056c06ffe0 2023-12-05T09:54:08.193 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:08.195+0000 7f056bfff700 1 --2- 172.21.15.100:0/1195613315 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f055c068f70 0x7f055c06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:08.193 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:08.196+0000 7f056bfff700 1 --2- 172.21.15.100:0/1195613315 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f055c068f70 0x7f055c06b420 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f055800b370 tx=0x7f0558009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:54:08.197 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:08.199+0000 7f05697fa700 1 -- 172.21.15.100:0/1195613315 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f0560056cf0 con 0x7f056c06ffe0 2023-12-05T09:54:08.383 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:08.385+0000 7f0571850700 1 -- 172.21.15.100:0/1195613315 --> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f056c04bb80 con 0x7f055c068f70 2023-12-05T09:54:08.384 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:08.387+0000 7f05697fa700 1 -- 172.21.15.100:0/1195613315 <== mgr.14210 v2:172.21.15.100:6800/1237547575 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+24486 (secure 0 0 0) 0x7f056c04bb80 con 0x7f055c068f70 2023-12-05T09:54:08.385 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:54:08.390 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:08.389+0000 7f0571850700 1 -- 172.21.15.100:0/1195613315 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f055c068f70 msgr2=0x7f055c06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:08.390 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:08.389+0000 7f0571850700 1 --2- 172.21.15.100:0/1195613315 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f055c068f70 0x7f055c06b420 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f055800b370 tx=0x7f0558009e30 comp rx=0 tx=0).stop 2023-12-05T09:54:08.390 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:08.389+0000 7f0571850700 1 -- 172.21.15.100:0/1195613315 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f056c06ffe0 msgr2=0x7f056c115620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:08.390 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:08.389+0000 7f0571850700 1 --2- 172.21.15.100:0/1195613315 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f056c06ffe0 0x7f056c115620 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f056000b790 tx=0x7f0560009250 comp rx=0 tx=0).stop 2023-12-05T09:54:08.390 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:08.389+0000 7f0571850700 1 -- 172.21.15.100:0/1195613315 shutdown_connections 2023-12-05T09:54:08.390 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:08.389+0000 7f0571850700 1 --2- 172.21.15.100:0/1195613315 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f055c068f70 0x7f055c06b420 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:08.391 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:08.389+0000 7f0571850700 1 --2- 172.21.15.100:0/1195613315 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f056c06ffe0 0x7f056c115620 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:08.391 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:08.389+0000 7f0571850700 1 --2- 172.21.15.100:0/1195613315 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f056c0708f0 0x7f056c115ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:08.391 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:08.389+0000 7f0571850700 1 -- 172.21.15.100:0/1195613315 >> 172.21.15.100:0/1195613315 conn(0x7f056c0f8560 msgr2=0x7f056c103540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:54:08.391 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:08.389+0000 7f0571850700 1 -- 172.21.15.100:0/1195613315 shutdown_connections 2023-12-05T09:54:08.391 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:08.389+0000 7f0571850700 1 -- 172.21.15.100:0/1195613315 wait complete. 2023-12-05T09:54:08.391 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2023-12-05T09:54:08.818 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":137,"stamp":"2023-12-05T09:54:08.103501+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1787604,"kb_used_data":3876,"kb_used_omap":0,"kb_used_meta":1783680,"kb_avail":560683308,"statfs":{"total":575970213888,"available":574139707392,"internally_reserved":0,"allocated":3969024,"data_stored":2606262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1826488320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002065"},"pg_stats":[{"pgid":"1.0","version":"23'117","reported_seq":190,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-05T09:53:33.600510+0000","last_change":"2023-12-05T09:53:11.139071+0000","last_active":"2023-12-05T09:53:33.600510+0000","last_peered":"2023-12-05T09:53:33.600510+0000","last_clean":"2023-12-05T09:53:33.600510+0000","last_became_active":"2023-12-05T09:53:11.138695+0000","last_became_peered":"2023-12-05T09:53:11.138695+0000","last_unstale":"2023-12-05T09:53:33.600510+0000","last_undegraded":"2023-12-05T09:53:33.600510+0000","last_fullsized":"2023-12-05T09:53:33.600510+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-05T09:52:26.650762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-05T09:52:26.650762+0000","last_clean_scrub_stamp":"2023-12-05T09:52:26.650762+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-06T19:32:24.293980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":39,"seq":167503724554,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297644,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447508,"statfs":{"total":95995035648,"available":95690248192,"internally_reserved":0,"allocated":364544,"data_stored":139193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]}]},{"osd":4,"up_from":34,"seq":146028888078,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297644,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447508,"statfs":{"total":95995035648,"available":95690248192,"internally_reserved":0,"allocated":364544,"data_stored":139193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]}]},{"osd":3,"up_from":26,"seq":111669149714,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298224,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446928,"statfs":{"total":95995035648,"available":95689654272,"internally_reserved":0,"allocated":958464,"data_stored":729561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 5 09:53:48 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":3.5739999999999998,"5min":3.5739999999999998,"15min":3.5739999999999998},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1,"5min":1,"15min":1},"last":0.39400000000000002}]},{"osd":1,"last update":"Tue Dec 5 09:53:48 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.46999999999999997}]},{"osd":2,"last update":"Tue Dec 5 09:53:48 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.58799999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]}]},{"osd":2,"up_from":19,"seq":81604378647,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297644,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447508,"statfs":{"total":95995035648,"available":95690248192,"internally_reserved":0,"allocated":364544,"data_stored":139193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 5 09:53:26 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.51800000000000002}]},{"osd":1,"last update":"Tue Dec 5 09:53:26 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":1.0129999999999999},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.88}]},{"osd":3,"last update":"Tue Dec 5 09:53:49 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.86099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96099999999999997}]}]},{"osd":0,"up_from":9,"seq":38654705695,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298224,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446928,"statfs":{"total":95995035648,"available":95689654272,"internally_reserved":0,"allocated":958464,"data_stored":729561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 5 09:53:04 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.59099999999999997}]},{"osd":2,"last update":"Tue Dec 5 09:53:27 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":1.0669999999999999},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.78400000000000003}]},{"osd":3,"last update":"Tue Dec 5 09:53:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.94699999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.046}]}]},{"osd":1,"up_from":14,"seq":60129542172,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298224,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446928,"statfs":{"total":95995035648,"available":95689654272,"internally_reserved":0,"allocated":958464,"data_stored":729561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 5 09:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.42399999999999999,"15min":0.41599999999999998},"min":{"1min":0.28599999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.42399999999999999,"15min":0.41799999999999998},"min":{"1min":0.33100000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.38600000000000001}]},{"osd":2,"last update":"Tue Dec 5 09:53:29 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.42799999999999999}]},{"osd":3,"last update":"Tue Dec 5 09:53:49 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.84699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-05T09:54:08.819 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- ceph pg dump --format=json 2023-12-05T09:54:09.242 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi100/config 2023-12-05T09:54:09.784 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:09 smithi100 ceph-mon[107145]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:54:09.785 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:09 smithi100 ceph-mon[107145]: from='client.14434 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-05T09:54:09.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:09 smithi150 ceph-mon[116142]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:54:09.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:09 smithi150 ceph-mon[116142]: from='client.14434 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-05T09:54:10.487 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:10.489+0000 7f17ad1c4700 1 -- 172.21.15.100:0/1495568239 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17a8102c00 msgr2=0x7f17a8102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:10.487 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:10.489+0000 7f17ad1c4700 1 --2- 172.21.15.100:0/1495568239 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17a8102c00 0x7f17a8102fd0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1798004940 tx=0x7f1798009e30 comp rx=0 tx=0).stop 2023-12-05T09:54:10.487 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:10.489+0000 7f17ad1c4700 1 -- 172.21.15.100:0/1495568239 shutdown_connections 2023-12-05T09:54:10.488 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:10.489+0000 7f17ad1c4700 1 --2- 172.21.15.100:0/1495568239 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17a81035a0 0x7f17a80fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:10.488 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:10.489+0000 7f17ad1c4700 1 --2- 172.21.15.100:0/1495568239 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17a8102c00 0x7f17a8102fd0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:10.488 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:10.489+0000 7f17ad1c4700 1 -- 172.21.15.100:0/1495568239 >> 172.21.15.100:0/1495568239 conn(0x7f17a80f8790 msgr2=0x7f17a80faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:54:10.488 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:10.489+0000 7f17ad1c4700 1 -- 172.21.15.100:0/1495568239 shutdown_connections 2023-12-05T09:54:10.488 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:10.490+0000 7f17ad1c4700 1 -- 172.21.15.100:0/1495568239 wait complete. 2023-12-05T09:54:10.489 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:10.490+0000 7f17ad1c4700 1 Processor -- start 2023-12-05T09:54:10.489 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:10.490+0000 7f17ad1c4700 1 -- start start 2023-12-05T09:54:10.489 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:10.491+0000 7f17ad1c4700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17a8102c00 0x7f17a8115840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:10.489 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:10.491+0000 7f17ad1c4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17a81035a0 0x7f17a8115d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:10.489 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:10.491+0000 7f17ad1c4700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a81163d0 con 0x7f17a8102c00 2023-12-05T09:54:10.489 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:10.491+0000 7f17ad1c4700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a810f700 con 0x7f17a81035a0 2023-12-05T09:54:10.489 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:10.491+0000 7f17a6d9d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17a8102c00 0x7f17a8115840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:10.489 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:10.491+0000 7f17a6d9d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17a8102c00 0x7f17a8115840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52966/0 (socket says 172.21.15.100:52966) 2023-12-05T09:54:10.489 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:10.491+0000 7f17a6d9d700 1 -- 172.21.15.100:0/3351409208 learned_addr learned my addr 172.21.15.100:0/3351409208 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:54:10.490 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:10.491+0000 7f17a659c700 1 --2- 172.21.15.100:0/3351409208 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17a81035a0 0x7f17a8115d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:10.490 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:10.491+0000 7f17a6d9d700 1 -- 172.21.15.100:0/3351409208 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17a81035a0 msgr2=0x7f17a8115d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:10.490 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:10.491+0000 7f17a6d9d700 1 --2- 172.21.15.100:0/3351409208 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17a81035a0 0x7f17a8115d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:10.490 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:10.491+0000 7f17a6d9d700 1 -- 172.21.15.100:0/3351409208 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1798005040 con 0x7f17a8102c00 2023-12-05T09:54:10.490 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:10.491+0000 7f17a659c700 1 --2- 172.21.15.100:0/3351409208 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17a81035a0 0x7f17a8115d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-05T09:54:10.490 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:10.492+0000 7f17a6d9d700 1 --2- 172.21.15.100:0/3351409208 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17a8102c00 0x7f17a8115840 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1798009fd0 tx=0x7f1798009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:54:10.490 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:10.492+0000 7f178f7fe700 1 -- 172.21.15.100:0/3351409208 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f179800e040 con 0x7f17a8102c00 2023-12-05T09:54:10.490 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:10.492+0000 7f178f7fe700 1 -- 172.21.15.100:0/3351409208 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f179800bc50 con 0x7f17a8102c00 2023-12-05T09:54:10.491 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:10.492+0000 7f178f7fe700 1 -- 172.21.15.100:0/3351409208 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1798013ea0 con 0x7f17a8102c00 2023-12-05T09:54:10.491 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:10.492+0000 7f17ad1c4700 1 -- 172.21.15.100:0/3351409208 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17a810f980 con 0x7f17a8102c00 2023-12-05T09:54:10.491 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:10.492+0000 7f17ad1c4700 1 -- 172.21.15.100:0/3351409208 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17a810fec0 con 0x7f17a8102c00 2023-12-05T09:54:10.491 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:10.493+0000 7f17ad1c4700 1 -- 172.21.15.100:0/3351409208 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17a80fc390 con 0x7f17a8102c00 2023-12-05T09:54:10.491 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:10.494+0000 7f178f7fe700 1 -- 172.21.15.100:0/3351409208 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f1798013420 con 0x7f17a8102c00 2023-12-05T09:54:10.492 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:10.495+0000 7f178f7fe700 1 --2- 172.21.15.100:0/3351409208 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f1790068f70 0x7f179006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:10.492 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:10.495+0000 7f178f7fe700 1 -- 172.21.15.100:0/3351409208 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f1798088070 con 0x7f17a8102c00 2023-12-05T09:54:10.492 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:10.495+0000 7f17a659c700 1 --2- 172.21.15.100:0/3351409208 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f1790068f70 0x7f179006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:10.493 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:10.495+0000 7f17a659c700 1 --2- 172.21.15.100:0/3351409208 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f1790068f70 0x7f179006b420 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f179c007fd0 tx=0x7f179c009040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:54:10.497 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:10.499+0000 7f178f7fe700 1 -- 172.21.15.100:0/3351409208 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f17980581f0 con 0x7f17a8102c00 2023-12-05T09:54:10.686 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:10.689+0000 7f17ad1c4700 1 -- 172.21.15.100:0/3351409208 --> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f17a8110e20 con 0x7f1790068f70 2023-12-05T09:54:10.687 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:10.690+0000 7f178f7fe700 1 -- 172.21.15.100:0/3351409208 <== mgr.14210 v2:172.21.15.100:6800/1237547575 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+24428 (secure 0 0 0) 0x7f17a8110e20 con 0x7f1790068f70 2023-12-05T09:54:10.688 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:54:10.690 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:10.693+0000 7f17ad1c4700 1 -- 172.21.15.100:0/3351409208 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f1790068f70 msgr2=0x7f179006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:10.690 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:10.693+0000 7f17ad1c4700 1 --2- 172.21.15.100:0/3351409208 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f1790068f70 0x7f179006b420 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f179c007fd0 tx=0x7f179c009040 comp rx=0 tx=0).stop 2023-12-05T09:54:10.690 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:10.693+0000 7f17ad1c4700 1 -- 172.21.15.100:0/3351409208 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17a8102c00 msgr2=0x7f17a8115840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:10.690 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:10.693+0000 7f17ad1c4700 1 --2- 172.21.15.100:0/3351409208 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17a8102c00 0x7f17a8115840 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1798009fd0 tx=0x7f1798009e30 comp rx=0 tx=0).stop 2023-12-05T09:54:10.690 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:10.693+0000 7f17ad1c4700 1 -- 172.21.15.100:0/3351409208 shutdown_connections 2023-12-05T09:54:10.691 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:10.693+0000 7f17ad1c4700 1 --2- 172.21.15.100:0/3351409208 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f1790068f70 0x7f179006b420 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:10.691 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:10.693+0000 7f17ad1c4700 1 --2- 172.21.15.100:0/3351409208 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17a8102c00 0x7f17a8115840 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:10.691 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:10.693+0000 7f17ad1c4700 1 --2- 172.21.15.100:0/3351409208 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17a81035a0 0x7f17a8115d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:10.691 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:10.693+0000 7f17ad1c4700 1 -- 172.21.15.100:0/3351409208 >> 172.21.15.100:0/3351409208 conn(0x7f17a80f8790 msgr2=0x7f17a80fa1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:54:10.691 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:10.693+0000 7f17ad1c4700 1 -- 172.21.15.100:0/3351409208 shutdown_connections 2023-12-05T09:54:10.691 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:10.693+0000 7f17ad1c4700 1 -- 172.21.15.100:0/3351409208 wait complete. 2023-12-05T09:54:10.691 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2023-12-05T09:54:11.233 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":138,"stamp":"2023-12-05T09:54:10.103812+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1787604,"kb_used_data":3876,"kb_used_omap":0,"kb_used_meta":1783680,"kb_avail":560683308,"statfs":{"total":575970213888,"available":574139707392,"internally_reserved":0,"allocated":3969024,"data_stored":2606262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1826488320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002022"},"pg_stats":[{"pgid":"1.0","version":"23'117","reported_seq":190,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-05T09:53:33.600510+0000","last_change":"2023-12-05T09:53:11.139071+0000","last_active":"2023-12-05T09:53:33.600510+0000","last_peered":"2023-12-05T09:53:33.600510+0000","last_clean":"2023-12-05T09:53:33.600510+0000","last_became_active":"2023-12-05T09:53:11.138695+0000","last_became_peered":"2023-12-05T09:53:11.138695+0000","last_unstale":"2023-12-05T09:53:33.600510+0000","last_undegraded":"2023-12-05T09:53:33.600510+0000","last_fullsized":"2023-12-05T09:53:33.600510+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-05T09:52:26.650762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-05T09:52:26.650762+0000","last_clean_scrub_stamp":"2023-12-05T09:52:26.650762+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-06T19:32:24.293980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":39,"seq":167503724555,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297644,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447508,"statfs":{"total":95995035648,"available":95690248192,"internally_reserved":0,"allocated":364544,"data_stored":139193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]}]},{"osd":4,"up_from":34,"seq":146028888078,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297644,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447508,"statfs":{"total":95995035648,"available":95690248192,"internally_reserved":0,"allocated":364544,"data_stored":139193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]}]},{"osd":3,"up_from":26,"seq":111669149715,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298224,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446928,"statfs":{"total":95995035648,"available":95689654272,"internally_reserved":0,"allocated":958464,"data_stored":729561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 5 09:53:48 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":3.5739999999999998,"5min":3.5739999999999998,"15min":3.5739999999999998},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1,"5min":1,"15min":1},"last":0.5}]},{"osd":1,"last update":"Tue Dec 5 09:53:48 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.55600000000000005}]},{"osd":2,"last update":"Tue Dec 5 09:53:48 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.59199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]}]},{"osd":2,"up_from":19,"seq":81604378647,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297644,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447508,"statfs":{"total":95995035648,"available":95690248192,"internally_reserved":0,"allocated":364544,"data_stored":139193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 5 09:53:26 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.51800000000000002}]},{"osd":1,"last update":"Tue Dec 5 09:53:26 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":1.0129999999999999},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.88}]},{"osd":3,"last update":"Tue Dec 5 09:53:49 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.86099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96099999999999997}]}]},{"osd":0,"up_from":9,"seq":38654705696,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298224,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446928,"statfs":{"total":95995035648,"available":95689654272,"internally_reserved":0,"allocated":958464,"data_stored":729561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 5 09:54:04 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.38900000000000001,"15min":0.38100000000000001},"min":{"1min":0.30399999999999999,"5min":0.245,"15min":0.245},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.41799999999999998,"15min":0.40699999999999997},"min":{"1min":0.34499999999999997,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.33500000000000002}]},{"osd":2,"last update":"Tue Dec 5 09:53:27 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.442},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.31900000000000001}]},{"osd":3,"last update":"Tue Dec 5 09:53:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.627}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542172,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298224,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446928,"statfs":{"total":95995035648,"available":95689654272,"internally_reserved":0,"allocated":958464,"data_stored":729561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 5 09:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.42399999999999999,"15min":0.41599999999999998},"min":{"1min":0.28599999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.42399999999999999,"15min":0.41799999999999998},"min":{"1min":0.33100000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.38600000000000001}]},{"osd":2,"last update":"Tue Dec 5 09:53:29 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.42799999999999999}]},{"osd":3,"last update":"Tue Dec 5 09:53:49 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.84699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-05T09:54:11.234 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2023-12-05T09:54:11.234 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-12-05T09:54:11.234 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2023-12-05T09:54:11.234 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- ceph health --format=json 2023-12-05T09:54:11.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:11 smithi100 ceph-mon[107145]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:54:11.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:11 smithi100 ceph-mon[107145]: from='client.14438 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-05T09:54:11.655 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi100/config 2023-12-05T09:54:11.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:11 smithi150 ceph-mon[116142]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:54:11.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:11 smithi150 ceph-mon[116142]: from='client.14438 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-05T09:54:12.801 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:12.803+0000 7fa6e46f0700 1 -- 172.21.15.100:0/1172798659 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6dc102c00 msgr2=0x7fa6dc102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:12.801 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:12.803+0000 7fa6e46f0700 1 --2- 172.21.15.100:0/1172798659 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6dc102c00 0x7fa6dc102fd0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa6d8004940 tx=0x7fa6d8009e30 comp rx=0 tx=0).stop 2023-12-05T09:54:12.801 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:12.803+0000 7fa6e46f0700 1 -- 172.21.15.100:0/1172798659 shutdown_connections 2023-12-05T09:54:12.801 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:12.803+0000 7fa6e46f0700 1 --2- 172.21.15.100:0/1172798659 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa6dc1035a0 0x7fa6dc0fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:12.801 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:12.803+0000 7fa6e46f0700 1 --2- 172.21.15.100:0/1172798659 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6dc102c00 0x7fa6dc102fd0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:12.801 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:12.803+0000 7fa6e46f0700 1 -- 172.21.15.100:0/1172798659 >> 172.21.15.100:0/1172798659 conn(0x7fa6dc0f8790 msgr2=0x7fa6dc0faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:54:12.801 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:12.803+0000 7fa6e46f0700 1 -- 172.21.15.100:0/1172798659 shutdown_connections 2023-12-05T09:54:12.801 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:12.803+0000 7fa6e46f0700 1 -- 172.21.15.100:0/1172798659 wait complete. 2023-12-05T09:54:12.803 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:12.804+0000 7fa6e46f0700 1 Processor -- start 2023-12-05T09:54:12.803 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:12.804+0000 7fa6e46f0700 1 -- start start 2023-12-05T09:54:12.803 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:12.804+0000 7fa6e46f0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa6dc102c00 0x7fa6dc06ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:12.803 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:12.804+0000 7fa6e46f0700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6dc1035a0 0x7fa6dc070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:12.803 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:12.804+0000 7fa6e46f0700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6dc070a80 con 0x7fa6dc1035a0 2023-12-05T09:54:12.803 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:12.804+0000 7fa6e46f0700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6dc070bf0 con 0x7fa6dc102c00 2023-12-05T09:54:12.803 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:12.805+0000 7fa6e1c8b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6dc1035a0 0x7fa6dc070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:12.803 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:12.805+0000 7fa6e1c8b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6dc1035a0 0x7fa6dc070480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52988/0 (socket says 172.21.15.100:52988) 2023-12-05T09:54:12.804 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:12.805+0000 7fa6e1c8b700 1 -- 172.21.15.100:0/2870717360 learned_addr learned my addr 172.21.15.100:0/2870717360 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:54:12.804 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:12.805+0000 7fa6e248c700 1 --2- 172.21.15.100:0/2870717360 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa6dc102c00 0x7fa6dc06ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:12.804 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:12.805+0000 7fa6e1c8b700 1 -- 172.21.15.100:0/2870717360 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa6dc102c00 msgr2=0x7fa6dc06ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:12.804 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:12.805+0000 7fa6e1c8b700 1 --2- 172.21.15.100:0/2870717360 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa6dc102c00 0x7fa6dc06ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:12.804 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:12.805+0000 7fa6e1c8b700 1 -- 172.21.15.100:0/2870717360 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6d8005040 con 0x7fa6dc1035a0 2023-12-05T09:54:12.804 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:12.805+0000 7fa6e1c8b700 1 --2- 172.21.15.100:0/2870717360 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6dc1035a0 0x7fa6dc070480 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc002a50 tx=0x7fa6cc004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:54:12.804 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:12.805+0000 7fa6d2ffd700 1 -- 172.21.15.100:0/2870717360 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6cc007cc0 con 0x7fa6dc1035a0 2023-12-05T09:54:12.804 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:12.805+0000 7fa6d2ffd700 1 -- 172.21.15.100:0/2870717360 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa6cc00f040 con 0x7fa6dc1035a0 2023-12-05T09:54:12.804 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:12.805+0000 7fa6e46f0700 1 -- 172.21.15.100:0/2870717360 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6dc119850 con 0x7fa6dc1035a0 2023-12-05T09:54:12.804 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:12.805+0000 7fa6d2ffd700 1 -- 172.21.15.100:0/2870717360 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6cc00d920 con 0x7fa6dc1035a0 2023-12-05T09:54:12.804 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:12.805+0000 7fa6e46f0700 1 -- 172.21.15.100:0/2870717360 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6dc119d30 con 0x7fa6dc1035a0 2023-12-05T09:54:12.805 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:12.807+0000 7fa6e46f0700 1 -- 172.21.15.100:0/2870717360 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6dc0fff10 con 0x7fa6dc1035a0 2023-12-05T09:54:12.805 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:12.807+0000 7fa6d2ffd700 1 -- 172.21.15.100:0/2870717360 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7fa6cc009680 con 0x7fa6dc1035a0 2023-12-05T09:54:12.805 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:12.808+0000 7fa6d2ffd700 1 --2- 172.21.15.100:0/2870717360 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fa6c8068f70 0x7fa6c806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:12.806 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:12.808+0000 7fa6d2ffd700 1 -- 172.21.15.100:0/2870717360 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fa6cc0867a0 con 0x7fa6dc1035a0 2023-12-05T09:54:12.806 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:12.809+0000 7fa6e248c700 1 --2- 172.21.15.100:0/2870717360 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fa6c8068f70 0x7fa6c806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:12.806 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:12.809+0000 7fa6e248c700 1 --2- 172.21.15.100:0/2870717360 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fa6c8068f70 0x7fa6c806b420 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa6d80043d0 tx=0x7fa6d8009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:54:12.810 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:12.813+0000 7fa6d2ffd700 1 -- 172.21.15.100:0/2870717360 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fa6cc052f10 con 0x7fa6dc1035a0 2023-12-05T09:54:13.046 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:13.048+0000 7fa6e46f0700 1 -- 172.21.15.100:0/2870717360 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fa6dc0fc390 con 0x7fa6dc1035a0 2023-12-05T09:54:13.046 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:13.048+0000 7fa6d2ffd700 1 -- 172.21.15.100:0/2870717360 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fa6cc056530 con 0x7fa6dc1035a0 2023-12-05T09:54:13.046 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:54:13.046 INFO:teuthology.orchestra.run.smithi100.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-12-05T09:54:13.048 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:13.050+0000 7fa6e46f0700 1 -- 172.21.15.100:0/2870717360 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fa6c8068f70 msgr2=0x7fa6c806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:13.048 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:13.051+0000 7fa6e46f0700 1 --2- 172.21.15.100:0/2870717360 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fa6c8068f70 0x7fa6c806b420 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa6d80043d0 tx=0x7fa6d8009e30 comp rx=0 tx=0).stop 2023-12-05T09:54:13.048 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:13.051+0000 7fa6e46f0700 1 -- 172.21.15.100:0/2870717360 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6dc1035a0 msgr2=0x7fa6dc070480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:13.049 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:13.051+0000 7fa6e46f0700 1 --2- 172.21.15.100:0/2870717360 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6dc1035a0 0x7fa6dc070480 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc002a50 tx=0x7fa6cc004600 comp rx=0 tx=0).stop 2023-12-05T09:54:13.049 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:13.051+0000 7fa6e46f0700 1 -- 172.21.15.100:0/2870717360 shutdown_connections 2023-12-05T09:54:13.049 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:13.051+0000 7fa6e46f0700 1 --2- 172.21.15.100:0/2870717360 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fa6c8068f70 0x7fa6c806b420 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:13.049 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:13.051+0000 7fa6e46f0700 1 --2- 172.21.15.100:0/2870717360 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa6dc102c00 0x7fa6dc06ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:13.049 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:13.051+0000 7fa6e46f0700 1 --2- 172.21.15.100:0/2870717360 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6dc1035a0 0x7fa6dc070480 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:13.049 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:13.051+0000 7fa6e46f0700 1 -- 172.21.15.100:0/2870717360 >> 172.21.15.100:0/2870717360 conn(0x7fa6dc0f8790 msgr2=0x7fa6dc0fa2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:54:13.049 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:13.051+0000 7fa6e46f0700 1 -- 172.21.15.100:0/2870717360 shutdown_connections 2023-12-05T09:54:13.049 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:13.051+0000 7fa6e46f0700 1 -- 172.21.15.100:0/2870717360 wait complete. 2023-12-05T09:54:13.474 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2023-12-05T09:54:13.474 INFO:tasks.cephadm:Setup complete, yielding 2023-12-05T09:54:13.475 INFO:teuthology.run_tasks:Running task print... 2023-12-05T09:54:13.483 INFO:teuthology.task.print:**** done end installing quincy cephadm ... 2023-12-05T09:54:13.484 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-05T09:54:13.508 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi100.front.sepia.ceph.com 2023-12-05T09:54:13.509 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2023-12-05T09:54:13.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:13 smithi150 ceph-mon[116142]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:54:13.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:13 smithi150 ceph-mon[116142]: from='client.? 172.21.15.100:0/2870717360' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-12-05T09:54:13.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:13 smithi100 ceph-mon[107145]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:54:13.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:13 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/2870717360' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-12-05T09:54:13.930 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi100/config 2023-12-05T09:54:15.074 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:15.076+0000 7faaea785700 1 -- 172.21.15.100:0/4243801885 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faae40fcbf0 msgr2=0x7faae40fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:15.074 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:15.076+0000 7faaea785700 1 --2- 172.21.15.100:0/4243801885 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faae40fcbf0 0x7faae40fd000 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7faad4004940 tx=0x7faad4009e30 comp rx=0 tx=0).stop 2023-12-05T09:54:15.074 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:15.076+0000 7faaea785700 1 -- 172.21.15.100:0/4243801885 shutdown_connections 2023-12-05T09:54:15.074 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:15.076+0000 7faaea785700 1 --2- 172.21.15.100:0/4243801885 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faae40fde00 0x7faae40fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:15.075 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:15.076+0000 7faaea785700 1 --2- 172.21.15.100:0/4243801885 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faae40fcbf0 0x7faae40fd000 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:15.075 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:15.076+0000 7faaea785700 1 -- 172.21.15.100:0/4243801885 >> 172.21.15.100:0/4243801885 conn(0x7faae40f82d0 msgr2=0x7faae40fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:54:15.075 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:15.076+0000 7faaea785700 1 -- 172.21.15.100:0/4243801885 shutdown_connections 2023-12-05T09:54:15.075 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:15.076+0000 7faaea785700 1 -- 172.21.15.100:0/4243801885 wait complete. 2023-12-05T09:54:15.075 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:15.076+0000 7faaea785700 1 Processor -- start 2023-12-05T09:54:15.075 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:15.077+0000 7faaea785700 1 -- start start 2023-12-05T09:54:15.075 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:15.077+0000 7faaea785700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faae40fcbf0 0x7faae4071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:15.075 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:15.077+0000 7faaea785700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faae40fde00 0x7faae406ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:15.075 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:15.077+0000 7faaea785700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae4070590 con 0x7faae40fcbf0 2023-12-05T09:54:15.075 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:15.077+0000 7faaea785700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae4070700 con 0x7faae40fde00 2023-12-05T09:54:15.077 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:15.077+0000 7faae3fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faae40fcbf0 0x7faae4071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:15.077 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:15.077+0000 7faae3fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faae40fcbf0 0x7faae4071b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52998/0 (socket says 172.21.15.100:52998) 2023-12-05T09:54:15.077 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:15.077+0000 7faae3fff700 1 -- 172.21.15.100:0/2820149647 learned_addr learned my addr 172.21.15.100:0/2820149647 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:54:15.077 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:15.077+0000 7faae37fe700 1 --2- 172.21.15.100:0/2820149647 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faae40fde00 0x7faae406ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:15.077 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:15.078+0000 7faae3fff700 1 -- 172.21.15.100:0/2820149647 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faae40fde00 msgr2=0x7faae406ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:15.077 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:15.078+0000 7faae3fff700 1 --2- 172.21.15.100:0/2820149647 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faae40fde00 0x7faae406ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:15.077 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:15.078+0000 7faae3fff700 1 -- 172.21.15.100:0/2820149647 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faad4005040 con 0x7faae40fcbf0 2023-12-05T09:54:15.077 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:15.078+0000 7faae3fff700 1 --2- 172.21.15.100:0/2820149647 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faae40fcbf0 0x7faae4071b10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7faad4000c00 tx=0x7faad4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:54:15.077 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:15.078+0000 7faae0ff9700 1 -- 172.21.15.100:0/2820149647 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faad400e040 con 0x7faae40fcbf0 2023-12-05T09:54:15.078 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:15.078+0000 7faae0ff9700 1 -- 172.21.15.100:0/2820149647 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7faad4013420 con 0x7faae40fcbf0 2023-12-05T09:54:15.078 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:15.078+0000 7faae0ff9700 1 -- 172.21.15.100:0/2820149647 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faad401c630 con 0x7faae40fcbf0 2023-12-05T09:54:15.078 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:15.078+0000 7faaea785700 1 -- 172.21.15.100:0/2820149647 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faae4070980 con 0x7faae40fcbf0 2023-12-05T09:54:15.078 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:15.078+0000 7faaea785700 1 -- 172.21.15.100:0/2820149647 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faae4115590 con 0x7faae40fcbf0 2023-12-05T09:54:15.078 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:15.079+0000 7faaea785700 1 -- 172.21.15.100:0/2820149647 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faae404bb80 con 0x7faae40fcbf0 2023-12-05T09:54:15.079 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:15.080+0000 7faae0ff9700 1 -- 172.21.15.100:0/2820149647 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7faad4013590 con 0x7faae40fcbf0 2023-12-05T09:54:15.079 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:15.081+0000 7faae0ff9700 1 --2- 172.21.15.100:0/2820149647 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7faacc068f70 0x7faacc06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:15.079 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:15.081+0000 7faae0ff9700 1 -- 172.21.15.100:0/2820149647 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7faad4087d00 con 0x7faae40fcbf0 2023-12-05T09:54:15.079 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:15.082+0000 7faae37fe700 1 --2- 172.21.15.100:0/2820149647 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7faacc068f70 0x7faacc06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:15.080 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:15.082+0000 7faae37fe700 1 --2- 172.21.15.100:0/2820149647 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7faacc068f70 0x7faacc06b420 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7faad8007fd0 tx=0x7faad8009040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:54:15.083 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:15.085+0000 7faae0ff9700 1 -- 172.21.15.100:0/2820149647 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7faad4057f80 con 0x7faae40fcbf0 2023-12-05T09:54:15.277 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:15.279+0000 7faaea785700 1 -- 172.21.15.100:0/2820149647 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7faae4105590 con 0x7faae40fcbf0 2023-12-05T09:54:15.281 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:15.284+0000 7faae0ff9700 1 -- 172.21.15.100:0/2820149647 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v20)=0 v20) v1 ==== 143+0+0 (secure 0 0 0) 0x7faad4013840 con 0x7faae40fcbf0 2023-12-05T09:54:15.285 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:15.287+0000 7faaea785700 1 -- 172.21.15.100:0/2820149647 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7faacc068f70 msgr2=0x7faacc06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:15.285 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:15.287+0000 7faaea785700 1 --2- 172.21.15.100:0/2820149647 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7faacc068f70 0x7faacc06b420 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7faad8007fd0 tx=0x7faad8009040 comp rx=0 tx=0).stop 2023-12-05T09:54:15.285 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:15.287+0000 7faaea785700 1 -- 172.21.15.100:0/2820149647 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faae40fcbf0 msgr2=0x7faae4071b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:15.285 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:15.287+0000 7faaea785700 1 --2- 172.21.15.100:0/2820149647 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faae40fcbf0 0x7faae4071b10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7faad4000c00 tx=0x7faad4009e30 comp rx=0 tx=0).stop 2023-12-05T09:54:15.285 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:15.287+0000 7faaea785700 1 -- 172.21.15.100:0/2820149647 shutdown_connections 2023-12-05T09:54:15.285 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:15.287+0000 7faaea785700 1 --2- 172.21.15.100:0/2820149647 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7faacc068f70 0x7faacc06b420 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:15.285 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:15.287+0000 7faaea785700 1 --2- 172.21.15.100:0/2820149647 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faae40fcbf0 0x7faae4071b10 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:15.285 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:15.287+0000 7faaea785700 1 --2- 172.21.15.100:0/2820149647 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faae40fde00 0x7faae406ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:15.285 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:15.287+0000 7faaea785700 1 -- 172.21.15.100:0/2820149647 >> 172.21.15.100:0/2820149647 conn(0x7faae40f82d0 msgr2=0x7faae4101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:54:15.285 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:15.287+0000 7faaea785700 1 -- 172.21.15.100:0/2820149647 shutdown_connections 2023-12-05T09:54:15.285 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:15.287+0000 7faaea785700 1 -- 172.21.15.100:0/2820149647 wait complete. 2023-12-05T09:54:15.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:15 smithi100 ceph-mon[107145]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:54:15.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:15 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:54:15.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:15 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/2820149647' entity='client.admin' 2023-12-05T09:54:15.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:15 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:54:15.717 INFO:teuthology.run_tasks:Running task print... 2023-12-05T09:54:15.726 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2023-12-05T09:54:15.727 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-05T09:54:15.744 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi100.front.sepia.ceph.com 2023-12-05T09:54:15.744 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- bash -c 'ceph orch status' 2023-12-05T09:54:15.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:15 smithi150 ceph-mon[116142]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:54:15.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:15 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:54:15.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:15 smithi150 ceph-mon[116142]: from='client.? 172.21.15.100:0/2820149647' entity='client.admin' 2023-12-05T09:54:15.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:15 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:54:16.210 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi100/config 2023-12-05T09:54:16.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:16 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:54:16.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:16 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:54:16.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:16 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:54:16.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:16 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:54:16.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:16 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:54:16.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:16 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:54:17.380 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:17.381+0000 7f587c65f700 1 -- 172.21.15.100:0/893387699 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58740fcbf0 msgr2=0x7f58740fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:17.380 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:17.381+0000 7f587c65f700 1 --2- 172.21.15.100:0/893387699 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58740fcbf0 0x7f58740fd000 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5870004940 tx=0x7f5870009e30 comp rx=0 tx=0).stop 2023-12-05T09:54:17.380 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:17.381+0000 7f587c65f700 1 -- 172.21.15.100:0/893387699 shutdown_connections 2023-12-05T09:54:17.380 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:17.381+0000 7f587c65f700 1 --2- 172.21.15.100:0/893387699 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58740fde00 0x7f58740fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:17.380 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:17.381+0000 7f587c65f700 1 --2- 172.21.15.100:0/893387699 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58740fcbf0 0x7f58740fd000 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:17.380 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:17.381+0000 7f587c65f700 1 -- 172.21.15.100:0/893387699 >> 172.21.15.100:0/893387699 conn(0x7f58740f82d0 msgr2=0x7f58740fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:54:17.380 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:17.381+0000 7f587c65f700 1 -- 172.21.15.100:0/893387699 shutdown_connections 2023-12-05T09:54:17.380 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:17.381+0000 7f587c65f700 1 -- 172.21.15.100:0/893387699 wait complete. 2023-12-05T09:54:17.380 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:17.382+0000 7f587c65f700 1 Processor -- start 2023-12-05T09:54:17.380 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:17.382+0000 7f587c65f700 1 -- start start 2023-12-05T09:54:17.382 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:17.383+0000 7f587c65f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58740fcbf0 0x7f587410f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:17.382 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:17.383+0000 7f587c65f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58740fde00 0x7f587410fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:17.382 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:17.383+0000 7f587c65f700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58741102a0 con 0x7f58740fcbf0 2023-12-05T09:54:17.382 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:17.383+0000 7f587c65f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5874110b40 con 0x7f58740fde00 2023-12-05T09:54:17.382 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:17.383+0000 7f587a3fb700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58740fcbf0 0x7f587410f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:17.383 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:17.383+0000 7f587a3fb700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58740fcbf0 0x7f587410f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53010/0 (socket says 172.21.15.100:53010) 2023-12-05T09:54:17.383 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:17.383+0000 7f587a3fb700 1 -- 172.21.15.100:0/2893791050 learned_addr learned my addr 172.21.15.100:0/2893791050 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:54:17.383 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:17.383+0000 7f5879bfa700 1 --2- 172.21.15.100:0/2893791050 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58740fde00 0x7f587410fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:17.383 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:17.383+0000 7f587a3fb700 1 -- 172.21.15.100:0/2893791050 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58740fde00 msgr2=0x7f587410fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:17.383 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:17.383+0000 7f587a3fb700 1 --2- 172.21.15.100:0/2893791050 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58740fde00 0x7f587410fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:17.383 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:17.383+0000 7f587a3fb700 1 -- 172.21.15.100:0/2893791050 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5870005040 con 0x7f58740fcbf0 2023-12-05T09:54:17.383 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:17.384+0000 7f587a3fb700 1 --2- 172.21.15.100:0/2893791050 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58740fcbf0 0x7f587410f760 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5870000c00 tx=0x7f5870009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:54:17.383 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:17.384+0000 7f586affd700 1 -- 172.21.15.100:0/2893791050 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f587000e040 con 0x7f58740fcbf0 2023-12-05T09:54:17.383 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:17.384+0000 7f586affd700 1 -- 172.21.15.100:0/2893791050 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f587000bc50 con 0x7f58740fcbf0 2023-12-05T09:54:17.383 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:17.384+0000 7f587c65f700 1 -- 172.21.15.100:0/2893791050 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5874110dc0 con 0x7f58740fcbf0 2023-12-05T09:54:17.383 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:17.384+0000 7f586affd700 1 -- 172.21.15.100:0/2893791050 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f587001c630 con 0x7f58740fcbf0 2023-12-05T09:54:17.383 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:17.384+0000 7f587c65f700 1 -- 172.21.15.100:0/2893791050 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5874111300 con 0x7f58740fcbf0 2023-12-05T09:54:17.384 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:17.385+0000 7f587c65f700 1 -- 172.21.15.100:0/2893791050 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5874101ea0 con 0x7f58740fcbf0 2023-12-05T09:54:17.384 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:17.386+0000 7f586affd700 1 -- 172.21.15.100:0/2893791050 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f5870013420 con 0x7f58740fcbf0 2023-12-05T09:54:17.384 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:17.387+0000 7f586affd700 1 --2- 172.21.15.100:0/2893791050 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f5860068f70 0x7f586006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:17.384 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:17.387+0000 7f586affd700 1 -- 172.21.15.100:0/2893791050 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f5870087d10 con 0x7f58740fcbf0 2023-12-05T09:54:17.385 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:17.387+0000 7f5879bfa700 1 --2- 172.21.15.100:0/2893791050 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f5860068f70 0x7f586006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:17.385 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:17.387+0000 7f5879bfa700 1 --2- 172.21.15.100:0/2893791050 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f5860068f70 0x7f586006b420 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5864004990 tx=0x7f5864009ee0 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:54:17.388 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:17.391+0000 7f586affd700 1 -- 172.21.15.100:0/2893791050 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f5870057fb0 con 0x7f58740fcbf0 2023-12-05T09:54:17.599 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:17.602+0000 7f587c65f700 1 -- 172.21.15.100:0/2893791050 --> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5874111570 con 0x7f5860068f70 2023-12-05T09:54:17.600 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:17.603+0000 7f586affd700 1 -- 172.21.15.100:0/2893791050 <== mgr.14210 v2:172.21.15.100:6800/1237547575 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f5874111570 con 0x7f5860068f70 2023-12-05T09:54:17.601 INFO:teuthology.orchestra.run.smithi100.stdout:Backend: cephadm 2023-12-05T09:54:17.601 INFO:teuthology.orchestra.run.smithi100.stdout:Available: Yes 2023-12-05T09:54:17.601 INFO:teuthology.orchestra.run.smithi100.stdout:Paused: No 2023-12-05T09:54:17.603 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:17.605+0000 7f587c65f700 1 -- 172.21.15.100:0/2893791050 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f5860068f70 msgr2=0x7f586006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:17.603 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:17.605+0000 7f587c65f700 1 --2- 172.21.15.100:0/2893791050 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f5860068f70 0x7f586006b420 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5864004990 tx=0x7f5864009ee0 comp rx=0 tx=0).stop 2023-12-05T09:54:17.603 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:17.605+0000 7f587c65f700 1 -- 172.21.15.100:0/2893791050 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58740fcbf0 msgr2=0x7f587410f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:17.603 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:17.605+0000 7f587c65f700 1 --2- 172.21.15.100:0/2893791050 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58740fcbf0 0x7f587410f760 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5870000c00 tx=0x7f5870009e30 comp rx=0 tx=0).stop 2023-12-05T09:54:17.603 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:17.605+0000 7f587c65f700 1 -- 172.21.15.100:0/2893791050 shutdown_connections 2023-12-05T09:54:17.603 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:17.605+0000 7f587c65f700 1 --2- 172.21.15.100:0/2893791050 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f5860068f70 0x7f586006b420 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:17.603 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:17.605+0000 7f587c65f700 1 --2- 172.21.15.100:0/2893791050 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58740fcbf0 0x7f587410f760 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:17.603 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:17.605+0000 7f587c65f700 1 --2- 172.21.15.100:0/2893791050 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58740fde00 0x7f587410fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:17.603 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:17.605+0000 7f587c65f700 1 -- 172.21.15.100:0/2893791050 >> 172.21.15.100:0/2893791050 conn(0x7f58740f82d0 msgr2=0x7f58740ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:54:17.604 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:17.605+0000 7f587c65f700 1 -- 172.21.15.100:0/2893791050 shutdown_connections 2023-12-05T09:54:17.604 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:17.606+0000 7f587c65f700 1 -- 172.21.15.100:0/2893791050 wait complete. 2023-12-05T09:54:17.781 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:17 smithi100 ceph-mon[107145]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:54:17.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:17 smithi150 ceph-mon[116142]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:54:17.995 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- bash -c 'ceph orch ps' 2023-12-05T09:54:18.419 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi100/config 2023-12-05T09:54:18.718 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:18 smithi100 ceph-mon[107145]: from='client.14450 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:54:18.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:18 smithi150 ceph-mon[116142]: from='client.14450 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:54:19.571 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:19.573+0000 7f055e29d700 1 -- 172.21.15.100:0/1731118656 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05580fcbf0 msgr2=0x7f05580fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:19.571 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:19.573+0000 7f055e29d700 1 --2- 172.21.15.100:0/1731118656 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05580fcbf0 0x7f05580fd000 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0548004940 tx=0x7f0548009e30 comp rx=0 tx=0).stop 2023-12-05T09:54:19.571 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:19.573+0000 7f055e29d700 1 -- 172.21.15.100:0/1731118656 shutdown_connections 2023-12-05T09:54:19.572 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:19.573+0000 7f055e29d700 1 --2- 172.21.15.100:0/1731118656 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05580fde00 0x7f05580fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:19.572 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:19.573+0000 7f055e29d700 1 --2- 172.21.15.100:0/1731118656 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05580fcbf0 0x7f05580fd000 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:19.572 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:19.573+0000 7f055e29d700 1 -- 172.21.15.100:0/1731118656 >> 172.21.15.100:0/1731118656 conn(0x7f05580f82d0 msgr2=0x7f05580fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:54:19.572 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:19.573+0000 7f055e29d700 1 -- 172.21.15.100:0/1731118656 shutdown_connections 2023-12-05T09:54:19.572 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:19.574+0000 7f055e29d700 1 -- 172.21.15.100:0/1731118656 wait complete. 2023-12-05T09:54:19.572 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:19.575+0000 7f055e29d700 1 Processor -- start 2023-12-05T09:54:19.572 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:19.575+0000 7f055e29d700 1 -- start start 2023-12-05T09:54:19.573 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:19.575+0000 7f055e29d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05580fcbf0 0x7f055810d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:19.573 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:19.575+0000 7f055e29d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05580fde00 0x7f055810da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:19.573 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:19.575+0000 7f055e29d700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055810e010 con 0x7f05580fde00 2023-12-05T09:54:19.573 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:19.575+0000 7f055e29d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055810e8b0 con 0x7f05580fcbf0 2023-12-05T09:54:19.573 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:19.576+0000 7f05577fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05580fde00 0x7f055810da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:19.574 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:19.576+0000 7f05577fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05580fde00 0x7f055810da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53024/0 (socket says 172.21.15.100:53024) 2023-12-05T09:54:19.574 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:19.576+0000 7f05577fe700 1 -- 172.21.15.100:0/625091601 learned_addr learned my addr 172.21.15.100:0/625091601 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:54:19.574 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:19.576+0000 7f0557fff700 1 --2- 172.21.15.100:0/625091601 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05580fcbf0 0x7f055810d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:19.574 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:19.576+0000 7f05577fe700 1 -- 172.21.15.100:0/625091601 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05580fcbf0 msgr2=0x7f055810d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:19.574 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:19.576+0000 7f05577fe700 1 --2- 172.21.15.100:0/625091601 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05580fcbf0 0x7f055810d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:19.574 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:19.576+0000 7f05577fe700 1 -- 172.21.15.100:0/625091601 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0548005040 con 0x7f05580fde00 2023-12-05T09:54:19.575 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:19.576+0000 7f05577fe700 1 --2- 172.21.15.100:0/625091601 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05580fde00 0x7f055810da10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f054c00eb40 tx=0x7f054c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:54:19.575 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:19.577+0000 7f0554ff9700 1 -- 172.21.15.100:0/625091601 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f054c007cc0 con 0x7f05580fde00 2023-12-05T09:54:19.575 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:19.577+0000 7f0554ff9700 1 -- 172.21.15.100:0/625091601 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f054c00f040 con 0x7f05580fde00 2023-12-05T09:54:19.575 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:19.577+0000 7f0554ff9700 1 -- 172.21.15.100:0/625091601 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f054c00c990 con 0x7f05580fde00 2023-12-05T09:54:19.575 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:19.577+0000 7f055e29d700 1 -- 172.21.15.100:0/625091601 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f055810eb30 con 0x7f05580fde00 2023-12-05T09:54:19.575 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:19.577+0000 7f055e29d700 1 -- 172.21.15.100:0/625091601 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f055810f070 con 0x7f05580fde00 2023-12-05T09:54:19.575 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:19.578+0000 7f055e29d700 1 -- 172.21.15.100:0/625091601 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f055804bb80 con 0x7f05580fde00 2023-12-05T09:54:19.576 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:19.579+0000 7f0554ff9700 1 -- 172.21.15.100:0/625091601 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f054c00caf0 con 0x7f05580fde00 2023-12-05T09:54:19.577 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:19.580+0000 7f0554ff9700 1 --2- 172.21.15.100:0/625091601 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f0540068f70 0x7f054006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:19.577 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:19.580+0000 7f0554ff9700 1 -- 172.21.15.100:0/625091601 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f054c086640 con 0x7f05580fde00 2023-12-05T09:54:19.578 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:19.580+0000 7f0557fff700 1 --2- 172.21.15.100:0/625091601 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f0540068f70 0x7f054006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:19.578 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:19.581+0000 7f0557fff700 1 --2- 172.21.15.100:0/625091601 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f0540068f70 0x7f054006b420 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f054800b0d0 tx=0x7f0548009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:54:19.581 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:19.584+0000 7f0554ff9700 1 -- 172.21.15.100:0/625091601 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f054c04da00 con 0x7f05580fde00 2023-12-05T09:54:19.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:19 smithi100 ceph-mon[107145]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:54:19.785 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:19.787+0000 7f055e29d700 1 -- 172.21.15.100:0/625091601 --> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f055810f510 con 0x7f0540068f70 2023-12-05T09:54:19.793 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:19.796+0000 7f0554ff9700 1 -- 172.21.15.100:0/625091601 <== mgr.14210 v2:172.21.15.100:6800/1237547575 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2682 (secure 0 0 0) 0x7f055810f510 con 0x7f0540068f70 2023-12-05T09:54:19.793 INFO:teuthology.orchestra.run.smithi100.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-05T09:54:19.794 INFO:teuthology.orchestra.run.smithi100.stdout:alertmanager.smithi100 smithi100 *:9093,9094 running (3m) 107s ago 4m 14.8M - 0.25.0 c8568f914cd2 836425c83df9 2023-12-05T09:54:19.794 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi100 smithi100 running (4m) 107s ago 4m 7822k - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 6379a3185d48 2023-12-05T09:54:19.794 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi150 smithi150 running (3m) 49s ago 3m 7826k - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 349d37092dbd 2023-12-05T09:54:19.794 INFO:teuthology.orchestra.run.smithi100.stdout:grafana.smithi100 smithi100 *:3000 running (2m) 107s ago 4m 78.0M - 9.4.7 2c41d148cca3 53cd204a480d 2023-12-05T09:54:19.794 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi100.ehmuhg smithi100 *:9283 running (5m) 107s ago 5m 492M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc a724d569b69c 2023-12-05T09:54:19.794 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi150.zkskag smithi150 *:8443,9283 running (3m) 49s ago 3m 441M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc e9131b921eac 2023-12-05T09:54:19.794 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi100 smithi100 running (5m) 107s ago 5m 57.1M 2048M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 8e091d6081cc 2023-12-05T09:54:19.794 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi150 smithi150 running (3m) 49s ago 3m 50.3M 2048M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 05fe70420b09 2023-12-05T09:54:19.794 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi100 smithi100 *:9100 running (4m) 107s ago 4m 8564k - 1.5.0 0da6a335fe13 14c9b3344a5a 2023-12-05T09:54:19.794 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi150 smithi150 *:9100 running (3m) 49s ago 3m 8812k - 1.5.0 0da6a335fe13 d3babc3b947c 2023-12-05T09:54:19.794 INFO:teuthology.orchestra.run.smithi100.stdout:osd.0 smithi100 running (2m) 107s ago 2m 45.5M 4349M 17.2.7-109-g1fd3ca3c e139fc5fd9fc c8e64a62cd47 2023-12-05T09:54:19.794 INFO:teuthology.orchestra.run.smithi100.stdout:osd.1 smithi100 running (2m) 107s ago 2m 44.4M 4349M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 0500895cdfc2 2023-12-05T09:54:19.794 INFO:teuthology.orchestra.run.smithi100.stdout:osd.2 smithi100 running (2m) 107s ago 2m 41.4M 4349M 17.2.7-109-g1fd3ca3c e139fc5fd9fc f145372c8ccc 2023-12-05T09:54:19.794 INFO:teuthology.orchestra.run.smithi100.stdout:osd.3 smithi150 running (98s) 49s ago 98s 44.5M 5373M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 78137d463d29 2023-12-05T09:54:19.795 INFO:teuthology.orchestra.run.smithi100.stdout:osd.4 smithi150 running (75s) 49s ago 75s 40.7M 5373M 17.2.7-109-g1fd3ca3c e139fc5fd9fc dfef9accd162 2023-12-05T09:54:19.795 INFO:teuthology.orchestra.run.smithi100.stdout:osd.5 smithi150 running (52s) 49s ago 52s 11.9M 5373M 17.2.7-109-g1fd3ca3c e139fc5fd9fc d9720b1eae0c 2023-12-05T09:54:19.795 INFO:teuthology.orchestra.run.smithi100.stdout:prometheus.smithi100 smithi100 *:9095 running (2m) 107s ago 3m 32.3M - 2.43.0 a07b618ecd1d 74a355bfd7ab 2023-12-05T09:54:19.795 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:19.798+0000 7f055e29d700 1 -- 172.21.15.100:0/625091601 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f0540068f70 msgr2=0x7f054006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:19.795 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:19.798+0000 7f055e29d700 1 --2- 172.21.15.100:0/625091601 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f0540068f70 0x7f054006b420 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f054800b0d0 tx=0x7f0548009e30 comp rx=0 tx=0).stop 2023-12-05T09:54:19.796 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:19.798+0000 7f055e29d700 1 -- 172.21.15.100:0/625091601 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05580fde00 msgr2=0x7f055810da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:19.796 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:19.798+0000 7f055e29d700 1 --2- 172.21.15.100:0/625091601 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05580fde00 0x7f055810da10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f054c00eb40 tx=0x7f054c00b040 comp rx=0 tx=0).stop 2023-12-05T09:54:19.796 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:19.798+0000 7f055e29d700 1 -- 172.21.15.100:0/625091601 shutdown_connections 2023-12-05T09:54:19.796 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:19.798+0000 7f055e29d700 1 --2- 172.21.15.100:0/625091601 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f0540068f70 0x7f054006b420 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:19.796 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:19.798+0000 7f055e29d700 1 --2- 172.21.15.100:0/625091601 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05580fcbf0 0x7f055810d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:19.796 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:19.798+0000 7f055e29d700 1 --2- 172.21.15.100:0/625091601 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05580fde00 0x7f055810da10 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:19.796 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:19.798+0000 7f055e29d700 1 -- 172.21.15.100:0/625091601 >> 172.21.15.100:0/625091601 conn(0x7f05580f82d0 msgr2=0x7f0558101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:54:19.796 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:19.798+0000 7f055e29d700 1 -- 172.21.15.100:0/625091601 shutdown_connections 2023-12-05T09:54:19.796 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:19.798+0000 7f055e29d700 1 -- 172.21.15.100:0/625091601 wait complete. 2023-12-05T09:54:19.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:19 smithi150 ceph-mon[116142]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:54:20.257 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- bash -c 'ceph orch ls' 2023-12-05T09:54:20.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:20 smithi100 ceph-mon[107145]: from='client.14454 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:54:20.678 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi100/config 2023-12-05T09:54:20.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:20 smithi150 ceph-mon[116142]: from='client.14454 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:54:21.734 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:21 smithi100 ceph-mon[107145]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:54:21.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:21 smithi150 ceph-mon[116142]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:54:21.912 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:21.914+0000 7fb77b408700 1 -- 172.21.15.100:0/941551267 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7740fde00 msgr2=0x7fb7740fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:21.912 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:21.914+0000 7fb77b408700 1 --2- 172.21.15.100:0/941551267 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7740fde00 0x7fb7740fe250 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb764004940 tx=0x7fb764009e30 comp rx=0 tx=0).stop 2023-12-05T09:54:21.912 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:21.914+0000 7fb77b408700 1 -- 172.21.15.100:0/941551267 shutdown_connections 2023-12-05T09:54:21.912 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:21.914+0000 7fb77b408700 1 --2- 172.21.15.100:0/941551267 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7740fde00 0x7fb7740fe250 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:21.913 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:21.914+0000 7fb77b408700 1 --2- 172.21.15.100:0/941551267 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7740fcbf0 0x7fb7740fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:21.913 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:21.914+0000 7fb77b408700 1 -- 172.21.15.100:0/941551267 >> 172.21.15.100:0/941551267 conn(0x7fb7740f82d0 msgr2=0x7fb7740fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:54:21.913 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:21.914+0000 7fb77b408700 1 -- 172.21.15.100:0/941551267 shutdown_connections 2023-12-05T09:54:21.913 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:21.914+0000 7fb77b408700 1 -- 172.21.15.100:0/941551267 wait complete. 2023-12-05T09:54:21.914 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:21.915+0000 7fb77b408700 1 Processor -- start 2023-12-05T09:54:21.914 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:21.916+0000 7fb77b408700 1 -- start start 2023-12-05T09:54:21.914 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:21.916+0000 7fb77b408700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7740fcbf0 0x7fb77410d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:21.914 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:21.916+0000 7fb77b408700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7740fde00 0x7fb77410da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:21.914 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:21.916+0000 7fb77b408700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb77410e020 con 0x7fb7740fde00 2023-12-05T09:54:21.914 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:21.916+0000 7fb77b408700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb77410e8c0 con 0x7fb7740fcbf0 2023-12-05T09:54:21.915 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:21.916+0000 7fb7789a3700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7740fde00 0x7fb77410da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:21.915 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:21.917+0000 7fb7789a3700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7740fde00 0x7fb77410da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44440/0 (socket says 172.21.15.100:44440) 2023-12-05T09:54:21.915 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:21.917+0000 7fb7789a3700 1 -- 172.21.15.100:0/2051348415 learned_addr learned my addr 172.21.15.100:0/2051348415 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:54:21.915 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:21.917+0000 7fb7791a4700 1 --2- 172.21.15.100:0/2051348415 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7740fcbf0 0x7fb77410d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:21.916 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:21.917+0000 7fb7789a3700 1 -- 172.21.15.100:0/2051348415 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7740fcbf0 msgr2=0x7fb77410d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:21.916 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:21.917+0000 7fb7789a3700 1 --2- 172.21.15.100:0/2051348415 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7740fcbf0 0x7fb77410d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:21.916 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:21.917+0000 7fb7789a3700 1 -- 172.21.15.100:0/2051348415 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb764005040 con 0x7fb7740fde00 2023-12-05T09:54:21.916 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:21.917+0000 7fb7789a3700 1 --2- 172.21.15.100:0/2051348415 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7740fde00 0x7fb77410da20 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb764008f90 tx=0x7fb764009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:54:21.916 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:21.917+0000 7fb769ffb700 1 -- 172.21.15.100:0/2051348415 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb764021070 con 0x7fb7740fde00 2023-12-05T09:54:21.916 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:21.917+0000 7fb769ffb700 1 -- 172.21.15.100:0/2051348415 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb76401c400 con 0x7fb7740fde00 2023-12-05T09:54:21.916 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:21.917+0000 7fb77b408700 1 -- 172.21.15.100:0/2051348415 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb77410eb40 con 0x7fb7740fde00 2023-12-05T09:54:21.916 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:21.917+0000 7fb769ffb700 1 -- 172.21.15.100:0/2051348415 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb76400e030 con 0x7fb7740fde00 2023-12-05T09:54:21.916 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:21.918+0000 7fb77b408700 1 -- 172.21.15.100:0/2051348415 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb77410f080 con 0x7fb7740fde00 2023-12-05T09:54:21.917 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:21.919+0000 7fb77b408700 1 -- 172.21.15.100:0/2051348415 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb77404bb80 con 0x7fb7740fde00 2023-12-05T09:54:21.917 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:21.920+0000 7fb769ffb700 1 -- 172.21.15.100:0/2051348415 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7fb76401ca00 con 0x7fb7740fde00 2023-12-05T09:54:21.918 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:21.920+0000 7fb769ffb700 1 --2- 172.21.15.100:0/2051348415 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fb760068f70 0x7fb76006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:21.918 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:21.920+0000 7fb769ffb700 1 -- 172.21.15.100:0/2051348415 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fb764087c50 con 0x7fb7740fde00 2023-12-05T09:54:21.918 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:21.921+0000 7fb7791a4700 1 --2- 172.21.15.100:0/2051348415 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fb760068f70 0x7fb76006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:21.918 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:21.921+0000 7fb7791a4700 1 --2- 172.21.15.100:0/2051348415 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fb760068f70 0x7fb76006b420 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb770009b80 tx=0x7fb77000b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:54:21.922 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:21.925+0000 7fb769ffb700 1 -- 172.21.15.100:0/2051348415 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fb764057f90 con 0x7fb7740fde00 2023-12-05T09:54:22.123 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:22.126+0000 7fb77b408700 1 -- 172.21.15.100:0/2051348415 --> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fb77410f4e0 con 0x7fb760068f70 2023-12-05T09:54:22.127 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:22.130+0000 7fb769ffb700 1 -- 172.21.15.100:0/2051348415 <== mgr.14210 v2:172.21.15.100:6800/1237547575 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1179 (secure 0 0 0) 0x7fb77410f4e0 con 0x7fb760068f70 2023-12-05T09:54:22.127 INFO:teuthology.orchestra.run.smithi100.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2023-12-05T09:54:22.128 INFO:teuthology.orchestra.run.smithi100.stdout:alertmanager ?:9093,9094 1/1 110s ago 5m count:1 2023-12-05T09:54:22.128 INFO:teuthology.orchestra.run.smithi100.stdout:crash 2/2 110s ago 5m * 2023-12-05T09:54:22.128 INFO:teuthology.orchestra.run.smithi100.stdout:grafana ?:3000 1/1 110s ago 5m count:1 2023-12-05T09:54:22.128 INFO:teuthology.orchestra.run.smithi100.stdout:mgr 2/2 110s ago 5m count:2 2023-12-05T09:54:22.128 INFO:teuthology.orchestra.run.smithi100.stdout:mon 2/2 110s ago 4m smithi100:172.21.15.100=smithi100;smithi150:172.21.15.150=smithi150;count:2 2023-12-05T09:54:22.128 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter ?:9100 2/2 110s ago 5m * 2023-12-05T09:54:22.128 INFO:teuthology.orchestra.run.smithi100.stdout:osd 6 110s ago - 2023-12-05T09:54:22.128 INFO:teuthology.orchestra.run.smithi100.stdout:prometheus ?:9095 1/1 110s ago 5m count:1 2023-12-05T09:54:22.130 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:22.133+0000 7fb77b408700 1 -- 172.21.15.100:0/2051348415 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fb760068f70 msgr2=0x7fb76006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:22.130 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:22.133+0000 7fb77b408700 1 --2- 172.21.15.100:0/2051348415 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fb760068f70 0x7fb76006b420 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb770009b80 tx=0x7fb77000b040 comp rx=0 tx=0).stop 2023-12-05T09:54:22.130 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:22.133+0000 7fb77b408700 1 -- 172.21.15.100:0/2051348415 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7740fde00 msgr2=0x7fb77410da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:22.130 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:22.133+0000 7fb77b408700 1 --2- 172.21.15.100:0/2051348415 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7740fde00 0x7fb77410da20 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb764008f90 tx=0x7fb764009e30 comp rx=0 tx=0).stop 2023-12-05T09:54:22.130 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:22.133+0000 7fb77b408700 1 -- 172.21.15.100:0/2051348415 shutdown_connections 2023-12-05T09:54:22.130 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:22.133+0000 7fb77b408700 1 --2- 172.21.15.100:0/2051348415 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fb760068f70 0x7fb76006b420 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:22.130 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:22.133+0000 7fb77b408700 1 --2- 172.21.15.100:0/2051348415 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7740fcbf0 0x7fb77410d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:22.131 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:22.133+0000 7fb77b408700 1 --2- 172.21.15.100:0/2051348415 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7740fde00 0x7fb77410da20 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:22.131 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:22.133+0000 7fb77b408700 1 -- 172.21.15.100:0/2051348415 >> 172.21.15.100:0/2051348415 conn(0x7fb7740f82d0 msgr2=0x7fb774101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:54:22.131 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:22.133+0000 7fb77b408700 1 -- 172.21.15.100:0/2051348415 shutdown_connections 2023-12-05T09:54:22.131 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:22.133+0000 7fb77b408700 1 -- 172.21.15.100:0/2051348415 wait complete. 2023-12-05T09:54:22.501 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- bash -c 'ceph orch host ls' 2023-12-05T09:54:22.921 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi100/config 2023-12-05T09:54:23.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:23 smithi150 ceph-mon[116142]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:54:23.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:23 smithi150 ceph-mon[116142]: from='client.14458 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:54:23.892 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:23 smithi100 ceph-mon[107145]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:54:23.892 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:23 smithi100 ceph-mon[107145]: from='client.14458 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:54:24.111 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:24.114+0000 7f52629d4700 1 -- 172.21.15.100:0/2084428613 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f525c0fcbf0 msgr2=0x7f525c0fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:24.111 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:24.114+0000 7f52629d4700 1 --2- 172.21.15.100:0/2084428613 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f525c0fcbf0 0x7f525c0fd000 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f524c004940 tx=0x7f524c009e30 comp rx=0 tx=0).stop 2023-12-05T09:54:24.112 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:24.114+0000 7f52629d4700 1 -- 172.21.15.100:0/2084428613 shutdown_connections 2023-12-05T09:54:24.112 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:24.114+0000 7f52629d4700 1 --2- 172.21.15.100:0/2084428613 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f525c0fde00 0x7f525c0fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:24.112 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:24.114+0000 7f52629d4700 1 --2- 172.21.15.100:0/2084428613 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f525c0fcbf0 0x7f525c0fd000 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:24.112 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:24.114+0000 7f52629d4700 1 -- 172.21.15.100:0/2084428613 >> 172.21.15.100:0/2084428613 conn(0x7f525c0f82d0 msgr2=0x7f525c0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:54:24.112 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:24.114+0000 7f52629d4700 1 -- 172.21.15.100:0/2084428613 shutdown_connections 2023-12-05T09:54:24.112 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:24.115+0000 7f52629d4700 1 -- 172.21.15.100:0/2084428613 wait complete. 2023-12-05T09:54:24.114 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:24.115+0000 7f52629d4700 1 Processor -- start 2023-12-05T09:54:24.115 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:24.115+0000 7f52629d4700 1 -- start start 2023-12-05T09:54:24.115 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:24.116+0000 7f52629d4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f525c0fcbf0 0x7f525c10f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:24.115 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:24.116+0000 7f52629d4700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f525c0fde00 0x7f525c10fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:24.115 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:24.116+0000 7f52629d4700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f525c1102a0 con 0x7f525c0fde00 2023-12-05T09:54:24.115 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:24.116+0000 7f52629d4700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f525c110b40 con 0x7f525c0fcbf0 2023-12-05T09:54:24.116 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:24.116+0000 7f525b7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f525c0fde00 0x7f525c10fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:24.116 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:24.116+0000 7f525b7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f525c0fde00 0x7f525c10fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44456/0 (socket says 172.21.15.100:44456) 2023-12-05T09:54:24.116 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:24.116+0000 7f525b7fe700 1 -- 172.21.15.100:0/825345394 learned_addr learned my addr 172.21.15.100:0/825345394 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:54:24.116 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:24.116+0000 7f525bfff700 1 --2- 172.21.15.100:0/825345394 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f525c0fcbf0 0x7f525c10f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:24.116 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:24.116+0000 7f525b7fe700 1 -- 172.21.15.100:0/825345394 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f525c0fcbf0 msgr2=0x7f525c10f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:24.116 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:24.116+0000 7f525b7fe700 1 --2- 172.21.15.100:0/825345394 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f525c0fcbf0 0x7f525c10f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:24.116 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:24.116+0000 7f525b7fe700 1 -- 172.21.15.100:0/825345394 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f524c005040 con 0x7f525c0fde00 2023-12-05T09:54:24.116 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:24.116+0000 7f525bfff700 1 --2- 172.21.15.100:0/825345394 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f525c0fcbf0 0x7f525c10f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-05T09:54:24.117 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:24.117+0000 7f525b7fe700 1 --2- 172.21.15.100:0/825345394 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f525c0fde00 0x7f525c10fca0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f525000c8c0 tx=0x7f52500044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:54:24.117 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:24.117+0000 7f5258ff9700 1 -- 172.21.15.100:0/825345394 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f525000a980 con 0x7f525c0fde00 2023-12-05T09:54:24.117 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:24.117+0000 7f5258ff9700 1 -- 172.21.15.100:0/825345394 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f525000ce60 con 0x7f525c0fde00 2023-12-05T09:54:24.117 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:24.117+0000 7f52629d4700 1 -- 172.21.15.100:0/825345394 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f525c110e20 con 0x7f525c0fde00 2023-12-05T09:54:24.117 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:24.117+0000 7f5258ff9700 1 -- 172.21.15.100:0/825345394 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52500113a0 con 0x7f525c0fde00 2023-12-05T09:54:24.117 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:24.117+0000 7f52629d4700 1 -- 172.21.15.100:0/825345394 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f525c111360 con 0x7f525c0fde00 2023-12-05T09:54:24.118 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:24.119+0000 7f52629d4700 1 -- 172.21.15.100:0/825345394 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f525c101ea0 con 0x7f525c0fde00 2023-12-05T09:54:24.119 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:24.120+0000 7f5258ff9700 1 -- 172.21.15.100:0/825345394 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f5250012400 con 0x7f525c0fde00 2023-12-05T09:54:24.119 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:24.121+0000 7f5258ff9700 1 --2- 172.21.15.100:0/825345394 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f5244068f70 0x7f524406b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:24.119 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:24.121+0000 7f5258ff9700 1 -- 172.21.15.100:0/825345394 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f5250086c50 con 0x7f525c0fde00 2023-12-05T09:54:24.119 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:24.121+0000 7f525bfff700 1 --2- 172.21.15.100:0/825345394 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f5244068f70 0x7f524406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:24.119 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:24.122+0000 7f525bfff700 1 --2- 172.21.15.100:0/825345394 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f5244068f70 0x7f524406b420 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f524c004f90 tx=0x7f524c009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:54:24.121 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:24.125+0000 7f5258ff9700 1 -- 172.21.15.100:0/825345394 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f5250056e50 con 0x7f525c0fde00 2023-12-05T09:54:24.320 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:24.324+0000 7f52629d4700 1 -- 172.21.15.100:0/825345394 --> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f525c111680 con 0x7f5244068f70 2023-12-05T09:54:24.321 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:24.325+0000 7f5258ff9700 1 -- 172.21.15.100:0/825345394 <== mgr.14210 v2:172.21.15.100:6800/1237547575 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+148 (secure 0 0 0) 0x7f525c111680 con 0x7f5244068f70 2023-12-05T09:54:24.322 INFO:teuthology.orchestra.run.smithi100.stdout:HOST ADDR LABELS STATUS 2023-12-05T09:54:24.322 INFO:teuthology.orchestra.run.smithi100.stdout:smithi100 172.21.15.100 2023-12-05T09:54:24.322 INFO:teuthology.orchestra.run.smithi100.stdout:smithi150 172.21.15.150 2023-12-05T09:54:24.322 INFO:teuthology.orchestra.run.smithi100.stdout:2 hosts in cluster 2023-12-05T09:54:24.324 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:24.327+0000 7f52629d4700 1 -- 172.21.15.100:0/825345394 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f5244068f70 msgr2=0x7f524406b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:24.324 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:24.327+0000 7f52629d4700 1 --2- 172.21.15.100:0/825345394 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f5244068f70 0x7f524406b420 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f524c004f90 tx=0x7f524c009e30 comp rx=0 tx=0).stop 2023-12-05T09:54:24.325 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:24.327+0000 7f52629d4700 1 -- 172.21.15.100:0/825345394 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f525c0fde00 msgr2=0x7f525c10fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:24.325 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:24.327+0000 7f52629d4700 1 --2- 172.21.15.100:0/825345394 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f525c0fde00 0x7f525c10fca0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f525000c8c0 tx=0x7f52500044c0 comp rx=0 tx=0).stop 2023-12-05T09:54:24.325 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:24.328+0000 7f52629d4700 1 -- 172.21.15.100:0/825345394 shutdown_connections 2023-12-05T09:54:24.325 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:24.328+0000 7f52629d4700 1 --2- 172.21.15.100:0/825345394 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f5244068f70 0x7f524406b420 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:24.325 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:24.328+0000 7f52629d4700 1 --2- 172.21.15.100:0/825345394 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f525c0fcbf0 0x7f525c10f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:24.325 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:24.328+0000 7f52629d4700 1 --2- 172.21.15.100:0/825345394 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f525c0fde00 0x7f525c10fca0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:24.325 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:24.328+0000 7f52629d4700 1 -- 172.21.15.100:0/825345394 >> 172.21.15.100:0/825345394 conn(0x7f525c0f82d0 msgr2=0x7f525c0ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:54:24.325 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:24.328+0000 7f52629d4700 1 -- 172.21.15.100:0/825345394 shutdown_connections 2023-12-05T09:54:24.325 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:24.328+0000 7f52629d4700 1 -- 172.21.15.100:0/825345394 wait complete. 2023-12-05T09:54:24.782 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- bash -c 'ceph orch device ls' 2023-12-05T09:54:25.204 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi100/config 2023-12-05T09:54:25.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:25 smithi100 ceph-mon[107145]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:54:25.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:25 smithi100 ceph-mon[107145]: from='client.14462 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:54:25.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:25 smithi150 ceph-mon[116142]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:54:25.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:25 smithi150 ceph-mon[116142]: from='client.14462 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:54:26.362 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:26.364+0000 7f31f105a700 1 -- 172.21.15.100:0/4133934189 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31ec0fdc10 msgr2=0x7f31ec0fe060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:26.362 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:26.364+0000 7f31f105a700 1 --2- 172.21.15.100:0/4133934189 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31ec0fdc10 0x7f31ec0fe060 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f31e0004940 tx=0x7f31e0009e30 comp rx=0 tx=0).stop 2023-12-05T09:54:26.362 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:26.364+0000 7f31f105a700 1 -- 172.21.15.100:0/4133934189 shutdown_connections 2023-12-05T09:54:26.363 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:26.364+0000 7f31f105a700 1 --2- 172.21.15.100:0/4133934189 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31ec0fdc10 0x7f31ec0fe060 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:26.363 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:26.364+0000 7f31f105a700 1 --2- 172.21.15.100:0/4133934189 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31ec0fca00 0x7f31ec0fce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:26.363 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:26.364+0000 7f31f105a700 1 -- 172.21.15.100:0/4133934189 >> 172.21.15.100:0/4133934189 conn(0x7f31ec0f80e0 msgr2=0x7f31ec0fa4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:54:26.363 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:26.364+0000 7f31f105a700 1 -- 172.21.15.100:0/4133934189 shutdown_connections 2023-12-05T09:54:26.363 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:26.364+0000 7f31f105a700 1 -- 172.21.15.100:0/4133934189 wait complete. 2023-12-05T09:54:26.363 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:26.365+0000 7f31f105a700 1 Processor -- start 2023-12-05T09:54:26.363 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:26.365+0000 7f31f105a700 1 -- start start 2023-12-05T09:54:26.364 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:26.365+0000 7f31f105a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31ec0fca00 0x7f31ec10d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:26.364 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:26.365+0000 7f31f105a700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31ec0fdc10 0x7f31ec10d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:26.365 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:26.365+0000 7f31f105a700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31ec10de40 con 0x7f31ec0fdc10 2023-12-05T09:54:26.365 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:26.365+0000 7f31f105a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31ec10e6e0 con 0x7f31ec0fca00 2023-12-05T09:54:26.365 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:26.366+0000 7f31eb7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31ec0fdc10 0x7f31ec10d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:26.365 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:26.366+0000 7f31eb7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31ec0fdc10 0x7f31ec10d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44474/0 (socket says 172.21.15.100:44474) 2023-12-05T09:54:26.365 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:26.366+0000 7f31eb7fe700 1 -- 172.21.15.100:0/1442633805 learned_addr learned my addr 172.21.15.100:0/1442633805 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:54:26.365 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:26.366+0000 7f31ebfff700 1 --2- 172.21.15.100:0/1442633805 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31ec0fca00 0x7f31ec10d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:26.365 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:26.366+0000 7f31eb7fe700 1 -- 172.21.15.100:0/1442633805 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31ec0fca00 msgr2=0x7f31ec10d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:26.365 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:26.366+0000 7f31eb7fe700 1 --2- 172.21.15.100:0/1442633805 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31ec0fca00 0x7f31ec10d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:26.365 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:26.366+0000 7f31eb7fe700 1 -- 172.21.15.100:0/1442633805 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e0005040 con 0x7f31ec0fdc10 2023-12-05T09:54:26.365 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:26.366+0000 7f31eb7fe700 1 --2- 172.21.15.100:0/1442633805 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31ec0fdc10 0x7f31ec10d840 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f31e0009380 tx=0x7f31e0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:54:26.365 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:26.366+0000 7f31e8ff9700 1 -- 172.21.15.100:0/1442633805 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31e000e040 con 0x7f31ec0fdc10 2023-12-05T09:54:26.365 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:26.366+0000 7f31e8ff9700 1 -- 172.21.15.100:0/1442633805 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f31e000bd20 con 0x7f31ec0fdc10 2023-12-05T09:54:26.365 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:26.366+0000 7f31f105a700 1 -- 172.21.15.100:0/1442633805 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31ec10e960 con 0x7f31ec0fdc10 2023-12-05T09:54:26.365 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:26.366+0000 7f31e8ff9700 1 -- 172.21.15.100:0/1442633805 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31e001c630 con 0x7f31ec0fdc10 2023-12-05T09:54:26.366 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:26.367+0000 7f31f105a700 1 -- 172.21.15.100:0/1442633805 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31ec10eea0 con 0x7f31ec0fdc10 2023-12-05T09:54:26.366 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:26.368+0000 7f31f105a700 1 -- 172.21.15.100:0/1442633805 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31ec04bb80 con 0x7f31ec0fdc10 2023-12-05T09:54:26.366 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:26.369+0000 7f31e8ff9700 1 -- 172.21.15.100:0/1442633805 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f31e0013420 con 0x7f31ec0fdc10 2023-12-05T09:54:26.367 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:26.370+0000 7f31e8ff9700 1 --2- 172.21.15.100:0/1442633805 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f31d4068f60 0x7f31d406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:26.367 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:26.370+0000 7f31e8ff9700 1 -- 172.21.15.100:0/1442633805 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f31e0087ea0 con 0x7f31ec0fdc10 2023-12-05T09:54:26.368 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:26.370+0000 7f31ebfff700 1 --2- 172.21.15.100:0/1442633805 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f31d4068f60 0x7f31d406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:26.368 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:26.371+0000 7f31ebfff700 1 --2- 172.21.15.100:0/1442633805 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f31d4068f60 0x7f31d406b410 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f31ec0fda70 tx=0x7f31dc00b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:54:26.372 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:26.374+0000 7f31e8ff9700 1 -- 172.21.15.100:0/1442633805 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f31e00580a0 con 0x7f31ec0fdc10 2023-12-05T09:54:26.571 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:26.574+0000 7f31f105a700 1 -- 172.21.15.100:0/1442633805 --> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f31ec10f480 con 0x7f31d4068f60 2023-12-05T09:54:26.573 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:26.576+0000 7f31e8ff9700 1 -- 172.21.15.100:0/1442633805 <== mgr.14210 v2:172.21.15.100:6800/1237547575 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+399 (secure 0 0 0) 0x7f31ec10f480 con 0x7f31d4068f60 2023-12-05T09:54:26.573 INFO:teuthology.orchestra.run.smithi100.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2023-12-05T09:54:26.573 INFO:teuthology.orchestra.run.smithi100.stdout:smithi100 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400WR400BGN 372G No 119s ago Has a FileSystem, LVM detected 2023-12-05T09:54:26.573 INFO:teuthology.orchestra.run.smithi100.stdout:smithi150 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300GX400BGN 372G No 52s ago Has a FileSystem, LVM detected 2023-12-05T09:54:26.575 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:26.578+0000 7f31f105a700 1 -- 172.21.15.100:0/1442633805 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f31d4068f60 msgr2=0x7f31d406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:26.576 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:26.578+0000 7f31f105a700 1 --2- 172.21.15.100:0/1442633805 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f31d4068f60 0x7f31d406b410 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f31ec0fda70 tx=0x7f31dc00b040 comp rx=0 tx=0).stop 2023-12-05T09:54:26.576 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:26.578+0000 7f31f105a700 1 -- 172.21.15.100:0/1442633805 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31ec0fdc10 msgr2=0x7f31ec10d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:26.576 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:26.578+0000 7f31f105a700 1 --2- 172.21.15.100:0/1442633805 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31ec0fdc10 0x7f31ec10d840 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f31e0009380 tx=0x7f31e0009e30 comp rx=0 tx=0).stop 2023-12-05T09:54:26.576 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:26.578+0000 7f31f105a700 1 -- 172.21.15.100:0/1442633805 shutdown_connections 2023-12-05T09:54:26.576 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:26.578+0000 7f31f105a700 1 --2- 172.21.15.100:0/1442633805 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f31d4068f60 0x7f31d406b410 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:26.576 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:26.578+0000 7f31f105a700 1 --2- 172.21.15.100:0/1442633805 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31ec0fca00 0x7f31ec10d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:26.576 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:26.578+0000 7f31f105a700 1 --2- 172.21.15.100:0/1442633805 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31ec0fdc10 0x7f31ec10d840 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:26.576 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:26.578+0000 7f31f105a700 1 -- 172.21.15.100:0/1442633805 >> 172.21.15.100:0/1442633805 conn(0x7f31ec0f80e0 msgr2=0x7f31ec100e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:54:26.576 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:26.578+0000 7f31f105a700 1 -- 172.21.15.100:0/1442633805 shutdown_connections 2023-12-05T09:54:26.576 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:26.578+0000 7f31f105a700 1 -- 172.21.15.100:0/1442633805 wait complete. 2023-12-05T09:54:26.966 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-05T09:54:26.976 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi100.front.sepia.ceph.com 2023-12-05T09:54:26.976 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- bash -c 'ceph fs volume create cephfs --placement=4' 2023-12-05T09:54:27.400 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi100/config 2023-12-05T09:54:27.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:27 smithi150 ceph-mon[116142]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:54:27.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:27 smithi150 ceph-mon[116142]: from='client.14466 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:54:27.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:27 smithi100 ceph-mon[107145]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:54:27.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:27 smithi100 ceph-mon[107145]: from='client.14466 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:54:28.590 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:28.592+0000 7fa78987c700 1 -- 172.21.15.100:0/3776909424 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7840fcb80 msgr2=0x7fa7840fcf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:28.590 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:28.592+0000 7fa78987c700 1 --2- 172.21.15.100:0/3776909424 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7840fcb80 0x7fa7840fcf90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa774004940 tx=0x7fa774009e30 comp rx=0 tx=0).stop 2023-12-05T09:54:28.591 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:28.593+0000 7fa78987c700 1 -- 172.21.15.100:0/3776909424 shutdown_connections 2023-12-05T09:54:28.591 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:28.593+0000 7fa78987c700 1 --2- 172.21.15.100:0/3776909424 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7840fdd90 0x7fa7840fe1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:28.591 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:28.593+0000 7fa78987c700 1 --2- 172.21.15.100:0/3776909424 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7840fcb80 0x7fa7840fcf90 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:28.591 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:28.593+0000 7fa78987c700 1 -- 172.21.15.100:0/3776909424 >> 172.21.15.100:0/3776909424 conn(0x7fa7840f8240 msgr2=0x7fa7840fa670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:54:28.591 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:28.593+0000 7fa78987c700 1 -- 172.21.15.100:0/3776909424 shutdown_connections 2023-12-05T09:54:28.591 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:28.593+0000 7fa78987c700 1 -- 172.21.15.100:0/3776909424 wait complete. 2023-12-05T09:54:28.592 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:28.593+0000 7fa78987c700 1 Processor -- start 2023-12-05T09:54:28.592 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:28.594+0000 7fa78987c700 1 -- start start 2023-12-05T09:54:28.592 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:28.594+0000 7fa78987c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7840fcb80 0x7fa78410d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:28.593 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:28.594+0000 7fa78987c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7840fdd90 0x7fa78410d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:28.593 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:28.594+0000 7fa78987c700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa78410dfa0 con 0x7fa7840fcb80 2023-12-05T09:54:28.593 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:28.594+0000 7fa78987c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa78410e840 con 0x7fa7840fdd90 2023-12-05T09:54:28.593 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:28.594+0000 7fa782ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7840fcb80 0x7fa78410d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:28.593 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:28.594+0000 7fa782ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7840fcb80 0x7fa78410d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44492/0 (socket says 172.21.15.100:44492) 2023-12-05T09:54:28.593 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:28.594+0000 7fa782ffd700 1 -- 172.21.15.100:0/1694276007 learned_addr learned my addr 172.21.15.100:0/1694276007 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:54:28.593 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:28.594+0000 7fa7827fc700 1 --2- 172.21.15.100:0/1694276007 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7840fdd90 0x7fa78410d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:28.593 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:28.594+0000 7fa782ffd700 1 -- 172.21.15.100:0/1694276007 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7840fdd90 msgr2=0x7fa78410d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:28.593 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:28.594+0000 7fa782ffd700 1 --2- 172.21.15.100:0/1694276007 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7840fdd90 0x7fa78410d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:28.593 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:28.594+0000 7fa782ffd700 1 -- 172.21.15.100:0/1694276007 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa774005040 con 0x7fa7840fcb80 2023-12-05T09:54:28.593 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:28.595+0000 7fa782ffd700 1 --2- 172.21.15.100:0/1694276007 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7840fcb80 0x7fa78410d460 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa774000c00 tx=0x7fa774009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:54:28.593 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:28.595+0000 7fa76b7fe700 1 -- 172.21.15.100:0/1694276007 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa77400e040 con 0x7fa7840fcb80 2023-12-05T09:54:28.593 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:28.595+0000 7fa76b7fe700 1 -- 172.21.15.100:0/1694276007 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa774013420 con 0x7fa7840fcb80 2023-12-05T09:54:28.593 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:28.595+0000 7fa78987c700 1 -- 172.21.15.100:0/1694276007 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa78410eac0 con 0x7fa7840fcb80 2023-12-05T09:54:28.593 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:28.595+0000 7fa76b7fe700 1 -- 172.21.15.100:0/1694276007 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa77401c630 con 0x7fa7840fcb80 2023-12-05T09:54:28.594 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:28.595+0000 7fa78987c700 1 -- 172.21.15.100:0/1694276007 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa78410f000 con 0x7fa7840fcb80 2023-12-05T09:54:28.594 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:28.596+0000 7fa78987c700 1 -- 172.21.15.100:0/1694276007 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa78404bb80 con 0x7fa7840fcb80 2023-12-05T09:54:28.594 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:28.597+0000 7fa76b7fe700 1 -- 172.21.15.100:0/1694276007 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7fa774013590 con 0x7fa7840fcb80 2023-12-05T09:54:28.595 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:28.598+0000 7fa76b7fe700 1 --2- 172.21.15.100:0/1694276007 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fa76c068f70 0x7fa76c06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:28.595 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:28.598+0000 7fa76b7fe700 1 -- 172.21.15.100:0/1694276007 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fa774087cc0 con 0x7fa7840fcb80 2023-12-05T09:54:28.597 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:28.598+0000 7fa7827fc700 1 --2- 172.21.15.100:0/1694276007 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fa76c068f70 0x7fa76c06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:28.598 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:28.599+0000 7fa7827fc700 1 --2- 172.21.15.100:0/1694276007 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fa76c068f70 0x7fa76c06b420 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa778004f40 tx=0x7fa77800b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:54:28.600 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:28.602+0000 7fa76b7fe700 1 -- 172.21.15.100:0/1694276007 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fa77408d020 con 0x7fa7840fcb80 2023-12-05T09:54:28.822 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:28.824+0000 7fa78987c700 1 -- 172.21.15.100:0/1694276007 --> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fa7841026e0 con 0x7fa76c068f70 2023-12-05T09:54:29.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:29 smithi150 ceph-mon[116142]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:54:29.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:29 smithi150 ceph-mon[116142]: from='client.14470 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:54:29.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:29 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2023-12-05T09:54:29.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:29 smithi100 ceph-mon[107145]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:54:29.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:29 smithi100 ceph-mon[107145]: from='client.14470 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:54:29.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:29 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2023-12-05T09:54:30.535 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:30.538+0000 7fa76b7fe700 1 -- 172.21.15.100:0/1694276007 <== mgr.14210 v2:172.21.15.100:6800/1237547575 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fa7841026e0 con 0x7fa76c068f70 2023-12-05T09:54:30.539 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:30.541+0000 7fa78987c700 1 -- 172.21.15.100:0/1694276007 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fa76c068f70 msgr2=0x7fa76c06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:30.539 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:30.541+0000 7fa78987c700 1 --2- 172.21.15.100:0/1694276007 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fa76c068f70 0x7fa76c06b420 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa778004f40 tx=0x7fa77800b040 comp rx=0 tx=0).stop 2023-12-05T09:54:30.539 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:30.541+0000 7fa78987c700 1 -- 172.21.15.100:0/1694276007 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7840fcb80 msgr2=0x7fa78410d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:30.539 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:30.541+0000 7fa78987c700 1 --2- 172.21.15.100:0/1694276007 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7840fcb80 0x7fa78410d460 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa774000c00 tx=0x7fa774009e30 comp rx=0 tx=0).stop 2023-12-05T09:54:30.539 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:30.541+0000 7fa78987c700 1 -- 172.21.15.100:0/1694276007 shutdown_connections 2023-12-05T09:54:30.539 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:30.541+0000 7fa78987c700 1 --2- 172.21.15.100:0/1694276007 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fa76c068f70 0x7fa76c06b420 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:30.539 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:30.541+0000 7fa78987c700 1 --2- 172.21.15.100:0/1694276007 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7840fcb80 0x7fa78410d460 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:30.540 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:30.541+0000 7fa78987c700 1 --2- 172.21.15.100:0/1694276007 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7840fdd90 0x7fa78410d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:30.540 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:30.541+0000 7fa78987c700 1 -- 172.21.15.100:0/1694276007 >> 172.21.15.100:0/1694276007 conn(0x7fa7840f8240 msgr2=0x7fa784100fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:54:30.540 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:30.541+0000 7fa78987c700 1 -- 172.21.15.100:0/1694276007 shutdown_connections 2023-12-05T09:54:30.540 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:30.541+0000 7fa78987c700 1 -- 172.21.15.100:0/1694276007 wait complete. 2023-12-05T09:54:30.788 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:30 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2023-12-05T09:54:30.789 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:30 smithi100 ceph-mon[107145]: osdmap e41: 6 total, 6 up, 6 in 2023-12-05T09:54:30.789 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:30 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2023-12-05T09:54:30.789 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:30 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:54:30.789 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:30 smithi100 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-mon-smithi100[107122]: 2023-12-05T09:54:30.514+0000 7f9255088700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-05T09:54:30.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:30 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2023-12-05T09:54:30.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:30 smithi150 ceph-mon[116142]: osdmap e41: 6 total, 6 up, 6 in 2023-12-05T09:54:30.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:30 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2023-12-05T09:54:30.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:30 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:54:31.028 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- bash -c 'ceph fs dump' 2023-12-05T09:54:31.641 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi100/config 2023-12-05T09:54:31.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:31 smithi100 ceph-mon[107145]: pgmap v149: 33 pgs: 5 creating+peering, 1 active+clean, 27 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:54:31.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:31 smithi100 ceph-mon[107145]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-12-05T09:54:31.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:31 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2023-12-05T09:54:31.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:31 smithi100 ceph-mon[107145]: osdmap e42: 6 total, 6 up, 6 in 2023-12-05T09:54:31.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:31 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2023-12-05T09:54:31.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:31 smithi100 ceph-mon[107145]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-05T09:54:31.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:31 smithi100 ceph-mon[107145]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-12-05T09:54:31.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:31 smithi100 ceph-mon[107145]: osdmap e43: 6 total, 6 up, 6 in 2023-12-05T09:54:31.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:31 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2023-12-05T09:54:31.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:31 smithi100 ceph-mon[107145]: fsmap cephfs:0 2023-12-05T09:54:31.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:31 smithi100 ceph-mon[107145]: Saving service mds.cephfs spec with placement count:4 2023-12-05T09:54:31.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:31 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:54:31.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:31 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:54:31.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:31 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:54:31.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:31 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:54:31.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:31 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:54:31.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:31 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi100.sqplhn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-05T09:54:31.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:31 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi100.sqplhn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-05T09:54:31.647 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:31 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:54:31.647 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:31 smithi100 ceph-mon[107145]: Deploying daemon mds.cephfs.smithi100.sqplhn on smithi100 2023-12-05T09:54:31.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:31 smithi150 ceph-mon[116142]: pgmap v149: 33 pgs: 5 creating+peering, 1 active+clean, 27 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:54:31.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:31 smithi150 ceph-mon[116142]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-12-05T09:54:31.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:31 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2023-12-05T09:54:31.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:31 smithi150 ceph-mon[116142]: osdmap e42: 6 total, 6 up, 6 in 2023-12-05T09:54:31.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:31 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2023-12-05T09:54:31.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:31 smithi150 ceph-mon[116142]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-05T09:54:31.847 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:31 smithi150 ceph-mon[116142]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-12-05T09:54:31.847 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:31 smithi150 ceph-mon[116142]: osdmap e43: 6 total, 6 up, 6 in 2023-12-05T09:54:31.847 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:31 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2023-12-05T09:54:31.847 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:31 smithi150 ceph-mon[116142]: fsmap cephfs:0 2023-12-05T09:54:31.847 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:31 smithi150 ceph-mon[116142]: Saving service mds.cephfs spec with placement count:4 2023-12-05T09:54:31.847 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:31 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:54:31.847 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:31 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:54:31.847 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:31 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:54:31.847 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:31 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:54:31.847 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:31 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:54:31.847 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:31 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi100.sqplhn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-05T09:54:31.847 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:31 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi100.sqplhn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-05T09:54:31.847 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:31 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:54:31.847 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:31 smithi150 ceph-mon[116142]: Deploying daemon mds.cephfs.smithi100.sqplhn on smithi100 2023-12-05T09:54:32.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:32 smithi100 ceph-mon[107145]: osdmap e44: 6 total, 6 up, 6 in 2023-12-05T09:54:32.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:32 smithi150 ceph-mon[116142]: osdmap e44: 6 total, 6 up, 6 in 2023-12-05T09:54:33.104 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:33.105+0000 7f9b6ebe8700 1 -- 172.21.15.100:0/3824468568 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b68071bc0 msgr2=0x7f9b68070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:33.104 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:33.105+0000 7f9b6ebe8700 1 --2- 172.21.15.100:0/3824468568 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b68071bc0 0x7f9b68070030 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9b64004940 tx=0x7f9b64009e30 comp rx=0 tx=0).stop 2023-12-05T09:54:33.104 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:33.105+0000 7f9b6ebe8700 1 -- 172.21.15.100:0/3824468568 shutdown_connections 2023-12-05T09:54:33.104 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:33.105+0000 7f9b6ebe8700 1 --2- 172.21.15.100:0/3824468568 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b68070570 0x7f9b680709c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:33.104 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:33.105+0000 7f9b6ebe8700 1 --2- 172.21.15.100:0/3824468568 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b68071bc0 0x7f9b68070030 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:33.105 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:33.105+0000 7f9b6ebe8700 1 -- 172.21.15.100:0/3824468568 >> 172.21.15.100:0/3824468568 conn(0x7f9b680f8090 msgr2=0x7f9b680fa4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:54:33.105 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:33.105+0000 7f9b6ebe8700 1 -- 172.21.15.100:0/3824468568 shutdown_connections 2023-12-05T09:54:33.105 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:33.106+0000 7f9b6ebe8700 1 -- 172.21.15.100:0/3824468568 wait complete. 2023-12-05T09:54:33.105 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:33.106+0000 7f9b6ebe8700 1 Processor -- start 2023-12-05T09:54:33.105 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:33.106+0000 7f9b6ebe8700 1 -- start start 2023-12-05T09:54:33.106 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:33.107+0000 7f9b6ebe8700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b68070570 0x7f9b6810f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:33.106 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:33.107+0000 7f9b6ebe8700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b68071bc0 0x7f9b6810fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:33.106 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:33.107+0000 7f9b6ebe8700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b68110090 con 0x7f9b68070570 2023-12-05T09:54:33.106 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:33.107+0000 7f9b6ebe8700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b68110930 con 0x7f9b68071bc0 2023-12-05T09:54:33.106 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:33.107+0000 7f9b6dbe6700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b68070570 0x7f9b6810f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:33.106 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:33.107+0000 7f9b6d3e5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b68071bc0 0x7f9b6810fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:33.106 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:33.107+0000 7f9b6dbe6700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b68070570 0x7f9b6810f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54102/0 (socket says 172.21.15.100:54102) 2023-12-05T09:54:33.106 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:33.107+0000 7f9b6dbe6700 1 -- 172.21.15.100:0/556585009 learned_addr learned my addr 172.21.15.100:0/556585009 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:54:33.106 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:33.108+0000 7f9b6dbe6700 1 -- 172.21.15.100:0/556585009 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b68071bc0 msgr2=0x7f9b6810fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:33.106 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:33.108+0000 7f9b6dbe6700 1 --2- 172.21.15.100:0/556585009 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b68071bc0 0x7f9b6810fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:33.106 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:33.108+0000 7f9b6dbe6700 1 -- 172.21.15.100:0/556585009 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b64005040 con 0x7f9b68070570 2023-12-05T09:54:33.106 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:33.108+0000 7f9b6dbe6700 1 --2- 172.21.15.100:0/556585009 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b68070570 0x7f9b6810f550 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9b64009fd0 tx=0x7f9b64009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:54:33.107 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:33.109+0000 7f9b5e7fc700 1 -- 172.21.15.100:0/556585009 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b6400e040 con 0x7f9b68070570 2023-12-05T09:54:33.107 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:33.109+0000 7f9b5e7fc700 1 -- 172.21.15.100:0/556585009 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9b64004290 con 0x7f9b68070570 2023-12-05T09:54:33.107 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:33.109+0000 7f9b6ebe8700 1 -- 172.21.15.100:0/556585009 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b68110bb0 con 0x7f9b68070570 2023-12-05T09:54:33.107 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:33.109+0000 7f9b5e7fc700 1 -- 172.21.15.100:0/556585009 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b6401c3f0 con 0x7f9b68070570 2023-12-05T09:54:33.107 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:33.109+0000 7f9b6ebe8700 1 -- 172.21.15.100:0/556585009 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b681110f0 con 0x7f9b68070570 2023-12-05T09:54:33.108 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:33.110+0000 7f9b6ebe8700 1 -- 172.21.15.100:0/556585009 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b6804bb80 con 0x7f9b68070570 2023-12-05T09:54:33.109 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:33.112+0000 7f9b5e7fc700 1 -- 172.21.15.100:0/556585009 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f9b6400bbf0 con 0x7f9b68070570 2023-12-05T09:54:33.111 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:33.113+0000 7f9b5e7fc700 1 --2- 172.21.15.100:0/556585009 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f9b54068f70 0x7f9b5406b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:33.111 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:33.114+0000 7f9b5e7fc700 1 -- 172.21.15.100:0/556585009 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f9b64088020 con 0x7f9b68070570 2023-12-05T09:54:33.111 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:33.114+0000 7f9b6d3e5700 1 --2- 172.21.15.100:0/556585009 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f9b54068f70 0x7f9b5406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:33.112 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:33.114+0000 7f9b6d3e5700 1 --2- 172.21.15.100:0/556585009 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f9b54068f70 0x7f9b5406b420 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9b58004f40 tx=0x7f9b5800b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:54:33.115 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:33.118+0000 7f9b5e7fc700 1 -- 172.21.15.100:0/556585009 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f9b64058020 con 0x7f9b68070570 2023-12-05T09:54:33.389 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:33.391+0000 7f9b6ebe8700 1 -- 172.21.15.100:0/556585009 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9b68110d40 con 0x7f9b68070570 2023-12-05T09:54:33.391 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:33.394+0000 7f9b5e7fc700 1 -- 172.21.15.100:0/556585009 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 3 v3) v1 ==== 75+0+1249 (secure 0 0 0) 0x7f9b68110d40 con 0x7f9b68070570 2023-12-05T09:54:33.391 INFO:teuthology.orchestra.run.smithi100.stdout:e3 2023-12-05T09:54:33.392 INFO:teuthology.orchestra.run.smithi100.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-05T09:54:33.392 INFO:teuthology.orchestra.run.smithi100.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T09:54:33.392 INFO:teuthology.orchestra.run.smithi100.stdout:legacy client fscid: 1 2023-12-05T09:54:33.392 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:54:33.392 INFO:teuthology.orchestra.run.smithi100.stdout:Filesystem 'cephfs' (1) 2023-12-05T09:54:33.392 INFO:teuthology.orchestra.run.smithi100.stdout:fs_name cephfs 2023-12-05T09:54:33.392 INFO:teuthology.orchestra.run.smithi100.stdout:epoch 3 2023-12-05T09:54:33.392 INFO:teuthology.orchestra.run.smithi100.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-05T09:54:33.392 INFO:teuthology.orchestra.run.smithi100.stdout:created 2023-12-05T09:54:30.515778+0000 2023-12-05T09:54:33.392 INFO:teuthology.orchestra.run.smithi100.stdout:modified 2023-12-05T09:54:33.388539+0000 2023-12-05T09:54:33.392 INFO:teuthology.orchestra.run.smithi100.stdout:tableserver 0 2023-12-05T09:54:33.392 INFO:teuthology.orchestra.run.smithi100.stdout:root 0 2023-12-05T09:54:33.392 INFO:teuthology.orchestra.run.smithi100.stdout:session_timeout 60 2023-12-05T09:54:33.393 INFO:teuthology.orchestra.run.smithi100.stdout:session_autoclose 300 2023-12-05T09:54:33.393 INFO:teuthology.orchestra.run.smithi100.stdout:max_file_size 1099511627776 2023-12-05T09:54:33.393 INFO:teuthology.orchestra.run.smithi100.stdout:required_client_features {} 2023-12-05T09:54:33.393 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure 0 2023-12-05T09:54:33.393 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure_osd_epoch 0 2023-12-05T09:54:33.393 INFO:teuthology.orchestra.run.smithi100.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T09:54:33.393 INFO:teuthology.orchestra.run.smithi100.stdout:max_mds 1 2023-12-05T09:54:33.393 INFO:teuthology.orchestra.run.smithi100.stdout:in 0 2023-12-05T09:54:33.393 INFO:teuthology.orchestra.run.smithi100.stdout:up {0=14478} 2023-12-05T09:54:33.393 INFO:teuthology.orchestra.run.smithi100.stdout:failed 2023-12-05T09:54:33.393 INFO:teuthology.orchestra.run.smithi100.stdout:damaged 2023-12-05T09:54:33.393 INFO:teuthology.orchestra.run.smithi100.stdout:stopped 2023-12-05T09:54:33.393 INFO:teuthology.orchestra.run.smithi100.stdout:data_pools [3] 2023-12-05T09:54:33.393 INFO:teuthology.orchestra.run.smithi100.stdout:metadata_pool 2 2023-12-05T09:54:33.393 INFO:teuthology.orchestra.run.smithi100.stdout:inline_data disabled 2023-12-05T09:54:33.393 INFO:teuthology.orchestra.run.smithi100.stdout:balancer 2023-12-05T09:54:33.394 INFO:teuthology.orchestra.run.smithi100.stdout:standby_count_wanted 0 2023-12-05T09:54:33.394 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi100.sqplhn{0:14478} state up:creating seq 1 addr [v2:172.21.15.100:6826/3068237273,v1:172.21.15.100:6827/3068237273] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:54:33.394 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:54:33.394 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:54:33.394 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:33.396+0000 7f9b6ebe8700 1 -- 172.21.15.100:0/556585009 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f9b54068f70 msgr2=0x7f9b5406b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:33.394 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:33.396+0000 7f9b6ebe8700 1 --2- 172.21.15.100:0/556585009 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f9b54068f70 0x7f9b5406b420 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9b58004f40 tx=0x7f9b5800b040 comp rx=0 tx=0).stop 2023-12-05T09:54:33.395 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:33.396+0000 7f9b6ebe8700 1 -- 172.21.15.100:0/556585009 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b68070570 msgr2=0x7f9b6810f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:33.395 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:33.396+0000 7f9b6ebe8700 1 --2- 172.21.15.100:0/556585009 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b68070570 0x7f9b6810f550 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9b64009fd0 tx=0x7f9b64009e30 comp rx=0 tx=0).stop 2023-12-05T09:54:33.395 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:33.397+0000 7f9b6ebe8700 1 -- 172.21.15.100:0/556585009 shutdown_connections 2023-12-05T09:54:33.395 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:33.397+0000 7f9b6ebe8700 1 --2- 172.21.15.100:0/556585009 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f9b54068f70 0x7f9b5406b420 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:33.395 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:33.397+0000 7f9b6ebe8700 1 --2- 172.21.15.100:0/556585009 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b68070570 0x7f9b6810f550 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:33.395 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:33.397+0000 7f9b6ebe8700 1 --2- 172.21.15.100:0/556585009 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b68071bc0 0x7f9b6810fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:33.395 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:33.397+0000 7f9b6ebe8700 1 -- 172.21.15.100:0/556585009 >> 172.21.15.100:0/556585009 conn(0x7f9b680f8090 msgr2=0x7f9b68102880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:54:33.395 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:33.397+0000 7f9b6ebe8700 1 -- 172.21.15.100:0/556585009 shutdown_connections 2023-12-05T09:54:33.395 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:33.397+0000 7f9b6ebe8700 1 -- 172.21.15.100:0/556585009 wait complete. 2023-12-05T09:54:33.396 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 3 2023-12-05T09:54:33.610 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:33 smithi100 ceph-mon[107145]: pgmap v153: 65 pgs: 2 creating+activating, 8 creating+peering, 11 active+clean, 44 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:54:33.610 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:33 smithi100 ceph-mon[107145]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-12-05T09:54:33.610 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:33 smithi100 ceph-mon[107145]: osdmap e45: 6 total, 6 up, 6 in 2023-12-05T09:54:33.610 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:33 smithi100 ceph-mon[107145]: daemon mds.cephfs.smithi100.sqplhn assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2023-12-05T09:54:33.610 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:33 smithi100 ceph-mon[107145]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-12-05T09:54:33.610 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:33 smithi100 ceph-mon[107145]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-12-05T09:54:33.610 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:33 smithi100 ceph-mon[107145]: Cluster is now healthy 2023-12-05T09:54:33.610 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:33 smithi100 ceph-mon[107145]: mds.? [v2:172.21.15.100:6826/3068237273,v1:172.21.15.100:6827/3068237273] up:boot 2023-12-05T09:54:33.610 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:33 smithi100 ceph-mon[107145]: fsmap cephfs:1 {0=cephfs.smithi100.sqplhn=up:creating} 2023-12-05T09:54:33.610 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:33 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi100.sqplhn"}]: dispatch 2023-12-05T09:54:33.610 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:33 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/556585009' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-05T09:54:33.610 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:33 smithi100 ceph-mon[107145]: daemon mds.cephfs.smithi100.sqplhn is now active in filesystem cephfs as rank 0 2023-12-05T09:54:33.610 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:33 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:54:33.611 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:33 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:54:33.611 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:33 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:54:33.611 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:33 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi150.pcbpxm", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-05T09:54:33.611 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:33 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi150.pcbpxm", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-05T09:54:33.611 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:33 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:54:33.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:33 smithi150 ceph-mon[116142]: pgmap v153: 65 pgs: 2 creating+activating, 8 creating+peering, 11 active+clean, 44 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:54:33.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:33 smithi150 ceph-mon[116142]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-12-05T09:54:33.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:33 smithi150 ceph-mon[116142]: osdmap e45: 6 total, 6 up, 6 in 2023-12-05T09:54:33.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:33 smithi150 ceph-mon[116142]: daemon mds.cephfs.smithi100.sqplhn assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2023-12-05T09:54:33.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:33 smithi150 ceph-mon[116142]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-12-05T09:54:33.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:33 smithi150 ceph-mon[116142]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-12-05T09:54:33.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:33 smithi150 ceph-mon[116142]: Cluster is now healthy 2023-12-05T09:54:33.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:33 smithi150 ceph-mon[116142]: mds.? [v2:172.21.15.100:6826/3068237273,v1:172.21.15.100:6827/3068237273] up:boot 2023-12-05T09:54:33.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:33 smithi150 ceph-mon[116142]: fsmap cephfs:1 {0=cephfs.smithi100.sqplhn=up:creating} 2023-12-05T09:54:33.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:33 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi100.sqplhn"}]: dispatch 2023-12-05T09:54:33.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:33 smithi150 ceph-mon[116142]: from='client.? 172.21.15.100:0/556585009' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-05T09:54:33.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:33 smithi150 ceph-mon[116142]: daemon mds.cephfs.smithi100.sqplhn is now active in filesystem cephfs as rank 0 2023-12-05T09:54:33.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:33 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:54:33.847 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:33 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:54:33.847 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:33 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:54:33.847 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:33 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi150.pcbpxm", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-05T09:54:33.847 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:33 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi150.pcbpxm", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-05T09:54:33.847 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:33 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:54:33.869 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-05T09:54:33.881 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi100.front.sepia.ceph.com 2023-12-05T09:54:33.882 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- bash -c 'ceph fs set cephfs max_mds 1' 2023-12-05T09:54:34.311 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi100/config 2023-12-05T09:54:34.838 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:34 smithi100 ceph-mon[107145]: Deploying daemon mds.cephfs.smithi150.pcbpxm on smithi150 2023-12-05T09:54:34.838 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:34 smithi100 ceph-mon[107145]: mds.? [v2:172.21.15.100:6826/3068237273,v1:172.21.15.100:6827/3068237273] up:active 2023-12-05T09:54:34.838 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:34 smithi100 ceph-mon[107145]: fsmap cephfs:1 {0=cephfs.smithi100.sqplhn=up:active} 2023-12-05T09:54:34.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:34 smithi150 ceph-mon[116142]: Deploying daemon mds.cephfs.smithi150.pcbpxm on smithi150 2023-12-05T09:54:34.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:34 smithi150 ceph-mon[116142]: mds.? [v2:172.21.15.100:6826/3068237273,v1:172.21.15.100:6827/3068237273] up:active 2023-12-05T09:54:34.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:34 smithi150 ceph-mon[116142]: fsmap cephfs:1 {0=cephfs.smithi100.sqplhn=up:active} 2023-12-05T09:54:35.548 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:35.550+0000 7fe413fe3700 1 -- 172.21.15.100:0/3034186366 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe40c0fcbf0 msgr2=0x7fe40c0fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:35.548 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:35.550+0000 7fe413fe3700 1 --2- 172.21.15.100:0/3034186366 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe40c0fcbf0 0x7fe40c0fd000 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe408004940 tx=0x7fe408009e30 comp rx=0 tx=0).stop 2023-12-05T09:54:35.548 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:35.550+0000 7fe413fe3700 1 -- 172.21.15.100:0/3034186366 shutdown_connections 2023-12-05T09:54:35.548 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:35.550+0000 7fe413fe3700 1 --2- 172.21.15.100:0/3034186366 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe40c0fde00 0x7fe40c0fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:35.548 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:35.550+0000 7fe413fe3700 1 --2- 172.21.15.100:0/3034186366 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe40c0fcbf0 0x7fe40c0fd000 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:35.548 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:35.550+0000 7fe413fe3700 1 -- 172.21.15.100:0/3034186366 >> 172.21.15.100:0/3034186366 conn(0x7fe40c0f82d0 msgr2=0x7fe40c0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:54:35.549 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:35.550+0000 7fe413fe3700 1 -- 172.21.15.100:0/3034186366 shutdown_connections 2023-12-05T09:54:35.549 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:35.550+0000 7fe413fe3700 1 -- 172.21.15.100:0/3034186366 wait complete. 2023-12-05T09:54:35.549 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:35.551+0000 7fe413fe3700 1 Processor -- start 2023-12-05T09:54:35.549 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:35.551+0000 7fe413fe3700 1 -- start start 2023-12-05T09:54:35.550 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:35.551+0000 7fe413fe3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe40c0fcbf0 0x7fe40c10f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:35.550 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:35.551+0000 7fe413fe3700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe40c0fde00 0x7fe40c10fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:35.550 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:35.551+0000 7fe413fe3700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe40c110220 con 0x7fe40c0fde00 2023-12-05T09:54:35.550 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:35.551+0000 7fe413fe3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe40c110ac0 con 0x7fe40c0fcbf0 2023-12-05T09:54:35.551 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:35.551+0000 7fe41157e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe40c0fde00 0x7fe40c10fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:35.551 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:35.551+0000 7fe41157e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe40c0fde00 0x7fe40c10fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54148/0 (socket says 172.21.15.100:54148) 2023-12-05T09:54:35.551 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:35.551+0000 7fe41157e700 1 -- 172.21.15.100:0/3037381653 learned_addr learned my addr 172.21.15.100:0/3037381653 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:54:35.551 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:35.551+0000 7fe411d7f700 1 --2- 172.21.15.100:0/3037381653 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe40c0fcbf0 0x7fe40c10f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:35.551 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:35.552+0000 7fe41157e700 1 -- 172.21.15.100:0/3037381653 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe40c0fcbf0 msgr2=0x7fe40c10f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:35.551 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:35.552+0000 7fe41157e700 1 --2- 172.21.15.100:0/3037381653 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe40c0fcbf0 0x7fe40c10f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:35.551 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:35.552+0000 7fe41157e700 1 -- 172.21.15.100:0/3037381653 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe408005040 con 0x7fe40c0fde00 2023-12-05T09:54:35.551 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:35.552+0000 7fe411d7f700 1 --2- 172.21.15.100:0/3037381653 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe40c0fcbf0 0x7fe40c10f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-05T09:54:35.551 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:35.552+0000 7fe41157e700 1 --2- 172.21.15.100:0/3037381653 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe40c0fde00 0x7fe40c10fc20 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc00eb40 tx=0x7fe3fc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:54:35.551 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:35.552+0000 7fe4027fc700 1 -- 172.21.15.100:0/3037381653 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe3fc007cc0 con 0x7fe40c0fde00 2023-12-05T09:54:35.551 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:35.552+0000 7fe4027fc700 1 -- 172.21.15.100:0/3037381653 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe3fc00f040 con 0x7fe40c0fde00 2023-12-05T09:54:35.551 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:35.552+0000 7fe413fe3700 1 -- 172.21.15.100:0/3037381653 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe40c110d40 con 0x7fe40c0fde00 2023-12-05T09:54:35.551 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:35.552+0000 7fe4027fc700 1 -- 172.21.15.100:0/3037381653 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe3fc00c990 con 0x7fe40c0fde00 2023-12-05T09:54:35.552 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:35.552+0000 7fe413fe3700 1 -- 172.21.15.100:0/3037381653 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe40c111280 con 0x7fe40c0fde00 2023-12-05T09:54:35.553 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:35.553+0000 7fe413fe3700 1 -- 172.21.15.100:0/3037381653 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe40c101ea0 con 0x7fe40c0fde00 2023-12-05T09:54:35.553 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:35.554+0000 7fe4027fc700 1 -- 172.21.15.100:0/3037381653 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7fe3fc00caf0 con 0x7fe40c0fde00 2023-12-05T09:54:35.553 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:35.555+0000 7fe4027fc700 1 --2- 172.21.15.100:0/3037381653 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fe3f8068f70 0x7fe3f806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:35.553 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:35.555+0000 7fe4027fc700 1 -- 172.21.15.100:0/3037381653 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fe3fc0868e0 con 0x7fe40c0fde00 2023-12-05T09:54:35.553 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:35.555+0000 7fe411d7f700 1 --2- 172.21.15.100:0/3037381653 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fe3f8068f70 0x7fe3f806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:35.553 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:35.556+0000 7fe411d7f700 1 --2- 172.21.15.100:0/3037381653 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fe3f8068f70 0x7fe3f806b420 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe40800b0d0 tx=0x7fe408009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:54:35.557 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:35.559+0000 7fe4027fc700 1 -- 172.21.15.100:0/3037381653 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fe3fc04da00 con 0x7fe40c0fde00 2023-12-05T09:54:35.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:35 smithi100 ceph-mon[107145]: pgmap v155: 65 pgs: 2 creating+activating, 8 creating+peering, 47 active+clean, 8 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:54:35.797 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:35.799+0000 7fe413fe3700 1 -- 172.21.15.100:0/3037381653 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) v1 -- 0x7fe40c02b0e0 con 0x7fe40c0fde00 2023-12-05T09:54:35.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:35 smithi150 ceph-mon[116142]: pgmap v155: 65 pgs: 2 creating+activating, 8 creating+peering, 47 active+clean, 8 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:54:36.538 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:36.540+0000 7fe4027fc700 1 -- 172.21.15.100:0/3037381653 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v5) v1 ==== 105+0+0 (secure 0 0 0) 0x7fe3fc0568f0 con 0x7fe40c0fde00 2023-12-05T09:54:36.541 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:36.543+0000 7fe413fe3700 1 -- 172.21.15.100:0/3037381653 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fe3f8068f70 msgr2=0x7fe3f806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:36.541 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:36.543+0000 7fe413fe3700 1 --2- 172.21.15.100:0/3037381653 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fe3f8068f70 0x7fe3f806b420 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe40800b0d0 tx=0x7fe408009e30 comp rx=0 tx=0).stop 2023-12-05T09:54:36.541 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:36.543+0000 7fe413fe3700 1 -- 172.21.15.100:0/3037381653 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe40c0fde00 msgr2=0x7fe40c10fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:36.541 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:36.543+0000 7fe413fe3700 1 --2- 172.21.15.100:0/3037381653 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe40c0fde00 0x7fe40c10fc20 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc00eb40 tx=0x7fe3fc00b040 comp rx=0 tx=0).stop 2023-12-05T09:54:36.541 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:36.543+0000 7fe413fe3700 1 -- 172.21.15.100:0/3037381653 shutdown_connections 2023-12-05T09:54:36.541 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:36.543+0000 7fe413fe3700 1 --2- 172.21.15.100:0/3037381653 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fe3f8068f70 0x7fe3f806b420 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:36.541 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:36.543+0000 7fe413fe3700 1 --2- 172.21.15.100:0/3037381653 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe40c0fcbf0 0x7fe40c10f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:36.541 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:36.543+0000 7fe413fe3700 1 --2- 172.21.15.100:0/3037381653 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe40c0fde00 0x7fe40c10fc20 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:36.541 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:36.543+0000 7fe413fe3700 1 -- 172.21.15.100:0/3037381653 >> 172.21.15.100:0/3037381653 conn(0x7fe40c0f82d0 msgr2=0x7fe40c0ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:54:36.541 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:36.543+0000 7fe413fe3700 1 -- 172.21.15.100:0/3037381653 shutdown_connections 2023-12-05T09:54:36.541 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:36.543+0000 7fe413fe3700 1 -- 172.21.15.100:0/3037381653 wait complete. 2023-12-05T09:54:37.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:36 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:54:37.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:36 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:54:37.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:36 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:54:37.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:36 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi100.akmstb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-05T09:54:37.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:36 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi100.akmstb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-05T09:54:37.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:36 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:54:37.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:36 smithi150 ceph-mon[116142]: Deploying daemon mds.cephfs.smithi100.akmstb on smithi100 2023-12-05T09:54:37.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:36 smithi150 ceph-mon[116142]: from='client.? 172.21.15.100:0/3037381653' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2023-12-05T09:54:37.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:36 smithi150 ceph-mon[116142]: mds.? [v2:172.21.15.150:6824/3645854543,v1:172.21.15.150:6825/3645854543] up:boot 2023-12-05T09:54:37.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:36 smithi150 ceph-mon[116142]: from='client.? 172.21.15.100:0/3037381653' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2023-12-05T09:54:37.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:36 smithi150 ceph-mon[116142]: fsmap cephfs:1 {0=cephfs.smithi100.sqplhn=up:active} 1 up:standby 2023-12-05T09:54:37.097 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:36 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi150.pcbpxm"}]: dispatch 2023-12-05T09:54:37.097 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:36 smithi150 ceph-mon[116142]: fsmap cephfs:1 {0=cephfs.smithi100.sqplhn=up:active} 1 up:standby 2023-12-05T09:54:37.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:36 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:54:37.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:36 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:54:37.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:36 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:54:37.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:36 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi100.akmstb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-05T09:54:37.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:36 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi100.akmstb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-05T09:54:37.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:36 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:54:37.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:36 smithi100 ceph-mon[107145]: Deploying daemon mds.cephfs.smithi100.akmstb on smithi100 2023-12-05T09:54:37.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:36 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/3037381653' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2023-12-05T09:54:37.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:36 smithi100 ceph-mon[107145]: mds.? [v2:172.21.15.150:6824/3645854543,v1:172.21.15.150:6825/3645854543] up:boot 2023-12-05T09:54:37.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:36 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/3037381653' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2023-12-05T09:54:37.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:36 smithi100 ceph-mon[107145]: fsmap cephfs:1 {0=cephfs.smithi100.sqplhn=up:active} 1 up:standby 2023-12-05T09:54:37.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:36 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi150.pcbpxm"}]: dispatch 2023-12-05T09:54:37.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:36 smithi100 ceph-mon[107145]: fsmap cephfs:1 {0=cephfs.smithi100.sqplhn=up:active} 1 up:standby 2023-12-05T09:54:37.177 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-05T09:54:37.186 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi100.front.sepia.ceph.com 2023-12-05T09:54:37.187 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- bash -c 'ceph fs set cephfs allow_standby_replay false' 2023-12-05T09:54:37.658 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi100/config 2023-12-05T09:54:37.969 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:37 smithi100 ceph-mon[107145]: pgmap v156: 65 pgs: 3 creating+peering, 62 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 0 B/s wr, 2 op/s 2023-12-05T09:54:38.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:37 smithi150 ceph-mon[116142]: pgmap v156: 65 pgs: 3 creating+peering, 62 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 0 B/s wr, 2 op/s 2023-12-05T09:54:39.135 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:39.137+0000 7feeaefdb700 1 -- 172.21.15.100:0/1550176267 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feea8070570 msgr2=0x7feea80709c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:39.135 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:39.137+0000 7feeaefdb700 1 --2- 172.21.15.100:0/1550176267 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feea8070570 0x7feea80709c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fee94004940 tx=0x7fee94009e30 comp rx=0 tx=0).stop 2023-12-05T09:54:39.135 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:39.137+0000 7feeaefdb700 1 -- 172.21.15.100:0/1550176267 shutdown_connections 2023-12-05T09:54:39.135 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:39.137+0000 7feeaefdb700 1 --2- 172.21.15.100:0/1550176267 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feea8070570 0x7feea80709c0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:39.135 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:39.137+0000 7feeaefdb700 1 --2- 172.21.15.100:0/1550176267 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feea8071bc0 0x7feea8070030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:39.136 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:39.137+0000 7feeaefdb700 1 -- 172.21.15.100:0/1550176267 >> 172.21.15.100:0/1550176267 conn(0x7feea80f82d0 msgr2=0x7feea80fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:54:39.136 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:39.137+0000 7feeaefdb700 1 -- 172.21.15.100:0/1550176267 shutdown_connections 2023-12-05T09:54:39.136 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:39.137+0000 7feeaefdb700 1 -- 172.21.15.100:0/1550176267 wait complete. 2023-12-05T09:54:39.137 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:39.138+0000 7feeaefdb700 1 Processor -- start 2023-12-05T09:54:39.137 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:39.139+0000 7feeaefdb700 1 -- start start 2023-12-05T09:54:39.138 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:39.139+0000 7feeaefdb700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feea8070570 0x7feea8113ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:39.138 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:39.139+0000 7feeaefdb700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feea8071bc0 0x7feea8114000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:39.138 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:39.139+0000 7feeaefdb700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea8114600 con 0x7feea8071bc0 2023-12-05T09:54:39.138 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:39.139+0000 7feeaefdb700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea8114ea0 con 0x7feea8070570 2023-12-05T09:54:39.138 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:39.139+0000 7feea7fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feea8071bc0 0x7feea8114000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:39.138 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:39.140+0000 7feeacd77700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feea8070570 0x7feea8113ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:39.138 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:39.140+0000 7feea7fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feea8071bc0 0x7feea8114000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54186/0 (socket says 172.21.15.100:54186) 2023-12-05T09:54:39.138 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:39.140+0000 7feea7fff700 1 -- 172.21.15.100:0/3046877481 learned_addr learned my addr 172.21.15.100:0/3046877481 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:54:39.138 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:39.140+0000 7feea7fff700 1 -- 172.21.15.100:0/3046877481 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feea8070570 msgr2=0x7feea8113ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:39.138 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:39.140+0000 7feea7fff700 1 --2- 172.21.15.100:0/3046877481 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feea8070570 0x7feea8113ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:39.139 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:39.140+0000 7feea7fff700 1 -- 172.21.15.100:0/3046877481 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee94005040 con 0x7feea8071bc0 2023-12-05T09:54:39.139 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:39.140+0000 7feea7fff700 1 --2- 172.21.15.100:0/3046877481 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feea8071bc0 0x7feea8114000 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fee94009fd0 tx=0x7fee94009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:54:39.139 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:39.140+0000 7feea57fa700 1 -- 172.21.15.100:0/3046877481 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee94021070 con 0x7feea8071bc0 2023-12-05T09:54:39.139 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:39.140+0000 7feea57fa700 1 -- 172.21.15.100:0/3046877481 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fee9401c400 con 0x7feea8071bc0 2023-12-05T09:54:39.140 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:39.140+0000 7feeaefdb700 1 -- 172.21.15.100:0/3046877481 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feea8115120 con 0x7feea8071bc0 2023-12-05T09:54:39.140 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:39.140+0000 7feea57fa700 1 -- 172.21.15.100:0/3046877481 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee9400e070 con 0x7feea8071bc0 2023-12-05T09:54:39.140 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:39.140+0000 7feeaefdb700 1 -- 172.21.15.100:0/3046877481 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feea8115660 con 0x7feea8071bc0 2023-12-05T09:54:39.140 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:39.142+0000 7feeaefdb700 1 -- 172.21.15.100:0/3046877481 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feea804bb80 con 0x7feea8071bc0 2023-12-05T09:54:39.141 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:39.143+0000 7feea57fa700 1 -- 172.21.15.100:0/3046877481 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7fee9401c570 con 0x7feea8071bc0 2023-12-05T09:54:39.141 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:39.143+0000 7feea57fa700 1 --2- 172.21.15.100:0/3046877481 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fee98068f70 0x7fee9806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:39.141 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:39.143+0000 7feea57fa700 1 -- 172.21.15.100:0/3046877481 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fee940880b0 con 0x7feea8071bc0 2023-12-05T09:54:39.141 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:39.144+0000 7feeacd77700 1 --2- 172.21.15.100:0/3046877481 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fee98068f70 0x7fee9806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:39.141 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:39.144+0000 7feeacd77700 1 --2- 172.21.15.100:0/3046877481 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fee98068f70 0x7fee9806b420 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fee9c009b80 tx=0x7fee9c00b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:54:39.145 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:39.148+0000 7feea57fa700 1 -- 172.21.15.100:0/3046877481 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fee94057f70 con 0x7feea8071bc0 2023-12-05T09:54:39.386 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:39.388+0000 7feeaefdb700 1 -- 172.21.15.100:0/3046877481 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7feea8115a50 con 0x7feea8071bc0 2023-12-05T09:54:39.800 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:39.802+0000 7feea57fa700 1 -- 172.21.15.100:0/3046877481 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) v1 ==== 122+0+0 (secure 0 0 0) 0x7fee94057b00 con 0x7feea8071bc0 2023-12-05T09:54:39.802 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:39.805+0000 7feeaefdb700 1 -- 172.21.15.100:0/3046877481 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fee98068f70 msgr2=0x7fee9806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:39.802 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:39.805+0000 7feeaefdb700 1 --2- 172.21.15.100:0/3046877481 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fee98068f70 0x7fee9806b420 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fee9c009b80 tx=0x7fee9c00b040 comp rx=0 tx=0).stop 2023-12-05T09:54:39.805 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:39.805+0000 7feeaefdb700 1 -- 172.21.15.100:0/3046877481 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feea8071bc0 msgr2=0x7feea8114000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:39.805 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:39.805+0000 7feeaefdb700 1 --2- 172.21.15.100:0/3046877481 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feea8071bc0 0x7feea8114000 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fee94009fd0 tx=0x7fee94009e30 comp rx=0 tx=0).stop 2023-12-05T09:54:39.805 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:39.805+0000 7feeaefdb700 1 -- 172.21.15.100:0/3046877481 shutdown_connections 2023-12-05T09:54:39.806 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:39.805+0000 7feeaefdb700 1 --2- 172.21.15.100:0/3046877481 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fee98068f70 0x7fee9806b420 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:39.806 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:39.805+0000 7feeaefdb700 1 --2- 172.21.15.100:0/3046877481 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feea8070570 0x7feea8113ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:39.806 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:39.805+0000 7feeaefdb700 1 --2- 172.21.15.100:0/3046877481 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feea8071bc0 0x7feea8114000 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:39.806 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:39.805+0000 7feeaefdb700 1 -- 172.21.15.100:0/3046877481 >> 172.21.15.100:0/3046877481 conn(0x7feea80f82d0 msgr2=0x7feea80fa640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:54:39.806 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:39.805+0000 7feeaefdb700 1 -- 172.21.15.100:0/3046877481 shutdown_connections 2023-12-05T09:54:39.806 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:39.805+0000 7feeaefdb700 1 -- 172.21.15.100:0/3046877481 wait complete. 2023-12-05T09:54:40.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:39 smithi150 ceph-mon[116142]: pgmap v157: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 404 B/s wr, 3 op/s 2023-12-05T09:54:40.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:39 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:54:40.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:39 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:54:40.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:39 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:54:40.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:39 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi150.fcnhsv", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-05T09:54:40.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:39 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi150.fcnhsv", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-05T09:54:40.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:39 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:54:40.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:39 smithi150 ceph-mon[116142]: from='client.? 172.21.15.100:0/3046877481' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2023-12-05T09:54:40.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:39 smithi100 ceph-mon[107145]: pgmap v157: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 404 B/s wr, 3 op/s 2023-12-05T09:54:40.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:39 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:54:40.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:39 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:54:40.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:39 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:54:40.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:39 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi150.fcnhsv", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-05T09:54:40.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:39 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi150.fcnhsv", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-05T09:54:40.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:39 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:54:40.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:39 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/3046877481' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2023-12-05T09:54:40.235 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-05T09:54:40.245 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi100.front.sepia.ceph.com 2023-12-05T09:54:40.246 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- bash -c 'ceph fs set cephfs inline_data false' 2023-12-05T09:54:40.673 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi100/config 2023-12-05T09:54:40.878 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:40 smithi150 ceph-mon[116142]: Deploying daemon mds.cephfs.smithi150.fcnhsv on smithi150 2023-12-05T09:54:40.879 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:40 smithi150 ceph-mon[116142]: mds.? [v2:172.21.15.100:6828/627555128,v1:172.21.15.100:6829/627555128] up:boot 2023-12-05T09:54:40.879 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:40 smithi150 ceph-mon[116142]: from='client.? 172.21.15.100:0/3046877481' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2023-12-05T09:54:40.879 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:40 smithi150 ceph-mon[116142]: fsmap cephfs:1 {0=cephfs.smithi100.sqplhn=up:active} 2 up:standby 2023-12-05T09:54:40.879 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:40 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi100.akmstb"}]: dispatch 2023-12-05T09:54:41.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:40 smithi100 ceph-mon[107145]: Deploying daemon mds.cephfs.smithi150.fcnhsv on smithi150 2023-12-05T09:54:41.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:40 smithi100 ceph-mon[107145]: mds.? [v2:172.21.15.100:6828/627555128,v1:172.21.15.100:6829/627555128] up:boot 2023-12-05T09:54:41.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:40 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/3046877481' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2023-12-05T09:54:41.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:40 smithi100 ceph-mon[107145]: fsmap cephfs:1 {0=cephfs.smithi100.sqplhn=up:active} 2 up:standby 2023-12-05T09:54:41.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:40 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi100.akmstb"}]: dispatch 2023-12-05T09:54:41.909 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:41.910+0000 7f6fbd304700 1 -- 172.21.15.100:0/1336995827 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6fb8071bc0 msgr2=0x7f6fb8070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:41.909 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:41.910+0000 7f6fbd304700 1 --2- 172.21.15.100:0/1336995827 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6fb8071bc0 0x7f6fb8070030 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6fa8004940 tx=0x7f6fa8009e30 comp rx=0 tx=0).stop 2023-12-05T09:54:41.909 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:41.910+0000 7f6fbd304700 1 -- 172.21.15.100:0/1336995827 shutdown_connections 2023-12-05T09:54:41.909 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:41.910+0000 7f6fbd304700 1 --2- 172.21.15.100:0/1336995827 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6fb8070570 0x7f6fb80709c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:41.909 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:41.910+0000 7f6fbd304700 1 --2- 172.21.15.100:0/1336995827 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6fb8071bc0 0x7f6fb8070030 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:41.909 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:41.910+0000 7f6fbd304700 1 -- 172.21.15.100:0/1336995827 >> 172.21.15.100:0/1336995827 conn(0x7f6fb80f82d0 msgr2=0x7f6fb80fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:54:41.909 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:41.910+0000 7f6fbd304700 1 -- 172.21.15.100:0/1336995827 shutdown_connections 2023-12-05T09:54:41.909 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:41.910+0000 7f6fbd304700 1 -- 172.21.15.100:0/1336995827 wait complete. 2023-12-05T09:54:41.909 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:41.911+0000 7f6fbd304700 1 Processor -- start 2023-12-05T09:54:41.909 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:41.911+0000 7f6fbd304700 1 -- start start 2023-12-05T09:54:41.909 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:41.911+0000 7f6fbd304700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6fb8070570 0x7f6fb8113aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:41.910 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:41.911+0000 7f6fbd304700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6fb8071bc0 0x7f6fb8113fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:41.910 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:41.911+0000 7f6fbd304700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb81145e0 con 0x7f6fb8070570 2023-12-05T09:54:41.910 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:41.911+0000 7f6fbd304700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb8114e80 con 0x7f6fb8071bc0 2023-12-05T09:54:41.910 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:41.911+0000 7f6fb6ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6fb8070570 0x7f6fb8113aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:41.910 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:41.911+0000 7f6fb6ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6fb8070570 0x7f6fb8113aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57600/0 (socket says 172.21.15.100:57600) 2023-12-05T09:54:41.910 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:41.911+0000 7f6fb6ffd700 1 -- 172.21.15.100:0/2410634720 learned_addr learned my addr 172.21.15.100:0/2410634720 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:54:41.910 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:41.911+0000 7f6fb67fc700 1 --2- 172.21.15.100:0/2410634720 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6fb8071bc0 0x7f6fb8113fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:41.911 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:41.912+0000 7f6fb6ffd700 1 -- 172.21.15.100:0/2410634720 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6fb8071bc0 msgr2=0x7f6fb8113fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:41.911 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:41.912+0000 7f6fb6ffd700 1 --2- 172.21.15.100:0/2410634720 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6fb8071bc0 0x7f6fb8113fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:41.911 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:41.912+0000 7f6fb6ffd700 1 -- 172.21.15.100:0/2410634720 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa8005040 con 0x7f6fb8070570 2023-12-05T09:54:41.911 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:41.912+0000 7f6fb6ffd700 1 --2- 172.21.15.100:0/2410634720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6fb8070570 0x7f6fb8113aa0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6fa8009fd0 tx=0x7f6fa8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:54:41.911 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:41.912+0000 7f6f9f7fe700 1 -- 172.21.15.100:0/2410634720 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6fa8021070 con 0x7f6fb8070570 2023-12-05T09:54:41.911 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:41.912+0000 7f6f9f7fe700 1 -- 172.21.15.100:0/2410634720 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6fa801c400 con 0x7f6fb8070570 2023-12-05T09:54:41.912 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:41.912+0000 7f6f9f7fe700 1 -- 172.21.15.100:0/2410634720 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6fa800e070 con 0x7f6fb8070570 2023-12-05T09:54:41.912 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:41.912+0000 7f6fbd304700 1 -- 172.21.15.100:0/2410634720 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fb8115100 con 0x7f6fb8070570 2023-12-05T09:54:41.912 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:41.913+0000 7f6fbd304700 1 -- 172.21.15.100:0/2410634720 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fb8115640 con 0x7f6fb8070570 2023-12-05T09:54:41.912 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:41.914+0000 7f6fbd304700 1 -- 172.21.15.100:0/2410634720 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fb804bb80 con 0x7f6fb8070570 2023-12-05T09:54:41.912 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:41.915+0000 7f6f9f7fe700 1 -- 172.21.15.100:0/2410634720 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f6fa801c570 con 0x7f6fb8070570 2023-12-05T09:54:41.913 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:41.916+0000 7f6f9f7fe700 1 --2- 172.21.15.100:0/2410634720 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f6fa0068f70 0x7f6fa006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:41.913 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:41.916+0000 7f6f9f7fe700 1 -- 172.21.15.100:0/2410634720 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f6fa8087f60 con 0x7f6fb8070570 2023-12-05T09:54:41.913 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:41.916+0000 7f6fb67fc700 1 --2- 172.21.15.100:0/2410634720 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f6fa0068f70 0x7f6fa006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:41.914 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:41.916+0000 7f6fb67fc700 1 --2- 172.21.15.100:0/2410634720 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f6fa0068f70 0x7f6fa006b420 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6fac009b80 tx=0x7f6fac00b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:54:41.917 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:41.920+0000 7f6f9f7fe700 1 -- 172.21.15.100:0/2410634720 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f6fa80b9a00 con 0x7f6fb8070570 2023-12-05T09:54:42.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:41 smithi150 ceph-mon[116142]: pgmap v158: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s wr, 5 op/s 2023-12-05T09:54:42.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:41 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:54:42.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:41 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:54:42.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:41 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:54:42.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:41 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:54:42.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:41 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:54:42.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:41 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:54:42.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:41 smithi100 ceph-mon[107145]: pgmap v158: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s wr, 5 op/s 2023-12-05T09:54:42.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:41 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:54:42.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:41 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:54:42.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:41 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:54:42.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:41 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:54:42.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:41 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:54:42.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:41 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:54:42.163 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:42.166+0000 7f6fbd304700 1 -- 172.21.15.100:0/2410634720 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"} v 0) v1 -- 0x7f6fb8115af0 con 0x7f6fb8070570 2023-12-05T09:54:42.823 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:42.825+0000 7f6f9f7fe700 1 -- 172.21.15.100:0/2410634720 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]=0 inline data disabled v9) v1 ==== 133+0+0 (secure 0 0 0) 0x7f6fa8057f60 con 0x7f6fb8070570 2023-12-05T09:54:42.826 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:42.828+0000 7f6fbd304700 1 -- 172.21.15.100:0/2410634720 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f6fa0068f70 msgr2=0x7f6fa006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:42.826 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:42.828+0000 7f6fbd304700 1 --2- 172.21.15.100:0/2410634720 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f6fa0068f70 0x7f6fa006b420 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6fac009b80 tx=0x7f6fac00b040 comp rx=0 tx=0).stop 2023-12-05T09:54:42.826 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:42.828+0000 7f6fbd304700 1 -- 172.21.15.100:0/2410634720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6fb8070570 msgr2=0x7f6fb8113aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:42.826 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:42.828+0000 7f6fbd304700 1 --2- 172.21.15.100:0/2410634720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6fb8070570 0x7f6fb8113aa0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6fa8009fd0 tx=0x7f6fa8009e30 comp rx=0 tx=0).stop 2023-12-05T09:54:42.826 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:42.829+0000 7f6fbd304700 1 -- 172.21.15.100:0/2410634720 shutdown_connections 2023-12-05T09:54:42.827 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:42.829+0000 7f6fbd304700 1 --2- 172.21.15.100:0/2410634720 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f6fa0068f70 0x7f6fa006b420 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:42.827 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:42.829+0000 7f6fbd304700 1 --2- 172.21.15.100:0/2410634720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6fb8070570 0x7f6fb8113aa0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:42.827 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:42.829+0000 7f6fbd304700 1 --2- 172.21.15.100:0/2410634720 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6fb8071bc0 0x7f6fb8113fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:42.827 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:42.829+0000 7f6fbd304700 1 -- 172.21.15.100:0/2410634720 >> 172.21.15.100:0/2410634720 conn(0x7f6fb80f82d0 msgr2=0x7f6fb80fe630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:54:42.827 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:42.829+0000 7f6fbd304700 1 -- 172.21.15.100:0/2410634720 shutdown_connections 2023-12-05T09:54:42.827 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:42.829+0000 7f6fbd304700 1 -- 172.21.15.100:0/2410634720 wait complete. 2023-12-05T09:54:42.827 INFO:teuthology.orchestra.run.smithi100.stderr:inline data disabled 2023-12-05T09:54:43.003 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:42 smithi100 ceph-mon[107145]: mds.? [v2:172.21.15.150:6826/3249949736,v1:172.21.15.150:6827/3249949736] up:boot 2023-12-05T09:54:43.003 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:42 smithi100 ceph-mon[107145]: fsmap cephfs:1 {0=cephfs.smithi100.sqplhn=up:active} 3 up:standby 2023-12-05T09:54:43.003 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:42 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi150.fcnhsv"}]: dispatch 2023-12-05T09:54:43.003 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:42 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/2410634720' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2023-12-05T09:54:43.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:42 smithi150 ceph-mon[116142]: mds.? [v2:172.21.15.150:6826/3249949736,v1:172.21.15.150:6827/3249949736] up:boot 2023-12-05T09:54:43.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:42 smithi150 ceph-mon[116142]: fsmap cephfs:1 {0=cephfs.smithi100.sqplhn=up:active} 3 up:standby 2023-12-05T09:54:43.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:42 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi150.fcnhsv"}]: dispatch 2023-12-05T09:54:43.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:42 smithi150 ceph-mon[116142]: from='client.? 172.21.15.100:0/2410634720' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2023-12-05T09:54:43.271 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-05T09:54:43.281 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi100.front.sepia.ceph.com 2023-12-05T09:54:43.282 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- bash -c 'ceph fs dump' 2023-12-05T09:54:43.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:43 smithi100 ceph-mon[107145]: pgmap v159: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s wr, 4 op/s 2023-12-05T09:54:43.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:43 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/2410634720' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2023-12-05T09:54:43.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:43 smithi100 ceph-mon[107145]: fsmap cephfs:1 {0=cephfs.smithi100.sqplhn=up:active} 3 up:standby 2023-12-05T09:54:43.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:43 smithi100 ceph-mon[107145]: Dropping low affinity active daemon mds.cephfs.smithi100.sqplhn in favor of higher affinity standby. 2023-12-05T09:54:43.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:43 smithi100 ceph-mon[107145]: Replacing daemon mds.cephfs.smithi100.sqplhn as rank 0 with standby daemon mds.cephfs.smithi100.akmstb 2023-12-05T09:54:43.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:43 smithi100 ceph-mon[107145]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-12-05T09:54:43.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:43 smithi100 ceph-mon[107145]: osdmap e46: 6 total, 6 up, 6 in 2023-12-05T09:54:43.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:43 smithi100 ceph-mon[107145]: mds.? [v2:172.21.15.100:6828/627555128,v1:172.21.15.100:6829/627555128] up:standby 2023-12-05T09:54:43.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:43 smithi100 ceph-mon[107145]: fsmap cephfs:1/1 {0=cephfs.smithi100.akmstb=up:replay} 2 up:standby 2023-12-05T09:54:43.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:43 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi100.sqplhn"}]: dispatch 2023-12-05T09:54:43.962 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi100/config 2023-12-05T09:54:44.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:43 smithi150 ceph-mon[116142]: pgmap v159: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s wr, 4 op/s 2023-12-05T09:54:44.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:43 smithi150 ceph-mon[116142]: from='client.? 172.21.15.100:0/2410634720' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2023-12-05T09:54:44.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:43 smithi150 ceph-mon[116142]: fsmap cephfs:1 {0=cephfs.smithi100.sqplhn=up:active} 3 up:standby 2023-12-05T09:54:44.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:43 smithi150 ceph-mon[116142]: Dropping low affinity active daemon mds.cephfs.smithi100.sqplhn in favor of higher affinity standby. 2023-12-05T09:54:44.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:43 smithi150 ceph-mon[116142]: Replacing daemon mds.cephfs.smithi100.sqplhn as rank 0 with standby daemon mds.cephfs.smithi100.akmstb 2023-12-05T09:54:44.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:43 smithi150 ceph-mon[116142]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-12-05T09:54:44.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:43 smithi150 ceph-mon[116142]: osdmap e46: 6 total, 6 up, 6 in 2023-12-05T09:54:44.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:43 smithi150 ceph-mon[116142]: mds.? [v2:172.21.15.100:6828/627555128,v1:172.21.15.100:6829/627555128] up:standby 2023-12-05T09:54:44.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:43 smithi150 ceph-mon[116142]: fsmap cephfs:1/1 {0=cephfs.smithi100.akmstb=up:replay} 2 up:standby 2023-12-05T09:54:44.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:43 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi100.sqplhn"}]: dispatch 2023-12-05T09:54:45.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:44 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:54:45.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:44 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:54:45.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:44 smithi100 ceph-mon[107145]: mds.? [v2:172.21.15.100:6828/627555128,v1:172.21.15.100:6829/627555128] up:reconnect 2023-12-05T09:54:45.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:44 smithi100 ceph-mon[107145]: mds.? [v2:172.21.15.100:6826/2472212864,v1:172.21.15.100:6827/2472212864] up:boot 2023-12-05T09:54:45.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:44 smithi100 ceph-mon[107145]: mds.? [v2:172.21.15.150:6824/3645854543,v1:172.21.15.150:6825/3645854543] up:standby 2023-12-05T09:54:45.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:44 smithi100 ceph-mon[107145]: fsmap cephfs:1/1 {0=cephfs.smithi100.akmstb=up:reconnect} 3 up:standby 2023-12-05T09:54:45.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:44 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi100.sqplhn"}]: dispatch 2023-12-05T09:54:45.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:44 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:54:45.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:44 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:54:45.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:44 smithi150 ceph-mon[116142]: mds.? [v2:172.21.15.100:6828/627555128,v1:172.21.15.100:6829/627555128] up:reconnect 2023-12-05T09:54:45.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:44 smithi150 ceph-mon[116142]: mds.? [v2:172.21.15.100:6826/2472212864,v1:172.21.15.100:6827/2472212864] up:boot 2023-12-05T09:54:45.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:44 smithi150 ceph-mon[116142]: mds.? [v2:172.21.15.150:6824/3645854543,v1:172.21.15.150:6825/3645854543] up:standby 2023-12-05T09:54:45.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:44 smithi150 ceph-mon[116142]: fsmap cephfs:1/1 {0=cephfs.smithi100.akmstb=up:reconnect} 3 up:standby 2023-12-05T09:54:45.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:44 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi100.sqplhn"}]: dispatch 2023-12-05T09:54:45.520 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:45.522+0000 7fd85f238700 1 -- 172.21.15.100:0/2345678030 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8580fdaa0 msgr2=0x7fd8580fff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:45.520 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:45.522+0000 7fd85f238700 1 --2- 172.21.15.100:0/2345678030 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8580fdaa0 0x7fd8580fff20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd848004940 tx=0x7fd848009e30 comp rx=0 tx=0).stop 2023-12-05T09:54:45.520 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:45.522+0000 7fd85f238700 1 -- 172.21.15.100:0/2345678030 shutdown_connections 2023-12-05T09:54:45.520 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:45.522+0000 7fd85f238700 1 --2- 172.21.15.100:0/2345678030 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8580fdaa0 0x7fd8580fff20 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:45.520 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:45.522+0000 7fd85f238700 1 --2- 172.21.15.100:0/2345678030 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd858066050 0x7fd8580fd560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:45.520 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:45.522+0000 7fd85f238700 1 -- 172.21.15.100:0/2345678030 >> 172.21.15.100:0/2345678030 conn(0x7fd8580f71e0 msgr2=0x7fd8580f9610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:54:45.520 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:45.522+0000 7fd85f238700 1 -- 172.21.15.100:0/2345678030 shutdown_connections 2023-12-05T09:54:45.520 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:45.522+0000 7fd85f238700 1 -- 172.21.15.100:0/2345678030 wait complete. 2023-12-05T09:54:45.522 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:45.523+0000 7fd85f238700 1 Processor -- start 2023-12-05T09:54:45.522 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:45.523+0000 7fd85f238700 1 -- start start 2023-12-05T09:54:45.522 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:45.523+0000 7fd85f238700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd858066050 0x7fd8581139f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:45.522 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:45.523+0000 7fd85f238700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8580fdaa0 0x7fd858113f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:45.522 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:45.523+0000 7fd85f238700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd858114530 con 0x7fd8580fdaa0 2023-12-05T09:54:45.522 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:45.523+0000 7fd85f238700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd858114dd0 con 0x7fd858066050 2023-12-05T09:54:45.522 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:45.524+0000 7fd84ffff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8580fdaa0 0x7fd858113f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:45.522 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:45.524+0000 7fd84ffff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8580fdaa0 0x7fd858113f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57648/0 (socket says 172.21.15.100:57648) 2023-12-05T09:54:45.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:45.524+0000 7fd84ffff700 1 -- 172.21.15.100:0/2866297022 learned_addr learned my addr 172.21.15.100:0/2866297022 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:54:45.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:45.524+0000 7fd85cfd4700 1 --2- 172.21.15.100:0/2866297022 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd858066050 0x7fd8581139f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:45.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:45.524+0000 7fd84ffff700 1 -- 172.21.15.100:0/2866297022 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd858066050 msgr2=0x7fd8581139f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:45.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:45.524+0000 7fd84ffff700 1 --2- 172.21.15.100:0/2866297022 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd858066050 0x7fd8581139f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:45.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:45.524+0000 7fd84ffff700 1 -- 172.21.15.100:0/2866297022 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd848005040 con 0x7fd8580fdaa0 2023-12-05T09:54:45.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:45.524+0000 7fd85cfd4700 1 --2- 172.21.15.100:0/2866297022 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd858066050 0x7fd8581139f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-05T09:54:45.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:45.524+0000 7fd84ffff700 1 --2- 172.21.15.100:0/2866297022 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8580fdaa0 0x7fd858113f30 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd848008f90 tx=0x7fd848009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:54:45.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:45.524+0000 7fd84d7fa700 1 -- 172.21.15.100:0/2866297022 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd848021070 con 0x7fd8580fdaa0 2023-12-05T09:54:45.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:45.525+0000 7fd84d7fa700 1 -- 172.21.15.100:0/2866297022 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd84801c400 con 0x7fd8580fdaa0 2023-12-05T09:54:45.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:45.525+0000 7fd85f238700 1 -- 172.21.15.100:0/2866297022 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd858115050 con 0x7fd8580fdaa0 2023-12-05T09:54:45.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:45.525+0000 7fd84d7fa700 1 -- 172.21.15.100:0/2866297022 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd84800e030 con 0x7fd8580fdaa0 2023-12-05T09:54:45.524 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:45.525+0000 7fd85f238700 1 -- 172.21.15.100:0/2866297022 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd858115590 con 0x7fd8580fdaa0 2023-12-05T09:54:45.524 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:45.526+0000 7fd85f238700 1 -- 172.21.15.100:0/2866297022 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd85810dba0 con 0x7fd8580fdaa0 2023-12-05T09:54:45.524 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:45.527+0000 7fd84d7fa700 1 -- 172.21.15.100:0/2866297022 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7fd84801ca00 con 0x7fd8580fdaa0 2023-12-05T09:54:45.525 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:45.527+0000 7fd84d7fa700 1 --2- 172.21.15.100:0/2866297022 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fd840068f70 0x7fd84006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:45.525 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:45.528+0000 7fd84d7fa700 1 -- 172.21.15.100:0/2866297022 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fd848088160 con 0x7fd8580fdaa0 2023-12-05T09:54:45.525 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:45.528+0000 7fd85cfd4700 1 --2- 172.21.15.100:0/2866297022 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fd840068f70 0x7fd84006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:45.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:45.528+0000 7fd85cfd4700 1 --2- 172.21.15.100:0/2866297022 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fd840068f70 0x7fd84006b420 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd854004600 tx=0x7fd85400b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:54:45.529 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:45.532+0000 7fd84d7fa700 1 -- 172.21.15.100:0/2866297022 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fd848058090 con 0x7fd8580fdaa0 2023-12-05T09:54:45.787 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:45.790+0000 7fd85f238700 1 -- 172.21.15.100:0/2866297022 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd85810bb60 con 0x7fd8580fdaa0 2023-12-05T09:54:45.788 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:45.790+0000 7fd84d7fa700 1 -- 172.21.15.100:0/2866297022 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 12 v12) v1 ==== 76+0+1814 (secure 0 0 0) 0x7fd848057c20 con 0x7fd8580fdaa0 2023-12-05T09:54:45.788 INFO:teuthology.orchestra.run.smithi100.stdout:e12 2023-12-05T09:54:45.788 INFO:teuthology.orchestra.run.smithi100.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-05T09:54:45.788 INFO:teuthology.orchestra.run.smithi100.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T09:54:45.788 INFO:teuthology.orchestra.run.smithi100.stdout:legacy client fscid: 1 2023-12-05T09:54:45.788 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:54:45.788 INFO:teuthology.orchestra.run.smithi100.stdout:Filesystem 'cephfs' (1) 2023-12-05T09:54:45.789 INFO:teuthology.orchestra.run.smithi100.stdout:fs_name cephfs 2023-12-05T09:54:45.789 INFO:teuthology.orchestra.run.smithi100.stdout:epoch 12 2023-12-05T09:54:45.789 INFO:teuthology.orchestra.run.smithi100.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-05T09:54:45.789 INFO:teuthology.orchestra.run.smithi100.stdout:created 2023-12-05T09:54:30.515778+0000 2023-12-05T09:54:45.789 INFO:teuthology.orchestra.run.smithi100.stdout:modified 2023-12-05T09:54:45.401349+0000 2023-12-05T09:54:45.789 INFO:teuthology.orchestra.run.smithi100.stdout:tableserver 0 2023-12-05T09:54:45.789 INFO:teuthology.orchestra.run.smithi100.stdout:root 0 2023-12-05T09:54:45.789 INFO:teuthology.orchestra.run.smithi100.stdout:session_timeout 60 2023-12-05T09:54:45.789 INFO:teuthology.orchestra.run.smithi100.stdout:session_autoclose 300 2023-12-05T09:54:45.789 INFO:teuthology.orchestra.run.smithi100.stdout:max_file_size 1099511627776 2023-12-05T09:54:45.789 INFO:teuthology.orchestra.run.smithi100.stdout:required_client_features {} 2023-12-05T09:54:45.789 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure 0 2023-12-05T09:54:45.789 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure_osd_epoch 46 2023-12-05T09:54:45.789 INFO:teuthology.orchestra.run.smithi100.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T09:54:45.789 INFO:teuthology.orchestra.run.smithi100.stdout:max_mds 1 2023-12-05T09:54:45.789 INFO:teuthology.orchestra.run.smithi100.stdout:in 0 2023-12-05T09:54:45.790 INFO:teuthology.orchestra.run.smithi100.stdout:up {0=14490} 2023-12-05T09:54:45.790 INFO:teuthology.orchestra.run.smithi100.stdout:failed 2023-12-05T09:54:45.790 INFO:teuthology.orchestra.run.smithi100.stdout:damaged 2023-12-05T09:54:45.790 INFO:teuthology.orchestra.run.smithi100.stdout:stopped 2023-12-05T09:54:45.790 INFO:teuthology.orchestra.run.smithi100.stdout:data_pools [3] 2023-12-05T09:54:45.790 INFO:teuthology.orchestra.run.smithi100.stdout:metadata_pool 2 2023-12-05T09:54:45.790 INFO:teuthology.orchestra.run.smithi100.stdout:inline_data disabled 2023-12-05T09:54:45.790 INFO:teuthology.orchestra.run.smithi100.stdout:balancer 2023-12-05T09:54:45.790 INFO:teuthology.orchestra.run.smithi100.stdout:standby_count_wanted 1 2023-12-05T09:54:45.790 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi100.akmstb{0:14490} state up:rejoin seq 4 join_fscid=1 addr [v2:172.21.15.100:6828/627555128,v1:172.21.15.100:6829/627555128] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:54:45.790 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:54:45.790 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:54:45.790 INFO:teuthology.orchestra.run.smithi100.stdout:Standby daemons: 2023-12-05T09:54:45.790 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:54:45.791 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi150.pcbpxm{-1:14486} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.150:6824/3645854543,v1:172.21.15.150:6825/3645854543] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:54:45.791 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi150.fcnhsv{-1:14498} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.150:6826/3249949736,v1:172.21.15.150:6827/3249949736] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:54:45.791 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi100.sqplhn{-1:14506} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.100:6826/2472212864,v1:172.21.15.100:6827/2472212864] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:54:45.791 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:45.793+0000 7fd85f238700 1 -- 172.21.15.100:0/2866297022 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fd840068f70 msgr2=0x7fd84006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:45.791 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:45.793+0000 7fd85f238700 1 --2- 172.21.15.100:0/2866297022 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fd840068f70 0x7fd84006b420 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd854004600 tx=0x7fd85400b040 comp rx=0 tx=0).stop 2023-12-05T09:54:45.792 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:45.793+0000 7fd85f238700 1 -- 172.21.15.100:0/2866297022 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8580fdaa0 msgr2=0x7fd858113f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:45.792 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:45.793+0000 7fd85f238700 1 --2- 172.21.15.100:0/2866297022 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8580fdaa0 0x7fd858113f30 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd848008f90 tx=0x7fd848009e30 comp rx=0 tx=0).stop 2023-12-05T09:54:45.792 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:45.793+0000 7fd85f238700 1 -- 172.21.15.100:0/2866297022 shutdown_connections 2023-12-05T09:54:45.792 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:45.793+0000 7fd85f238700 1 --2- 172.21.15.100:0/2866297022 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fd840068f70 0x7fd84006b420 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:45.792 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:45.793+0000 7fd85f238700 1 --2- 172.21.15.100:0/2866297022 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd858066050 0x7fd8581139f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:45.792 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:45.793+0000 7fd85f238700 1 --2- 172.21.15.100:0/2866297022 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8580fdaa0 0x7fd858113f30 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:45.792 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:45.793+0000 7fd85f238700 1 -- 172.21.15.100:0/2866297022 >> 172.21.15.100:0/2866297022 conn(0x7fd8580f71e0 msgr2=0x7fd8580f9610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:54:45.792 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:45.793+0000 7fd85f238700 1 -- 172.21.15.100:0/2866297022 shutdown_connections 2023-12-05T09:54:45.792 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:45.793+0000 7fd85f238700 1 -- 172.21.15.100:0/2866297022 wait complete. 2023-12-05T09:54:45.792 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 12 2023-12-05T09:54:46.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:45 smithi100 ceph-mon[107145]: pgmap v161: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s wr, 4 op/s 2023-12-05T09:54:46.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:45 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:54:46.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:45 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:54:46.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:45 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:54:46.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:45 smithi100 ceph-mon[107145]: mds.? [v2:172.21.15.100:6828/627555128,v1:172.21.15.100:6829/627555128] up:rejoin 2023-12-05T09:54:46.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:45 smithi100 ceph-mon[107145]: mds.? [v2:172.21.15.150:6826/3249949736,v1:172.21.15.150:6827/3249949736] up:standby 2023-12-05T09:54:46.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:45 smithi100 ceph-mon[107145]: fsmap cephfs:1/1 {0=cephfs.smithi100.akmstb=up:rejoin} 3 up:standby 2023-12-05T09:54:46.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:45 smithi100 ceph-mon[107145]: daemon mds.cephfs.smithi100.akmstb is now active in filesystem cephfs as rank 0 2023-12-05T09:54:46.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:45 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/2866297022' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-05T09:54:46.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:45 smithi150 ceph-mon[116142]: pgmap v161: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s wr, 4 op/s 2023-12-05T09:54:46.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:45 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:54:46.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:45 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:54:46.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:45 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:54:46.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:45 smithi150 ceph-mon[116142]: mds.? [v2:172.21.15.100:6828/627555128,v1:172.21.15.100:6829/627555128] up:rejoin 2023-12-05T09:54:46.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:45 smithi150 ceph-mon[116142]: mds.? [v2:172.21.15.150:6826/3249949736,v1:172.21.15.150:6827/3249949736] up:standby 2023-12-05T09:54:46.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:45 smithi150 ceph-mon[116142]: fsmap cephfs:1/1 {0=cephfs.smithi100.akmstb=up:rejoin} 3 up:standby 2023-12-05T09:54:46.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:45 smithi150 ceph-mon[116142]: daemon mds.cephfs.smithi100.akmstb is now active in filesystem cephfs as rank 0 2023-12-05T09:54:46.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:45 smithi150 ceph-mon[116142]: from='client.? 172.21.15.100:0/2866297022' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-05T09:54:46.434 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2023-12-05T09:54:46.890 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi100/config 2023-12-05T09:54:47.236 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:46 smithi100 ceph-mon[107145]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-12-05T09:54:47.236 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:46 smithi100 ceph-mon[107145]: Cluster is now healthy 2023-12-05T09:54:47.236 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:46 smithi100 ceph-mon[107145]: mds.? [v2:172.21.15.100:6828/627555128,v1:172.21.15.100:6829/627555128] up:active 2023-12-05T09:54:47.236 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:46 smithi100 ceph-mon[107145]: fsmap cephfs:1 {0=cephfs.smithi100.akmstb=up:active} 3 up:standby 2023-12-05T09:54:47.236 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:46 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:54:47.236 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:46 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:54:47.236 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:46 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:54:47.236 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:46 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:54:47.236 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:46 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:54:47.345 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:46 smithi150 ceph-mon[116142]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-12-05T09:54:47.345 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:46 smithi150 ceph-mon[116142]: Cluster is now healthy 2023-12-05T09:54:47.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:46 smithi150 ceph-mon[116142]: mds.? [v2:172.21.15.100:6828/627555128,v1:172.21.15.100:6829/627555128] up:active 2023-12-05T09:54:47.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:46 smithi150 ceph-mon[116142]: fsmap cephfs:1 {0=cephfs.smithi100.akmstb=up:active} 3 up:standby 2023-12-05T09:54:47.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:46 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:54:47.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:46 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:54:47.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:46 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:54:47.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:46 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:54:47.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:46 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:54:48.230 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:48.231+0000 7f189bf79700 1 -- 172.21.15.100:0/1782607027 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18940fb520 msgr2=0x7f18940fd940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:48.230 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:48.231+0000 7f189bf79700 1 --2- 172.21.15.100:0/1782607027 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18940fb520 0x7f18940fd940 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1890004940 tx=0x7f1890009e30 comp rx=0 tx=0).stop 2023-12-05T09:54:48.230 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:48.231+0000 7f189bf79700 1 -- 172.21.15.100:0/1782607027 shutdown_connections 2023-12-05T09:54:48.230 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:48.231+0000 7f189bf79700 1 --2- 172.21.15.100:0/1782607027 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18940fde80 0x7f1894100300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:48.230 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:48.231+0000 7f189bf79700 1 --2- 172.21.15.100:0/1782607027 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18940fb520 0x7f18940fd940 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:48.230 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:48.231+0000 7f189bf79700 1 -- 172.21.15.100:0/1782607027 >> 172.21.15.100:0/1782607027 conn(0x7f18940f7190 msgr2=0x7f18940f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:54:48.230 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:48.232+0000 7f189bf79700 1 -- 172.21.15.100:0/1782607027 shutdown_connections 2023-12-05T09:54:48.230 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:48.232+0000 7f189bf79700 1 -- 172.21.15.100:0/1782607027 wait complete. 2023-12-05T09:54:48.231 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:48.233+0000 7f189bf79700 1 Processor -- start 2023-12-05T09:54:48.232 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:48.233+0000 7f189bf79700 1 -- start start 2023-12-05T09:54:48.232 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:48.233+0000 7f189bf79700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18940fb520 0x7f1894113ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:48.232 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:48.233+0000 7f189bf79700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18940fde80 0x7f1894114020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:48.232 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:48.233+0000 7f189bf79700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1894114620 con 0x7f18940fb520 2023-12-05T09:54:48.232 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:48.233+0000 7f189bf79700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1894114ec0 con 0x7f18940fde80 2023-12-05T09:54:48.232 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:48.234+0000 7f1899d15700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18940fb520 0x7f1894113ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:48.232 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:48.234+0000 7f1899d15700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18940fb520 0x7f1894113ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57670/0 (socket says 172.21.15.100:57670) 2023-12-05T09:54:48.232 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:48.234+0000 7f1899d15700 1 -- 172.21.15.100:0/869711092 learned_addr learned my addr 172.21.15.100:0/869711092 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:54:48.232 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:48.234+0000 7f1899514700 1 --2- 172.21.15.100:0/869711092 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18940fde80 0x7f1894114020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:48.232 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:48.234+0000 7f1899d15700 1 -- 172.21.15.100:0/869711092 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18940fde80 msgr2=0x7f1894114020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:48.232 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:48.234+0000 7f1899d15700 1 --2- 172.21.15.100:0/869711092 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18940fde80 0x7f1894114020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:48.232 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:48.234+0000 7f1899d15700 1 -- 172.21.15.100:0/869711092 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1890005040 con 0x7f18940fb520 2023-12-05T09:54:48.233 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:48.234+0000 7f1899d15700 1 --2- 172.21.15.100:0/869711092 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18940fb520 0x7f1894113ae0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1890009fd0 tx=0x7f1890009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:54:48.233 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:48.235+0000 7f188a7fc700 1 -- 172.21.15.100:0/869711092 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1890021070 con 0x7f18940fb520 2023-12-05T09:54:48.233 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:48.235+0000 7f188a7fc700 1 -- 172.21.15.100:0/869711092 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f189001c400 con 0x7f18940fb520 2023-12-05T09:54:48.233 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:48.235+0000 7f188a7fc700 1 -- 172.21.15.100:0/869711092 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f189000e070 con 0x7f18940fb520 2023-12-05T09:54:48.233 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:48.235+0000 7f189bf79700 1 -- 172.21.15.100:0/869711092 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1894115140 con 0x7f18940fb520 2023-12-05T09:54:48.233 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:48.235+0000 7f189bf79700 1 -- 172.21.15.100:0/869711092 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1894115680 con 0x7f18940fb520 2023-12-05T09:54:48.234 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:48.236+0000 7f189bf79700 1 -- 172.21.15.100:0/869711092 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f189404bb80 con 0x7f18940fb520 2023-12-05T09:54:48.234 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:48.237+0000 7f188a7fc700 1 -- 172.21.15.100:0/869711092 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f189001c570 con 0x7f18940fb520 2023-12-05T09:54:48.236 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:48.238+0000 7f188a7fc700 1 --2- 172.21.15.100:0/869711092 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f1880068f70 0x7f188006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:48.236 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:48.239+0000 7f188a7fc700 1 -- 172.21.15.100:0/869711092 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f1890087ff0 con 0x7f18940fb520 2023-12-05T09:54:48.236 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:48.239+0000 7f1899514700 1 --2- 172.21.15.100:0/869711092 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f1880068f70 0x7f188006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:48.237 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:48.239+0000 7f1899514700 1 --2- 172.21.15.100:0/869711092 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f1880068f70 0x7f188006b420 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1884009b80 tx=0x7f188400b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:54:48.240 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:48.243+0000 7f188a7fc700 1 -- 172.21.15.100:0/869711092 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f1890057f40 con 0x7f18940fb520 2023-12-05T09:54:48.345 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:47 smithi150 ceph-mon[116142]: pgmap v162: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s wr, 2 op/s 2023-12-05T09:54:48.345 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:47 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:54:48.368 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:47 smithi100 ceph-mon[107145]: pgmap v162: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s wr, 2 op/s 2023-12-05T09:54:48.368 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:47 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:54:48.487 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:48.489+0000 7f189bf79700 1 -- 172.21.15.100:0/869711092 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f189410bb80 con 0x7f18940fb520 2023-12-05T09:54:48.487 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:48.490+0000 7f188a7fc700 1 -- 172.21.15.100:0/869711092 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4697 (secure 0 0 0) 0x7f1890057ad0 con 0x7f18940fb520 2023-12-05T09:54:48.490 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:48.492+0000 7f189bf79700 1 -- 172.21.15.100:0/869711092 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f1880068f70 msgr2=0x7f188006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:48.490 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:48.492+0000 7f189bf79700 1 --2- 172.21.15.100:0/869711092 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f1880068f70 0x7f188006b420 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1884009b80 tx=0x7f188400b040 comp rx=0 tx=0).stop 2023-12-05T09:54:48.490 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:48.492+0000 7f189bf79700 1 -- 172.21.15.100:0/869711092 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18940fb520 msgr2=0x7f1894113ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:48.490 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:48.492+0000 7f189bf79700 1 --2- 172.21.15.100:0/869711092 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18940fb520 0x7f1894113ae0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1890009fd0 tx=0x7f1890009e30 comp rx=0 tx=0).stop 2023-12-05T09:54:48.490 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:48.492+0000 7f189bf79700 1 -- 172.21.15.100:0/869711092 shutdown_connections 2023-12-05T09:54:48.490 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:48.492+0000 7f189bf79700 1 --2- 172.21.15.100:0/869711092 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f1880068f70 0x7f188006b420 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:48.490 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:48.492+0000 7f189bf79700 1 --2- 172.21.15.100:0/869711092 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18940fb520 0x7f1894113ae0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:48.490 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:48.492+0000 7f189bf79700 1 --2- 172.21.15.100:0/869711092 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18940fde80 0x7f1894114020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:48.490 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:48.492+0000 7f189bf79700 1 -- 172.21.15.100:0/869711092 >> 172.21.15.100:0/869711092 conn(0x7f18940f7190 msgr2=0x7f18940f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:54:48.490 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:48.492+0000 7f189bf79700 1 -- 172.21.15.100:0/869711092 shutdown_connections 2023-12-05T09:54:48.490 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:48.492+0000 7f189bf79700 1 -- 172.21.15.100:0/869711092 wait complete. 2023-12-05T09:54:48.491 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 13 2023-12-05T09:54:48.504 INFO:teuthology.orchestra.run.smithi100.stdout:true 2023-12-05T09:54:48.922 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2023-12-05T09:54:49.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:49 smithi100 ceph-mon[107145]: pgmap v163: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 819 B/s rd, 1023 B/s wr, 2 op/s 2023-12-05T09:54:49.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:49 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/869711092' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-05T09:54:49.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:49 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:54:49.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:49 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:54:49.647 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi100/config 2023-12-05T09:54:49.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:49 smithi150 ceph-mon[116142]: pgmap v163: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 819 B/s rd, 1023 B/s wr, 2 op/s 2023-12-05T09:54:49.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:49 smithi150 ceph-mon[116142]: from='client.? 172.21.15.100:0/869711092' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-05T09:54:49.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:49 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:54:49.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:49 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:54:51.234 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:51.236+0000 7feb90c50700 1 -- 172.21.15.100:0/2093952005 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb8c0fdc10 msgr2=0x7feb8c0fe060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:51.234 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:51.236+0000 7feb90c50700 1 --2- 172.21.15.100:0/2093952005 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb8c0fdc10 0x7feb8c0fe060 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7feb80004940 tx=0x7feb80009e30 comp rx=0 tx=0).stop 2023-12-05T09:54:51.234 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:51.236+0000 7feb90c50700 1 -- 172.21.15.100:0/2093952005 shutdown_connections 2023-12-05T09:54:51.234 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:51.236+0000 7feb90c50700 1 --2- 172.21.15.100:0/2093952005 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb8c0fdc10 0x7feb8c0fe060 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:51.234 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:51.236+0000 7feb90c50700 1 --2- 172.21.15.100:0/2093952005 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb8c0fca00 0x7feb8c0fce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:51.234 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:51.236+0000 7feb90c50700 1 -- 172.21.15.100:0/2093952005 >> 172.21.15.100:0/2093952005 conn(0x7feb8c0f80e0 msgr2=0x7feb8c0fa4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:54:51.234 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:51.236+0000 7feb90c50700 1 -- 172.21.15.100:0/2093952005 shutdown_connections 2023-12-05T09:54:51.234 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:51.236+0000 7feb90c50700 1 -- 172.21.15.100:0/2093952005 wait complete. 2023-12-05T09:54:51.236 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:51.237+0000 7feb90c50700 1 Processor -- start 2023-12-05T09:54:51.236 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:51.237+0000 7feb90c50700 1 -- start start 2023-12-05T09:54:51.236 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:51.237+0000 7feb90c50700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb8c0fca00 0x7feb8c071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:51.236 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:51.237+0000 7feb90c50700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb8c0fdc10 0x7feb8c06ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:51.236 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:51.237+0000 7feb90c50700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb8c070590 con 0x7feb8c0fdc10 2023-12-05T09:54:51.237 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:51.237+0000 7feb90c50700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb8c070700 con 0x7feb8c0fca00 2023-12-05T09:54:51.237 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:51.237+0000 7feb8affd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb8c0fdc10 0x7feb8c06ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:51.237 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:51.237+0000 7feb8affd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb8c0fdc10 0x7feb8c06ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48484/0 (socket says 172.21.15.100:48484) 2023-12-05T09:54:51.237 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:51.237+0000 7feb8affd700 1 -- 172.21.15.100:0/2286814531 learned_addr learned my addr 172.21.15.100:0/2286814531 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:54:51.237 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:51.238+0000 7feb8b7fe700 1 --2- 172.21.15.100:0/2286814531 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb8c0fca00 0x7feb8c071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:51.237 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:51.238+0000 7feb8affd700 1 -- 172.21.15.100:0/2286814531 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb8c0fca00 msgr2=0x7feb8c071b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:51.237 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:51.238+0000 7feb8affd700 1 --2- 172.21.15.100:0/2286814531 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb8c0fca00 0x7feb8c071b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:51.237 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:51.238+0000 7feb8affd700 1 -- 172.21.15.100:0/2286814531 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb80005040 con 0x7feb8c0fdc10 2023-12-05T09:54:51.237 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:51.238+0000 7feb8affd700 1 --2- 172.21.15.100:0/2286814531 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb8c0fdc10 0x7feb8c06ff90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7feb8000b3b0 tx=0x7feb80009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:54:51.237 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:51.238+0000 7feb73fff700 1 -- 172.21.15.100:0/2286814531 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb8000e040 con 0x7feb8c0fdc10 2023-12-05T09:54:51.237 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:51.238+0000 7feb73fff700 1 -- 172.21.15.100:0/2286814531 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7feb8000bcd0 con 0x7feb8c0fdc10 2023-12-05T09:54:51.237 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:51.238+0000 7feb73fff700 1 -- 172.21.15.100:0/2286814531 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb8001c630 con 0x7feb8c0fdc10 2023-12-05T09:54:51.237 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:51.238+0000 7feb90c50700 1 -- 172.21.15.100:0/2286814531 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb8c070980 con 0x7feb8c0fdc10 2023-12-05T09:54:51.237 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:51.239+0000 7feb90c50700 1 -- 172.21.15.100:0/2286814531 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb8c1152b0 con 0x7feb8c0fdc10 2023-12-05T09:54:51.238 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:51.240+0000 7feb90c50700 1 -- 172.21.15.100:0/2286814531 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb8c04bb80 con 0x7feb8c0fdc10 2023-12-05T09:54:51.238 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:51.240+0000 7feb73fff700 1 -- 172.21.15.100:0/2286814531 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7feb80013420 con 0x7feb8c0fdc10 2023-12-05T09:54:51.238 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:51.241+0000 7feb73fff700 1 --2- 172.21.15.100:0/2286814531 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7feb74068f70 0x7feb7406b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:51.239 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:51.241+0000 7feb73fff700 1 -- 172.21.15.100:0/2286814531 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7feb80088210 con 0x7feb8c0fdc10 2023-12-05T09:54:51.239 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:51.241+0000 7feb8b7fe700 1 --2- 172.21.15.100:0/2286814531 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7feb74068f70 0x7feb7406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:51.239 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:51.242+0000 7feb8b7fe700 1 --2- 172.21.15.100:0/2286814531 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7feb74068f70 0x7feb7406b420 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7feb8c0718a0 tx=0x7feb7c007ea0 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:54:51.244 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:51.246+0000 7feb73fff700 1 -- 172.21.15.100:0/2286814531 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7feb80058120 con 0x7feb8c0fdc10 2023-12-05T09:54:51.532 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:51.535+0000 7feb90c50700 1 -- 172.21.15.100:0/2286814531 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7feb8c115730 con 0x7feb8c0fdc10 2023-12-05T09:54:51.532 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:51.535+0000 7feb73fff700 1 -- 172.21.15.100:0/2286814531 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v13) v1 ==== 78+0+99 (secure 0 0 0) 0x7feb80057cb0 con 0x7feb8c0fdc10 2023-12-05T09:54:51.536 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:51.538+0000 7feb90c50700 1 -- 172.21.15.100:0/2286814531 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7feb74068f70 msgr2=0x7feb7406b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:51.536 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:51.538+0000 7feb90c50700 1 --2- 172.21.15.100:0/2286814531 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7feb74068f70 0x7feb7406b420 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7feb8c0718a0 tx=0x7feb7c007ea0 comp rx=0 tx=0).stop 2023-12-05T09:54:51.536 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:51.539+0000 7feb90c50700 1 -- 172.21.15.100:0/2286814531 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb8c0fdc10 msgr2=0x7feb8c06ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:51.536 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:51.539+0000 7feb90c50700 1 --2- 172.21.15.100:0/2286814531 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb8c0fdc10 0x7feb8c06ff90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7feb8000b3b0 tx=0x7feb80009e30 comp rx=0 tx=0).stop 2023-12-05T09:54:51.536 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:51.539+0000 7feb90c50700 1 -- 172.21.15.100:0/2286814531 shutdown_connections 2023-12-05T09:54:51.536 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:51.539+0000 7feb90c50700 1 --2- 172.21.15.100:0/2286814531 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7feb74068f70 0x7feb7406b420 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:51.537 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:51.539+0000 7feb90c50700 1 --2- 172.21.15.100:0/2286814531 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb8c0fca00 0x7feb8c071b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:51.537 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:51.539+0000 7feb90c50700 1 --2- 172.21.15.100:0/2286814531 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb8c0fdc10 0x7feb8c06ff90 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:51.537 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:51.539+0000 7feb90c50700 1 -- 172.21.15.100:0/2286814531 >> 172.21.15.100:0/2286814531 conn(0x7feb8c0f80e0 msgr2=0x7feb8c100e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:54:51.537 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:51.539+0000 7feb90c50700 1 -- 172.21.15.100:0/2286814531 shutdown_connections 2023-12-05T09:54:51.537 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:51.539+0000 7feb90c50700 1 -- 172.21.15.100:0/2286814531 wait complete. 2023-12-05T09:54:51.551 INFO:teuthology.orchestra.run.smithi100.stdout:true 2023-12-05T09:54:51.659 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:51 smithi100 ceph-mon[107145]: pgmap v164: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.3 KiB/s rd, 0 B/s wr, 3 op/s 2023-12-05T09:54:51.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:51 smithi150 ceph-mon[116142]: pgmap v164: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.3 KiB/s rd, 0 B/s wr, 3 op/s 2023-12-05T09:54:52.058 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2023-12-05T09:54:52.070 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-05T09:54:52.319 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.321+0000 7f039fbff700 1 -- 172.21.15.100:0/451787788 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03980fcaa0 msgr2=0x7f03980fceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:52.319 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.321+0000 7f039fbff700 1 --2- 172.21.15.100:0/451787788 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03980fcaa0 0x7f03980fceb0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0394004940 tx=0x7f0394009e30 comp rx=0 tx=0).stop 2023-12-05T09:54:52.319 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.321+0000 7f039fbff700 1 -- 172.21.15.100:0/451787788 shutdown_connections 2023-12-05T09:54:52.319 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.321+0000 7f039fbff700 1 --2- 172.21.15.100:0/451787788 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03980fdcb0 0x7f03980fe100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:52.319 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.321+0000 7f039fbff700 1 --2- 172.21.15.100:0/451787788 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03980fcaa0 0x7f03980fceb0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:52.319 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.321+0000 7f039fbff700 1 -- 172.21.15.100:0/451787788 >> 172.21.15.100:0/451787788 conn(0x7f03980f8160 msgr2=0x7f03980fa590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:54:52.319 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.321+0000 7f039fbff700 1 -- 172.21.15.100:0/451787788 shutdown_connections 2023-12-05T09:54:52.319 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.321+0000 7f039fbff700 1 -- 172.21.15.100:0/451787788 wait complete. 2023-12-05T09:54:52.321 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.322+0000 7f039fbff700 1 Processor -- start 2023-12-05T09:54:52.321 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.322+0000 7f039fbff700 1 -- start start 2023-12-05T09:54:52.321 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.322+0000 7f039fbff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03980fcaa0 0x7f039810f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:52.321 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.322+0000 7f039fbff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03980fdcb0 0x7f039810f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:52.321 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.322+0000 7f039fbff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f039810ffd0 con 0x7f03980fcaa0 2023-12-05T09:54:52.321 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.322+0000 7f039fbff700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0398110140 con 0x7f03980fdcb0 2023-12-05T09:54:52.321 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.322+0000 7f039d99b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03980fcaa0 0x7f039810f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:52.321 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.322+0000 7f039d99b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03980fcaa0 0x7f039810f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48506/0 (socket says 172.21.15.100:48506) 2023-12-05T09:54:52.321 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.322+0000 7f039d99b700 1 -- 172.21.15.100:0/3348932348 learned_addr learned my addr 172.21.15.100:0/3348932348 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:54:52.321 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.323+0000 7f039d19a700 1 --2- 172.21.15.100:0/3348932348 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03980fdcb0 0x7f039810f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:52.321 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.323+0000 7f039d99b700 1 -- 172.21.15.100:0/3348932348 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03980fdcb0 msgr2=0x7f039810f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:52.322 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.323+0000 7f039d99b700 1 --2- 172.21.15.100:0/3348932348 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03980fdcb0 0x7f039810f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:52.322 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.323+0000 7f039d99b700 1 -- 172.21.15.100:0/3348932348 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0394005040 con 0x7f03980fcaa0 2023-12-05T09:54:52.322 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.323+0000 7f039d99b700 1 --2- 172.21.15.100:0/3348932348 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03980fcaa0 0x7f039810f490 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0394008f80 tx=0x7f0394009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:54:52.322 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.323+0000 7f038e7fc700 1 -- 172.21.15.100:0/3348932348 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0394021070 con 0x7f03980fcaa0 2023-12-05T09:54:52.322 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.323+0000 7f038e7fc700 1 -- 172.21.15.100:0/3348932348 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f039401c400 con 0x7f03980fcaa0 2023-12-05T09:54:52.322 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.323+0000 7f038e7fc700 1 -- 172.21.15.100:0/3348932348 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f039400e070 con 0x7f03980fcaa0 2023-12-05T09:54:52.322 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.323+0000 7f039fbff700 1 -- 172.21.15.100:0/3348932348 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03980677a0 con 0x7f03980fcaa0 2023-12-05T09:54:52.322 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.324+0000 7f039fbff700 1 -- 172.21.15.100:0/3348932348 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0398067cb0 con 0x7f03980fcaa0 2023-12-05T09:54:52.322 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.325+0000 7f039fbff700 1 -- 172.21.15.100:0/3348932348 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0398101d50 con 0x7f03980fcaa0 2023-12-05T09:54:52.323 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.326+0000 7f038e7fc700 1 -- 172.21.15.100:0/3348932348 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f039401c950 con 0x7f03980fcaa0 2023-12-05T09:54:52.324 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.327+0000 7f038e7fc700 1 --2- 172.21.15.100:0/3348932348 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f0384068f70 0x7f038406b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:52.324 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.327+0000 7f038e7fc700 1 -- 172.21.15.100:0/3348932348 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f0394088020 con 0x7f03980fcaa0 2023-12-05T09:54:52.324 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.327+0000 7f039d19a700 1 --2- 172.21.15.100:0/3348932348 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f0384068f70 0x7f038406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:52.325 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.327+0000 7f039d19a700 1 --2- 172.21.15.100:0/3348932348 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f0384068f70 0x7f038406b420 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0388009b80 tx=0x7f038800b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:54:52.328 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.331+0000 7f038e7fc700 1 -- 172.21.15.100:0/3348932348 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f0394057f30 con 0x7f03980fcaa0 2023-12-05T09:54:52.581 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.584+0000 7f039fbff700 1 -- 172.21.15.100:0/3348932348 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f039802b1e0 con 0x7f03980fcaa0 2023-12-05T09:54:52.582 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.585+0000 7f038e7fc700 1 -- 172.21.15.100:0/3348932348 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+14438 (secure 0 0 0) 0x7f0394057ac0 con 0x7f03980fcaa0 2023-12-05T09:54:52.582 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:54:52.582 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":46,"fsid":"5b035ce6-9353-11ee-95a2-87774f69a715","created":"2023-12-05T09:48:33.718763+0000","modified":"2023-12-05T09:54:43.391134+0000","last_up_change":"2023-12-05T09:53:33.596224+0000","last_in_change":"2023-12-05T09:53:15.176570+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-05T09:52:26.650134+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2023-12-05T09:54:29.310760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2023-12-05T09:54:29.992340+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9f3faeed-8336-4509-9127-eafa0273ecea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2938979601},{"type":"v1","addr":"172.21.15.100:6803","nonce":2938979601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2938979601},{"type":"v1","addr":"172.21.15.100:6805","nonce":2938979601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":2938979601},{"type":"v1","addr":"172.21.15.100:6809","nonce":2938979601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2938979601},{"type":"v1","addr":"172.21.15.100:6807","nonce":2938979601}]},"public_addr":"172.21.15.100:6803/2938979601","cluster_addr":"172.21.15.100:6805/2938979601","heartbeat_back_addr":"172.21.15.100:6809/2938979601","heartbeat_front_addr":"172.21.15.100:6807/2938979601","state":["exists","up"]},{"osd":1,"uuid":"6ca8c1e2-e673-4dc4-b02d-c0805493bcf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":38684261},{"type":"v1","addr":"172.21.15.100:6811","nonce":38684261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":38684261},{"type":"v1","addr":"172.21.15.100:6813","nonce":38684261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":38684261},{"type":"v1","addr":"172.21.15.100:6817","nonce":38684261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":38684261},{"type":"v1","addr":"172.21.15.100:6815","nonce":38684261}]},"public_addr":"172.21.15.100:6811/38684261","cluster_addr":"172.21.15.100:6813/38684261","heartbeat_back_addr":"172.21.15.100:6817/38684261","heartbeat_front_addr":"172.21.15.100:6815/38684261","state":["exists","up"]},{"osd":2,"uuid":"59a55cb9-28ae-4485-8cbf-e5f6224bd377","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":2128721915},{"type":"v1","addr":"172.21.15.100:6819","nonce":2128721915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2128721915},{"type":"v1","addr":"172.21.15.100:6821","nonce":2128721915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":2128721915},{"type":"v1","addr":"172.21.15.100:6825","nonce":2128721915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":2128721915},{"type":"v1","addr":"172.21.15.100:6823","nonce":2128721915}]},"public_addr":"172.21.15.100:6819/2128721915","cluster_addr":"172.21.15.100:6821/2128721915","heartbeat_back_addr":"172.21.15.100:6825/2128721915","heartbeat_front_addr":"172.21.15.100:6823/2128721915","state":["exists","up"]},{"osd":3,"uuid":"e12b505f-7f0c-4d6f-b039-5aa793f79db0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":1626769878},{"type":"v1","addr":"172.21.15.150:6801","nonce":1626769878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":1626769878},{"type":"v1","addr":"172.21.15.150:6803","nonce":1626769878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":1626769878},{"type":"v1","addr":"172.21.15.150:6807","nonce":1626769878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":1626769878},{"type":"v1","addr":"172.21.15.150:6805","nonce":1626769878}]},"public_addr":"172.21.15.150:6801/1626769878","cluster_addr":"172.21.15.150:6803/1626769878","heartbeat_back_addr":"172.21.15.150:6807/1626769878","heartbeat_front_addr":"172.21.15.150:6805/1626769878","state":["exists","up"]},{"osd":4,"uuid":"33fbbf55-86ba-4e7f-a66b-e958dce72283","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":2589618062},{"type":"v1","addr":"172.21.15.150:6809","nonce":2589618062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":2589618062},{"type":"v1","addr":"172.21.15.150:6811","nonce":2589618062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":2589618062},{"type":"v1","addr":"172.21.15.150:6815","nonce":2589618062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":2589618062},{"type":"v1","addr":"172.21.15.150:6813","nonce":2589618062}]},"public_addr":"172.21.15.150:6809/2589618062","cluster_addr":"172.21.15.150:6811/2589618062","heartbeat_back_addr":"172.21.15.150:6815/2589618062","heartbeat_front_addr":"172.21.15.150:6813/2589618062","state":["exists","up"]},{"osd":5,"uuid":"93b2d10b-0410-4390-9283-b4129c0439d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":4116522433},{"type":"v1","addr":"172.21.15.150:6817","nonce":4116522433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":4116522433},{"type":"v1","addr":"172.21.15.150:6819","nonce":4116522433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":4116522433},{"type":"v1","addr":"172.21.15.150:6823","nonce":4116522433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":4116522433},{"type":"v1","addr":"172.21.15.150:6821","nonce":4116522433}]},"public_addr":"172.21.15.150:6817/4116522433","cluster_addr":"172.21.15.150:6819/4116522433","heartbeat_back_addr":"172.21.15.150:6823/4116522433","heartbeat_front_addr":"172.21.15.150:6821/4116522433","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T09:51:35.123538+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T09:51:59.961993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T09:52:23.976682+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T09:52:46.493238+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T09:53:09.121783+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T09:53:32.450910+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:6801/3606837497":"2023-12-06T09:49:01.007941+0000","172.21.15.100:0/3942224339":"2023-12-06T09:49:28.559106+0000","172.21.15.100:6800/3606837497":"2023-12-06T09:49:01.007941+0000","172.21.15.100:0/4197065049":"2023-12-06T09:50:30.059721+0000","172.21.15.100:6800/2397627746":"2023-12-06T09:50:30.059721+0000","172.21.15.100:0/567522562":"2023-12-06T09:49:01.007941+0000","172.21.15.100:0/556453695":"2023-12-06T09:49:28.559106+0000","172.21.15.100:6827/3068237273":"2023-12-06T09:54:43.391103+0000","172.21.15.100:6800/2647899624":"2023-12-06T09:49:28.559106+0000","172.21.15.100:6801/2647899624":"2023-12-06T09:49:28.559106+0000","172.21.15.100:0/2992397636":"2023-12-06T09:49:01.007941+0000","172.21.15.100:0/1529397750":"2023-12-06T09:49:28.559106+0000","172.21.15.100:0/737517101":"2023-12-06T09:50:30.059721+0000","172.21.15.100:6801/2397627746":"2023-12-06T09:50:30.059721+0000","172.21.15.100:0/2826914555":"2023-12-06T09:50:30.059721+0000","172.21.15.100:0/2400356084":"2023-12-06T09:49:01.007941+0000","172.21.15.100:6826/3068237273":"2023-12-06T09:54:43.391103+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-05T09:54:52.585 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.587+0000 7f039fbff700 1 -- 172.21.15.100:0/3348932348 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f0384068f70 msgr2=0x7f038406b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:52.585 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.587+0000 7f039fbff700 1 --2- 172.21.15.100:0/3348932348 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f0384068f70 0x7f038406b420 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0388009b80 tx=0x7f038800b040 comp rx=0 tx=0).stop 2023-12-05T09:54:52.585 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.587+0000 7f039fbff700 1 -- 172.21.15.100:0/3348932348 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03980fcaa0 msgr2=0x7f039810f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:52.585 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.587+0000 7f039fbff700 1 --2- 172.21.15.100:0/3348932348 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03980fcaa0 0x7f039810f490 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0394008f80 tx=0x7f0394009e30 comp rx=0 tx=0).stop 2023-12-05T09:54:52.585 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.587+0000 7f039fbff700 1 -- 172.21.15.100:0/3348932348 shutdown_connections 2023-12-05T09:54:52.585 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.587+0000 7f039fbff700 1 --2- 172.21.15.100:0/3348932348 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f0384068f70 0x7f038406b420 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:52.585 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.587+0000 7f039fbff700 1 --2- 172.21.15.100:0/3348932348 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03980fcaa0 0x7f039810f490 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:52.585 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.587+0000 7f039fbff700 1 --2- 172.21.15.100:0/3348932348 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f03980fdcb0 0x7f039810f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:52.585 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.587+0000 7f039fbff700 1 -- 172.21.15.100:0/3348932348 >> 172.21.15.100:0/3348932348 conn(0x7f03980f8160 msgr2=0x7f03980feed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:54:52.585 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.587+0000 7f039fbff700 1 -- 172.21.15.100:0/3348932348 shutdown_connections 2023-12-05T09:54:52.585 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.588+0000 7f039fbff700 1 -- 172.21.15.100:0/3348932348 wait complete. 2023-12-05T09:54:52.606 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-05T09:52:26.650134+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2023-12-05T09:54:29.310760+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2023-12-05T09:54:29.992340+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-05T09:54:52.606 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-05T09:54:52.671 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:52 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/2286814531' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2023-12-05T09:54:52.817 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.820+0000 7fd6617ff700 1 -- 172.21.15.100:0/857532350 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd65c066ad0 msgr2=0x7fd65c101a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:52.818 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.820+0000 7fd6617ff700 1 --2- 172.21.15.100:0/857532350 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd65c066ad0 0x7fd65c101a50 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd64c004940 tx=0x7fd64c009e30 comp rx=0 tx=0).stop 2023-12-05T09:54:52.818 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.820+0000 7fd6617ff700 1 -- 172.21.15.100:0/857532350 shutdown_connections 2023-12-05T09:54:52.818 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.820+0000 7fd6617ff700 1 --2- 172.21.15.100:0/857532350 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd65c101f90 0x7fd65c104370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:52.818 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.820+0000 7fd6617ff700 1 --2- 172.21.15.100:0/857532350 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd65c066ad0 0x7fd65c101a50 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:52.818 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.820+0000 7fd6617ff700 1 -- 172.21.15.100:0/857532350 >> 172.21.15.100:0/857532350 conn(0x7fd65c0f70c0 msgr2=0x7fd65c0f94f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:54:52.818 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.820+0000 7fd6617ff700 1 -- 172.21.15.100:0/857532350 shutdown_connections 2023-12-05T09:54:52.818 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.820+0000 7fd6617ff700 1 -- 172.21.15.100:0/857532350 wait complete. 2023-12-05T09:54:52.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.820+0000 7fd6617ff700 1 Processor -- start 2023-12-05T09:54:52.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.821+0000 7fd6617ff700 1 -- start start 2023-12-05T09:54:52.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.821+0000 7fd6617ff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd65c066ad0 0x7fd65c10f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:52.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.821+0000 7fd6617ff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd65c101f90 0x7fd65c10f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:52.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.821+0000 7fd6617ff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd65c10ffd0 con 0x7fd65c101f90 2023-12-05T09:54:52.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.821+0000 7fd6617ff700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd65c110140 con 0x7fd65c066ad0 2023-12-05T09:54:52.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.821+0000 7fd65a7fc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd65c101f90 0x7fd65c10f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:52.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.821+0000 7fd65a7fc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd65c101f90 0x7fd65c10f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48528/0 (socket says 172.21.15.100:48528) 2023-12-05T09:54:52.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.821+0000 7fd65a7fc700 1 -- 172.21.15.100:0/2272812473 learned_addr learned my addr 172.21.15.100:0/2272812473 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:54:52.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.821+0000 7fd65affd700 1 --2- 172.21.15.100:0/2272812473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd65c066ad0 0x7fd65c10f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:52.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.822+0000 7fd65a7fc700 1 -- 172.21.15.100:0/2272812473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd65c066ad0 msgr2=0x7fd65c10f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:52.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.822+0000 7fd65a7fc700 1 --2- 172.21.15.100:0/2272812473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd65c066ad0 0x7fd65c10f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:52.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.822+0000 7fd65a7fc700 1 -- 172.21.15.100:0/2272812473 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd64c005040 con 0x7fd65c101f90 2023-12-05T09:54:52.821 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.822+0000 7fd65a7fc700 1 --2- 172.21.15.100:0/2272812473 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd65c101f90 0x7fd65c10f9d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd65000eb40 tx=0x7fd65000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:54:52.821 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.822+0000 7fd6437fe700 1 -- 172.21.15.100:0/2272812473 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd650007cc0 con 0x7fd65c101f90 2023-12-05T09:54:52.821 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.822+0000 7fd6437fe700 1 -- 172.21.15.100:0/2272812473 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd65000f040 con 0x7fd65c101f90 2023-12-05T09:54:52.821 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.822+0000 7fd6437fe700 1 -- 172.21.15.100:0/2272812473 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd65000ca30 con 0x7fd65c101f90 2023-12-05T09:54:52.821 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.822+0000 7fd6617ff700 1 -- 172.21.15.100:0/2272812473 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd65c114b90 con 0x7fd65c101f90 2023-12-05T09:54:52.821 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.822+0000 7fd6617ff700 1 -- 172.21.15.100:0/2272812473 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd65c115150 con 0x7fd65c101f90 2023-12-05T09:54:52.821 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.823+0000 7fd6617ff700 1 -- 172.21.15.100:0/2272812473 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd65c107660 con 0x7fd65c101f90 2023-12-05T09:54:52.822 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.824+0000 7fd6437fe700 1 -- 172.21.15.100:0/2272812473 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7fd65000cb90 con 0x7fd65c101f90 2023-12-05T09:54:52.823 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.825+0000 7fd6437fe700 1 --2- 172.21.15.100:0/2272812473 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fd644068f90 0x7fd64406b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:52.823 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.825+0000 7fd6437fe700 1 -- 172.21.15.100:0/2272812473 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fd650086840 con 0x7fd65c101f90 2023-12-05T09:54:52.823 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.826+0000 7fd65affd700 1 --2- 172.21.15.100:0/2272812473 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fd644068f90 0x7fd64406b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:52.823 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.826+0000 7fd65affd700 1 --2- 172.21.15.100:0/2272812473 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fd644068f90 0x7fd64406b440 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd64c009fd0 tx=0x7fd64c009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:54:52.828 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:52.830+0000 7fd6437fe700 1 -- 172.21.15.100:0/2272812473 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fd650056750 con 0x7fd65c101f90 2023-12-05T09:54:52.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:52 smithi150 ceph-mon[116142]: from='client.? 172.21.15.100:0/2286814531' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2023-12-05T09:54:53.026 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.029+0000 7fd6617ff700 1 -- 172.21.15.100:0/2272812473 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd65c115390 con 0x7fd65c101f90 2023-12-05T09:54:53.026 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.029+0000 7fd6437fe700 1 -- 172.21.15.100:0/2272812473 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd6500562e0 con 0x7fd65c101f90 2023-12-05T09:54:53.027 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2023-12-05T09:54:53.029 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.031+0000 7fd6617ff700 1 -- 172.21.15.100:0/2272812473 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fd644068f90 msgr2=0x7fd64406b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:53.029 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.031+0000 7fd6617ff700 1 --2- 172.21.15.100:0/2272812473 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fd644068f90 0x7fd64406b440 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd64c009fd0 tx=0x7fd64c009e30 comp rx=0 tx=0).stop 2023-12-05T09:54:53.029 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.031+0000 7fd6617ff700 1 -- 172.21.15.100:0/2272812473 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd65c101f90 msgr2=0x7fd65c10f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:53.029 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.031+0000 7fd6617ff700 1 --2- 172.21.15.100:0/2272812473 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd65c101f90 0x7fd65c10f9d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd65000eb40 tx=0x7fd65000b040 comp rx=0 tx=0).stop 2023-12-05T09:54:53.029 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.031+0000 7fd6617ff700 1 -- 172.21.15.100:0/2272812473 shutdown_connections 2023-12-05T09:54:53.029 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.031+0000 7fd6617ff700 1 --2- 172.21.15.100:0/2272812473 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fd644068f90 0x7fd64406b440 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:53.029 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.031+0000 7fd6617ff700 1 --2- 172.21.15.100:0/2272812473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd65c066ad0 0x7fd65c10f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:53.029 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.031+0000 7fd6617ff700 1 --2- 172.21.15.100:0/2272812473 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd65c101f90 0x7fd65c10f9d0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:53.029 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.031+0000 7fd6617ff700 1 -- 172.21.15.100:0/2272812473 >> 172.21.15.100:0/2272812473 conn(0x7fd65c0f70c0 msgr2=0x7fd65c0f94f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:54:53.029 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.032+0000 7fd6617ff700 1 -- 172.21.15.100:0/2272812473 shutdown_connections 2023-12-05T09:54:53.030 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.032+0000 7fd6617ff700 1 -- 172.21.15.100:0/2272812473 wait complete. 2023-12-05T09:54:53.048 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2023-12-05T09:54:53.244 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.247+0000 7f8e14dff700 1 -- 172.21.15.100:0/453700338 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e100fdd30 msgr2=0x7f8e100fe1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:53.245 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.247+0000 7f8e14dff700 1 --2- 172.21.15.100:0/453700338 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e100fdd30 0x7f8e100fe1a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8e04004940 tx=0x7f8e04009e30 comp rx=0 tx=0).stop 2023-12-05T09:54:53.245 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.247+0000 7f8e14dff700 1 -- 172.21.15.100:0/453700338 shutdown_connections 2023-12-05T09:54:53.245 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.247+0000 7f8e14dff700 1 --2- 172.21.15.100:0/453700338 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e100fdd30 0x7f8e100fe1a0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:53.245 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.247+0000 7f8e14dff700 1 --2- 172.21.15.100:0/453700338 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8e100fca80 0x7f8e100fce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:53.245 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.247+0000 7f8e14dff700 1 -- 172.21.15.100:0/453700338 >> 172.21.15.100:0/453700338 conn(0x7f8e100f81c0 msgr2=0x7f8e100fa610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:54:53.245 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.247+0000 7f8e14dff700 1 -- 172.21.15.100:0/453700338 shutdown_connections 2023-12-05T09:54:53.245 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.247+0000 7f8e14dff700 1 -- 172.21.15.100:0/453700338 wait complete. 2023-12-05T09:54:53.247 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.247+0000 7f8e14dff700 1 Processor -- start 2023-12-05T09:54:53.247 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.248+0000 7f8e14dff700 1 -- start start 2023-12-05T09:54:53.247 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.248+0000 7f8e14dff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8e100fca80 0x7f8e1010f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:53.247 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.248+0000 7f8e14dff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e100fdd30 0x7f8e1010f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:53.247 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.248+0000 7f8e14dff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1010ffc0 con 0x7f8e100fdd30 2023-12-05T09:54:53.247 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.248+0000 7f8e14dff700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e10110130 con 0x7f8e100fca80 2023-12-05T09:54:53.247 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.248+0000 7f8e0dd9b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e100fdd30 0x7f8e1010f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:53.247 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.248+0000 7f8e0dd9b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e100fdd30 0x7f8e1010f9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48554/0 (socket says 172.21.15.100:48554) 2023-12-05T09:54:53.247 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.248+0000 7f8e0dd9b700 1 -- 172.21.15.100:0/1161474147 learned_addr learned my addr 172.21.15.100:0/1161474147 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:54:53.247 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.248+0000 7f8e0e59c700 1 --2- 172.21.15.100:0/1161474147 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8e100fca80 0x7f8e1010f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:53.247 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.248+0000 7f8e0dd9b700 1 -- 172.21.15.100:0/1161474147 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8e100fca80 msgr2=0x7f8e1010f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:53.247 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.248+0000 7f8e0dd9b700 1 --2- 172.21.15.100:0/1161474147 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8e100fca80 0x7f8e1010f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:53.247 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.248+0000 7f8e0dd9b700 1 -- 172.21.15.100:0/1161474147 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e04005040 con 0x7f8e100fdd30 2023-12-05T09:54:53.248 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.248+0000 7f8e0e59c700 1 --2- 172.21.15.100:0/1161474147 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8e100fca80 0x7f8e1010f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-05T09:54:53.248 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.249+0000 7f8e0dd9b700 1 --2- 172.21.15.100:0/1161474147 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e100fdd30 0x7f8e1010f9c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8e0400b3b0 tx=0x7f8e04009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:54:53.248 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.249+0000 7f8dfeffd700 1 -- 172.21.15.100:0/1161474147 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e0400e040 con 0x7f8e100fdd30 2023-12-05T09:54:53.248 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.249+0000 7f8dfeffd700 1 -- 172.21.15.100:0/1161474147 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8e0400bcd0 con 0x7f8e100fdd30 2023-12-05T09:54:53.248 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.249+0000 7f8e14dff700 1 -- 172.21.15.100:0/1161474147 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e10114b80 con 0x7f8e100fdd30 2023-12-05T09:54:53.248 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.249+0000 7f8dfeffd700 1 -- 172.21.15.100:0/1161474147 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e0401c630 con 0x7f8e100fdd30 2023-12-05T09:54:53.248 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.249+0000 7f8e14dff700 1 -- 172.21.15.100:0/1161474147 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e10115140 con 0x7f8e100fdd30 2023-12-05T09:54:53.248 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.250+0000 7f8e14dff700 1 -- 172.21.15.100:0/1161474147 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e10101dd0 con 0x7f8e100fdd30 2023-12-05T09:54:53.249 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.251+0000 7f8dfeffd700 1 -- 172.21.15.100:0/1161474147 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f8e04013420 con 0x7f8e100fdd30 2023-12-05T09:54:53.249 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.252+0000 7f8dfeffd700 1 --2- 172.21.15.100:0/1161474147 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f8df8068f70 0x7f8df806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:53.249 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.252+0000 7f8dfeffd700 1 -- 172.21.15.100:0/1161474147 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f8e04088240 con 0x7f8e100fdd30 2023-12-05T09:54:53.249 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.252+0000 7f8e0e59c700 1 --2- 172.21.15.100:0/1161474147 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f8df8068f70 0x7f8df806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:53.250 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.252+0000 7f8e0e59c700 1 --2- 172.21.15.100:0/1161474147 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f8df8068f70 0x7f8df806b420 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8e00007fd0 tx=0x7f8e00009040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:54:53.253 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.256+0000 7f8dfeffd700 1 -- 172.21.15.100:0/1161474147 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f8e040580f0 con 0x7f8e100fdd30 2023-12-05T09:54:53.451 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.453+0000 7f8e14dff700 1 -- 172.21.15.100:0/1161474147 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f8e10105440 con 0x7f8e100fdd30 2023-12-05T09:54:53.451 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.454+0000 7f8dfeffd700 1 -- 172.21.15.100:0/1161474147 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v46) v1 ==== 107+0+11 (secure 0 0 0) 0x7f8e10105440 con 0x7f8e100fdd30 2023-12-05T09:54:53.451 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2023-12-05T09:54:53.454 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.456+0000 7f8e14dff700 1 -- 172.21.15.100:0/1161474147 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f8df8068f70 msgr2=0x7f8df806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:53.454 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.456+0000 7f8e14dff700 1 --2- 172.21.15.100:0/1161474147 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f8df8068f70 0x7f8df806b420 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8e00007fd0 tx=0x7f8e00009040 comp rx=0 tx=0).stop 2023-12-05T09:54:53.454 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.456+0000 7f8e14dff700 1 -- 172.21.15.100:0/1161474147 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e100fdd30 msgr2=0x7f8e1010f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:53.454 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.456+0000 7f8e14dff700 1 --2- 172.21.15.100:0/1161474147 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e100fdd30 0x7f8e1010f9c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8e0400b3b0 tx=0x7f8e04009e30 comp rx=0 tx=0).stop 2023-12-05T09:54:53.454 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.456+0000 7f8e14dff700 1 -- 172.21.15.100:0/1161474147 shutdown_connections 2023-12-05T09:54:53.454 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.456+0000 7f8e14dff700 1 --2- 172.21.15.100:0/1161474147 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f8df8068f70 0x7f8df806b420 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:53.454 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.456+0000 7f8e14dff700 1 --2- 172.21.15.100:0/1161474147 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8e100fca80 0x7f8e1010f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:53.454 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.456+0000 7f8e14dff700 1 --2- 172.21.15.100:0/1161474147 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e100fdd30 0x7f8e1010f9c0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:53.454 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.456+0000 7f8e14dff700 1 -- 172.21.15.100:0/1161474147 >> 172.21.15.100:0/1161474147 conn(0x7f8e100f81c0 msgr2=0x7f8e100fef50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:54:53.454 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.456+0000 7f8e14dff700 1 -- 172.21.15.100:0/1161474147 shutdown_connections 2023-12-05T09:54:53.454 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.456+0000 7f8e14dff700 1 -- 172.21.15.100:0/1161474147 wait complete. 2023-12-05T09:54:53.472 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2023-12-05T09:54:53.667 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.669+0000 7faa8c3ff700 1 -- 172.21.15.100:0/189722304 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa84071b30 msgr2=0x7faa84070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:53.667 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.669+0000 7faa8c3ff700 1 --2- 172.21.15.100:0/189722304 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa84071b30 0x7faa84070030 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7faa80004940 tx=0x7faa80009e30 comp rx=0 tx=0).stop 2023-12-05T09:54:53.667 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.669+0000 7faa8c3ff700 1 -- 172.21.15.100:0/189722304 shutdown_connections 2023-12-05T09:54:53.667 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.669+0000 7faa8c3ff700 1 --2- 172.21.15.100:0/189722304 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa84070570 0x7faa840709e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:53.667 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.669+0000 7faa8c3ff700 1 --2- 172.21.15.100:0/189722304 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa84071b30 0x7faa84070030 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:53.668 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.669+0000 7faa8c3ff700 1 -- 172.21.15.100:0/189722304 >> 172.21.15.100:0/189722304 conn(0x7faa840f81c0 msgr2=0x7faa840fa610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:54:53.668 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.669+0000 7faa8c3ff700 1 -- 172.21.15.100:0/189722304 shutdown_connections 2023-12-05T09:54:53.668 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.669+0000 7faa8c3ff700 1 -- 172.21.15.100:0/189722304 wait complete. 2023-12-05T09:54:53.669 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.670+0000 7faa8c3ff700 1 Processor -- start 2023-12-05T09:54:53.669 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.671+0000 7faa8c3ff700 1 -- start start 2023-12-05T09:54:53.669 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.671+0000 7faa8c3ff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa84070570 0x7faa8410f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:53.669 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.671+0000 7faa8c3ff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa84071b30 0x7faa8410f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:53.669 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.671+0000 7faa8c3ff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa8410ff70 con 0x7faa84071b30 2023-12-05T09:54:53.669 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.671+0000 7faa8c3ff700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa841100e0 con 0x7faa84070570 2023-12-05T09:54:53.669 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.671+0000 7faa8999a700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa84071b30 0x7faa8410f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:53.669 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.671+0000 7faa8999a700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa84071b30 0x7faa8410f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48562/0 (socket says 172.21.15.100:48562) 2023-12-05T09:54:53.669 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.671+0000 7faa8999a700 1 -- 172.21.15.100:0/3113592240 learned_addr learned my addr 172.21.15.100:0/3113592240 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:54:53.670 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.672+0000 7faa8a19b700 1 --2- 172.21.15.100:0/3113592240 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa84070570 0x7faa8410f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:53.670 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.672+0000 7faa8999a700 1 -- 172.21.15.100:0/3113592240 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa84070570 msgr2=0x7faa8410f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:53.670 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.672+0000 7faa8999a700 1 --2- 172.21.15.100:0/3113592240 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa84070570 0x7faa8410f430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:53.671 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.672+0000 7faa8999a700 1 -- 172.21.15.100:0/3113592240 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa80005040 con 0x7faa84071b30 2023-12-05T09:54:53.671 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.672+0000 7faa8999a700 1 --2- 172.21.15.100:0/3113592240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa84071b30 0x7faa8410f970 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7faa7400eb40 tx=0x7faa7400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:54:53.671 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.672+0000 7faa7affd700 1 -- 172.21.15.100:0/3113592240 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa74007cc0 con 0x7faa84071b30 2023-12-05T09:54:53.671 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.672+0000 7faa7affd700 1 -- 172.21.15.100:0/3113592240 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7faa7400f040 con 0x7faa84071b30 2023-12-05T09:54:53.671 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.672+0000 7faa7affd700 1 -- 172.21.15.100:0/3113592240 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa74009570 con 0x7faa84071b30 2023-12-05T09:54:53.671 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.672+0000 7faa8c3ff700 1 -- 172.21.15.100:0/3113592240 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa84114b30 con 0x7faa84071b30 2023-12-05T09:54:53.671 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.672+0000 7faa8c3ff700 1 -- 172.21.15.100:0/3113592240 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa841150f0 con 0x7faa84071b30 2023-12-05T09:54:53.671 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.673+0000 7faa8c3ff700 1 -- 172.21.15.100:0/3113592240 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa84107620 con 0x7faa84071b30 2023-12-05T09:54:53.671 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.674+0000 7faa7affd700 1 -- 172.21.15.100:0/3113592240 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7faa740096d0 con 0x7faa84071b30 2023-12-05T09:54:53.673 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.675+0000 7faa7affd700 1 --2- 172.21.15.100:0/3113592240 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7faa70068f70 0x7faa7006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:53.673 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.675+0000 7faa7affd700 1 -- 172.21.15.100:0/3113592240 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7faa74086a30 con 0x7faa84071b30 2023-12-05T09:54:53.673 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.676+0000 7faa8a19b700 1 --2- 172.21.15.100:0/3113592240 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7faa70068f70 0x7faa7006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:53.673 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.676+0000 7faa8a19b700 1 --2- 172.21.15.100:0/3113592240 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7faa70068f70 0x7faa7006b420 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7faa8000b0d0 tx=0x7faa80009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:54:53.677 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.679+0000 7faa7affd700 1 -- 172.21.15.100:0/3113592240 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7faa7404da00 con 0x7faa84071b30 2023-12-05T09:54:53.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:53 smithi150 ceph-mon[116142]: pgmap v165: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.1 KiB/s rd, 0 B/s wr, 4 op/s 2023-12-05T09:54:53.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:53 smithi150 ceph-mon[116142]: from='client.? 172.21.15.100:0/3348932348' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-05T09:54:53.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:53 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:54:53.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:53 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:54:53.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:53 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:54:53.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:53 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:54:53.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:53 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:54:53.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:53 smithi150 ceph-mon[116142]: from='client.? 172.21.15.100:0/2272812473' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-05T09:54:53.869 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.872+0000 7faa8c3ff700 1 -- 172.21.15.100:0/3113592240 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7faa84115340 con 0x7faa84071b30 2023-12-05T09:54:53.870 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.872+0000 7faa7affd700 1 -- 172.21.15.100:0/3113592240 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v46) v1 ==== 107+0+11 (secure 0 0 0) 0x7faa74019020 con 0x7faa84071b30 2023-12-05T09:54:53.870 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2023-12-05T09:54:53.872 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.875+0000 7faa8c3ff700 1 -- 172.21.15.100:0/3113592240 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7faa70068f70 msgr2=0x7faa7006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:53.872 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.875+0000 7faa8c3ff700 1 --2- 172.21.15.100:0/3113592240 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7faa70068f70 0x7faa7006b420 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7faa8000b0d0 tx=0x7faa80009e30 comp rx=0 tx=0).stop 2023-12-05T09:54:53.873 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.875+0000 7faa8c3ff700 1 -- 172.21.15.100:0/3113592240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa84071b30 msgr2=0x7faa8410f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:53.873 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.875+0000 7faa8c3ff700 1 --2- 172.21.15.100:0/3113592240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa84071b30 0x7faa8410f970 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7faa7400eb40 tx=0x7faa7400b040 comp rx=0 tx=0).stop 2023-12-05T09:54:53.873 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.875+0000 7faa8c3ff700 1 -- 172.21.15.100:0/3113592240 shutdown_connections 2023-12-05T09:54:53.873 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.875+0000 7faa8c3ff700 1 --2- 172.21.15.100:0/3113592240 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7faa70068f70 0x7faa7006b420 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:53.873 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.875+0000 7faa8c3ff700 1 --2- 172.21.15.100:0/3113592240 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa84070570 0x7faa8410f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:53.873 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.875+0000 7faa8c3ff700 1 --2- 172.21.15.100:0/3113592240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa84071b30 0x7faa8410f970 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:53.873 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.875+0000 7faa8c3ff700 1 -- 172.21.15.100:0/3113592240 >> 172.21.15.100:0/3113592240 conn(0x7faa840f81c0 msgr2=0x7faa841029b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:54:53.873 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.875+0000 7faa8c3ff700 1 -- 172.21.15.100:0/3113592240 shutdown_connections 2023-12-05T09:54:53.873 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:53.875+0000 7faa8c3ff700 1 -- 172.21.15.100:0/3113592240 wait complete. 2023-12-05T09:54:53.888 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:53 smithi100 ceph-mon[107145]: pgmap v165: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.1 KiB/s rd, 0 B/s wr, 4 op/s 2023-12-05T09:54:53.888 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:53 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/3348932348' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-05T09:54:53.888 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:53 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:54:53.888 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:53 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:54:53.888 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:53 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:54:53.888 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:53 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:54:53.888 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:53 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:54:53.889 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:53 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/2272812473' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-05T09:54:53.891 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-05T09:54:54.083 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:54.085+0000 7f8278fff700 1 -- 172.21.15.100:0/1696609069 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82740fcaa0 msgr2=0x7f82740fceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:54.084 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:54.085+0000 7f8278fff700 1 --2- 172.21.15.100:0/1696609069 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82740fcaa0 0x7f82740fceb0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8264004940 tx=0x7f8264009e30 comp rx=0 tx=0).stop 2023-12-05T09:54:54.084 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:54.086+0000 7f8278fff700 1 -- 172.21.15.100:0/1696609069 shutdown_connections 2023-12-05T09:54:54.084 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:54.086+0000 7f8278fff700 1 --2- 172.21.15.100:0/1696609069 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82740fdcb0 0x7f82740fe100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:54.084 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:54.086+0000 7f8278fff700 1 --2- 172.21.15.100:0/1696609069 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82740fcaa0 0x7f82740fceb0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:54.084 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:54.086+0000 7f8278fff700 1 -- 172.21.15.100:0/1696609069 >> 172.21.15.100:0/1696609069 conn(0x7f82740f8160 msgr2=0x7f82740fa590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:54:54.084 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:54.086+0000 7f8278fff700 1 -- 172.21.15.100:0/1696609069 shutdown_connections 2023-12-05T09:54:54.084 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:54.086+0000 7f8278fff700 1 -- 172.21.15.100:0/1696609069 wait complete. 2023-12-05T09:54:54.086 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:54.086+0000 7f8278fff700 1 Processor -- start 2023-12-05T09:54:54.086 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:54.087+0000 7f8278fff700 1 -- start start 2023-12-05T09:54:54.086 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:54.087+0000 7f8278fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82740fcaa0 0x7f827410d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:54.086 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:54.087+0000 7f8278fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82740fdcb0 0x7f827410d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:54.086 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:54.087+0000 7f8278fff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f827410de50 con 0x7f82740fdcb0 2023-12-05T09:54:54.087 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:54.087+0000 7f8278fff700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f827410dfc0 con 0x7f82740fcaa0 2023-12-05T09:54:54.087 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:54.087+0000 7f8271d9b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82740fdcb0 0x7f827410d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:54.087 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:54.087+0000 7f8271d9b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82740fdcb0 0x7f827410d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48586/0 (socket says 172.21.15.100:48586) 2023-12-05T09:54:54.087 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:54.087+0000 7f8271d9b700 1 -- 172.21.15.100:0/3623080718 learned_addr learned my addr 172.21.15.100:0/3623080718 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:54:54.087 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:54.087+0000 7f827259c700 1 --2- 172.21.15.100:0/3623080718 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82740fcaa0 0x7f827410d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:54.087 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:54.088+0000 7f8271d9b700 1 -- 172.21.15.100:0/3623080718 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82740fcaa0 msgr2=0x7f827410d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:54.087 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:54.088+0000 7f8271d9b700 1 --2- 172.21.15.100:0/3623080718 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82740fcaa0 0x7f827410d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:54.087 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:54.088+0000 7f8271d9b700 1 -- 172.21.15.100:0/3623080718 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8264005040 con 0x7f82740fdcb0 2023-12-05T09:54:54.087 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:54.088+0000 7f8271d9b700 1 --2- 172.21.15.100:0/3623080718 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82740fdcb0 0x7f827410d850 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f8268002a50 tx=0x7f82680046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:54:54.087 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:54.088+0000 7f8262ffd700 1 -- 172.21.15.100:0/3623080718 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8268007cc0 con 0x7f82740fdcb0 2023-12-05T09:54:54.087 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:54.088+0000 7f8262ffd700 1 -- 172.21.15.100:0/3623080718 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f826800f040 con 0x7f82740fdcb0 2023-12-05T09:54:54.087 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:54.088+0000 7f8278fff700 1 -- 172.21.15.100:0/3623080718 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8274112a70 con 0x7f82740fdcb0 2023-12-05T09:54:54.088 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:54.088+0000 7f8262ffd700 1 -- 172.21.15.100:0/3623080718 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f826800d9c0 con 0x7f82740fdcb0 2023-12-05T09:54:54.088 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:54.088+0000 7f8278fff700 1 -- 172.21.15.100:0/3623080718 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8274113030 con 0x7f82740fdcb0 2023-12-05T09:54:54.088 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:54.089+0000 7f8278fff700 1 -- 172.21.15.100:0/3623080718 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8274105460 con 0x7f82740fdcb0 2023-12-05T09:54:54.089 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:54.090+0000 7f8262ffd700 1 -- 172.21.15.100:0/3623080718 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f826800db60 con 0x7f82740fdcb0 2023-12-05T09:54:54.089 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:54.091+0000 7f8262ffd700 1 --2- 172.21.15.100:0/3623080718 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f825c068f70 0x7f825c06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:54.089 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:54.091+0000 7f8262ffd700 1 -- 172.21.15.100:0/3623080718 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f8268086400 con 0x7f82740fdcb0 2023-12-05T09:54:54.089 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:54.091+0000 7f827259c700 1 --2- 172.21.15.100:0/3623080718 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f825c068f70 0x7f825c06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:54.089 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:54.092+0000 7f827259c700 1 --2- 172.21.15.100:0/3623080718 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f825c068f70 0x7f825c06b420 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f826400b3b0 tx=0x7f8264009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:54:54.092 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:54.095+0000 7f8262ffd700 1 -- 172.21.15.100:0/3623080718 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f826804ca00 con 0x7f82740fdcb0 2023-12-05T09:54:54.331 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:54.334+0000 7f8278fff700 1 -- 172.21.15.100:0/3623080718 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f82741132e0 con 0x7f82740fdcb0 2023-12-05T09:54:54.332 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:54.335+0000 7f8262ffd700 1 -- 172.21.15.100:0/3623080718 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4697 (secure 0 0 0) 0x7f82680562b0 con 0x7f82740fdcb0 2023-12-05T09:54:54.332 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:54:54.332 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14486,"name":"cephfs.smithi150.pcbpxm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.150:6825/3645854543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":3645854543},{"type":"v1","addr":"172.21.15.150:6825","nonce":3645854543}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14498,"name":"cephfs.smithi150.fcnhsv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.150:6827/3249949736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":3249949736},{"type":"v1","addr":"172.21.15.150:6827","nonce":3249949736}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":14506,"name":"cephfs.smithi100.sqplhn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6827/2472212864","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":2472212864},{"type":"v1","addr":"172.21.15.100:6827","nonce":2472212864}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-05T09:54:30.515778+0000","modified":"2023-12-05T09:54:46.403009+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":46,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14490":{"gid":14490,"name":"cephfs.smithi100.akmstb","rank":0,"incarnation":10,"state":"up:active","state_seq":5,"addr":"172.21.15.100:6829/627555128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":627555128},{"type":"v1","addr":"172.21.15.100:6829","nonce":627555128}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-12-05T09:54:54.335 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:54.337+0000 7f8278fff700 1 -- 172.21.15.100:0/3623080718 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f825c068f70 msgr2=0x7f825c06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:54.335 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:54.337+0000 7f8278fff700 1 --2- 172.21.15.100:0/3623080718 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f825c068f70 0x7f825c06b420 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f826400b3b0 tx=0x7f8264009e30 comp rx=0 tx=0).stop 2023-12-05T09:54:54.335 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:54.337+0000 7f8278fff700 1 -- 172.21.15.100:0/3623080718 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82740fdcb0 msgr2=0x7f827410d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:54.335 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:54.337+0000 7f8278fff700 1 --2- 172.21.15.100:0/3623080718 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82740fdcb0 0x7f827410d850 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f8268002a50 tx=0x7f82680046b0 comp rx=0 tx=0).stop 2023-12-05T09:54:54.335 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:54.337+0000 7f8278fff700 1 -- 172.21.15.100:0/3623080718 shutdown_connections 2023-12-05T09:54:54.335 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:54.337+0000 7f8278fff700 1 --2- 172.21.15.100:0/3623080718 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f825c068f70 0x7f825c06b420 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:54.335 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:54.337+0000 7f8278fff700 1 --2- 172.21.15.100:0/3623080718 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82740fcaa0 0x7f827410d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:54.335 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:54.337+0000 7f8278fff700 1 --2- 172.21.15.100:0/3623080718 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82740fdcb0 0x7f827410d850 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:54.335 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:54.337+0000 7f8278fff700 1 -- 172.21.15.100:0/3623080718 >> 172.21.15.100:0/3623080718 conn(0x7f82740f8160 msgr2=0x7f8274100ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:54:54.335 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:54.337+0000 7f8278fff700 1 -- 172.21.15.100:0/3623080718 shutdown_connections 2023-12-05T09:54:54.335 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:54.337+0000 7f8278fff700 1 -- 172.21.15.100:0/3623080718 wait complete. 2023-12-05T09:54:54.336 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 13 2023-12-05T09:54:54.353 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 13, 'max_mds': 1, 'flags': 18} 2023-12-05T09:54:54.353 INFO:teuthology.run_tasks:Running task kclient... 2023-12-05T09:54:54.379 INFO:tasks.kclient:Mounting kernel clients... 2023-12-05T09:54:54.379 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2023-12-05T09:54:54.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:54:54.380 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2023-12-05T09:54:54.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:54:54.429 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link delete ceph-brx 2023-12-05T09:54:54.502 INFO:teuthology.orchestra.run.smithi100.stderr:Cannot find device "ceph-brx" 2023-12-05T09:54:54.505 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-05T09:54:54.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:54:54.505 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list 2023-12-05T09:54:54.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:54:54.561 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link delete ceph-brx 2023-12-05T09:54:54.641 INFO:teuthology.orchestra.run.smithi150.stderr:Cannot find device "ceph-brx" 2023-12-05T09:54:54.644 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-05T09:54:54.644 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-12-05T09:54:54.645 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-05T09:54:54.645 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-05T09:54:54.645 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- ceph fs ls 2023-12-05T09:54:54.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:54 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/1161474147' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-05T09:54:54.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:54 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/3113592240' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-05T09:54:54.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:54 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/3623080718' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-05T09:54:54.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:54 smithi150 ceph-mon[116142]: from='client.? 172.21.15.100:0/1161474147' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-05T09:54:54.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:54 smithi150 ceph-mon[116142]: from='client.? 172.21.15.100:0/3113592240' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-05T09:54:54.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:54 smithi150 ceph-mon[116142]: from='client.? 172.21.15.100:0/3623080718' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-05T09:54:55.071 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi100/config 2023-12-05T09:54:55.586 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:55 smithi100 ceph-mon[107145]: pgmap v166: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.8 KiB/s rd, 0 B/s wr, 4 op/s 2023-12-05T09:54:55.698 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:55 smithi150 ceph-mon[116142]: pgmap v166: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.8 KiB/s rd, 0 B/s wr, 4 op/s 2023-12-05T09:54:56.322 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:56.325+0000 7fb89bb28700 1 -- 172.21.15.100:0/2331149215 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb894102c00 msgr2=0x7fb894102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:56.323 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:56.325+0000 7fb89bb28700 1 --2- 172.21.15.100:0/2331149215 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb894102c00 0x7fb894102fd0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb890004940 tx=0x7fb890009e30 comp rx=0 tx=0).stop 2023-12-05T09:54:56.323 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:56.325+0000 7fb89bb28700 1 -- 172.21.15.100:0/2331149215 shutdown_connections 2023-12-05T09:54:56.323 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:56.325+0000 7fb89bb28700 1 --2- 172.21.15.100:0/2331149215 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8941035a0 0x7fb8940fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:56.323 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:56.325+0000 7fb89bb28700 1 --2- 172.21.15.100:0/2331149215 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb894102c00 0x7fb894102fd0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:56.323 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:56.325+0000 7fb89bb28700 1 -- 172.21.15.100:0/2331149215 >> 172.21.15.100:0/2331149215 conn(0x7fb8940f8790 msgr2=0x7fb8940faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:54:56.323 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:56.325+0000 7fb89bb28700 1 -- 172.21.15.100:0/2331149215 shutdown_connections 2023-12-05T09:54:56.323 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:56.325+0000 7fb89bb28700 1 -- 172.21.15.100:0/2331149215 wait complete. 2023-12-05T09:54:56.325 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:56.326+0000 7fb89bb28700 1 Processor -- start 2023-12-05T09:54:56.325 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:56.326+0000 7fb89bb28700 1 -- start start 2023-12-05T09:54:56.326 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:56.326+0000 7fb89bb28700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb894102c00 0x7fb89406ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:56.326 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:56.326+0000 7fb89bb28700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8941035a0 0x7fb894070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:56.326 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:56.326+0000 7fb89bb28700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb894070a80 con 0x7fb8941035a0 2023-12-05T09:54:56.326 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:56.326+0000 7fb89bb28700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb894070bf0 con 0x7fb894102c00 2023-12-05T09:54:56.326 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:56.326+0000 7fb8990c3700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8941035a0 0x7fb894070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:56.326 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:56.326+0000 7fb8990c3700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8941035a0 0x7fb894070480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48602/0 (socket says 172.21.15.100:48602) 2023-12-05T09:54:56.326 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:56.326+0000 7fb8990c3700 1 -- 172.21.15.100:0/897557593 learned_addr learned my addr 172.21.15.100:0/897557593 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:54:56.326 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:56.327+0000 7fb8998c4700 1 --2- 172.21.15.100:0/897557593 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb894102c00 0x7fb89406ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:56.326 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:56.327+0000 7fb8990c3700 1 -- 172.21.15.100:0/897557593 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb894102c00 msgr2=0x7fb89406ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:56.326 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:56.327+0000 7fb8990c3700 1 --2- 172.21.15.100:0/897557593 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb894102c00 0x7fb89406ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:56.326 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:56.327+0000 7fb8990c3700 1 -- 172.21.15.100:0/897557593 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb890005040 con 0x7fb8941035a0 2023-12-05T09:54:56.326 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:56.327+0000 7fb8990c3700 1 --2- 172.21.15.100:0/897557593 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8941035a0 0x7fb894070480 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb884002a80 tx=0x7fb884004630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:54:56.327 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:56.327+0000 7fb88a7fc700 1 -- 172.21.15.100:0/897557593 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb884004e80 con 0x7fb8941035a0 2023-12-05T09:54:56.327 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:56.327+0000 7fb88a7fc700 1 -- 172.21.15.100:0/897557593 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb88400f040 con 0x7fb8941035a0 2023-12-05T09:54:56.327 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:56.327+0000 7fb89bb28700 1 -- 172.21.15.100:0/897557593 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb894119870 con 0x7fb8941035a0 2023-12-05T09:54:56.327 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:56.327+0000 7fb88a7fc700 1 -- 172.21.15.100:0/897557593 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb88400da00 con 0x7fb8941035a0 2023-12-05T09:54:56.327 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:56.327+0000 7fb89bb28700 1 -- 172.21.15.100:0/897557593 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb894119d50 con 0x7fb8941035a0 2023-12-05T09:54:56.328 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:56.329+0000 7fb89bb28700 1 -- 172.21.15.100:0/897557593 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8940fff10 con 0x7fb8941035a0 2023-12-05T09:54:56.328 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:56.329+0000 7fb88a7fc700 1 -- 172.21.15.100:0/897557593 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7fb884007cc0 con 0x7fb8941035a0 2023-12-05T09:54:56.328 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:56.331+0000 7fb88a7fc700 1 --2- 172.21.15.100:0/897557593 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fb880068f70 0x7fb88006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:54:56.329 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:56.331+0000 7fb88a7fc700 1 -- 172.21.15.100:0/897557593 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fb8840864f0 con 0x7fb8941035a0 2023-12-05T09:54:56.329 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:56.331+0000 7fb8998c4700 1 --2- 172.21.15.100:0/897557593 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fb880068f70 0x7fb88006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:54:56.329 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:56.331+0000 7fb8998c4700 1 --2- 172.21.15.100:0/897557593 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fb880068f70 0x7fb88006b420 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb8900043d0 tx=0x7fb890009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:54:56.332 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:56.335+0000 7fb88a7fc700 1 -- 172.21.15.100:0/897557593 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fb88404ca00 con 0x7fb8941035a0 2023-12-05T09:54:56.571 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:56.574+0000 7fb89bb28700 1 -- 172.21.15.100:0/897557593 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb8940fc390 con 0x7fb8941035a0 2023-12-05T09:54:56.572 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:56.574+0000 7fb88a7fc700 1 -- 172.21.15.100:0/897557593 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v13) v1 ==== 53+0+83 (secure 0 0 0) 0x7fb884052850 con 0x7fb8941035a0 2023-12-05T09:54:56.572 INFO:teuthology.orchestra.run.smithi100.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2023-12-05T09:54:56.574 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:56.577+0000 7fb89bb28700 1 -- 172.21.15.100:0/897557593 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fb880068f70 msgr2=0x7fb88006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:56.575 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:56.577+0000 7fb89bb28700 1 --2- 172.21.15.100:0/897557593 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fb880068f70 0x7fb88006b420 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb8900043d0 tx=0x7fb890009e30 comp rx=0 tx=0).stop 2023-12-05T09:54:56.575 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:56.577+0000 7fb89bb28700 1 -- 172.21.15.100:0/897557593 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8941035a0 msgr2=0x7fb894070480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:54:56.575 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:56.577+0000 7fb89bb28700 1 --2- 172.21.15.100:0/897557593 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8941035a0 0x7fb894070480 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb884002a80 tx=0x7fb884004630 comp rx=0 tx=0).stop 2023-12-05T09:54:56.575 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:56.577+0000 7fb89bb28700 1 -- 172.21.15.100:0/897557593 shutdown_connections 2023-12-05T09:54:56.575 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:56.577+0000 7fb89bb28700 1 --2- 172.21.15.100:0/897557593 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fb880068f70 0x7fb88006b420 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:56.575 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:56.577+0000 7fb89bb28700 1 --2- 172.21.15.100:0/897557593 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb894102c00 0x7fb89406ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:56.575 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:56.577+0000 7fb89bb28700 1 --2- 172.21.15.100:0/897557593 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8941035a0 0x7fb894070480 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:54:56.575 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:56.577+0000 7fb89bb28700 1 -- 172.21.15.100:0/897557593 >> 172.21.15.100:0/897557593 conn(0x7fb8940f8790 msgr2=0x7fb8940fa280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:54:56.575 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:56.577+0000 7fb89bb28700 1 -- 172.21.15.100:0/897557593 shutdown_connections 2023-12-05T09:54:56.575 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:54:56.577+0000 7fb89bb28700 1 -- 172.21.15.100:0/897557593 wait complete. 2023-12-05T09:54:57.031 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-05T09:54:57.031 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-05T09:54:57.031 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi100.front.sepia.ceph.com 2023-12-05T09:54:57.031 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-05T09:54:57.031 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-05T09:54:57.031 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-05T09:54:57.031 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-05T09:54:57.031 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-05T09:54:57.032 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-05T09:54:57.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:54:57.032 DEBUG:teuthology.orchestra.run.smithi100:> ip addr 2023-12-05T09:54:57.080 INFO:teuthology.orchestra.run.smithi100.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-05T09:54:57.080 INFO:teuthology.orchestra.run.smithi100.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-05T09:54:57.080 INFO:teuthology.orchestra.run.smithi100.stdout: inet 127.0.0.1/8 scope host lo 2023-12-05T09:54:57.080 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2023-12-05T09:54:57.081 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 ::1/128 scope host 2023-12-05T09:54:57.081 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2023-12-05T09:54:57.081 INFO:teuthology.orchestra.run.smithi100.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-05T09:54:57.081 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:28 brd ff:ff:ff:ff:ff:ff 2023-12-05T09:54:57.081 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f0 2023-12-05T09:54:57.081 INFO:teuthology.orchestra.run.smithi100.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-05T09:54:57.081 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:29 brd ff:ff:ff:ff:ff:ff 2023-12-05T09:54:57.081 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f1 2023-12-05T09:54:57.081 INFO:teuthology.orchestra.run.smithi100.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-05T09:54:57.081 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:32 brd ff:ff:ff:ff:ff:ff 2023-12-05T09:54:57.081 INFO:teuthology.orchestra.run.smithi100.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-05T09:54:57.081 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:33 brd ff:ff:ff:ff:ff:ff 2023-12-05T09:54:57.081 INFO:teuthology.orchestra.run.smithi100.stdout: inet 172.21.15.100/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-05T09:54:57.081 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft 41730sec preferred_lft 41730sec 2023-12-05T09:54:57.082 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::ec4:7aff:fe8f:d733/64 scope link 2023-12-05T09:54:57.082 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2023-12-05T09:54:57.082 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-05T09:54:57.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:54:57.082 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec bash -c ' 2023-12-05T09:54:57.082 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2023-12-05T09:54:57.082 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link add name ceph-brx type bridge 2023-12-05T09:54:57.082 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip addr flush dev ceph-brx 2023-12-05T09:54:57.083 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set ceph-brx up 2023-12-05T09:54:57.083 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-05T09:54:57.083 DEBUG:teuthology.orchestra.run.smithi100:> ') 2023-12-05T09:54:57.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:54:57.512 DEBUG:teuthology.orchestra.run.smithi100:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-05T09:54:57.585 INFO:teuthology.orchestra.run.smithi100.stdout:1 2023-12-05T09:54:57.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:54:57.589 DEBUG:teuthology.orchestra.run.smithi100:> route 2023-12-05T09:54:57.656 INFO:teuthology.orchestra.run.smithi100.stdout:Kernel IP routing table 2023-12-05T09:54:57.656 INFO:teuthology.orchestra.run.smithi100.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-05T09:54:57.656 INFO:teuthology.orchestra.run.smithi100.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-05T09:54:57.656 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-05T09:54:57.656 INFO:teuthology.orchestra.run.smithi100.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-05T09:54:57.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:54:57.658 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec bash -c ' 2023-12-05T09:54:57.658 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2023-12-05T09:54:57.658 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-05T09:54:57.658 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-05T09:54:57.658 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-05T09:54:57.658 DEBUG:teuthology.orchestra.run.smithi100:> ') 2023-12-05T09:54:57.762 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:57 smithi100 ceph-mon[107145]: pgmap v167: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.2 KiB/s rd, 0 B/s wr, 4 op/s 2023-12-05T09:54:57.762 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:57 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/897557593' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-12-05T09:54:57.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:57 smithi150 ceph-mon[116142]: pgmap v167: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.2 KiB/s rd, 0 B/s wr, 4 op/s 2023-12-05T09:54:57.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:57 smithi150 ceph-mon[116142]: from='client.? 172.21.15.100:0/897557593' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-12-05T09:54:58.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:54:58.375 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2023-12-05T09:54:58.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:54:58.424 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list-id 2023-12-05T09:54:58.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:54:58.472 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec bash -c ' 2023-12-05T09:54:58.472 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2023-12-05T09:54:58.472 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-05T09:54:58.472 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-12-05T09:54:58.472 DEBUG:teuthology.orchestra.run.smithi100:> ') 2023-12-05T09:54:58.618 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-12-05T09:54:58.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:54:58.618 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec bash -c ' 2023-12-05T09:54:58.618 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2023-12-05T09:54:58.618 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-12-05T09:54:58.618 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-05T09:54:58.618 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-12-05T09:54:58.618 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-12-05T09:54:58.619 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-12-05T09:54:58.619 DEBUG:teuthology.orchestra.run.smithi100:> ') 2023-12-05T09:54:58.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:54:58.890 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec bash -c ' 2023-12-05T09:54:58.890 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2023-12-05T09:54:58.890 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set brx.0 up 2023-12-05T09:54:58.890 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set dev brx.0 master ceph-brx 2023-12-05T09:54:58.890 DEBUG:teuthology.orchestra.run.smithi100:> ') 2023-12-05T09:54:59.067 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-05T09:54:59.067 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-05T09:54:59.113 INFO:teuthology.orchestra.run.smithi100.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-05T09:54:59.114 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-05T09:54:59.114 DEBUG:teuthology.orchestra.run.smithi100:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-05T09:54:59.200 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-12-05T09:54:59.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:54:59.200 DEBUG:teuthology.orchestra.run.smithi100:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-05T09:54:59.353 INFO:teuthology.orchestra.run.smithi100.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-05T09:54:59.353 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-05T09:54:59.353 INFO:teuthology.orchestra.run.smithi100.stdout:invalid new device string format 2023-12-05T09:54:59.604 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:54:59 smithi100 ceph-mon[107145]: pgmap v168: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.2 KiB/s rd, 0 B/s wr, 4 op/s 2023-12-05T09:54:59.776 INFO:teuthology.orchestra.run.smithi100.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-05T09:54:59.777 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-05T09:54:59.777 INFO:teuthology.orchestra.run.smithi100.stdout:invalid new device string format 2023-12-05T09:54:59.777 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: resolved to: "172.21.15.100:3300,172.21.15.150:3300" 2023-12-05T09:54:59.777 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-05T09:54:59.805 INFO:teuthology.orchestra.run.smithi100.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-05T09:54:59.805 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-05T09:54:59.805 INFO:teuthology.orchestra.run.smithi100.stdout:invalid new device string format 2023-12-05T09:54:59.805 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: resolved to: "172.21.15.100:3300,172.21.15.150:3300" 2023-12-05T09:54:59.805 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-05T09:54:59.805 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: resolved to: "172.21.15.100:6789,172.21.15.150:6789" 2023-12-05T09:54:59.805 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.100:6789,172.21.15.150:6789:/ 2023-12-05T09:54:59.806 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=5b035ce6-9353-11ee-95a2-87774f69a715" will pass to kernel 2023-12-05T09:54:59.811 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-05T09:54:59.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:54:59.811 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-05T09:54:59.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:54:59 smithi150 ceph-mon[116142]: pgmap v168: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.2 KiB/s rd, 0 B/s wr, 4 op/s 2023-12-05T09:54:59.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:54:59.884 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-05T09:54:59.997 INFO:teuthology.orchestra.run.smithi100.stdout:client24353 2023-12-05T09:54:59.997 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-12-05T09:54:59.997 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-05T09:55:00.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:55:00.044 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-05T09:55:00.188 INFO:teuthology.orchestra.run.smithi100.stdout:client24353 2023-12-05T09:55:00.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:55:00.188 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-05T09:55:00.290 INFO:teuthology.orchestra.run.smithi100.stdout:client24353 2023-12-05T09:55:00.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:55:00.291 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/5b035ce6-9353-11ee-95a2-87774f69a715.client24353/status') 2023-12-05T09:55:00.411 INFO:teuthology.orchestra.run.smithi100.stdout:instance: client.24353 (3)172.21.15.100:0/245096102 2023-12-05T09:55:00.411 INFO:teuthology.orchestra.run.smithi100.stdout:blocklisted: false 2023-12-05T09:55:00.411 INFO:teuthology.orchestra.run.smithi100.stderr:0+1 records in 2023-12-05T09:55:00.411 INFO:teuthology.orchestra.run.smithi100.stderr:0+1 records out 2023-12-05T09:55:00.411 INFO:teuthology.orchestra.run.smithi100.stderr:71 bytes copied, 5.9469e-05 s, 1.2 MB/s 2023-12-05T09:55:00.414 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2023-12-05T09:55:00.414 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-05T09:55:00.415 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-05T09:55:00.415 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -- ceph fs ls 2023-12-05T09:55:00.839 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi100/config 2023-12-05T09:55:01.383 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:55:01 smithi100 ceph-mon[107145]: pgmap v169: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.6 KiB/s rd, 0 B/s wr, 3 op/s 2023-12-05T09:55:01.383 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:55:01 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:55:01.383 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:55:01 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:55:01.595 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:55:01 smithi150 ceph-mon[116142]: pgmap v169: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.6 KiB/s rd, 0 B/s wr, 3 op/s 2023-12-05T09:55:01.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:55:01 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:55:01.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:55:01 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:55:02.080 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:02.082+0000 7f898a481700 1 -- 172.21.15.100:0/2496802620 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89841035a0 msgr2=0x7f89840fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:02.080 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:02.082+0000 7f898a481700 1 --2- 172.21.15.100:0/2496802620 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89841035a0 0x7f89840fcc10 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8978004940 tx=0x7f8978009e30 comp rx=0 tx=0).stop 2023-12-05T09:55:02.080 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:02.083+0000 7f898a481700 1 -- 172.21.15.100:0/2496802620 shutdown_connections 2023-12-05T09:55:02.080 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:02.083+0000 7f898a481700 1 --2- 172.21.15.100:0/2496802620 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89841035a0 0x7f89840fcc10 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:02.080 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:02.083+0000 7f898a481700 1 --2- 172.21.15.100:0/2496802620 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8984102c00 0x7f8984102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:02.080 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:02.083+0000 7f898a481700 1 -- 172.21.15.100:0/2496802620 >> 172.21.15.100:0/2496802620 conn(0x7f89840f8790 msgr2=0x7f89840faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:55:02.080 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:02.083+0000 7f898a481700 1 -- 172.21.15.100:0/2496802620 shutdown_connections 2023-12-05T09:55:02.081 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:02.083+0000 7f898a481700 1 -- 172.21.15.100:0/2496802620 wait complete. 2023-12-05T09:55:02.081 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:02.083+0000 7f898a481700 1 Processor -- start 2023-12-05T09:55:02.081 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:02.084+0000 7f898a481700 1 -- start start 2023-12-05T09:55:02.082 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:02.084+0000 7f898a481700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8984102c00 0x7f8984113680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:55:02.082 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:02.084+0000 7f898a481700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89841035a0 0x7f8984113bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:55:02.082 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:02.084+0000 7f898a481700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8984114210 con 0x7f89841035a0 2023-12-05T09:55:02.082 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:02.084+0000 7f898a481700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f898410d500 con 0x7f8984102c00 2023-12-05T09:55:02.082 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:02.084+0000 7f89837fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89841035a0 0x7f8984113bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:55:02.082 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:02.084+0000 7f89837fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89841035a0 0x7f8984113bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57638/0 (socket says 172.21.15.100:57638) 2023-12-05T09:55:02.083 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:02.084+0000 7f89837fe700 1 -- 172.21.15.100:0/1259391565 learned_addr learned my addr 172.21.15.100:0/1259391565 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:55:02.083 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:02.084+0000 7f8983fff700 1 --2- 172.21.15.100:0/1259391565 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8984102c00 0x7f8984113680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:55:02.083 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:02.085+0000 7f89837fe700 1 -- 172.21.15.100:0/1259391565 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8984102c00 msgr2=0x7f8984113680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:02.083 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:02.085+0000 7f89837fe700 1 --2- 172.21.15.100:0/1259391565 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8984102c00 0x7f8984113680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:02.083 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:02.085+0000 7f89837fe700 1 -- 172.21.15.100:0/1259391565 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8978005040 con 0x7f89841035a0 2023-12-05T09:55:02.083 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:02.085+0000 7f89837fe700 1 --2- 172.21.15.100:0/1259391565 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89841035a0 0x7f8984113bc0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8978009360 tx=0x7f8978009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:55:02.083 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:02.085+0000 7f8980ff9700 1 -- 172.21.15.100:0/1259391565 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f897800e040 con 0x7f89841035a0 2023-12-05T09:55:02.083 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:02.085+0000 7f8980ff9700 1 -- 172.21.15.100:0/1259391565 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8978013420 con 0x7f89841035a0 2023-12-05T09:55:02.083 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:02.085+0000 7f8980ff9700 1 -- 172.21.15.100:0/1259391565 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f897801c610 con 0x7f89841035a0 2023-12-05T09:55:02.083 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:02.085+0000 7f898a481700 1 -- 172.21.15.100:0/1259391565 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f898410d780 con 0x7f89841035a0 2023-12-05T09:55:02.083 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:02.085+0000 7f898a481700 1 -- 172.21.15.100:0/1259391565 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f898410dcc0 con 0x7f89841035a0 2023-12-05T09:55:02.084 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:02.086+0000 7f898a481700 1 -- 172.21.15.100:0/1259391565 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8984113310 con 0x7f89841035a0 2023-12-05T09:55:02.084 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:02.087+0000 7f8980ff9700 1 -- 172.21.15.100:0/1259391565 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f8978013590 con 0x7f89841035a0 2023-12-05T09:55:02.085 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:02.088+0000 7f8980ff9700 1 --2- 172.21.15.100:0/1259391565 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f896c068f70 0x7f896c06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:55:02.085 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:02.088+0000 7f8980ff9700 1 -- 172.21.15.100:0/1259391565 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f8978088070 con 0x7f89841035a0 2023-12-05T09:55:02.085 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:02.089+0000 7f8983fff700 1 --2- 172.21.15.100:0/1259391565 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f896c068f70 0x7f896c06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:55:02.085 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:02.089+0000 7f8983fff700 1 --2- 172.21.15.100:0/1259391565 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f896c068f70 0x7f896c06b420 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8974004f40 tx=0x7f897400b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:55:02.089 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:02.093+0000 7f8980ff9700 1 -- 172.21.15.100:0/1259391565 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f8978057ee0 con 0x7f89841035a0 2023-12-05T09:55:02.327 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:02.330+0000 7f898a481700 1 -- 172.21.15.100:0/1259391565 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f898404bbd0 con 0x7f89841035a0 2023-12-05T09:55:02.327 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:02.330+0000 7f8980ff9700 1 -- 172.21.15.100:0/1259391565 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v13) v1 ==== 53+0+83 (secure 0 0 0) 0x7f8978057a70 con 0x7f89841035a0 2023-12-05T09:55:02.327 INFO:teuthology.orchestra.run.smithi100.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2023-12-05T09:55:02.329 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:02.332+0000 7f898a481700 1 -- 172.21.15.100:0/1259391565 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f896c068f70 msgr2=0x7f896c06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:02.329 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:02.332+0000 7f898a481700 1 --2- 172.21.15.100:0/1259391565 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f896c068f70 0x7f896c06b420 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8974004f40 tx=0x7f897400b040 comp rx=0 tx=0).stop 2023-12-05T09:55:02.329 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:02.332+0000 7f898a481700 1 -- 172.21.15.100:0/1259391565 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89841035a0 msgr2=0x7f8984113bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:02.329 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:02.332+0000 7f898a481700 1 --2- 172.21.15.100:0/1259391565 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89841035a0 0x7f8984113bc0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8978009360 tx=0x7f8978009e30 comp rx=0 tx=0).stop 2023-12-05T09:55:02.329 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:02.333+0000 7f898a481700 1 -- 172.21.15.100:0/1259391565 shutdown_connections 2023-12-05T09:55:02.329 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:02.333+0000 7f898a481700 1 --2- 172.21.15.100:0/1259391565 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f896c068f70 0x7f896c06b420 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:02.329 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:02.333+0000 7f898a481700 1 --2- 172.21.15.100:0/1259391565 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8984102c00 0x7f8984113680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:02.330 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:02.333+0000 7f898a481700 1 --2- 172.21.15.100:0/1259391565 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89841035a0 0x7f8984113bc0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:02.330 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:02.333+0000 7f898a481700 1 -- 172.21.15.100:0/1259391565 >> 172.21.15.100:0/1259391565 conn(0x7f89840f8790 msgr2=0x7f89840fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:55:02.330 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:02.333+0000 7f898a481700 1 -- 172.21.15.100:0/1259391565 shutdown_connections 2023-12-05T09:55:02.330 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:02.333+0000 7f898a481700 1 -- 172.21.15.100:0/1259391565 wait complete. 2023-12-05T09:55:02.725 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-05T09:55:02.725 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-05T09:55:02.725 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi150.front.sepia.ceph.com 2023-12-05T09:55:02.725 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-05T09:55:02.725 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-05T09:55:02.725 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-05T09:55:02.725 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-05T09:55:02.725 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-05T09:55:02.725 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-05T09:55:02.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:55:02.726 DEBUG:teuthology.orchestra.run.smithi150:> ip addr 2023-12-05T09:55:02.779 INFO:teuthology.orchestra.run.smithi150.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-05T09:55:02.779 INFO:teuthology.orchestra.run.smithi150.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-05T09:55:02.779 INFO:teuthology.orchestra.run.smithi150.stdout: inet 127.0.0.1/8 scope host lo 2023-12-05T09:55:02.779 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2023-12-05T09:55:02.779 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 ::1/128 scope host 2023-12-05T09:55:02.779 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2023-12-05T09:55:02.779 INFO:teuthology.orchestra.run.smithi150.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-05T09:55:02.779 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bc brd ff:ff:ff:ff:ff:ff 2023-12-05T09:55:02.780 INFO:teuthology.orchestra.run.smithi150.stdout: altname enp7s0f0 2023-12-05T09:55:02.780 INFO:teuthology.orchestra.run.smithi150.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-05T09:55:02.780 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bd brd ff:ff:ff:ff:ff:ff 2023-12-05T09:55:02.780 INFO:teuthology.orchestra.run.smithi150.stdout: altname enp7s0f1 2023-12-05T09:55:02.780 INFO:teuthology.orchestra.run.smithi150.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-05T09:55:02.780 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:34 brd ff:ff:ff:ff:ff:ff 2023-12-05T09:55:02.780 INFO:teuthology.orchestra.run.smithi150.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-05T09:55:02.780 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:35 brd ff:ff:ff:ff:ff:ff 2023-12-05T09:55:02.780 INFO:teuthology.orchestra.run.smithi150.stdout: inet 172.21.15.150/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-05T09:55:02.780 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft 41804sec preferred_lft 41804sec 2023-12-05T09:55:02.780 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::ec4:7aff:fe88:6e35/64 scope link 2023-12-05T09:55:02.780 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2023-12-05T09:55:02.781 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-05T09:55:02.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:55:02.781 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec bash -c ' 2023-12-05T09:55:02.781 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2023-12-05T09:55:02.781 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link add name ceph-brx type bridge 2023-12-05T09:55:02.781 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip addr flush dev ceph-brx 2023-12-05T09:55:02.781 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set ceph-brx up 2023-12-05T09:55:02.781 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-05T09:55:02.781 DEBUG:teuthology.orchestra.run.smithi150:> ') 2023-12-05T09:55:03.142 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:55:03 smithi150 ceph-mon[116142]: pgmap v170: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1 op/s 2023-12-05T09:55:03.142 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:55:03 smithi150 ceph-mon[116142]: from='client.? 172.21.15.100:0/1259391565' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-12-05T09:55:03.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:55:03.209 DEBUG:teuthology.orchestra.run.smithi150:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-05T09:55:03.282 INFO:teuthology.orchestra.run.smithi150.stdout:1 2023-12-05T09:55:03.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:55:03.285 DEBUG:teuthology.orchestra.run.smithi150:> route 2023-12-05T09:55:03.352 INFO:teuthology.orchestra.run.smithi150.stdout:Kernel IP routing table 2023-12-05T09:55:03.352 INFO:teuthology.orchestra.run.smithi150.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-05T09:55:03.352 INFO:teuthology.orchestra.run.smithi150.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-05T09:55:03.352 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-05T09:55:03.352 INFO:teuthology.orchestra.run.smithi150.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-05T09:55:03.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:55:03.354 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec bash -c ' 2023-12-05T09:55:03.354 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2023-12-05T09:55:03.354 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-05T09:55:03.354 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-05T09:55:03.354 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-05T09:55:03.354 DEBUG:teuthology.orchestra.run.smithi150:> ') 2023-12-05T09:55:03.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:55:03 smithi100 ceph-mon[107145]: pgmap v170: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1 op/s 2023-12-05T09:55:03.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:55:03 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/1259391565' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-12-05T09:55:04.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:55:04.037 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list 2023-12-05T09:55:04.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:55:04.085 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list-id 2023-12-05T09:55:04.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:55:04.132 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec bash -c ' 2023-12-05T09:55:04.132 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2023-12-05T09:55:04.132 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-05T09:55:04.132 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-12-05T09:55:04.133 DEBUG:teuthology.orchestra.run.smithi150:> ') 2023-12-05T09:55:04.277 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-12-05T09:55:04.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:55:04.278 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec bash -c ' 2023-12-05T09:55:04.278 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2023-12-05T09:55:04.278 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-12-05T09:55:04.278 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-05T09:55:04.278 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-12-05T09:55:04.278 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-12-05T09:55:04.278 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-12-05T09:55:04.278 DEBUG:teuthology.orchestra.run.smithi150:> ') 2023-12-05T09:55:04.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:55:04.544 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec bash -c ' 2023-12-05T09:55:04.544 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2023-12-05T09:55:04.544 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set brx.0 up 2023-12-05T09:55:04.544 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set dev brx.0 master ceph-brx 2023-12-05T09:55:04.544 DEBUG:teuthology.orchestra.run.smithi150:> ') 2023-12-05T09:55:04.720 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-05T09:55:04.720 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-05T09:55:04.767 INFO:teuthology.orchestra.run.smithi150.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-05T09:55:04.767 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-05T09:55:04.767 DEBUG:teuthology.orchestra.run.smithi150:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-05T09:55:04.854 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-12-05T09:55:04.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:55:04.854 DEBUG:teuthology.orchestra.run.smithi150:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-05T09:55:05.008 INFO:teuthology.orchestra.run.smithi150.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-05T09:55:05.008 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-12-05T09:55:05.008 INFO:teuthology.orchestra.run.smithi150.stdout:invalid new device string format 2023-12-05T09:55:05.430 INFO:teuthology.orchestra.run.smithi150.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-05T09:55:05.431 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-12-05T09:55:05.431 INFO:teuthology.orchestra.run.smithi150.stdout:invalid new device string format 2023-12-05T09:55:05.431 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: resolved to: "172.21.15.100:3300,172.21.15.150:3300" 2023-12-05T09:55:05.431 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-05T09:55:05.456 INFO:teuthology.orchestra.run.smithi150.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-05T09:55:05.456 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-12-05T09:55:05.456 INFO:teuthology.orchestra.run.smithi150.stdout:invalid new device string format 2023-12-05T09:55:05.456 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: resolved to: "172.21.15.100:3300,172.21.15.150:3300" 2023-12-05T09:55:05.456 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-05T09:55:05.456 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: resolved to: "172.21.15.100:6789,172.21.15.150:6789" 2023-12-05T09:55:05.456 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.100:6789,172.21.15.150:6789:/ 2023-12-05T09:55:05.456 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=5b035ce6-9353-11ee-95a2-87774f69a715" will pass to kernel 2023-12-05T09:55:05.461 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-05T09:55:05.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:55:05.462 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-05T09:55:05.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:55:05.534 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-05T09:55:05.632 INFO:teuthology.orchestra.run.smithi150.stdout:client24359 2023-12-05T09:55:05.633 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-12-05T09:55:05.633 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-05T09:55:05.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:55:05.680 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-05T09:55:05.699 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:55:05 smithi150 ceph-mon[116142]: pgmap v171: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2023-12-05T09:55:05.788 INFO:teuthology.orchestra.run.smithi150.stdout:client24359 2023-12-05T09:55:05.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:55:05.789 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-05T09:55:05.877 INFO:teuthology.orchestra.run.smithi150.stdout:client24359 2023-12-05T09:55:05.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:55:05.878 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/5b035ce6-9353-11ee-95a2-87774f69a715.client24359/status') 2023-12-05T09:55:05.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:55:05 smithi100 ceph-mon[107145]: pgmap v171: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2023-12-05T09:55:05.988 INFO:teuthology.orchestra.run.smithi150.stdout:instance: client.24359 (3)192.168.0.1:0/2212005706 2023-12-05T09:55:05.988 INFO:teuthology.orchestra.run.smithi150.stdout:blocklisted: false 2023-12-05T09:55:05.988 INFO:teuthology.orchestra.run.smithi150.stderr:0+1 records in 2023-12-05T09:55:05.988 INFO:teuthology.orchestra.run.smithi150.stderr:0+1 records out 2023-12-05T09:55:05.988 INFO:teuthology.orchestra.run.smithi150.stderr:70 bytes copied, 8.3422e-05 s, 839 kB/s 2023-12-05T09:55:05.991 INFO:teuthology.run_tasks:Running task print... 2023-12-05T09:55:06.001 INFO:teuthology.task.print:**** done client 2023-12-05T09:55:06.001 INFO:teuthology.run_tasks:Running task parallel... 2023-12-05T09:55:06.014 INFO:teuthology.task.parallel:starting parallel... 2023-12-05T09:55:06.014 INFO:teuthology.task.parallel:In parallel, running task sequential... 2023-12-05T09:55:06.015 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2023-12-05T09:55:06.015 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi100.front.sepia.ceph.com 2023-12-05T09:55:06.015 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -e sha1=3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs false || true' 2023-12-05T09:55:06.016 INFO:teuthology.task.parallel:In parallel, running task sequential... 2023-12-05T09:55:06.016 INFO:teuthology.task.sequential:In sequential, running task workunit... 2023-12-05T09:55:06.019 INFO:tasks.workunit:Pulling workunits from ref 3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 2023-12-05T09:55:06.019 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-12-05T09:55:06.019 INFO:tasks.workunit:timeout=3h 2023-12-05T09:55:06.019 INFO:tasks.workunit:cleanup=True 2023-12-05T09:55:06.020 DEBUG:teuthology.orchestra.run.smithi100:> stat -- /home/ubuntu/cephtest/mnt.0 2023-12-05T09:55:06.074 INFO:teuthology.orchestra.run.smithi100.stdout: File: /home/ubuntu/cephtest/mnt.0 2023-12-05T09:55:06.074 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2023-12-05T09:55:06.075 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 96h/150d Inode: 1 Links: 2 2023-12-05T09:55:06.075 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-05T09:55:06.075 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:cephfs_t:s0 2023-12-05T09:55:06.075 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-12-05T09:55:06.075 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2023-12-05 09:54:33.392246984 +0000 2023-12-05T09:55:06.075 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2023-12-05 09:54:59.883071469 +0000 2023-12-05T09:55:06.075 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2023-12-05 09:54:33.392246984 +0000 2023-12-05T09:55:06.075 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2023-12-05T09:55:06.075 DEBUG:teuthology.orchestra.run.smithi100:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2023-12-05T09:55:06.196 DEBUG:teuthology.orchestra.run.smithi150:> stat -- /home/ubuntu/cephtest/mnt.1 2023-12-05T09:55:06.244 INFO:teuthology.orchestra.run.smithi150.stdout: File: /home/ubuntu/cephtest/mnt.1 2023-12-05T09:55:06.244 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 1 Blocks: 0 IO Block: 65536 directory 2023-12-05T09:55:06.244 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 75h/117d Inode: 1 Links: 3 2023-12-05T09:55:06.244 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-05T09:55:06.244 INFO:teuthology.orchestra.run.smithi150.stdout:Context: system_u:object_r:cephfs_t:s0 2023-12-05T09:55:06.244 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-12-05T09:55:06.245 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2023-12-05 09:55:06.188906083 +0000 2023-12-05T09:55:06.245 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2023-12-05 09:55:06.188906083 +0000 2023-12-05T09:55:06.245 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: 2023-12-05 09:54:33.392246984 +0000 2023-12-05T09:55:06.245 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2023-12-05T09:55:06.245 DEBUG:teuthology.orchestra.run.smithi150:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2023-12-05T09:55:06.322 DEBUG:teuthology.orchestra.run.smithi100:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 2023-12-05T09:55:06.322 DEBUG:teuthology.orchestra.run.smithi150:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 2023-12-05T09:55:06.372 INFO:tasks.workunit.client.1.smithi150.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2023-12-05T09:55:06.376 INFO:tasks.workunit.client.0.smithi100.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-12-05T09:55:06.469 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi100/config 2023-12-05T09:55:07.736 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:07.737+0000 7ff654992700 1 -- 172.21.15.100:0/897158341 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6500fde00 msgr2=0x7ff6500fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:07.736 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:07.737+0000 7ff654992700 1 --2- 172.21.15.100:0/897158341 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6500fde00 0x7ff6500fe250 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff644004940 tx=0x7ff644009e30 comp rx=0 tx=0).stop 2023-12-05T09:55:07.736 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:07.737+0000 7ff654992700 1 -- 172.21.15.100:0/897158341 shutdown_connections 2023-12-05T09:55:07.736 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:07.737+0000 7ff654992700 1 --2- 172.21.15.100:0/897158341 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6500fde00 0x7ff6500fe250 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:07.736 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:07.737+0000 7ff654992700 1 --2- 172.21.15.100:0/897158341 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6500fcbf0 0x7ff6500fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:07.736 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:07.737+0000 7ff654992700 1 -- 172.21.15.100:0/897158341 >> 172.21.15.100:0/897158341 conn(0x7ff6500f82d0 msgr2=0x7ff6500fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:55:07.737 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:07.737+0000 7ff654992700 1 -- 172.21.15.100:0/897158341 shutdown_connections 2023-12-05T09:55:07.737 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:07.737+0000 7ff654992700 1 -- 172.21.15.100:0/897158341 wait complete. 2023-12-05T09:55:07.737 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:07.738+0000 7ff654992700 1 Processor -- start 2023-12-05T09:55:07.737 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:07.738+0000 7ff654992700 1 -- start start 2023-12-05T09:55:07.737 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:07.738+0000 7ff654992700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6500fcbf0 0x7ff650071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:55:07.737 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:07.738+0000 7ff654992700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6500fde00 0x7ff65006ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:55:07.737 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:07.738+0000 7ff654992700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff650070590 con 0x7ff6500fde00 2023-12-05T09:55:07.737 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:07.738+0000 7ff654992700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff650070700 con 0x7ff6500fcbf0 2023-12-05T09:55:07.737 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:07.738+0000 7ff64dd9b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6500fde00 0x7ff65006ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:55:07.737 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:07.738+0000 7ff64dd9b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6500fde00 0x7ff65006ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57654/0 (socket says 172.21.15.100:57654) 2023-12-05T09:55:07.737 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:07.738+0000 7ff64dd9b700 1 -- 172.21.15.100:0/1573658790 learned_addr learned my addr 172.21.15.100:0/1573658790 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:55:07.737 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:07.738+0000 7ff64e59c700 1 --2- 172.21.15.100:0/1573658790 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6500fcbf0 0x7ff650071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:55:07.737 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:07.739+0000 7ff64dd9b700 1 -- 172.21.15.100:0/1573658790 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6500fcbf0 msgr2=0x7ff650071b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:07.737 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:07.739+0000 7ff64dd9b700 1 --2- 172.21.15.100:0/1573658790 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6500fcbf0 0x7ff650071b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:07.738 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:07.739+0000 7ff64dd9b700 1 -- 172.21.15.100:0/1573658790 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff644005040 con 0x7ff6500fde00 2023-12-05T09:55:07.738 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:07.739+0000 7ff64dd9b700 1 --2- 172.21.15.100:0/1573658790 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6500fde00 0x7ff65006ff90 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff644009fd0 tx=0x7ff644009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:55:07.738 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:07.739+0000 7ff63effd700 1 -- 172.21.15.100:0/1573658790 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff64400e040 con 0x7ff6500fde00 2023-12-05T09:55:07.738 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:07.739+0000 7ff63effd700 1 -- 172.21.15.100:0/1573658790 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff644004290 con 0x7ff6500fde00 2023-12-05T09:55:07.738 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:07.739+0000 7ff654992700 1 -- 172.21.15.100:0/1573658790 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff650070980 con 0x7ff6500fde00 2023-12-05T09:55:07.739 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:07.739+0000 7ff63effd700 1 -- 172.21.15.100:0/1573658790 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff64401c3f0 con 0x7ff6500fde00 2023-12-05T09:55:07.739 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:07.739+0000 7ff654992700 1 -- 172.21.15.100:0/1573658790 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6501155b0 con 0x7ff6500fde00 2023-12-05T09:55:07.739 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:07.740+0000 7ff654992700 1 -- 172.21.15.100:0/1573658790 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff65004bb80 con 0x7ff6500fde00 2023-12-05T09:55:07.739 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:07.741+0000 7ff63effd700 1 -- 172.21.15.100:0/1573658790 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7ff64400bc50 con 0x7ff6500fde00 2023-12-05T09:55:07.740 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:07.742+0000 7ff63effd700 1 --2- 172.21.15.100:0/1573658790 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7ff638068f70 0x7ff63806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:55:07.740 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:07.742+0000 7ff63effd700 1 -- 172.21.15.100:0/1573658790 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7ff644088280 con 0x7ff6500fde00 2023-12-05T09:55:07.740 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:07.742+0000 7ff64e59c700 1 --2- 172.21.15.100:0/1573658790 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7ff638068f70 0x7ff63806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:55:07.740 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:07.743+0000 7ff64e59c700 1 --2- 172.21.15.100:0/1573658790 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7ff638068f70 0x7ff63806b420 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff6500718a0 tx=0x7ff640009040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:55:07.744 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:07.747+0000 7ff63effd700 1 -- 172.21.15.100:0/1573658790 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ff6440580f0 con 0x7ff6500fde00 2023-12-05T09:55:07.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:55:07 smithi150 ceph-mon[116142]: pgmap v172: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2023-12-05T09:55:07.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:55:07 smithi100 ceph-mon[107145]: pgmap v172: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2023-12-05T09:55:07.936 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:07.938+0000 7ff654992700 1 -- 172.21.15.100:0/1573658790 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7ff6501158f0 con 0x7ff6500fde00 2023-12-05T09:55:07.936 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:07.938+0000 7ff63effd700 1 -- 172.21.15.100:0/1573658790 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=-22 unrecognized config option 'mgr/orchestrator/fail_fs' v21)=-22 unrecognized config option 'mgr/orchestrator/fail_fs' v21) v1 ==== 179+0+0 (secure 0 0 0) 0x7ff644057c80 con 0x7ff6500fde00 2023-12-05T09:55:07.937 INFO:teuthology.orchestra.run.smithi100.stderr:Error EINVAL: unrecognized config option 'mgr/orchestrator/fail_fs' 2023-12-05T09:55:08.347 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2023-12-05T09:55:08.347 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi100.front.sepia.ceph.com 2023-12-05T09:55:08.347 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -e sha1=3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2023-12-05T09:55:08.776 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi100/config 2023-12-05T09:55:09.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:55:09 smithi100 ceph-mon[107145]: pgmap v173: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2023-12-05T09:55:09.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:55:09 smithi150 ceph-mon[116142]: pgmap v173: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2023-12-05T09:55:10.043 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:10.044+0000 7f36e465d700 1 -- 172.21.15.100:0/618736080 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36dc0fcbf0 msgr2=0x7f36dc0fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:10.043 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:10.044+0000 7f36e465d700 1 --2- 172.21.15.100:0/618736080 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36dc0fcbf0 0x7f36dc0fd000 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f36d8004940 tx=0x7f36d8009e30 comp rx=0 tx=0).stop 2023-12-05T09:55:10.043 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:10.045+0000 7f36e465d700 1 -- 172.21.15.100:0/618736080 shutdown_connections 2023-12-05T09:55:10.043 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:10.045+0000 7f36e465d700 1 --2- 172.21.15.100:0/618736080 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36dc0fde00 0x7f36dc0fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:10.044 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:10.045+0000 7f36e465d700 1 --2- 172.21.15.100:0/618736080 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36dc0fcbf0 0x7f36dc0fd000 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:10.044 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:10.045+0000 7f36e465d700 1 -- 172.21.15.100:0/618736080 >> 172.21.15.100:0/618736080 conn(0x7f36dc0f82d0 msgr2=0x7f36dc0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:55:10.044 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:10.045+0000 7f36e465d700 1 -- 172.21.15.100:0/618736080 shutdown_connections 2023-12-05T09:55:10.044 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:10.045+0000 7f36e465d700 1 -- 172.21.15.100:0/618736080 wait complete. 2023-12-05T09:55:10.044 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:10.045+0000 7f36e465d700 1 Processor -- start 2023-12-05T09:55:10.044 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:10.046+0000 7f36e465d700 1 -- start start 2023-12-05T09:55:10.044 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:10.046+0000 7f36e465d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36dc0fcbf0 0x7f36dc071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:55:10.044 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:10.046+0000 7f36e465d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36dc0fde00 0x7f36dc06ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:55:10.044 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:10.046+0000 7f36e465d700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36dc070620 con 0x7f36dc0fde00 2023-12-05T09:55:10.044 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:10.046+0000 7f36e465d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36dc070790 con 0x7f36dc0fcbf0 2023-12-05T09:55:10.045 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:10.046+0000 7f36e1bf8700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36dc0fde00 0x7f36dc06ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:55:10.045 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:10.046+0000 7f36e1bf8700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36dc0fde00 0x7f36dc06ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59474/0 (socket says 172.21.15.100:59474) 2023-12-05T09:55:10.045 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:10.046+0000 7f36e1bf8700 1 -- 172.21.15.100:0/3373441713 learned_addr learned my addr 172.21.15.100:0/3373441713 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:55:10.045 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:10.047+0000 7f36e1bf8700 1 -- 172.21.15.100:0/3373441713 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36dc0fcbf0 msgr2=0x7f36dc071b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:10.046 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:10.047+0000 7f36e23f9700 1 --2- 172.21.15.100:0/3373441713 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36dc0fcbf0 0x7f36dc071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:55:10.046 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:10.047+0000 7f36e1bf8700 1 --2- 172.21.15.100:0/3373441713 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36dc0fcbf0 0x7f36dc071b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:10.046 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:10.047+0000 7f36e1bf8700 1 -- 172.21.15.100:0/3373441713 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36d8005040 con 0x7f36dc0fde00 2023-12-05T09:55:10.046 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:10.047+0000 7f36e23f9700 1 --2- 172.21.15.100:0/3373441713 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36dc0fcbf0 0x7f36dc071b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-05T09:55:10.046 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:10.047+0000 7f36e1bf8700 1 --2- 172.21.15.100:0/3373441713 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36dc0fde00 0x7f36dc06ff90 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f36cc00b790 tx=0x7f36cc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:55:10.046 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:10.047+0000 7f36d2ffd700 1 -- 172.21.15.100:0/3373441713 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36cc00f770 con 0x7f36dc0fde00 2023-12-05T09:55:10.046 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:10.047+0000 7f36d2ffd700 1 -- 172.21.15.100:0/3373441713 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f36cc00fd80 con 0x7f36dc0fde00 2023-12-05T09:55:10.046 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:10.047+0000 7f36d2ffd700 1 -- 172.21.15.100:0/3373441713 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36cc00d310 con 0x7f36dc0fde00 2023-12-05T09:55:10.046 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:10.047+0000 7f36e465d700 1 -- 172.21.15.100:0/3373441713 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36dc070a70 con 0x7f36dc0fde00 2023-12-05T09:55:10.046 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:10.047+0000 7f36e465d700 1 -- 172.21.15.100:0/3373441713 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36dc1155d0 con 0x7f36dc0fde00 2023-12-05T09:55:10.047 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:10.048+0000 7f36e465d700 1 -- 172.21.15.100:0/3373441713 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36dc04bb80 con 0x7f36dc0fde00 2023-12-05T09:55:10.047 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:10.049+0000 7f36d2ffd700 1 -- 172.21.15.100:0/3373441713 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f36cc010420 con 0x7f36dc0fde00 2023-12-05T09:55:10.047 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:10.050+0000 7f36d2ffd700 1 --2- 172.21.15.100:0/3373441713 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f36c8068f70 0x7f36c806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:55:10.047 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:10.050+0000 7f36d2ffd700 1 -- 172.21.15.100:0/3373441713 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f36cc086e30 con 0x7f36dc0fde00 2023-12-05T09:55:10.048 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:10.050+0000 7f36e23f9700 1 --2- 172.21.15.100:0/3373441713 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f36c8068f70 0x7f36c806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:55:10.048 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:10.051+0000 7f36e23f9700 1 --2- 172.21.15.100:0/3373441713 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f36c8068f70 0x7f36c806b420 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f36d800b3b0 tx=0x7f36d8009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:55:10.052 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:10.054+0000 7f36d2ffd700 1 -- 172.21.15.100:0/3373441713 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f36cc056ca0 con 0x7f36dc0fde00 2023-12-05T09:55:10.244 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:10.247+0000 7f36e465d700 1 -- 172.21.15.100:0/3373441713 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f36dc115ac0 con 0x7f36dc0fde00 2023-12-05T09:55:10.245 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:10.247+0000 7f36d2ffd700 1 -- 172.21.15.100:0/3373441713 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v21)=0 v21) v1 ==== 155+0+0 (secure 0 0 0) 0x7f36cc05ae60 con 0x7f36dc0fde00 2023-12-05T09:55:10.247 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:10.249+0000 7f36e465d700 1 -- 172.21.15.100:0/3373441713 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f36c8068f70 msgr2=0x7f36c806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:10.247 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:10.249+0000 7f36e465d700 1 --2- 172.21.15.100:0/3373441713 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f36c8068f70 0x7f36c806b420 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f36d800b3b0 tx=0x7f36d8009e30 comp rx=0 tx=0).stop 2023-12-05T09:55:10.247 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:10.249+0000 7f36e465d700 1 -- 172.21.15.100:0/3373441713 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36dc0fde00 msgr2=0x7f36dc06ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:10.247 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:10.249+0000 7f36e465d700 1 --2- 172.21.15.100:0/3373441713 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36dc0fde00 0x7f36dc06ff90 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f36cc00b790 tx=0x7f36cc009250 comp rx=0 tx=0).stop 2023-12-05T09:55:10.247 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:10.249+0000 7f36e465d700 1 -- 172.21.15.100:0/3373441713 shutdown_connections 2023-12-05T09:55:10.247 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:10.249+0000 7f36e465d700 1 --2- 172.21.15.100:0/3373441713 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f36c8068f70 0x7f36c806b420 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:10.247 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:10.249+0000 7f36e465d700 1 --2- 172.21.15.100:0/3373441713 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36dc0fcbf0 0x7f36dc071b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:10.248 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:10.249+0000 7f36e465d700 1 --2- 172.21.15.100:0/3373441713 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36dc0fde00 0x7f36dc06ff90 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:10.248 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:10.249+0000 7f36e465d700 1 -- 172.21.15.100:0/3373441713 >> 172.21.15.100:0/3373441713 conn(0x7f36dc0f82d0 msgr2=0x7f36dc101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:55:10.248 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:10.250+0000 7f36e465d700 1 -- 172.21.15.100:0/3373441713 shutdown_connections 2023-12-05T09:55:10.248 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:10.250+0000 7f36e465d700 1 -- 172.21.15.100:0/3373441713 wait complete. 2023-12-05T09:55:10.706 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -e sha1=3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2023-12-05T09:55:11.132 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi100/config 2023-12-05T09:55:11.606 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:55:11 smithi100 ceph-mon[107145]: pgmap v174: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2023-12-05T09:55:11.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:55:11 smithi150 ceph-mon[116142]: pgmap v174: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2023-12-05T09:55:12.251 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:12.253+0000 7f24107eb700 1 -- 172.21.15.100:0/3579381150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2408071b40 msgr2=0x7f240806ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:12.251 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:12.253+0000 7f24107eb700 1 --2- 172.21.15.100:0/3579381150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2408071b40 0x7f240806ffb0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f2404004940 tx=0x7f2404009e30 comp rx=0 tx=0).stop 2023-12-05T09:55:12.251 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:12.253+0000 7f24107eb700 1 -- 172.21.15.100:0/3579381150 shutdown_connections 2023-12-05T09:55:12.251 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:12.253+0000 7f24107eb700 1 --2- 172.21.15.100:0/3579381150 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24080704f0 0x7f2408070960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:12.251 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:12.253+0000 7f24107eb700 1 --2- 172.21.15.100:0/3579381150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2408071b40 0x7f240806ffb0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:12.251 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:12.253+0000 7f24107eb700 1 -- 172.21.15.100:0/3579381150 >> 172.21.15.100:0/3579381150 conn(0x7f24080f82d0 msgr2=0x7f24080fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:55:12.251 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:12.253+0000 7f24107eb700 1 -- 172.21.15.100:0/3579381150 shutdown_connections 2023-12-05T09:55:12.251 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:12.253+0000 7f24107eb700 1 -- 172.21.15.100:0/3579381150 wait complete. 2023-12-05T09:55:12.253 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:12.254+0000 7f24107eb700 1 Processor -- start 2023-12-05T09:55:12.253 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:12.254+0000 7f24107eb700 1 -- start start 2023-12-05T09:55:12.253 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:12.255+0000 7f24107eb700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24080704f0 0x7f240810f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:55:12.253 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:12.255+0000 7f24107eb700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2408071b40 0x7f240810fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:55:12.253 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:12.255+0000 7f24107eb700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2408110340 con 0x7f24080704f0 2023-12-05T09:55:12.253 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:12.255+0000 7f24107eb700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2408110be0 con 0x7f2408071b40 2023-12-05T09:55:12.253 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:12.255+0000 7f240e587700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24080704f0 0x7f240810f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:55:12.253 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:12.255+0000 7f240e587700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24080704f0 0x7f240810f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59500/0 (socket says 172.21.15.100:59500) 2023-12-05T09:55:12.253 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:12.255+0000 7f240e587700 1 -- 172.21.15.100:0/3421731539 learned_addr learned my addr 172.21.15.100:0/3421731539 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:55:12.253 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:12.255+0000 7f240dd86700 1 --2- 172.21.15.100:0/3421731539 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2408071b40 0x7f240810fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:55:12.253 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:12.255+0000 7f240e587700 1 -- 172.21.15.100:0/3421731539 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2408071b40 msgr2=0x7f240810fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:12.254 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:12.255+0000 7f240e587700 1 --2- 172.21.15.100:0/3421731539 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2408071b40 0x7f240810fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:12.254 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:12.255+0000 7f240e587700 1 -- 172.21.15.100:0/3421731539 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2404005040 con 0x7f24080704f0 2023-12-05T09:55:12.254 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:12.255+0000 7f240dd86700 1 --2- 172.21.15.100:0/3421731539 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2408071b40 0x7f240810fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-05T09:55:12.254 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:12.255+0000 7f240e587700 1 --2- 172.21.15.100:0/3421731539 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24080704f0 0x7f240810f800 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f2404009fd0 tx=0x7f2404009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:55:12.254 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:12.256+0000 7f23feffd700 1 -- 172.21.15.100:0/3421731539 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f240400e040 con 0x7f24080704f0 2023-12-05T09:55:12.254 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:12.256+0000 7f23feffd700 1 -- 172.21.15.100:0/3421731539 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2404004290 con 0x7f24080704f0 2023-12-05T09:55:12.255 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:12.256+0000 7f23feffd700 1 -- 172.21.15.100:0/3421731539 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f240401c3f0 con 0x7f24080704f0 2023-12-05T09:55:12.255 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:12.256+0000 7f24107eb700 1 -- 172.21.15.100:0/3421731539 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2408110e60 con 0x7f24080704f0 2023-12-05T09:55:12.255 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:12.256+0000 7f24107eb700 1 -- 172.21.15.100:0/3421731539 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24081113a0 con 0x7f24080704f0 2023-12-05T09:55:12.255 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:12.257+0000 7f24107eb700 1 -- 172.21.15.100:0/3421731539 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24081096e0 con 0x7f24080704f0 2023-12-05T09:55:12.255 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:12.258+0000 7f23feffd700 1 -- 172.21.15.100:0/3421731539 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f2404013420 con 0x7f24080704f0 2023-12-05T09:55:12.256 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:12.259+0000 7f23feffd700 1 --2- 172.21.15.100:0/3421731539 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f23f4068f70 0x7f23f406b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:55:12.256 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:12.259+0000 7f23feffd700 1 -- 172.21.15.100:0/3421731539 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f2404088250 con 0x7f24080704f0 2023-12-05T09:55:12.256 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:12.259+0000 7f240dd86700 1 --2- 172.21.15.100:0/3421731539 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f23f4068f70 0x7f23f406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:55:12.257 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:12.260+0000 7f240dd86700 1 --2- 172.21.15.100:0/3421731539 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f23f4068f70 0x7f23f406b420 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f23f8009fd0 tx=0x7f23f8009ee0 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:55:12.260 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:12.263+0000 7f23feffd700 1 -- 172.21.15.100:0/3421731539 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f24040580c0 con 0x7f24080704f0 2023-12-05T09:55:12.456 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:12.459+0000 7f24107eb700 1 -- 172.21.15.100:0/3421731539 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7f240804bb80 con 0x7f24080704f0 2023-12-05T09:55:12.457 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:12.459+0000 7f23feffd700 1 -- 172.21.15.100:0/3421731539 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v21)=0 v21) v1 ==== 163+0+0 (secure 0 0 0) 0x7f2404057c50 con 0x7f24080704f0 2023-12-05T09:55:12.459 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:12.461+0000 7f24107eb700 1 -- 172.21.15.100:0/3421731539 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f23f4068f70 msgr2=0x7f23f406b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:12.459 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:12.461+0000 7f24107eb700 1 --2- 172.21.15.100:0/3421731539 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f23f4068f70 0x7f23f406b420 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f23f8009fd0 tx=0x7f23f8009ee0 comp rx=0 tx=0).stop 2023-12-05T09:55:12.459 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:12.461+0000 7f24107eb700 1 -- 172.21.15.100:0/3421731539 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24080704f0 msgr2=0x7f240810f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:12.459 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:12.461+0000 7f24107eb700 1 --2- 172.21.15.100:0/3421731539 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24080704f0 0x7f240810f800 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f2404009fd0 tx=0x7f2404009e30 comp rx=0 tx=0).stop 2023-12-05T09:55:12.459 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:12.462+0000 7f24107eb700 1 -- 172.21.15.100:0/3421731539 shutdown_connections 2023-12-05T09:55:12.459 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:12.462+0000 7f24107eb700 1 --2- 172.21.15.100:0/3421731539 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f23f4068f70 0x7f23f406b420 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:12.460 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:12.462+0000 7f24107eb700 1 --2- 172.21.15.100:0/3421731539 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24080704f0 0x7f240810f800 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:12.460 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:12.462+0000 7f24107eb700 1 --2- 172.21.15.100:0/3421731539 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2408071b40 0x7f240810fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:12.460 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:12.462+0000 7f24107eb700 1 -- 172.21.15.100:0/3421731539 >> 172.21.15.100:0/3421731539 conn(0x7f24080f82d0 msgr2=0x7f2408103390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:55:12.460 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:12.462+0000 7f24107eb700 1 -- 172.21.15.100:0/3421731539 shutdown_connections 2023-12-05T09:55:12.460 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:12.462+0000 7f24107eb700 1 -- 172.21.15.100:0/3421731539 wait complete. 2023-12-05T09:55:12.872 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -e sha1=3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 -- bash -c 'ceph config set global log_to_journald false --force' 2023-12-05T09:55:13.296 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi100/config 2023-12-05T09:55:13.597 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:55:13 smithi150 ceph-mon[116142]: pgmap v175: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2023-12-05T09:55:13.839 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:55:13 smithi100 ceph-mon[107145]: pgmap v175: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2023-12-05T09:55:14.559 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:14.561+0000 7f209278d700 1 -- 172.21.15.100:0/3505456032 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f208c0fde00 msgr2=0x7f208c0fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:14.559 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:14.561+0000 7f209278d700 1 --2- 172.21.15.100:0/3505456032 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f208c0fde00 0x7f208c0fe250 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2080004940 tx=0x7f2080009e30 comp rx=0 tx=0).stop 2023-12-05T09:55:14.559 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:14.561+0000 7f209278d700 1 -- 172.21.15.100:0/3505456032 shutdown_connections 2023-12-05T09:55:14.559 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:14.561+0000 7f209278d700 1 --2- 172.21.15.100:0/3505456032 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f208c0fde00 0x7f208c0fe250 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:14.560 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:14.561+0000 7f209278d700 1 --2- 172.21.15.100:0/3505456032 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f208c0fcbf0 0x7f208c0fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:14.560 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:14.561+0000 7f209278d700 1 -- 172.21.15.100:0/3505456032 >> 172.21.15.100:0/3505456032 conn(0x7f208c0f82d0 msgr2=0x7f208c0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:55:14.560 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:14.561+0000 7f209278d700 1 -- 172.21.15.100:0/3505456032 shutdown_connections 2023-12-05T09:55:14.560 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:14.561+0000 7f209278d700 1 -- 172.21.15.100:0/3505456032 wait complete. 2023-12-05T09:55:14.561 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:14.562+0000 7f209278d700 1 Processor -- start 2023-12-05T09:55:14.561 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:14.562+0000 7f209278d700 1 -- start start 2023-12-05T09:55:14.561 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:14.563+0000 7f209278d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f208c0fcbf0 0x7f208c071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:55:14.562 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:14.563+0000 7f209278d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f208c0fde00 0x7f208c06ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:55:14.562 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:14.563+0000 7f209278d700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f208c070590 con 0x7f208c0fcbf0 2023-12-05T09:55:14.562 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:14.563+0000 7f209278d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f208c070700 con 0x7f208c0fde00 2023-12-05T09:55:14.562 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:14.563+0000 7f208bfff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f208c0fcbf0 0x7f208c071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:55:14.562 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:14.563+0000 7f208bfff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f208c0fcbf0 0x7f208c071b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59528/0 (socket says 172.21.15.100:59528) 2023-12-05T09:55:14.562 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:14.563+0000 7f208bfff700 1 -- 172.21.15.100:0/2599841313 learned_addr learned my addr 172.21.15.100:0/2599841313 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:55:14.562 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:14.563+0000 7f208b7fe700 1 --2- 172.21.15.100:0/2599841313 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f208c0fde00 0x7f208c06ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:55:14.562 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:14.563+0000 7f208bfff700 1 -- 172.21.15.100:0/2599841313 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f208c0fde00 msgr2=0x7f208c06ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:14.562 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:14.563+0000 7f208bfff700 1 --2- 172.21.15.100:0/2599841313 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f208c0fde00 0x7f208c06ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:14.562 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:14.563+0000 7f208bfff700 1 -- 172.21.15.100:0/2599841313 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2080005040 con 0x7f208c0fcbf0 2023-12-05T09:55:14.562 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:14.563+0000 7f208b7fe700 1 --2- 172.21.15.100:0/2599841313 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f208c0fde00 0x7f208c06ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-05T09:55:14.562 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:14.564+0000 7f208bfff700 1 --2- 172.21.15.100:0/2599841313 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f208c0fcbf0 0x7f208c071b10 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f207c002a80 tx=0x7f207c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:55:14.562 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:14.564+0000 7f2088ff9700 1 -- 172.21.15.100:0/2599841313 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f207c007cc0 con 0x7f208c0fcbf0 2023-12-05T09:55:14.563 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:14.564+0000 7f2088ff9700 1 -- 172.21.15.100:0/2599841313 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f207c00f040 con 0x7f208c0fcbf0 2023-12-05T09:55:14.563 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:14.564+0000 7f209278d700 1 -- 172.21.15.100:0/2599841313 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f208c0709e0 con 0x7f208c0fcbf0 2023-12-05T09:55:14.563 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:14.564+0000 7f2088ff9700 1 -- 172.21.15.100:0/2599841313 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f207c00da20 con 0x7f208c0fcbf0 2023-12-05T09:55:14.563 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:14.564+0000 7f209278d700 1 -- 172.21.15.100:0/2599841313 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f208c1155b0 con 0x7f208c0fcbf0 2023-12-05T09:55:14.563 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:14.565+0000 7f209278d700 1 -- 172.21.15.100:0/2599841313 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f208c04bb80 con 0x7f208c0fcbf0 2023-12-05T09:55:14.563 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:14.566+0000 7f2088ff9700 1 -- 172.21.15.100:0/2599841313 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f207c00db80 con 0x7f208c0fcbf0 2023-12-05T09:55:14.564 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:14.567+0000 7f2088ff9700 1 --2- 172.21.15.100:0/2599841313 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f2074068f60 0x7f207406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:55:14.564 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:14.567+0000 7f2088ff9700 1 -- 172.21.15.100:0/2599841313 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f207c086c80 con 0x7f208c0fcbf0 2023-12-05T09:55:14.565 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:14.567+0000 7f208b7fe700 1 --2- 172.21.15.100:0/2599841313 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f2074068f60 0x7f207406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:55:14.565 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:14.568+0000 7f208b7fe700 1 --2- 172.21.15.100:0/2599841313 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f2074068f60 0x7f207406b410 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2080000c00 tx=0x7f2080009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:55:14.569 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:14.571+0000 7f2088ff9700 1 -- 172.21.15.100:0/2599841313 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f207c056a70 con 0x7f208c0fcbf0 2023-12-05T09:55:14.763 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:14.765+0000 7f209278d700 1 -- 172.21.15.100:0/2599841313 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f208c105590 con 0x7f208c0fcbf0 2023-12-05T09:55:14.763 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:14.766+0000 7f2088ff9700 1 -- 172.21.15.100:0/2599841313 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v21)=0 v21) v1 ==== 135+0+0 (secure 0 0 0) 0x7f207c056600 con 0x7f208c0fcbf0 2023-12-05T09:55:14.766 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:14.768+0000 7f209278d700 1 -- 172.21.15.100:0/2599841313 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f2074068f60 msgr2=0x7f207406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:14.766 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:14.768+0000 7f209278d700 1 --2- 172.21.15.100:0/2599841313 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f2074068f60 0x7f207406b410 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2080000c00 tx=0x7f2080009e30 comp rx=0 tx=0).stop 2023-12-05T09:55:14.766 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:14.768+0000 7f209278d700 1 -- 172.21.15.100:0/2599841313 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f208c0fcbf0 msgr2=0x7f208c071b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:14.766 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:14.768+0000 7f209278d700 1 --2- 172.21.15.100:0/2599841313 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f208c0fcbf0 0x7f208c071b10 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f207c002a80 tx=0x7f207c004600 comp rx=0 tx=0).stop 2023-12-05T09:55:14.766 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:14.768+0000 7f209278d700 1 -- 172.21.15.100:0/2599841313 shutdown_connections 2023-12-05T09:55:14.766 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:14.768+0000 7f209278d700 1 --2- 172.21.15.100:0/2599841313 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f2074068f60 0x7f207406b410 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:14.766 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:14.768+0000 7f209278d700 1 --2- 172.21.15.100:0/2599841313 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f208c0fcbf0 0x7f208c071b10 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:14.766 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:14.768+0000 7f209278d700 1 --2- 172.21.15.100:0/2599841313 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f208c0fde00 0x7f208c06ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:14.766 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:14.768+0000 7f209278d700 1 -- 172.21.15.100:0/2599841313 >> 172.21.15.100:0/2599841313 conn(0x7f208c0f82d0 msgr2=0x7f208c101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:55:14.766 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:14.768+0000 7f209278d700 1 -- 172.21.15.100:0/2599841313 shutdown_connections 2023-12-05T09:55:14.766 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:14.768+0000 7f209278d700 1 -- 172.21.15.100:0/2599841313 wait complete. 2023-12-05T09:55:15.159 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -e sha1=3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2023-12-05T09:55:15.587 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi100/config 2023-12-05T09:55:15.700 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:55:15 smithi150 ceph-mon[116142]: pgmap v176: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2023-12-05T09:55:15.700 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:55:15 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:55:15.757 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:55:15 smithi100 ceph-mon[107145]: pgmap v176: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2023-12-05T09:55:15.757 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:55:15 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:55:16.790 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:16.792+0000 7fc159810700 1 -- 172.21.15.100:0/2110671695 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1540fcbf0 msgr2=0x7fc1540fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:16.791 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:16.792+0000 7fc159810700 1 --2- 172.21.15.100:0/2110671695 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1540fcbf0 0x7fc1540fd000 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc144004940 tx=0x7fc144009e30 comp rx=0 tx=0).stop 2023-12-05T09:55:16.791 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:16.792+0000 7fc159810700 1 -- 172.21.15.100:0/2110671695 shutdown_connections 2023-12-05T09:55:16.791 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:16.792+0000 7fc159810700 1 --2- 172.21.15.100:0/2110671695 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc1540fde00 0x7fc1540fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:16.791 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:16.792+0000 7fc159810700 1 --2- 172.21.15.100:0/2110671695 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1540fcbf0 0x7fc1540fd000 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:16.791 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:16.792+0000 7fc159810700 1 -- 172.21.15.100:0/2110671695 >> 172.21.15.100:0/2110671695 conn(0x7fc1540f82d0 msgr2=0x7fc1540fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:55:16.791 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:16.792+0000 7fc159810700 1 -- 172.21.15.100:0/2110671695 shutdown_connections 2023-12-05T09:55:16.791 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:16.793+0000 7fc159810700 1 -- 172.21.15.100:0/2110671695 wait complete. 2023-12-05T09:55:16.791 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:16.793+0000 7fc159810700 1 Processor -- start 2023-12-05T09:55:16.792 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:16.793+0000 7fc159810700 1 -- start start 2023-12-05T09:55:16.792 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:16.794+0000 7fc159810700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc1540fcbf0 0x7fc15410f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:55:16.792 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:16.794+0000 7fc159810700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1540fde00 0x7fc15410fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:55:16.793 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:16.794+0000 7fc159810700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc154110200 con 0x7fc1540fde00 2023-12-05T09:55:16.793 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:16.794+0000 7fc159810700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc154110aa0 con 0x7fc1540fcbf0 2023-12-05T09:55:16.793 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:16.794+0000 7fc1527fc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1540fde00 0x7fc15410fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:55:16.793 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:16.794+0000 7fc1527fc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1540fde00 0x7fc15410fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59552/0 (socket says 172.21.15.100:59552) 2023-12-05T09:55:16.793 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:16.794+0000 7fc1527fc700 1 -- 172.21.15.100:0/1223931235 learned_addr learned my addr 172.21.15.100:0/1223931235 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:55:16.793 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:16.794+0000 7fc152ffd700 1 --2- 172.21.15.100:0/1223931235 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc1540fcbf0 0x7fc15410f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:55:16.793 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:16.794+0000 7fc1527fc700 1 -- 172.21.15.100:0/1223931235 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc1540fcbf0 msgr2=0x7fc15410f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:16.793 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:16.794+0000 7fc1527fc700 1 --2- 172.21.15.100:0/1223931235 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc1540fcbf0 0x7fc15410f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:16.793 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:16.794+0000 7fc1527fc700 1 -- 172.21.15.100:0/1223931235 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc144005040 con 0x7fc1540fde00 2023-12-05T09:55:16.793 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:16.795+0000 7fc1527fc700 1 --2- 172.21.15.100:0/1223931235 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1540fde00 0x7fc15410fc00 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc14800eb40 tx=0x7fc14800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:55:16.793 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:16.795+0000 7fc13b7fe700 1 -- 172.21.15.100:0/1223931235 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc148007cc0 con 0x7fc1540fde00 2023-12-05T09:55:16.793 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:16.795+0000 7fc13b7fe700 1 -- 172.21.15.100:0/1223931235 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc14800f040 con 0x7fc1540fde00 2023-12-05T09:55:16.793 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:16.795+0000 7fc159810700 1 -- 172.21.15.100:0/1223931235 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc154110d20 con 0x7fc1540fde00 2023-12-05T09:55:16.793 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:16.795+0000 7fc13b7fe700 1 -- 172.21.15.100:0/1223931235 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc148009570 con 0x7fc1540fde00 2023-12-05T09:55:16.793 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:16.795+0000 7fc159810700 1 -- 172.21.15.100:0/1223931235 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc154111260 con 0x7fc1540fde00 2023-12-05T09:55:16.794 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:16.796+0000 7fc159810700 1 -- 172.21.15.100:0/1223931235 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc154101ea0 con 0x7fc1540fde00 2023-12-05T09:55:16.794 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:16.797+0000 7fc13b7fe700 1 -- 172.21.15.100:0/1223931235 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7fc1480096d0 con 0x7fc1540fde00 2023-12-05T09:55:16.795 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:16.798+0000 7fc13b7fe700 1 --2- 172.21.15.100:0/1223931235 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fc13c068f70 0x7fc13c06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:55:16.795 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:16.798+0000 7fc13b7fe700 1 -- 172.21.15.100:0/1223931235 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fc148086a70 con 0x7fc1540fde00 2023-12-05T09:55:16.795 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:16.798+0000 7fc152ffd700 1 --2- 172.21.15.100:0/1223931235 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fc13c068f70 0x7fc13c06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:55:16.796 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:16.799+0000 7fc152ffd700 1 --2- 172.21.15.100:0/1223931235 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fc13c068f70 0x7fc13c06b420 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc144013600 tx=0x7fc144009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:55:16.799 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:16.802+0000 7fc13b7fe700 1 -- 172.21.15.100:0/1223931235 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fc14804da00 con 0x7fc1540fde00 2023-12-05T09:55:17.008 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:17.011+0000 7fc159810700 1 -- 172.21.15.100:0/1223931235 --> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:3fe8d441c2f973bfe963ba4dd30ba8eac9f36227", "target": ["mon-mgr", ""]}) v1 -- 0x7fc154111570 con 0x7fc13c068f70 2023-12-05T09:55:17.014 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:17.017+0000 7fc13b7fe700 1 -- 172.21.15.100:0/1223931235 <== mgr.14210 v2:172.21.15.100:6800/1237547575 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7fc154111570 con 0x7fc13c068f70 2023-12-05T09:55:17.014 INFO:teuthology.orchestra.run.smithi100.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 2023-12-05T09:55:17.017 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:17.019+0000 7fc159810700 1 -- 172.21.15.100:0/1223931235 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fc13c068f70 msgr2=0x7fc13c06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:17.017 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:17.019+0000 7fc159810700 1 --2- 172.21.15.100:0/1223931235 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fc13c068f70 0x7fc13c06b420 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc144013600 tx=0x7fc144009e30 comp rx=0 tx=0).stop 2023-12-05T09:55:17.017 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:17.019+0000 7fc159810700 1 -- 172.21.15.100:0/1223931235 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1540fde00 msgr2=0x7fc15410fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:17.017 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:17.019+0000 7fc159810700 1 --2- 172.21.15.100:0/1223931235 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1540fde00 0x7fc15410fc00 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc14800eb40 tx=0x7fc14800b040 comp rx=0 tx=0).stop 2023-12-05T09:55:17.017 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:17.019+0000 7fc159810700 1 -- 172.21.15.100:0/1223931235 shutdown_connections 2023-12-05T09:55:17.017 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:17.019+0000 7fc159810700 1 --2- 172.21.15.100:0/1223931235 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fc13c068f70 0x7fc13c06b420 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:17.017 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:17.019+0000 7fc159810700 1 --2- 172.21.15.100:0/1223931235 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc1540fcbf0 0x7fc15410f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:17.017 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:17.019+0000 7fc159810700 1 --2- 172.21.15.100:0/1223931235 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1540fde00 0x7fc15410fc00 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:17.017 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:17.019+0000 7fc159810700 1 -- 172.21.15.100:0/1223931235 >> 172.21.15.100:0/1223931235 conn(0x7fc1540f82d0 msgr2=0x7fc1540ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:55:17.017 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:17.019+0000 7fc159810700 1 -- 172.21.15.100:0/1223931235 shutdown_connections 2023-12-05T09:55:17.017 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:17.019+0000 7fc159810700 1 -- 172.21.15.100:0/1223931235 wait complete. 2023-12-05T09:55:17.412 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2023-12-05T09:55:17.412 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi100.front.sepia.ceph.com 2023-12-05T09:55:17.413 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -e sha1=3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2023-12-05T09:55:17.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:55:17 smithi100 ceph-mon[107145]: pgmap v177: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2023-12-05T09:55:17.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:55:17 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:55:17.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:55:17 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:55:17.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:55:17 smithi150 ceph-mon[116142]: pgmap v177: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2023-12-05T09:55:17.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:55:17 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:55:17.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:55:17 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:55:17.863 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi100/config 2023-12-05T09:55:18.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:55:18 smithi100 ceph-mon[107145]: from='client.14566 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:3fe8d441c2f973bfe963ba4dd30ba8eac9f36227", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:55:18.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:55:18 smithi100 ceph-mon[107145]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 2023-12-05T09:55:18.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:55:18 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:55:18.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:55:18 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:55:18.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:55:18 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:55:18.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:55:18 smithi150 ceph-mon[116142]: from='client.14566 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:3fe8d441c2f973bfe963ba4dd30ba8eac9f36227", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:55:18.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:55:18 smithi150 ceph-mon[116142]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 2023-12-05T09:55:18.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:55:18 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:55:18.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:55:18 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:55:18.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:55:18 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:55:19.162 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.164+0000 7fb67b59e700 1 -- 172.21.15.100:0/2926420329 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb67c0fdc10 msgr2=0x7fb67c0fe060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:19.162 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.164+0000 7fb67b59e700 1 --2- 172.21.15.100:0/2926420329 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb67c0fdc10 0x7fb67c0fe060 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb670004940 tx=0x7fb670009e30 comp rx=0 tx=0).stop 2023-12-05T09:55:19.162 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.164+0000 7fb67b59e700 1 -- 172.21.15.100:0/2926420329 shutdown_connections 2023-12-05T09:55:19.162 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.164+0000 7fb67b59e700 1 --2- 172.21.15.100:0/2926420329 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb67c0fdc10 0x7fb67c0fe060 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:19.162 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.164+0000 7fb67b59e700 1 --2- 172.21.15.100:0/2926420329 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb67c0fca00 0x7fb67c0fce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:19.163 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.164+0000 7fb67b59e700 1 -- 172.21.15.100:0/2926420329 >> 172.21.15.100:0/2926420329 conn(0x7fb67c0f80e0 msgr2=0x7fb67c0fa4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:55:19.163 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.164+0000 7fb67b59e700 1 -- 172.21.15.100:0/2926420329 shutdown_connections 2023-12-05T09:55:19.163 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.164+0000 7fb67b59e700 1 -- 172.21.15.100:0/2926420329 wait complete. 2023-12-05T09:55:19.163 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.165+0000 7fb67b59e700 1 Processor -- start 2023-12-05T09:55:19.164 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.165+0000 7fb67b59e700 1 -- start start 2023-12-05T09:55:19.164 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.165+0000 7fb67b59e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb67c0fca00 0x7fb67c071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:55:19.164 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.165+0000 7fb67b59e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb67c0fdc10 0x7fb67c06ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:55:19.164 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.165+0000 7fb67b59e700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb67c110fe0 con 0x7fb67c0fdc10 2023-12-05T09:55:19.164 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.165+0000 7fb67b59e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb67c111150 con 0x7fb67c0fca00 2023-12-05T09:55:19.164 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.166+0000 7fb679d9b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb67c0fdc10 0x7fb67c06ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:55:19.164 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.166+0000 7fb679d9b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb67c0fdc10 0x7fb67c06ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59572/0 (socket says 172.21.15.100:59572) 2023-12-05T09:55:19.164 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.166+0000 7fb679d9b700 1 -- 172.21.15.100:0/2658714264 learned_addr learned my addr 172.21.15.100:0/2658714264 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:55:19.164 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.166+0000 7fb67a59c700 1 --2- 172.21.15.100:0/2658714264 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb67c0fca00 0x7fb67c071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:55:19.164 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.166+0000 7fb679d9b700 1 -- 172.21.15.100:0/2658714264 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb67c0fca00 msgr2=0x7fb67c071b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:19.164 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.166+0000 7fb679d9b700 1 --2- 172.21.15.100:0/2658714264 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb67c0fca00 0x7fb67c071b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:19.164 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.166+0000 7fb679d9b700 1 -- 172.21.15.100:0/2658714264 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb670005040 con 0x7fb67c0fdc10 2023-12-05T09:55:19.164 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.166+0000 7fb679d9b700 1 --2- 172.21.15.100:0/2658714264 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb67c0fdc10 0x7fb67c06ff90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb670009fd0 tx=0x7fb670009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:55:19.165 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.167+0000 7fb66affd700 1 -- 172.21.15.100:0/2658714264 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb67000e040 con 0x7fb67c0fdc10 2023-12-05T09:55:19.165 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.167+0000 7fb66affd700 1 -- 172.21.15.100:0/2658714264 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb670004290 con 0x7fb67c0fdc10 2023-12-05T09:55:19.165 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.167+0000 7fb66affd700 1 -- 172.21.15.100:0/2658714264 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb67001c3f0 con 0x7fb67c0fdc10 2023-12-05T09:55:19.165 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.167+0000 7fb67b59e700 1 -- 172.21.15.100:0/2658714264 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb67c070590 con 0x7fb67c0fdc10 2023-12-05T09:55:19.165 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.167+0000 7fb67b59e700 1 -- 172.21.15.100:0/2658714264 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb67c070b50 con 0x7fb67c0fdc10 2023-12-05T09:55:19.166 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.169+0000 7fb67b59e700 1 -- 172.21.15.100:0/2658714264 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb67c04bb80 con 0x7fb67c0fdc10 2023-12-05T09:55:19.166 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.169+0000 7fb66affd700 1 -- 172.21.15.100:0/2658714264 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7fb67000bc50 con 0x7fb67c0fdc10 2023-12-05T09:55:19.168 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.170+0000 7fb66affd700 1 --2- 172.21.15.100:0/2658714264 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fb664068f70 0x7fb66406b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:55:19.168 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.170+0000 7fb66affd700 1 -- 172.21.15.100:0/2658714264 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fb6700880f0 con 0x7fb67c0fdc10 2023-12-05T09:55:19.168 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.171+0000 7fb67a59c700 1 --2- 172.21.15.100:0/2658714264 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fb664068f70 0x7fb66406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:55:19.168 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.171+0000 7fb67a59c700 1 --2- 172.21.15.100:0/2658714264 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fb664068f70 0x7fb66406b420 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb67c0718a0 tx=0x7fb66c00b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:55:19.172 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.175+0000 7fb66affd700 1 -- 172.21.15.100:0/2658714264 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fb6700580a0 con 0x7fb67c0fdc10 2023-12-05T09:55:19.446 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.449+0000 7fb67b59e700 1 -- 172.21.15.100:0/2658714264 --> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb67c102560 con 0x7fb664068f70 2023-12-05T09:55:19.447 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.450+0000 7fb66affd700 1 -- 172.21.15.100:0/2658714264 <== mgr.14210 v2:172.21.15.100:6800/1237547575 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7fb67c102560 con 0x7fb664068f70 2023-12-05T09:55:19.450 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.452+0000 7fb67b59e700 1 -- 172.21.15.100:0/2658714264 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fb664068f70 msgr2=0x7fb66406b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:19.450 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.452+0000 7fb67b59e700 1 --2- 172.21.15.100:0/2658714264 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fb664068f70 0x7fb66406b420 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb67c0718a0 tx=0x7fb66c00b040 comp rx=0 tx=0).stop 2023-12-05T09:55:19.450 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.452+0000 7fb67b59e700 1 -- 172.21.15.100:0/2658714264 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb67c0fdc10 msgr2=0x7fb67c06ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:19.450 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.452+0000 7fb67b59e700 1 --2- 172.21.15.100:0/2658714264 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb67c0fdc10 0x7fb67c06ff90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb670009fd0 tx=0x7fb670009e30 comp rx=0 tx=0).stop 2023-12-05T09:55:19.451 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.453+0000 7fb67b59e700 1 -- 172.21.15.100:0/2658714264 shutdown_connections 2023-12-05T09:55:19.451 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.453+0000 7fb67b59e700 1 --2- 172.21.15.100:0/2658714264 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fb664068f70 0x7fb66406b420 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:19.451 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.453+0000 7fb67b59e700 1 --2- 172.21.15.100:0/2658714264 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb67c0fca00 0x7fb67c071b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:19.451 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.453+0000 7fb67b59e700 1 --2- 172.21.15.100:0/2658714264 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb67c0fdc10 0x7fb67c06ff90 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:19.451 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.453+0000 7fb67b59e700 1 -- 172.21.15.100:0/2658714264 >> 172.21.15.100:0/2658714264 conn(0x7fb67c0f80e0 msgr2=0x7fb67c100e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:55:19.451 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.453+0000 7fb67b59e700 1 -- 172.21.15.100:0/2658714264 shutdown_connections 2023-12-05T09:55:19.451 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.453+0000 7fb67b59e700 1 -- 172.21.15.100:0/2658714264 wait complete. 2023-12-05T09:55:19.465 INFO:teuthology.orchestra.run.smithi100.stdout:true 2023-12-05T09:55:19.617 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.619+0000 7fbf2f0f7700 1 -- 172.21.15.100:0/32186255 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf28071bc0 msgr2=0x7fbf28070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:19.617 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.619+0000 7fbf2f0f7700 1 --2- 172.21.15.100:0/32186255 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf28071bc0 0x7fbf28070030 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c004940 tx=0x7fbf1c009e30 comp rx=0 tx=0).stop 2023-12-05T09:55:19.617 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.619+0000 7fbf2f0f7700 1 -- 172.21.15.100:0/32186255 shutdown_connections 2023-12-05T09:55:19.617 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.619+0000 7fbf2f0f7700 1 --2- 172.21.15.100:0/32186255 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf28070570 0x7fbf280709c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:19.617 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.619+0000 7fbf2f0f7700 1 --2- 172.21.15.100:0/32186255 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf28071bc0 0x7fbf28070030 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:19.617 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.619+0000 7fbf2f0f7700 1 -- 172.21.15.100:0/32186255 >> 172.21.15.100:0/32186255 conn(0x7fbf280f82d0 msgr2=0x7fbf280fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:55:19.618 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.619+0000 7fbf2f0f7700 1 -- 172.21.15.100:0/32186255 shutdown_connections 2023-12-05T09:55:19.618 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.619+0000 7fbf2f0f7700 1 -- 172.21.15.100:0/32186255 wait complete. 2023-12-05T09:55:19.618 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.620+0000 7fbf2f0f7700 1 Processor -- start 2023-12-05T09:55:19.618 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.621+0000 7fbf2f0f7700 1 -- start start 2023-12-05T09:55:19.619 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.621+0000 7fbf2f0f7700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf28070570 0x7fbf2810f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:55:19.619 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.621+0000 7fbf2f0f7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf28071bc0 0x7fbf2810fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:55:19.619 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.621+0000 7fbf2f0f7700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf281103b0 con 0x7fbf28070570 2023-12-05T09:55:19.619 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.621+0000 7fbf2f0f7700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf28110c50 con 0x7fbf28071bc0 2023-12-05T09:55:19.619 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.621+0000 7fbf2ce93700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf28070570 0x7fbf2810f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:55:19.619 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.621+0000 7fbf2ce93700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf28070570 0x7fbf2810f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59578/0 (socket says 172.21.15.100:59578) 2023-12-05T09:55:19.619 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.621+0000 7fbf2ce93700 1 -- 172.21.15.100:0/1624909202 learned_addr learned my addr 172.21.15.100:0/1624909202 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:55:19.620 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.622+0000 7fbf2ce93700 1 -- 172.21.15.100:0/1624909202 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf28071bc0 msgr2=0x7fbf2810fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:19.620 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.622+0000 7fbf2ce93700 1 --2- 172.21.15.100:0/1624909202 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf28071bc0 0x7fbf2810fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:19.620 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.622+0000 7fbf2ce93700 1 -- 172.21.15.100:0/1624909202 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf1c005040 con 0x7fbf28070570 2023-12-05T09:55:19.620 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.622+0000 7fbf2ce93700 1 --2- 172.21.15.100:0/1624909202 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf28070570 0x7fbf2810f870 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c004890 tx=0x7fbf1c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:55:19.620 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.622+0000 7fbf257fa700 1 -- 172.21.15.100:0/1624909202 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf1c021070 con 0x7fbf28070570 2023-12-05T09:55:19.620 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.622+0000 7fbf257fa700 1 -- 172.21.15.100:0/1624909202 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbf1c01c400 con 0x7fbf28070570 2023-12-05T09:55:19.620 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.622+0000 7fbf2f0f7700 1 -- 172.21.15.100:0/1624909202 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf28110ed0 con 0x7fbf28070570 2023-12-05T09:55:19.620 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.622+0000 7fbf257fa700 1 -- 172.21.15.100:0/1624909202 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf1c00e070 con 0x7fbf28070570 2023-12-05T09:55:19.620 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.622+0000 7fbf2f0f7700 1 -- 172.21.15.100:0/1624909202 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf281113b0 con 0x7fbf28070570 2023-12-05T09:55:19.621 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.624+0000 7fbf2f0f7700 1 -- 172.21.15.100:0/1624909202 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf281096f0 con 0x7fbf28070570 2023-12-05T09:55:19.621 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.624+0000 7fbf257fa700 1 -- 172.21.15.100:0/1624909202 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7fbf1c01c9c0 con 0x7fbf28070570 2023-12-05T09:55:19.623 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.626+0000 7fbf257fa700 1 --2- 172.21.15.100:0/1624909202 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fbf18068f70 0x7fbf1806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:55:19.623 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.626+0000 7fbf257fa700 1 -- 172.21.15.100:0/1624909202 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fbf1c088010 con 0x7fbf28070570 2023-12-05T09:55:19.623 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.626+0000 7fbf27fff700 1 --2- 172.21.15.100:0/1624909202 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fbf18068f70 0x7fbf1806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:55:19.624 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.627+0000 7fbf27fff700 1 --2- 172.21.15.100:0/1624909202 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fbf18068f70 0x7fbf1806b420 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbf14009fd0 tx=0x7fbf1400b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:55:19.629 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.632+0000 7fbf257fa700 1 -- 172.21.15.100:0/1624909202 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fbf1c057f20 con 0x7fbf28070570 2023-12-05T09:55:19.883 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.886+0000 7fbf2f0f7700 1 -- 172.21.15.100:0/1624909202 --> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbf281115d0 con 0x7fbf18068f70 2023-12-05T09:55:19.884 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.887+0000 7fbf257fa700 1 -- 172.21.15.100:0/1624909202 <== mgr.14210 v2:172.21.15.100:6800/1237547575 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7fbf281115d0 con 0x7fbf18068f70 2023-12-05T09:55:19.888 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.890+0000 7fbf2f0f7700 1 -- 172.21.15.100:0/1624909202 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fbf18068f70 msgr2=0x7fbf1806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:19.888 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.890+0000 7fbf2f0f7700 1 --2- 172.21.15.100:0/1624909202 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fbf18068f70 0x7fbf1806b420 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbf14009fd0 tx=0x7fbf1400b040 comp rx=0 tx=0).stop 2023-12-05T09:55:19.888 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.890+0000 7fbf2f0f7700 1 -- 172.21.15.100:0/1624909202 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf28070570 msgr2=0x7fbf2810f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:19.888 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.890+0000 7fbf2f0f7700 1 --2- 172.21.15.100:0/1624909202 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf28070570 0x7fbf2810f870 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c004890 tx=0x7fbf1c009e30 comp rx=0 tx=0).stop 2023-12-05T09:55:19.888 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.890+0000 7fbf2f0f7700 1 -- 172.21.15.100:0/1624909202 shutdown_connections 2023-12-05T09:55:19.888 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.890+0000 7fbf2f0f7700 1 --2- 172.21.15.100:0/1624909202 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fbf18068f70 0x7fbf1806b420 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:19.888 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.890+0000 7fbf2f0f7700 1 --2- 172.21.15.100:0/1624909202 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf28070570 0x7fbf2810f870 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:19.888 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.890+0000 7fbf2f0f7700 1 --2- 172.21.15.100:0/1624909202 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf28071bc0 0x7fbf2810fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:19.888 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.890+0000 7fbf2f0f7700 1 -- 172.21.15.100:0/1624909202 >> 172.21.15.100:0/1624909202 conn(0x7fbf280f82d0 msgr2=0x7fbf28103310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:55:19.888 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.890+0000 7fbf2f0f7700 1 -- 172.21.15.100:0/1624909202 shutdown_connections 2023-12-05T09:55:19.888 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:19.890+0000 7fbf2f0f7700 1 -- 172.21.15.100:0/1624909202 wait complete. 2023-12-05T09:55:20.047 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.049+0000 7f0292d45700 1 -- 172.21.15.100:0/3518302960 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f028c0fde00 msgr2=0x7f028c0fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:20.048 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.049+0000 7f0292d45700 1 --2- 172.21.15.100:0/3518302960 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f028c0fde00 0x7f028c0fe250 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f0278004940 tx=0x7f0278009e30 comp rx=0 tx=0).stop 2023-12-05T09:55:20.048 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.050+0000 7f0292d45700 1 -- 172.21.15.100:0/3518302960 shutdown_connections 2023-12-05T09:55:20.048 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.050+0000 7f0292d45700 1 --2- 172.21.15.100:0/3518302960 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f028c0fde00 0x7f028c0fe250 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:20.048 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.050+0000 7f0292d45700 1 --2- 172.21.15.100:0/3518302960 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f028c0fcbf0 0x7f028c0fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:20.048 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.050+0000 7f0292d45700 1 -- 172.21.15.100:0/3518302960 >> 172.21.15.100:0/3518302960 conn(0x7f028c0f82d0 msgr2=0x7f028c0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:55:20.048 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.050+0000 7f0292d45700 1 -- 172.21.15.100:0/3518302960 shutdown_connections 2023-12-05T09:55:20.048 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.050+0000 7f0292d45700 1 -- 172.21.15.100:0/3518302960 wait complete. 2023-12-05T09:55:20.048 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.051+0000 7f0292d45700 1 Processor -- start 2023-12-05T09:55:20.049 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.051+0000 7f0292d45700 1 -- start start 2023-12-05T09:55:20.049 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.051+0000 7f0292d45700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f028c0fcbf0 0x7f028c10d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:55:20.049 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.052+0000 7f0292d45700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f028c0fde00 0x7f028c10da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:55:20.049 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.052+0000 7f0292d45700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f028c10e030 con 0x7f028c0fde00 2023-12-05T09:55:20.050 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.052+0000 7f0292d45700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f028c10e8d0 con 0x7f028c0fcbf0 2023-12-05T09:55:20.050 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.052+0000 7f028bfff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f028c0fde00 0x7f028c10da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:55:20.050 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.052+0000 7f028bfff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f028c0fde00 0x7f028c10da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51378/0 (socket says 172.21.15.100:51378) 2023-12-05T09:55:20.050 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.052+0000 7f028bfff700 1 -- 172.21.15.100:0/1393474325 learned_addr learned my addr 172.21.15.100:0/1393474325 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:55:20.050 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.052+0000 7f0290ae1700 1 --2- 172.21.15.100:0/1393474325 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f028c0fcbf0 0x7f028c10d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:55:20.051 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.052+0000 7f028bfff700 1 -- 172.21.15.100:0/1393474325 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f028c0fcbf0 msgr2=0x7f028c10d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:20.051 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.052+0000 7f028bfff700 1 --2- 172.21.15.100:0/1393474325 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f028c0fcbf0 0x7f028c10d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:20.051 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.052+0000 7f028bfff700 1 -- 172.21.15.100:0/1393474325 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0278005040 con 0x7f028c0fde00 2023-12-05T09:55:20.051 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.052+0000 7f0290ae1700 1 --2- 172.21.15.100:0/1393474325 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f028c0fcbf0 0x7f028c10d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-05T09:55:20.051 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.053+0000 7f028bfff700 1 --2- 172.21.15.100:0/1393474325 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f028c0fde00 0x7f028c10da30 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f0278000c00 tx=0x7f0278009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:55:20.051 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.053+0000 7f02897fa700 1 -- 172.21.15.100:0/1393474325 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0278021070 con 0x7f028c0fde00 2023-12-05T09:55:20.051 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.053+0000 7f02897fa700 1 -- 172.21.15.100:0/1393474325 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f027801c400 con 0x7f028c0fde00 2023-12-05T09:55:20.051 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.053+0000 7f02897fa700 1 -- 172.21.15.100:0/1393474325 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f027800e070 con 0x7f028c0fde00 2023-12-05T09:55:20.051 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.053+0000 7f0292d45700 1 -- 172.21.15.100:0/1393474325 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f028c10eb50 con 0x7f028c0fde00 2023-12-05T09:55:20.051 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.053+0000 7f0292d45700 1 -- 172.21.15.100:0/1393474325 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f028c10ef90 con 0x7f028c0fde00 2023-12-05T09:55:20.052 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.054+0000 7f0292d45700 1 -- 172.21.15.100:0/1393474325 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f028c04bb80 con 0x7f028c0fde00 2023-12-05T09:55:20.053 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.056+0000 7f02897fa700 1 -- 172.21.15.100:0/1393474325 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f027801c570 con 0x7f028c0fde00 2023-12-05T09:55:20.055 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.057+0000 7f02897fa700 1 --2- 172.21.15.100:0/1393474325 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f027c068f60 0x7f027c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:55:20.055 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.057+0000 7f02897fa700 1 -- 172.21.15.100:0/1393474325 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f02780880f0 con 0x7f028c0fde00 2023-12-05T09:55:20.055 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.058+0000 7f0290ae1700 1 --2- 172.21.15.100:0/1393474325 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f027c068f60 0x7f027c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:55:20.055 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.058+0000 7f0290ae1700 1 --2- 172.21.15.100:0/1393474325 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f027c068f60 0x7f027c06b410 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0280004600 tx=0x7f028000b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:55:20.059 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.062+0000 7f02897fa700 1 -- 172.21.15.100:0/1393474325 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f0278058000 con 0x7f028c0fde00 2023-12-05T09:55:20.345 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:55:19 smithi150 ceph-mon[116142]: pgmap v178: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2023-12-05T09:55:20.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:55:19 smithi150 ceph-mon[116142]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 2023-12-05T09:55:20.369 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.372+0000 7f0292d45700 1 -- 172.21.15.100:0/1393474325 --> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f028c10f460 con 0x7f027c068f60 2023-12-05T09:55:20.379 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.382+0000 7f02897fa700 1 -- 172.21.15.100:0/1393474325 <== mgr.14210 v2:172.21.15.100:6800/1237547575 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f028c10f460 con 0x7f027c068f60 2023-12-05T09:55:20.380 INFO:teuthology.orchestra.run.smithi100.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-05T09:55:20.380 INFO:teuthology.orchestra.run.smithi100.stdout:alertmanager.smithi100 smithi100 *:9093,9094 running (4m) 27s ago 5m 14.4M - 0.25.0 c8568f914cd2 836425c83df9 2023-12-05T09:55:20.380 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi100 smithi100 running (5m) 27s ago 5m 7822k - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 6379a3185d48 2023-12-05T09:55:20.380 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi150 smithi150 running (4m) 31s ago 4m 7826k - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 349d37092dbd 2023-12-05T09:55:20.380 INFO:teuthology.orchestra.run.smithi100.stdout:grafana.smithi100 smithi100 *:3000 running (4m) 27s ago 5m 78.5M - 9.4.7 2c41d148cca3 53cd204a480d 2023-12-05T09:55:20.380 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.akmstb smithi100 running (41s) 27s ago 41s 14.6M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 6ce55c42c55b 2023-12-05T09:55:20.380 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.sqplhn smithi100 running (47s) 27s ago 47s 12.3M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc c2682d65f0c9 2023-12-05T09:55:20.380 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi150.fcnhsv smithi150 running (39s) 31s ago 39s 11.9M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 1a259762235d 2023-12-05T09:55:20.380 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi150.pcbpxm smithi150 running (44s) 31s ago 44s 12.0M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 27f730f8b9f9 2023-12-05T09:55:20.380 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi100.ehmuhg smithi100 *:9283 running (6m) 27s ago 6m 501M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc a724d569b69c 2023-12-05T09:55:20.380 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi150.zkskag smithi150 *:8443,9283 running (4m) 31s ago 4m 442M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc e9131b921eac 2023-12-05T09:55:20.380 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi100 smithi100 running (6m) 27s ago 6m 75.4M 2048M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 8e091d6081cc 2023-12-05T09:55:20.381 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi150 smithi150 running (4m) 31s ago 4m 47.8M 2048M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 05fe70420b09 2023-12-05T09:55:20.381 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi100 smithi100 *:9100 running (5m) 27s ago 5m 8904k - 1.5.0 0da6a335fe13 14c9b3344a5a 2023-12-05T09:55:20.381 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi150 smithi150 *:9100 running (4m) 31s ago 4m 8715k - 1.5.0 0da6a335fe13 d3babc3b947c 2023-12-05T09:55:20.381 INFO:teuthology.orchestra.run.smithi100.stdout:osd.0 smithi100 running (3m) 27s ago 3m 56.0M 4349M 17.2.7-109-g1fd3ca3c e139fc5fd9fc c8e64a62cd47 2023-12-05T09:55:20.381 INFO:teuthology.orchestra.run.smithi100.stdout:osd.1 smithi100 running (3m) 27s ago 3m 59.8M 4349M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 0500895cdfc2 2023-12-05T09:55:20.381 INFO:teuthology.orchestra.run.smithi100.stdout:osd.2 smithi100 running (3m) 27s ago 3m 53.3M 4349M 17.2.7-109-g1fd3ca3c e139fc5fd9fc f145372c8ccc 2023-12-05T09:55:20.381 INFO:teuthology.orchestra.run.smithi100.stdout:osd.3 smithi150 running (2m) 31s ago 2m 54.2M 5373M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 78137d463d29 2023-12-05T09:55:20.381 INFO:teuthology.orchestra.run.smithi100.stdout:osd.4 smithi150 running (2m) 31s ago 2m 49.5M 5373M 17.2.7-109-g1fd3ca3c e139fc5fd9fc dfef9accd162 2023-12-05T09:55:20.381 INFO:teuthology.orchestra.run.smithi100.stdout:osd.5 smithi150 running (113s) 31s ago 113s 50.9M 5373M 17.2.7-109-g1fd3ca3c e139fc5fd9fc d9720b1eae0c 2023-12-05T09:55:20.381 INFO:teuthology.orchestra.run.smithi100.stdout:prometheus.smithi100 smithi100 *:9095 running (3m) 27s ago 4m 43.0M - 2.43.0 a07b618ecd1d 74a355bfd7ab 2023-12-05T09:55:20.382 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.384+0000 7f0292d45700 1 -- 172.21.15.100:0/1393474325 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f027c068f60 msgr2=0x7f027c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:20.382 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.384+0000 7f0292d45700 1 --2- 172.21.15.100:0/1393474325 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f027c068f60 0x7f027c06b410 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0280004600 tx=0x7f028000b040 comp rx=0 tx=0).stop 2023-12-05T09:55:20.382 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.384+0000 7f0292d45700 1 -- 172.21.15.100:0/1393474325 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f028c0fde00 msgr2=0x7f028c10da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:20.382 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.384+0000 7f0292d45700 1 --2- 172.21.15.100:0/1393474325 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f028c0fde00 0x7f028c10da30 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f0278000c00 tx=0x7f0278009e30 comp rx=0 tx=0).stop 2023-12-05T09:55:20.382 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.384+0000 7f0292d45700 1 -- 172.21.15.100:0/1393474325 shutdown_connections 2023-12-05T09:55:20.382 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.384+0000 7f0292d45700 1 --2- 172.21.15.100:0/1393474325 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f027c068f60 0x7f027c06b410 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:20.382 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.384+0000 7f0292d45700 1 --2- 172.21.15.100:0/1393474325 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f028c0fcbf0 0x7f028c10d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:20.383 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.384+0000 7f0292d45700 1 --2- 172.21.15.100:0/1393474325 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f028c0fde00 0x7f028c10da30 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:20.383 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.384+0000 7f0292d45700 1 -- 172.21.15.100:0/1393474325 >> 172.21.15.100:0/1393474325 conn(0x7f028c0f82d0 msgr2=0x7f028c101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:55:20.383 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.385+0000 7f0292d45700 1 -- 172.21.15.100:0/1393474325 shutdown_connections 2023-12-05T09:55:20.383 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.385+0000 7f0292d45700 1 -- 172.21.15.100:0/1393474325 wait complete. 2023-12-05T09:55:20.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:55:19 smithi100 ceph-mon[107145]: pgmap v178: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2023-12-05T09:55:20.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:55:19 smithi100 ceph-mon[107145]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 2023-12-05T09:55:20.550 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.552+0000 7f317d75a700 1 -- 172.21.15.100:0/2011218092 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31780ffe70 msgr2=0x7f3178102250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:20.550 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.552+0000 7f317d75a700 1 --2- 172.21.15.100:0/2011218092 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31780ffe70 0x7f3178102250 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f316c004940 tx=0x7f316c009e30 comp rx=0 tx=0).stop 2023-12-05T09:55:20.550 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.552+0000 7f317d75a700 1 -- 172.21.15.100:0/2011218092 shutdown_connections 2023-12-05T09:55:20.550 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.552+0000 7f317d75a700 1 --2- 172.21.15.100:0/2011218092 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31780ffe70 0x7f3178102250 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:20.550 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.552+0000 7f317d75a700 1 --2- 172.21.15.100:0/2011218092 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31780fd550 0x7f31780ff930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:20.551 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.552+0000 7f317d75a700 1 -- 172.21.15.100:0/2011218092 >> 172.21.15.100:0/2011218092 conn(0x7f31780f6fb0 msgr2=0x7f31780f9400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:55:20.551 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.552+0000 7f317d75a700 1 -- 172.21.15.100:0/2011218092 shutdown_connections 2023-12-05T09:55:20.551 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.553+0000 7f317d75a700 1 -- 172.21.15.100:0/2011218092 wait complete. 2023-12-05T09:55:20.551 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.553+0000 7f317d75a700 1 Processor -- start 2023-12-05T09:55:20.551 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.554+0000 7f317d75a700 1 -- start start 2023-12-05T09:55:20.551 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.554+0000 7f317d75a700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31780fd550 0x7f317810d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:55:20.551 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.554+0000 7f317d75a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31780ffe70 0x7f317810d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:55:20.551 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.554+0000 7f317d75a700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f317810de20 con 0x7f31780fd550 2023-12-05T09:55:20.552 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.554+0000 7f317d75a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f317810e6c0 con 0x7f31780ffe70 2023-12-05T09:55:20.552 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.554+0000 7f3177fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31780fd550 0x7f317810d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:55:20.552 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.554+0000 7f3177fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31780fd550 0x7f317810d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51394/0 (socket says 172.21.15.100:51394) 2023-12-05T09:55:20.552 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.554+0000 7f3177fff700 1 -- 172.21.15.100:0/2455269622 learned_addr learned my addr 172.21.15.100:0/2455269622 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:55:20.553 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.554+0000 7f31777fe700 1 --2- 172.21.15.100:0/2455269622 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31780ffe70 0x7f317810d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:55:20.553 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.555+0000 7f3177fff700 1 -- 172.21.15.100:0/2455269622 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31780ffe70 msgr2=0x7f317810d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:20.553 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.555+0000 7f3177fff700 1 --2- 172.21.15.100:0/2455269622 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31780ffe70 0x7f317810d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:20.553 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.555+0000 7f3177fff700 1 -- 172.21.15.100:0/2455269622 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f316c005040 con 0x7f31780fd550 2023-12-05T09:55:20.553 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.555+0000 7f3177fff700 1 --2- 172.21.15.100:0/2455269622 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31780fd550 0x7f317810d2e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f3168002a50 tx=0x7f31680046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:55:20.553 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.555+0000 7f3174ff9700 1 -- 172.21.15.100:0/2455269622 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3168007cc0 con 0x7f31780fd550 2023-12-05T09:55:20.554 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.555+0000 7f317d75a700 1 -- 172.21.15.100:0/2455269622 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f317810e9a0 con 0x7f31780fd550 2023-12-05T09:55:20.554 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.555+0000 7f3174ff9700 1 -- 172.21.15.100:0/2455269622 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f316800f040 con 0x7f31780fd550 2023-12-05T09:55:20.554 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.555+0000 7f3174ff9700 1 -- 172.21.15.100:0/2455269622 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f316800d9c0 con 0x7f31780fd550 2023-12-05T09:55:20.554 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.556+0000 7f317d75a700 1 -- 172.21.15.100:0/2455269622 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f317810eee0 con 0x7f31780fd550 2023-12-05T09:55:20.554 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.557+0000 7f317d75a700 1 -- 172.21.15.100:0/2455269622 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f317804bb80 con 0x7f31780fd550 2023-12-05T09:55:20.555 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.558+0000 7f3174ff9700 1 -- 172.21.15.100:0/2455269622 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f316800db20 con 0x7f31780fd550 2023-12-05T09:55:20.557 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.559+0000 7f3174ff9700 1 --2- 172.21.15.100:0/2455269622 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f3160068f70 0x7f316006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:55:20.557 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.560+0000 7f3174ff9700 1 -- 172.21.15.100:0/2455269622 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f3168086b30 con 0x7f31780fd550 2023-12-05T09:55:20.557 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.560+0000 7f31777fe700 1 --2- 172.21.15.100:0/2455269622 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f3160068f70 0x7f316006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:55:20.558 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.560+0000 7f31777fe700 1 --2- 172.21.15.100:0/2455269622 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f3160068f70 0x7f316006b420 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f316c00b3b0 tx=0x7f316c009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:55:20.561 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.563+0000 7f3174ff9700 1 -- 172.21.15.100:0/2455269622 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f31680569c0 con 0x7f31780fd550 2023-12-05T09:55:20.912 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.914+0000 7f317d75a700 1 -- 172.21.15.100:0/2455269622 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f317810f4e0 con 0x7f31780fd550 2023-12-05T09:55:20.912 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.915+0000 7f3174ff9700 1 -- 172.21.15.100:0/2455269622 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7f3168056550 con 0x7f31780fd550 2023-12-05T09:55:20.913 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2023-12-05T09:55:20.913 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": { 2023-12-05T09:55:20.913 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 2 2023-12-05T09:55:20.913 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-12-05T09:55:20.913 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": { 2023-12-05T09:55:20.913 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 2 2023-12-05T09:55:20.913 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-12-05T09:55:20.913 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": { 2023-12-05T09:55:20.913 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 6 2023-12-05T09:55:20.913 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-12-05T09:55:20.913 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": { 2023-12-05T09:55:20.913 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 4 2023-12-05T09:55:20.913 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-12-05T09:55:20.913 INFO:teuthology.orchestra.run.smithi100.stdout: "overall": { 2023-12-05T09:55:20.914 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 14 2023-12-05T09:55:20.914 INFO:teuthology.orchestra.run.smithi100.stdout: } 2023-12-05T09:55:20.914 INFO:teuthology.orchestra.run.smithi100.stdout:} 2023-12-05T09:55:20.915 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.917+0000 7f317d75a700 1 -- 172.21.15.100:0/2455269622 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f3160068f70 msgr2=0x7f316006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:20.915 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.917+0000 7f317d75a700 1 --2- 172.21.15.100:0/2455269622 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f3160068f70 0x7f316006b420 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f316c00b3b0 tx=0x7f316c009e30 comp rx=0 tx=0).stop 2023-12-05T09:55:20.915 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.917+0000 7f317d75a700 1 -- 172.21.15.100:0/2455269622 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31780fd550 msgr2=0x7f317810d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:20.915 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.917+0000 7f317d75a700 1 --2- 172.21.15.100:0/2455269622 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31780fd550 0x7f317810d2e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f3168002a50 tx=0x7f31680046b0 comp rx=0 tx=0).stop 2023-12-05T09:55:20.915 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.917+0000 7f317d75a700 1 -- 172.21.15.100:0/2455269622 shutdown_connections 2023-12-05T09:55:20.915 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.917+0000 7f317d75a700 1 --2- 172.21.15.100:0/2455269622 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f3160068f70 0x7f316006b420 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:20.915 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.917+0000 7f317d75a700 1 --2- 172.21.15.100:0/2455269622 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31780fd550 0x7f317810d2e0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:20.916 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.917+0000 7f317d75a700 1 --2- 172.21.15.100:0/2455269622 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31780ffe70 0x7f317810d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:20.916 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.917+0000 7f317d75a700 1 -- 172.21.15.100:0/2455269622 >> 172.21.15.100:0/2455269622 conn(0x7f31780f6fb0 msgr2=0x7f31780f9400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:55:20.916 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.917+0000 7f317d75a700 1 -- 172.21.15.100:0/2455269622 shutdown_connections 2023-12-05T09:55:20.916 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:20.918+0000 7f317d75a700 1 -- 172.21.15.100:0/2455269622 wait complete. 2023-12-05T09:55:21.067 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.069+0000 7f952424d700 1 -- 172.21.15.100:0/4122374677 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f951c0fbaf0 msgr2=0x7f951c0fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:21.067 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.069+0000 7f952424d700 1 --2- 172.21.15.100:0/4122374677 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f951c0fbaf0 0x7f951c0fbf00 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9518004940 tx=0x7f9518009e30 comp rx=0 tx=0).stop 2023-12-05T09:55:21.067 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.069+0000 7f952424d700 1 -- 172.21.15.100:0/4122374677 shutdown_connections 2023-12-05T09:55:21.067 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.069+0000 7f952424d700 1 --2- 172.21.15.100:0/4122374677 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f951c0fcd00 0x7f951c0fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:21.067 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.069+0000 7f952424d700 1 --2- 172.21.15.100:0/4122374677 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f951c0fbaf0 0x7f951c0fbf00 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:21.067 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.069+0000 7f952424d700 1 -- 172.21.15.100:0/4122374677 >> 172.21.15.100:0/4122374677 conn(0x7f951c0f7190 msgr2=0x7f951c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:55:21.067 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.069+0000 7f952424d700 1 -- 172.21.15.100:0/4122374677 shutdown_connections 2023-12-05T09:55:21.067 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.069+0000 7f952424d700 1 -- 172.21.15.100:0/4122374677 wait complete. 2023-12-05T09:55:21.068 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.070+0000 7f952424d700 1 Processor -- start 2023-12-05T09:55:21.068 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.070+0000 7f952424d700 1 -- start start 2023-12-05T09:55:21.068 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.071+0000 7f952424d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f951c0fbaf0 0x7f951c10f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:55:21.068 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.071+0000 7f952424d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f951c0fcd00 0x7f951c10fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:55:21.068 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.071+0000 7f952424d700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f951c1102c0 con 0x7f951c0fbaf0 2023-12-05T09:55:21.069 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.071+0000 7f952424d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f951c110b60 con 0x7f951c0fcd00 2023-12-05T09:55:21.069 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.071+0000 7f9521fe9700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f951c0fbaf0 0x7f951c10f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:55:21.069 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.071+0000 7f9521fe9700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f951c0fbaf0 0x7f951c10f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51416/0 (socket says 172.21.15.100:51416) 2023-12-05T09:55:21.069 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.071+0000 7f9521fe9700 1 -- 172.21.15.100:0/3250866650 learned_addr learned my addr 172.21.15.100:0/3250866650 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:55:21.070 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.071+0000 7f95217e8700 1 --2- 172.21.15.100:0/3250866650 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f951c0fcd00 0x7f951c10fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:55:21.070 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.071+0000 7f9521fe9700 1 -- 172.21.15.100:0/3250866650 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f951c0fcd00 msgr2=0x7f951c10fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:21.070 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.071+0000 7f9521fe9700 1 --2- 172.21.15.100:0/3250866650 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f951c0fcd00 0x7f951c10fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:21.070 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.071+0000 7f9521fe9700 1 -- 172.21.15.100:0/3250866650 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9518005040 con 0x7f951c0fbaf0 2023-12-05T09:55:21.070 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.071+0000 7f95217e8700 1 --2- 172.21.15.100:0/3250866650 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f951c0fcd00 0x7f951c10fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-05T09:55:21.070 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.072+0000 7f9521fe9700 1 --2- 172.21.15.100:0/3250866650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f951c0fbaf0 0x7f951c10f780 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f9518004f90 tx=0x7f9518009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:55:21.070 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.072+0000 7f95127fc700 1 -- 172.21.15.100:0/3250866650 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f951800e040 con 0x7f951c0fbaf0 2023-12-05T09:55:21.070 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.072+0000 7f95127fc700 1 -- 172.21.15.100:0/3250866650 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f951800bcd0 con 0x7f951c0fbaf0 2023-12-05T09:55:21.070 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.072+0000 7f952424d700 1 -- 172.21.15.100:0/3250866650 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f951c110de0 con 0x7f951c0fbaf0 2023-12-05T09:55:21.070 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.072+0000 7f95127fc700 1 -- 172.21.15.100:0/3250866650 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f951801c630 con 0x7f951c0fbaf0 2023-12-05T09:55:21.070 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.072+0000 7f952424d700 1 -- 172.21.15.100:0/3250866650 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f951c111320 con 0x7f951c0fbaf0 2023-12-05T09:55:21.071 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.073+0000 7f952424d700 1 -- 172.21.15.100:0/3250866650 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f951c100da0 con 0x7f951c0fbaf0 2023-12-05T09:55:21.071 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.074+0000 7f95127fc700 1 -- 172.21.15.100:0/3250866650 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f9518013960 con 0x7f951c0fbaf0 2023-12-05T09:55:21.072 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.075+0000 7f95127fc700 1 --2- 172.21.15.100:0/3250866650 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f9508068f60 0x7f950806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:55:21.072 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.075+0000 7f95127fc700 1 -- 172.21.15.100:0/3250866650 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f9518088290 con 0x7f951c0fbaf0 2023-12-05T09:55:21.073 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.075+0000 7f95217e8700 1 --2- 172.21.15.100:0/3250866650 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f9508068f60 0x7f950806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:55:21.073 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.076+0000 7f95217e8700 1 --2- 172.21.15.100:0/3250866650 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f9508068f60 0x7f950806b410 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f950c009fd0 tx=0x7f950c00b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:55:21.076 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.079+0000 7f95127fc700 1 -- 172.21.15.100:0/3250866650 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f95180581a0 con 0x7f951c0fbaf0 2023-12-05T09:55:21.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:55:20 smithi150 ceph-mon[116142]: from='client.14570 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:55:21.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:55:20 smithi150 ceph-mon[116142]: from='client.14574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:55:21.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:55:20 smithi150 ceph-mon[116142]: from='client.? 172.21.15.100:0/2455269622' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:55:21.349 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.352+0000 7f952424d700 1 -- 172.21.15.100:0/3250866650 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f951c04bb80 con 0x7f951c0fbaf0 2023-12-05T09:55:21.350 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.352+0000 7f95127fc700 1 -- 172.21.15.100:0/3250866650 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1814 (secure 0 0 0) 0x7f9518057d30 con 0x7f951c0fbaf0 2023-12-05T09:55:21.350 INFO:teuthology.orchestra.run.smithi100.stdout:e13 2023-12-05T09:55:21.350 INFO:teuthology.orchestra.run.smithi100.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-05T09:55:21.350 INFO:teuthology.orchestra.run.smithi100.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T09:55:21.350 INFO:teuthology.orchestra.run.smithi100.stdout:legacy client fscid: 1 2023-12-05T09:55:21.350 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:55:21.350 INFO:teuthology.orchestra.run.smithi100.stdout:Filesystem 'cephfs' (1) 2023-12-05T09:55:21.351 INFO:teuthology.orchestra.run.smithi100.stdout:fs_name cephfs 2023-12-05T09:55:21.351 INFO:teuthology.orchestra.run.smithi100.stdout:epoch 13 2023-12-05T09:55:21.351 INFO:teuthology.orchestra.run.smithi100.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-05T09:55:21.351 INFO:teuthology.orchestra.run.smithi100.stdout:created 2023-12-05T09:54:30.515778+0000 2023-12-05T09:55:21.351 INFO:teuthology.orchestra.run.smithi100.stdout:modified 2023-12-05T09:54:46.403009+0000 2023-12-05T09:55:21.351 INFO:teuthology.orchestra.run.smithi100.stdout:tableserver 0 2023-12-05T09:55:21.351 INFO:teuthology.orchestra.run.smithi100.stdout:root 0 2023-12-05T09:55:21.351 INFO:teuthology.orchestra.run.smithi100.stdout:session_timeout 60 2023-12-05T09:55:21.351 INFO:teuthology.orchestra.run.smithi100.stdout:session_autoclose 300 2023-12-05T09:55:21.351 INFO:teuthology.orchestra.run.smithi100.stdout:max_file_size 1099511627776 2023-12-05T09:55:21.351 INFO:teuthology.orchestra.run.smithi100.stdout:required_client_features {} 2023-12-05T09:55:21.351 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure 0 2023-12-05T09:55:21.351 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure_osd_epoch 46 2023-12-05T09:55:21.351 INFO:teuthology.orchestra.run.smithi100.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T09:55:21.351 INFO:teuthology.orchestra.run.smithi100.stdout:max_mds 1 2023-12-05T09:55:21.351 INFO:teuthology.orchestra.run.smithi100.stdout:in 0 2023-12-05T09:55:21.352 INFO:teuthology.orchestra.run.smithi100.stdout:up {0=14490} 2023-12-05T09:55:21.352 INFO:teuthology.orchestra.run.smithi100.stdout:failed 2023-12-05T09:55:21.352 INFO:teuthology.orchestra.run.smithi100.stdout:damaged 2023-12-05T09:55:21.352 INFO:teuthology.orchestra.run.smithi100.stdout:stopped 2023-12-05T09:55:21.352 INFO:teuthology.orchestra.run.smithi100.stdout:data_pools [3] 2023-12-05T09:55:21.352 INFO:teuthology.orchestra.run.smithi100.stdout:metadata_pool 2 2023-12-05T09:55:21.352 INFO:teuthology.orchestra.run.smithi100.stdout:inline_data disabled 2023-12-05T09:55:21.352 INFO:teuthology.orchestra.run.smithi100.stdout:balancer 2023-12-05T09:55:21.352 INFO:teuthology.orchestra.run.smithi100.stdout:standby_count_wanted 1 2023-12-05T09:55:21.352 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi100.akmstb{0:14490} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.100:6828/627555128,v1:172.21.15.100:6829/627555128] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:55:21.352 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:55:21.352 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:55:21.352 INFO:teuthology.orchestra.run.smithi100.stdout:Standby daemons: 2023-12-05T09:55:21.352 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:55:21.352 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi150.pcbpxm{-1:14486} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.150:6824/3645854543,v1:172.21.15.150:6825/3645854543] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:55:21.353 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi150.fcnhsv{-1:14498} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.150:6826/3249949736,v1:172.21.15.150:6827/3249949736] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:55:21.353 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi100.sqplhn{-1:14506} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.100:6826/2472212864,v1:172.21.15.100:6827/2472212864] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:55:21.353 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.355+0000 7f952424d700 1 -- 172.21.15.100:0/3250866650 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f9508068f60 msgr2=0x7f950806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:21.354 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.355+0000 7f952424d700 1 --2- 172.21.15.100:0/3250866650 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f9508068f60 0x7f950806b410 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f950c009fd0 tx=0x7f950c00b040 comp rx=0 tx=0).stop 2023-12-05T09:55:21.354 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.355+0000 7f952424d700 1 -- 172.21.15.100:0/3250866650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f951c0fbaf0 msgr2=0x7f951c10f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:21.354 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.355+0000 7f952424d700 1 --2- 172.21.15.100:0/3250866650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f951c0fbaf0 0x7f951c10f780 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f9518004f90 tx=0x7f9518009e30 comp rx=0 tx=0).stop 2023-12-05T09:55:21.354 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.355+0000 7f952424d700 1 -- 172.21.15.100:0/3250866650 shutdown_connections 2023-12-05T09:55:21.354 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.355+0000 7f952424d700 1 --2- 172.21.15.100:0/3250866650 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f9508068f60 0x7f950806b410 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:21.354 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.355+0000 7f952424d700 1 --2- 172.21.15.100:0/3250866650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f951c0fbaf0 0x7f951c10f780 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:21.354 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.355+0000 7f952424d700 1 --2- 172.21.15.100:0/3250866650 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f951c0fcd00 0x7f951c10fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:21.354 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.355+0000 7f952424d700 1 -- 172.21.15.100:0/3250866650 >> 172.21.15.100:0/3250866650 conn(0x7f951c0f7190 msgr2=0x7f951c0fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:55:21.354 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.355+0000 7f952424d700 1 -- 172.21.15.100:0/3250866650 shutdown_connections 2023-12-05T09:55:21.354 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.355+0000 7f952424d700 1 -- 172.21.15.100:0/3250866650 wait complete. 2023-12-05T09:55:21.355 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 13 2023-12-05T09:55:21.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:55:20 smithi100 ceph-mon[107145]: from='client.14570 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:55:21.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:55:20 smithi100 ceph-mon[107145]: from='client.14574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:55:21.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:55:20 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/2455269622' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:55:21.497 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.499+0000 7ff9d7fff700 1 -- 172.21.15.100:0/115531743 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9d80fc9f0 msgr2=0x7ff9d80fce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:21.497 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.499+0000 7ff9d7fff700 1 --2- 172.21.15.100:0/115531743 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9d80fc9f0 0x7ff9d80fce00 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8004940 tx=0x7ff9c8009e30 comp rx=0 tx=0).stop 2023-12-05T09:55:21.497 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.499+0000 7ff9d7fff700 1 -- 172.21.15.100:0/115531743 shutdown_connections 2023-12-05T09:55:21.497 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.499+0000 7ff9d7fff700 1 --2- 172.21.15.100:0/115531743 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9d80fdc00 0x7ff9d80fe050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:21.497 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.499+0000 7ff9d7fff700 1 --2- 172.21.15.100:0/115531743 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9d80fc9f0 0x7ff9d80fce00 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:21.497 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.499+0000 7ff9d7fff700 1 -- 172.21.15.100:0/115531743 >> 172.21.15.100:0/115531743 conn(0x7ff9d80f8090 msgr2=0x7ff9d80fa4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:55:21.497 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.499+0000 7ff9d7fff700 1 -- 172.21.15.100:0/115531743 shutdown_connections 2023-12-05T09:55:21.497 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.499+0000 7ff9d7fff700 1 -- 172.21.15.100:0/115531743 wait complete. 2023-12-05T09:55:21.498 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.500+0000 7ff9d7fff700 1 Processor -- start 2023-12-05T09:55:21.499 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.500+0000 7ff9d7fff700 1 -- start start 2023-12-05T09:55:21.499 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.501+0000 7ff9d7fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9d80fc9f0 0x7ff9d810f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:55:21.499 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.501+0000 7ff9d7fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9d80fdc00 0x7ff9d810f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:55:21.499 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.501+0000 7ff9d7fff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d810ffb0 con 0x7ff9d80fdc00 2023-12-05T09:55:21.499 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.501+0000 7ff9d7fff700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d8110850 con 0x7ff9d80fc9f0 2023-12-05T09:55:21.499 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.501+0000 7ff9d67fc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9d80fdc00 0x7ff9d810f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:55:21.499 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.501+0000 7ff9d67fc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9d80fdc00 0x7ff9d810f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51436/0 (socket says 172.21.15.100:51436) 2023-12-05T09:55:21.499 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.501+0000 7ff9d67fc700 1 -- 172.21.15.100:0/676015535 learned_addr learned my addr 172.21.15.100:0/676015535 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:55:21.499 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.501+0000 7ff9d6ffd700 1 --2- 172.21.15.100:0/676015535 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9d80fc9f0 0x7ff9d810f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:55:21.499 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.501+0000 7ff9d67fc700 1 -- 172.21.15.100:0/676015535 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9d80fc9f0 msgr2=0x7ff9d810f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:21.499 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.501+0000 7ff9d67fc700 1 --2- 172.21.15.100:0/676015535 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9d80fc9f0 0x7ff9d810f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:21.499 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.501+0000 7ff9d67fc700 1 -- 172.21.15.100:0/676015535 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9c8005040 con 0x7ff9d80fdc00 2023-12-05T09:55:21.500 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.502+0000 7ff9d67fc700 1 --2- 172.21.15.100:0/676015535 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9d80fdc00 0x7ff9d810f9b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc00eb40 tx=0x7ff9cc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:55:21.500 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.502+0000 7ff9bf7fe700 1 -- 172.21.15.100:0/676015535 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9cc007cc0 con 0x7ff9d80fdc00 2023-12-05T09:55:21.500 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.502+0000 7ff9bf7fe700 1 -- 172.21.15.100:0/676015535 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff9cc00f040 con 0x7ff9d80fdc00 2023-12-05T09:55:21.500 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.502+0000 7ff9d7fff700 1 -- 172.21.15.100:0/676015535 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9d8110ad0 con 0x7ff9d80fdc00 2023-12-05T09:55:21.500 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.502+0000 7ff9bf7fe700 1 -- 172.21.15.100:0/676015535 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9cc009570 con 0x7ff9d80fdc00 2023-12-05T09:55:21.500 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.502+0000 7ff9d7fff700 1 -- 172.21.15.100:0/676015535 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9d8111010 con 0x7ff9d80fdc00 2023-12-05T09:55:21.501 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.504+0000 7ff9d7fff700 1 -- 172.21.15.100:0/676015535 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9d8101ca0 con 0x7ff9d80fdc00 2023-12-05T09:55:21.502 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.505+0000 7ff9bf7fe700 1 -- 172.21.15.100:0/676015535 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7ff9cc0096d0 con 0x7ff9d80fdc00 2023-12-05T09:55:21.503 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.506+0000 7ff9bf7fe700 1 --2- 172.21.15.100:0/676015535 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7ff9c0068fc0 0x7ff9c006b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:55:21.503 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.506+0000 7ff9bf7fe700 1 -- 172.21.15.100:0/676015535 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7ff9cc086b30 con 0x7ff9d80fdc00 2023-12-05T09:55:21.503 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.506+0000 7ff9d6ffd700 1 --2- 172.21.15.100:0/676015535 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7ff9c0068fc0 0x7ff9c006b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:55:21.504 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.507+0000 7ff9d6ffd700 1 --2- 172.21.15.100:0/676015535 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7ff9c0068fc0 0x7ff9c006b470 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff9c800b0d0 tx=0x7ff9c8009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:55:21.509 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.512+0000 7ff9bf7fe700 1 -- 172.21.15.100:0/676015535 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ff9cc04da00 con 0x7ff9d80fdc00 2023-12-05T09:55:21.761 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.763+0000 7ff9d7fff700 1 -- 172.21.15.100:0/676015535 --> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff9d802b250 con 0x7ff9c0068fc0 2023-12-05T09:55:21.762 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.765+0000 7ff9bf7fe700 1 -- 172.21.15.100:0/676015535 <== mgr.14210 v2:172.21.15.100:6800/1237547575 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7ff9d802b250 con 0x7ff9c0068fc0 2023-12-05T09:55:21.762 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2023-12-05T09:55:21.762 INFO:teuthology.orchestra.run.smithi100.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:3fe8d441c2f973bfe963ba4dd30ba8eac9f36227", 2023-12-05T09:55:21.762 INFO:teuthology.orchestra.run.smithi100.stdout: "in_progress": true, 2023-12-05T09:55:21.763 INFO:teuthology.orchestra.run.smithi100.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-05T09:55:21.763 INFO:teuthology.orchestra.run.smithi100.stdout: "services_complete": [], 2023-12-05T09:55:21.763 INFO:teuthology.orchestra.run.smithi100.stdout: "progress": "", 2023-12-05T09:55:21.763 INFO:teuthology.orchestra.run.smithi100.stdout: "message": "Doing first pull of quay.ceph.io/ceph-ci/ceph:3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 image", 2023-12-05T09:55:21.763 INFO:teuthology.orchestra.run.smithi100.stdout: "is_paused": false 2023-12-05T09:55:21.763 INFO:teuthology.orchestra.run.smithi100.stdout:} 2023-12-05T09:55:21.765 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.767+0000 7ff9d7fff700 1 -- 172.21.15.100:0/676015535 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7ff9c0068fc0 msgr2=0x7ff9c006b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:21.765 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.767+0000 7ff9d7fff700 1 --2- 172.21.15.100:0/676015535 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7ff9c0068fc0 0x7ff9c006b470 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff9c800b0d0 tx=0x7ff9c8009e30 comp rx=0 tx=0).stop 2023-12-05T09:55:21.765 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.767+0000 7ff9d7fff700 1 -- 172.21.15.100:0/676015535 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9d80fdc00 msgr2=0x7ff9d810f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:21.765 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.767+0000 7ff9d7fff700 1 --2- 172.21.15.100:0/676015535 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9d80fdc00 0x7ff9d810f9b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc00eb40 tx=0x7ff9cc00b040 comp rx=0 tx=0).stop 2023-12-05T09:55:21.765 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.767+0000 7ff9d7fff700 1 -- 172.21.15.100:0/676015535 shutdown_connections 2023-12-05T09:55:21.765 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.767+0000 7ff9d7fff700 1 --2- 172.21.15.100:0/676015535 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7ff9c0068fc0 0x7ff9c006b470 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:21.765 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.767+0000 7ff9d7fff700 1 --2- 172.21.15.100:0/676015535 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9d80fc9f0 0x7ff9d810f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:21.765 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.767+0000 7ff9d7fff700 1 --2- 172.21.15.100:0/676015535 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9d80fdc00 0x7ff9d810f9b0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:21.765 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.767+0000 7ff9d7fff700 1 -- 172.21.15.100:0/676015535 >> 172.21.15.100:0/676015535 conn(0x7ff9d80f8090 msgr2=0x7ff9d80fee20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:55:21.765 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.767+0000 7ff9d7fff700 1 -- 172.21.15.100:0/676015535 shutdown_connections 2023-12-05T09:55:21.766 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.768+0000 7ff9d7fff700 1 -- 172.21.15.100:0/676015535 wait complete. 2023-12-05T09:55:21.929 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.931+0000 7fbe1168c700 1 -- 172.21.15.100:0/3095719557 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe0c0fec60 msgr2=0x7fbe0c0ff070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:21.929 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.931+0000 7fbe1168c700 1 --2- 172.21.15.100:0/3095719557 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe0c0fec60 0x7fbe0c0ff070 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc004940 tx=0x7fbdfc009e30 comp rx=0 tx=0).stop 2023-12-05T09:55:21.929 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.931+0000 7fbe1168c700 1 -- 172.21.15.100:0/3095719557 shutdown_connections 2023-12-05T09:55:21.929 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.931+0000 7fbe1168c700 1 --2- 172.21.15.100:0/3095719557 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe0c0ffe70 0x7fbe0c1002c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:21.929 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.931+0000 7fbe1168c700 1 --2- 172.21.15.100:0/3095719557 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe0c0fec60 0x7fbe0c0ff070 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:21.929 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.931+0000 7fbe1168c700 1 -- 172.21.15.100:0/3095719557 >> 172.21.15.100:0/3095719557 conn(0x7fbe0c0fa410 msgr2=0x7fbe0c0fc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:55:21.929 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.931+0000 7fbe1168c700 1 -- 172.21.15.100:0/3095719557 shutdown_connections 2023-12-05T09:55:21.929 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.931+0000 7fbe1168c700 1 -- 172.21.15.100:0/3095719557 wait complete. 2023-12-05T09:55:21.930 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.932+0000 7fbe1168c700 1 Processor -- start 2023-12-05T09:55:21.930 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.932+0000 7fbe1168c700 1 -- start start 2023-12-05T09:55:21.930 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.933+0000 7fbe1168c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe0c0fec60 0x7fbe0c10f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:55:21.930 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.933+0000 7fbe1168c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe0c0ffe70 0x7fbe0c10fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:55:21.931 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.933+0000 7fbe1168c700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0c110020 con 0x7fbe0c0fec60 2023-12-05T09:55:21.931 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.933+0000 7fbe1168c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0c1108c0 con 0x7fbe0c0ffe70 2023-12-05T09:55:21.931 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.933+0000 7fbe0bfff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe0c0fec60 0x7fbe0c10f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:55:21.931 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.933+0000 7fbe0bfff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe0c0fec60 0x7fbe0c10f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51456/0 (socket says 172.21.15.100:51456) 2023-12-05T09:55:21.931 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.933+0000 7fbe0bfff700 1 -- 172.21.15.100:0/2582918988 learned_addr learned my addr 172.21.15.100:0/2582918988 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:55:21.932 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.933+0000 7fbe0bfff700 1 -- 172.21.15.100:0/2582918988 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe0c0ffe70 msgr2=0x7fbe0c10fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:21.932 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.933+0000 7fbe0bfff700 1 --2- 172.21.15.100:0/2582918988 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe0c0ffe70 0x7fbe0c10fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:21.932 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.933+0000 7fbe0bfff700 1 -- 172.21.15.100:0/2582918988 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdfc005040 con 0x7fbe0c0fec60 2023-12-05T09:55:21.932 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.934+0000 7fbe0bfff700 1 --2- 172.21.15.100:0/2582918988 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe0c0fec60 0x7fbe0c10f4e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc000c00 tx=0x7fbdfc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:55:21.932 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.934+0000 7fbe08ff9700 1 -- 172.21.15.100:0/2582918988 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbdfc00e040 con 0x7fbe0c0fec60 2023-12-05T09:55:21.932 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.934+0000 7fbe08ff9700 1 -- 172.21.15.100:0/2582918988 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbdfc00bc50 con 0x7fbe0c0fec60 2023-12-05T09:55:21.932 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.934+0000 7fbe1168c700 1 -- 172.21.15.100:0/2582918988 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe0c110b40 con 0x7fbe0c0fec60 2023-12-05T09:55:21.932 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.934+0000 7fbe08ff9700 1 -- 172.21.15.100:0/2582918988 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbdfc01c630 con 0x7fbe0c0fec60 2023-12-05T09:55:21.932 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.934+0000 7fbe1168c700 1 -- 172.21.15.100:0/2582918988 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe0c111080 con 0x7fbe0c0fec60 2023-12-05T09:55:21.933 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.935+0000 7fbe1168c700 1 -- 172.21.15.100:0/2582918988 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe0c04bb80 con 0x7fbe0c0fec60 2023-12-05T09:55:21.933 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.936+0000 7fbe08ff9700 1 -- 172.21.15.100:0/2582918988 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7fbdfc013420 con 0x7fbe0c0fec60 2023-12-05T09:55:21.936 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.938+0000 7fbe08ff9700 1 --2- 172.21.15.100:0/2582918988 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fbdf4068f70 0x7fbdf406b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:55:21.936 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.938+0000 7fbe08ff9700 1 -- 172.21.15.100:0/2582918988 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fbdfc0880a0 con 0x7fbe0c0fec60 2023-12-05T09:55:21.936 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.939+0000 7fbe0b7fe700 1 --2- 172.21.15.100:0/2582918988 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fbdf4068f70 0x7fbdf406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:55:21.936 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.939+0000 7fbe0b7fe700 1 --2- 172.21.15.100:0/2582918988 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fbdf4068f70 0x7fbdf406b420 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbe00009b80 tx=0x7fbe00009d60 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:55:21.939 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:21.941+0000 7fbe08ff9700 1 -- 172.21.15.100:0/2582918988 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fbdfc057fb0 con 0x7fbe0c0fec60 2023-12-05T09:55:22.312 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:22.314+0000 7fbe1168c700 1 -- 172.21.15.100:0/2582918988 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fbe0c111740 con 0x7fbe0c0fec60 2023-12-05T09:55:22.312 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:22.315+0000 7fbe08ff9700 1 -- 172.21.15.100:0/2582918988 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fbdfc05d030 con 0x7fbe0c0fec60 2023-12-05T09:55:22.312 INFO:teuthology.orchestra.run.smithi100.stdout:HEALTH_OK 2023-12-05T09:55:22.316 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:22.318+0000 7fbe1168c700 1 -- 172.21.15.100:0/2582918988 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fbdf4068f70 msgr2=0x7fbdf406b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:22.316 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:22.318+0000 7fbe1168c700 1 --2- 172.21.15.100:0/2582918988 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fbdf4068f70 0x7fbdf406b420 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbe00009b80 tx=0x7fbe00009d60 comp rx=0 tx=0).stop 2023-12-05T09:55:22.316 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:22.318+0000 7fbe1168c700 1 -- 172.21.15.100:0/2582918988 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe0c0fec60 msgr2=0x7fbe0c10f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:22.316 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:22.318+0000 7fbe1168c700 1 --2- 172.21.15.100:0/2582918988 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe0c0fec60 0x7fbe0c10f4e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc000c00 tx=0x7fbdfc009e30 comp rx=0 tx=0).stop 2023-12-05T09:55:22.316 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:22.318+0000 7fbe1168c700 1 -- 172.21.15.100:0/2582918988 shutdown_connections 2023-12-05T09:55:22.316 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:22.318+0000 7fbe1168c700 1 --2- 172.21.15.100:0/2582918988 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fbdf4068f70 0x7fbdf406b420 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:22.316 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:22.318+0000 7fbe1168c700 1 --2- 172.21.15.100:0/2582918988 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe0c0fec60 0x7fbe0c10f4e0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:22.316 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:22.318+0000 7fbe1168c700 1 --2- 172.21.15.100:0/2582918988 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe0c0ffe70 0x7fbe0c10fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:22.316 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:22.318+0000 7fbe1168c700 1 -- 172.21.15.100:0/2582918988 >> 172.21.15.100:0/2582918988 conn(0x7fbe0c0fa410 msgr2=0x7fbe0c1030a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:55:22.316 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:22.318+0000 7fbe1168c700 1 -- 172.21.15.100:0/2582918988 shutdown_connections 2023-12-05T09:55:22.317 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:22.318+0000 7fbe1168c700 1 -- 172.21.15.100:0/2582918988 wait complete. 2023-12-05T09:55:22.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:55:21 smithi150 ceph-mon[116142]: pgmap v179: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2023-12-05T09:55:22.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:55:21 smithi150 ceph-mon[116142]: from='client.14578 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:55:22.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:55:21 smithi150 ceph-mon[116142]: from='client.? 172.21.15.100:0/3250866650' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-05T09:55:22.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:55:21 smithi100 ceph-mon[107145]: pgmap v179: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2023-12-05T09:55:22.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:55:21 smithi100 ceph-mon[107145]: from='client.14578 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:55:22.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:55:21 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/3250866650' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-05T09:55:23.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:55:22 smithi150 ceph-mon[116142]: from='client.14590 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:55:23.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:55:22 smithi150 ceph-mon[116142]: from='client.? 172.21.15.100:0/2582918988' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-05T09:55:23.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:55:22 smithi100 ceph-mon[107145]: from='client.14590 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:55:23.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:55:22 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/2582918988' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-05T09:55:24.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:55:23 smithi150 ceph-mon[116142]: pgmap v180: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-05T09:55:24.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:55:23 smithi100 ceph-mon[107145]: pgmap v180: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-05T09:55:26.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:55:25 smithi150 ceph-mon[116142]: pgmap v181: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-05T09:55:26.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:55:25 smithi100 ceph-mon[107145]: pgmap v181: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-05T09:55:28.345 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:55:27 smithi150 ceph-mon[116142]: pgmap v182: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:55:28.397 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:55:27 smithi100 ceph-mon[107145]: pgmap v182: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:55:30.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:55:29 smithi150 ceph-mon[116142]: pgmap v183: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:55:30.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:55:29 smithi100 ceph-mon[107145]: pgmap v183: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:55:31.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:55:30 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:55:31.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:55:30 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:55:32.345 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:55:31 smithi150 ceph-mon[116142]: pgmap v184: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:55:32.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:55:31 smithi100 ceph-mon[107145]: pgmap v184: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:55:34.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:55:33 smithi150 ceph-mon[116142]: pgmap v185: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:55:34.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:55:33 smithi100 ceph-mon[107145]: pgmap v185: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:55:35.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:55:34 smithi150 ceph-mon[116142]: pgmap v186: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:55:35.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:55:34 smithi100 ceph-mon[107145]: pgmap v186: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:55:37.595 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:55:37 smithi150 ceph-mon[116142]: pgmap v187: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:55:37.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:55:37 smithi100 ceph-mon[107145]: pgmap v187: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:55:39.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:55:39 smithi150 ceph-mon[116142]: pgmap v188: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:55:39.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:55:39 smithi100 ceph-mon[107145]: pgmap v188: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:55:41.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:55:41 smithi150 ceph-mon[116142]: pgmap v189: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-05T09:55:41.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:55:41 smithi100 ceph-mon[107145]: pgmap v189: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-05T09:55:43.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:55:43 smithi150 ceph-mon[116142]: pgmap v190: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-05T09:55:43.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:55:43 smithi100 ceph-mon[107145]: pgmap v190: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-05T09:55:45.698 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:55:45 smithi150 ceph-mon[116142]: pgmap v191: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-05T09:55:45.699 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:55:45 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:55:45.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:55:45 smithi100 ceph-mon[107145]: pgmap v191: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-05T09:55:45.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:55:45 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:55:47.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:55:47 smithi100 ceph-mon[107145]: pgmap v192: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-05T09:55:47.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:55:47 smithi150 ceph-mon[116142]: pgmap v192: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-05T09:55:49.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:55:48 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:55:49.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:55:48 smithi150 ceph-mon[116142]: Upgrade: Target is version 19.0.0-11-g3fe8d441 (unknown) 2023-12-05T09:55:49.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:55:48 smithi150 ceph-mon[116142]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:ff918c95653912ae4c171d8d1db5f5eabc756f85ff7e3ce78f13f9c521198459, digests ['quay.ceph.io/ceph-ci/ceph@sha256:ff918c95653912ae4c171d8d1db5f5eabc756f85ff7e3ce78f13f9c521198459'] 2023-12-05T09:55:49.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:55:48 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:55:49.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:55:48 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:55:49.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:55:48 smithi150 ceph-mon[116142]: Upgrade: Need to upgrade myself (mgr.smithi100.ehmuhg) 2023-12-05T09:55:49.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:55:48 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:55:49.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:55:48 smithi100 ceph-mon[107145]: Upgrade: Target is version 19.0.0-11-g3fe8d441 (unknown) 2023-12-05T09:55:49.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:55:48 smithi100 ceph-mon[107145]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:ff918c95653912ae4c171d8d1db5f5eabc756f85ff7e3ce78f13f9c521198459, digests ['quay.ceph.io/ceph-ci/ceph@sha256:ff918c95653912ae4c171d8d1db5f5eabc756f85ff7e3ce78f13f9c521198459'] 2023-12-05T09:55:49.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:55:48 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:55:49.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:55:48 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:55:49.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:55:48 smithi100 ceph-mon[107145]: Upgrade: Need to upgrade myself (mgr.smithi100.ehmuhg) 2023-12-05T09:55:50.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:55:49 smithi150 ceph-mon[116142]: pgmap v193: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-05T09:55:50.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:55:49 smithi150 ceph-mon[116142]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:ff918c95653912ae4c171d8d1db5f5eabc756f85ff7e3ce78f13f9c521198459 on smithi150 2023-12-05T09:55:50.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:55:49 smithi100 ceph-mon[107145]: pgmap v193: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-05T09:55:50.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:55:49 smithi100 ceph-mon[107145]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:ff918c95653912ae4c171d8d1db5f5eabc756f85ff7e3ce78f13f9c521198459 on smithi150 2023-12-05T09:55:52.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:55:51 smithi150 ceph-mon[116142]: pgmap v194: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-05T09:55:52.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:55:51 smithi100 ceph-mon[107145]: pgmap v194: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-05T09:55:52.491 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.493+0000 7f046bf1d700 1 -- 172.21.15.100:0/674849215 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f04640fcbf0 msgr2=0x7f04640fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:52.491 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.493+0000 7f046bf1d700 1 --2- 172.21.15.100:0/674849215 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f04640fcbf0 0x7f04640fd000 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f0460004940 tx=0x7f0460009e30 comp rx=0 tx=0).stop 2023-12-05T09:55:52.491 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.493+0000 7f046bf1d700 1 -- 172.21.15.100:0/674849215 shutdown_connections 2023-12-05T09:55:52.491 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.493+0000 7f046bf1d700 1 --2- 172.21.15.100:0/674849215 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04640fde00 0x7f04640fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:52.491 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.493+0000 7f046bf1d700 1 --2- 172.21.15.100:0/674849215 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f04640fcbf0 0x7f04640fd000 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:52.491 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.493+0000 7f046bf1d700 1 -- 172.21.15.100:0/674849215 >> 172.21.15.100:0/674849215 conn(0x7f04640f82d0 msgr2=0x7f04640fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:55:52.491 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.493+0000 7f046bf1d700 1 -- 172.21.15.100:0/674849215 shutdown_connections 2023-12-05T09:55:52.491 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.493+0000 7f046bf1d700 1 -- 172.21.15.100:0/674849215 wait complete. 2023-12-05T09:55:52.492 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.494+0000 7f046bf1d700 1 Processor -- start 2023-12-05T09:55:52.492 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.494+0000 7f046bf1d700 1 -- start start 2023-12-05T09:55:52.492 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.495+0000 7f046bf1d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04640fcbf0 0x7f046410d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:55:52.492 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.495+0000 7f046bf1d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f04640fde00 0x7f046410da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:55:52.492 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.495+0000 7f046bf1d700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f046410e010 con 0x7f04640fde00 2023-12-05T09:55:52.492 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.495+0000 7f046bf1d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f046410e8b0 con 0x7f04640fcbf0 2023-12-05T09:55:52.493 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.495+0000 7f0469cb9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04640fcbf0 0x7f046410d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:55:52.493 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.495+0000 7f0469cb9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04640fcbf0 0x7f046410d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.100:57240/0 (socket says 172.21.15.100:57240) 2023-12-05T09:55:52.493 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.495+0000 7f0469cb9700 1 -- 172.21.15.100:0/2098278429 learned_addr learned my addr 172.21.15.100:0/2098278429 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:55:52.493 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.495+0000 7f04694b8700 1 --2- 172.21.15.100:0/2098278429 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f04640fde00 0x7f046410da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:55:52.493 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.496+0000 7f0469cb9700 1 -- 172.21.15.100:0/2098278429 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f04640fde00 msgr2=0x7f046410da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:52.493 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.496+0000 7f0469cb9700 1 --2- 172.21.15.100:0/2098278429 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f04640fde00 0x7f046410da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:52.493 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.496+0000 7f0469cb9700 1 -- 172.21.15.100:0/2098278429 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0460005040 con 0x7f04640fcbf0 2023-12-05T09:55:52.494 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.496+0000 7f0469cb9700 1 --2- 172.21.15.100:0/2098278429 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04640fcbf0 0x7f046410d4d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0460009fd0 tx=0x7f0460009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:55:52.494 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.496+0000 7f045a7fc700 1 -- 172.21.15.100:0/2098278429 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0460021070 con 0x7f04640fcbf0 2023-12-05T09:55:52.494 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.496+0000 7f045a7fc700 1 -- 172.21.15.100:0/2098278429 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f046001c400 con 0x7f04640fcbf0 2023-12-05T09:55:52.494 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.496+0000 7f046bf1d700 1 -- 172.21.15.100:0/2098278429 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f046410eb30 con 0x7f04640fcbf0 2023-12-05T09:55:52.494 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.496+0000 7f045a7fc700 1 -- 172.21.15.100:0/2098278429 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f046000e070 con 0x7f04640fcbf0 2023-12-05T09:55:52.494 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.497+0000 7f046bf1d700 1 -- 172.21.15.100:0/2098278429 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f046410f070 con 0x7f04640fcbf0 2023-12-05T09:55:52.495 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.498+0000 7f046bf1d700 1 -- 172.21.15.100:0/2098278429 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f046404bb80 con 0x7f04640fcbf0 2023-12-05T09:55:52.497 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.500+0000 7f045a7fc700 1 -- 172.21.15.100:0/2098278429 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f046001c9c0 con 0x7f04640fcbf0 2023-12-05T09:55:52.498 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.500+0000 7f045a7fc700 1 --2- 172.21.15.100:0/2098278429 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f0450068f70 0x7f045006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:55:52.498 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.501+0000 7f045a7fc700 1 -- 172.21.15.100:0/2098278429 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f0460087ff0 con 0x7f04640fcbf0 2023-12-05T09:55:52.498 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.501+0000 7f04694b8700 1 --2- 172.21.15.100:0/2098278429 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f0450068f70 0x7f045006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:55:52.499 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.502+0000 7f04694b8700 1 --2- 172.21.15.100:0/2098278429 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f0450068f70 0x7f045006b420 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0454009b80 tx=0x7f045400b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:55:52.507 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.509+0000 7f045a7fc700 1 -- 172.21.15.100:0/2098278429 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f0460057f20 con 0x7f04640fcbf0 2023-12-05T09:55:52.770 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.773+0000 7f046bf1d700 1 -- 172.21.15.100:0/2098278429 --> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0464102750 con 0x7f0450068f70 2023-12-05T09:55:52.771 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.774+0000 7f045a7fc700 1 -- 172.21.15.100:0/2098278429 <== mgr.14210 v2:172.21.15.100:6800/1237547575 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f0464102750 con 0x7f0450068f70 2023-12-05T09:55:52.775 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.778+0000 7f046bf1d700 1 -- 172.21.15.100:0/2098278429 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f0450068f70 msgr2=0x7f045006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:52.775 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.778+0000 7f046bf1d700 1 --2- 172.21.15.100:0/2098278429 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f0450068f70 0x7f045006b420 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0454009b80 tx=0x7f045400b040 comp rx=0 tx=0).stop 2023-12-05T09:55:52.776 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.778+0000 7f046bf1d700 1 -- 172.21.15.100:0/2098278429 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04640fcbf0 msgr2=0x7f046410d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:52.776 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.778+0000 7f046bf1d700 1 --2- 172.21.15.100:0/2098278429 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04640fcbf0 0x7f046410d4d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0460009fd0 tx=0x7f0460009e30 comp rx=0 tx=0).stop 2023-12-05T09:55:52.776 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.778+0000 7f046bf1d700 1 -- 172.21.15.100:0/2098278429 shutdown_connections 2023-12-05T09:55:52.776 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.778+0000 7f046bf1d700 1 --2- 172.21.15.100:0/2098278429 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f0450068f70 0x7f045006b420 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:52.776 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.778+0000 7f046bf1d700 1 --2- 172.21.15.100:0/2098278429 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04640fcbf0 0x7f046410d4d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:52.776 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.778+0000 7f046bf1d700 1 --2- 172.21.15.100:0/2098278429 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f04640fde00 0x7f046410da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:52.776 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.778+0000 7f046bf1d700 1 -- 172.21.15.100:0/2098278429 >> 172.21.15.100:0/2098278429 conn(0x7f04640f82d0 msgr2=0x7f0464101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:55:52.776 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.778+0000 7f046bf1d700 1 -- 172.21.15.100:0/2098278429 shutdown_connections 2023-12-05T09:55:52.776 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.778+0000 7f046bf1d700 1 -- 172.21.15.100:0/2098278429 wait complete. 2023-12-05T09:55:52.791 INFO:teuthology.orchestra.run.smithi100.stdout:true 2023-12-05T09:55:52.927 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.929+0000 7f34dafa9700 1 -- 172.21.15.100:0/1677088226 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34d40fff70 msgr2=0x7f34d41003e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:52.927 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.929+0000 7f34dafa9700 1 --2- 172.21.15.100:0/1677088226 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34d40fff70 0x7f34d41003e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f34c0004940 tx=0x7f34c0009e30 comp rx=0 tx=0).stop 2023-12-05T09:55:52.927 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.929+0000 7f34dafa9700 1 -- 172.21.15.100:0/1677088226 shutdown_connections 2023-12-05T09:55:52.928 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.929+0000 7f34dafa9700 1 --2- 172.21.15.100:0/1677088226 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34d40fff70 0x7f34d41003e0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:52.928 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.929+0000 7f34dafa9700 1 --2- 172.21.15.100:0/1677088226 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f34d40fee00 0x7f34d40ff210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:52.928 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.929+0000 7f34dafa9700 1 -- 172.21.15.100:0/1677088226 >> 172.21.15.100:0/1677088226 conn(0x7f34d40fa5d0 msgr2=0x7f34d40fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:55:52.928 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.930+0000 7f34dafa9700 1 -- 172.21.15.100:0/1677088226 shutdown_connections 2023-12-05T09:55:52.928 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.930+0000 7f34dafa9700 1 -- 172.21.15.100:0/1677088226 wait complete. 2023-12-05T09:55:52.928 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.930+0000 7f34dafa9700 1 Processor -- start 2023-12-05T09:55:52.929 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.931+0000 7f34dafa9700 1 -- start start 2023-12-05T09:55:52.929 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.931+0000 7f34dafa9700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34d40fee00 0x7f34d410f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:55:52.929 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.931+0000 7f34dafa9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f34d40fff70 0x7f34d410fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:55:52.929 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.931+0000 7f34dafa9700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d4110250 con 0x7f34d40fee00 2023-12-05T09:55:52.929 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.931+0000 7f34dafa9700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d4110af0 con 0x7f34d40fff70 2023-12-05T09:55:52.929 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.931+0000 7f34d8d45700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34d40fee00 0x7f34d410f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:55:52.930 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.931+0000 7f34d3fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f34d40fff70 0x7f34d410fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:55:52.930 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.931+0000 7f34d3fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f34d40fff70 0x7f34d410fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.100:57256/0 (socket says 172.21.15.100:57256) 2023-12-05T09:55:52.930 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.931+0000 7f34d3fff700 1 -- 172.21.15.100:0/3913992462 learned_addr learned my addr 172.21.15.100:0/3913992462 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:55:52.930 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.932+0000 7f34d8d45700 1 -- 172.21.15.100:0/3913992462 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f34d40fff70 msgr2=0x7f34d410fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:52.930 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.932+0000 7f34d8d45700 1 --2- 172.21.15.100:0/3913992462 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f34d40fff70 0x7f34d410fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:52.930 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.932+0000 7f34d8d45700 1 -- 172.21.15.100:0/3913992462 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34c0005040 con 0x7f34d40fee00 2023-12-05T09:55:52.930 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.932+0000 7f34d3fff700 1 --2- 172.21.15.100:0/3913992462 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f34d40fff70 0x7f34d410fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-05T09:55:52.930 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.932+0000 7f34d8d45700 1 --2- 172.21.15.100:0/3913992462 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34d40fee00 0x7f34d410f710 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f34c8009fd0 tx=0x7f34c800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:55:52.931 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.932+0000 7f34d17fa700 1 -- 172.21.15.100:0/3913992462 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34c8004e90 con 0x7f34d40fee00 2023-12-05T09:55:52.931 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.933+0000 7f34d17fa700 1 -- 172.21.15.100:0/3913992462 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f34c800f040 con 0x7f34d40fee00 2023-12-05T09:55:52.931 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.933+0000 7f34dafa9700 1 -- 172.21.15.100:0/3913992462 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34d4110d70 con 0x7f34d40fee00 2023-12-05T09:55:52.931 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.933+0000 7f34dafa9700 1 -- 172.21.15.100:0/3913992462 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34d41112b0 con 0x7f34d40fee00 2023-12-05T09:55:52.931 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.933+0000 7f34d17fa700 1 -- 172.21.15.100:0/3913992462 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34c800c9b0 con 0x7f34d40fee00 2023-12-05T09:55:52.931 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.934+0000 7f34dafa9700 1 -- 172.21.15.100:0/3913992462 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34d404bb80 con 0x7f34d40fee00 2023-12-05T09:55:52.933 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.936+0000 7f34d17fa700 1 -- 172.21.15.100:0/3913992462 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f34c8007cc0 con 0x7f34d40fee00 2023-12-05T09:55:52.934 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.937+0000 7f34d17fa700 1 --2- 172.21.15.100:0/3913992462 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f34c4068f70 0x7f34c406b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:55:52.934 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.937+0000 7f34d17fa700 1 -- 172.21.15.100:0/3913992462 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f34c8086780 con 0x7f34d40fee00 2023-12-05T09:55:52.935 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.937+0000 7f34d3fff700 1 --2- 172.21.15.100:0/3913992462 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f34c4068f70 0x7f34c406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:55:52.935 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.938+0000 7f34d3fff700 1 --2- 172.21.15.100:0/3913992462 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f34c4068f70 0x7f34c406b420 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f34c000b0d0 tx=0x7f34c0009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:55:52.941 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:52.941+0000 7f34d17fa700 1 -- 172.21.15.100:0/3913992462 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f34c804da00 con 0x7f34d40fee00 2023-12-05T09:55:53.230 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.233+0000 7f34dafa9700 1 -- 172.21.15.100:0/3913992462 --> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f34d4111800 con 0x7f34c4068f70 2023-12-05T09:55:53.232 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.234+0000 7f34d17fa700 1 -- 172.21.15.100:0/3913992462 <== mgr.14210 v2:172.21.15.100:6800/1237547575 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f34d4111800 con 0x7f34c4068f70 2023-12-05T09:55:53.235 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.238+0000 7f34dafa9700 1 -- 172.21.15.100:0/3913992462 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f34c4068f70 msgr2=0x7f34c406b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:53.236 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.238+0000 7f34dafa9700 1 --2- 172.21.15.100:0/3913992462 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f34c4068f70 0x7f34c406b420 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f34c000b0d0 tx=0x7f34c0009e30 comp rx=0 tx=0).stop 2023-12-05T09:55:53.236 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.238+0000 7f34dafa9700 1 -- 172.21.15.100:0/3913992462 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34d40fee00 msgr2=0x7f34d410f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:53.236 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.238+0000 7f34dafa9700 1 --2- 172.21.15.100:0/3913992462 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34d40fee00 0x7f34d410f710 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f34c8009fd0 tx=0x7f34c800b040 comp rx=0 tx=0).stop 2023-12-05T09:55:53.236 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.238+0000 7f34dafa9700 1 -- 172.21.15.100:0/3913992462 shutdown_connections 2023-12-05T09:55:53.236 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.238+0000 7f34dafa9700 1 --2- 172.21.15.100:0/3913992462 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f34c4068f70 0x7f34c406b420 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:53.236 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.238+0000 7f34dafa9700 1 --2- 172.21.15.100:0/3913992462 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34d40fee00 0x7f34d410f710 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:53.236 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.238+0000 7f34dafa9700 1 --2- 172.21.15.100:0/3913992462 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f34d40fff70 0x7f34d410fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:53.236 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.238+0000 7f34dafa9700 1 -- 172.21.15.100:0/3913992462 >> 172.21.15.100:0/3913992462 conn(0x7f34d40fa5d0 msgr2=0x7f34d4103230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:55:53.236 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.238+0000 7f34dafa9700 1 -- 172.21.15.100:0/3913992462 shutdown_connections 2023-12-05T09:55:53.236 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.238+0000 7f34dafa9700 1 -- 172.21.15.100:0/3913992462 wait complete. 2023-12-05T09:55:53.406 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.408+0000 7f91c7fff700 1 -- 172.21.15.100:0/3868538722 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91c80fcb00 msgr2=0x7f91c80fcf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:53.406 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.408+0000 7f91c7fff700 1 --2- 172.21.15.100:0/3868538722 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91c80fcb00 0x7f91c80fcf50 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f91bc004940 tx=0x7f91bc009e30 comp rx=0 tx=0).stop 2023-12-05T09:55:53.407 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.409+0000 7f91c7fff700 1 -- 172.21.15.100:0/3868538722 shutdown_connections 2023-12-05T09:55:53.407 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.409+0000 7f91c7fff700 1 --2- 172.21.15.100:0/3868538722 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91c80fcb00 0x7f91c80fcf50 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:53.407 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.409+0000 7f91c7fff700 1 --2- 172.21.15.100:0/3868538722 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91c80fb8f0 0x7f91c80fbd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:53.407 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.409+0000 7f91c7fff700 1 -- 172.21.15.100:0/3868538722 >> 172.21.15.100:0/3868538722 conn(0x7f91c80f6f70 msgr2=0x7f91c80f93e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:55:53.407 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.409+0000 7f91c7fff700 1 -- 172.21.15.100:0/3868538722 shutdown_connections 2023-12-05T09:55:53.407 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.409+0000 7f91c7fff700 1 -- 172.21.15.100:0/3868538722 wait complete. 2023-12-05T09:55:53.407 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.410+0000 7f91c7fff700 1 Processor -- start 2023-12-05T09:55:53.408 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.410+0000 7f91c7fff700 1 -- start start 2023-12-05T09:55:53.409 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.410+0000 7f91c7fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91c80fb8f0 0x7f91c810f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:55:53.409 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.411+0000 7f91c7fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91c80fcb00 0x7f91c810f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:55:53.409 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.411+0000 7f91c7fff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c810ffc0 con 0x7f91c80fb8f0 2023-12-05T09:55:53.409 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.411+0000 7f91c7fff700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c8110860 con 0x7f91c80fcb00 2023-12-05T09:55:53.409 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.411+0000 7f91c6ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91c80fb8f0 0x7f91c810f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:55:53.409 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.411+0000 7f91c6ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91c80fb8f0 0x7f91c810f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49970/0 (socket says 172.21.15.100:49970) 2023-12-05T09:55:53.409 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.411+0000 7f91c6ffd700 1 -- 172.21.15.100:0/2515851882 learned_addr learned my addr 172.21.15.100:0/2515851882 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:55:53.410 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.412+0000 7f91c6ffd700 1 -- 172.21.15.100:0/2515851882 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91c80fcb00 msgr2=0x7f91c810f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:53.410 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.412+0000 7f91c6ffd700 1 --2- 172.21.15.100:0/2515851882 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91c80fcb00 0x7f91c810f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:53.410 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.412+0000 7f91c6ffd700 1 -- 172.21.15.100:0/2515851882 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91bc005040 con 0x7f91c80fb8f0 2023-12-05T09:55:53.410 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.412+0000 7f91c6ffd700 1 --2- 172.21.15.100:0/2515851882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91c80fb8f0 0x7f91c810f480 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f91b8004fd0 tx=0x7f91b800d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:55:53.410 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.412+0000 7f91af7fe700 1 -- 172.21.15.100:0/2515851882 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91b8010040 con 0x7f91c80fb8f0 2023-12-05T09:55:53.410 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.412+0000 7f91af7fe700 1 -- 172.21.15.100:0/2515851882 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f91b800edf0 con 0x7f91c80fb8f0 2023-12-05T09:55:53.411 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.412+0000 7f91af7fe700 1 -- 172.21.15.100:0/2515851882 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91b8014400 con 0x7f91c80fb8f0 2023-12-05T09:55:53.411 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.412+0000 7f91c7fff700 1 -- 172.21.15.100:0/2515851882 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91c8110a60 con 0x7f91c80fb8f0 2023-12-05T09:55:53.411 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.412+0000 7f91c7fff700 1 -- 172.21.15.100:0/2515851882 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91c8111020 con 0x7f91c80fb8f0 2023-12-05T09:55:53.411 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.414+0000 7f91c7fff700 1 -- 172.21.15.100:0/2515851882 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91c804bb80 con 0x7f91c80fb8f0 2023-12-05T09:55:53.413 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.415+0000 7f91af7fe700 1 -- 172.21.15.100:0/2515851882 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f91b800e940 con 0x7f91c80fb8f0 2023-12-05T09:55:53.414 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.417+0000 7f91af7fe700 1 --2- 172.21.15.100:0/2515851882 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f91b0068f70 0x7f91b006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:55:53.414 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.417+0000 7f91af7fe700 1 -- 172.21.15.100:0/2515851882 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f91b8086a70 con 0x7f91c80fb8f0 2023-12-05T09:55:53.415 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.417+0000 7f91c67fc700 1 --2- 172.21.15.100:0/2515851882 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f91b0068f70 0x7f91b006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:55:53.415 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.418+0000 7f91c67fc700 1 --2- 172.21.15.100:0/2515851882 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f91b0068f70 0x7f91b006b420 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f91bc00b0d0 tx=0x7f91bc009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:55:53.423 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.425+0000 7f91af7fe700 1 -- 172.21.15.100:0/2515851882 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f91b804da00 con 0x7f91c80fb8f0 2023-12-05T09:55:53.670 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.672+0000 7f91c7fff700 1 -- 172.21.15.100:0/2515851882 --> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f91c8101450 con 0x7f91b0068f70 2023-12-05T09:55:53.687 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.689+0000 7f91af7fe700 1 -- 172.21.15.100:0/2515851882 <== mgr.14210 v2:172.21.15.100:6800/1237547575 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7f91c8101450 con 0x7f91b0068f70 2023-12-05T09:55:53.687 INFO:teuthology.orchestra.run.smithi100.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-05T09:55:53.687 INFO:teuthology.orchestra.run.smithi100.stdout:alertmanager.smithi100 smithi100 *:9093,9094 running (4m) 60s ago 5m 14.4M - 0.25.0 c8568f914cd2 836425c83df9 2023-12-05T09:55:53.687 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi100 smithi100 running (6m) 60s ago 6m 7822k - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 6379a3185d48 2023-12-05T09:55:53.687 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi150 smithi150 running (5m) 64s ago 5m 7826k - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 349d37092dbd 2023-12-05T09:55:53.687 INFO:teuthology.orchestra.run.smithi100.stdout:grafana.smithi100 smithi100 *:3000 running (4m) 60s ago 5m 78.5M - 9.4.7 2c41d148cca3 53cd204a480d 2023-12-05T09:55:53.687 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.akmstb smithi100 running (75s) 60s ago 74s 14.6M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 6ce55c42c55b 2023-12-05T09:55:53.687 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.sqplhn smithi100 running (80s) 60s ago 80s 12.3M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc c2682d65f0c9 2023-12-05T09:55:53.687 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi150.fcnhsv smithi150 running (72s) 64s ago 72s 11.9M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 1a259762235d 2023-12-05T09:55:53.687 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi150.pcbpxm smithi150 running (78s) 64s ago 77s 12.0M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 27f730f8b9f9 2023-12-05T09:55:53.687 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi100.ehmuhg smithi100 *:9283 running (7m) 60s ago 7m 501M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc a724d569b69c 2023-12-05T09:55:53.688 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi150.zkskag smithi150 *:8443,9283 running (5m) 64s ago 5m 442M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc e9131b921eac 2023-12-05T09:55:53.688 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi100 smithi100 running (7m) 60s ago 7m 75.4M 2048M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 8e091d6081cc 2023-12-05T09:55:53.688 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi150 smithi150 running (5m) 64s ago 5m 47.8M 2048M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 05fe70420b09 2023-12-05T09:55:53.688 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi100 smithi100 *:9100 running (6m) 60s ago 6m 8904k - 1.5.0 0da6a335fe13 14c9b3344a5a 2023-12-05T09:55:53.688 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi150 smithi150 *:9100 running (5m) 64s ago 5m 8715k - 1.5.0 0da6a335fe13 d3babc3b947c 2023-12-05T09:55:53.688 INFO:teuthology.orchestra.run.smithi100.stdout:osd.0 smithi100 running (4m) 60s ago 4m 56.0M 4349M 17.2.7-109-g1fd3ca3c e139fc5fd9fc c8e64a62cd47 2023-12-05T09:55:53.688 INFO:teuthology.orchestra.run.smithi100.stdout:osd.1 smithi100 running (3m) 60s ago 3m 59.8M 4349M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 0500895cdfc2 2023-12-05T09:55:53.688 INFO:teuthology.orchestra.run.smithi100.stdout:osd.2 smithi100 running (3m) 60s ago 3m 53.3M 4349M 17.2.7-109-g1fd3ca3c e139fc5fd9fc f145372c8ccc 2023-12-05T09:55:53.688 INFO:teuthology.orchestra.run.smithi100.stdout:osd.3 smithi150 running (3m) 64s ago 3m 54.2M 5373M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 78137d463d29 2023-12-05T09:55:53.688 INFO:teuthology.orchestra.run.smithi100.stdout:osd.4 smithi150 running (2m) 64s ago 2m 49.5M 5373M 17.2.7-109-g1fd3ca3c e139fc5fd9fc dfef9accd162 2023-12-05T09:55:53.688 INFO:teuthology.orchestra.run.smithi100.stdout:osd.5 smithi150 running (2m) 64s ago 2m 50.9M 5373M 17.2.7-109-g1fd3ca3c e139fc5fd9fc d9720b1eae0c 2023-12-05T09:55:53.688 INFO:teuthology.orchestra.run.smithi100.stdout:prometheus.smithi100 smithi100 *:9095 running (4m) 60s ago 5m 43.0M - 2.43.0 a07b618ecd1d 74a355bfd7ab 2023-12-05T09:55:53.690 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.692+0000 7f91c7fff700 1 -- 172.21.15.100:0/2515851882 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f91b0068f70 msgr2=0x7f91b006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:53.690 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.692+0000 7f91c7fff700 1 --2- 172.21.15.100:0/2515851882 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f91b0068f70 0x7f91b006b420 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f91bc00b0d0 tx=0x7f91bc009e30 comp rx=0 tx=0).stop 2023-12-05T09:55:53.690 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.692+0000 7f91c7fff700 1 -- 172.21.15.100:0/2515851882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91c80fb8f0 msgr2=0x7f91c810f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:53.691 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.692+0000 7f91c7fff700 1 --2- 172.21.15.100:0/2515851882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91c80fb8f0 0x7f91c810f480 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f91b8004fd0 tx=0x7f91b800d040 comp rx=0 tx=0).stop 2023-12-05T09:55:53.691 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.693+0000 7f91c7fff700 1 -- 172.21.15.100:0/2515851882 shutdown_connections 2023-12-05T09:55:53.691 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.693+0000 7f91c7fff700 1 --2- 172.21.15.100:0/2515851882 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f91b0068f70 0x7f91b006b420 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:53.691 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.693+0000 7f91c7fff700 1 --2- 172.21.15.100:0/2515851882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91c80fb8f0 0x7f91c810f480 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:53.691 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.693+0000 7f91c7fff700 1 --2- 172.21.15.100:0/2515851882 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91c80fcb00 0x7f91c810f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:53.691 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.693+0000 7f91c7fff700 1 -- 172.21.15.100:0/2515851882 >> 172.21.15.100:0/2515851882 conn(0x7f91c80f6f70 msgr2=0x7f91c80ffd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:55:53.691 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.693+0000 7f91c7fff700 1 -- 172.21.15.100:0/2515851882 shutdown_connections 2023-12-05T09:55:53.691 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.693+0000 7f91c7fff700 1 -- 172.21.15.100:0/2515851882 wait complete. 2023-12-05T09:55:53.885 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.887+0000 7f396bfff700 1 -- 172.21.15.100:0/3898400015 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f396c0ffe50 msgr2=0x7f396c102230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:53.885 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.887+0000 7f396bfff700 1 --2- 172.21.15.100:0/3898400015 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f396c0ffe50 0x7f396c102230 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f3960004940 tx=0x7f3960009e30 comp rx=0 tx=0).stop 2023-12-05T09:55:53.885 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.887+0000 7f396bfff700 1 -- 172.21.15.100:0/3898400015 shutdown_connections 2023-12-05T09:55:53.885 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.887+0000 7f396bfff700 1 --2- 172.21.15.100:0/3898400015 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f396c0ffe50 0x7f396c102230 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:53.886 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.887+0000 7f396bfff700 1 --2- 172.21.15.100:0/3898400015 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f396c0fd530 0x7f396c0ff910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:53.886 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.887+0000 7f396bfff700 1 -- 172.21.15.100:0/3898400015 >> 172.21.15.100:0/3898400015 conn(0x7f396c0f6f70 msgr2=0x7f396c0f93e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:55:53.886 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.888+0000 7f396bfff700 1 -- 172.21.15.100:0/3898400015 shutdown_connections 2023-12-05T09:55:53.886 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.888+0000 7f396bfff700 1 -- 172.21.15.100:0/3898400015 wait complete. 2023-12-05T09:55:53.886 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.889+0000 7f396bfff700 1 Processor -- start 2023-12-05T09:55:53.887 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.889+0000 7f396bfff700 1 -- start start 2023-12-05T09:55:53.887 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.889+0000 7f396bfff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f396c0fd530 0x7f396c10f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:55:53.887 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.889+0000 7f396bfff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f396c0ffe50 0x7f396c10f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:55:53.887 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.889+0000 7f396bfff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f396c10ff90 con 0x7f396c0fd530 2023-12-05T09:55:53.887 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.889+0000 7f396bfff700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f396c110830 con 0x7f396c0ffe50 2023-12-05T09:55:53.887 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.890+0000 7f396a7fc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f396c0ffe50 0x7f396c10f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:55:53.887 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.890+0000 7f396a7fc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f396c0ffe50 0x7f396c10f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.100:57282/0 (socket says 172.21.15.100:57282) 2023-12-05T09:55:53.888 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.890+0000 7f396a7fc700 1 -- 172.21.15.100:0/2410562491 learned_addr learned my addr 172.21.15.100:0/2410562491 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:55:53.888 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.890+0000 7f396affd700 1 --2- 172.21.15.100:0/2410562491 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f396c0fd530 0x7f396c10f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:55:53.888 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.890+0000 7f396a7fc700 1 -- 172.21.15.100:0/2410562491 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f396c0fd530 msgr2=0x7f396c10f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:53.888 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.890+0000 7f396a7fc700 1 --2- 172.21.15.100:0/2410562491 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f396c0fd530 0x7f396c10f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:53.888 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.890+0000 7f396a7fc700 1 -- 172.21.15.100:0/2410562491 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3960005040 con 0x7f396c0ffe50 2023-12-05T09:55:53.889 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.890+0000 7f396a7fc700 1 --2- 172.21.15.100:0/2410562491 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f396c0ffe50 0x7f396c10f990 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3960008f90 tx=0x7f3960009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:55:53.889 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.891+0000 7f39537fe700 1 -- 172.21.15.100:0/2410562491 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3960021070 con 0x7f396c0ffe50 2023-12-05T09:55:53.889 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.891+0000 7f396bfff700 1 -- 172.21.15.100:0/2410562491 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f396c110ab0 con 0x7f396c0ffe50 2023-12-05T09:55:53.889 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.891+0000 7f396bfff700 1 -- 172.21.15.100:0/2410562491 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f396c110ff0 con 0x7f396c0ffe50 2023-12-05T09:55:53.889 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.891+0000 7f39537fe700 1 -- 172.21.15.100:0/2410562491 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3960026410 con 0x7f396c0ffe50 2023-12-05T09:55:53.889 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.891+0000 7f39537fe700 1 -- 172.21.15.100:0/2410562491 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f396000e030 con 0x7f396c0ffe50 2023-12-05T09:55:53.890 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.892+0000 7f396bfff700 1 -- 172.21.15.100:0/2410562491 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39580052e0 con 0x7f396c0ffe50 2023-12-05T09:55:53.891 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.894+0000 7f39537fe700 1 -- 172.21.15.100:0/2410562491 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f3960013a30 con 0x7f396c0ffe50 2023-12-05T09:55:53.892 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.895+0000 7f39537fe700 1 --2- 172.21.15.100:0/2410562491 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f3954068fc0 0x7f395406b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:55:53.892 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.895+0000 7f39537fe700 1 -- 172.21.15.100:0/2410562491 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f39600880f0 con 0x7f396c0ffe50 2023-12-05T09:55:53.892 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.895+0000 7f396affd700 1 --2- 172.21.15.100:0/2410562491 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f3954068fc0 0x7f395406b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:55:53.893 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.896+0000 7f396affd700 1 --2- 172.21.15.100:0/2410562491 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f3954068fc0 0x7f395406b470 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f395c009b80 tx=0x7f395c00b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:55:53.898 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:53.900+0000 7f39537fe700 1 -- 172.21.15.100:0/2410562491 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f3960057f60 con 0x7f396c0ffe50 2023-12-05T09:55:54.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:55:53 smithi150 ceph-mon[116142]: pgmap v195: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-05T09:55:54.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:55:53 smithi150 ceph-mon[116142]: from='client.24397 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:55:54.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:55:53 smithi100 ceph-mon[107145]: pgmap v195: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-05T09:55:54.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:55:53 smithi100 ceph-mon[107145]: from='client.24397 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:55:54.210 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.212+0000 7f396bfff700 1 -- 172.21.15.100:0/2410562491 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3958005da0 con 0x7f396c0ffe50 2023-12-05T09:55:54.210 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.213+0000 7f39537fe700 1 -- 172.21.15.100:0/2410562491 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7f3960057af0 con 0x7f396c0ffe50 2023-12-05T09:55:54.210 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2023-12-05T09:55:54.210 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": { 2023-12-05T09:55:54.210 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 2 2023-12-05T09:55:54.211 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-12-05T09:55:54.211 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": { 2023-12-05T09:55:54.211 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 2 2023-12-05T09:55:54.211 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-12-05T09:55:54.211 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": { 2023-12-05T09:55:54.211 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 6 2023-12-05T09:55:54.211 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-12-05T09:55:54.211 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": { 2023-12-05T09:55:54.211 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 4 2023-12-05T09:55:54.211 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-12-05T09:55:54.211 INFO:teuthology.orchestra.run.smithi100.stdout: "overall": { 2023-12-05T09:55:54.211 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 14 2023-12-05T09:55:54.211 INFO:teuthology.orchestra.run.smithi100.stdout: } 2023-12-05T09:55:54.211 INFO:teuthology.orchestra.run.smithi100.stdout:} 2023-12-05T09:55:54.213 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.215+0000 7f396bfff700 1 -- 172.21.15.100:0/2410562491 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f3954068fc0 msgr2=0x7f395406b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:54.213 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.215+0000 7f396bfff700 1 --2- 172.21.15.100:0/2410562491 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f3954068fc0 0x7f395406b470 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f395c009b80 tx=0x7f395c00b040 comp rx=0 tx=0).stop 2023-12-05T09:55:54.213 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.215+0000 7f396bfff700 1 -- 172.21.15.100:0/2410562491 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f396c0ffe50 msgr2=0x7f396c10f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:54.213 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.215+0000 7f396bfff700 1 --2- 172.21.15.100:0/2410562491 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f396c0ffe50 0x7f396c10f990 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3960008f90 tx=0x7f3960009e30 comp rx=0 tx=0).stop 2023-12-05T09:55:54.213 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.215+0000 7f396bfff700 1 -- 172.21.15.100:0/2410562491 shutdown_connections 2023-12-05T09:55:54.213 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.215+0000 7f396bfff700 1 --2- 172.21.15.100:0/2410562491 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f3954068fc0 0x7f395406b470 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:54.214 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.215+0000 7f396bfff700 1 --2- 172.21.15.100:0/2410562491 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f396c0fd530 0x7f396c10f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:54.214 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.215+0000 7f396bfff700 1 --2- 172.21.15.100:0/2410562491 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f396c0ffe50 0x7f396c10f990 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:54.214 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.215+0000 7f396bfff700 1 -- 172.21.15.100:0/2410562491 >> 172.21.15.100:0/2410562491 conn(0x7f396c0f6f70 msgr2=0x7f396c100ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:55:54.214 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.216+0000 7f396bfff700 1 -- 172.21.15.100:0/2410562491 shutdown_connections 2023-12-05T09:55:54.214 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.216+0000 7f396bfff700 1 -- 172.21.15.100:0/2410562491 wait complete. 2023-12-05T09:55:54.365 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.367+0000 7f0f4d68f700 1 -- 172.21.15.100:0/3281002594 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f48066090 msgr2=0x7f0f480ff5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:54.365 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.367+0000 7f0f4d68f700 1 --2- 172.21.15.100:0/3281002594 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f48066090 0x7f0f480ff5a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0f38004940 tx=0x7f0f38009e30 comp rx=0 tx=0).stop 2023-12-05T09:55:54.365 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.367+0000 7f0f4d68f700 1 -- 172.21.15.100:0/3281002594 shutdown_connections 2023-12-05T09:55:54.365 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.367+0000 7f0f4d68f700 1 --2- 172.21.15.100:0/3281002594 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f480ffb70 0x7f0f48101fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:54.365 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.367+0000 7f0f4d68f700 1 --2- 172.21.15.100:0/3281002594 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f48066090 0x7f0f480ff5a0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:54.365 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.367+0000 7f0f4d68f700 1 -- 172.21.15.100:0/3281002594 >> 172.21.15.100:0/3281002594 conn(0x7f0f480f6f70 msgr2=0x7f0f480f93e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:55:54.365 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.367+0000 7f0f4d68f700 1 -- 172.21.15.100:0/3281002594 shutdown_connections 2023-12-05T09:55:54.365 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.367+0000 7f0f4d68f700 1 -- 172.21.15.100:0/3281002594 wait complete. 2023-12-05T09:55:54.366 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.368+0000 7f0f4d68f700 1 Processor -- start 2023-12-05T09:55:54.366 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.368+0000 7f0f4d68f700 1 -- start start 2023-12-05T09:55:54.366 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.369+0000 7f0f4d68f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f48066090 0x7f0f4810d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:55:54.366 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.369+0000 7f0f4d68f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f480ffb70 0x7f0f4810d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:55:54.366 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.369+0000 7f0f4d68f700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f4810dde0 con 0x7f0f480ffb70 2023-12-05T09:55:54.367 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.369+0000 7f0f4d68f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f4810e680 con 0x7f0f48066090 2023-12-05T09:55:54.367 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.369+0000 7f0f477fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f480ffb70 0x7f0f4810d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:55:54.367 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.369+0000 7f0f47fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f48066090 0x7f0f4810d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:55:54.367 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.369+0000 7f0f47fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f48066090 0x7f0f4810d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.100:57300/0 (socket says 172.21.15.100:57300) 2023-12-05T09:55:54.367 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.369+0000 7f0f47fff700 1 -- 172.21.15.100:0/2399313080 learned_addr learned my addr 172.21.15.100:0/2399313080 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:55:54.368 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.370+0000 7f0f477fe700 1 -- 172.21.15.100:0/2399313080 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f48066090 msgr2=0x7f0f4810d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:54.368 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.370+0000 7f0f477fe700 1 --2- 172.21.15.100:0/2399313080 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f48066090 0x7f0f4810d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:54.368 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.370+0000 7f0f477fe700 1 -- 172.21.15.100:0/2399313080 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f38005040 con 0x7f0f480ffb70 2023-12-05T09:55:54.369 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.370+0000 7f0f477fe700 1 --2- 172.21.15.100:0/2399313080 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f480ffb70 0x7f0f4810d7e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0f48065dd0 tx=0x7f0f3c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:55:54.369 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.370+0000 7f0f44ff9700 1 -- 172.21.15.100:0/2399313080 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f3c004e90 con 0x7f0f480ffb70 2023-12-05T09:55:54.369 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.370+0000 7f0f44ff9700 1 -- 172.21.15.100:0/2399313080 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0f3c00f040 con 0x7f0f480ffb70 2023-12-05T09:55:54.369 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.370+0000 7f0f44ff9700 1 -- 172.21.15.100:0/2399313080 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f3c00c980 con 0x7f0f480ffb70 2023-12-05T09:55:54.369 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.371+0000 7f0f4d68f700 1 -- 172.21.15.100:0/2399313080 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f4810e900 con 0x7f0f480ffb70 2023-12-05T09:55:54.369 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.371+0000 7f0f4d68f700 1 -- 172.21.15.100:0/2399313080 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f4810ee40 con 0x7f0f480ffb70 2023-12-05T09:55:54.370 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.372+0000 7f0f4d68f700 1 -- 172.21.15.100:0/2399313080 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f481073e0 con 0x7f0f480ffb70 2023-12-05T09:55:54.370 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.373+0000 7f0f44ff9700 1 -- 172.21.15.100:0/2399313080 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f0f3c007cc0 con 0x7f0f480ffb70 2023-12-05T09:55:54.372 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.375+0000 7f0f44ff9700 1 --2- 172.21.15.100:0/2399313080 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f0f3006d370 0x7f0f3006f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:55:54.373 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.375+0000 7f0f44ff9700 1 -- 172.21.15.100:0/2399313080 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f0f3c0867f0 con 0x7f0f480ffb70 2023-12-05T09:55:54.373 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.375+0000 7f0f47fff700 1 --2- 172.21.15.100:0/2399313080 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f0f3006d370 0x7f0f3006f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:55:54.373 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.376+0000 7f0f47fff700 1 --2- 172.21.15.100:0/2399313080 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f0f3006d370 0x7f0f3006f820 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0f38013600 tx=0x7f0f38009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:55:54.375 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.378+0000 7f0f44ff9700 1 -- 172.21.15.100:0/2399313080 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f0f3c04da00 con 0x7f0f480ffb70 2023-12-05T09:55:54.780 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.783+0000 7f0f4d68f700 1 -- 172.21.15.100:0/2399313080 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0f481053a0 con 0x7f0f480ffb70 2023-12-05T09:55:54.781 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.783+0000 7f0f44ff9700 1 -- 172.21.15.100:0/2399313080 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1814 (secure 0 0 0) 0x7f0f3c056710 con 0x7f0f480ffb70 2023-12-05T09:55:54.781 INFO:teuthology.orchestra.run.smithi100.stdout:e13 2023-12-05T09:55:54.781 INFO:teuthology.orchestra.run.smithi100.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-05T09:55:54.781 INFO:teuthology.orchestra.run.smithi100.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T09:55:54.781 INFO:teuthology.orchestra.run.smithi100.stdout:legacy client fscid: 1 2023-12-05T09:55:54.781 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:55:54.781 INFO:teuthology.orchestra.run.smithi100.stdout:Filesystem 'cephfs' (1) 2023-12-05T09:55:54.781 INFO:teuthology.orchestra.run.smithi100.stdout:fs_name cephfs 2023-12-05T09:55:54.781 INFO:teuthology.orchestra.run.smithi100.stdout:epoch 13 2023-12-05T09:55:54.781 INFO:teuthology.orchestra.run.smithi100.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-05T09:55:54.781 INFO:teuthology.orchestra.run.smithi100.stdout:created 2023-12-05T09:54:30.515778+0000 2023-12-05T09:55:54.781 INFO:teuthology.orchestra.run.smithi100.stdout:modified 2023-12-05T09:54:46.403009+0000 2023-12-05T09:55:54.781 INFO:teuthology.orchestra.run.smithi100.stdout:tableserver 0 2023-12-05T09:55:54.782 INFO:teuthology.orchestra.run.smithi100.stdout:root 0 2023-12-05T09:55:54.782 INFO:teuthology.orchestra.run.smithi100.stdout:session_timeout 60 2023-12-05T09:55:54.782 INFO:teuthology.orchestra.run.smithi100.stdout:session_autoclose 300 2023-12-05T09:55:54.782 INFO:teuthology.orchestra.run.smithi100.stdout:max_file_size 1099511627776 2023-12-05T09:55:54.782 INFO:teuthology.orchestra.run.smithi100.stdout:required_client_features {} 2023-12-05T09:55:54.782 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure 0 2023-12-05T09:55:54.782 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure_osd_epoch 46 2023-12-05T09:55:54.782 INFO:teuthology.orchestra.run.smithi100.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T09:55:54.782 INFO:teuthology.orchestra.run.smithi100.stdout:max_mds 1 2023-12-05T09:55:54.782 INFO:teuthology.orchestra.run.smithi100.stdout:in 0 2023-12-05T09:55:54.785 INFO:teuthology.orchestra.run.smithi100.stdout:up {0=14490} 2023-12-05T09:55:54.786 INFO:teuthology.orchestra.run.smithi100.stdout:failed 2023-12-05T09:55:54.786 INFO:teuthology.orchestra.run.smithi100.stdout:damaged 2023-12-05T09:55:54.786 INFO:teuthology.orchestra.run.smithi100.stdout:stopped 2023-12-05T09:55:54.786 INFO:teuthology.orchestra.run.smithi100.stdout:data_pools [3] 2023-12-05T09:55:54.786 INFO:teuthology.orchestra.run.smithi100.stdout:metadata_pool 2 2023-12-05T09:55:54.786 INFO:teuthology.orchestra.run.smithi100.stdout:inline_data disabled 2023-12-05T09:55:54.786 INFO:teuthology.orchestra.run.smithi100.stdout:balancer 2023-12-05T09:55:54.786 INFO:teuthology.orchestra.run.smithi100.stdout:standby_count_wanted 1 2023-12-05T09:55:54.786 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi100.akmstb{0:14490} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.100:6828/627555128,v1:172.21.15.100:6829/627555128] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:55:54.786 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:55:54.786 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:55:54.786 INFO:teuthology.orchestra.run.smithi100.stdout:Standby daemons: 2023-12-05T09:55:54.786 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:55:54.786 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi150.pcbpxm{-1:14486} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.150:6824/3645854543,v1:172.21.15.150:6825/3645854543] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:55:54.786 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi150.fcnhsv{-1:14498} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.150:6826/3249949736,v1:172.21.15.150:6827/3249949736] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:55:54.787 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi100.sqplhn{-1:14506} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.100:6826/2472212864,v1:172.21.15.100:6827/2472212864] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:55:54.788 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.786+0000 7f0f4d68f700 1 -- 172.21.15.100:0/2399313080 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f0f3006d370 msgr2=0x7f0f3006f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:54.788 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.786+0000 7f0f4d68f700 1 --2- 172.21.15.100:0/2399313080 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f0f3006d370 0x7f0f3006f820 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0f38013600 tx=0x7f0f38009e30 comp rx=0 tx=0).stop 2023-12-05T09:55:54.788 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.786+0000 7f0f4d68f700 1 -- 172.21.15.100:0/2399313080 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f480ffb70 msgr2=0x7f0f4810d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:54.788 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.786+0000 7f0f4d68f700 1 --2- 172.21.15.100:0/2399313080 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f480ffb70 0x7f0f4810d7e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0f48065dd0 tx=0x7f0f3c00b040 comp rx=0 tx=0).stop 2023-12-05T09:55:54.788 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.786+0000 7f0f4d68f700 1 -- 172.21.15.100:0/2399313080 shutdown_connections 2023-12-05T09:55:54.788 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.786+0000 7f0f4d68f700 1 --2- 172.21.15.100:0/2399313080 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f0f3006d370 0x7f0f3006f820 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:54.788 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.786+0000 7f0f4d68f700 1 --2- 172.21.15.100:0/2399313080 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f48066090 0x7f0f4810d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:54.788 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.786+0000 7f0f4d68f700 1 --2- 172.21.15.100:0/2399313080 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f480ffb70 0x7f0f4810d7e0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:54.788 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.786+0000 7f0f4d68f700 1 -- 172.21.15.100:0/2399313080 >> 172.21.15.100:0/2399313080 conn(0x7f0f480f6f70 msgr2=0x7f0f480f93e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:55:54.788 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.786+0000 7f0f4d68f700 1 -- 172.21.15.100:0/2399313080 shutdown_connections 2023-12-05T09:55:54.788 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.786+0000 7f0f4d68f700 1 -- 172.21.15.100:0/2399313080 wait complete. 2023-12-05T09:55:54.788 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 13 2023-12-05T09:55:54.929 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.931+0000 7f6d53fff700 1 -- 172.21.15.100:0/2302779256 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d540fdc30 msgr2=0x7f6d540fe080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:54.929 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.931+0000 7f6d53fff700 1 --2- 172.21.15.100:0/2302779256 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d540fdc30 0x7f6d540fe080 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6d48004940 tx=0x7f6d48009e30 comp rx=0 tx=0).stop 2023-12-05T09:55:54.929 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.931+0000 7f6d53fff700 1 -- 172.21.15.100:0/2302779256 shutdown_connections 2023-12-05T09:55:54.929 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.931+0000 7f6d53fff700 1 --2- 172.21.15.100:0/2302779256 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d540fdc30 0x7f6d540fe080 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:54.929 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.931+0000 7f6d53fff700 1 --2- 172.21.15.100:0/2302779256 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d540fca20 0x7f6d540fce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:54.929 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.931+0000 7f6d53fff700 1 -- 172.21.15.100:0/2302779256 >> 172.21.15.100:0/2302779256 conn(0x7f6d540f80c0 msgr2=0x7f6d540fa510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:55:54.929 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.931+0000 7f6d53fff700 1 -- 172.21.15.100:0/2302779256 shutdown_connections 2023-12-05T09:55:54.929 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.931+0000 7f6d53fff700 1 -- 172.21.15.100:0/2302779256 wait complete. 2023-12-05T09:55:54.930 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.932+0000 7f6d53fff700 1 Processor -- start 2023-12-05T09:55:54.930 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.932+0000 7f6d53fff700 1 -- start start 2023-12-05T09:55:54.930 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.933+0000 7f6d53fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d540fca20 0x7f6d54071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:55:54.930 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.933+0000 7f6d53fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d540fdc30 0x7f6d5406ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:55:54.930 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.933+0000 7f6d53fff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d54070590 con 0x7f6d540fca20 2023-12-05T09:55:54.930 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.933+0000 7f6d53fff700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d54070700 con 0x7f6d540fdc30 2023-12-05T09:55:54.931 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.933+0000 7f6d52ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d540fca20 0x7f6d54071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:55:54.931 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.933+0000 7f6d52ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d540fca20 0x7f6d54071b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50032/0 (socket says 172.21.15.100:50032) 2023-12-05T09:55:54.931 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.933+0000 7f6d52ffd700 1 -- 172.21.15.100:0/2925431844 learned_addr learned my addr 172.21.15.100:0/2925431844 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:55:54.931 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.933+0000 7f6d527fc700 1 --2- 172.21.15.100:0/2925431844 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d540fdc30 0x7f6d5406ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:55:54.931 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.934+0000 7f6d52ffd700 1 -- 172.21.15.100:0/2925431844 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d540fdc30 msgr2=0x7f6d5406ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:54.931 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.934+0000 7f6d52ffd700 1 --2- 172.21.15.100:0/2925431844 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d540fdc30 0x7f6d5406ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:54.931 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.934+0000 7f6d52ffd700 1 -- 172.21.15.100:0/2925431844 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d48005040 con 0x7f6d540fca20 2023-12-05T09:55:54.932 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.934+0000 7f6d52ffd700 1 --2- 172.21.15.100:0/2925431844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d540fca20 0x7f6d54071b10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f6d4400eb70 tx=0x7f6d4400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:55:54.932 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.934+0000 7f6d3b7fe700 1 -- 172.21.15.100:0/2925431844 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d44007cc0 con 0x7f6d540fca20 2023-12-05T09:55:54.932 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.934+0000 7f6d3b7fe700 1 -- 172.21.15.100:0/2925431844 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6d4400f040 con 0x7f6d540fca20 2023-12-05T09:55:54.932 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.934+0000 7f6d3b7fe700 1 -- 172.21.15.100:0/2925431844 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d4400c9d0 con 0x7f6d540fca20 2023-12-05T09:55:54.932 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.935+0000 7f6d53fff700 1 -- 172.21.15.100:0/2925431844 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d54070980 con 0x7f6d540fca20 2023-12-05T09:55:54.933 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.935+0000 7f6d53fff700 1 -- 172.21.15.100:0/2925431844 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d541152b0 con 0x7f6d540fca20 2023-12-05T09:55:54.933 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.936+0000 7f6d53fff700 1 -- 172.21.15.100:0/2925431844 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d5404bb80 con 0x7f6d540fca20 2023-12-05T09:55:54.935 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.937+0000 7f6d3b7fe700 1 -- 172.21.15.100:0/2925431844 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f6d4400cb30 con 0x7f6d540fca20 2023-12-05T09:55:54.936 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.938+0000 7f6d3b7fe700 1 --2- 172.21.15.100:0/2925431844 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f6d3c068f70 0x7f6d3c06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:55:54.936 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.938+0000 7f6d3b7fe700 1 -- 172.21.15.100:0/2925431844 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f6d440868a0 con 0x7f6d540fca20 2023-12-05T09:55:54.936 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.939+0000 7f6d527fc700 1 --2- 172.21.15.100:0/2925431844 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f6d3c068f70 0x7f6d3c06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:55:54.937 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.940+0000 7f6d527fc700 1 --2- 172.21.15.100:0/2925431844 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f6d3c068f70 0x7f6d3c06b420 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6d48013680 tx=0x7f6d48009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:55:54.940 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:54.943+0000 7f6d3b7fe700 1 -- 172.21.15.100:0/2925431844 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f6d4404da00 con 0x7f6d540fca20 2023-12-05T09:55:55.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:55:54 smithi150 ceph-mon[116142]: from='client.14602 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:55:55.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:55:54 smithi150 ceph-mon[116142]: from='client.14606 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:55:55.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:55:54 smithi150 ceph-mon[116142]: from='client.? 172.21.15.100:0/2410562491' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:55:55.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:55:54 smithi100 ceph-mon[107145]: from='client.14602 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:55:55.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:55:54 smithi100 ceph-mon[107145]: from='client.14606 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:55:55.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:55:54 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/2410562491' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:55:55.182 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:55.185+0000 7f6d53fff700 1 -- 172.21.15.100:0/2925431844 --> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6d54102580 con 0x7f6d3c068f70 2023-12-05T09:55:55.184 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2023-12-05T09:55:55.184 INFO:teuthology.orchestra.run.smithi100.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ff918c95653912ae4c171d8d1db5f5eabc756f85ff7e3ce78f13f9c521198459", 2023-12-05T09:55:55.184 INFO:teuthology.orchestra.run.smithi100.stdout: "in_progress": true, 2023-12-05T09:55:55.184 INFO:teuthology.orchestra.run.smithi100.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-05T09:55:55.184 INFO:teuthology.orchestra.run.smithi100.stdout: "services_complete": [], 2023-12-05T09:55:55.184 INFO:teuthology.orchestra.run.smithi100.stdout: "progress": "0/21 daemons upgraded", 2023-12-05T09:55:55.184 INFO:teuthology.orchestra.run.smithi100.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:ff918c95653912ae4c171d8d1db5f5eabc756f85ff7e3ce78f13f9c521198459 image on host smithi150", 2023-12-05T09:55:55.185 INFO:teuthology.orchestra.run.smithi100.stdout: "is_paused": false 2023-12-05T09:55:55.185 INFO:teuthology.orchestra.run.smithi100.stdout:} 2023-12-05T09:55:55.185 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:55.187+0000 7f6d3b7fe700 1 -- 172.21.15.100:0/2925431844 <== mgr.14210 v2:172.21.15.100:6800/1237547575 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f6d54102580 con 0x7f6d3c068f70 2023-12-05T09:55:55.186 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:55.189+0000 7f6d53fff700 1 -- 172.21.15.100:0/2925431844 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f6d3c068f70 msgr2=0x7f6d3c06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:55.186 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:55.189+0000 7f6d53fff700 1 --2- 172.21.15.100:0/2925431844 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f6d3c068f70 0x7f6d3c06b420 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6d48013680 tx=0x7f6d48009e30 comp rx=0 tx=0).stop 2023-12-05T09:55:55.186 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:55.189+0000 7f6d53fff700 1 -- 172.21.15.100:0/2925431844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d540fca20 msgr2=0x7f6d54071b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:55.187 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:55.189+0000 7f6d53fff700 1 --2- 172.21.15.100:0/2925431844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d540fca20 0x7f6d54071b10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f6d4400eb70 tx=0x7f6d4400b040 comp rx=0 tx=0).stop 2023-12-05T09:55:55.187 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:55.189+0000 7f6d53fff700 1 -- 172.21.15.100:0/2925431844 shutdown_connections 2023-12-05T09:55:55.187 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:55.189+0000 7f6d53fff700 1 --2- 172.21.15.100:0/2925431844 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f6d3c068f70 0x7f6d3c06b420 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:55.187 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:55.189+0000 7f6d53fff700 1 --2- 172.21.15.100:0/2925431844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d540fca20 0x7f6d54071b10 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:55.187 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:55.189+0000 7f6d53fff700 1 --2- 172.21.15.100:0/2925431844 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d540fdc30 0x7f6d5406ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:55.187 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:55.189+0000 7f6d53fff700 1 -- 172.21.15.100:0/2925431844 >> 172.21.15.100:0/2925431844 conn(0x7f6d540f80c0 msgr2=0x7f6d54100e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:55:55.187 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:55.189+0000 7f6d53fff700 1 -- 172.21.15.100:0/2925431844 shutdown_connections 2023-12-05T09:55:55.187 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:55.190+0000 7f6d53fff700 1 -- 172.21.15.100:0/2925431844 wait complete. 2023-12-05T09:55:55.337 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:55.339+0000 7f93e50a2700 1 -- 172.21.15.100:0/1654976619 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93e00fde00 msgr2=0x7f93e00fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:55.337 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:55.339+0000 7f93e50a2700 1 --2- 172.21.15.100:0/1654976619 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93e00fde00 0x7f93e00fe250 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f93d4004940 tx=0x7f93d4009e30 comp rx=0 tx=0).stop 2023-12-05T09:55:55.337 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:55.339+0000 7f93e50a2700 1 -- 172.21.15.100:0/1654976619 shutdown_connections 2023-12-05T09:55:55.337 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:55.339+0000 7f93e50a2700 1 --2- 172.21.15.100:0/1654976619 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93e00fde00 0x7f93e00fe250 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:55.337 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:55.339+0000 7f93e50a2700 1 --2- 172.21.15.100:0/1654976619 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93e00fcbf0 0x7f93e00fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:55.337 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:55.339+0000 7f93e50a2700 1 -- 172.21.15.100:0/1654976619 >> 172.21.15.100:0/1654976619 conn(0x7f93e00f82d0 msgr2=0x7f93e00fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:55:55.337 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:55.340+0000 7f93e50a2700 1 -- 172.21.15.100:0/1654976619 shutdown_connections 2023-12-05T09:55:55.338 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:55.340+0000 7f93e50a2700 1 -- 172.21.15.100:0/1654976619 wait complete. 2023-12-05T09:55:55.338 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:55.341+0000 7f93e50a2700 1 Processor -- start 2023-12-05T09:55:55.338 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:55.341+0000 7f93e50a2700 1 -- start start 2023-12-05T09:55:55.339 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:55.341+0000 7f93e50a2700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93e00fcbf0 0x7f93e006ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:55:55.339 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:55.341+0000 7f93e50a2700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93e00fde00 0x7f93e006f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:55:55.339 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:55.341+0000 7f93e50a2700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e006f850 con 0x7f93e00fcbf0 2023-12-05T09:55:55.339 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:55.341+0000 7f93e50a2700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e0117060 con 0x7f93e00fde00 2023-12-05T09:55:55.340 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:55.342+0000 7f93ded9d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93e00fcbf0 0x7f93e006ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:55:55.340 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:55.342+0000 7f93ded9d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93e00fcbf0 0x7f93e006ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50060/0 (socket says 172.21.15.100:50060) 2023-12-05T09:55:55.340 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:55.342+0000 7f93de59c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93e00fde00 0x7f93e006f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:55:55.340 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:55.342+0000 7f93ded9d700 1 -- 172.21.15.100:0/3488144486 learned_addr learned my addr 172.21.15.100:0/3488144486 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:55:55.341 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:55.342+0000 7f93de59c700 1 -- 172.21.15.100:0/3488144486 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93e00fcbf0 msgr2=0x7f93e006ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:55.341 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:55.342+0000 7f93de59c700 1 --2- 172.21.15.100:0/3488144486 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93e00fcbf0 0x7f93e006ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:55.341 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:55.343+0000 7f93de59c700 1 -- 172.21.15.100:0/3488144486 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d4005040 con 0x7f93e00fde00 2023-12-05T09:55:55.341 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:55.343+0000 7f93ded9d700 1 --2- 172.21.15.100:0/3488144486 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93e00fcbf0 0x7f93e006ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-05T09:55:55.341 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:55.343+0000 7f93de59c700 1 --2- 172.21.15.100:0/3488144486 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93e00fde00 0x7f93e006f250 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f93d4009fd0 tx=0x7f93d4009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:55:55.341 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:55.343+0000 7f93c77fe700 1 -- 172.21.15.100:0/3488144486 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93d400e070 con 0x7f93e00fde00 2023-12-05T09:55:55.341 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:55.343+0000 7f93c77fe700 1 -- 172.21.15.100:0/3488144486 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f93d40093f0 con 0x7f93e00fde00 2023-12-05T09:55:55.341 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:55.343+0000 7f93e50a2700 1 -- 172.21.15.100:0/3488144486 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93e01172b0 con 0x7f93e00fde00 2023-12-05T09:55:55.341 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:55.343+0000 7f93c77fe700 1 -- 172.21.15.100:0/3488144486 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93d400b410 con 0x7f93e00fde00 2023-12-05T09:55:55.342 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:55.344+0000 7f93e50a2700 1 -- 172.21.15.100:0/3488144486 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93e0117790 con 0x7f93e00fde00 2023-12-05T09:55:55.343 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:55.345+0000 7f93e50a2700 1 -- 172.21.15.100:0/3488144486 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93e004bb80 con 0x7f93e00fde00 2023-12-05T09:55:55.344 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:55.346+0000 7f93c77fe700 1 -- 172.21.15.100:0/3488144486 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f93d4013c60 con 0x7f93e00fde00 2023-12-05T09:55:55.345 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:55.348+0000 7f93c77fe700 1 --2- 172.21.15.100:0/3488144486 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f93c8068f70 0x7f93c806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:55:55.345 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:55.348+0000 7f93c77fe700 1 -- 172.21.15.100:0/3488144486 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f93d4088350 con 0x7f93e00fde00 2023-12-05T09:55:55.346 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:55.348+0000 7f93ded9d700 1 --2- 172.21.15.100:0/3488144486 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f93c8068f70 0x7f93c806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:55:55.346 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:55.349+0000 7f93ded9d700 1 --2- 172.21.15.100:0/3488144486 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f93c8068f70 0x7f93c806b420 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f93d000f6a0 tx=0x7f93d000b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:55:55.353 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:55.356+0000 7f93c77fe700 1 -- 172.21.15.100:0/3488144486 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f93d4058300 con 0x7f93e00fde00 2023-12-05T09:55:55.638 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:55.640+0000 7f93e50a2700 1 -- 172.21.15.100:0/3488144486 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f93e0105590 con 0x7f93e00fde00 2023-12-05T09:55:55.638 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:55.641+0000 7f93c77fe700 1 -- 172.21.15.100:0/3488144486 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f93d4057e90 con 0x7f93e00fde00 2023-12-05T09:55:55.639 INFO:teuthology.orchestra.run.smithi100.stdout:HEALTH_OK 2023-12-05T09:55:55.641 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:55.643+0000 7f93e50a2700 1 -- 172.21.15.100:0/3488144486 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f93c8068f70 msgr2=0x7f93c806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:55.641 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:55.643+0000 7f93e50a2700 1 --2- 172.21.15.100:0/3488144486 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f93c8068f70 0x7f93c806b420 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f93d000f6a0 tx=0x7f93d000b040 comp rx=0 tx=0).stop 2023-12-05T09:55:55.641 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:55.643+0000 7f93e50a2700 1 -- 172.21.15.100:0/3488144486 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93e00fde00 msgr2=0x7f93e006f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:55:55.641 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:55.643+0000 7f93e50a2700 1 --2- 172.21.15.100:0/3488144486 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93e00fde00 0x7f93e006f250 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f93d4009fd0 tx=0x7f93d4009e30 comp rx=0 tx=0).stop 2023-12-05T09:55:55.641 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:55.644+0000 7f93e50a2700 1 -- 172.21.15.100:0/3488144486 shutdown_connections 2023-12-05T09:55:55.642 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:55.644+0000 7f93e50a2700 1 --2- 172.21.15.100:0/3488144486 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f93c8068f70 0x7f93c806b420 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:55.642 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:55.644+0000 7f93e50a2700 1 --2- 172.21.15.100:0/3488144486 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93e00fcbf0 0x7f93e006ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:55.642 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:55.644+0000 7f93e50a2700 1 --2- 172.21.15.100:0/3488144486 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93e00fde00 0x7f93e006f250 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:55:55.642 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:55.644+0000 7f93e50a2700 1 -- 172.21.15.100:0/3488144486 >> 172.21.15.100:0/3488144486 conn(0x7f93e00f82d0 msgr2=0x7f93e0101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:55:55.642 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:55.644+0000 7f93e50a2700 1 -- 172.21.15.100:0/3488144486 shutdown_connections 2023-12-05T09:55:55.642 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:55:55.644+0000 7f93e50a2700 1 -- 172.21.15.100:0/3488144486 wait complete. 2023-12-05T09:55:56.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:55:55 smithi150 ceph-mon[116142]: pgmap v196: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2023-12-05T09:55:56.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:55:55 smithi150 ceph-mon[116142]: from='client.? 172.21.15.100:0/2399313080' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-05T09:55:56.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:55:55 smithi150 ceph-mon[116142]: from='client.? 172.21.15.100:0/3488144486' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-05T09:55:56.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:55:55 smithi100 ceph-mon[107145]: pgmap v196: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2023-12-05T09:55:56.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:55:55 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/2399313080' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-05T09:55:56.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:55:55 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/3488144486' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-05T09:55:57.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:55:56 smithi150 ceph-mon[116142]: from='client.14618 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:55:57.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:55:56 smithi100 ceph-mon[107145]: from='client.14618 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:55:58.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:55:57 smithi150 ceph-mon[116142]: pgmap v197: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-05T09:55:58.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:55:57 smithi100 ceph-mon[107145]: pgmap v197: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-05T09:56:00.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:55:59 smithi150 ceph-mon[116142]: pgmap v198: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-05T09:56:00.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:55:59 smithi100 ceph-mon[107145]: pgmap v198: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-05T09:56:01.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:00 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:56:01.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:00 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:56:02.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:01 smithi150 ceph-mon[116142]: pgmap v199: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-05T09:56:02.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:01 smithi100 ceph-mon[107145]: pgmap v199: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-05T09:56:04.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:03 smithi150 ceph-mon[116142]: pgmap v200: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-05T09:56:04.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:03 smithi100 ceph-mon[107145]: pgmap v200: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-05T09:56:06.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:05 smithi150 ceph-mon[116142]: pgmap v201: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-05T09:56:06.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:05 smithi100 ceph-mon[107145]: pgmap v201: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-05T09:56:08.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:07 smithi150 ceph-mon[116142]: pgmap v202: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:56:08.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:07 smithi100 ceph-mon[107145]: pgmap v202: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:56:10.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:09 smithi150 ceph-mon[116142]: pgmap v203: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:56:10.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:09 smithi100 ceph-mon[107145]: pgmap v203: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:56:12.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:11 smithi150 ceph-mon[116142]: pgmap v204: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:56:12.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:11 smithi100 ceph-mon[107145]: pgmap v204: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:56:14.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:13 smithi150 ceph-mon[116142]: pgmap v205: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:56:14.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:13 smithi100 ceph-mon[107145]: pgmap v205: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:56:16.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:15 smithi150 ceph-mon[116142]: pgmap v206: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:56:16.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:15 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:56:16.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:15 smithi100 ceph-mon[107145]: pgmap v206: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:56:16.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:15 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:56:18.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:17 smithi150 ceph-mon[116142]: pgmap v207: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:56:18.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:17 smithi100 ceph-mon[107145]: pgmap v207: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:56:20.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:19 smithi150 ceph-mon[116142]: pgmap v208: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:56:20.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:19 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:56:20.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:19 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi150.zkskag", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-05T09:56:20.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:19 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-05T09:56:20.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:19 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:56:20.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:19 smithi100 ceph-mon[107145]: pgmap v208: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:56:20.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:19 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:56:20.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:19 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi150.zkskag", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-05T09:56:20.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:19 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-05T09:56:20.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:19 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:56:20.374 INFO:tasks.workunit.client.0.smithi100.stderr:Updating files: 64% (7853/12123) Updating files: 65% (7880/12123) Updating files: 66% (8002/12123) Updating files: 67% (8123/12123) Updating files: 68% (8244/12123) Updating files: 69% (8365/12123) Updating files: 70% (8487/12123) Updating files: 71% (8608/12123) Updating files: 72% (8729/12123) Updating files: 73% (8850/12123) Updating files: 74% (8972/12123) Updating files: 75% (9093/12123) Updating files: 76% (9214/12123) Updating files: 77% (9335/12123) Updating files: 78% (9456/12123) Updating files: 79% (9578/12123) Updating files: 80% (9699/12123) Updating files: 81% (9820/12123) Updating files: 82% (9941/12123) Updating files: 83% (10063/12123) Updating files: 84% (10184/12123) Updating files: 85% (10305/12123) Updating files: 86% (10426/12123) Updating files: 87% (10548/12123) Updating files: 88% (10669/12123) Updating files: 89% (10790/12123) Updating files: 90% (10911/12123) Updating files: 91% (11032/12123) Updating files: 92% (11154/12123) Updating files: 93% (11275/12123) Updating files: 94% (11396/12123) Updating files: 95% (11517/12123) Updating files: 96% (11639/12123) Updating files: 97% (11760/12123) Updating files: 98% (11881/12123) Updating files: 99% (12002/12123) Updating files: 100% (12123/12123) Updating files: 100% (12123/12123), done. 2023-12-05T09:56:20.800 INFO:tasks.workunit.client.0.smithi100.stderr:Note: switching to '3fe8d441c2f973bfe963ba4dd30ba8eac9f36227'. 2023-12-05T09:56:20.800 INFO:tasks.workunit.client.0.smithi100.stderr: 2023-12-05T09:56:20.800 INFO:tasks.workunit.client.0.smithi100.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-12-05T09:56:20.800 INFO:tasks.workunit.client.0.smithi100.stderr:changes and commit them, and you can discard any commits you make in this 2023-12-05T09:56:20.800 INFO:tasks.workunit.client.0.smithi100.stderr:state without impacting any branches by switching back to a branch. 2023-12-05T09:56:20.800 INFO:tasks.workunit.client.0.smithi100.stderr: 2023-12-05T09:56:20.800 INFO:tasks.workunit.client.0.smithi100.stderr:If you want to create a new branch to retain commits you create, you may 2023-12-05T09:56:20.800 INFO:tasks.workunit.client.0.smithi100.stderr:do so (now or later) by using -c with the switch command. Example: 2023-12-05T09:56:20.800 INFO:tasks.workunit.client.0.smithi100.stderr: 2023-12-05T09:56:20.800 INFO:tasks.workunit.client.0.smithi100.stderr: git switch -c 2023-12-05T09:56:20.800 INFO:tasks.workunit.client.0.smithi100.stderr: 2023-12-05T09:56:20.800 INFO:tasks.workunit.client.0.smithi100.stderr:Or undo this operation with: 2023-12-05T09:56:20.801 INFO:tasks.workunit.client.0.smithi100.stderr: 2023-12-05T09:56:20.801 INFO:tasks.workunit.client.0.smithi100.stderr: git switch - 2023-12-05T09:56:20.801 INFO:tasks.workunit.client.0.smithi100.stderr: 2023-12-05T09:56:20.801 INFO:tasks.workunit.client.0.smithi100.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-12-05T09:56:20.801 INFO:tasks.workunit.client.0.smithi100.stderr: 2023-12-05T09:56:20.801 INFO:tasks.workunit.client.0.smithi100.stderr:HEAD is now at 3fe8d441c2f Merge PR #53564 into wip-mchangir-testing-20231205.064351 2023-12-05T09:56:20.807 DEBUG:teuthology.orchestra.run.smithi100:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-12-05T09:56:20.843 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:20 smithi150 ceph-mon[116142]: Upgrade: Updating mgr.smithi150.zkskag 2023-12-05T09:56:20.843 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:20 smithi150 ceph-mon[116142]: Deploying daemon mgr.smithi150.zkskag on smithi150 2023-12-05T09:56:20.936 INFO:tasks.workunit.client.0.smithi100.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-12-05T09:56:20.941 INFO:tasks.workunit.client.0.smithi100.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-05T09:56:20.941 INFO:tasks.workunit.client.0.smithi100.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-12-05T09:56:21.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:20 smithi100 ceph-mon[107145]: Upgrade: Updating mgr.smithi150.zkskag 2023-12-05T09:56:21.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:20 smithi100 ceph-mon[107145]: Deploying daemon mgr.smithi150.zkskag on smithi150 2023-12-05T09:56:21.594 INFO:tasks.workunit.client.0.smithi100.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-12-05T09:56:21.718 INFO:tasks.workunit.client.0.smithi100.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-12-05T09:56:21.784 INFO:tasks.workunit.client.0.smithi100.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-05T09:56:21.788 INFO:tasks.workunit.client.0.smithi100.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-05T09:56:21.788 INFO:tasks.workunit.client.0.smithi100.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-12-05T09:56:21.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:21 smithi150 ceph-mon[116142]: pgmap v209: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:56:21.852 INFO:tasks.workunit.client.0.smithi100.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-05T09:56:21.860 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-12-05T09:56:21.860 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-12-05T09:56:21.906 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2023-12-05T09:56:21.907 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2023-12-05T09:56:21.907 DEBUG:teuthology.orchestra.run.smithi100:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2023-12-05T09:56:22.006 INFO:tasks.workunit.client.0.smithi100.stderr:+ mkdir -p fsstress 2023-12-05T09:56:22.010 INFO:tasks.workunit.client.0.smithi100.stderr:+ pushd fsstress 2023-12-05T09:56:22.010 INFO:tasks.workunit.client.0.smithi100.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2023-12-05T09:56:22.010 INFO:tasks.workunit.client.0.smithi100.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2023-12-05T09:56:22.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:21 smithi100 ceph-mon[107145]: pgmap v209: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:56:22.585 INFO:tasks.workunit.client.0.smithi100.stderr:+ tar xzf ltp-full.tgz 2023-12-05T09:56:24.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:23 smithi150 ceph-mon[116142]: pgmap v210: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:56:24.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:23 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:56:24.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:23 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:56:24.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:23 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:56:24.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:23 smithi100 ceph-mon[107145]: pgmap v210: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:56:24.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:23 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:56:24.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:23 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:56:24.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:23 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:56:25.596 INFO:tasks.workunit.client.1.smithi150.stderr:Updating files: 59% (7273/12123) Updating files: 60% (7274/12123) Updating files: 61% (7396/12123) Updating files: 62% (7517/12123) Updating files: 63% (7638/12123) Updating files: 64% (7759/12123) Updating files: 65% (7880/12123) Updating files: 66% (8002/12123) Updating files: 67% (8123/12123) Updating files: 68% (8244/12123) Updating files: 69% (8365/12123) Updating files: 70% (8487/12123) Updating files: 71% (8608/12123) Updating files: 72% (8729/12123) Updating files: 73% (8850/12123) Updating files: 74% (8972/12123) Updating files: 75% (9093/12123) Updating files: 76% (9214/12123) Updating files: 77% (9335/12123) Updating files: 78% (9456/12123) Updating files: 79% (9578/12123) Updating files: 80% (9699/12123) Updating files: 81% (9820/12123) Updating files: 82% (9941/12123) Updating files: 83% (10063/12123) Updating files: 84% (10184/12123) Updating files: 85% (10305/12123) Updating files: 86% (10426/12123) Updating files: 87% (10548/12123) Updating files: 88% (10669/12123) Updating files: 89% (10790/12123) Updating files: 90% (10911/12123) Updating files: 91% (11032/12123) Updating files: 92% (11154/12123) Updating files: 93% (11275/12123) Updating files: 94% (11396/12123) Updating files: 95% (11517/12123) Updating files: 96% (11639/12123) Updating files: 97% (11760/12123) Updating files: 97% (11864/12123) Updating files: 98% (11881/12123) Updating files: 99% (12002/12123) Updating files: 100% (12123/12123) Updating files: 100% (12123/12123), done. 2023-12-05T09:56:25.793 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:25.795+0000 7fe7478a9700 1 -- 172.21.15.100:0/3867559694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7400fcbf0 msgr2=0x7fe7400fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:56:25.793 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:25.795+0000 7fe7478a9700 1 --2- 172.21.15.100:0/3867559694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7400fcbf0 0x7fe7400fd000 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe73c004940 tx=0x7fe73c009e30 comp rx=0 tx=0).stop 2023-12-05T09:56:25.793 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:25.795+0000 7fe7478a9700 1 -- 172.21.15.100:0/3867559694 shutdown_connections 2023-12-05T09:56:25.793 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:25.795+0000 7fe7478a9700 1 --2- 172.21.15.100:0/3867559694 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7400fde00 0x7fe7400fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:56:25.793 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:25.795+0000 7fe7478a9700 1 --2- 172.21.15.100:0/3867559694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7400fcbf0 0x7fe7400fd000 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:56:25.793 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:25.795+0000 7fe7478a9700 1 -- 172.21.15.100:0/3867559694 >> 172.21.15.100:0/3867559694 conn(0x7fe7400f82d0 msgr2=0x7fe7400fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:56:25.793 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:25.795+0000 7fe7478a9700 1 -- 172.21.15.100:0/3867559694 shutdown_connections 2023-12-05T09:56:25.794 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:25.795+0000 7fe7478a9700 1 -- 172.21.15.100:0/3867559694 wait complete. 2023-12-05T09:56:25.795 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:25.796+0000 7fe7478a9700 1 Processor -- start 2023-12-05T09:56:25.795 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:25.796+0000 7fe7478a9700 1 -- start start 2023-12-05T09:56:25.795 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:25.796+0000 7fe7478a9700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7400fcbf0 0x7fe74010f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:56:25.795 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:25.796+0000 7fe7478a9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7400fde00 0x7fe74010fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:56:25.795 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:25.796+0000 7fe7478a9700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7401101e0 con 0x7fe7400fcbf0 2023-12-05T09:56:25.795 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:25.796+0000 7fe7478a9700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe740110a80 con 0x7fe7400fde00 2023-12-05T09:56:25.795 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:25.797+0000 7fe745645700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7400fcbf0 0x7fe74010f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:56:25.795 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:25.797+0000 7fe745645700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7400fcbf0 0x7fe74010f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45090/0 (socket says 172.21.15.100:45090) 2023-12-05T09:56:25.795 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:25.797+0000 7fe745645700 1 -- 172.21.15.100:0/2967254549 learned_addr learned my addr 172.21.15.100:0/2967254549 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:56:25.795 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:25.797+0000 7fe744e44700 1 --2- 172.21.15.100:0/2967254549 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7400fde00 0x7fe74010fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:56:25.795 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:25.797+0000 7fe745645700 1 -- 172.21.15.100:0/2967254549 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7400fde00 msgr2=0x7fe74010fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:56:25.795 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:25.797+0000 7fe745645700 1 --2- 172.21.15.100:0/2967254549 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7400fde00 0x7fe74010fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:56:25.796 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:25.797+0000 7fe745645700 1 -- 172.21.15.100:0/2967254549 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe73c005040 con 0x7fe7400fcbf0 2023-12-05T09:56:25.796 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:25.797+0000 7fe745645700 1 --2- 172.21.15.100:0/2967254549 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7400fcbf0 0x7fe74010f6a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe73c009fd0 tx=0x7fe73c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:56:25.796 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:25.798+0000 7fe735ffb700 1 -- 172.21.15.100:0/2967254549 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe73c021070 con 0x7fe7400fcbf0 2023-12-05T09:56:25.796 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:25.798+0000 7fe735ffb700 1 -- 172.21.15.100:0/2967254549 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe73c01c400 con 0x7fe7400fcbf0 2023-12-05T09:56:25.796 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:25.798+0000 7fe7478a9700 1 -- 172.21.15.100:0/2967254549 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe740110d00 con 0x7fe7400fcbf0 2023-12-05T09:56:25.796 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:25.798+0000 7fe735ffb700 1 -- 172.21.15.100:0/2967254549 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe73c00e070 con 0x7fe7400fcbf0 2023-12-05T09:56:25.796 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:25.798+0000 7fe7478a9700 1 -- 172.21.15.100:0/2967254549 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe740111240 con 0x7fe7400fcbf0 2023-12-05T09:56:25.797 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:25.799+0000 7fe7478a9700 1 -- 172.21.15.100:0/2967254549 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe740101ea0 con 0x7fe7400fcbf0 2023-12-05T09:56:25.798 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:25.801+0000 7fe735ffb700 1 -- 172.21.15.100:0/2967254549 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7fe73c01c9c0 con 0x7fe7400fcbf0 2023-12-05T09:56:25.800 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:25.802+0000 7fe735ffb700 1 --2- 172.21.15.100:0/2967254549 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fe72c068f70 0x7fe72c06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:56:25.800 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:25.803+0000 7fe735ffb700 1 -- 172.21.15.100:0/2967254549 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fe73c087fe0 con 0x7fe7400fcbf0 2023-12-05T09:56:25.800 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:25.803+0000 7fe744e44700 1 --2- 172.21.15.100:0/2967254549 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fe72c068f70 0x7fe72c06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:56:25.801 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:25.803+0000 7fe744e44700 1 --2- 172.21.15.100:0/2967254549 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fe72c068f70 0x7fe72c06b420 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe730009b80 tx=0x7fe73000b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:56:25.805 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:25.808+0000 7fe735ffb700 1 -- 172.21.15.100:0/2967254549 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fe73c057f30 con 0x7fe7400fcbf0 2023-12-05T09:56:26.092 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.094+0000 7fe7478a9700 1 -- 172.21.15.100:0/2967254549 --> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe7401115e0 con 0x7fe72c068f70 2023-12-05T09:56:26.093 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.096+0000 7fe735ffb700 1 -- 172.21.15.100:0/2967254549 <== mgr.14210 v2:172.21.15.100:6800/1237547575 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+328 (secure 0 0 0) 0x7fe7401115e0 con 0x7fe72c068f70 2023-12-05T09:56:26.096 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.098+0000 7fe7478a9700 1 -- 172.21.15.100:0/2967254549 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fe72c068f70 msgr2=0x7fe72c06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:56:26.096 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.098+0000 7fe7478a9700 1 --2- 172.21.15.100:0/2967254549 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fe72c068f70 0x7fe72c06b420 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe730009b80 tx=0x7fe73000b040 comp rx=0 tx=0).stop 2023-12-05T09:56:26.096 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.098+0000 7fe7478a9700 1 -- 172.21.15.100:0/2967254549 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7400fcbf0 msgr2=0x7fe74010f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:56:26.096 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.098+0000 7fe7478a9700 1 --2- 172.21.15.100:0/2967254549 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7400fcbf0 0x7fe74010f6a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe73c009fd0 tx=0x7fe73c009e30 comp rx=0 tx=0).stop 2023-12-05T09:56:26.096 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.098+0000 7fe7478a9700 1 -- 172.21.15.100:0/2967254549 shutdown_connections 2023-12-05T09:56:26.096 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.098+0000 7fe7478a9700 1 --2- 172.21.15.100:0/2967254549 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7fe72c068f70 0x7fe72c06b420 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:56:26.096 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.098+0000 7fe7478a9700 1 --2- 172.21.15.100:0/2967254549 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7400fcbf0 0x7fe74010f6a0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:56:26.096 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.098+0000 7fe7478a9700 1 --2- 172.21.15.100:0/2967254549 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7400fde00 0x7fe74010fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:56:26.096 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.098+0000 7fe7478a9700 1 -- 172.21.15.100:0/2967254549 >> 172.21.15.100:0/2967254549 conn(0x7fe7400f82d0 msgr2=0x7fe7400ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:56:26.097 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.099+0000 7fe7478a9700 1 -- 172.21.15.100:0/2967254549 shutdown_connections 2023-12-05T09:56:26.097 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.099+0000 7fe7478a9700 1 -- 172.21.15.100:0/2967254549 wait complete. 2023-12-05T09:56:26.111 INFO:tasks.workunit.client.1.smithi150.stderr:Note: switching to '3fe8d441c2f973bfe963ba4dd30ba8eac9f36227'. 2023-12-05T09:56:26.112 INFO:tasks.workunit.client.1.smithi150.stderr: 2023-12-05T09:56:26.112 INFO:tasks.workunit.client.1.smithi150.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-12-05T09:56:26.112 INFO:tasks.workunit.client.1.smithi150.stderr:changes and commit them, and you can discard any commits you make in this 2023-12-05T09:56:26.112 INFO:tasks.workunit.client.1.smithi150.stderr:state without impacting any branches by switching back to a branch. 2023-12-05T09:56:26.112 INFO:tasks.workunit.client.1.smithi150.stderr: 2023-12-05T09:56:26.112 INFO:tasks.workunit.client.1.smithi150.stderr:If you want to create a new branch to retain commits you create, you may 2023-12-05T09:56:26.112 INFO:tasks.workunit.client.1.smithi150.stderr:do so (now or later) by using -c with the switch command. Example: 2023-12-05T09:56:26.112 INFO:tasks.workunit.client.1.smithi150.stderr: 2023-12-05T09:56:26.112 INFO:tasks.workunit.client.1.smithi150.stderr: git switch -c 2023-12-05T09:56:26.112 INFO:tasks.workunit.client.1.smithi150.stderr: 2023-12-05T09:56:26.112 INFO:tasks.workunit.client.1.smithi150.stderr:Or undo this operation with: 2023-12-05T09:56:26.112 INFO:tasks.workunit.client.1.smithi150.stderr: 2023-12-05T09:56:26.113 INFO:tasks.workunit.client.1.smithi150.stderr: git switch - 2023-12-05T09:56:26.113 INFO:tasks.workunit.client.1.smithi150.stderr: 2023-12-05T09:56:26.113 INFO:tasks.workunit.client.1.smithi150.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-12-05T09:56:26.113 INFO:tasks.workunit.client.1.smithi150.stderr: 2023-12-05T09:56:26.113 INFO:tasks.workunit.client.1.smithi150.stderr:HEAD is now at 3fe8d441c2f Merge PR #53564 into wip-mchangir-testing-20231205.064351 2023-12-05T09:56:26.113 INFO:teuthology.orchestra.run.smithi100.stdout:true 2023-12-05T09:56:26.120 DEBUG:teuthology.orchestra.run.smithi150:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2023-12-05T09:56:26.183 INFO:tasks.workunit.client.1.smithi150.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-12-05T09:56:26.188 INFO:tasks.workunit.client.1.smithi150.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2023-12-05T09:56:26.188 INFO:tasks.workunit.client.1.smithi150.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-12-05T09:56:26.258 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.260+0000 7f24e45b4700 1 -- 172.21.15.100:0/32963838 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24dc070570 msgr2=0x7f24dc0709c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:56:26.258 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.260+0000 7f24e45b4700 1 --2- 172.21.15.100:0/32963838 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24dc070570 0x7f24dc0709c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f24cc004940 tx=0x7f24cc009e30 comp rx=0 tx=0).stop 2023-12-05T09:56:26.258 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.260+0000 7f24e45b4700 1 -- 172.21.15.100:0/32963838 shutdown_connections 2023-12-05T09:56:26.258 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.260+0000 7f24e45b4700 1 --2- 172.21.15.100:0/32963838 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24dc070570 0x7f24dc0709c0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:56:26.259 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.260+0000 7f24e45b4700 1 --2- 172.21.15.100:0/32963838 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24dc071bc0 0x7f24dc070030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:56:26.259 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.260+0000 7f24e45b4700 1 -- 172.21.15.100:0/32963838 >> 172.21.15.100:0/32963838 conn(0x7f24dc0f82d0 msgr2=0x7f24dc0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:56:26.259 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.261+0000 7f24e45b4700 1 -- 172.21.15.100:0/32963838 shutdown_connections 2023-12-05T09:56:26.259 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.261+0000 7f24e45b4700 1 -- 172.21.15.100:0/32963838 wait complete. 2023-12-05T09:56:26.260 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.261+0000 7f24e45b4700 1 Processor -- start 2023-12-05T09:56:26.260 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.262+0000 7f24e45b4700 1 -- start start 2023-12-05T09:56:26.260 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.262+0000 7f24e45b4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24dc070570 0x7f24dc10f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:56:26.260 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.262+0000 7f24e45b4700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24dc071bc0 0x7f24dc10fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:56:26.260 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.262+0000 7f24e45b4700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24dc1103a0 con 0x7f24dc071bc0 2023-12-05T09:56:26.260 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.262+0000 7f24e45b4700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24dc110c40 con 0x7f24dc070570 2023-12-05T09:56:26.260 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.262+0000 7f24e1b4f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24dc071bc0 0x7f24dc10fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:56:26.260 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.262+0000 7f24e1b4f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24dc071bc0 0x7f24dc10fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45102/0 (socket says 172.21.15.100:45102) 2023-12-05T09:56:26.261 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.262+0000 7f24e1b4f700 1 -- 172.21.15.100:0/1309762504 learned_addr learned my addr 172.21.15.100:0/1309762504 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:56:26.261 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.262+0000 7f24e2350700 1 --2- 172.21.15.100:0/1309762504 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24dc070570 0x7f24dc10f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:56:26.261 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.263+0000 7f24e1b4f700 1 -- 172.21.15.100:0/1309762504 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24dc070570 msgr2=0x7f24dc10f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:56:26.261 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.263+0000 7f24e1b4f700 1 --2- 172.21.15.100:0/1309762504 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24dc070570 0x7f24dc10f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:56:26.262 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.263+0000 7f24e1b4f700 1 -- 172.21.15.100:0/1309762504 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24cc005040 con 0x7f24dc071bc0 2023-12-05T09:56:26.262 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.263+0000 7f24e1b4f700 1 --2- 172.21.15.100:0/1309762504 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24dc071bc0 0x7f24dc10fda0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f24cc000c00 tx=0x7f24cc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:56:26.262 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.263+0000 7f24d2ffd700 1 -- 172.21.15.100:0/1309762504 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24cc00e040 con 0x7f24dc071bc0 2023-12-05T09:56:26.262 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.263+0000 7f24e45b4700 1 -- 172.21.15.100:0/1309762504 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24dc110ec0 con 0x7f24dc071bc0 2023-12-05T09:56:26.262 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.264+0000 7f24e45b4700 1 -- 172.21.15.100:0/1309762504 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24dc111400 con 0x7f24dc071bc0 2023-12-05T09:56:26.262 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.264+0000 7f24d2ffd700 1 -- 172.21.15.100:0/1309762504 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f24cc004290 con 0x7f24dc071bc0 2023-12-05T09:56:26.262 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.264+0000 7f24d2ffd700 1 -- 172.21.15.100:0/1309762504 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24cc025400 con 0x7f24dc071bc0 2023-12-05T09:56:26.262 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.265+0000 7f24e45b4700 1 -- 172.21.15.100:0/1309762504 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24c00052e0 con 0x7f24dc071bc0 2023-12-05T09:56:26.263 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.266+0000 7f24d2ffd700 1 -- 172.21.15.100:0/1309762504 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f24cc013420 con 0x7f24dc071bc0 2023-12-05T09:56:26.264 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.267+0000 7f24d2ffd700 1 --2- 172.21.15.100:0/1309762504 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f24c8068f60 0x7f24c806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:56:26.264 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.267+0000 7f24d2ffd700 1 -- 172.21.15.100:0/1309762504 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f24cc0880f0 con 0x7f24dc071bc0 2023-12-05T09:56:26.265 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.267+0000 7f24e2350700 1 --2- 172.21.15.100:0/1309762504 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f24c8068f60 0x7f24c806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:56:26.266 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.268+0000 7f24e2350700 1 --2- 172.21.15.100:0/1309762504 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f24c8068f60 0x7f24c806b410 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f24d8004f40 tx=0x7f24d800b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:56:26.271 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.273+0000 7f24d2ffd700 1 -- 172.21.15.100:0/1309762504 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f24cc058000 con 0x7f24dc071bc0 2023-12-05T09:56:26.345 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:25 smithi150 ceph-mon[116142]: pgmap v211: 65 pgs: 65 active+clean; 2.8 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 194 KiB/s wr, 0 op/s 2023-12-05T09:56:26.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:25 smithi100 ceph-mon[107145]: pgmap v211: 65 pgs: 65 active+clean; 2.8 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 194 KiB/s wr, 0 op/s 2023-12-05T09:56:26.593 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.595+0000 7f24e45b4700 1 -- 172.21.15.100:0/1309762504 --> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f24c0000bf0 con 0x7f24c8068f60 2023-12-05T09:56:26.594 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.597+0000 7f24d2ffd700 1 -- 172.21.15.100:0/1309762504 <== mgr.14210 v2:172.21.15.100:6800/1237547575 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7f24c0000bf0 con 0x7f24c8068f60 2023-12-05T09:56:26.597 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.599+0000 7f24e45b4700 1 -- 172.21.15.100:0/1309762504 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f24c8068f60 msgr2=0x7f24c806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:56:26.597 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.599+0000 7f24e45b4700 1 --2- 172.21.15.100:0/1309762504 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f24c8068f60 0x7f24c806b410 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f24d8004f40 tx=0x7f24d800b040 comp rx=0 tx=0).stop 2023-12-05T09:56:26.597 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.599+0000 7f24e45b4700 1 -- 172.21.15.100:0/1309762504 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24dc071bc0 msgr2=0x7f24dc10fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:56:26.597 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.599+0000 7f24e45b4700 1 --2- 172.21.15.100:0/1309762504 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24dc071bc0 0x7f24dc10fda0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f24cc000c00 tx=0x7f24cc009e30 comp rx=0 tx=0).stop 2023-12-05T09:56:26.598 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.600+0000 7f24e45b4700 1 -- 172.21.15.100:0/1309762504 shutdown_connections 2023-12-05T09:56:26.598 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.600+0000 7f24e45b4700 1 --2- 172.21.15.100:0/1309762504 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f24c8068f60 0x7f24c806b410 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:56:26.598 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.600+0000 7f24e45b4700 1 --2- 172.21.15.100:0/1309762504 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24dc070570 0x7f24dc10f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:56:26.598 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.600+0000 7f24e45b4700 1 --2- 172.21.15.100:0/1309762504 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24dc071bc0 0x7f24dc10fda0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:56:26.598 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.600+0000 7f24e45b4700 1 -- 172.21.15.100:0/1309762504 >> 172.21.15.100:0/1309762504 conn(0x7f24dc0f82d0 msgr2=0x7f24dc103310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:56:26.598 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.600+0000 7f24e45b4700 1 -- 172.21.15.100:0/1309762504 shutdown_connections 2023-12-05T09:56:26.598 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.600+0000 7f24e45b4700 1 -- 172.21.15.100:0/1309762504 wait complete. 2023-12-05T09:56:26.753 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.755+0000 7f12edeb5700 1 -- 172.21.15.100:0/1211977777 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12e80fff70 msgr2=0x7f12e81003e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:56:26.753 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.755+0000 7f12edeb5700 1 --2- 172.21.15.100:0/1211977777 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12e80fff70 0x7f12e81003e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f12dc004940 tx=0x7f12dc009e30 comp rx=0 tx=0).stop 2023-12-05T09:56:26.754 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.756+0000 7f12edeb5700 1 -- 172.21.15.100:0/1211977777 shutdown_connections 2023-12-05T09:56:26.754 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.756+0000 7f12edeb5700 1 --2- 172.21.15.100:0/1211977777 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12e80fff70 0x7f12e81003e0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:56:26.754 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.756+0000 7f12edeb5700 1 --2- 172.21.15.100:0/1211977777 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f12e80fee00 0x7f12e80ff210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:56:26.754 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.756+0000 7f12edeb5700 1 -- 172.21.15.100:0/1211977777 >> 172.21.15.100:0/1211977777 conn(0x7f12e80fa5d0 msgr2=0x7f12e80fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:56:26.754 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.756+0000 7f12edeb5700 1 -- 172.21.15.100:0/1211977777 shutdown_connections 2023-12-05T09:56:26.754 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.756+0000 7f12edeb5700 1 -- 172.21.15.100:0/1211977777 wait complete. 2023-12-05T09:56:26.754 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.757+0000 7f12edeb5700 1 Processor -- start 2023-12-05T09:56:26.755 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.757+0000 7f12edeb5700 1 -- start start 2023-12-05T09:56:26.756 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.758+0000 7f12edeb5700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12e80fee00 0x7f12e810f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:56:26.756 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.758+0000 7f12edeb5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f12e80fff70 0x7f12e810fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:56:26.756 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.758+0000 7f12edeb5700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12e8110230 con 0x7f12e80fee00 2023-12-05T09:56:26.756 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.758+0000 7f12edeb5700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12e8110ad0 con 0x7f12e80fff70 2023-12-05T09:56:26.756 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.758+0000 7f12e77fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12e80fee00 0x7f12e810f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:56:26.756 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.758+0000 7f12e77fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12e80fee00 0x7f12e810f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45124/0 (socket says 172.21.15.100:45124) 2023-12-05T09:56:26.756 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.758+0000 7f12e77fe700 1 -- 172.21.15.100:0/2372605693 learned_addr learned my addr 172.21.15.100:0/2372605693 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:56:26.756 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.758+0000 7f12e6ffd700 1 --2- 172.21.15.100:0/2372605693 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f12e80fff70 0x7f12e810fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:56:26.756 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.758+0000 7f12e77fe700 1 -- 172.21.15.100:0/2372605693 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f12e80fff70 msgr2=0x7f12e810fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:56:26.757 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.758+0000 7f12e77fe700 1 --2- 172.21.15.100:0/2372605693 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f12e80fff70 0x7f12e810fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:56:26.757 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.758+0000 7f12e77fe700 1 -- 172.21.15.100:0/2372605693 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12dc005040 con 0x7f12e80fee00 2023-12-05T09:56:26.757 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.759+0000 7f12e77fe700 1 --2- 172.21.15.100:0/2372605693 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12e80fee00 0x7f12e810f6f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f12d800eb40 tx=0x7f12d800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:56:26.757 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.759+0000 7f12cffff700 1 -- 172.21.15.100:0/2372605693 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f12d8007cc0 con 0x7f12e80fee00 2023-12-05T09:56:26.757 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.759+0000 7f12cffff700 1 -- 172.21.15.100:0/2372605693 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f12d800f040 con 0x7f12e80fee00 2023-12-05T09:56:26.757 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.759+0000 7f12cffff700 1 -- 172.21.15.100:0/2372605693 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f12d800c990 con 0x7f12e80fee00 2023-12-05T09:56:26.758 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.759+0000 7f12edeb5700 1 -- 172.21.15.100:0/2372605693 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12e8110d50 con 0x7f12e80fee00 2023-12-05T09:56:26.758 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.759+0000 7f12edeb5700 1 -- 172.21.15.100:0/2372605693 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12e8111290 con 0x7f12e80fee00 2023-12-05T09:56:26.758 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.761+0000 7f12edeb5700 1 -- 172.21.15.100:0/2372605693 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12e804bb80 con 0x7f12e80fee00 2023-12-05T09:56:26.759 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.762+0000 7f12cffff700 1 -- 172.21.15.100:0/2372605693 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f12d800caf0 con 0x7f12e80fee00 2023-12-05T09:56:26.761 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.764+0000 7f12cffff700 1 --2- 172.21.15.100:0/2372605693 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f12d0068f60 0x7f12d006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:56:26.761 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.764+0000 7f12cffff700 1 -- 172.21.15.100:0/2372605693 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f12d80868f0 con 0x7f12e80fee00 2023-12-05T09:56:26.761 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.764+0000 7f12e6ffd700 1 --2- 172.21.15.100:0/2372605693 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f12d0068f60 0x7f12d006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:56:26.762 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.765+0000 7f12e6ffd700 1 --2- 172.21.15.100:0/2372605693 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f12d0068f60 0x7f12d006b410 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f12dc013680 tx=0x7f12dc009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:56:26.765 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:26.768+0000 7f12cffff700 1 -- 172.21.15.100:0/2372605693 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f12d804da00 con 0x7f12e80fee00 2023-12-05T09:56:26.888 INFO:tasks.workunit.client.1.smithi150.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-12-05T09:56:27.023 INFO:tasks.workunit.client.1.smithi150.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-12-05T09:56:27.080 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.082+0000 7f12edeb5700 1 -- 172.21.15.100:0/2372605693 --> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f12e8111700 con 0x7f12d0068f60 2023-12-05T09:56:27.091 INFO:tasks.workunit.client.1.smithi150.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2023-12-05T09:56:27.095 INFO:tasks.workunit.client.1.smithi150.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2023-12-05T09:56:27.095 INFO:tasks.workunit.client.1.smithi150.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-12-05T09:56:27.098 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.101+0000 7f12cffff700 1 -- 172.21.15.100:0/2372605693 <== mgr.14210 v2:172.21.15.100:6800/1237547575 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f12e8111700 con 0x7f12d0068f60 2023-12-05T09:56:27.098 INFO:teuthology.orchestra.run.smithi100.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-05T09:56:27.099 INFO:teuthology.orchestra.run.smithi100.stdout:alertmanager.smithi100 smithi100 *:9093,9094 running (5m) 94s ago 6m 14.4M - 0.25.0 c8568f914cd2 836425c83df9 2023-12-05T09:56:27.099 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi100 smithi100 running (6m) 94s ago 6m 7822k - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 6379a3185d48 2023-12-05T09:56:27.099 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi150 smithi150 running (5m) 0s ago 5m 7826k - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 349d37092dbd 2023-12-05T09:56:27.099 INFO:teuthology.orchestra.run.smithi100.stdout:grafana.smithi100 smithi100 *:3000 running (5m) 94s ago 6m 78.5M - 9.4.7 2c41d148cca3 53cd204a480d 2023-12-05T09:56:27.099 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.akmstb smithi100 running (108s) 94s ago 108s 14.6M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 6ce55c42c55b 2023-12-05T09:56:27.099 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.sqplhn smithi100 running (114s) 94s ago 113s 12.3M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc c2682d65f0c9 2023-12-05T09:56:27.099 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi150.fcnhsv smithi150 running (105s) 0s ago 105s 12.5M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 1a259762235d 2023-12-05T09:56:27.099 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi150.pcbpxm smithi150 running (111s) 0s ago 111s 12.5M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 27f730f8b9f9 2023-12-05T09:56:27.099 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi100.ehmuhg smithi100 *:9283 running (7m) 94s ago 7m 501M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc a724d569b69c 2023-12-05T09:56:27.099 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi150.zkskag smithi150 *:8443,9283 running (4s) 0s ago 5m 58.1M - 19.0.0-11-g3fe8d441 56dea28e5206 154eb1df84c7 2023-12-05T09:56:27.099 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi100 smithi100 running (7m) 94s ago 7m 75.4M 2048M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 8e091d6081cc 2023-12-05T09:56:27.099 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi150 smithi150 running (5m) 0s ago 5m 51.7M 2048M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 05fe70420b09 2023-12-05T09:56:27.099 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi100 smithi100 *:9100 running (6m) 94s ago 6m 8904k - 1.5.0 0da6a335fe13 14c9b3344a5a 2023-12-05T09:56:27.099 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi150 smithi150 *:9100 running (5m) 0s ago 5m 8744k - 1.5.0 0da6a335fe13 d3babc3b947c 2023-12-05T09:56:27.099 INFO:teuthology.orchestra.run.smithi100.stdout:osd.0 smithi100 running (4m) 94s ago 4m 56.0M 4349M 17.2.7-109-g1fd3ca3c e139fc5fd9fc c8e64a62cd47 2023-12-05T09:56:27.100 INFO:teuthology.orchestra.run.smithi100.stdout:osd.1 smithi100 running (4m) 94s ago 4m 59.8M 4349M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 0500895cdfc2 2023-12-05T09:56:27.100 INFO:teuthology.orchestra.run.smithi100.stdout:osd.2 smithi100 running (4m) 94s ago 4m 53.3M 4349M 17.2.7-109-g1fd3ca3c e139fc5fd9fc f145372c8ccc 2023-12-05T09:56:27.100 INFO:teuthology.orchestra.run.smithi100.stdout:osd.3 smithi150 running (3m) 0s ago 3m 64.6M 5373M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 78137d463d29 2023-12-05T09:56:27.100 INFO:teuthology.orchestra.run.smithi100.stdout:osd.4 smithi150 running (3m) 0s ago 3m 58.7M 5373M 17.2.7-109-g1fd3ca3c e139fc5fd9fc dfef9accd162 2023-12-05T09:56:27.100 INFO:teuthology.orchestra.run.smithi100.stdout:osd.5 smithi150 running (2m) 0s ago 2m 60.5M 5373M 17.2.7-109-g1fd3ca3c e139fc5fd9fc d9720b1eae0c 2023-12-05T09:56:27.100 INFO:teuthology.orchestra.run.smithi100.stdout:prometheus.smithi100 smithi100 *:9095 running (5m) 94s ago 6m 43.0M - 2.43.0 a07b618ecd1d 74a355bfd7ab 2023-12-05T09:56:27.102 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.104+0000 7f12edeb5700 1 -- 172.21.15.100:0/2372605693 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f12d0068f60 msgr2=0x7f12d006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:56:27.102 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.104+0000 7f12edeb5700 1 --2- 172.21.15.100:0/2372605693 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f12d0068f60 0x7f12d006b410 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f12dc013680 tx=0x7f12dc009e30 comp rx=0 tx=0).stop 2023-12-05T09:56:27.102 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.104+0000 7f12edeb5700 1 -- 172.21.15.100:0/2372605693 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12e80fee00 msgr2=0x7f12e810f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:56:27.102 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.104+0000 7f12edeb5700 1 --2- 172.21.15.100:0/2372605693 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12e80fee00 0x7f12e810f6f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f12d800eb40 tx=0x7f12d800b040 comp rx=0 tx=0).stop 2023-12-05T09:56:27.102 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.105+0000 7f12edeb5700 1 -- 172.21.15.100:0/2372605693 shutdown_connections 2023-12-05T09:56:27.102 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.105+0000 7f12edeb5700 1 --2- 172.21.15.100:0/2372605693 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f12d0068f60 0x7f12d006b410 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:56:27.102 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.105+0000 7f12edeb5700 1 --2- 172.21.15.100:0/2372605693 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12e80fee00 0x7f12e810f6f0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:56:27.103 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.105+0000 7f12edeb5700 1 --2- 172.21.15.100:0/2372605693 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f12e80fff70 0x7f12e810fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:56:27.103 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.105+0000 7f12edeb5700 1 -- 172.21.15.100:0/2372605693 >> 172.21.15.100:0/2372605693 conn(0x7f12e80fa5d0 msgr2=0x7f12e8103230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:56:27.103 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.105+0000 7f12edeb5700 1 -- 172.21.15.100:0/2372605693 shutdown_connections 2023-12-05T09:56:27.103 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.105+0000 7f12edeb5700 1 -- 172.21.15.100:0/2372605693 wait complete. 2023-12-05T09:56:27.162 INFO:tasks.workunit.client.1.smithi150.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2023-12-05T09:56:27.169 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-12-05T09:56:27.169 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2023-12-05T09:56:27.217 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2023-12-05T09:56:27.218 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2023-12-05T09:56:27.218 DEBUG:teuthology.orchestra.run.smithi150:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2023-12-05T09:56:27.253 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.255+0000 7f2651e21700 1 -- 172.21.15.100:0/1949940802 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f264c0fff70 msgr2=0x7f264c1003e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:56:27.253 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.255+0000 7f2651e21700 1 --2- 172.21.15.100:0/1949940802 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f264c0fff70 0x7f264c1003e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2640004940 tx=0x7f2640009e30 comp rx=0 tx=0).stop 2023-12-05T09:56:27.253 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.255+0000 7f2651e21700 1 -- 172.21.15.100:0/1949940802 shutdown_connections 2023-12-05T09:56:27.253 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.255+0000 7f2651e21700 1 --2- 172.21.15.100:0/1949940802 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f264c0fff70 0x7f264c1003e0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:56:27.254 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.255+0000 7f2651e21700 1 --2- 172.21.15.100:0/1949940802 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f264c0fee00 0x7f264c0ff210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:56:27.254 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.255+0000 7f2651e21700 1 -- 172.21.15.100:0/1949940802 >> 172.21.15.100:0/1949940802 conn(0x7f264c0fa5d0 msgr2=0x7f264c0fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:56:27.254 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.255+0000 7f2651e21700 1 -- 172.21.15.100:0/1949940802 shutdown_connections 2023-12-05T09:56:27.254 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.256+0000 7f2651e21700 1 -- 172.21.15.100:0/1949940802 wait complete. 2023-12-05T09:56:27.255 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.256+0000 7f2651e21700 1 Processor -- start 2023-12-05T09:56:27.255 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.257+0000 7f2651e21700 1 -- start start 2023-12-05T09:56:27.255 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.257+0000 7f2651e21700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f264c0fee00 0x7f264c10f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:56:27.255 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.257+0000 7f2651e21700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f264c0fff70 0x7f264c10fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:56:27.255 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.257+0000 7f2651e21700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f264c110200 con 0x7f264c0fff70 2023-12-05T09:56:27.255 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.257+0000 7f2651e21700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f264c110aa0 con 0x7f264c0fee00 2023-12-05T09:56:27.255 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.257+0000 7f264affd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f264c0fff70 0x7f264c10fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:56:27.255 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.257+0000 7f264b7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f264c0fee00 0x7f264c10f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:56:27.255 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.257+0000 7f264affd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f264c0fff70 0x7f264c10fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45144/0 (socket says 172.21.15.100:45144) 2023-12-05T09:56:27.255 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.257+0000 7f264affd700 1 -- 172.21.15.100:0/3155596211 learned_addr learned my addr 172.21.15.100:0/3155596211 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:56:27.256 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.258+0000 7f264b7fe700 1 -- 172.21.15.100:0/3155596211 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f264c0fff70 msgr2=0x7f264c10fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:56:27.256 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.258+0000 7f264b7fe700 1 --2- 172.21.15.100:0/3155596211 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f264c0fff70 0x7f264c10fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:56:27.256 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.258+0000 7f264b7fe700 1 -- 172.21.15.100:0/3155596211 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2640005040 con 0x7f264c0fee00 2023-12-05T09:56:27.256 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.258+0000 7f264affd700 1 --2- 172.21.15.100:0/3155596211 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f264c0fff70 0x7f264c10fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-05T09:56:27.257 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.258+0000 7f264b7fe700 1 --2- 172.21.15.100:0/3155596211 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f264c0fee00 0x7f264c10f6c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f263c009fd0 tx=0x7f263c00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:56:27.257 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.258+0000 7f2633fff700 1 -- 172.21.15.100:0/3155596211 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f263c004e90 con 0x7f264c0fee00 2023-12-05T09:56:27.257 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.258+0000 7f2633fff700 1 -- 172.21.15.100:0/3155596211 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f263c00f040 con 0x7f264c0fee00 2023-12-05T09:56:27.257 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.258+0000 7f2651e21700 1 -- 172.21.15.100:0/3155596211 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f264c110d20 con 0x7f264c0fee00 2023-12-05T09:56:27.257 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.258+0000 7f2633fff700 1 -- 172.21.15.100:0/3155596211 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f263c00c9b0 con 0x7f264c0fee00 2023-12-05T09:56:27.257 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.258+0000 7f2651e21700 1 -- 172.21.15.100:0/3155596211 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f264c111260 con 0x7f264c0fee00 2023-12-05T09:56:27.257 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.260+0000 7f2651e21700 1 -- 172.21.15.100:0/3155596211 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f264c04bb80 con 0x7f264c0fee00 2023-12-05T09:56:27.258 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.261+0000 7f2633fff700 1 -- 172.21.15.100:0/3155596211 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f263c007cc0 con 0x7f264c0fee00 2023-12-05T09:56:27.259 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.261+0000 7f2633fff700 1 --2- 172.21.15.100:0/3155596211 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f2634068f70 0x7f263406b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:56:27.259 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.262+0000 7f2633fff700 1 -- 172.21.15.100:0/3155596211 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f263c086900 con 0x7f264c0fee00 2023-12-05T09:56:27.259 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.262+0000 7f264affd700 1 --2- 172.21.15.100:0/3155596211 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f2634068f70 0x7f263406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:56:27.260 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.262+0000 7f264affd700 1 --2- 172.21.15.100:0/3155596211 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f2634068f70 0x7f263406b420 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f264000b0d0 tx=0x7f2640009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:56:27.267 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.269+0000 7f2633fff700 1 -- 172.21.15.100:0/3155596211 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f263c04da00 con 0x7f264c0fee00 2023-12-05T09:56:27.325 INFO:tasks.workunit.client.1.smithi150.stderr:+ mkdir -p fsstress 2023-12-05T09:56:27.329 INFO:tasks.workunit.client.1.smithi150.stderr:+ pushd fsstress 2023-12-05T09:56:27.329 INFO:tasks.workunit.client.1.smithi150.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2023-12-05T09:56:27.329 INFO:tasks.workunit.client.1.smithi150.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2023-12-05T09:56:27.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:27 smithi150 ceph-mon[116142]: from='client.14630 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:56:27.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:27 smithi150 ceph-mon[116142]: pgmap v212: 65 pgs: 65 active+clean; 2.8 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 194 KiB/s wr, 0 op/s 2023-12-05T09:56:27.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:27 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:56:27.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:27 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:56:27.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:27 smithi150 ceph-mon[116142]: from='client.14634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:56:27.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:27 smithi100 ceph-mon[107145]: from='client.14630 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:56:27.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:27 smithi100 ceph-mon[107145]: pgmap v212: 65 pgs: 65 active+clean; 2.8 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 194 KiB/s wr, 0 op/s 2023-12-05T09:56:27.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:27 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:56:27.647 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:27 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:56:27.647 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:27 smithi100 ceph-mon[107145]: from='client.14634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:56:27.668 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.668+0000 7f2651e21700 1 -- 172.21.15.100:0/3155596211 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f264c1118e0 con 0x7f264c0fee00 2023-12-05T09:56:27.671 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.673+0000 7f2633fff700 1 -- 172.21.15.100:0/3155596211 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7f263c0567a0 con 0x7f264c0fee00 2023-12-05T09:56:27.674 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2023-12-05T09:56:27.674 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": { 2023-12-05T09:56:27.675 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 2 2023-12-05T09:56:27.675 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-12-05T09:56:27.675 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": { 2023-12-05T09:56:27.675 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 2 2023-12-05T09:56:27.675 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-12-05T09:56:27.675 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": { 2023-12-05T09:56:27.675 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 6 2023-12-05T09:56:27.675 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-12-05T09:56:27.675 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": { 2023-12-05T09:56:27.675 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 4 2023-12-05T09:56:27.675 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-12-05T09:56:27.675 INFO:teuthology.orchestra.run.smithi100.stdout: "overall": { 2023-12-05T09:56:27.675 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 14 2023-12-05T09:56:27.675 INFO:teuthology.orchestra.run.smithi100.stdout: } 2023-12-05T09:56:27.675 INFO:teuthology.orchestra.run.smithi100.stdout:} 2023-12-05T09:56:27.677 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.678+0000 7f2651e21700 1 -- 172.21.15.100:0/3155596211 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f2634068f70 msgr2=0x7f263406b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:56:27.677 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.678+0000 7f2651e21700 1 --2- 172.21.15.100:0/3155596211 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f2634068f70 0x7f263406b420 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f264000b0d0 tx=0x7f2640009e30 comp rx=0 tx=0).stop 2023-12-05T09:56:27.677 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.678+0000 7f2651e21700 1 -- 172.21.15.100:0/3155596211 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f264c0fee00 msgr2=0x7f264c10f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:56:27.677 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.678+0000 7f2651e21700 1 --2- 172.21.15.100:0/3155596211 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f264c0fee00 0x7f264c10f6c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f263c009fd0 tx=0x7f263c00b040 comp rx=0 tx=0).stop 2023-12-05T09:56:27.677 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.678+0000 7f2651e21700 1 -- 172.21.15.100:0/3155596211 shutdown_connections 2023-12-05T09:56:27.677 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.678+0000 7f2651e21700 1 --2- 172.21.15.100:0/3155596211 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f2634068f70 0x7f263406b420 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:56:27.677 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.678+0000 7f2651e21700 1 --2- 172.21.15.100:0/3155596211 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f264c0fee00 0x7f264c10f6c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:56:27.678 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.678+0000 7f2651e21700 1 --2- 172.21.15.100:0/3155596211 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f264c0fff70 0x7f264c10fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:56:27.678 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.678+0000 7f2651e21700 1 -- 172.21.15.100:0/3155596211 >> 172.21.15.100:0/3155596211 conn(0x7f264c0fa5d0 msgr2=0x7f264c103230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:56:27.678 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.679+0000 7f2651e21700 1 -- 172.21.15.100:0/3155596211 shutdown_connections 2023-12-05T09:56:27.678 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.679+0000 7f2651e21700 1 -- 172.21.15.100:0/3155596211 wait complete. 2023-12-05T09:56:27.943 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.945+0000 7f9ea026b700 1 -- 172.21.15.100:0/2200381651 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e980fde00 msgr2=0x7f9e980fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:56:27.943 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.945+0000 7f9ea026b700 1 --2- 172.21.15.100:0/2200381651 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e980fde00 0x7f9e980fe250 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9e94004880 tx=0x7f9e94009e30 comp rx=0 tx=0).stop 2023-12-05T09:56:27.943 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.945+0000 7f9ea026b700 1 -- 172.21.15.100:0/2200381651 shutdown_connections 2023-12-05T09:56:27.943 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.945+0000 7f9ea026b700 1 --2- 172.21.15.100:0/2200381651 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e980fde00 0x7f9e980fe250 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:56:27.944 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.945+0000 7f9ea026b700 1 --2- 172.21.15.100:0/2200381651 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e980fcbf0 0x7f9e980fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:56:27.944 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.946+0000 7f9ea026b700 1 -- 172.21.15.100:0/2200381651 >> 172.21.15.100:0/2200381651 conn(0x7f9e980f82d0 msgr2=0x7f9e980fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:56:27.944 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.946+0000 7f9ea026b700 1 -- 172.21.15.100:0/2200381651 shutdown_connections 2023-12-05T09:56:27.944 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.946+0000 7f9ea026b700 1 -- 172.21.15.100:0/2200381651 wait complete. 2023-12-05T09:56:27.945 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.947+0000 7f9ea026b700 1 Processor -- start 2023-12-05T09:56:27.945 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.947+0000 7f9ea026b700 1 -- start start 2023-12-05T09:56:27.945 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.948+0000 7f9ea026b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e980fcbf0 0x7f9e98113b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:56:27.946 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.948+0000 7f9ea026b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e980fde00 0x7f9e981140a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:56:27.946 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.948+0000 7f9ea026b700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e981146a0 con 0x7f9e980fcbf0 2023-12-05T09:56:27.946 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.948+0000 7f9ea026b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e98114f40 con 0x7f9e980fde00 2023-12-05T09:56:27.946 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.949+0000 7f9e9e007700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e980fcbf0 0x7f9e98113b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:56:27.947 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.949+0000 7f9e9e007700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e980fcbf0 0x7f9e98113b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45164/0 (socket says 172.21.15.100:45164) 2023-12-05T09:56:27.947 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.949+0000 7f9e9e007700 1 -- 172.21.15.100:0/556401103 learned_addr learned my addr 172.21.15.100:0/556401103 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:56:27.947 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.950+0000 7f9e9d806700 1 --2- 172.21.15.100:0/556401103 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e980fde00 0x7f9e981140a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:56:27.948 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.950+0000 7f9e9e007700 1 -- 172.21.15.100:0/556401103 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e980fde00 msgr2=0x7f9e981140a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:56:27.948 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.950+0000 7f9e9e007700 1 --2- 172.21.15.100:0/556401103 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e980fde00 0x7f9e981140a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:56:27.948 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.950+0000 7f9e9e007700 1 -- 172.21.15.100:0/556401103 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e94005040 con 0x7f9e980fcbf0 2023-12-05T09:56:27.949 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.951+0000 7f9e9d806700 1 --2- 172.21.15.100:0/556401103 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e980fde00 0x7f9e981140a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-05T09:56:27.951 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.952+0000 7f9e9e007700 1 --2- 172.21.15.100:0/556401103 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e980fcbf0 0x7f9e98113b60 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9e8800eb40 tx=0x7f9e8800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:56:27.951 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.953+0000 7f9e8effd700 1 -- 172.21.15.100:0/556401103 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e88007cc0 con 0x7f9e980fcbf0 2023-12-05T09:56:27.951 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.953+0000 7f9e8effd700 1 -- 172.21.15.100:0/556401103 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9e8800f040 con 0x7f9e980fcbf0 2023-12-05T09:56:27.951 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.953+0000 7f9e8effd700 1 -- 172.21.15.100:0/556401103 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e88009580 con 0x7f9e980fcbf0 2023-12-05T09:56:27.951 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.953+0000 7f9ea026b700 1 -- 172.21.15.100:0/556401103 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e981151a0 con 0x7f9e980fcbf0 2023-12-05T09:56:27.952 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.953+0000 7f9ea026b700 1 -- 172.21.15.100:0/556401103 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e981156e0 con 0x7f9e980fcbf0 2023-12-05T09:56:27.952 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.955+0000 7f9ea026b700 1 -- 172.21.15.100:0/556401103 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e7c0052e0 con 0x7f9e980fcbf0 2023-12-05T09:56:27.955 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.957+0000 7f9e8effd700 1 -- 172.21.15.100:0/556401103 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f9e880096e0 con 0x7f9e980fcbf0 2023-12-05T09:56:27.957 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.959+0000 7f9e8effd700 1 --2- 172.21.15.100:0/556401103 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f9e84069020 0x7f9e8406b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:56:27.957 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.959+0000 7f9e8effd700 1 -- 172.21.15.100:0/556401103 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f9e88086800 con 0x7f9e980fcbf0 2023-12-05T09:56:27.961 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.963+0000 7f9e9d806700 1 --2- 172.21.15.100:0/556401103 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f9e84069020 0x7f9e8406b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:56:27.963 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.965+0000 7f9e9d806700 1 --2- 172.21.15.100:0/556401103 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f9e84069020 0x7f9e8406b4d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9e940135d0 tx=0x7f9e94009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:56:27.965 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:27.967+0000 7f9e8effd700 1 -- 172.21.15.100:0/556401103 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f9e8804da00 con 0x7f9e980fcbf0 2023-12-05T09:56:28.345 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:28 smithi150 ceph-mon[116142]: from='client.14638 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:56:28.345 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:28 smithi150 ceph-mon[116142]: from='client.? 172.21.15.100:0/3155596211' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:56:28.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:28 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:56:28.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:28 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:56:28.411 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:28.413+0000 7f9ea026b700 1 -- 172.21.15.100:0/556401103 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9e7c005da0 con 0x7f9e980fcbf0 2023-12-05T09:56:28.411 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:28.414+0000 7f9e8effd700 1 -- 172.21.15.100:0/556401103 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1814 (secure 0 0 0) 0x7f9e88056860 con 0x7f9e980fcbf0 2023-12-05T09:56:28.412 INFO:teuthology.orchestra.run.smithi100.stdout:e13 2023-12-05T09:56:28.412 INFO:teuthology.orchestra.run.smithi100.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-05T09:56:28.412 INFO:teuthology.orchestra.run.smithi100.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T09:56:28.412 INFO:teuthology.orchestra.run.smithi100.stdout:legacy client fscid: 1 2023-12-05T09:56:28.412 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:56:28.412 INFO:teuthology.orchestra.run.smithi100.stdout:Filesystem 'cephfs' (1) 2023-12-05T09:56:28.412 INFO:teuthology.orchestra.run.smithi100.stdout:fs_name cephfs 2023-12-05T09:56:28.412 INFO:teuthology.orchestra.run.smithi100.stdout:epoch 13 2023-12-05T09:56:28.412 INFO:teuthology.orchestra.run.smithi100.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-05T09:56:28.412 INFO:teuthology.orchestra.run.smithi100.stdout:created 2023-12-05T09:54:30.515778+0000 2023-12-05T09:56:28.412 INFO:teuthology.orchestra.run.smithi100.stdout:modified 2023-12-05T09:54:46.403009+0000 2023-12-05T09:56:28.412 INFO:teuthology.orchestra.run.smithi100.stdout:tableserver 0 2023-12-05T09:56:28.412 INFO:teuthology.orchestra.run.smithi100.stdout:root 0 2023-12-05T09:56:28.413 INFO:teuthology.orchestra.run.smithi100.stdout:session_timeout 60 2023-12-05T09:56:28.413 INFO:teuthology.orchestra.run.smithi100.stdout:session_autoclose 300 2023-12-05T09:56:28.413 INFO:teuthology.orchestra.run.smithi100.stdout:max_file_size 1099511627776 2023-12-05T09:56:28.413 INFO:teuthology.orchestra.run.smithi100.stdout:required_client_features {} 2023-12-05T09:56:28.413 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure 0 2023-12-05T09:56:28.413 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure_osd_epoch 46 2023-12-05T09:56:28.413 INFO:teuthology.orchestra.run.smithi100.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T09:56:28.413 INFO:teuthology.orchestra.run.smithi100.stdout:max_mds 1 2023-12-05T09:56:28.413 INFO:teuthology.orchestra.run.smithi100.stdout:in 0 2023-12-05T09:56:28.413 INFO:teuthology.orchestra.run.smithi100.stdout:up {0=14490} 2023-12-05T09:56:28.413 INFO:teuthology.orchestra.run.smithi100.stdout:failed 2023-12-05T09:56:28.413 INFO:teuthology.orchestra.run.smithi100.stdout:damaged 2023-12-05T09:56:28.413 INFO:teuthology.orchestra.run.smithi100.stdout:stopped 2023-12-05T09:56:28.413 INFO:teuthology.orchestra.run.smithi100.stdout:data_pools [3] 2023-12-05T09:56:28.413 INFO:teuthology.orchestra.run.smithi100.stdout:metadata_pool 2 2023-12-05T09:56:28.414 INFO:teuthology.orchestra.run.smithi100.stdout:inline_data disabled 2023-12-05T09:56:28.414 INFO:teuthology.orchestra.run.smithi100.stdout:balancer 2023-12-05T09:56:28.414 INFO:teuthology.orchestra.run.smithi100.stdout:standby_count_wanted 1 2023-12-05T09:56:28.414 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi100.akmstb{0:14490} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.100:6828/627555128,v1:172.21.15.100:6829/627555128] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:56:28.414 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:56:28.414 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:56:28.414 INFO:teuthology.orchestra.run.smithi100.stdout:Standby daemons: 2023-12-05T09:56:28.414 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:56:28.414 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi150.pcbpxm{-1:14486} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.150:6824/3645854543,v1:172.21.15.150:6825/3645854543] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:56:28.414 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi150.fcnhsv{-1:14498} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.150:6826/3249949736,v1:172.21.15.150:6827/3249949736] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:56:28.414 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi100.sqplhn{-1:14506} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.100:6826/2472212864,v1:172.21.15.100:6827/2472212864] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:56:28.415 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:28.417+0000 7f9ea026b700 1 -- 172.21.15.100:0/556401103 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f9e84069020 msgr2=0x7f9e8406b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:56:28.415 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:28.417+0000 7f9ea026b700 1 --2- 172.21.15.100:0/556401103 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f9e84069020 0x7f9e8406b4d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9e940135d0 tx=0x7f9e94009e30 comp rx=0 tx=0).stop 2023-12-05T09:56:28.415 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:28.417+0000 7f9ea026b700 1 -- 172.21.15.100:0/556401103 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e980fcbf0 msgr2=0x7f9e98113b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:56:28.415 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:28.417+0000 7f9ea026b700 1 --2- 172.21.15.100:0/556401103 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e980fcbf0 0x7f9e98113b60 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9e8800eb40 tx=0x7f9e8800b040 comp rx=0 tx=0).stop 2023-12-05T09:56:28.415 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:28.417+0000 7f9ea026b700 1 -- 172.21.15.100:0/556401103 shutdown_connections 2023-12-05T09:56:28.415 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:28.417+0000 7f9ea026b700 1 --2- 172.21.15.100:0/556401103 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f9e84069020 0x7f9e8406b4d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:56:28.415 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:28.417+0000 7f9ea026b700 1 --2- 172.21.15.100:0/556401103 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e980fcbf0 0x7f9e98113b60 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:56:28.415 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:28.417+0000 7f9ea026b700 1 --2- 172.21.15.100:0/556401103 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e980fde00 0x7f9e981140a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:56:28.415 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:28.417+0000 7f9ea026b700 1 -- 172.21.15.100:0/556401103 >> 172.21.15.100:0/556401103 conn(0x7f9e980f82d0 msgr2=0x7f9e980ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:56:28.416 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:28.418+0000 7f9ea026b700 1 -- 172.21.15.100:0/556401103 shutdown_connections 2023-12-05T09:56:28.416 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:28.418+0000 7f9ea026b700 1 -- 172.21.15.100:0/556401103 wait complete. 2023-12-05T09:56:28.416 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 13 2023-12-05T09:56:28.584 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:28.586+0000 7f405acfe700 1 -- 172.21.15.100:0/2285313758 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40540fde00 msgr2=0x7f40540fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:56:28.584 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:28.586+0000 7f405acfe700 1 --2- 172.21.15.100:0/2285313758 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40540fde00 0x7f40540fe250 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4040004940 tx=0x7f4040009e30 comp rx=0 tx=0).stop 2023-12-05T09:56:28.585 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:28.586+0000 7f405acfe700 1 -- 172.21.15.100:0/2285313758 shutdown_connections 2023-12-05T09:56:28.585 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:28.586+0000 7f405acfe700 1 --2- 172.21.15.100:0/2285313758 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40540fde00 0x7f40540fe250 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:56:28.585 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:28.586+0000 7f405acfe700 1 --2- 172.21.15.100:0/2285313758 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40540fcbf0 0x7f40540fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:56:28.585 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:28.586+0000 7f405acfe700 1 -- 172.21.15.100:0/2285313758 >> 172.21.15.100:0/2285313758 conn(0x7f40540f82d0 msgr2=0x7f40540fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:56:28.585 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:28.587+0000 7f405acfe700 1 -- 172.21.15.100:0/2285313758 shutdown_connections 2023-12-05T09:56:28.585 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:28.587+0000 7f405acfe700 1 -- 172.21.15.100:0/2285313758 wait complete. 2023-12-05T09:56:28.586 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:28.587+0000 7f405acfe700 1 Processor -- start 2023-12-05T09:56:28.586 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:28.588+0000 7f405acfe700 1 -- start start 2023-12-05T09:56:28.586 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:28.588+0000 7f405acfe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40540fcbf0 0x7f405410f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:56:28.586 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:28.588+0000 7f405acfe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40540fde00 0x7f405410fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:56:28.586 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:28.588+0000 7f405acfe700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4054110230 con 0x7f40540fde00 2023-12-05T09:56:28.586 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:28.588+0000 7f405acfe700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4054110ad0 con 0x7f40540fcbf0 2023-12-05T09:56:28.586 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:28.588+0000 7f4053fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40540fde00 0x7f405410fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:56:28.586 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:28.588+0000 7f4053fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40540fde00 0x7f405410fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45182/0 (socket says 172.21.15.100:45182) 2023-12-05T09:56:28.587 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:28.588+0000 7f4053fff700 1 -- 172.21.15.100:0/1829350450 learned_addr learned my addr 172.21.15.100:0/1829350450 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:56:28.587 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:28.588+0000 7f4058a9a700 1 --2- 172.21.15.100:0/1829350450 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40540fcbf0 0x7f405410f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:56:28.587 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:28.589+0000 7f4053fff700 1 -- 172.21.15.100:0/1829350450 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40540fcbf0 msgr2=0x7f405410f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:56:28.587 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:28.589+0000 7f4053fff700 1 --2- 172.21.15.100:0/1829350450 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40540fcbf0 0x7f405410f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:56:28.587 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:28.589+0000 7f4053fff700 1 -- 172.21.15.100:0/1829350450 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4040005040 con 0x7f40540fde00 2023-12-05T09:56:28.587 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:28.589+0000 7f4053fff700 1 --2- 172.21.15.100:0/1829350450 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40540fde00 0x7f405410fc30 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4040009fd0 tx=0x7f4040009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:56:28.587 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:28.589+0000 7f40517fa700 1 -- 172.21.15.100:0/1829350450 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4040021070 con 0x7f40540fde00 2023-12-05T09:56:28.587 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:28.589+0000 7f40517fa700 1 -- 172.21.15.100:0/1829350450 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f404001c400 con 0x7f40540fde00 2023-12-05T09:56:28.588 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:28.589+0000 7f40517fa700 1 -- 172.21.15.100:0/1829350450 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f404000e070 con 0x7f40540fde00 2023-12-05T09:56:28.588 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:28.589+0000 7f405acfe700 1 -- 172.21.15.100:0/1829350450 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4054110d50 con 0x7f40540fde00 2023-12-05T09:56:28.588 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:28.589+0000 7f405acfe700 1 -- 172.21.15.100:0/1829350450 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40541111e0 con 0x7f40540fde00 2023-12-05T09:56:28.588 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:28.591+0000 7f405acfe700 1 -- 172.21.15.100:0/1829350450 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4054101ea0 con 0x7f40540fde00 2023-12-05T09:56:28.589 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:28.592+0000 7f40517fa700 1 -- 172.21.15.100:0/1829350450 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f404001ca00 con 0x7f40540fde00 2023-12-05T09:56:28.591 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:28.593+0000 7f40517fa700 1 --2- 172.21.15.100:0/1829350450 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f4044068f60 0x7f404406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:56:28.591 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:28.594+0000 7f40517fa700 1 -- 172.21.15.100:0/1829350450 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f4040088090 con 0x7f40540fde00 2023-12-05T09:56:28.591 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:28.594+0000 7f4058a9a700 1 --2- 172.21.15.100:0/1829350450 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f4044068f60 0x7f404406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:56:28.592 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:28.595+0000 7f4058a9a700 1 --2- 172.21.15.100:0/1829350450 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f4044068f60 0x7f404406b410 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4048009b80 tx=0x7f404800b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:56:28.595 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:28.598+0000 7f40517fa700 1 -- 172.21.15.100:0/1829350450 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f4040057f00 con 0x7f40540fde00 2023-12-05T09:56:28.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:28 smithi100 ceph-mon[107145]: from='client.14638 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:56:28.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:28 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/3155596211' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:56:28.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:28 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:56:28.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:28 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:56:28.851 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:28.853+0000 7f405acfe700 1 -- 172.21.15.100:0/1829350450 --> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f405402b1f0 con 0x7f4044068f60 2023-12-05T09:56:28.852 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:28.854+0000 7f40517fa700 1 -- 172.21.15.100:0/1829350450 <== mgr.14210 v2:172.21.15.100:6800/1237547575 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7f405402b1f0 con 0x7f4044068f60 2023-12-05T09:56:28.852 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2023-12-05T09:56:28.852 INFO:teuthology.orchestra.run.smithi100.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ff918c95653912ae4c171d8d1db5f5eabc756f85ff7e3ce78f13f9c521198459", 2023-12-05T09:56:28.853 INFO:teuthology.orchestra.run.smithi100.stdout: "in_progress": true, 2023-12-05T09:56:28.853 INFO:teuthology.orchestra.run.smithi100.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-05T09:56:28.853 INFO:teuthology.orchestra.run.smithi100.stdout: "services_complete": [], 2023-12-05T09:56:28.853 INFO:teuthology.orchestra.run.smithi100.stdout: "progress": "1/21 daemons upgraded", 2023-12-05T09:56:28.853 INFO:teuthology.orchestra.run.smithi100.stdout: "message": "Currently upgrading mgr daemons", 2023-12-05T09:56:28.853 INFO:teuthology.orchestra.run.smithi100.stdout: "is_paused": false 2023-12-05T09:56:28.853 INFO:teuthology.orchestra.run.smithi100.stdout:} 2023-12-05T09:56:28.855 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:28.857+0000 7f405acfe700 1 -- 172.21.15.100:0/1829350450 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f4044068f60 msgr2=0x7f404406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:56:28.856 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:28.857+0000 7f405acfe700 1 --2- 172.21.15.100:0/1829350450 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f4044068f60 0x7f404406b410 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4048009b80 tx=0x7f404800b040 comp rx=0 tx=0).stop 2023-12-05T09:56:28.856 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:28.857+0000 7f405acfe700 1 -- 172.21.15.100:0/1829350450 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40540fde00 msgr2=0x7f405410fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:56:28.856 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:28.857+0000 7f405acfe700 1 --2- 172.21.15.100:0/1829350450 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40540fde00 0x7f405410fc30 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4040009fd0 tx=0x7f4040009e30 comp rx=0 tx=0).stop 2023-12-05T09:56:28.856 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:28.857+0000 7f405acfe700 1 -- 172.21.15.100:0/1829350450 shutdown_connections 2023-12-05T09:56:28.856 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:28.857+0000 7f405acfe700 1 --2- 172.21.15.100:0/1829350450 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f4044068f60 0x7f404406b410 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:56:28.856 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:28.857+0000 7f405acfe700 1 --2- 172.21.15.100:0/1829350450 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40540fcbf0 0x7f405410f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:56:28.856 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:28.857+0000 7f405acfe700 1 --2- 172.21.15.100:0/1829350450 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40540fde00 0x7f405410fc30 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:56:28.857 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:28.857+0000 7f405acfe700 1 -- 172.21.15.100:0/1829350450 >> 172.21.15.100:0/1829350450 conn(0x7f40540f82d0 msgr2=0x7f40540ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:56:28.857 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:28.858+0000 7f405acfe700 1 -- 172.21.15.100:0/1829350450 shutdown_connections 2023-12-05T09:56:28.857 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:28.858+0000 7f405acfe700 1 -- 172.21.15.100:0/1829350450 wait complete. 2023-12-05T09:56:29.021 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:29.023+0000 7f1b0d3a5700 1 -- 172.21.15.100:0/3300604973 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b080fd730 msgr2=0x7f1b080ffb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:56:29.021 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:29.023+0000 7f1b0d3a5700 1 --2- 172.21.15.100:0/3300604973 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b080fd730 0x7f1b080ffb10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f1af8004940 tx=0x7f1af8009e30 comp rx=0 tx=0).stop 2023-12-05T09:56:29.021 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:29.023+0000 7f1b0d3a5700 1 -- 172.21.15.100:0/3300604973 shutdown_connections 2023-12-05T09:56:29.021 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:29.023+0000 7f1b0d3a5700 1 --2- 172.21.15.100:0/3300604973 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b08100050 0x7f1b08102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:56:29.021 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:29.023+0000 7f1b0d3a5700 1 --2- 172.21.15.100:0/3300604973 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b080fd730 0x7f1b080ffb10 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:56:29.021 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:29.023+0000 7f1b0d3a5700 1 -- 172.21.15.100:0/3300604973 >> 172.21.15.100:0/3300604973 conn(0x7f1b080f71d0 msgr2=0x7f1b080f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:56:29.021 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:29.023+0000 7f1b0d3a5700 1 -- 172.21.15.100:0/3300604973 shutdown_connections 2023-12-05T09:56:29.021 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:29.023+0000 7f1b0d3a5700 1 -- 172.21.15.100:0/3300604973 wait complete. 2023-12-05T09:56:29.022 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:29.024+0000 7f1b0d3a5700 1 Processor -- start 2023-12-05T09:56:29.022 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:29.025+0000 7f1b0d3a5700 1 -- start start 2023-12-05T09:56:29.022 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:29.025+0000 7f1b0d3a5700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b080fd730 0x7f1b080fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:56:29.023 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:29.025+0000 7f1b0d3a5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b08100050 0x7f1b080fb640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:56:29.023 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:29.025+0000 7f1b0d3a5700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b080fbc40 con 0x7f1b080fd730 2023-12-05T09:56:29.023 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:29.025+0000 7f1b0d3a5700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b080fbdb0 con 0x7f1b08100050 2023-12-05T09:56:29.024 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:29.025+0000 7f1b06ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b080fd730 0x7f1b080fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:56:29.024 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:29.025+0000 7f1b06ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b080fd730 0x7f1b080fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45192/0 (socket says 172.21.15.100:45192) 2023-12-05T09:56:29.024 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:29.025+0000 7f1b06ffd700 1 -- 172.21.15.100:0/3711096812 learned_addr learned my addr 172.21.15.100:0/3711096812 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:56:29.024 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:29.026+0000 7f1b067fc700 1 --2- 172.21.15.100:0/3711096812 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b08100050 0x7f1b080fb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:56:29.024 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:29.026+0000 7f1b06ffd700 1 -- 172.21.15.100:0/3711096812 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b08100050 msgr2=0x7f1b080fb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:56:29.024 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:29.026+0000 7f1b06ffd700 1 --2- 172.21.15.100:0/3711096812 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b08100050 0x7f1b080fb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:56:29.024 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:29.026+0000 7f1b06ffd700 1 -- 172.21.15.100:0/3711096812 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1af8005040 con 0x7f1b080fd730 2023-12-05T09:56:29.024 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:29.026+0000 7f1b06ffd700 1 --2- 172.21.15.100:0/3711096812 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b080fd730 0x7f1b080fd1c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f1af800b3b0 tx=0x7f1af8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:56:29.025 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:29.027+0000 7f1aef7fe700 1 -- 172.21.15.100:0/3711096812 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1af800e040 con 0x7f1b080fd730 2023-12-05T09:56:29.025 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:29.027+0000 7f1aef7fe700 1 -- 172.21.15.100:0/3711096812 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1af800bc50 con 0x7f1b080fd730 2023-12-05T09:56:29.025 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:29.027+0000 7f1b0d3a5700 1 -- 172.21.15.100:0/3711096812 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b080fc030 con 0x7f1b080fd730 2023-12-05T09:56:29.025 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:29.027+0000 7f1aef7fe700 1 -- 172.21.15.100:0/3711096812 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1af801c630 con 0x7f1b080fd730 2023-12-05T09:56:29.025 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:29.027+0000 7f1b0d3a5700 1 -- 172.21.15.100:0/3711096812 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b08115540 con 0x7f1b080fd730 2023-12-05T09:56:29.025 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:29.028+0000 7f1b0d3a5700 1 -- 172.21.15.100:0/3711096812 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b081075c0 con 0x7f1b080fd730 2023-12-05T09:56:29.026 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:29.029+0000 7f1aef7fe700 1 -- 172.21.15.100:0/3711096812 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f1af8013420 con 0x7f1b080fd730 2023-12-05T09:56:29.028 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:29.030+0000 7f1aef7fe700 1 --2- 172.21.15.100:0/3711096812 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f1af0068f70 0x7f1af006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:56:29.028 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:29.031+0000 7f1aef7fe700 1 -- 172.21.15.100:0/3711096812 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f1af80881c0 con 0x7f1b080fd730 2023-12-05T09:56:29.028 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:29.031+0000 7f1b067fc700 1 --2- 172.21.15.100:0/3711096812 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f1af0068f70 0x7f1af006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:56:29.029 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:29.031+0000 7f1b067fc700 1 --2- 172.21.15.100:0/3711096812 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f1af0068f70 0x7f1af006b420 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1afc004f40 tx=0x7f1afc00b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:56:29.032 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:29.034+0000 7f1aef7fe700 1 -- 172.21.15.100:0/3711096812 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f1af80580d0 con 0x7f1b080fd730 2023-12-05T09:56:29.348 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:29.350+0000 7f1b0d3a5700 1 -- 172.21.15.100:0/3711096812 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f1b0804bb80 con 0x7f1b080fd730 2023-12-05T09:56:29.348 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:29.351+0000 7f1aef7fe700 1 -- 172.21.15.100:0/3711096812 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f1af8057c60 con 0x7f1b080fd730 2023-12-05T09:56:29.349 INFO:teuthology.orchestra.run.smithi100.stdout:HEALTH_OK 2023-12-05T09:56:29.351 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:29.353+0000 7f1b0d3a5700 1 -- 172.21.15.100:0/3711096812 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f1af0068f70 msgr2=0x7f1af006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:56:29.351 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:29.353+0000 7f1b0d3a5700 1 --2- 172.21.15.100:0/3711096812 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f1af0068f70 0x7f1af006b420 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1afc004f40 tx=0x7f1afc00b040 comp rx=0 tx=0).stop 2023-12-05T09:56:29.351 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:29.353+0000 7f1b0d3a5700 1 -- 172.21.15.100:0/3711096812 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b080fd730 msgr2=0x7f1b080fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:56:29.351 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:29.353+0000 7f1b0d3a5700 1 --2- 172.21.15.100:0/3711096812 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b080fd730 0x7f1b080fd1c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f1af800b3b0 tx=0x7f1af8009e30 comp rx=0 tx=0).stop 2023-12-05T09:56:29.352 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:29.353+0000 7f1b0d3a5700 1 -- 172.21.15.100:0/3711096812 shutdown_connections 2023-12-05T09:56:29.352 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:29.354+0000 7f1b0d3a5700 1 --2- 172.21.15.100:0/3711096812 >> [v2:172.21.15.100:6800/1237547575,v1:172.21.15.100:6801/1237547575] conn(0x7f1af0068f70 0x7f1af006b420 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:56:29.352 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:29.354+0000 7f1b0d3a5700 1 --2- 172.21.15.100:0/3711096812 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b080fd730 0x7f1b080fd1c0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:56:29.352 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:29.354+0000 7f1b0d3a5700 1 --2- 172.21.15.100:0/3711096812 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b08100050 0x7f1b080fb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:56:29.352 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:29.354+0000 7f1b0d3a5700 1 -- 172.21.15.100:0/3711096812 >> 172.21.15.100:0/3711096812 conn(0x7f1b080f71d0 msgr2=0x7f1b080f95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:56:29.352 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:29.354+0000 7f1b0d3a5700 1 -- 172.21.15.100:0/3711096812 shutdown_connections 2023-12-05T09:56:29.352 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:29.354+0000 7f1b0d3a5700 1 -- 172.21.15.100:0/3711096812 wait complete. 2023-12-05T09:56:29.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:29 smithi150 ceph-mon[116142]: pgmap v213: 65 pgs: 65 active+clean; 7.5 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 614 KiB/s wr, 21 op/s 2023-12-05T09:56:29.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:29 smithi150 ceph-mon[116142]: from='client.? 172.21.15.100:0/556401103' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-05T09:56:29.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:29 smithi150 ceph-mon[116142]: from='client.14650 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:56:29.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:29 smithi100 ceph-mon[107145]: pgmap v213: 65 pgs: 65 active+clean; 7.5 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 614 KiB/s wr, 21 op/s 2023-12-05T09:56:29.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:29 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/556401103' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-05T09:56:29.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:29 smithi100 ceph-mon[107145]: from='client.14650 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:56:30.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:30 smithi150 ceph-mon[116142]: from='client.? 172.21.15.100:0/3711096812' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-05T09:56:30.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:30 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:56:30.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:30 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/3711096812' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-05T09:56:30.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:30 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:56:31.022 INFO:tasks.workunit.client.1.smithi150.stderr:+ tar xzf ltp-full.tgz 2023-12-05T09:56:31.567 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:31 smithi150 ceph-mon[116142]: pgmap v214: 65 pgs: 65 active+clean; 30 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.6 MiB/s wr, 174 op/s 2023-12-05T09:56:31.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:31 smithi100 ceph-mon[107145]: pgmap v214: 65 pgs: 65 active+clean; 30 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.6 MiB/s wr, 174 op/s 2023-12-05T09:56:32.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:32 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:56:32.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:32 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:56:32.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:32 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:56:32.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:32 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:56:32.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:32 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:56:32.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:32 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:56:32.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:32 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mgr fail", "who": "smithi100.ehmuhg"}]: dispatch 2023-12-05T09:56:32.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:32 smithi100 ceph-mon[107145]: osdmap e47: 6 total, 6 up, 6 in 2023-12-05T09:56:32.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:32 smithi100 ceph-mon[107145]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd='[{"prefix": "mgr fail", "who": "smithi100.ehmuhg"}]': finished 2023-12-05T09:56:32.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:32 smithi100 ceph-mon[107145]: mgrmap e20: smithi150.zkskag(active, starting, since 0.0106278s) 2023-12-05T09:56:32.992 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:32 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:56:32.992 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:32 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:56:32.992 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:32 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:56:32.992 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:32 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:56:32.992 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:32 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:56:32.992 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:32 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:56:32.992 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:32 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mgr fail", "who": "smithi100.ehmuhg"}]: dispatch 2023-12-05T09:56:32.992 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:32 smithi150 ceph-mon[116142]: osdmap e47: 6 total, 6 up, 6 in 2023-12-05T09:56:32.992 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:32 smithi150 ceph-mon[116142]: from='mgr.14210 172.21.15.100:0/638154656' entity='mgr.smithi100.ehmuhg' cmd='[{"prefix": "mgr fail", "who": "smithi100.ehmuhg"}]': finished 2023-12-05T09:56:32.992 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:32 smithi150 ceph-mon[116142]: mgrmap e20: smithi150.zkskag(active, starting, since 0.0106278s) 2023-12-05T09:56:33.878 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:33 smithi100 ceph-mon[107145]: Active manager daemon smithi150.zkskag restarted 2023-12-05T09:56:33.878 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:33 smithi100 ceph-mon[107145]: Activating manager daemon smithi150.zkskag 2023-12-05T09:56:33.878 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:33 smithi100 ceph-mon[107145]: osdmap e48: 6 total, 6 up, 6 in 2023-12-05T09:56:33.878 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:33 smithi100 ceph-mon[107145]: mgrmap e21: smithi150.zkskag(active, starting, since 0.00822281s) 2023-12-05T09:56:33.878 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:33 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi150.zkskag/crt"}]: dispatch 2023-12-05T09:56:33.878 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:33 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "mon metadata", "id": "smithi100"}]: dispatch 2023-12-05T09:56:33.878 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:33 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "mon metadata", "id": "smithi150"}]: dispatch 2023-12-05T09:56:33.878 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:33 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi150.pcbpxm"}]: dispatch 2023-12-05T09:56:33.878 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:33 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi100.akmstb"}]: dispatch 2023-12-05T09:56:33.878 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:33 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi150.fcnhsv"}]: dispatch 2023-12-05T09:56:33.879 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:33 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi100.sqplhn"}]: dispatch 2023-12-05T09:56:33.879 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:33 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "mgr metadata", "who": "smithi150.zkskag", "id": "smithi150.zkskag"}]: dispatch 2023-12-05T09:56:33.879 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:33 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-05T09:56:33.879 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:33 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-05T09:56:33.879 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:33 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-05T09:56:33.879 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:33 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-05T09:56:33.879 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:33 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-05T09:56:33.879 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:33 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-05T09:56:33.879 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:33 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-05T09:56:33.879 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:33 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-05T09:56:33.880 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:33 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-05T09:56:33.880 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:33 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-05T09:56:33.880 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:33 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi150.zkskag/key"}]: dispatch 2023-12-05T09:56:33.880 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:33 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-05T09:56:33.880 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:33 smithi100 ceph-mon[107145]: Manager daemon smithi150.zkskag is now available 2023-12-05T09:56:33.880 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:33 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:56:33.880 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:33 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:56:33.881 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:33 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:56:33.881 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:33 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:56:33.881 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:33 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi150.zkskag/mirror_snapshot_schedule"}]: dispatch 2023-12-05T09:56:33.881 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:33 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi150.zkskag/trash_purge_schedule"}]: dispatch 2023-12-05T09:56:33.881 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:33 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:56:33.881 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:33 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:56:34.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:33 smithi150 ceph-mon[116142]: Active manager daemon smithi150.zkskag restarted 2023-12-05T09:56:34.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:33 smithi150 ceph-mon[116142]: Activating manager daemon smithi150.zkskag 2023-12-05T09:56:34.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:33 smithi150 ceph-mon[116142]: osdmap e48: 6 total, 6 up, 6 in 2023-12-05T09:56:34.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:33 smithi150 ceph-mon[116142]: mgrmap e21: smithi150.zkskag(active, starting, since 0.00822281s) 2023-12-05T09:56:34.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:33 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi150.zkskag/crt"}]: dispatch 2023-12-05T09:56:34.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:33 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "mon metadata", "id": "smithi100"}]: dispatch 2023-12-05T09:56:34.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:33 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "mon metadata", "id": "smithi150"}]: dispatch 2023-12-05T09:56:34.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:33 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi150.pcbpxm"}]: dispatch 2023-12-05T09:56:34.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:33 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi100.akmstb"}]: dispatch 2023-12-05T09:56:34.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:33 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi150.fcnhsv"}]: dispatch 2023-12-05T09:56:34.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:33 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi100.sqplhn"}]: dispatch 2023-12-05T09:56:34.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:33 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "mgr metadata", "who": "smithi150.zkskag", "id": "smithi150.zkskag"}]: dispatch 2023-12-05T09:56:34.097 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:33 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-05T09:56:34.097 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:33 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-05T09:56:34.097 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:33 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-05T09:56:34.097 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:33 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-05T09:56:34.097 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:33 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-05T09:56:34.097 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:33 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-05T09:56:34.097 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:33 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-05T09:56:34.097 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:33 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-05T09:56:34.097 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:33 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-05T09:56:34.097 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:33 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-05T09:56:34.097 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:33 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi150.zkskag/key"}]: dispatch 2023-12-05T09:56:34.097 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:33 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-05T09:56:34.097 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:33 smithi150 ceph-mon[116142]: Manager daemon smithi150.zkskag is now available 2023-12-05T09:56:34.097 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:33 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:56:34.098 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:33 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:56:34.098 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:33 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:56:34.098 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:33 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:56:34.098 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:33 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi150.zkskag/mirror_snapshot_schedule"}]: dispatch 2023-12-05T09:56:34.098 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:33 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi150.zkskag/trash_purge_schedule"}]: dispatch 2023-12-05T09:56:34.098 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:33 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:56:34.098 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:33 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:56:35.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:34 smithi100 ceph-mon[107145]: Deploying cephadm binary to smithi150 2023-12-05T09:56:35.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:34 smithi100 ceph-mon[107145]: mgrmap e22: smithi150.zkskag(active, since 1.01247s) 2023-12-05T09:56:35.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:34 smithi100 ceph-mon[107145]: Deploying cephadm binary to smithi100 2023-12-05T09:56:35.345 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:34 smithi150 ceph-mon[116142]: Deploying cephadm binary to smithi150 2023-12-05T09:56:35.345 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:34 smithi150 ceph-mon[116142]: mgrmap e22: smithi150.zkskag(active, since 1.01247s) 2023-12-05T09:56:35.345 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:34 smithi150 ceph-mon[116142]: Deploying cephadm binary to smithi100 2023-12-05T09:56:36.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:35 smithi150 ceph-mon[116142]: pgmap v3: 65 pgs: 65 active+clean; 69 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:56:36.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:35 smithi150 ceph-mon[116142]: mgrmap e23: smithi150.zkskag(active, since 2s) 2023-12-05T09:56:36.156 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:35 smithi100 ceph-mon[107145]: pgmap v3: 65 pgs: 65 active+clean; 69 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:56:36.156 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:35 smithi100 ceph-mon[107145]: mgrmap e23: smithi150.zkskag(active, since 2s) 2023-12-05T09:56:37.261 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:36 smithi100 ceph-mon[107145]: pgmap v4: 65 pgs: 65 active+clean; 69 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:56:37.261 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:36 smithi100 ceph-mon[107145]: [05/Dec/2023:09:56:35] ENGINE Bus STARTING 2023-12-05T09:56:37.261 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:36 smithi100 ceph-mon[107145]: [05/Dec/2023:09:56:35] ENGINE Serving on http://172.21.15.150:8765 2023-12-05T09:56:37.261 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:36 smithi100 ceph-mon[107145]: [05/Dec/2023:09:56:35] ENGINE Serving on https://172.21.15.150:7150 2023-12-05T09:56:37.261 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:36 smithi100 ceph-mon[107145]: [05/Dec/2023:09:56:35] ENGINE Bus STARTED 2023-12-05T09:56:37.345 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:36 smithi150 ceph-mon[116142]: pgmap v4: 65 pgs: 65 active+clean; 69 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:56:37.345 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:36 smithi150 ceph-mon[116142]: [05/Dec/2023:09:56:35] ENGINE Bus STARTING 2023-12-05T09:56:37.345 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:36 smithi150 ceph-mon[116142]: [05/Dec/2023:09:56:35] ENGINE Serving on http://172.21.15.150:8765 2023-12-05T09:56:37.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:36 smithi150 ceph-mon[116142]: [05/Dec/2023:09:56:35] ENGINE Serving on https://172.21.15.150:7150 2023-12-05T09:56:37.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:36 smithi150 ceph-mon[116142]: [05/Dec/2023:09:56:35] ENGINE Bus STARTED 2023-12-05T09:56:38.345 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:37 smithi150 ceph-mon[116142]: pgmap v5: 65 pgs: 65 active+clean; 69 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:56:38.345 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:37 smithi150 ceph-mon[116142]: mgrmap e24: smithi150.zkskag(active, since 4s) 2023-12-05T09:56:38.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:37 smithi100 ceph-mon[107145]: pgmap v5: 65 pgs: 65 active+clean; 69 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:56:38.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:37 smithi100 ceph-mon[107145]: mgrmap e24: smithi150.zkskag(active, since 4s) 2023-12-05T09:56:40.490 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:40 smithi100 ceph-mon[107145]: pgmap v6: 65 pgs: 65 active+clean; 69 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:56:40.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:40 smithi150 ceph-mon[116142]: pgmap v6: 65 pgs: 65 active+clean; 69 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:56:42.754 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:42 smithi100 ceph-mon[107145]: pgmap v7: 65 pgs: 65 active+clean; 87 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 2.7 MiB/s wr, 195 op/s 2023-12-05T09:56:42.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:42 smithi150 ceph-mon[116142]: pgmap v7: 65 pgs: 65 active+clean; 87 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 2.7 MiB/s wr, 195 op/s 2023-12-05T09:56:43.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:43 smithi150 ceph-mon[116142]: Standby manager daemon smithi100.ehmuhg started 2023-12-05T09:56:43.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:43 smithi150 ceph-mon[116142]: from='mgr.? 172.21.15.100:0/1234890704' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi100.ehmuhg/crt"}]: dispatch 2023-12-05T09:56:43.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:43 smithi150 ceph-mon[116142]: from='mgr.? 172.21.15.100:0/1234890704' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-05T09:56:43.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:43 smithi150 ceph-mon[116142]: from='mgr.? 172.21.15.100:0/1234890704' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi100.ehmuhg/key"}]: dispatch 2023-12-05T09:56:43.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:43 smithi150 ceph-mon[116142]: from='mgr.? 172.21.15.100:0/1234890704' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-05T09:56:43.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:43 smithi100 ceph-mon[107145]: Standby manager daemon smithi100.ehmuhg started 2023-12-05T09:56:43.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:43 smithi100 ceph-mon[107145]: from='mgr.? 172.21.15.100:0/1234890704' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi100.ehmuhg/crt"}]: dispatch 2023-12-05T09:56:43.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:43 smithi100 ceph-mon[107145]: from='mgr.? 172.21.15.100:0/1234890704' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-05T09:56:43.897 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:43 smithi100 ceph-mon[107145]: from='mgr.? 172.21.15.100:0/1234890704' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi100.ehmuhg/key"}]: dispatch 2023-12-05T09:56:43.897 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:43 smithi100 ceph-mon[107145]: from='mgr.? 172.21.15.100:0/1234890704' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-05T09:56:44.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:44 smithi150 ceph-mon[116142]: pgmap v8: 65 pgs: 65 active+clean; 87 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 2.1 MiB/s wr, 151 op/s 2023-12-05T09:56:44.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:44 smithi150 ceph-mon[116142]: mgrmap e25: smithi150.zkskag(active, since 10s), standbys: smithi100.ehmuhg 2023-12-05T09:56:44.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:44 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "mgr metadata", "who": "smithi100.ehmuhg", "id": "smithi100.ehmuhg"}]: dispatch 2023-12-05T09:56:44.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:44 smithi100 ceph-mon[107145]: pgmap v8: 65 pgs: 65 active+clean; 87 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 2.1 MiB/s wr, 151 op/s 2023-12-05T09:56:44.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:44 smithi100 ceph-mon[107145]: mgrmap e25: smithi150.zkskag(active, since 10s), standbys: smithi100.ehmuhg 2023-12-05T09:56:44.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:44 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "mgr metadata", "who": "smithi100.ehmuhg", "id": "smithi100.ehmuhg"}]: dispatch 2023-12-05T09:56:45.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:45 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:56:45.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:45 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:56:45.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:45 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:56:45.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:45 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:56:46.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:46 smithi100 ceph-mon[107145]: pgmap v9: 65 pgs: 65 active+clean; 105 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 3.5 MiB/s wr, 427 op/s 2023-12-05T09:56:46.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:46 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:56:46.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:46 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:56:46.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:46 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:56:46.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:46 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:56:46.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:46 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:56:46.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:46 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:56:47.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:46 smithi150 ceph-mon[116142]: pgmap v9: 65 pgs: 65 active+clean; 105 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 3.5 MiB/s wr, 427 op/s 2023-12-05T09:56:47.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:46 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:56:47.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:46 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:56:47.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:46 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:56:47.097 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:46 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:56:47.097 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:46 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:56:47.097 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:46 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:56:47.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:47 smithi100 ceph-mon[107145]: Adjusting osd_memory_target on smithi100 to 1618M 2023-12-05T09:56:48.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:47 smithi150 ceph-mon[116142]: Adjusting osd_memory_target on smithi100 to 1618M 2023-12-05T09:56:48.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:48 smithi100 ceph-mon[107145]: pgmap v10: 65 pgs: 65 active+clean; 105 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 3.2 MiB/s wr, 391 op/s 2023-12-05T09:56:48.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:48 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:56:49.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:48 smithi150 ceph-mon[116142]: pgmap v10: 65 pgs: 65 active+clean; 105 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 3.2 MiB/s wr, 391 op/s 2023-12-05T09:56:49.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:48 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:56:50.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:50 smithi100 ceph-mon[107145]: pgmap v11: 65 pgs: 65 active+clean; 105 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 3.2 MiB/s wr, 391 op/s 2023-12-05T09:56:51.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:50 smithi150 ceph-mon[116142]: pgmap v11: 65 pgs: 65 active+clean; 105 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 3.2 MiB/s wr, 391 op/s 2023-12-05T09:56:52.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:52 smithi100 ceph-mon[107145]: pgmap v12: 65 pgs: 65 active+clean; 137 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 6.0 MiB/s wr, 618 op/s 2023-12-05T09:56:53.070 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:52 smithi150 ceph-mon[116142]: pgmap v12: 65 pgs: 65 active+clean; 137 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 6.0 MiB/s wr, 618 op/s 2023-12-05T09:56:55.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:54 smithi150 ceph-mon[116142]: pgmap v13: 65 pgs: 65 active+clean; 137 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 4.5 MiB/s wr, 504 op/s 2023-12-05T09:56:55.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:54 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:56:55.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:54 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:56:55.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:54 smithi100 ceph-mon[107145]: pgmap v13: 65 pgs: 65 active+clean; 137 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 4.5 MiB/s wr, 504 op/s 2023-12-05T09:56:55.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:54 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:56:55.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:54 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:56:56.246 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:56 smithi150 ceph-mon[116142]: pgmap v14: 65 pgs: 65 active+clean; 149 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 5.5 MiB/s wr, 514 op/s 2023-12-05T09:56:56.246 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:56 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:56:56.246 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:56 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:56:56.329 INFO:tasks.workunit.client.0.smithi100.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2023-12-05T09:56:56.354 INFO:tasks.workunit.client.0.smithi100.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2023-12-05T09:56:56.355 INFO:tasks.workunit.client.0.smithi100.stderr:+ make 2023-12-05T09:56:56.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:56 smithi100 ceph-mon[107145]: pgmap v14: 65 pgs: 65 active+clean; 149 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 5.5 MiB/s wr, 514 op/s 2023-12-05T09:56:56.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:56 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:56:56.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:56 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:56:57.151 INFO:tasks.workunit.client.0.smithi100.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2023-12-05T09:56:57.483 INFO:tasks.workunit.client.0.smithi100.stderr:++ readlink -f fsstress 2023-12-05T09:56:57.485 INFO:tasks.workunit.client.0.smithi100.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2023-12-05T09:56:57.485 INFO:tasks.workunit.client.0.smithi100.stderr:+ popd 2023-12-05T09:56:57.486 INFO:tasks.workunit.client.0.smithi100.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2023-12-05T09:56:57.486 INFO:tasks.workunit.client.0.smithi100.stderr:+ popd 2023-12-05T09:56:57.486 INFO:tasks.workunit.client.0.smithi100.stdout:~/cephtest/mnt.0/client.0/tmp 2023-12-05T09:56:57.486 INFO:tasks.workunit.client.0.smithi100.stderr:++ mktemp -d -p . 2023-12-05T09:56:57.489 INFO:tasks.workunit.client.0.smithi100.stderr:+ T=./tmp.XnAl0zcD3v 2023-12-05T09:56:57.489 INFO:tasks.workunit.client.0.smithi100.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.XnAl0zcD3v -l 1 -n 1000 -p 10 -v 2023-12-05T09:56:57.492 INFO:tasks.workunit.client.0.smithi100.stdout:seed = 1701405004 2023-12-05T09:56:57.496 INFO:tasks.workunit.client.0.smithi100.stdout:0/0: rename - no filename 2023-12-05T09:56:57.498 INFO:tasks.workunit.client.0.smithi100.stdout:5/0: read - no filename 2023-12-05T09:56:57.498 INFO:tasks.workunit.client.0.smithi100.stdout:5/1: truncate - no filename 2023-12-05T09:56:57.499 INFO:tasks.workunit.client.0.smithi100.stdout:0/1: creat f0 x:0 0 0 2023-12-05T09:56:57.500 INFO:tasks.workunit.client.0.smithi100.stdout:1/0: readlink - no filename 2023-12-05T09:56:57.501 INFO:tasks.workunit.client.0.smithi100.stdout:2/0: link - no file 2023-12-05T09:56:57.501 INFO:tasks.workunit.client.0.smithi100.stdout:2/1: dread - no filename 2023-12-05T09:56:57.501 INFO:tasks.workunit.client.0.smithi100.stdout:2/2: dread - no filename 2023-12-05T09:56:57.501 INFO:tasks.workunit.client.0.smithi100.stdout:2/3: chown . 51429448 1 2023-12-05T09:56:57.501 INFO:tasks.workunit.client.0.smithi100.stdout:2/4: rename - no filename 2023-12-05T09:56:57.502 INFO:tasks.workunit.client.0.smithi100.stdout:2/5: dread - no filename 2023-12-05T09:56:57.502 INFO:tasks.workunit.client.0.smithi100.stdout:2/6: readlink - no filename 2023-12-05T09:56:57.502 INFO:tasks.workunit.client.0.smithi100.stdout:2/7: chown . 173511156 1 2023-12-05T09:56:57.502 INFO:tasks.workunit.client.0.smithi100.stdout:2/8: chown . 4438783 1 2023-12-05T09:56:57.502 INFO:tasks.workunit.client.0.smithi100.stdout:2/9: fsync - no filename 2023-12-05T09:56:57.505 INFO:tasks.workunit.client.0.smithi100.stdout:1/1: creat f0 x:0 0 0 2023-12-05T09:56:57.507 INFO:tasks.workunit.client.0.smithi100.stdout:1/2: creat f1 x:0 0 0 2023-12-05T09:56:57.509 INFO:tasks.workunit.client.0.smithi100.stdout:2/10: creat f0 x:0 0 0 2023-12-05T09:56:57.509 INFO:tasks.workunit.client.0.smithi100.stdout:2/11: truncate f0 151259 0 2023-12-05T09:56:57.511 INFO:tasks.workunit.client.0.smithi100.stdout:2/12: write f0 [599963,20909] 0 2023-12-05T09:56:57.511 INFO:tasks.workunit.client.0.smithi100.stdout:3/0: fdatasync - no filename 2023-12-05T09:56:57.511 INFO:tasks.workunit.client.0.smithi100.stdout:3/1: dread - no filename 2023-12-05T09:56:57.511 INFO:tasks.workunit.client.0.smithi100.stdout:3/2: write - no filename 2023-12-05T09:56:57.522 INFO:tasks.workunit.client.0.smithi100.stdout:1/3: mknod c2 0 2023-12-05T09:56:57.522 INFO:tasks.workunit.client.0.smithi100.stdout:1/4: creat f3 x:0 0 0 2023-12-05T09:56:57.522 INFO:tasks.workunit.client.0.smithi100.stdout:3/3: mkdir d0 0 2023-12-05T09:56:57.522 INFO:tasks.workunit.client.0.smithi100.stdout:3/4: dread - no filename 2023-12-05T09:56:57.522 INFO:tasks.workunit.client.0.smithi100.stdout:3/5: dread - no filename 2023-12-05T09:56:57.522 INFO:tasks.workunit.client.0.smithi100.stdout:3/6: unlink - no file 2023-12-05T09:56:57.522 INFO:tasks.workunit.client.0.smithi100.stdout:3/7: link - no file 2023-12-05T09:56:57.523 INFO:tasks.workunit.client.0.smithi100.stdout:3/8: dread - no filename 2023-12-05T09:56:57.523 INFO:tasks.workunit.client.0.smithi100.stdout:3/9: truncate - no filename 2023-12-05T09:56:57.523 INFO:tasks.workunit.client.0.smithi100.stdout:4/0: creat f0 x:0 0 0 2023-12-05T09:56:57.523 INFO:tasks.workunit.client.0.smithi100.stdout:4/1: readlink - no filename 2023-12-05T09:56:57.523 INFO:tasks.workunit.client.0.smithi100.stdout:4/2: creat f1 x:0 0 0 2023-12-05T09:56:57.524 INFO:tasks.workunit.client.0.smithi100.stdout:6/0: dwrite - no filename 2023-12-05T09:56:57.524 INFO:tasks.workunit.client.0.smithi100.stdout:6/1: dread - no filename 2023-12-05T09:56:57.524 INFO:tasks.workunit.client.0.smithi100.stdout:6/2: dread - no filename 2023-12-05T09:56:57.525 INFO:tasks.workunit.client.0.smithi100.stdout:6/3: dread - no filename 2023-12-05T09:56:57.525 INFO:tasks.workunit.client.0.smithi100.stdout:6/4: read - no filename 2023-12-05T09:56:57.530 INFO:tasks.workunit.client.0.smithi100.stdout:3/10: creat d0/f1 x:0 0 0 2023-12-05T09:56:57.530 INFO:tasks.workunit.client.0.smithi100.stdout:3/11: write d0/f1 [588055,46167] 0 2023-12-05T09:56:57.530 INFO:tasks.workunit.client.0.smithi100.stdout:3/12: readlink - no filename 2023-12-05T09:56:57.539 INFO:tasks.workunit.client.0.smithi100.stdout:6/5: symlink l0 0 2023-12-05T09:56:57.569 INFO:tasks.workunit.client.0.smithi100.stdout:6/6: symlink l1 0 2023-12-05T09:56:57.569 INFO:tasks.workunit.client.0.smithi100.stdout:6/7: truncate - no filename 2023-12-05T09:56:57.569 INFO:tasks.workunit.client.0.smithi100.stdout:8/0: write - no filename 2023-12-05T09:56:57.569 INFO:tasks.workunit.client.0.smithi100.stdout:8/1: rename - no filename 2023-12-05T09:56:57.569 INFO:tasks.workunit.client.0.smithi100.stdout:8/2: stat - no entries 2023-12-05T09:56:57.570 INFO:tasks.workunit.client.0.smithi100.stdout:8/3: chown . 238600567 1 2023-12-05T09:56:57.570 INFO:tasks.workunit.client.0.smithi100.stdout:8/4: dwrite - no filename 2023-12-05T09:56:57.570 INFO:tasks.workunit.client.0.smithi100.stdout:8/5: rename - no filename 2023-12-05T09:56:57.570 INFO:tasks.workunit.client.0.smithi100.stdout:8/6: rmdir - no directory 2023-12-05T09:56:57.570 INFO:tasks.workunit.client.0.smithi100.stdout:7/0: creat f0 x:0 0 0 2023-12-05T09:56:57.570 INFO:tasks.workunit.client.0.smithi100.stdout:7/1: readlink - no filename 2023-12-05T09:56:57.587 INFO:tasks.workunit.client.0.smithi100.stdout:6/8: link l0 l2 0 2023-12-05T09:56:57.587 INFO:tasks.workunit.client.0.smithi100.stdout:6/9: dwrite - no filename 2023-12-05T09:56:57.587 INFO:tasks.workunit.client.0.smithi100.stdout:6/10: fsync - no filename 2023-12-05T09:56:57.587 INFO:tasks.workunit.client.0.smithi100.stdout:6/11: write - no filename 2023-12-05T09:56:57.590 INFO:tasks.workunit.client.0.smithi100.stdout:8/7: mkdir d0 0 2023-12-05T09:56:57.590 INFO:tasks.workunit.client.0.smithi100.stdout:8/8: dread - no filename 2023-12-05T09:56:57.590 INFO:tasks.workunit.client.0.smithi100.stdout:8/9: dwrite - no filename 2023-12-05T09:56:57.590 INFO:tasks.workunit.client.0.smithi100.stdout:8/10: chown d0 1 1 2023-12-05T09:56:57.590 INFO:tasks.workunit.client.0.smithi100.stdout:8/11: dwrite - no filename 2023-12-05T09:56:57.590 INFO:tasks.workunit.client.0.smithi100.stdout:8/12: fdatasync - no filename 2023-12-05T09:56:57.590 INFO:tasks.workunit.client.0.smithi100.stdout:8/13: getdents d0 0 2023-12-05T09:56:57.590 INFO:tasks.workunit.client.0.smithi100.stdout:8/14: dread - no filename 2023-12-05T09:56:57.591 INFO:tasks.workunit.client.0.smithi100.stdout:8/15: rename d0 to d0/d1 22 2023-12-05T09:56:57.591 INFO:tasks.workunit.client.0.smithi100.stdout:8/16: stat d0 0 2023-12-05T09:56:57.591 INFO:tasks.workunit.client.0.smithi100.stdout:8/17: read - no filename 2023-12-05T09:56:57.591 INFO:tasks.workunit.client.0.smithi100.stdout:8/18: chown d0 0 1 2023-12-05T09:56:57.591 INFO:tasks.workunit.client.0.smithi100.stdout:8/19: truncate - no filename 2023-12-05T09:56:57.591 INFO:tasks.workunit.client.0.smithi100.stdout:8/20: dread - no filename 2023-12-05T09:56:57.591 INFO:tasks.workunit.client.0.smithi100.stdout:8/21: unlink - no file 2023-12-05T09:56:57.591 INFO:tasks.workunit.client.0.smithi100.stdout:8/22: dwrite - no filename 2023-12-05T09:56:57.591 INFO:tasks.workunit.client.0.smithi100.stdout:8/23: truncate - no filename 2023-12-05T09:56:57.591 INFO:tasks.workunit.client.0.smithi100.stdout:7/2: mknod c1 0 2023-12-05T09:56:57.593 INFO:tasks.workunit.client.0.smithi100.stdout:6/12: creat f3 x:0 0 0 2023-12-05T09:56:57.593 INFO:tasks.workunit.client.0.smithi100.stdout:6/13: creat f4 x:0 0 0 2023-12-05T09:56:57.593 INFO:tasks.workunit.client.0.smithi100.stdout:6/14: creat f5 x:0 0 0 2023-12-05T09:56:57.593 INFO:tasks.workunit.client.0.smithi100.stdout:6/15: write f4 [395104,118247] 0 2023-12-05T09:56:57.594 INFO:tasks.workunit.client.0.smithi100.stdout:6/16: chown l0 0 1 2023-12-05T09:56:57.594 INFO:tasks.workunit.client.0.smithi100.stdout:6/17: creat f6 x:0 0 0 2023-12-05T09:56:57.594 INFO:tasks.workunit.client.0.smithi100.stdout:6/18: write f6 [984,30850] 0 2023-12-05T09:56:57.594 INFO:tasks.workunit.client.0.smithi100.stdout:3/13: write d0/f1 [361067,56382] 0 2023-12-05T09:56:57.601 INFO:tasks.workunit.client.0.smithi100.stdout:9/0: creat f0 x:0 0 0 2023-12-05T09:56:57.620 INFO:tasks.workunit.client.0.smithi100.stdout:6/19: mkdir d7 0 2023-12-05T09:56:57.622 INFO:tasks.workunit.client.0.smithi100.stdout:3/14: mkdir d0/d2 0 2023-12-05T09:56:57.622 INFO:tasks.workunit.client.0.smithi100.stdout:3/15: creat d0/f3 x:0 0 0 2023-12-05T09:56:57.684 INFO:tasks.workunit.client.0.smithi100.stdout:6/20: symlink d7/l8 0 2023-12-05T09:56:57.685 INFO:tasks.workunit.client.0.smithi100.stdout:6/21: write f5 [621305,78250] 0 2023-12-05T09:56:57.699 INFO:tasks.workunit.client.0.smithi100.stdout:3/16: mkdir d0/d4 0 2023-12-05T09:56:57.699 INFO:tasks.workunit.client.0.smithi100.stdout:3/17: chown d0/f1 2050436179 1 2023-12-05T09:56:57.699 INFO:tasks.workunit.client.0.smithi100.stdout:3/18: getdents d0/d4 0 2023-12-05T09:56:57.699 INFO:tasks.workunit.client.0.smithi100.stdout:3/19: stat d0/d4 0 2023-12-05T09:56:57.699 INFO:tasks.workunit.client.0.smithi100.stdout:3/20: write d0/f3 [747386,151] 0 2023-12-05T09:56:57.732 INFO:tasks.workunit.client.0.smithi100.stdout:1/5: dwrite f3 [0,4194304] 0 2023-12-05T09:56:57.750 INFO:tasks.workunit.client.0.smithi100.stdout:0/2: dwrite f0 [0,4194304] 0 2023-12-05T09:56:57.750 INFO:tasks.workunit.client.0.smithi100.stdout:0/3: truncate f0 5092544 0 2023-12-05T09:56:58.036 INFO:tasks.workunit.client.0.smithi100.stdout:9/1: dwrite f0 [0,4194304] 0 2023-12-05T09:56:58.036 INFO:tasks.workunit.client.0.smithi100.stdout:9/2: creat f1 x:0 0 0 2023-12-05T09:56:58.116 INFO:tasks.workunit.client.0.smithi100.stdout:9/3: readlink - no filename 2023-12-05T09:56:58.180 INFO:tasks.workunit.client.0.smithi100.stdout:9/4: dread f0 [0,4194304] 0 2023-12-05T09:56:58.180 INFO:tasks.workunit.client.0.smithi100.stdout:9/5: truncate f1 130946 0 2023-12-05T09:56:58.188 INFO:tasks.workunit.client.0.smithi100.stdout:1/6: mknod c4 0 2023-12-05T09:56:58.272 INFO:tasks.workunit.client.0.smithi100.stdout:0/4: dread f0 [0,4194304] 0 2023-12-05T09:56:58.290 INFO:tasks.workunit.client.0.smithi100.stdout:0/5: write f0 [3247102,91577] 0 2023-12-05T09:56:58.291 INFO:tasks.workunit.client.0.smithi100.stdout:0/6: read f0 [337179,50525] 0 2023-12-05T09:56:58.291 INFO:tasks.workunit.client.0.smithi100.stdout:0/7: stat f0 0 2023-12-05T09:56:58.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:56:58 smithi100 ceph-mon[107145]: pgmap v15: 65 pgs: 65 active+clean; 149 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 3.8 MiB/s wr, 236 op/s 2023-12-05T09:56:58.400 INFO:tasks.workunit.client.0.smithi100.stdout:2/13: dwrite f0 [0,4194304] 0 2023-12-05T09:56:58.408 INFO:tasks.workunit.client.0.smithi100.stdout:3/21: dwrite d0/f1 [0,4194304] 0 2023-12-05T09:56:58.431 INFO:tasks.workunit.client.0.smithi100.stdout:6/22: dwrite f4 [0,4194304] 0 2023-12-05T09:56:58.431 INFO:tasks.workunit.client.0.smithi100.stdout:2/14: dread f0 [0,4194304] 0 2023-12-05T09:56:58.478 INFO:tasks.workunit.client.0.smithi100.stdout:3/22: dwrite d0/f3 [0,4194304] 0 2023-12-05T09:56:58.478 INFO:tasks.workunit.client.0.smithi100.stdout:3/23: rename d0 to d0/d4/d5 22 2023-12-05T09:56:58.523 INFO:tasks.workunit.client.0.smithi100.stdout:3/24: dwrite d0/f1 [0,4194304] 0 2023-12-05T09:56:58.595 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:56:58 smithi150 ceph-mon[116142]: pgmap v15: 65 pgs: 65 active+clean; 149 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 3.8 MiB/s wr, 236 op/s 2023-12-05T09:56:59.110 INFO:tasks.workunit.client.0.smithi100.stdout:4/3: fsync f1 0 2023-12-05T09:56:59.522 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:59.523+0000 7fc006c7d700 1 -- 172.21.15.100:0/3650007579 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc000066920 msgr2=0x7fc0000ff7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:56:59.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:59.523+0000 7fc006c7d700 1 --2- 172.21.15.100:0/3650007579 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc000066920 0x7fc0000ff7a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbffc004940 tx=0x7fbffc009e30 comp rx=0 tx=0).stop 2023-12-05T09:56:59.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:59.524+0000 7fc006c7d700 1 -- 172.21.15.100:0/3650007579 shutdown_connections 2023-12-05T09:56:59.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:59.524+0000 7fc006c7d700 1 --2- 172.21.15.100:0/3650007579 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc0000ffd70 0x7fc0001021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:56:59.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:59.524+0000 7fc006c7d700 1 --2- 172.21.15.100:0/3650007579 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc000066920 0x7fc0000ff7a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:56:59.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:59.524+0000 7fc006c7d700 1 -- 172.21.15.100:0/3650007579 >> 172.21.15.100:0/3650007579 conn(0x7fc0000f71d0 msgr2=0x7fc0000f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:56:59.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:59.524+0000 7fc006c7d700 1 -- 172.21.15.100:0/3650007579 shutdown_connections 2023-12-05T09:56:59.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:59.524+0000 7fc006c7d700 1 -- 172.21.15.100:0/3650007579 wait complete. 2023-12-05T09:56:59.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:59.525+0000 7fc006c7d700 1 Processor -- start 2023-12-05T09:56:59.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:59.525+0000 7fc006c7d700 1 -- start start 2023-12-05T09:56:59.524 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:59.525+0000 7fc006c7d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc000066920 0x7fc00010d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:56:59.524 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:59.525+0000 7fc006c7d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0000ffd70 0x7fc00010d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:56:59.524 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:59.525+0000 7fc006c7d700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc00010dff0 con 0x7fc000066920 2023-12-05T09:56:59.524 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:59.525+0000 7fc006c7d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc00010e890 con 0x7fc0000ffd70 2023-12-05T09:56:59.524 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:59.526+0000 7fbff7fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0000ffd70 0x7fc00010d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:56:59.524 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:59.526+0000 7fc004a19700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc000066920 0x7fc00010d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:56:59.525 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:59.526+0000 7fbff7fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0000ffd70 0x7fc00010d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.100:33786/0 (socket says 172.21.15.100:33786) 2023-12-05T09:56:59.525 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:59.526+0000 7fbff7fff700 1 -- 172.21.15.100:0/3698368230 learned_addr learned my addr 172.21.15.100:0/3698368230 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:56:59.525 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:59.526+0000 7fbff7fff700 1 -- 172.21.15.100:0/3698368230 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc000066920 msgr2=0x7fc00010d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:56:59.525 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:59.526+0000 7fbff7fff700 1 --2- 172.21.15.100:0/3698368230 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc000066920 0x7fc00010d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:56:59.525 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:59.526+0000 7fbff7fff700 1 -- 172.21.15.100:0/3698368230 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbff0005040 con 0x7fc0000ffd70 2023-12-05T09:56:59.525 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:59.527+0000 7fbff7fff700 1 --2- 172.21.15.100:0/3698368230 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0000ffd70 0x7fc00010d9f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbff0009700 tx=0x7fbff0009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:56:59.525 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:59.527+0000 7fbff57fa700 1 -- 172.21.15.100:0/3698368230 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbff000e760 con 0x7fc0000ffd70 2023-12-05T09:56:59.525 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:59.527+0000 7fbff57fa700 1 -- 172.21.15.100:0/3698368230 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbff000f040 con 0x7fc0000ffd70 2023-12-05T09:56:59.525 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:59.527+0000 7fc006c7d700 1 -- 172.21.15.100:0/3698368230 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbffc005040 con 0x7fc0000ffd70 2023-12-05T09:56:59.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:59.527+0000 7fbff57fa700 1 -- 172.21.15.100:0/3698368230 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbff0013c70 con 0x7fc0000ffd70 2023-12-05T09:56:59.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:59.527+0000 7fc006c7d700 1 -- 172.21.15.100:0/3698368230 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc00010ee60 con 0x7fc0000ffd70 2023-12-05T09:56:59.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:59.528+0000 7fc006c7d700 1 -- 172.21.15.100:0/3698368230 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc00004bb80 con 0x7fc0000ffd70 2023-12-05T09:56:59.527 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:59.530+0000 7fbff57fa700 1 -- 172.21.15.100:0/3698368230 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 25) v1 ==== 88726+0+0 (secure 0 0 0) 0x7fbff000e8c0 con 0x7fc0000ffd70 2023-12-05T09:56:59.529 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:59.531+0000 7fbff57fa700 1 --2- 172.21.15.100:0/3698368230 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7fbfe806ae40 0x7fbfe806d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:56:59.529 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:59.531+0000 7fbff57fa700 1 -- 172.21.15.100:0/3698368230 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fbff0089530 con 0x7fc0000ffd70 2023-12-05T09:56:59.529 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:59.532+0000 7fc004a19700 1 --2- 172.21.15.100:0/3698368230 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7fbfe806ae40 0x7fbfe806d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:56:59.530 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:59.533+0000 7fc004a19700 1 --2- 172.21.15.100:0/3698368230 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7fbfe806ae40 0x7fbfe806d2f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fbffc013600 tx=0x7fbffc01c040 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:56:59.538 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:59.536+0000 7fbff57fa700 1 -- 172.21.15.100:0/3698368230 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fbff0057260 con 0x7fc0000ffd70 2023-12-05T09:56:59.920 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:59.922+0000 7fc006c7d700 1 -- 172.21.15.100:0/3698368230 --> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc00010f390 con 0x7fbfe806ae40 2023-12-05T09:56:59.922 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:59.924+0000 7fbff57fa700 1 -- 172.21.15.100:0/3698368230 <== mgr.24423 v2:172.21.15.150:6828/896268868 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7fc00010f390 con 0x7fbfe806ae40 2023-12-05T09:56:59.925 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:59.927+0000 7fc006c7d700 1 -- 172.21.15.100:0/3698368230 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7fbfe806ae40 msgr2=0x7fbfe806d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:56:59.925 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:59.927+0000 7fc006c7d700 1 --2- 172.21.15.100:0/3698368230 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7fbfe806ae40 0x7fbfe806d2f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fbffc013600 tx=0x7fbffc01c040 comp rx=0 tx=0).stop 2023-12-05T09:56:59.925 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:59.927+0000 7fc006c7d700 1 -- 172.21.15.100:0/3698368230 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0000ffd70 msgr2=0x7fc00010d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:56:59.925 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:59.927+0000 7fc006c7d700 1 --2- 172.21.15.100:0/3698368230 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0000ffd70 0x7fc00010d9f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbff0009700 tx=0x7fbff0009e30 comp rx=0 tx=0).stop 2023-12-05T09:56:59.925 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:59.927+0000 7fc006c7d700 1 -- 172.21.15.100:0/3698368230 shutdown_connections 2023-12-05T09:56:59.925 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:59.927+0000 7fc006c7d700 1 --2- 172.21.15.100:0/3698368230 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7fbfe806ae40 0x7fbfe806d2f0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:56:59.925 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:59.927+0000 7fc006c7d700 1 --2- 172.21.15.100:0/3698368230 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc000066920 0x7fc00010d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:56:59.925 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:59.927+0000 7fc006c7d700 1 --2- 172.21.15.100:0/3698368230 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0000ffd70 0x7fc00010d9f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:56:59.925 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:59.927+0000 7fc006c7d700 1 -- 172.21.15.100:0/3698368230 >> 172.21.15.100:0/3698368230 conn(0x7fc0000f71d0 msgr2=0x7fc0000f95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:56:59.925 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:59.928+0000 7fc006c7d700 1 -- 172.21.15.100:0/3698368230 shutdown_connections 2023-12-05T09:56:59.926 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:56:59.928+0000 7fc006c7d700 1 -- 172.21.15.100:0/3698368230 wait complete. 2023-12-05T09:56:59.943 INFO:teuthology.orchestra.run.smithi100.stdout:true 2023-12-05T09:57:00.125 INFO:tasks.workunit.client.0.smithi100.stdout:9/6: symlink l2 0 2023-12-05T09:57:00.131 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.133+0000 7fa4a7db9700 1 -- 172.21.15.100:0/2622778668 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4a00fd730 msgr2=0x7fa4a00ffb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:57:00.131 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.133+0000 7fa4a7db9700 1 --2- 172.21.15.100:0/2622778668 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4a00fd730 0x7fa4a00ffb10 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa49c004940 tx=0x7fa49c009e30 comp rx=0 tx=0).stop 2023-12-05T09:57:00.131 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.133+0000 7fa4a7db9700 1 -- 172.21.15.100:0/2622778668 shutdown_connections 2023-12-05T09:57:00.131 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.133+0000 7fa4a7db9700 1 --2- 172.21.15.100:0/2622778668 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4a0100050 0x7fa4a0102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:00.131 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.133+0000 7fa4a7db9700 1 --2- 172.21.15.100:0/2622778668 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4a00fd730 0x7fa4a00ffb10 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:00.131 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.133+0000 7fa4a7db9700 1 -- 172.21.15.100:0/2622778668 >> 172.21.15.100:0/2622778668 conn(0x7fa4a00f7190 msgr2=0x7fa4a00f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:57:00.132 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.134+0000 7fa4a7db9700 1 -- 172.21.15.100:0/2622778668 shutdown_connections 2023-12-05T09:57:00.132 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.134+0000 7fa4a7db9700 1 -- 172.21.15.100:0/2622778668 wait complete. 2023-12-05T09:57:00.132 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.134+0000 7fa4a7db9700 1 Processor -- start 2023-12-05T09:57:00.132 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.135+0000 7fa4a7db9700 1 -- start start 2023-12-05T09:57:00.133 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.135+0000 7fa4a7db9700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4a00fd730 0x7fa4a010d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:57:00.133 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.135+0000 7fa4a7db9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4a0100050 0x7fa4a010d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:57:00.133 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.135+0000 7fa4a7db9700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a010dfd0 con 0x7fa4a00fd730 2023-12-05T09:57:00.133 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.135+0000 7fa4a7db9700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a010e870 con 0x7fa4a0100050 2023-12-05T09:57:00.133 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.135+0000 7fa4a5b55700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4a00fd730 0x7fa4a010d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:57:00.133 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.135+0000 7fa4a5b55700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4a00fd730 0x7fa4a010d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43646/0 (socket says 172.21.15.100:43646) 2023-12-05T09:57:00.133 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.135+0000 7fa4a5b55700 1 -- 172.21.15.100:0/1212379717 learned_addr learned my addr 172.21.15.100:0/1212379717 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:57:00.133 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.135+0000 7fa4a5354700 1 --2- 172.21.15.100:0/1212379717 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4a0100050 0x7fa4a010d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:57:00.134 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.136+0000 7fa4a5b55700 1 -- 172.21.15.100:0/1212379717 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4a0100050 msgr2=0x7fa4a010d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:57:00.134 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.136+0000 7fa4a5b55700 1 --2- 172.21.15.100:0/1212379717 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4a0100050 0x7fa4a010d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:00.134 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.136+0000 7fa4a5b55700 1 -- 172.21.15.100:0/1212379717 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa49c005040 con 0x7fa4a00fd730 2023-12-05T09:57:00.134 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.136+0000 7fa4a5b55700 1 --2- 172.21.15.100:0/1212379717 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4a00fd730 0x7fa4a010d490 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fa49c008f90 tx=0x7fa49c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:57:00.134 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.136+0000 7fa4967fc700 1 -- 172.21.15.100:0/1212379717 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa49c021070 con 0x7fa4a00fd730 2023-12-05T09:57:00.135 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.136+0000 7fa4a7db9700 1 -- 172.21.15.100:0/1212379717 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4a010eaf0 con 0x7fa4a00fd730 2023-12-05T09:57:00.135 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.137+0000 7fa4967fc700 1 -- 172.21.15.100:0/1212379717 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa49c01c400 con 0x7fa4a00fd730 2023-12-05T09:57:00.135 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.137+0000 7fa4967fc700 1 -- 172.21.15.100:0/1212379717 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa49c00e030 con 0x7fa4a00fd730 2023-12-05T09:57:00.135 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.137+0000 7fa4a7db9700 1 -- 172.21.15.100:0/1212379717 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4a010f030 con 0x7fa4a00fd730 2023-12-05T09:57:00.135 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.138+0000 7fa4a7db9700 1 -- 172.21.15.100:0/1212379717 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4a004bb80 con 0x7fa4a00fd730 2023-12-05T09:57:00.136 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.139+0000 7fa4967fc700 1 -- 172.21.15.100:0/1212379717 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 25) v1 ==== 88726+0+0 (secure 0 0 0) 0x7fa49c01ca00 con 0x7fa4a00fd730 2023-12-05T09:57:00.138 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.141+0000 7fa4967fc700 1 --2- 172.21.15.100:0/1212379717 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7fa48c06f250 0x7fa48c071700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:57:00.138 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.141+0000 7fa4967fc700 1 -- 172.21.15.100:0/1212379717 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fa49c08aa60 con 0x7fa4a00fd730 2023-12-05T09:57:00.139 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.141+0000 7fa4a5354700 1 --2- 172.21.15.100:0/1212379717 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7fa48c06f250 0x7fa48c071700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:57:00.139 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.142+0000 7fa4a5354700 1 --2- 172.21.15.100:0/1212379717 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7fa48c06f250 0x7fa48c071700 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa490009b80 tx=0x7fa49000b040 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:57:00.143 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.145+0000 7fa4967fc700 1 -- 172.21.15.100:0/1212379717 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fa49c058930 con 0x7fa4a00fd730 2023-12-05T09:57:00.345 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:00 smithi150 ceph-mon[116142]: pgmap v16: 65 pgs: 65 active+clean; 149 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 3.8 MiB/s wr, 236 op/s 2023-12-05T09:57:00.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:00 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:57:00.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:00 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:57:00.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:00 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:57:00.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:00 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:57:00.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:00 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:57:00.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:00 smithi150 ceph-mon[116142]: Adjusting osd_memory_target on smithi150 to 2642M 2023-12-05T09:57:00.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:00 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:57:00.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:00 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:57:00.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:00 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:57:00.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:00 smithi150 ceph-mon[116142]: Updating smithi100:/etc/ceph/ceph.conf 2023-12-05T09:57:00.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:00 smithi150 ceph-mon[116142]: Updating smithi150:/etc/ceph/ceph.conf 2023-12-05T09:57:00.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:00 smithi150 ceph-mon[116142]: Updating smithi150:/var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-05T09:57:00.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:00 smithi150 ceph-mon[116142]: Updating smithi100:/var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-05T09:57:00.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:00 smithi100 ceph-mon[107145]: pgmap v16: 65 pgs: 65 active+clean; 149 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 3.8 MiB/s wr, 236 op/s 2023-12-05T09:57:00.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:00 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:57:00.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:00 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:57:00.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:00 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:57:00.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:00 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:57:00.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:00 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:57:00.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:00 smithi100 ceph-mon[107145]: Adjusting osd_memory_target on smithi150 to 2642M 2023-12-05T09:57:00.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:00 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:57:00.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:00 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:57:00.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:00 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:57:00.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:00 smithi100 ceph-mon[107145]: Updating smithi100:/etc/ceph/ceph.conf 2023-12-05T09:57:00.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:00 smithi100 ceph-mon[107145]: Updating smithi150:/etc/ceph/ceph.conf 2023-12-05T09:57:00.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:00 smithi100 ceph-mon[107145]: Updating smithi150:/var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-05T09:57:00.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:00 smithi100 ceph-mon[107145]: Updating smithi100:/var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-05T09:57:00.434 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.436+0000 7fa4a7db9700 1 -- 172.21.15.100:0/1212379717 --> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa4a0100cb0 con 0x7fa48c06f250 2023-12-05T09:57:00.435 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.437+0000 7fa4967fc700 1 -- 172.21.15.100:0/1212379717 <== mgr.24423 v2:172.21.15.150:6828/896268868 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7fa4a0100cb0 con 0x7fa48c06f250 2023-12-05T09:57:00.438 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.440+0000 7fa4a7db9700 1 -- 172.21.15.100:0/1212379717 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7fa48c06f250 msgr2=0x7fa48c071700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:57:00.438 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.440+0000 7fa4a7db9700 1 --2- 172.21.15.100:0/1212379717 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7fa48c06f250 0x7fa48c071700 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa490009b80 tx=0x7fa49000b040 comp rx=0 tx=0).stop 2023-12-05T09:57:00.438 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.440+0000 7fa4a7db9700 1 -- 172.21.15.100:0/1212379717 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4a00fd730 msgr2=0x7fa4a010d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:57:00.438 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.440+0000 7fa4a7db9700 1 --2- 172.21.15.100:0/1212379717 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4a00fd730 0x7fa4a010d490 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fa49c008f90 tx=0x7fa49c009e30 comp rx=0 tx=0).stop 2023-12-05T09:57:00.438 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.440+0000 7fa4a7db9700 1 -- 172.21.15.100:0/1212379717 shutdown_connections 2023-12-05T09:57:00.438 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.440+0000 7fa4a7db9700 1 --2- 172.21.15.100:0/1212379717 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7fa48c06f250 0x7fa48c071700 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:00.438 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.440+0000 7fa4a7db9700 1 --2- 172.21.15.100:0/1212379717 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4a00fd730 0x7fa4a010d490 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:00.438 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.440+0000 7fa4a7db9700 1 --2- 172.21.15.100:0/1212379717 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4a0100050 0x7fa4a010d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:00.439 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.440+0000 7fa4a7db9700 1 -- 172.21.15.100:0/1212379717 >> 172.21.15.100:0/1212379717 conn(0x7fa4a00f7190 msgr2=0x7fa4a00f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:57:00.439 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.440+0000 7fa4a7db9700 1 -- 172.21.15.100:0/1212379717 shutdown_connections 2023-12-05T09:57:00.439 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.440+0000 7fa4a7db9700 1 -- 172.21.15.100:0/1212379717 wait complete. 2023-12-05T09:57:00.583 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.585+0000 7fb916a7d700 1 -- 172.21.15.100:0/4139376374 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9100fd530 msgr2=0x7fb9100ff910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:57:00.583 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.585+0000 7fb916a7d700 1 --2- 172.21.15.100:0/4139376374 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9100fd530 0x7fb9100ff910 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb90c004940 tx=0x7fb90c009e30 comp rx=0 tx=0).stop 2023-12-05T09:57:00.583 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.585+0000 7fb916a7d700 1 -- 172.21.15.100:0/4139376374 shutdown_connections 2023-12-05T09:57:00.583 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.585+0000 7fb916a7d700 1 --2- 172.21.15.100:0/4139376374 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9100ffe50 0x7fb910102230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:00.583 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.585+0000 7fb916a7d700 1 --2- 172.21.15.100:0/4139376374 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9100fd530 0x7fb9100ff910 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:00.583 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.585+0000 7fb916a7d700 1 -- 172.21.15.100:0/4139376374 >> 172.21.15.100:0/4139376374 conn(0x7fb9100f6f70 msgr2=0x7fb9100f93e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:57:00.583 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.585+0000 7fb916a7d700 1 -- 172.21.15.100:0/4139376374 shutdown_connections 2023-12-05T09:57:00.583 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.585+0000 7fb916a7d700 1 -- 172.21.15.100:0/4139376374 wait complete. 2023-12-05T09:57:00.584 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.586+0000 7fb916a7d700 1 Processor -- start 2023-12-05T09:57:00.584 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.586+0000 7fb916a7d700 1 -- start start 2023-12-05T09:57:00.584 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.586+0000 7fb916a7d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9100fd530 0x7fb91010f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:57:00.584 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.586+0000 7fb916a7d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9100ffe50 0x7fb91010f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:57:00.584 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.586+0000 7fb916a7d700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb91010ff80 con 0x7fb9100fd530 2023-12-05T09:57:00.584 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.586+0000 7fb916a7d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb910110820 con 0x7fb9100ffe50 2023-12-05T09:57:00.584 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.587+0000 7fb915a7b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9100fd530 0x7fb91010f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:57:00.585 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.587+0000 7fb915a7b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9100fd530 0x7fb91010f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43654/0 (socket says 172.21.15.100:43654) 2023-12-05T09:57:00.585 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.587+0000 7fb915a7b700 1 -- 172.21.15.100:0/3164405441 learned_addr learned my addr 172.21.15.100:0/3164405441 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:57:00.585 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.587+0000 7fb91527a700 1 --2- 172.21.15.100:0/3164405441 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9100ffe50 0x7fb91010f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:57:00.585 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.587+0000 7fb915a7b700 1 -- 172.21.15.100:0/3164405441 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9100ffe50 msgr2=0x7fb91010f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:57:00.585 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.587+0000 7fb915a7b700 1 --2- 172.21.15.100:0/3164405441 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9100ffe50 0x7fb91010f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:00.585 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.587+0000 7fb915a7b700 1 -- 172.21.15.100:0/3164405441 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb90c005040 con 0x7fb9100fd530 2023-12-05T09:57:00.585 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.587+0000 7fb915a7b700 1 --2- 172.21.15.100:0/3164405441 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9100fd530 0x7fb91010f440 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb90c008f90 tx=0x7fb90c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:57:00.586 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.588+0000 7fb9067fc700 1 -- 172.21.15.100:0/3164405441 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb90c021070 con 0x7fb9100fd530 2023-12-05T09:57:00.586 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.588+0000 7fb9067fc700 1 -- 172.21.15.100:0/3164405441 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb90c01c400 con 0x7fb9100fd530 2023-12-05T09:57:00.586 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.588+0000 7fb916a7d700 1 -- 172.21.15.100:0/3164405441 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb910110aa0 con 0x7fb9100fd530 2023-12-05T09:57:00.586 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.588+0000 7fb9067fc700 1 -- 172.21.15.100:0/3164405441 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb90c00e030 con 0x7fb9100fd530 2023-12-05T09:57:00.586 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.588+0000 7fb916a7d700 1 -- 172.21.15.100:0/3164405441 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb910110fe0 con 0x7fb9100fd530 2023-12-05T09:57:00.586 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.589+0000 7fb916a7d700 1 -- 172.21.15.100:0/3164405441 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9100f8b30 con 0x7fb9100fd530 2023-12-05T09:57:00.588 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.590+0000 7fb9067fc700 1 -- 172.21.15.100:0/3164405441 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 25) v1 ==== 88726+0+0 (secure 0 0 0) 0x7fb90c01ca00 con 0x7fb9100fd530 2023-12-05T09:57:00.588 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.591+0000 7fb9067fc700 1 --2- 172.21.15.100:0/3164405441 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7fb8fc06ae40 0x7fb8fc06d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:57:00.589 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.591+0000 7fb9067fc700 1 -- 172.21.15.100:0/3164405441 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fb90c08aa00 con 0x7fb9100fd530 2023-12-05T09:57:00.589 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.592+0000 7fb91527a700 1 --2- 172.21.15.100:0/3164405441 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7fb8fc06ae40 0x7fb8fc06d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:57:00.590 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.592+0000 7fb91527a700 1 --2- 172.21.15.100:0/3164405441 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7fb8fc06ae40 0x7fb8fc06d2f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb900009b80 tx=0x7fb90000b040 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:57:00.594 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.596+0000 7fb9067fc700 1 -- 172.21.15.100:0/3164405441 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fb90c0588d0 con 0x7fb9100fd530 2023-12-05T09:57:00.780 INFO:tasks.workunit.client.0.smithi100.stdout:6/23: getdents d7 0 2023-12-05T09:57:00.780 INFO:tasks.workunit.client.0.smithi100.stdout:6/24: write f5 [829280,24992] 0 2023-12-05T09:57:00.784 INFO:tasks.workunit.client.0.smithi100.stdout:3/25: symlink d0/l6 0 2023-12-05T09:57:00.784 INFO:tasks.workunit.client.0.smithi100.stdout:3/26: creat d0/f7 x:0 0 0 2023-12-05T09:57:00.788 INFO:tasks.workunit.client.0.smithi100.stdout:4/4: rename f0 to f2 0 2023-12-05T09:57:00.789 INFO:tasks.workunit.client.0.smithi100.stdout:4/5: chown f2 7159 1 2023-12-05T09:57:00.789 INFO:tasks.workunit.client.0.smithi100.stdout:4/6: write f2 [645950,56823] 0 2023-12-05T09:57:00.805 INFO:tasks.workunit.client.0.smithi100.stdout:3/27: dread d0/f1 [0,4194304] 0 2023-12-05T09:57:00.825 INFO:tasks.workunit.client.0.smithi100.stdout:9/7: mknod c3 0 2023-12-05T09:57:00.825 INFO:tasks.workunit.client.0.smithi100.stdout:9/8: chown f1 201 1 2023-12-05T09:57:00.827 INFO:tasks.workunit.client.0.smithi100.stdout:1/7: unlink f3 0 2023-12-05T09:57:00.827 INFO:tasks.workunit.client.0.smithi100.stdout:1/8: creat f5 x:0 0 0 2023-12-05T09:57:00.831 INFO:tasks.workunit.client.0.smithi100.stdout:0/8: rename f0 to f1 0 2023-12-05T09:57:00.834 INFO:tasks.workunit.client.0.smithi100.stdout:2/15: rename f0 to f1 0 2023-12-05T09:57:00.837 INFO:tasks.workunit.client.0.smithi100.stdout:6/25: creat d7/f9 x:0 0 0 2023-12-05T09:57:00.842 INFO:tasks.workunit.client.0.smithi100.stdout:4/7: dwrite f1 [0,4194304] 0 2023-12-05T09:57:00.847 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.849+0000 7fb916a7d700 1 -- 172.21.15.100:0/3164405441 --> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb91002b1f0 con 0x7fb8fc06ae40 2023-12-05T09:57:00.847 INFO:tasks.workunit.client.0.smithi100.stdout:9/9: symlink l4 0 2023-12-05T09:57:00.847 INFO:tasks.workunit.client.0.smithi100.stdout:3/28: mknod d0/d4/c8 0 2023-12-05T09:57:00.856 INFO:tasks.workunit.client.0.smithi100.stdout:9/10: symlink l5 0 2023-12-05T09:57:00.858 INFO:tasks.workunit.client.0.smithi100.stdout:3/29: creat d0/d2/f9 x:0 0 0 2023-12-05T09:57:00.862 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.865+0000 7fb9067fc700 1 -- 172.21.15.100:0/3164405441 <== mgr.24423 v2:172.21.15.150:6828/896268868 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7fb91002b1f0 con 0x7fb8fc06ae40 2023-12-05T09:57:00.863 INFO:teuthology.orchestra.run.smithi100.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-05T09:57:00.864 INFO:teuthology.orchestra.run.smithi100.stdout:alertmanager.smithi100 smithi100 *:9093,9094 running (5m) 16s ago 7m 14.7M - 0.25.0 c8568f914cd2 836425c83df9 2023-12-05T09:57:00.864 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi100 smithi100 running (7m) 16s ago 7m 7822k - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 6379a3185d48 2023-12-05T09:57:00.864 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi150 smithi150 running (6m) 7s ago 6m 7826k - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 349d37092dbd 2023-12-05T09:57:00.864 INFO:teuthology.orchestra.run.smithi100.stdout:grafana.smithi100 smithi100 *:3000 running (5m) 16s ago 6m 78.2M - 9.4.7 2c41d148cca3 53cd204a480d 2023-12-05T09:57:00.864 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.akmstb smithi100 running (2m) 16s ago 2m 1314M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 6ce55c42c55b 2023-12-05T09:57:00.864 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.sqplhn smithi100 running (2m) 16s ago 2m 13.3M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc c2682d65f0c9 2023-12-05T09:57:00.864 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi150.fcnhsv smithi150 running (2m) 7s ago 2m 12.9M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 1a259762235d 2023-12-05T09:57:00.864 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi150.pcbpxm smithi150 running (2m) 7s ago 2m 12.9M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 27f730f8b9f9 2023-12-05T09:57:00.864 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi100.ehmuhg smithi100 *:9283 running (8m) 16s ago 8m 357M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc a724d569b69c 2023-12-05T09:57:00.864 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi150.zkskag smithi150 *:8443,9283 running (38s) 7s ago 6m 497M - 19.0.0-11-g3fe8d441 56dea28e5206 154eb1df84c7 2023-12-05T09:57:00.864 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi100 smithi100 running (8m) 16s ago 8m 81.5M 2048M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 8e091d6081cc 2023-12-05T09:57:00.864 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi150 smithi150 running (6m) 7s ago 6m 54.9M 2048M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 05fe70420b09 2023-12-05T09:57:00.864 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi100 smithi100 *:9100 running (7m) 16s ago 7m 9265k - 1.5.0 0da6a335fe13 14c9b3344a5a 2023-12-05T09:57:00.865 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi150 smithi150 *:9100 running (6m) 7s ago 6m 9512k - 1.5.0 0da6a335fe13 d3babc3b947c 2023-12-05T09:57:00.865 INFO:teuthology.orchestra.run.smithi100.stdout:osd.0 smithi100 running (5m) 16s ago 5m 135M 1618M 17.2.7-109-g1fd3ca3c e139fc5fd9fc c8e64a62cd47 2023-12-05T09:57:00.865 INFO:teuthology.orchestra.run.smithi100.stdout:osd.1 smithi100 running (5m) 16s ago 5m 147M 1618M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 0500895cdfc2 2023-12-05T09:57:00.865 INFO:teuthology.orchestra.run.smithi100.stdout:osd.2 smithi100 running (4m) 16s ago 4m 117M 1618M 17.2.7-109-g1fd3ca3c e139fc5fd9fc f145372c8ccc 2023-12-05T09:57:00.865 INFO:teuthology.orchestra.run.smithi100.stdout:osd.3 smithi150 running (4m) 7s ago 4m 148M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 78137d463d29 2023-12-05T09:57:00.865 INFO:teuthology.orchestra.run.smithi100.stdout:osd.4 smithi150 running (3m) 7s ago 3m 125M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc dfef9accd162 2023-12-05T09:57:00.865 INFO:teuthology.orchestra.run.smithi100.stdout:osd.5 smithi150 running (3m) 7s ago 3m 142M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc d9720b1eae0c 2023-12-05T09:57:00.865 INFO:teuthology.orchestra.run.smithi100.stdout:prometheus.smithi100 smithi100 *:9095 running (5m) 16s ago 6m 47.0M - 2.43.0 a07b618ecd1d 74a355bfd7ab 2023-12-05T09:57:00.865 INFO:tasks.workunit.client.0.smithi100.stdout:9/11: dread f1 [0,4194304] 0 2023-12-05T09:57:00.869 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.871+0000 7fb916a7d700 1 -- 172.21.15.100:0/3164405441 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7fb8fc06ae40 msgr2=0x7fb8fc06d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:57:00.869 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.871+0000 7fb916a7d700 1 --2- 172.21.15.100:0/3164405441 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7fb8fc06ae40 0x7fb8fc06d2f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb900009b80 tx=0x7fb90000b040 comp rx=0 tx=0).stop 2023-12-05T09:57:00.869 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.871+0000 7fb916a7d700 1 -- 172.21.15.100:0/3164405441 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9100fd530 msgr2=0x7fb91010f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:57:00.869 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.871+0000 7fb916a7d700 1 --2- 172.21.15.100:0/3164405441 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9100fd530 0x7fb91010f440 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb90c008f90 tx=0x7fb90c009e30 comp rx=0 tx=0).stop 2023-12-05T09:57:00.869 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.871+0000 7fb916a7d700 1 -- 172.21.15.100:0/3164405441 shutdown_connections 2023-12-05T09:57:00.870 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.871+0000 7fb916a7d700 1 --2- 172.21.15.100:0/3164405441 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7fb8fc06ae40 0x7fb8fc06d2f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:00.870 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.871+0000 7fb916a7d700 1 --2- 172.21.15.100:0/3164405441 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9100fd530 0x7fb91010f440 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:00.870 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.871+0000 7fb916a7d700 1 --2- 172.21.15.100:0/3164405441 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9100ffe50 0x7fb91010f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:00.870 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.871+0000 7fb916a7d700 1 -- 172.21.15.100:0/3164405441 >> 172.21.15.100:0/3164405441 conn(0x7fb9100f6f70 msgr2=0x7fb910100ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:57:00.870 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.872+0000 7fb916a7d700 1 -- 172.21.15.100:0/3164405441 shutdown_connections 2023-12-05T09:57:00.870 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:00.872+0000 7fb916a7d700 1 -- 172.21.15.100:0/3164405441 wait complete. 2023-12-05T09:57:00.876 INFO:tasks.workunit.client.0.smithi100.stdout:3/30: write d0/f1 [2469307,54119] 0 2023-12-05T09:57:00.881 INFO:tasks.workunit.client.0.smithi100.stdout:3/31: creat d0/d4/fa x:0 0 0 2023-12-05T09:57:00.882 INFO:tasks.workunit.client.0.smithi100.stdout:3/32: truncate d0/d2/f9 971727 0 2023-12-05T09:57:00.884 INFO:tasks.workunit.client.0.smithi100.stdout:9/12: read f1 [98624,16531] 0 2023-12-05T09:57:00.885 INFO:tasks.workunit.client.0.smithi100.stdout:3/33: mknod d0/cb 0 2023-12-05T09:57:00.886 INFO:tasks.workunit.client.0.smithi100.stdout:4/8: dwrite f2 [0,4194304] 0 2023-12-05T09:57:00.888 INFO:tasks.workunit.client.0.smithi100.stdout:9/13: mknod c6 0 2023-12-05T09:57:00.892 INFO:tasks.workunit.client.0.smithi100.stdout:6/26: dwrite f6 [0,4194304] 0 2023-12-05T09:57:00.966 INFO:tasks.workunit.client.0.smithi100.stdout:9/14: dwrite f0 [0,4194304] 0 2023-12-05T09:57:00.966 INFO:tasks.workunit.client.0.smithi100.stdout:9/15: fdatasync f0 0 2023-12-05T09:57:00.966 INFO:tasks.workunit.client.0.smithi100.stdout:9/16: fdatasync f1 0 2023-12-05T09:57:00.969 INFO:tasks.workunit.client.0.smithi100.stdout:9/17: mkdir d7 0 2023-12-05T09:57:00.969 INFO:tasks.workunit.client.0.smithi100.stdout:9/18: fdatasync f1 0 2023-12-05T09:57:00.969 INFO:tasks.workunit.client.0.smithi100.stdout:9/19: write f1 [771579,69477] 0 2023-12-05T09:57:00.973 INFO:tasks.workunit.client.0.smithi100.stdout:9/20: creat d7/f8 x:0 0 0 2023-12-05T09:57:00.974 INFO:tasks.workunit.client.0.smithi100.stdout:9/21: creat d7/f9 x:0 0 0 2023-12-05T09:57:00.977 INFO:tasks.workunit.client.0.smithi100.stdout:9/22: mknod d7/ca 0 2023-12-05T09:57:00.979 INFO:tasks.workunit.client.0.smithi100.stdout:6/27: dwrite f6 [0,4194304] 0 2023-12-05T09:57:00.981 INFO:tasks.workunit.client.0.smithi100.stdout:9/23: rename f0 to d7/fb 0 2023-12-05T09:57:00.981 INFO:tasks.workunit.client.0.smithi100.stdout:9/24: creat d7/fc x:0 0 0 2023-12-05T09:57:00.982 INFO:tasks.workunit.client.0.smithi100.stdout:6/28: mknod d7/ca 0 2023-12-05T09:57:00.985 INFO:tasks.workunit.client.0.smithi100.stdout:9/25: fsync f1 0 2023-12-05T09:57:00.985 INFO:tasks.workunit.client.0.smithi100.stdout:9/26: creat d7/fd x:0 0 0 2023-12-05T09:57:01.000 INFO:tasks.workunit.client.0.smithi100.stdout:6/29: write f6 [1148007,76718] 0 2023-12-05T09:57:01.006 INFO:tasks.workunit.client.0.smithi100.stdout:6/30: rename d7/ca to d7/cb 0 2023-12-05T09:57:01.006 INFO:tasks.workunit.client.0.smithi100.stdout:6/31: read f5 [830597,126943] 0 2023-12-05T09:57:01.049 INFO:tasks.workunit.client.0.smithi100.stdout:6/32: dwrite f6 [0,4194304] 0 2023-12-05T09:57:01.050 INFO:tasks.workunit.client.0.smithi100.stdout:6/33: chown f4 16696311 1 2023-12-05T09:57:01.050 INFO:tasks.workunit.client.0.smithi100.stdout:6/34: chown f5 389140 1 2023-12-05T09:57:01.050 INFO:tasks.workunit.client.0.smithi100.stdout:6/35: fdatasync d7/f9 0 2023-12-05T09:57:01.097 INFO:tasks.workunit.client.0.smithi100.stdout:6/36: dwrite f5 [0,4194304] 0 2023-12-05T09:57:01.097 INFO:tasks.workunit.client.0.smithi100.stdout:6/37: readlink d7/l8 0 2023-12-05T09:57:01.327 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.085+0000 7f16297f2700 1 -- 172.21.15.100:0/1174668113 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16240fcbf0 msgr2=0x7f16240fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:57:01.327 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.085+0000 7f16297f2700 1 --2- 172.21.15.100:0/1174668113 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16240fcbf0 0x7f16240fd000 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f1614004940 tx=0x7f1614009e30 comp rx=0 tx=0).stop 2023-12-05T09:57:01.328 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.085+0000 7f16297f2700 1 -- 172.21.15.100:0/1174668113 shutdown_connections 2023-12-05T09:57:01.328 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.085+0000 7f16297f2700 1 --2- 172.21.15.100:0/1174668113 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16240fde00 0x7f16240fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:01.328 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.085+0000 7f16297f2700 1 --2- 172.21.15.100:0/1174668113 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16240fcbf0 0x7f16240fd000 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:01.328 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.085+0000 7f16297f2700 1 -- 172.21.15.100:0/1174668113 >> 172.21.15.100:0/1174668113 conn(0x7f16240f82d0 msgr2=0x7f16240fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:57:01.328 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.085+0000 7f16297f2700 1 -- 172.21.15.100:0/1174668113 shutdown_connections 2023-12-05T09:57:01.328 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.085+0000 7f16297f2700 1 -- 172.21.15.100:0/1174668113 wait complete. 2023-12-05T09:57:01.328 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.086+0000 7f16297f2700 1 Processor -- start 2023-12-05T09:57:01.328 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.086+0000 7f16297f2700 1 -- start start 2023-12-05T09:57:01.328 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.086+0000 7f16297f2700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16240fcbf0 0x7f1624071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:57:01.328 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.086+0000 7f16297f2700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16240fde00 0x7f162406ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:57:01.328 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.086+0000 7f16297f2700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1624070590 con 0x7f16240fcbf0 2023-12-05T09:57:01.328 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.086+0000 7f16297f2700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1624070700 con 0x7f16240fde00 2023-12-05T09:57:01.328 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.087+0000 7f1622ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16240fcbf0 0x7f1624071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:57:01.328 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.087+0000 7f1622ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16240fcbf0 0x7f1624071b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43666/0 (socket says 172.21.15.100:43666) 2023-12-05T09:57:01.329 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.087+0000 7f1622ffd700 1 -- 172.21.15.100:0/467228208 learned_addr learned my addr 172.21.15.100:0/467228208 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:57:01.329 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.087+0000 7f16227fc700 1 --2- 172.21.15.100:0/467228208 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16240fde00 0x7f162406ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:57:01.329 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.087+0000 7f1622ffd700 1 -- 172.21.15.100:0/467228208 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16240fde00 msgr2=0x7f162406ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:57:01.329 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.087+0000 7f1622ffd700 1 --2- 172.21.15.100:0/467228208 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16240fde00 0x7f162406ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:01.329 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.087+0000 7f1622ffd700 1 -- 172.21.15.100:0/467228208 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1614005040 con 0x7f16240fcbf0 2023-12-05T09:57:01.329 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.087+0000 7f1622ffd700 1 --2- 172.21.15.100:0/467228208 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16240fcbf0 0x7f1624071b10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f1614009fd0 tx=0x7f1614009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:57:01.329 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.087+0000 7f160b7fe700 1 -- 172.21.15.100:0/467228208 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1614021070 con 0x7f16240fcbf0 2023-12-05T09:57:01.329 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.087+0000 7f160b7fe700 1 -- 172.21.15.100:0/467228208 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f161401c400 con 0x7f16240fcbf0 2023-12-05T09:57:01.329 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.087+0000 7f160b7fe700 1 -- 172.21.15.100:0/467228208 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f161400e070 con 0x7f16240fcbf0 2023-12-05T09:57:01.329 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.087+0000 7f16297f2700 1 -- 172.21.15.100:0/467228208 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1624070980 con 0x7f16240fcbf0 2023-12-05T09:57:01.329 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.088+0000 7f16297f2700 1 -- 172.21.15.100:0/467228208 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1624115500 con 0x7f16240fcbf0 2023-12-05T09:57:01.329 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.088+0000 7f16297f2700 1 -- 172.21.15.100:0/467228208 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f162404bb80 con 0x7f16240fcbf0 2023-12-05T09:57:01.329 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.091+0000 7f160b7fe700 1 -- 172.21.15.100:0/467228208 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 25) v1 ==== 88726+0+0 (secure 0 0 0) 0x7f161401c9c0 con 0x7f16240fcbf0 2023-12-05T09:57:01.329 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.091+0000 7f160b7fe700 1 --2- 172.21.15.100:0/467228208 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7f160c06ae40 0x7f160c06d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:57:01.330 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.092+0000 7f160b7fe700 1 -- 172.21.15.100:0/467228208 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f161408b550 con 0x7f16240fcbf0 2023-12-05T09:57:01.330 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.092+0000 7f16227fc700 1 --2- 172.21.15.100:0/467228208 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7f160c06ae40 0x7f160c06d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:57:01.330 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.093+0000 7f16227fc700 1 --2- 172.21.15.100:0/467228208 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7f160c06ae40 0x7f160c06d2f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1618009b80 tx=0x7f161800b040 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:57:01.330 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.095+0000 7f160b7fe700 1 -- 172.21.15.100:0/467228208 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f16140593c0 con 0x7f16240fcbf0 2023-12-05T09:57:01.330 INFO:tasks.workunit.client.0.smithi100.stdout:6/38: mknod d7/cc 0 2023-12-05T09:57:01.332 INFO:tasks.workunit.client.0.smithi100.stdout:6/39: mkdir d7/dd 0 2023-12-05T09:57:01.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:01 smithi150 ceph-mon[116142]: from='client.24483 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:57:01.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:01 smithi150 ceph-mon[116142]: Updating smithi150:/etc/ceph/ceph.client.admin.keyring 2023-12-05T09:57:01.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:01 smithi150 ceph-mon[116142]: from='client.14684 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:57:01.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:01 smithi150 ceph-mon[116142]: Updating smithi150:/var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-05T09:57:01.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:01 smithi150 ceph-mon[116142]: from='client.14688 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:57:01.351 INFO:tasks.workunit.client.0.smithi100.stdout:6/40: read f4 [1482786,80862] 0 2023-12-05T09:57:01.351 INFO:tasks.workunit.client.0.smithi100.stdout:6/41: truncate f3 788752 0 2023-12-05T09:57:01.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:01 smithi100 ceph-mon[107145]: from='client.24483 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:57:01.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:01 smithi100 ceph-mon[107145]: Updating smithi150:/etc/ceph/ceph.client.admin.keyring 2023-12-05T09:57:01.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:01 smithi100 ceph-mon[107145]: from='client.14684 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:57:01.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:01 smithi100 ceph-mon[107145]: Updating smithi150:/var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-05T09:57:01.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:01 smithi100 ceph-mon[107145]: from='client.14688 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:57:01.424 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.426+0000 7f16297f2700 1 -- 172.21.15.100:0/467228208 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1624105590 con 0x7f16240fcbf0 2023-12-05T09:57:01.425 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.427+0000 7f160b7fe700 1 -- 172.21.15.100:0/467228208 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+840 (secure 0 0 0) 0x7f1614058f50 con 0x7f16240fcbf0 2023-12-05T09:57:01.425 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2023-12-05T09:57:01.425 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": { 2023-12-05T09:57:01.425 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 2 2023-12-05T09:57:01.425 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-12-05T09:57:01.425 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": { 2023-12-05T09:57:01.425 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 1, 2023-12-05T09:57:01.425 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 1 2023-12-05T09:57:01.425 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-12-05T09:57:01.425 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": { 2023-12-05T09:57:01.426 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 6 2023-12-05T09:57:01.426 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-12-05T09:57:01.426 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": { 2023-12-05T09:57:01.426 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 4 2023-12-05T09:57:01.426 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-12-05T09:57:01.426 INFO:teuthology.orchestra.run.smithi100.stdout: "overall": { 2023-12-05T09:57:01.426 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 13, 2023-12-05T09:57:01.426 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 1 2023-12-05T09:57:01.426 INFO:teuthology.orchestra.run.smithi100.stdout: } 2023-12-05T09:57:01.426 INFO:teuthology.orchestra.run.smithi100.stdout:} 2023-12-05T09:57:01.428 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.430+0000 7f16297f2700 1 -- 172.21.15.100:0/467228208 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7f160c06ae40 msgr2=0x7f160c06d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:57:01.428 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.430+0000 7f16297f2700 1 --2- 172.21.15.100:0/467228208 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7f160c06ae40 0x7f160c06d2f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1618009b80 tx=0x7f161800b040 comp rx=0 tx=0).stop 2023-12-05T09:57:01.428 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.430+0000 7f16297f2700 1 -- 172.21.15.100:0/467228208 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16240fcbf0 msgr2=0x7f1624071b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:57:01.428 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.430+0000 7f16297f2700 1 --2- 172.21.15.100:0/467228208 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16240fcbf0 0x7f1624071b10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f1614009fd0 tx=0x7f1614009e30 comp rx=0 tx=0).stop 2023-12-05T09:57:01.428 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.430+0000 7f16297f2700 1 -- 172.21.15.100:0/467228208 shutdown_connections 2023-12-05T09:57:01.428 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.430+0000 7f16297f2700 1 --2- 172.21.15.100:0/467228208 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7f160c06ae40 0x7f160c06d2f0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:01.428 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.430+0000 7f16297f2700 1 --2- 172.21.15.100:0/467228208 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16240fcbf0 0x7f1624071b10 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:01.428 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.430+0000 7f16297f2700 1 --2- 172.21.15.100:0/467228208 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16240fde00 0x7f162406ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:01.428 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.430+0000 7f16297f2700 1 -- 172.21.15.100:0/467228208 >> 172.21.15.100:0/467228208 conn(0x7f16240f82d0 msgr2=0x7f1624101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:57:01.428 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.430+0000 7f16297f2700 1 -- 172.21.15.100:0/467228208 shutdown_connections 2023-12-05T09:57:01.429 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.431+0000 7f16297f2700 1 -- 172.21.15.100:0/467228208 wait complete. 2023-12-05T09:57:01.593 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.595+0000 7f5a19664700 1 -- 172.21.15.100:0/1404741399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a1406e210 msgr2=0x7f5a1406e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:57:01.593 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.595+0000 7f5a19664700 1 --2- 172.21.15.100:0/1404741399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a1406e210 0x7f5a1406e620 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f5a04004940 tx=0x7f5a04009e30 comp rx=0 tx=0).stop 2023-12-05T09:57:01.593 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.595+0000 7f5a19664700 1 -- 172.21.15.100:0/1404741399 shutdown_connections 2023-12-05T09:57:01.593 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.595+0000 7f5a19664700 1 --2- 172.21.15.100:0/1404741399 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a1406eb60 0x7f5a1410ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:01.593 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.595+0000 7f5a19664700 1 --2- 172.21.15.100:0/1404741399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a1406e210 0x7f5a1406e620 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:01.593 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.595+0000 7f5a19664700 1 -- 172.21.15.100:0/1404741399 >> 172.21.15.100:0/1404741399 conn(0x7f5a14069b20 msgr2=0x7f5a1406bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:57:01.593 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.595+0000 7f5a19664700 1 -- 172.21.15.100:0/1404741399 shutdown_connections 2023-12-05T09:57:01.593 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.595+0000 7f5a19664700 1 -- 172.21.15.100:0/1404741399 wait complete. 2023-12-05T09:57:01.594 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.596+0000 7f5a19664700 1 Processor -- start 2023-12-05T09:57:01.594 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.596+0000 7f5a19664700 1 -- start start 2023-12-05T09:57:01.595 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.597+0000 7f5a19664700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a1406e210 0x7f5a14113af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:57:01.595 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.597+0000 7f5a19664700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a1406eb60 0x7f5a14114030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:57:01.595 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.597+0000 7f5a19664700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a14114630 con 0x7f5a1406eb60 2023-12-05T09:57:01.595 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.597+0000 7f5a19664700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a14114ed0 con 0x7f5a1406e210 2023-12-05T09:57:01.595 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.597+0000 7f5a127fc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a1406eb60 0x7f5a14114030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:57:01.595 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.597+0000 7f5a12ffd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a1406e210 0x7f5a14113af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:57:01.595 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.597+0000 7f5a127fc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a1406eb60 0x7f5a14114030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43686/0 (socket says 172.21.15.100:43686) 2023-12-05T09:57:01.595 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.597+0000 7f5a127fc700 1 -- 172.21.15.100:0/4219793367 learned_addr learned my addr 172.21.15.100:0/4219793367 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:57:01.595 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.597+0000 7f5a12ffd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a1406e210 0x7f5a14113af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.100:41144/0 (socket says 172.21.15.100:41144) 2023-12-05T09:57:01.596 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.597+0000 7f5a127fc700 1 -- 172.21.15.100:0/4219793367 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a1406e210 msgr2=0x7f5a14113af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:57:01.596 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.597+0000 7f5a127fc700 1 --2- 172.21.15.100:0/4219793367 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a1406e210 0x7f5a14113af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:01.596 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.598+0000 7f5a127fc700 1 -- 172.21.15.100:0/4219793367 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a04005040 con 0x7f5a1406eb60 2023-12-05T09:57:01.596 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.598+0000 7f5a12ffd700 1 --2- 172.21.15.100:0/4219793367 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a1406e210 0x7f5a14113af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-05T09:57:01.596 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.598+0000 7f5a127fc700 1 --2- 172.21.15.100:0/4219793367 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a1406eb60 0x7f5a14114030 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f5a0800edd0 tx=0x7f5a08011040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:57:01.596 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.598+0000 7f59fb7fe700 1 -- 172.21.15.100:0/4219793367 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a08014040 con 0x7f5a1406eb60 2023-12-05T09:57:01.597 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.598+0000 7f59fb7fe700 1 -- 172.21.15.100:0/4219793367 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5a08012df0 con 0x7f5a1406eb60 2023-12-05T09:57:01.597 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.598+0000 7f59fb7fe700 1 -- 172.21.15.100:0/4219793367 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a08018400 con 0x7f5a1406eb60 2023-12-05T09:57:01.597 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.598+0000 7f5a19664700 1 -- 172.21.15.100:0/4219793367 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a14115150 con 0x7f5a1406eb60 2023-12-05T09:57:01.597 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.599+0000 7f5a19664700 1 -- 172.21.15.100:0/4219793367 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a14115640 con 0x7f5a1406eb60 2023-12-05T09:57:01.597 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.600+0000 7f5a19664700 1 -- 172.21.15.100:0/4219793367 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a1410dc00 con 0x7f5a1406eb60 2023-12-05T09:57:01.599 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.601+0000 7f59fb7fe700 1 -- 172.21.15.100:0/4219793367 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 25) v1 ==== 88726+0+0 (secure 0 0 0) 0x7f5a08012940 con 0x7f5a1406eb60 2023-12-05T09:57:01.600 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.603+0000 7f59fb7fe700 1 --2- 172.21.15.100:0/4219793367 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7f59fc06ae40 0x7f59fc06d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:57:01.600 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.603+0000 7f59fb7fe700 1 -- 172.21.15.100:0/4219793367 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f5a0808d4c0 con 0x7f5a1406eb60 2023-12-05T09:57:01.601 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.603+0000 7f5a12ffd700 1 --2- 172.21.15.100:0/4219793367 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7f59fc06ae40 0x7f59fc06d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:57:01.601 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.604+0000 7f5a12ffd700 1 --2- 172.21.15.100:0/4219793367 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7f59fc06ae40 0x7f59fc06d2f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5a0400b0d0 tx=0x7f5a04009e30 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:57:01.604 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.607+0000 7f59fb7fe700 1 -- 172.21.15.100:0/4219793367 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f5a08052ce0 con 0x7f5a1406eb60 2023-12-05T09:57:02.014 INFO:teuthology.orchestra.run.smithi100.stdout:e13 2023-12-05T09:57:02.014 INFO:teuthology.orchestra.run.smithi100.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-05T09:57:02.014 INFO:teuthology.orchestra.run.smithi100.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T09:57:02.014 INFO:teuthology.orchestra.run.smithi100.stdout:legacy client fscid: 1 2023-12-05T09:57:02.014 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:57:02.014 INFO:teuthology.orchestra.run.smithi100.stdout:Filesystem 'cephfs' (1) 2023-12-05T09:57:02.014 INFO:teuthology.orchestra.run.smithi100.stdout:fs_name cephfs 2023-12-05T09:57:02.014 INFO:teuthology.orchestra.run.smithi100.stdout:epoch 13 2023-12-05T09:57:02.014 INFO:teuthology.orchestra.run.smithi100.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-05T09:57:02.014 INFO:teuthology.orchestra.run.smithi100.stdout:created 2023-12-05T09:54:30.515778+0000 2023-12-05T09:57:02.015 INFO:teuthology.orchestra.run.smithi100.stdout:modified 2023-12-05T09:54:46.403009+0000 2023-12-05T09:57:02.015 INFO:teuthology.orchestra.run.smithi100.stdout:tableserver 0 2023-12-05T09:57:02.015 INFO:teuthology.orchestra.run.smithi100.stdout:root 0 2023-12-05T09:57:02.015 INFO:teuthology.orchestra.run.smithi100.stdout:session_timeout 60 2023-12-05T09:57:02.015 INFO:teuthology.orchestra.run.smithi100.stdout:session_autoclose 300 2023-12-05T09:57:02.015 INFO:teuthology.orchestra.run.smithi100.stdout:max_file_size 1099511627776 2023-12-05T09:57:02.015 INFO:teuthology.orchestra.run.smithi100.stdout:required_client_features {} 2023-12-05T09:57:02.015 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure 0 2023-12-05T09:57:02.015 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure_osd_epoch 46 2023-12-05T09:57:02.015 INFO:teuthology.orchestra.run.smithi100.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T09:57:02.015 INFO:teuthology.orchestra.run.smithi100.stdout:max_mds 1 2023-12-05T09:57:02.015 INFO:teuthology.orchestra.run.smithi100.stdout:in 0 2023-12-05T09:57:02.015 INFO:teuthology.orchestra.run.smithi100.stdout:up {0=14490} 2023-12-05T09:57:02.015 INFO:teuthology.orchestra.run.smithi100.stdout:failed 2023-12-05T09:57:02.015 INFO:teuthology.orchestra.run.smithi100.stdout:damaged 2023-12-05T09:57:02.015 INFO:teuthology.orchestra.run.smithi100.stdout:stopped 2023-12-05T09:57:02.016 INFO:teuthology.orchestra.run.smithi100.stdout:data_pools [3] 2023-12-05T09:57:02.016 INFO:teuthology.orchestra.run.smithi100.stdout:metadata_pool 2 2023-12-05T09:57:02.016 INFO:teuthology.orchestra.run.smithi100.stdout:inline_data disabled 2023-12-05T09:57:02.016 INFO:teuthology.orchestra.run.smithi100.stdout:balancer 2023-12-05T09:57:02.016 INFO:teuthology.orchestra.run.smithi100.stdout:standby_count_wanted 1 2023-12-05T09:57:02.016 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi100.akmstb{0:14490} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.100:6828/627555128,v1:172.21.15.100:6829/627555128] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:57:02.016 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:57:02.016 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:57:02.016 INFO:teuthology.orchestra.run.smithi100.stdout:Standby daemons: 2023-12-05T09:57:02.016 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:57:02.016 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi150.pcbpxm{-1:14486} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.150:6824/3645854543,v1:172.21.15.150:6825/3645854543] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:57:02.016 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi150.fcnhsv{-1:14498} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.150:6826/3249949736,v1:172.21.15.150:6827/3249949736] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:57:02.016 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi100.sqplhn{-1:14506} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.100:6826/2472212864,v1:172.21.15.100:6827/2472212864] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:57:02.017 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.881+0000 7f5a19664700 1 -- 172.21.15.100:0/4219793367 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5a1404bb80 con 0x7f5a1406eb60 2023-12-05T09:57:02.018 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.882+0000 7f59fb7fe700 1 -- 172.21.15.100:0/4219793367 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1814 (secure 0 0 0) 0x7f5a0805b2a0 con 0x7f5a1406eb60 2023-12-05T09:57:02.018 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.884+0000 7f5a19664700 1 -- 172.21.15.100:0/4219793367 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7f59fc06ae40 msgr2=0x7f59fc06d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:57:02.018 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.884+0000 7f5a19664700 1 --2- 172.21.15.100:0/4219793367 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7f59fc06ae40 0x7f59fc06d2f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5a0400b0d0 tx=0x7f5a04009e30 comp rx=0 tx=0).stop 2023-12-05T09:57:02.018 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.884+0000 7f5a19664700 1 -- 172.21.15.100:0/4219793367 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a1406eb60 msgr2=0x7f5a14114030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:57:02.018 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.884+0000 7f5a19664700 1 --2- 172.21.15.100:0/4219793367 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a1406eb60 0x7f5a14114030 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f5a0800edd0 tx=0x7f5a08011040 comp rx=0 tx=0).stop 2023-12-05T09:57:02.018 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.884+0000 7f5a19664700 1 -- 172.21.15.100:0/4219793367 shutdown_connections 2023-12-05T09:57:02.018 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.884+0000 7f5a19664700 1 --2- 172.21.15.100:0/4219793367 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7f59fc06ae40 0x7f59fc06d2f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:02.018 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.884+0000 7f5a19664700 1 --2- 172.21.15.100:0/4219793367 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a1406e210 0x7f5a14113af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:02.018 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.884+0000 7f5a19664700 1 --2- 172.21.15.100:0/4219793367 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a1406eb60 0x7f5a14114030 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:02.018 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.884+0000 7f5a19664700 1 -- 172.21.15.100:0/4219793367 >> 172.21.15.100:0/4219793367 conn(0x7f5a14069b20 msgr2=0x7f5a141096f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:57:02.018 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.884+0000 7f5a19664700 1 -- 172.21.15.100:0/4219793367 shutdown_connections 2023-12-05T09:57:02.018 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:01.884+0000 7f5a19664700 1 -- 172.21.15.100:0/4219793367 wait complete. 2023-12-05T09:57:02.019 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 13 2023-12-05T09:57:02.019 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.018+0000 7fcb316a1700 1 -- 172.21.15.100:0/4226283039 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb2c100050 msgr2=0x7fcb2c102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:57:02.019 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.018+0000 7fcb316a1700 1 --2- 172.21.15.100:0/4226283039 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb2c100050 0x7fcb2c102430 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fcb20004940 tx=0x7fcb20009e30 comp rx=0 tx=0).stop 2023-12-05T09:57:02.019 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.018+0000 7fcb316a1700 1 -- 172.21.15.100:0/4226283039 shutdown_connections 2023-12-05T09:57:02.019 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.018+0000 7fcb316a1700 1 --2- 172.21.15.100:0/4226283039 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb2c100050 0x7fcb2c102430 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:02.019 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.018+0000 7fcb316a1700 1 --2- 172.21.15.100:0/4226283039 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcb2c0fd730 0x7fcb2c0ffb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:02.019 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.018+0000 7fcb316a1700 1 -- 172.21.15.100:0/4226283039 >> 172.21.15.100:0/4226283039 conn(0x7fcb2c0f7190 msgr2=0x7fcb2c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:57:02.019 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.018+0000 7fcb316a1700 1 -- 172.21.15.100:0/4226283039 shutdown_connections 2023-12-05T09:57:02.019 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.019+0000 7fcb316a1700 1 -- 172.21.15.100:0/4226283039 wait complete. 2023-12-05T09:57:02.019 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.019+0000 7fcb316a1700 1 Processor -- start 2023-12-05T09:57:02.019 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.020+0000 7fcb316a1700 1 -- start start 2023-12-05T09:57:02.021 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.021+0000 7fcb316a1700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcb2c0fd730 0x7fcb2c10f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:57:02.021 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.021+0000 7fcb316a1700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb2c100050 0x7fcb2c10fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:57:02.021 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.021+0000 7fcb316a1700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb2c1101f0 con 0x7fcb2c100050 2023-12-05T09:57:02.021 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.021+0000 7fcb316a1700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb2c110a90 con 0x7fcb2c0fd730 2023-12-05T09:57:02.022 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.021+0000 7fcb2a7fc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb2c100050 0x7fcb2c10fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:57:02.022 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.021+0000 7fcb2a7fc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb2c100050 0x7fcb2c10fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43704/0 (socket says 172.21.15.100:43704) 2023-12-05T09:57:02.022 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.021+0000 7fcb2a7fc700 1 -- 172.21.15.100:0/2751600913 learned_addr learned my addr 172.21.15.100:0/2751600913 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:57:02.022 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.021+0000 7fcb2affd700 1 --2- 172.21.15.100:0/2751600913 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcb2c0fd730 0x7fcb2c10f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:57:02.022 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.022+0000 7fcb2a7fc700 1 -- 172.21.15.100:0/2751600913 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcb2c0fd730 msgr2=0x7fcb2c10f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:57:02.022 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.022+0000 7fcb2a7fc700 1 --2- 172.21.15.100:0/2751600913 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcb2c0fd730 0x7fcb2c10f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:02.022 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.022+0000 7fcb2a7fc700 1 -- 172.21.15.100:0/2751600913 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb20005040 con 0x7fcb2c100050 2023-12-05T09:57:02.022 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.022+0000 7fcb2affd700 1 --2- 172.21.15.100:0/2751600913 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcb2c0fd730 0x7fcb2c10f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-05T09:57:02.022 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.022+0000 7fcb2a7fc700 1 --2- 172.21.15.100:0/2751600913 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb2c100050 0x7fcb2c10fbf0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fcb20000c00 tx=0x7fcb20009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:57:02.022 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.023+0000 7fcb137fe700 1 -- 172.21.15.100:0/2751600913 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb2000e030 con 0x7fcb2c100050 2023-12-05T09:57:02.022 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.023+0000 7fcb316a1700 1 -- 172.21.15.100:0/2751600913 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb2c110d10 con 0x7fcb2c100050 2023-12-05T09:57:02.022 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.023+0000 7fcb137fe700 1 -- 172.21.15.100:0/2751600913 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcb2002d410 con 0x7fcb2c100050 2023-12-05T09:57:02.022 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.023+0000 7fcb137fe700 1 -- 172.21.15.100:0/2751600913 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb2000b630 con 0x7fcb2c100050 2023-12-05T09:57:02.023 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.023+0000 7fcb316a1700 1 -- 172.21.15.100:0/2751600913 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb2c111250 con 0x7fcb2c100050 2023-12-05T09:57:02.024 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.026+0000 7fcb137fe700 1 -- 172.21.15.100:0/2751600913 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 25) v1 ==== 88726+0+0 (secure 0 0 0) 0x7fcb2002d580 con 0x7fcb2c100050 2023-12-05T09:57:02.024 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.026+0000 7fcb316a1700 1 -- 172.21.15.100:0/2751600913 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb2c04bb80 con 0x7fcb2c100050 2023-12-05T09:57:02.026 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.028+0000 7fcb137fe700 1 --2- 172.21.15.100:0/2751600913 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7fcb1406ae40 0x7fcb1406d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:57:02.026 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.028+0000 7fcb137fe700 1 -- 172.21.15.100:0/2751600913 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fcb2009bbe0 con 0x7fcb2c100050 2023-12-05T09:57:02.026 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.029+0000 7fcb2affd700 1 --2- 172.21.15.100:0/2751600913 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7fcb1406ae40 0x7fcb1406d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:57:02.027 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.029+0000 7fcb2affd700 1 --2- 172.21.15.100:0/2751600913 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7fcb1406ae40 0x7fcb1406d2f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c009b80 tx=0x7fcb1c00b040 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:57:02.031 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.034+0000 7fcb137fe700 1 -- 172.21.15.100:0/2751600913 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fcb20069ab0 con 0x7fcb2c100050 2023-12-05T09:57:02.072 INFO:tasks.workunit.client.0.smithi100.stdout:0/9: link f1 f2 0 2023-12-05T09:57:02.073 INFO:tasks.workunit.client.0.smithi100.stdout:0/10: mknod c3 0 2023-12-05T09:57:02.074 INFO:tasks.workunit.client.0.smithi100.stdout:0/11: link c3 c4 0 2023-12-05T09:57:02.075 INFO:tasks.workunit.client.0.smithi100.stdout:2/16: rename f1 to f2 0 2023-12-05T09:57:02.077 INFO:tasks.workunit.client.0.smithi100.stdout:2/17: mknod c3 0 2023-12-05T09:57:02.086 INFO:tasks.workunit.client.0.smithi100.stdout:3/34: rmdir d0/d2 39 2023-12-05T09:57:02.086 INFO:tasks.workunit.client.0.smithi100.stdout:3/35: creat d0/d4/fc x:0 0 0 2023-12-05T09:57:02.086 INFO:tasks.workunit.client.0.smithi100.stdout:3/36: chown d0/l6 0 1 2023-12-05T09:57:02.086 INFO:tasks.workunit.client.0.smithi100.stdout:3/37: readlink d0/l6 0 2023-12-05T09:57:02.086 INFO:tasks.workunit.client.0.smithi100.stdout:3/38: stat d0/f7 0 2023-12-05T09:57:02.089 INFO:tasks.workunit.client.0.smithi100.stdout:3/39: creat d0/d2/fd x:0 0 0 2023-12-05T09:57:02.089 INFO:tasks.workunit.client.0.smithi100.stdout:3/40: stat d0/d4/fc 0 2023-12-05T09:57:02.093 INFO:tasks.workunit.client.0.smithi100.stdout:2/18: read f2 [490896,40916] 0 2023-12-05T09:57:02.136 INFO:tasks.workunit.client.0.smithi100.stdout:4/9: dwrite f2 [4194304,4194304] 0 2023-12-05T09:57:02.136 INFO:tasks.workunit.client.0.smithi100.stdout:4/10: readlink - no filename 2023-12-05T09:57:02.136 INFO:tasks.workunit.client.0.smithi100.stdout:9/27: fsync d7/fc 0 2023-12-05T09:57:02.137 INFO:tasks.workunit.client.0.smithi100.stdout:4/11: mknod c3 0 2023-12-05T09:57:02.139 INFO:tasks.workunit.client.0.smithi100.stdout:9/28: mknod d7/ce 0 2023-12-05T09:57:02.139 INFO:tasks.workunit.client.0.smithi100.stdout:9/29: chown l5 3 1 2023-12-05T09:57:02.140 INFO:tasks.workunit.client.0.smithi100.stdout:4/12: symlink l4 0 2023-12-05T09:57:02.156 INFO:tasks.workunit.client.0.smithi100.stdout:9/30: dread d7/fb [0,4194304] 0 2023-12-05T09:57:02.156 INFO:tasks.workunit.client.0.smithi100.stdout:9/31: creat d7/ff x:0 0 0 2023-12-05T09:57:02.156 INFO:tasks.workunit.client.0.smithi100.stdout:9/32: truncate d7/f9 119364 0 2023-12-05T09:57:02.156 INFO:tasks.workunit.client.0.smithi100.stdout:9/33: chown d7/fc 21 1 2023-12-05T09:57:02.171 INFO:tasks.workunit.client.0.smithi100.stdout:6/42: getdents d7 0 2023-12-05T09:57:02.171 INFO:tasks.workunit.client.0.smithi100.stdout:6/43: readlink d7/l8 0 2023-12-05T09:57:02.172 INFO:tasks.workunit.client.0.smithi100.stdout:6/44: rmdir d7/dd 0 2023-12-05T09:57:02.192 INFO:tasks.workunit.client.0.smithi100.stdout:6/45: write f5 [85693,54148] 0 2023-12-05T09:57:02.192 INFO:tasks.workunit.client.0.smithi100.stdout:6/46: chown d7 75959 1 2023-12-05T09:57:02.193 INFO:tasks.workunit.client.0.smithi100.stdout:6/47: read f3 [726640,4879] 0 2023-12-05T09:57:02.197 INFO:tasks.workunit.client.0.smithi100.stdout:6/48: rename f6 to d7/fe 0 2023-12-05T09:57:02.199 INFO:tasks.workunit.client.0.smithi100.stdout:6/49: creat d7/ff x:0 0 0 2023-12-05T09:57:02.200 INFO:tasks.workunit.client.0.smithi100.stdout:6/50: creat d7/f10 x:0 0 0 2023-12-05T09:57:02.202 INFO:tasks.workunit.client.0.smithi100.stdout:6/51: unlink d7/f9 0 2023-12-05T09:57:02.202 INFO:tasks.workunit.client.0.smithi100.stdout:6/52: readlink l0 0 2023-12-05T09:57:02.269 INFO:tasks.workunit.client.0.smithi100.stdout:0/12: fsync f2 0 2023-12-05T09:57:02.273 INFO:tasks.workunit.client.0.smithi100.stdout:0/13: rename c4 to c5 0 2023-12-05T09:57:02.274 INFO:tasks.workunit.client.0.smithi100.stdout:0/14: write f2 [6011546,70587] 0 2023-12-05T09:57:02.275 INFO:tasks.workunit.client.0.smithi100.stdout:2/19: rename f2 to f4 0 2023-12-05T09:57:02.275 INFO:tasks.workunit.client.0.smithi100.stdout:2/20: read f4 [1903247,23179] 0 2023-12-05T09:57:02.275 INFO:tasks.workunit.client.0.smithi100.stdout:2/21: write f4 [967161,18716] 0 2023-12-05T09:57:02.275 INFO:tasks.workunit.client.0.smithi100.stdout:2/22: chown f4 1616 1 2023-12-05T09:57:02.275 INFO:tasks.workunit.client.0.smithi100.stdout:2/23: creat f5 x:0 0 0 2023-12-05T09:57:02.275 INFO:tasks.workunit.client.0.smithi100.stdout:2/24: write f4 [1893423,78636] 0 2023-12-05T09:57:02.277 INFO:tasks.workunit.client.0.smithi100.stdout:0/15: symlink l6 0 2023-12-05T09:57:02.278 INFO:tasks.workunit.client.0.smithi100.stdout:0/16: creat f7 x:0 0 0 2023-12-05T09:57:02.278 INFO:tasks.workunit.client.0.smithi100.stdout:3/41: getdents d0/d4 0 2023-12-05T09:57:02.282 INFO:tasks.workunit.client.0.smithi100.stdout:2/25: mknod c6 0 2023-12-05T09:57:02.282 INFO:tasks.workunit.client.0.smithi100.stdout:2/26: write f5 [23156,81255] 0 2023-12-05T09:57:02.284 INFO:tasks.workunit.client.0.smithi100.stdout:4/13: truncate f2 7838129 0 2023-12-05T09:57:02.286 INFO:tasks.workunit.client.0.smithi100.stdout:9/34: getdents d7 0 2023-12-05T09:57:02.288 INFO:tasks.workunit.client.0.smithi100.stdout:3/42: mkdir d0/d2/de 0 2023-12-05T09:57:02.288 INFO:tasks.workunit.client.0.smithi100.stdout:3/43: truncate d0/f7 451468 0 2023-12-05T09:57:02.290 INFO:tasks.workunit.client.0.smithi100.stdout:6/53: truncate f5 2855391 0 2023-12-05T09:57:02.290 INFO:tasks.workunit.client.0.smithi100.stdout:6/54: write d7/f10 [536087,13237] 0 2023-12-05T09:57:02.293 INFO:tasks.workunit.client.0.smithi100.stdout:2/27: mkdir d7 0 2023-12-05T09:57:02.297 INFO:tasks.workunit.client.0.smithi100.stdout:9/35: mkdir d7/d10 0 2023-12-05T09:57:02.297 INFO:tasks.workunit.client.0.smithi100.stdout:9/36: write d7/fb [4634887,123136] 0 2023-12-05T09:57:02.297 INFO:tasks.workunit.client.0.smithi100.stdout:9/37: fdatasync d7/ff 0 2023-12-05T09:57:02.297 INFO:tasks.workunit.client.0.smithi100.stdout:9/38: truncate d7/fd 921842 0 2023-12-05T09:57:02.301 INFO:tasks.workunit.client.0.smithi100.stdout:3/44: rename d0/d4/c8 to d0/cf 0 2023-12-05T09:57:02.301 INFO:tasks.workunit.client.0.smithi100.stdout:3/45: truncate d0/d2/f9 1489932 0 2023-12-05T09:57:02.303 INFO:tasks.workunit.client.0.smithi100.stdout:4/14: write f1 [2530888,12434] 0 2023-12-05T09:57:02.303 INFO:tasks.workunit.client.0.smithi100.stdout:4/15: fdatasync f2 0 2023-12-05T09:57:02.303 INFO:tasks.workunit.client.0.smithi100.stdout:4/16: readlink l4 0 2023-12-05T09:57:02.304 INFO:tasks.workunit.client.0.smithi100.stdout:2/28: creat d7/f8 x:0 0 0 2023-12-05T09:57:02.305 INFO:tasks.workunit.client.0.smithi100.stdout:2/29: write f5 [131576,6281] 0 2023-12-05T09:57:02.310 INFO:tasks.workunit.client.0.smithi100.stdout:9/39: creat d7/d10/f11 x:0 0 0 2023-12-05T09:57:02.310 INFO:tasks.workunit.client.0.smithi100.stdout:9/40: dread - d7/d10/f11 zero size 2023-12-05T09:57:02.317 INFO:tasks.workunit.client.0.smithi100.stdout:3/46: mkdir d0/d10 0 2023-12-05T09:57:02.322 INFO:tasks.workunit.client.0.smithi100.stdout:4/17: mknod c5 0 2023-12-05T09:57:02.330 INFO:tasks.workunit.client.0.smithi100.stdout:9/41: link l4 d7/d10/l12 0 2023-12-05T09:57:02.338 INFO:tasks.workunit.client.0.smithi100.stdout:6/55: dwrite d7/fe [0,4194304] 0 2023-12-05T09:57:02.338 INFO:tasks.workunit.client.0.smithi100.stdout:6/56: write d7/ff [446197,50502] 0 2023-12-05T09:57:02.339 INFO:tasks.workunit.client.0.smithi100.stdout:9/42: mknod d7/d10/c13 0 2023-12-05T09:57:02.339 INFO:tasks.workunit.client.0.smithi100.stdout:9/43: fdatasync d7/fc 0 2023-12-05T09:57:02.344 INFO:tasks.workunit.client.0.smithi100.stdout:6/57: truncate f4 4010893 0 2023-12-05T09:57:02.352 INFO:tasks.workunit.client.0.smithi100.stdout:6/58: mkdir d7/d11 0 2023-12-05T09:57:02.355 INFO:tasks.workunit.client.0.smithi100.stdout:0/17: dwrite f1 [0,4194304] 0 2023-12-05T09:57:02.355 INFO:tasks.workunit.client.0.smithi100.stdout:2/30: dwrite d7/f8 [0,4194304] 0 2023-12-05T09:57:02.364 INFO:tasks.workunit.client.0.smithi100.stdout:3/47: dread d0/f1 [0,4194304] 0 2023-12-05T09:57:02.364 INFO:tasks.workunit.client.0.smithi100.stdout:3/48: stat d0/d4 0 2023-12-05T09:57:02.364 INFO:tasks.workunit.client.0.smithi100.stdout:3/49: fdatasync d0/f3 0 2023-12-05T09:57:02.364 INFO:tasks.workunit.client.0.smithi100.stdout:3/50: dread - d0/d4/fa zero size 2023-12-05T09:57:02.367 INFO:tasks.workunit.client.0.smithi100.stdout:0/18: link l6 l8 0 2023-12-05T09:57:02.370 INFO:tasks.workunit.client.0.smithi100.stdout:9/44: getdents d7 0 2023-12-05T09:57:02.378 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.380+0000 7fcb316a1700 1 -- 172.21.15.100:0/2751600913 --> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcb2c1116b0 con 0x7fcb1406ae40 2023-12-05T09:57:02.379 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.382+0000 7fcb137fe700 1 -- 172.21.15.100:0/2751600913 <== mgr.24423 v2:172.21.15.150:6828/896268868 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7fcb2c1116b0 con 0x7fcb1406ae40 2023-12-05T09:57:02.381 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2023-12-05T09:57:02.381 INFO:teuthology.orchestra.run.smithi100.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ff918c95653912ae4c171d8d1db5f5eabc756f85ff7e3ce78f13f9c521198459", 2023-12-05T09:57:02.381 INFO:teuthology.orchestra.run.smithi100.stdout: "in_progress": true, 2023-12-05T09:57:02.381 INFO:teuthology.orchestra.run.smithi100.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-05T09:57:02.381 INFO:teuthology.orchestra.run.smithi100.stdout: "services_complete": [], 2023-12-05T09:57:02.381 INFO:teuthology.orchestra.run.smithi100.stdout: "progress": "1/21 daemons upgraded", 2023-12-05T09:57:02.381 INFO:teuthology.orchestra.run.smithi100.stdout: "message": "", 2023-12-05T09:57:02.381 INFO:teuthology.orchestra.run.smithi100.stdout: "is_paused": false 2023-12-05T09:57:02.382 INFO:teuthology.orchestra.run.smithi100.stdout:} 2023-12-05T09:57:02.382 INFO:tasks.workunit.client.0.smithi100.stdout:3/51: mkdir d0/d2/de/d11 0 2023-12-05T09:57:02.383 INFO:tasks.workunit.client.0.smithi100.stdout:3/52: chown d0/cb 108936 1 2023-12-05T09:57:02.383 INFO:tasks.workunit.client.0.smithi100.stdout:3/53: fsync d0/f3 0 2023-12-05T09:57:02.384 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.386+0000 7fcb316a1700 1 -- 172.21.15.100:0/2751600913 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7fcb1406ae40 msgr2=0x7fcb1406d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:57:02.384 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.386+0000 7fcb316a1700 1 --2- 172.21.15.100:0/2751600913 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7fcb1406ae40 0x7fcb1406d2f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c009b80 tx=0x7fcb1c00b040 comp rx=0 tx=0).stop 2023-12-05T09:57:02.384 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.386+0000 7fcb316a1700 1 -- 172.21.15.100:0/2751600913 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb2c100050 msgr2=0x7fcb2c10fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:57:02.384 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.386+0000 7fcb316a1700 1 --2- 172.21.15.100:0/2751600913 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb2c100050 0x7fcb2c10fbf0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fcb20000c00 tx=0x7fcb20009e30 comp rx=0 tx=0).stop 2023-12-05T09:57:02.384 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.387+0000 7fcb316a1700 1 -- 172.21.15.100:0/2751600913 shutdown_connections 2023-12-05T09:57:02.385 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.387+0000 7fcb316a1700 1 --2- 172.21.15.100:0/2751600913 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7fcb1406ae40 0x7fcb1406d2f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:02.385 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.387+0000 7fcb316a1700 1 --2- 172.21.15.100:0/2751600913 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcb2c0fd730 0x7fcb2c10f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:02.385 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.387+0000 7fcb316a1700 1 --2- 172.21.15.100:0/2751600913 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb2c100050 0x7fcb2c10fbf0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:02.385 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.387+0000 7fcb316a1700 1 -- 172.21.15.100:0/2751600913 >> 172.21.15.100:0/2751600913 conn(0x7fcb2c0f7190 msgr2=0x7fcb2c0fb520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:57:02.386 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.388+0000 7fcb316a1700 1 -- 172.21.15.100:0/2751600913 shutdown_connections 2023-12-05T09:57:02.388 INFO:tasks.workunit.client.0.smithi100.stdout:0/19: write f2 [3425073,121424] 0 2023-12-05T09:57:02.388 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.391+0000 7fcb316a1700 1 -- 172.21.15.100:0/2751600913 wait complete. 2023-12-05T09:57:02.390 INFO:tasks.workunit.client.0.smithi100.stdout:9/45: link f1 d7/d10/f14 0 2023-12-05T09:57:02.390 INFO:tasks.workunit.client.0.smithi100.stdout:9/46: write d7/f8 [488306,14391] 0 2023-12-05T09:57:02.394 INFO:tasks.workunit.client.0.smithi100.stdout:2/31: getdents d7 0 2023-12-05T09:57:02.394 INFO:tasks.workunit.client.0.smithi100.stdout:2/32: readlink - no filename 2023-12-05T09:57:02.398 INFO:tasks.workunit.client.0.smithi100.stdout:4/18: dwrite f2 [8388608,4194304] 0 2023-12-05T09:57:02.399 INFO:tasks.workunit.client.0.smithi100.stdout:0/20: mknod c9 0 2023-12-05T09:57:02.399 INFO:tasks.workunit.client.0.smithi100.stdout:0/21: readlink l6 0 2023-12-05T09:57:02.399 INFO:tasks.workunit.client.0.smithi100.stdout:0/22: truncate f7 166877 0 2023-12-05T09:57:02.400 INFO:tasks.workunit.client.0.smithi100.stdout:0/23: write f2 [616035,23259] 0 2023-12-05T09:57:02.404 INFO:tasks.workunit.client.0.smithi100.stdout:6/59: rmdir d7 39 2023-12-05T09:57:02.410 INFO:tasks.workunit.client.0.smithi100.stdout:6/60: rename d7/fe to d7/d11/f12 0 2023-12-05T09:57:02.411 INFO:tasks.workunit.client.0.smithi100.stdout:4/19: fsync f1 0 2023-12-05T09:57:02.411 INFO:tasks.workunit.client.0.smithi100.stdout:4/20: creat f6 x:0 0 0 2023-12-05T09:57:02.418 INFO:tasks.workunit.client.0.smithi100.stdout:2/33: read d7/f8 [174947,17267] 0 2023-12-05T09:57:02.421 INFO:tasks.workunit.client.0.smithi100.stdout:6/61: rename l1 to d7/d11/l13 0 2023-12-05T09:57:02.439 INFO:tasks.workunit.client.0.smithi100.stdout:6/62: dread d7/ff [0,4194304] 0 2023-12-05T09:57:02.440 INFO:tasks.workunit.client.0.smithi100.stdout:6/63: fdatasync f3 0 2023-12-05T09:57:02.440 INFO:tasks.workunit.client.0.smithi100.stdout:6/64: fdatasync d7/d11/f12 0 2023-12-05T09:57:02.446 INFO:tasks.workunit.client.0.smithi100.stdout:0/24: truncate f2 5418249 0 2023-12-05T09:57:02.455 INFO:tasks.workunit.client.0.smithi100.stdout:9/47: dwrite f1 [0,4194304] 0 2023-12-05T09:57:02.456 INFO:tasks.workunit.client.0.smithi100.stdout:3/54: dwrite d0/f1 [0,4194304] 0 2023-12-05T09:57:02.458 INFO:tasks.workunit.client.0.smithi100.stdout:9/48: write d7/f8 [143119,50950] 0 2023-12-05T09:57:02.461 INFO:tasks.workunit.client.0.smithi100.stdout:4/21: truncate f1 2762099 0 2023-12-05T09:57:02.462 INFO:tasks.workunit.client.0.smithi100.stdout:4/22: write f6 [350304,53917] 0 2023-12-05T09:57:02.462 INFO:tasks.workunit.client.0.smithi100.stdout:4/23: chown c5 38311 1 2023-12-05T09:57:02.462 INFO:tasks.workunit.client.0.smithi100.stdout:4/24: chown l4 3873 1 2023-12-05T09:57:02.463 INFO:tasks.workunit.client.0.smithi100.stdout:3/55: dread d0/f7 [0,4194304] 0 2023-12-05T09:57:02.471 INFO:tasks.workunit.client.0.smithi100.stdout:9/49: symlink d7/l15 0 2023-12-05T09:57:02.488 INFO:tasks.workunit.client.0.smithi100.stdout:0/25: write f1 [5605168,21836] 0 2023-12-05T09:57:02.490 INFO:tasks.workunit.client.0.smithi100.stdout:0/26: mkdir da 0 2023-12-05T09:57:02.496 INFO:tasks.workunit.client.0.smithi100.stdout:0/27: rename f7 to da/fb 0 2023-12-05T09:57:02.507 INFO:tasks.workunit.client.0.smithi100.stdout:6/65: dwrite f3 [0,4194304] 0 2023-12-05T09:57:02.507 INFO:tasks.workunit.client.0.smithi100.stdout:4/25: dread f2 [0,4194304] 0 2023-12-05T09:57:02.507 INFO:tasks.workunit.client.0.smithi100.stdout:4/26: creat f7 x:0 0 0 2023-12-05T09:57:02.528 INFO:tasks.workunit.client.0.smithi100.stdout:6/66: rename l0 to d7/l14 0 2023-12-05T09:57:02.539 INFO:tasks.workunit.client.0.smithi100.stdout:9/50: dwrite d7/ff [0,4194304] 0 2023-12-05T09:57:02.540 INFO:tasks.workunit.client.0.smithi100.stdout:9/51: dread - d7/fc zero size 2023-12-05T09:57:02.540 INFO:tasks.workunit.client.0.smithi100.stdout:0/28: dread f1 [0,4194304] 0 2023-12-05T09:57:02.542 INFO:tasks.workunit.client.0.smithi100.stdout:0/29: fdatasync da/fb 0 2023-12-05T09:57:02.547 INFO:tasks.workunit.client.0.smithi100.stdout:3/56: dwrite d0/f3 [0,4194304] 0 2023-12-05T09:57:02.547 INFO:tasks.workunit.client.0.smithi100.stdout:3/57: truncate d0/f7 1255657 0 2023-12-05T09:57:02.547 INFO:tasks.workunit.client.0.smithi100.stdout:3/58: chown d0/d2/fd 20975 1 2023-12-05T09:57:02.547 INFO:tasks.workunit.client.0.smithi100.stdout:6/67: dread f5 [0,4194304] 0 2023-12-05T09:57:02.557 INFO:tasks.workunit.client.0.smithi100.stdout:6/68: rmdir d7/d11 39 2023-12-05T09:57:02.557 INFO:tasks.workunit.client.0.smithi100.stdout:0/30: truncate f1 1635314 0 2023-12-05T09:57:02.559 INFO:tasks.workunit.client.0.smithi100.stdout:0/31: mknod da/cc 0 2023-12-05T09:57:02.559 INFO:tasks.workunit.client.0.smithi100.stdout:6/69: truncate f3 831668 0 2023-12-05T09:57:02.560 INFO:tasks.workunit.client.0.smithi100.stdout:6/70: stat f5 0 2023-12-05T09:57:02.560 INFO:tasks.workunit.client.0.smithi100.stdout:6/71: symlink d7/d11/l15 0 2023-12-05T09:57:02.578 INFO:tasks.workunit.client.0.smithi100.stdout:6/72: write f3 [1362626,4829] 0 2023-12-05T09:57:02.581 INFO:tasks.workunit.client.0.smithi100.stdout:3/59: write d0/f1 [1103826,108945] 0 2023-12-05T09:57:02.582 INFO:tasks.workunit.client.0.smithi100.stdout:6/73: creat d7/f16 x:0 0 0 2023-12-05T09:57:02.584 INFO:tasks.workunit.client.0.smithi100.stdout:4/27: dwrite f7 [0,4194304] 0 2023-12-05T09:57:02.584 INFO:tasks.workunit.client.0.smithi100.stdout:4/28: rmdir - no directory 2023-12-05T09:57:02.589 INFO:tasks.workunit.client.0.smithi100.stdout:4/29: mknod c8 0 2023-12-05T09:57:02.598 INFO:tasks.workunit.client.0.smithi100.stdout:6/74: write f3 [911307,66073] 0 2023-12-05T09:57:02.599 INFO:tasks.workunit.client.0.smithi100.stdout:6/75: fsync d7/f10 0 2023-12-05T09:57:02.599 INFO:tasks.workunit.client.0.smithi100.stdout:6/76: fsync f5 0 2023-12-05T09:57:02.599 INFO:tasks.workunit.client.0.smithi100.stdout:3/60: getdents d0 0 2023-12-05T09:57:02.602 INFO:tasks.workunit.client.0.smithi100.stdout:3/61: unlink d0/d4/fa 0 2023-12-05T09:57:02.602 INFO:tasks.workunit.client.0.smithi100.stdout:3/62: write d0/f1 [713229,88600] 0 2023-12-05T09:57:02.609 INFO:tasks.workunit.client.0.smithi100.stdout:6/77: getdents d7 0 2023-12-05T09:57:02.610 INFO:tasks.workunit.client.0.smithi100.stdout:6/78: getdents d7 0 2023-12-05T09:57:02.610 INFO:tasks.workunit.client.0.smithi100.stdout:6/79: getdents d7 0 2023-12-05T09:57:02.614 INFO:tasks.workunit.client.0.smithi100.stdout:0/32: dwrite f1 [0,4194304] 0 2023-12-05T09:57:02.615 INFO:tasks.workunit.client.0.smithi100.stdout:0/33: fdatasync da/fb 0 2023-12-05T09:57:02.615 INFO:tasks.workunit.client.0.smithi100.stdout:6/80: creat d7/f17 x:0 0 0 2023-12-05T09:57:02.615 INFO:tasks.workunit.client.0.smithi100.stdout:6/81: chown d7/d11 924171036 1 2023-12-05T09:57:02.617 INFO:tasks.workunit.client.0.smithi100.stdout:4/30: dread f7 [0,4194304] 0 2023-12-05T09:57:02.618 INFO:tasks.workunit.client.0.smithi100.stdout:6/82: mknod d7/c18 0 2023-12-05T09:57:02.618 INFO:tasks.workunit.client.0.smithi100.stdout:6/83: stat d7/ff 0 2023-12-05T09:57:02.625 INFO:tasks.workunit.client.0.smithi100.stdout:6/84: truncate d7/ff 188322 0 2023-12-05T09:57:02.645 INFO:tasks.workunit.client.0.smithi100.stdout:0/34: dread f1 [0,4194304] 0 2023-12-05T09:57:02.645 INFO:tasks.workunit.client.0.smithi100.stdout:0/35: creat da/fd x:0 0 0 2023-12-05T09:57:02.648 INFO:tasks.workunit.client.0.smithi100.stdout:0/36: stat c5 0 2023-12-05T09:57:02.649 INFO:tasks.workunit.client.0.smithi100.stdout:0/37: creat da/fe x:0 0 0 2023-12-05T09:57:02.649 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:02 smithi100 ceph-mon[107145]: pgmap v17: 65 pgs: 65 active+clean; 213 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 9.7 MiB/s wr, 517 op/s 2023-12-05T09:57:02.649 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:02 smithi100 ceph-mon[107145]: Updating smithi100:/etc/ceph/ceph.client.admin.keyring 2023-12-05T09:57:02.649 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:02 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:57:02.649 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:02 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:57:02.649 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:02 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/467228208' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:57:02.649 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:02 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/4219793367' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-05T09:57:02.653 INFO:tasks.workunit.client.0.smithi100.stdout:0/38: link l6 da/lf 0 2023-12-05T09:57:02.658 INFO:tasks.workunit.client.0.smithi100.stdout:0/39: symlink da/l10 0 2023-12-05T09:57:02.663 INFO:tasks.workunit.client.0.smithi100.stdout:0/40: rename da/fe to da/f11 0 2023-12-05T09:57:02.663 INFO:tasks.workunit.client.0.smithi100.stdout:0/41: dread - da/fd zero size 2023-12-05T09:57:02.664 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.665+0000 7f2fbd0ff700 1 -- 172.21.15.100:0/921430635 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fb80fbaf0 msgr2=0x7f2fb80fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:57:02.664 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.665+0000 7f2fbd0ff700 1 --2- 172.21.15.100:0/921430635 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fb80fbaf0 0x7f2fb80fbf00 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f2fa8004940 tx=0x7f2fa8009e30 comp rx=0 tx=0).stop 2023-12-05T09:57:02.664 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.666+0000 7f2fbd0ff700 1 -- 172.21.15.100:0/921430635 shutdown_connections 2023-12-05T09:57:02.664 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.666+0000 7f2fbd0ff700 1 --2- 172.21.15.100:0/921430635 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2fb80fcd00 0x7f2fb80fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:02.664 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.666+0000 7f2fbd0ff700 1 --2- 172.21.15.100:0/921430635 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fb80fbaf0 0x7f2fb80fbf00 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:02.664 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.666+0000 7f2fbd0ff700 1 -- 172.21.15.100:0/921430635 >> 172.21.15.100:0/921430635 conn(0x7f2fb80f7190 msgr2=0x7f2fb80f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:57:02.664 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.666+0000 7f2fbd0ff700 1 -- 172.21.15.100:0/921430635 shutdown_connections 2023-12-05T09:57:02.664 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.666+0000 7f2fbd0ff700 1 -- 172.21.15.100:0/921430635 wait complete. 2023-12-05T09:57:02.665 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.667+0000 7f2fbd0ff700 1 Processor -- start 2023-12-05T09:57:02.665 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.668+0000 7f2fbd0ff700 1 -- start start 2023-12-05T09:57:02.666 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.668+0000 7f2fbd0ff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2fb80fbaf0 0x7f2fb810b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:57:02.666 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.668+0000 7f2fbd0ff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fb80fcd00 0x7f2fb810b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:57:02.666 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.668+0000 7f2fbd0ff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb810bdf0 con 0x7f2fb80fcd00 2023-12-05T09:57:02.666 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.668+0000 7f2fbd0ff700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb810c690 con 0x7f2fb80fbaf0 2023-12-05T09:57:02.666 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.669+0000 7f2fb6d9d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2fb80fbaf0 0x7f2fb810b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:57:02.667 INFO:tasks.workunit.client.0.smithi100.stdout:0/42: symlink da/l12 0 2023-12-05T09:57:02.667 INFO:tasks.workunit.client.0.smithi100.stdout:0/43: fdatasync da/fb 0 2023-12-05T09:57:02.668 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.669+0000 7f2fb6d9d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2fb80fbaf0 0x7f2fb810b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.100:41192/0 (socket says 172.21.15.100:41192) 2023-12-05T09:57:02.668 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.669+0000 7f2fb6d9d700 1 -- 172.21.15.100:0/180267819 learned_addr learned my addr 172.21.15.100:0/180267819 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:57:02.668 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.669+0000 7f2fb659c700 1 --2- 172.21.15.100:0/180267819 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fb80fcd00 0x7f2fb810b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:57:02.668 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.669+0000 7f2fb6d9d700 1 -- 172.21.15.100:0/180267819 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fb80fcd00 msgr2=0x7f2fb810b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:57:02.668 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.669+0000 7f2fb6d9d700 1 --2- 172.21.15.100:0/180267819 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fb80fcd00 0x7f2fb810b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:02.668 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.669+0000 7f2fb6d9d700 1 -- 172.21.15.100:0/180267819 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fa8005040 con 0x7f2fb80fbaf0 2023-12-05T09:57:02.668 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.670+0000 7f2fb6d9d700 1 --2- 172.21.15.100:0/180267819 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2fb80fbaf0 0x7f2fb810b260 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2fa8008f80 tx=0x7f2fa8009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:57:02.669 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.670+0000 7f2f9f7fe700 1 -- 172.21.15.100:0/180267819 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2fa8021070 con 0x7f2fb80fbaf0 2023-12-05T09:57:02.669 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.670+0000 7f2f9f7fe700 1 -- 172.21.15.100:0/180267819 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2fa801c400 con 0x7f2fb80fbaf0 2023-12-05T09:57:02.669 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.670+0000 7f2f9f7fe700 1 -- 172.21.15.100:0/180267819 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2fa800e070 con 0x7f2fb80fbaf0 2023-12-05T09:57:02.669 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.670+0000 7f2fbd0ff700 1 -- 172.21.15.100:0/180267819 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fb810c910 con 0x7f2fb80fbaf0 2023-12-05T09:57:02.669 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.670+0000 7f2fbd0ff700 1 -- 172.21.15.100:0/180267819 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fb810cdf0 con 0x7f2fb80fbaf0 2023-12-05T09:57:02.669 INFO:tasks.workunit.client.0.smithi100.stdout:0/44: mknod da/c13 0 2023-12-05T09:57:02.670 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.672+0000 7f2fbd0ff700 1 -- 172.21.15.100:0/180267819 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fb804bb80 con 0x7f2fb80fbaf0 2023-12-05T09:57:02.671 INFO:tasks.workunit.client.0.smithi100.stdout:0/45: rename da/l10 to da/l14 0 2023-12-05T09:57:02.671 INFO:tasks.workunit.client.0.smithi100.stdout:0/46: chown f2 43717 1 2023-12-05T09:57:02.672 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.674+0000 7f2f9f7fe700 1 -- 172.21.15.100:0/180267819 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 25) v1 ==== 88726+0+0 (secure 0 0 0) 0x7f2fa801c9c0 con 0x7f2fb80fbaf0 2023-12-05T09:57:02.672 INFO:tasks.workunit.client.0.smithi100.stdout:0/47: link l8 da/l15 0 2023-12-05T09:57:02.673 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.676+0000 7f2f9f7fe700 1 --2- 172.21.15.100:0/180267819 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7f2fa006ae40 0x7f2fa006d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:57:02.673 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.676+0000 7f2f9f7fe700 1 -- 172.21.15.100:0/180267819 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f2fa808ad10 con 0x7f2fb80fbaf0 2023-12-05T09:57:02.674 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.676+0000 7f2fb659c700 1 --2- 172.21.15.100:0/180267819 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7f2fa006ae40 0x7f2fa006d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:57:02.675 INFO:tasks.workunit.client.0.smithi100.stdout:3/63: dwrite d0/d4/fc [0,4194304] 0 2023-12-05T09:57:02.676 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.679+0000 7f2f9f7fe700 1 -- 172.21.15.100:0/180267819 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f2fa80550e0 con 0x7f2fb80fbaf0 2023-12-05T09:57:02.677 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:02.679+0000 7f2fb659c700 1 --2- 172.21.15.100:0/180267819 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7f2fa006ae40 0x7f2fa006d2f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2fac004600 tx=0x7f2fac00b040 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:57:02.677 INFO:tasks.workunit.client.0.smithi100.stdout:3/64: mkdir d0/d2/de/d12 0 2023-12-05T09:57:02.697 INFO:tasks.workunit.client.0.smithi100.stdout:3/65: dread d0/f3 [0,4194304] 0 2023-12-05T09:57:02.703 INFO:tasks.workunit.client.0.smithi100.stdout:4/31: dwrite f1 [0,4194304] 0 2023-12-05T09:57:02.705 INFO:tasks.workunit.client.0.smithi100.stdout:0/48: rmdir da 39 2023-12-05T09:57:02.705 INFO:tasks.workunit.client.0.smithi100.stdout:0/49: chown da/lf 8 1 2023-12-05T09:57:02.710 INFO:tasks.workunit.client.0.smithi100.stdout:6/85: dwrite f4 [0,4194304] 0 2023-12-05T09:57:02.712 INFO:tasks.workunit.client.0.smithi100.stdout:6/86: symlink d7/d11/l19 0 2023-12-05T09:57:02.715 INFO:tasks.workunit.client.0.smithi100.stdout:6/87: readlink d7/d11/l19 0 2023-12-05T09:57:02.715 INFO:tasks.workunit.client.0.smithi100.stdout:6/88: fsync d7/ff 0 2023-12-05T09:57:02.715 INFO:tasks.workunit.client.0.smithi100.stdout:6/89: dread - d7/f17 zero size 2023-12-05T09:57:02.715 INFO:tasks.workunit.client.0.smithi100.stdout:6/90: chown f5 0 1 2023-12-05T09:57:02.719 INFO:tasks.workunit.client.0.smithi100.stdout:0/50: write f1 [1739243,10469] 0 2023-12-05T09:57:02.719 INFO:tasks.workunit.client.0.smithi100.stdout:0/51: read f1 [3008126,34594] 0 2023-12-05T09:57:02.719 INFO:tasks.workunit.client.0.smithi100.stdout:0/52: write f2 [4541428,51489] 0 2023-12-05T09:57:02.719 INFO:tasks.workunit.client.0.smithi100.stdout:0/53: readlink l8 0 2023-12-05T09:57:02.719 INFO:tasks.workunit.client.0.smithi100.stdout:0/54: write f2 [5341848,52458] 0 2023-12-05T09:57:02.719 INFO:tasks.workunit.client.0.smithi100.stdout:0/55: chown c3 0 1 2023-12-05T09:57:02.719 INFO:tasks.workunit.client.0.smithi100.stdout:0/56: chown da/f11 1271929018 1 2023-12-05T09:57:02.720 INFO:tasks.workunit.client.0.smithi100.stdout:4/32: dread f2 [8388608,4194304] 0 2023-12-05T09:57:02.720 INFO:tasks.workunit.client.0.smithi100.stdout:6/91: unlink d7/ff 0 2023-12-05T09:57:02.722 INFO:tasks.workunit.client.0.smithi100.stdout:0/57: rename l8 to da/l16 0 2023-12-05T09:57:02.744 INFO:tasks.workunit.client.0.smithi100.stdout:6/92: write d7/d11/f12 [1530047,39546] 0 2023-12-05T09:57:02.744 INFO:tasks.workunit.client.0.smithi100.stdout:4/33: write f7 [3984255,81557] 0 2023-12-05T09:57:02.752 INFO:tasks.workunit.client.0.smithi100.stdout:6/93: mkdir d7/d11/d1a 0 2023-12-05T09:57:02.753 INFO:tasks.workunit.client.0.smithi100.stdout:6/94: read d7/d11/f12 [685678,121545] 0 2023-12-05T09:57:02.756 INFO:tasks.workunit.client.0.smithi100.stdout:6/95: creat d7/d11/d1a/f1b x:0 0 0 2023-12-05T09:57:02.756 INFO:tasks.workunit.client.0.smithi100.stdout:6/96: dread - d7/d11/d1a/f1b zero size 2023-12-05T09:57:02.756 INFO:tasks.workunit.client.0.smithi100.stdout:6/97: read - d7/f16 zero size 2023-12-05T09:57:02.756 INFO:tasks.workunit.client.0.smithi100.stdout:6/98: dread - d7/f17 zero size 2023-12-05T09:57:02.758 INFO:tasks.workunit.client.0.smithi100.stdout:6/99: truncate f5 1605685 0 2023-12-05T09:57:02.772 INFO:tasks.workunit.client.0.smithi100.stdout:4/34: write f1 [483860,33698] 0 2023-12-05T09:57:02.772 INFO:tasks.workunit.client.0.smithi100.stdout:3/66: dwrite d0/d4/fc [0,4194304] 0 2023-12-05T09:57:02.828 INFO:tasks.workunit.client.0.smithi100.stdout:6/100: dwrite d7/d11/f12 [0,4194304] 0 2023-12-05T09:57:02.828 INFO:tasks.workunit.client.0.smithi100.stdout:6/101: write d7/f16 [55025,221] 0 2023-12-05T09:57:02.831 INFO:tasks.workunit.client.0.smithi100.stdout:6/102: mkdir d7/d11/d1a/d1c 0 2023-12-05T09:57:02.831 INFO:tasks.workunit.client.0.smithi100.stdout:6/103: creat d7/f1d x:0 0 0 2023-12-05T09:57:02.834 INFO:tasks.workunit.client.0.smithi100.stdout:6/104: creat d7/d11/d1a/d1c/f1e x:0 0 0 2023-12-05T09:57:02.834 INFO:tasks.workunit.client.0.smithi100.stdout:6/105: creat d7/d11/d1a/f1f x:0 0 0 2023-12-05T09:57:02.839 INFO:tasks.workunit.client.0.smithi100.stdout:6/106: link f5 d7/d11/f20 0 2023-12-05T09:57:02.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:02 smithi150 ceph-mon[116142]: pgmap v17: 65 pgs: 65 active+clean; 213 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 9.7 MiB/s wr, 517 op/s 2023-12-05T09:57:02.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:02 smithi150 ceph-mon[116142]: Updating smithi100:/etc/ceph/ceph.client.admin.keyring 2023-12-05T09:57:02.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:02 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:57:02.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:02 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:57:02.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:02 smithi150 ceph-mon[116142]: from='client.? 172.21.15.100:0/467228208' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:57:02.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:02 smithi150 ceph-mon[116142]: from='client.? 172.21.15.100:0/4219793367' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-05T09:57:02.858 INFO:tasks.workunit.client.0.smithi100.stdout:4/35: truncate f7 3717756 0 2023-12-05T09:57:02.867 INFO:tasks.workunit.client.0.smithi100.stdout:3/67: dwrite d0/d2/fd [0,4194304] 0 2023-12-05T09:57:02.874 INFO:tasks.workunit.client.0.smithi100.stdout:4/36: write f2 [6905291,99060] 0 2023-12-05T09:57:02.915 INFO:tasks.workunit.client.0.smithi100.stdout:6/107: rmdir d7/d11/d1a 39 2023-12-05T09:57:02.915 INFO:tasks.workunit.client.0.smithi100.stdout:6/108: chown d7/d11/d1a/f1b 144 1 2023-12-05T09:57:02.924 INFO:tasks.workunit.client.0.smithi100.stdout:6/109: dread d7/f16 [0,4194304] 0 2023-12-05T09:57:02.927 INFO:tasks.workunit.client.0.smithi100.stdout:6/110: symlink d7/d11/d1a/l21 0 2023-12-05T09:57:02.927 INFO:tasks.workunit.client.0.smithi100.stdout:3/68: dwrite d0/f1 [0,4194304] 0 2023-12-05T09:57:02.930 INFO:tasks.workunit.client.0.smithi100.stdout:6/111: creat d7/d11/d1a/f22 x:0 0 0 2023-12-05T09:57:02.930 INFO:tasks.workunit.client.0.smithi100.stdout:6/112: dread - d7/f17 zero size 2023-12-05T09:57:02.930 INFO:tasks.workunit.client.0.smithi100.stdout:6/113: creat d7/f23 x:0 0 0 2023-12-05T09:57:02.930 INFO:tasks.workunit.client.0.smithi100.stdout:6/114: write d7/d11/d1a/d1c/f1e [501944,20282] 0 2023-12-05T09:57:02.999 INFO:tasks.workunit.client.0.smithi100.stdout:4/37: dwrite f7 [0,4194304] 0 2023-12-05T09:57:03.000 INFO:tasks.workunit.client.0.smithi100.stdout:6/115: dwrite d7/d11/d1a/f1b [0,4194304] 0 2023-12-05T09:57:03.002 INFO:tasks.workunit.client.0.smithi100.stdout:4/38: fdatasync f1 0 2023-12-05T09:57:03.002 INFO:tasks.workunit.client.0.smithi100.stdout:4/39: readlink l4 0 2023-12-05T09:57:03.008 INFO:tasks.workunit.client.0.smithi100.stdout:6/116: symlink d7/l24 0 2023-12-05T09:57:03.008 INFO:tasks.workunit.client.0.smithi100.stdout:3/69: truncate d0/f3 1288976 0 2023-12-05T09:57:03.012 INFO:tasks.workunit.client.0.smithi100.stdout:6/117: mkdir d7/d11/d1a/d25 0 2023-12-05T09:57:03.015 INFO:tasks.workunit.client.0.smithi100.stdout:3/70: creat d0/f13 x:0 0 0 2023-12-05T09:57:03.019 INFO:tasks.workunit.client.0.smithi100.stdout:4/40: dread f2 [4194304,4194304] 0 2023-12-05T09:57:03.022 INFO:tasks.workunit.client.0.smithi100.stdout:3/71: dread d0/d2/f9 [0,4194304] 0 2023-12-05T09:57:03.023 INFO:tasks.workunit.client.0.smithi100.stdout:3/72: stat d0/d4/fc 0 2023-12-05T09:57:03.023 INFO:tasks.workunit.client.0.smithi100.stdout:3/73: getdents d0/d10 0 2023-12-05T09:57:03.028 INFO:tasks.workunit.client.0.smithi100.stdout:6/118: dread d7/d11/f12 [0,4194304] 0 2023-12-05T09:57:03.074 INFO:tasks.workunit.client.0.smithi100.stdout:6/119: getdents d7 0 2023-12-05T09:57:03.080 INFO:tasks.workunit.client.0.smithi100.stdout:3/74: dwrite d0/d4/fc [0,4194304] 0 2023-12-05T09:57:03.081 INFO:tasks.workunit.client.0.smithi100.stdout:6/120: rename d7/cb to d7/d11/c26 0 2023-12-05T09:57:03.084 INFO:tasks.workunit.client.0.smithi100.stdout:6/121: mkdir d7/d27 0 2023-12-05T09:57:03.134 INFO:tasks.workunit.client.0.smithi100.stdout:3/75: dwrite d0/d2/f9 [0,4194304] 0 2023-12-05T09:57:03.134 INFO:tasks.workunit.client.0.smithi100.stdout:3/76: fsync d0/d2/fd 0 2023-12-05T09:57:03.143 INFO:tasks.workunit.client.0.smithi100.stdout:3/77: write d0/f3 [611801,94493] 0 2023-12-05T09:57:03.152 INFO:tasks.workunit.client.0.smithi100.stdout:3/78: dread d0/f7 [0,4194304] 0 2023-12-05T09:57:03.152 INFO:tasks.workunit.client.0.smithi100.stdout:3/79: truncate d0/f7 1280713 0 2023-12-05T09:57:03.153 INFO:tasks.workunit.client.0.smithi100.stdout:6/122: dwrite d7/f16 [0,4194304] 0 2023-12-05T09:57:03.159 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:03.161+0000 7f2fbd0ff700 1 -- 172.21.15.100:0/180267819 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f2fb810d210 con 0x7f2fb80fbaf0 2023-12-05T09:57:03.159 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:03.162+0000 7f2f9f7fe700 1 -- 172.21.15.100:0/180267819 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f2fa8004490 con 0x7f2fb80fbaf0 2023-12-05T09:57:03.161 INFO:teuthology.orchestra.run.smithi100.stdout:HEALTH_OK 2023-12-05T09:57:03.169 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:03.171+0000 7f2fbd0ff700 1 -- 172.21.15.100:0/180267819 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7f2fa006ae40 msgr2=0x7f2fa006d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:57:03.169 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:03.171+0000 7f2fbd0ff700 1 --2- 172.21.15.100:0/180267819 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7f2fa006ae40 0x7f2fa006d2f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2fac004600 tx=0x7f2fac00b040 comp rx=0 tx=0).stop 2023-12-05T09:57:03.169 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:03.171+0000 7f2fbd0ff700 1 -- 172.21.15.100:0/180267819 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2fb80fbaf0 msgr2=0x7f2fb810b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:57:03.169 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:03.171+0000 7f2fbd0ff700 1 --2- 172.21.15.100:0/180267819 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2fb80fbaf0 0x7f2fb810b260 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2fa8008f80 tx=0x7f2fa8009e30 comp rx=0 tx=0).stop 2023-12-05T09:57:03.170 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:03.172+0000 7f2fbd0ff700 1 -- 172.21.15.100:0/180267819 shutdown_connections 2023-12-05T09:57:03.170 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:03.172+0000 7f2fbd0ff700 1 --2- 172.21.15.100:0/180267819 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7f2fa006ae40 0x7f2fa006d2f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:03.170 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:03.172+0000 7f2fbd0ff700 1 --2- 172.21.15.100:0/180267819 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2fb80fbaf0 0x7f2fb810b260 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:03.170 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:03.172+0000 7f2fbd0ff700 1 --2- 172.21.15.100:0/180267819 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fb80fcd00 0x7f2fb810b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:03.170 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:03.172+0000 7f2fbd0ff700 1 -- 172.21.15.100:0/180267819 >> 172.21.15.100:0/180267819 conn(0x7f2fb80f7190 msgr2=0x7f2fb80fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:57:03.170 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:03.172+0000 7f2fbd0ff700 1 -- 172.21.15.100:0/180267819 shutdown_connections 2023-12-05T09:57:03.170 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:03.173+0000 7f2fbd0ff700 1 -- 172.21.15.100:0/180267819 wait complete. 2023-12-05T09:57:03.198 INFO:tasks.workunit.client.0.smithi100.stdout:3/80: dwrite d0/f13 [0,4194304] 0 2023-12-05T09:57:03.218 INFO:tasks.workunit.client.0.smithi100.stdout:6/123: dwrite d7/d11/f12 [0,4194304] 0 2023-12-05T09:57:03.228 INFO:tasks.workunit.client.0.smithi100.stdout:6/124: dread f3 [0,4194304] 0 2023-12-05T09:57:03.296 INFO:tasks.workunit.client.0.smithi100.stdout:6/125: dwrite d7/d11/f12 [0,4194304] 0 2023-12-05T09:57:03.297 INFO:tasks.workunit.client.0.smithi100.stdout:6/126: creat d7/d11/d1a/d1c/f28 x:0 0 0 2023-12-05T09:57:03.299 INFO:tasks.workunit.client.0.smithi100.stdout:6/127: link d7/d11/d1a/f22 d7/d11/d1a/d1c/f29 0 2023-12-05T09:57:03.299 INFO:tasks.workunit.client.0.smithi100.stdout:6/128: write d7/f10 [1278792,51077] 0 2023-12-05T09:57:03.300 INFO:tasks.workunit.client.0.smithi100.stdout:6/129: rmdir d7/d11/d1a/d25 0 2023-12-05T09:57:03.303 INFO:tasks.workunit.client.0.smithi100.stdout:6/130: symlink d7/d27/l2a 0 2023-12-05T09:57:03.303 INFO:tasks.workunit.client.0.smithi100.stdout:6/131: creat d7/d11/d1a/f2b x:0 0 0 2023-12-05T09:57:03.303 INFO:tasks.workunit.client.0.smithi100.stdout:6/132: fdatasync d7/d11/f20 0 2023-12-05T09:57:03.303 INFO:tasks.workunit.client.0.smithi100.stdout:6/133: read d7/d11/f20 [1585541,124624] 0 2023-12-05T09:57:03.303 INFO:tasks.workunit.client.0.smithi100.stdout:6/134: write d7/d11/f20 [453606,12238] 0 2023-12-05T09:57:03.426 INFO:tasks.workunit.client.0.smithi100.stdout:6/135: getdents d7/d27 0 2023-12-05T09:57:03.482 INFO:tasks.workunit.client.0.smithi100.stdout:6/136: dwrite d7/d11/f20 [0,4194304] 0 2023-12-05T09:57:03.483 INFO:tasks.workunit.client.0.smithi100.stdout:6/137: creat d7/d11/f2c x:0 0 0 2023-12-05T09:57:03.644 INFO:tasks.workunit.client.0.smithi100.stdout:6/138: truncate f4 1030742 0 2023-12-05T09:57:03.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:03 smithi100 ceph-mon[107145]: Updating smithi100:/var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-05T09:57:03.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:03 smithi100 ceph-mon[107145]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:57:03.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:03 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:57:03.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:03 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/180267819' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-05T09:57:03.790 INFO:tasks.workunit.client.0.smithi100.stdout:6/139: dread f4 [0,4194304] 0 2023-12-05T09:57:03.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:03 smithi150 ceph-mon[116142]: Updating smithi100:/var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-05T09:57:03.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:03 smithi150 ceph-mon[116142]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:57:03.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:03 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:57:03.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:03 smithi150 ceph-mon[116142]: from='client.? 172.21.15.100:0/180267819' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-05T09:57:03.899 INFO:tasks.workunit.client.0.smithi100.stdout:6/140: truncate f5 4073239 0 2023-12-05T09:57:03.900 INFO:tasks.workunit.client.0.smithi100.stdout:6/141: write d7/f17 [7056,37203] 0 2023-12-05T09:57:03.906 INFO:tasks.workunit.client.0.smithi100.stdout:6/142: dread f4 [0,4194304] 0 2023-12-05T09:57:03.954 INFO:tasks.workunit.client.0.smithi100.stdout:6/143: dwrite d7/d11/f2c [0,4194304] 0 2023-12-05T09:57:03.971 INFO:tasks.workunit.client.0.smithi100.stdout:6/144: read d7/d11/f2c [376446,46251] 0 2023-12-05T09:57:03.973 INFO:tasks.workunit.client.0.smithi100.stdout:6/145: mkdir d7/d2d 0 2023-12-05T09:57:03.976 INFO:tasks.workunit.client.0.smithi100.stdout:6/146: creat d7/d27/f2e x:0 0 0 2023-12-05T09:57:03.976 INFO:tasks.workunit.client.0.smithi100.stdout:6/147: creat d7/d11/d1a/f2f x:0 0 0 2023-12-05T09:57:04.015 INFO:tasks.workunit.client.0.smithi100.stdout:6/148: dwrite d7/d11/f2c [0,4194304] 0 2023-12-05T09:57:04.015 INFO:tasks.workunit.client.0.smithi100.stdout:6/149: chown d7/d11/d1a/f2b 0 1 2023-12-05T09:57:04.015 INFO:tasks.workunit.client.0.smithi100.stdout:6/150: chown d7/l14 642755788 1 2023-12-05T09:57:04.018 INFO:tasks.workunit.client.0.smithi100.stdout:6/151: rename d7/f1d to d7/d2d/f30 0 2023-12-05T09:57:04.019 INFO:tasks.workunit.client.0.smithi100.stdout:6/152: chown d7/d11/d1a/d1c/f28 1534158455 1 2023-12-05T09:57:04.021 INFO:tasks.workunit.client.0.smithi100.stdout:6/153: mknod d7/d27/c31 0 2023-12-05T09:57:04.023 INFO:tasks.workunit.client.0.smithi100.stdout:6/154: symlink d7/d11/d1a/d1c/l32 0 2023-12-05T09:57:04.023 INFO:tasks.workunit.client.0.smithi100.stdout:6/155: write d7/f17 [973624,19993] 0 2023-12-05T09:57:04.037 INFO:tasks.workunit.client.0.smithi100.stdout:6/156: dread d7/f16 [0,4194304] 0 2023-12-05T09:57:04.087 INFO:tasks.workunit.client.0.smithi100.stdout:6/157: dwrite d7/f10 [0,4194304] 0 2023-12-05T09:57:04.090 INFO:tasks.workunit.client.0.smithi100.stdout:6/158: rename d7/d11/d1a/d1c/f1e to d7/d27/f33 0 2023-12-05T09:57:04.094 INFO:tasks.workunit.client.0.smithi100.stdout:6/159: symlink d7/d11/d1a/d1c/l34 0 2023-12-05T09:57:04.097 INFO:tasks.workunit.client.0.smithi100.stdout:6/160: mkdir d7/d27/d35 0 2023-12-05T09:57:04.104 INFO:tasks.workunit.client.0.smithi100.stdout:6/161: dread f4 [0,4194304] 0 2023-12-05T09:57:04.104 INFO:tasks.workunit.client.0.smithi100.stdout:6/162: write d7/d11/d1a/d1c/f28 [843572,50391] 0 2023-12-05T09:57:04.104 INFO:tasks.workunit.client.0.smithi100.stdout:6/163: chown d7/d11 2095649518 1 2023-12-05T09:57:04.105 INFO:tasks.workunit.client.0.smithi100.stdout:6/164: fdatasync d7/d11/d1a/f2f 0 2023-12-05T09:57:04.134 INFO:tasks.workunit.client.0.smithi100.stdout:6/165: dwrite f4 [0,4194304] 0 2023-12-05T09:57:04.136 INFO:tasks.workunit.client.0.smithi100.stdout:6/166: mknod d7/d11/d1a/d1c/c36 0 2023-12-05T09:57:04.136 INFO:tasks.workunit.client.0.smithi100.stdout:6/167: chown d7/d11/f2c 9 1 2023-12-05T09:57:04.138 INFO:tasks.workunit.client.0.smithi100.stdout:6/168: rename d7/cc to d7/c37 0 2023-12-05T09:57:04.139 INFO:tasks.workunit.client.0.smithi100.stdout:6/169: creat d7/d27/f38 x:0 0 0 2023-12-05T09:57:04.150 INFO:tasks.workunit.client.0.smithi100.stdout:6/170: dread d7/f16 [0,4194304] 0 2023-12-05T09:57:04.150 INFO:tasks.workunit.client.0.smithi100.stdout:6/171: fsync d7/f16 0 2023-12-05T09:57:04.182 INFO:tasks.workunit.client.0.smithi100.stdout:6/172: dwrite f5 [0,4194304] 0 2023-12-05T09:57:04.204 INFO:tasks.workunit.client.0.smithi100.stdout:6/173: write f4 [1782076,123080] 0 2023-12-05T09:57:04.265 INFO:tasks.workunit.client.0.smithi100.stdout:6/174: getdents d7/d11 0 2023-12-05T09:57:04.267 INFO:tasks.workunit.client.0.smithi100.stdout:6/175: creat d7/d27/d35/f39 x:0 0 0 2023-12-05T09:57:04.270 INFO:tasks.workunit.client.0.smithi100.stdout:6/176: link d7/d11/d1a/f22 d7/d27/d35/f3a 0 2023-12-05T09:57:04.374 INFO:tasks.workunit.client.0.smithi100.stdout:6/177: fsync d7/d11/d1a/d1c/f29 0 2023-12-05T09:57:04.387 INFO:tasks.workunit.client.0.smithi100.stdout:6/178: write d7/f16 [2179721,75163] 0 2023-12-05T09:57:04.388 INFO:tasks.workunit.client.0.smithi100.stdout:6/179: getdents d7/d11/d1a 0 2023-12-05T09:57:04.389 INFO:tasks.workunit.client.0.smithi100.stdout:6/180: creat d7/d27/f3b x:0 0 0 2023-12-05T09:57:04.410 INFO:tasks.workunit.client.0.smithi100.stdout:6/181: getdents d7/d27 0 2023-12-05T09:57:04.411 INFO:tasks.workunit.client.0.smithi100.stdout:6/182: mknod d7/d11/d1a/d1c/c3c 0 2023-12-05T09:57:04.411 INFO:tasks.workunit.client.0.smithi100.stdout:6/183: chown d7/d2d 455439350 1 2023-12-05T09:57:04.426 INFO:tasks.workunit.client.0.smithi100.stdout:6/184: dread d7/d11/f2c [0,4194304] 0 2023-12-05T09:57:04.426 INFO:tasks.workunit.client.0.smithi100.stdout:6/185: fdatasync d7/d11/d1a/f22 0 2023-12-05T09:57:04.466 INFO:tasks.workunit.client.0.smithi100.stdout:6/186: dwrite d7/f16 [4194304,4194304] 0 2023-12-05T09:57:04.466 INFO:tasks.workunit.client.0.smithi100.stdout:6/187: write d7/d11/d1a/f22 [1006361,115150] 0 2023-12-05T09:57:04.469 INFO:tasks.workunit.client.0.smithi100.stdout:6/188: symlink d7/d27/d35/l3d 0 2023-12-05T09:57:04.469 INFO:tasks.workunit.client.0.smithi100.stdout:6/189: dread - d7/d11/d1a/f2f zero size 2023-12-05T09:57:04.481 INFO:tasks.workunit.client.0.smithi100.stdout:6/190: write d7/d11/f12 [2696638,17122] 0 2023-12-05T09:57:04.483 INFO:tasks.workunit.client.0.smithi100.stdout:6/191: unlink d7/d27/f33 0 2023-12-05T09:57:04.500 INFO:tasks.workunit.client.0.smithi100.stdout:6/192: write d7/f10 [2467896,5495] 0 2023-12-05T09:57:04.502 INFO:tasks.workunit.client.0.smithi100.stdout:6/193: truncate d7/d11/d1a/f1b 196620 0 2023-12-05T09:57:04.513 INFO:tasks.workunit.client.0.smithi100.stdout:6/194: dread d7/f17 [0,4194304] 0 2023-12-05T09:57:04.561 INFO:tasks.workunit.client.0.smithi100.stdout:6/195: dwrite d7/d11/d1a/d1c/f28 [0,4194304] 0 2023-12-05T09:57:04.564 INFO:tasks.workunit.client.0.smithi100.stdout:6/196: mknod d7/d11/d1a/d1c/c3e 0 2023-12-05T09:57:04.564 INFO:tasks.workunit.client.0.smithi100.stdout:6/197: read - d7/d27/f2e zero size 2023-12-05T09:57:04.611 INFO:tasks.workunit.client.0.smithi100.stdout:6/198: dwrite d7/d11/d1a/f2b [0,4194304] 0 2023-12-05T09:57:04.611 INFO:tasks.workunit.client.0.smithi100.stdout:6/199: stat f5 0 2023-12-05T09:57:04.611 INFO:tasks.workunit.client.0.smithi100.stdout:6/200: dread - d7/d27/f3b zero size 2023-12-05T09:57:04.618 INFO:tasks.workunit.client.0.smithi100.stdout:6/201: write d7/d11/d1a/d1c/f28 [4707217,54667] 0 2023-12-05T09:57:04.619 INFO:tasks.workunit.client.0.smithi100.stdout:6/202: write d7/d27/d35/f3a [546606,49439] 0 2023-12-05T09:57:04.620 INFO:tasks.workunit.client.0.smithi100.stdout:6/203: rmdir d7/d11/d1a 39 2023-12-05T09:57:04.623 INFO:tasks.workunit.client.0.smithi100.stdout:6/204: creat d7/d2d/f3f x:0 0 0 2023-12-05T09:57:04.623 INFO:tasks.workunit.client.0.smithi100.stdout:6/205: readlink d7/d11/l19 0 2023-12-05T09:57:04.640 INFO:tasks.workunit.client.0.smithi100.stdout:6/206: dread d7/d11/d1a/d1c/f28 [0,4194304] 0 2023-12-05T09:57:04.641 INFO:tasks.workunit.client.0.smithi100.stdout:6/207: rename d7/d2d/f30 to d7/d2d/f40 0 2023-12-05T09:57:04.642 INFO:tasks.workunit.client.0.smithi100.stdout:6/208: mkdir d7/d41 0 2023-12-05T09:57:04.656 INFO:tasks.workunit.client.0.smithi100.stdout:6/209: write f5 [2402008,120787] 0 2023-12-05T09:57:04.687 INFO:tasks.workunit.client.0.smithi100.stdout:6/210: dwrite d7/d11/f20 [0,4194304] 0 2023-12-05T09:57:04.687 INFO:tasks.workunit.client.0.smithi100.stdout:6/211: fdatasync d7/d27/f3b 0 2023-12-05T09:57:04.687 INFO:tasks.workunit.client.0.smithi100.stdout:6/212: creat d7/d2d/f42 x:0 0 0 2023-12-05T09:57:04.689 INFO:tasks.workunit.client.0.smithi100.stdout:6/213: unlink d7/d11/d1a/d1c/c3c 0 2023-12-05T09:57:04.689 INFO:tasks.workunit.client.0.smithi100.stdout:6/214: write d7/f17 [1159235,99574] 0 2023-12-05T09:57:04.689 INFO:tasks.workunit.client.0.smithi100.stdout:6/215: getdents d7/d11 0 2023-12-05T09:57:04.689 INFO:tasks.workunit.client.0.smithi100.stdout:6/216: creat d7/d2d/f43 x:0 0 0 2023-12-05T09:57:04.692 INFO:tasks.workunit.client.0.smithi100.stdout:6/217: link d7/l8 d7/d11/l44 0 2023-12-05T09:57:04.692 INFO:tasks.workunit.client.0.smithi100.stdout:6/218: write d7/d11/d1a/f1f [878025,125763] 0 2023-12-05T09:57:04.705 INFO:tasks.workunit.client.0.smithi100.stdout:6/219: dread d7/d11/d1a/f2b [0,4194304] 0 2023-12-05T09:57:04.706 INFO:tasks.workunit.client.0.smithi100.stdout:6/220: symlink d7/d11/d1a/l45 0 2023-12-05T09:57:04.707 INFO:tasks.workunit.client.0.smithi100.stdout:6/221: truncate d7/d27/d35/f39 741352 0 2023-12-05T09:57:04.707 INFO:tasks.workunit.client.0.smithi100.stdout:6/222: fsync d7/d11/f2c 0 2023-12-05T09:57:04.709 INFO:tasks.workunit.client.0.smithi100.stdout:6/223: unlink d7/d2d/f3f 0 2023-12-05T09:57:04.742 INFO:tasks.workunit.client.0.smithi100.stdout:6/224: dwrite d7/d2d/f40 [0,4194304] 0 2023-12-05T09:57:04.743 INFO:tasks.workunit.client.0.smithi100.stdout:6/225: creat d7/d2d/f46 x:0 0 0 2023-12-05T09:57:04.743 INFO:tasks.workunit.client.0.smithi100.stdout:6/226: write d7/d27/d35/f3a [1226538,125125] 0 2023-12-05T09:57:04.752 INFO:tasks.workunit.client.0.smithi100.stdout:6/227: dread d7/f17 [0,4194304] 0 2023-12-05T09:57:04.844 INFO:tasks.workunit.client.0.smithi100.stdout:6/228: truncate d7/d11/f12 2193402 0 2023-12-05T09:57:04.845 INFO:tasks.workunit.client.0.smithi100.stdout:6/229: mknod d7/d11/c47 0 2023-12-05T09:57:04.845 INFO:tasks.workunit.client.0.smithi100.stdout:6/230: creat d7/d2d/f48 x:0 0 0 2023-12-05T09:57:04.845 INFO:tasks.workunit.client.0.smithi100.stdout:6/231: truncate d7/d11/f2c 4498078 0 2023-12-05T09:57:04.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:04 smithi150 ceph-mon[116142]: pgmap v18: 65 pgs: 65 active+clean; 213 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 6.8 MiB/s wr, 290 op/s 2023-12-05T09:57:04.880 INFO:tasks.workunit.client.0.smithi100.stdout:6/232: dwrite d7/d11/d1a/d1c/f28 [4194304,4194304] 0 2023-12-05T09:57:04.881 INFO:tasks.workunit.client.0.smithi100.stdout:6/233: creat d7/d27/d35/f49 x:0 0 0 2023-12-05T09:57:04.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:04 smithi100 ceph-mon[107145]: pgmap v18: 65 pgs: 65 active+clean; 213 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 6.8 MiB/s wr, 290 op/s 2023-12-05T09:57:04.908 INFO:tasks.workunit.client.0.smithi100.stdout:6/234: write d7/d11/f12 [714340,69573] 0 2023-12-05T09:57:04.908 INFO:tasks.workunit.client.0.smithi100.stdout:6/235: write d7/d2d/f43 [629517,88933] 0 2023-12-05T09:57:04.910 INFO:tasks.workunit.client.0.smithi100.stdout:6/236: rmdir d7/d41 0 2023-12-05T09:57:04.910 INFO:tasks.workunit.client.0.smithi100.stdout:6/237: creat d7/d2d/f4a x:0 0 0 2023-12-05T09:57:04.910 INFO:tasks.workunit.client.0.smithi100.stdout:6/238: chown d7/d27 0 1 2023-12-05T09:57:04.913 INFO:tasks.workunit.client.0.smithi100.stdout:6/239: mknod d7/c4b 0 2023-12-05T09:57:04.963 INFO:tasks.workunit.client.0.smithi100.stdout:6/240: getdents d7/d2d 0 2023-12-05T09:57:05.006 INFO:tasks.workunit.client.0.smithi100.stdout:6/241: truncate d7/d11/d1a/d1c/f28 1265199 0 2023-12-05T09:57:05.008 INFO:tasks.workunit.client.0.smithi100.stdout:6/242: fdatasync d7/f10 0 2023-12-05T09:57:05.008 INFO:tasks.workunit.client.0.smithi100.stdout:6/243: chown d7/d27/f3b 1923 1 2023-12-05T09:57:05.008 INFO:tasks.workunit.client.0.smithi100.stdout:6/244: fdatasync f3 0 2023-12-05T09:57:05.008 INFO:tasks.workunit.client.0.smithi100.stdout:6/245: dread - d7/f23 zero size 2023-12-05T09:57:05.011 INFO:tasks.workunit.client.0.smithi100.stdout:6/246: creat d7/d11/f4c x:0 0 0 2023-12-05T09:57:05.011 INFO:tasks.workunit.client.0.smithi100.stdout:6/247: write d7/d27/d35/f3a [1015329,80770] 0 2023-12-05T09:57:05.014 INFO:tasks.workunit.client.0.smithi100.stdout:6/248: rename d7/d11/d1a/d1c/l34 to d7/d27/l4d 0 2023-12-05T09:57:05.014 INFO:tasks.workunit.client.0.smithi100.stdout:6/249: chown d7/d2d/f46 1637145 1 2023-12-05T09:57:05.016 INFO:tasks.workunit.client.0.smithi100.stdout:6/250: symlink d7/d27/d35/l4e 0 2023-12-05T09:57:05.016 INFO:tasks.workunit.client.0.smithi100.stdout:6/251: readlink d7/l24 0 2023-12-05T09:57:05.019 INFO:tasks.workunit.client.0.smithi100.stdout:6/252: link d7/d11/f12 d7/f4f 0 2023-12-05T09:57:05.021 INFO:tasks.workunit.client.0.smithi100.stdout:6/253: creat d7/d27/f50 x:0 0 0 2023-12-05T09:57:05.024 INFO:tasks.workunit.client.0.smithi100.stdout:6/254: link d7/f16 d7/d11/f51 0 2023-12-05T09:57:05.024 INFO:tasks.workunit.client.0.smithi100.stdout:6/255: read d7/f16 [3827355,38332] 0 2023-12-05T09:57:05.024 INFO:tasks.workunit.client.0.smithi100.stdout:6/256: dread - d7/d27/f3b zero size 2023-12-05T09:57:05.026 INFO:tasks.workunit.client.0.smithi100.stdout:6/257: creat d7/d11/d1a/f52 x:0 0 0 2023-12-05T09:57:05.029 INFO:tasks.workunit.client.0.smithi100.stdout:6/258: mkdir d7/d11/d1a/d53 0 2023-12-05T09:57:05.029 INFO:tasks.workunit.client.0.smithi100.stdout:6/259: creat d7/d11/d1a/f54 x:0 0 0 2023-12-05T09:57:05.029 INFO:tasks.workunit.client.0.smithi100.stdout:6/260: stat d7/d27 0 2023-12-05T09:57:05.030 INFO:tasks.workunit.client.0.smithi100.stdout:6/261: dread - d7/d27/f38 zero size 2023-12-05T09:57:05.037 INFO:tasks.workunit.client.0.smithi100.stdout:6/262: dread f3 [0,4194304] 0 2023-12-05T09:57:05.040 INFO:tasks.workunit.client.0.smithi100.stdout:6/263: creat d7/d11/d1a/d53/f55 x:0 0 0 2023-12-05T09:57:05.060 INFO:tasks.workunit.client.0.smithi100.stdout:6/264: write d7/d2d/f40 [4163204,58985] 0 2023-12-05T09:57:05.060 INFO:tasks.workunit.client.0.smithi100.stdout:6/265: dread - d7/d11/d1a/f2f zero size 2023-12-05T09:57:05.102 INFO:tasks.workunit.client.0.smithi100.stdout:6/266: truncate d7/d11/f12 1660017 0 2023-12-05T09:57:05.105 INFO:tasks.workunit.client.0.smithi100.stdout:6/267: creat d7/f56 x:0 0 0 2023-12-05T09:57:05.105 INFO:tasks.workunit.client.0.smithi100.stdout:6/268: stat d7/d2d/f43 0 2023-12-05T09:57:05.118 INFO:tasks.workunit.client.0.smithi100.stdout:6/269: dread f5 [0,4194304] 0 2023-12-05T09:57:05.134 INFO:tasks.workunit.client.0.smithi100.stdout:6/270: getdents d7 0 2023-12-05T09:57:05.136 INFO:tasks.workunit.client.0.smithi100.stdout:6/271: symlink d7/d11/d1a/d1c/l57 0 2023-12-05T09:57:05.138 INFO:tasks.workunit.client.0.smithi100.stdout:6/272: symlink d7/d11/d1a/d1c/l58 0 2023-12-05T09:57:05.141 INFO:tasks.workunit.client.0.smithi100.stdout:6/273: creat d7/f59 x:0 0 0 2023-12-05T09:57:05.141 INFO:tasks.workunit.client.0.smithi100.stdout:6/274: chown d7/c18 25911 1 2023-12-05T09:57:05.142 INFO:tasks.workunit.client.0.smithi100.stdout:6/275: write d7/d27/d35/f39 [133190,57372] 0 2023-12-05T09:57:05.144 INFO:tasks.workunit.client.0.smithi100.stdout:6/276: mkdir d7/d27/d35/d5a 0 2023-12-05T09:57:05.144 INFO:tasks.workunit.client.0.smithi100.stdout:6/277: creat d7/d27/f5b x:0 0 0 2023-12-05T09:57:05.157 INFO:tasks.workunit.client.0.smithi100.stdout:6/278: write d7/d11/f51 [7091107,88291] 0 2023-12-05T09:57:05.170 INFO:tasks.workunit.client.0.smithi100.stdout:6/279: dread d7/d2d/f43 [0,4194304] 0 2023-12-05T09:57:05.170 INFO:tasks.workunit.client.0.smithi100.stdout:6/280: stat d7/d27/f50 0 2023-12-05T09:57:05.172 INFO:tasks.workunit.client.0.smithi100.stdout:6/281: rmdir d7/d11/d1a/d53 39 2023-12-05T09:57:05.174 INFO:tasks.workunit.client.0.smithi100.stdout:6/282: mknod d7/d27/c5c 0 2023-12-05T09:57:05.209 INFO:tasks.workunit.client.0.smithi100.stdout:6/283: dwrite d7/d11/d1a/d1c/f28 [0,4194304] 0 2023-12-05T09:57:05.212 INFO:tasks.workunit.client.0.smithi100.stdout:6/284: rename d7/d11/d1a/f1f to d7/d2d/f5d 0 2023-12-05T09:57:05.215 INFO:tasks.workunit.client.0.smithi100.stdout:6/285: mknod d7/d11/d1a/d1c/c5e 0 2023-12-05T09:57:05.218 INFO:tasks.workunit.client.0.smithi100.stdout:6/286: rename d7/l8 to d7/d2d/l5f 0 2023-12-05T09:57:05.220 INFO:tasks.workunit.client.0.smithi100.stdout:6/287: symlink d7/d27/d35/l60 0 2023-12-05T09:57:05.274 INFO:tasks.workunit.client.0.smithi100.stdout:6/288: dwrite d7/d2d/f4a [0,4194304] 0 2023-12-05T09:57:05.292 INFO:tasks.workunit.client.0.smithi100.stdout:6/289: dread f4 [0,4194304] 0 2023-12-05T09:57:05.296 INFO:tasks.workunit.client.0.smithi100.stdout:6/290: rename d7/d11/d1a/d1c/c5e to d7/d2d/c61 0 2023-12-05T09:57:05.309 INFO:tasks.workunit.client.0.smithi100.stdout:6/291: dread f5 [0,4194304] 0 2023-12-05T09:57:05.312 INFO:tasks.workunit.client.0.smithi100.stdout:6/292: rename d7/d11/l44 to d7/d11/d1a/d1c/l62 0 2023-12-05T09:57:05.347 INFO:tasks.workunit.client.0.smithi100.stdout:6/293: dwrite d7/d2d/f43 [0,4194304] 0 2023-12-05T09:57:05.350 INFO:tasks.workunit.client.0.smithi100.stdout:6/294: mknod d7/d2d/c63 0 2023-12-05T09:57:05.350 INFO:tasks.workunit.client.0.smithi100.stdout:6/295: fdatasync f4 0 2023-12-05T09:57:05.350 INFO:tasks.workunit.client.0.smithi100.stdout:6/296: dread - d7/d27/d35/f49 zero size 2023-12-05T09:57:05.354 INFO:tasks.workunit.client.0.smithi100.stdout:6/297: mkdir d7/d27/d35/d64 0 2023-12-05T09:57:05.356 INFO:tasks.workunit.client.0.smithi100.stdout:6/298: link d7/f4f d7/d27/d35/d5a/f65 0 2023-12-05T09:57:05.360 INFO:tasks.workunit.client.0.smithi100.stdout:6/299: mkdir d7/d2d/d66 0 2023-12-05T09:57:05.362 INFO:tasks.workunit.client.0.smithi100.stdout:6/300: symlink d7/d11/d1a/l67 0 2023-12-05T09:57:05.365 INFO:tasks.workunit.client.0.smithi100.stdout:6/301: mknod d7/d27/d35/c68 0 2023-12-05T09:57:05.365 INFO:tasks.workunit.client.0.smithi100.stdout:6/302: write d7/d27/d35/f49 [943156,107173] 0 2023-12-05T09:57:05.374 INFO:tasks.workunit.client.0.smithi100.stdout:6/303: symlink d7/d11/l69 0 2023-12-05T09:57:05.374 INFO:tasks.workunit.client.0.smithi100.stdout:6/304: truncate d7/d27/f38 666976 0 2023-12-05T09:57:05.375 INFO:tasks.workunit.client.0.smithi100.stdout:6/305: rmdir d7/d27/d35/d64 0 2023-12-05T09:57:05.375 INFO:tasks.workunit.client.0.smithi100.stdout:6/306: write d7/d11/d1a/f22 [462564,29417] 0 2023-12-05T09:57:05.380 INFO:tasks.workunit.client.0.smithi100.stdout:6/307: dread d7/d11/d1a/f2b [0,4194304] 0 2023-12-05T09:57:05.382 INFO:tasks.workunit.client.0.smithi100.stdout:6/308: mkdir d7/d2d/d6a 0 2023-12-05T09:57:05.420 INFO:tasks.workunit.client.0.smithi100.stdout:6/309: dwrite d7/f17 [0,4194304] 0 2023-12-05T09:57:05.420 INFO:tasks.workunit.client.0.smithi100.stdout:6/310: creat d7/d11/d1a/f6b x:0 0 0 2023-12-05T09:57:05.433 INFO:tasks.workunit.client.0.smithi100.stdout:6/311: write d7/d2d/f4a [1774475,117071] 0 2023-12-05T09:57:05.435 INFO:tasks.workunit.client.0.smithi100.stdout:6/312: mknod d7/d27/d35/c6c 0 2023-12-05T09:57:05.438 INFO:tasks.workunit.client.0.smithi100.stdout:6/313: rmdir d7/d2d/d66 0 2023-12-05T09:57:05.438 INFO:tasks.workunit.client.0.smithi100.stdout:6/314: creat d7/d11/f6d x:0 0 0 2023-12-05T09:57:05.514 INFO:tasks.workunit.client.0.smithi100.stdout:6/315: truncate d7/f10 2125553 0 2023-12-05T09:57:05.516 INFO:tasks.workunit.client.0.smithi100.stdout:6/316: rename d7/f4f to d7/d11/f6e 0 2023-12-05T09:57:05.516 INFO:tasks.workunit.client.0.smithi100.stdout:6/317: getdents d7/d2d/d6a 0 2023-12-05T09:57:05.518 INFO:tasks.workunit.client.0.smithi100.stdout:6/318: mknod d7/d2d/c6f 0 2023-12-05T09:57:05.518 INFO:tasks.workunit.client.0.smithi100.stdout:6/319: dread - d7/d11/f4c zero size 2023-12-05T09:57:05.518 INFO:tasks.workunit.client.0.smithi100.stdout:6/320: readlink d7/d27/d35/l60 0 2023-12-05T09:57:05.518 INFO:tasks.workunit.client.0.smithi100.stdout:6/321: readlink d7/l14 0 2023-12-05T09:57:05.561 INFO:tasks.workunit.client.0.smithi100.stdout:6/322: dwrite d7/f16 [4194304,4194304] 0 2023-12-05T09:57:05.562 INFO:tasks.workunit.client.0.smithi100.stdout:6/323: getdents d7/d27/d35/d5a 0 2023-12-05T09:57:05.599 INFO:tasks.workunit.client.0.smithi100.stdout:6/324: dread d7/f10 [0,4194304] 0 2023-12-05T09:57:05.601 INFO:tasks.workunit.client.0.smithi100.stdout:6/325: creat d7/d27/d35/d5a/f70 x:0 0 0 2023-12-05T09:57:06.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:06 smithi150 ceph-mon[116142]: pgmap v19: 65 pgs: 65 active+clean; 286 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 11 MiB/s rd, 20 MiB/s wr, 314 op/s 2023-12-05T09:57:06.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:06 smithi100 ceph-mon[107145]: pgmap v19: 65 pgs: 65 active+clean; 286 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 11 MiB/s rd, 20 MiB/s wr, 314 op/s 2023-12-05T09:57:08.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:08 smithi100 ceph-mon[107145]: pgmap v20: 65 pgs: 65 active+clean; 286 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 11 MiB/s rd, 19 MiB/s wr, 305 op/s 2023-12-05T09:57:08.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:08 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:57:08.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:08 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:57:08.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:08 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:57:08.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:08 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:57:08.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:08 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:57:08.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:08 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:57:08.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:08 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:57:08.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:08 smithi100 ceph-mon[107145]: Reconfiguring node-exporter.smithi100 (dependencies changed)... 2023-12-05T09:57:08.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:08 smithi100 ceph-mon[107145]: Reconfiguring daemon node-exporter.smithi100 on smithi100 2023-12-05T09:57:08.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:08 smithi150 ceph-mon[116142]: pgmap v20: 65 pgs: 65 active+clean; 286 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 11 MiB/s rd, 19 MiB/s wr, 305 op/s 2023-12-05T09:57:08.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:08 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:57:08.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:08 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:57:08.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:08 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:57:08.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:08 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:57:08.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:08 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:57:08.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:08 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:57:08.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:08 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:57:08.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:08 smithi150 ceph-mon[116142]: Reconfiguring node-exporter.smithi100 (dependencies changed)... 2023-12-05T09:57:08.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:08 smithi150 ceph-mon[116142]: Reconfiguring daemon node-exporter.smithi100 on smithi100 2023-12-05T09:57:10.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:10 smithi150 ceph-mon[116142]: pgmap v21: 65 pgs: 65 active+clean; 286 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 11 MiB/s rd, 19 MiB/s wr, 305 op/s 2023-12-05T09:57:10.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:10 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:57:10.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:10 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:57:10.887 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:10 smithi100 ceph-mon[107145]: pgmap v21: 65 pgs: 65 active+clean; 286 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 11 MiB/s rd, 19 MiB/s wr, 305 op/s 2023-12-05T09:57:10.887 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:10 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:57:10.888 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:10 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:57:11.227 INFO:tasks.workunit.client.0.smithi100.stdout:2/34: sync 2023-12-05T09:57:11.227 INFO:tasks.workunit.client.0.smithi100.stdout:9/52: sync 2023-12-05T09:57:11.227 INFO:tasks.workunit.client.0.smithi100.stdout:0/58: sync 2023-12-05T09:57:11.228 INFO:tasks.workunit.client.0.smithi100.stdout:6/326: sync 2023-12-05T09:57:11.228 INFO:tasks.workunit.client.0.smithi100.stdout:7/3: sync 2023-12-05T09:57:11.228 INFO:tasks.workunit.client.0.smithi100.stdout:7/4: rmdir - no directory 2023-12-05T09:57:11.228 INFO:tasks.workunit.client.0.smithi100.stdout:0/59: chown f1 917502 1 2023-12-05T09:57:11.228 INFO:tasks.workunit.client.0.smithi100.stdout:7/5: chown f0 23 1 2023-12-05T09:57:11.228 INFO:tasks.workunit.client.0.smithi100.stdout:7/6: truncate f0 664609 0 2023-12-05T09:57:11.228 INFO:tasks.workunit.client.0.smithi100.stdout:6/327: write d7/d11/d1a/d53/f55 [513378,88667] 0 2023-12-05T09:57:11.228 INFO:tasks.workunit.client.0.smithi100.stdout:6/328: chown d7/d27/d35/l60 265180881 1 2023-12-05T09:57:11.229 INFO:tasks.workunit.client.0.smithi100.stdout:4/41: sync 2023-12-05T09:57:11.229 INFO:tasks.workunit.client.0.smithi100.stdout:8/24: sync 2023-12-05T09:57:11.229 INFO:tasks.workunit.client.0.smithi100.stdout:5/2: sync 2023-12-05T09:57:11.229 INFO:tasks.workunit.client.0.smithi100.stdout:5/3: write - no filename 2023-12-05T09:57:11.229 INFO:tasks.workunit.client.0.smithi100.stdout:8/25: chown d0 72147296 1 2023-12-05T09:57:11.229 INFO:tasks.workunit.client.0.smithi100.stdout:5/4: dread - no filename 2023-12-05T09:57:11.229 INFO:tasks.workunit.client.0.smithi100.stdout:5/5: fsync - no filename 2023-12-05T09:57:11.229 INFO:tasks.workunit.client.0.smithi100.stdout:8/26: chown d0 32975 1 2023-12-05T09:57:11.229 INFO:tasks.workunit.client.0.smithi100.stdout:5/6: rmdir - no directory 2023-12-05T09:57:11.229 INFO:tasks.workunit.client.0.smithi100.stdout:8/27: dwrite - no filename 2023-12-05T09:57:11.229 INFO:tasks.workunit.client.0.smithi100.stdout:8/28: dwrite - no filename 2023-12-05T09:57:11.230 INFO:tasks.workunit.client.0.smithi100.stdout:8/29: dwrite - no filename 2023-12-05T09:57:11.230 INFO:tasks.workunit.client.0.smithi100.stdout:8/30: readlink - no filename 2023-12-05T09:57:11.230 INFO:tasks.workunit.client.0.smithi100.stdout:5/7: chown . 306 1 2023-12-05T09:57:11.230 INFO:tasks.workunit.client.0.smithi100.stdout:3/81: sync 2023-12-05T09:57:11.230 INFO:tasks.workunit.client.0.smithi100.stdout:1/9: sync 2023-12-05T09:57:11.230 INFO:tasks.workunit.client.0.smithi100.stdout:1/10: chown c2 61 1 2023-12-05T09:57:11.239 INFO:tasks.workunit.client.0.smithi100.stdout:4/42: rename f7 to f9 0 2023-12-05T09:57:11.239 INFO:tasks.workunit.client.0.smithi100.stdout:4/43: creat fa x:0 0 0 2023-12-05T09:57:11.240 INFO:tasks.workunit.client.0.smithi100.stdout:5/8: mkdir d0 0 2023-12-05T09:57:11.241 INFO:tasks.workunit.client.0.smithi100.stdout:5/9: write - no filename 2023-12-05T09:57:11.241 INFO:tasks.workunit.client.0.smithi100.stdout:5/10: getdents d0 0 2023-12-05T09:57:11.241 INFO:tasks.workunit.client.0.smithi100.stdout:5/11: truncate - no filename 2023-12-05T09:57:11.241 INFO:tasks.workunit.client.0.smithi100.stdout:5/12: write - no filename 2023-12-05T09:57:11.245 INFO:tasks.workunit.client.0.smithi100.stdout:9/53: dread d7/fd [0,4194304] 0 2023-12-05T09:57:11.253 INFO:tasks.workunit.client.0.smithi100.stdout:5/13: mknod d0/c1 0 2023-12-05T09:57:11.253 INFO:tasks.workunit.client.0.smithi100.stdout:5/14: readlink - no filename 2023-12-05T09:57:11.254 INFO:tasks.workunit.client.0.smithi100.stdout:5/15: chown d0/c1 3034 1 2023-12-05T09:57:11.259 INFO:tasks.workunit.client.0.smithi100.stdout:0/60: dread f1 [0,4194304] 0 2023-12-05T09:57:11.260 INFO:tasks.workunit.client.0.smithi100.stdout:3/82: dread d0/d4/fc [0,4194304] 0 2023-12-05T09:57:11.260 INFO:tasks.workunit.client.0.smithi100.stdout:3/83: readlink d0/l6 0 2023-12-05T09:57:11.261 INFO:tasks.workunit.client.0.smithi100.stdout:9/54: symlink d7/d10/l16 0 2023-12-05T09:57:11.266 INFO:tasks.workunit.client.0.smithi100.stdout:4/44: link fa fb 0 2023-12-05T09:57:11.272 INFO:tasks.workunit.client.0.smithi100.stdout:5/16: creat d0/f2 x:0 0 0 2023-12-05T09:57:11.273 INFO:tasks.workunit.client.0.smithi100.stdout:5/17: creat d0/f3 x:0 0 0 2023-12-05T09:57:11.281 INFO:tasks.workunit.client.0.smithi100.stdout:3/84: unlink d0/d2/f9 0 2023-12-05T09:57:11.287 INFO:tasks.workunit.client.0.smithi100.stdout:5/18: mkdir d0/d4 0 2023-12-05T09:57:11.301 INFO:tasks.workunit.client.0.smithi100.stdout:7/7: dwrite f0 [0,4194304] 0 2023-12-05T09:57:11.314 INFO:tasks.workunit.client.0.smithi100.stdout:6/329: dwrite d7/d11/d1a/f2b [4194304,4194304] 0 2023-12-05T09:57:11.325 INFO:tasks.workunit.client.0.smithi100.stdout:7/8: dread f0 [0,4194304] 0 2023-12-05T09:57:11.329 INFO:tasks.workunit.client.0.smithi100.stdout:7/9: rename c1 to c2 0 2023-12-05T09:57:11.329 INFO:tasks.workunit.client.0.smithi100.stdout:3/85: dwrite d0/d2/fd [4194304,4194304] 0 2023-12-05T09:57:11.329 INFO:tasks.workunit.client.0.smithi100.stdout:3/86: chown d0/f3 9 1 2023-12-05T09:57:11.329 INFO:tasks.workunit.client.0.smithi100.stdout:3/87: chown d0/cb 121 1 2023-12-05T09:57:11.329 INFO:tasks.workunit.client.0.smithi100.stdout:3/88: fsync d0/f7 0 2023-12-05T09:57:11.330 INFO:tasks.workunit.client.0.smithi100.stdout:2/35: dwrite d7/f8 [0,4194304] 0 2023-12-05T09:57:11.332 INFO:tasks.workunit.client.0.smithi100.stdout:7/10: mkdir d3 0 2023-12-05T09:57:11.333 INFO:tasks.workunit.client.0.smithi100.stdout:6/330: write f5 [656562,67443] 0 2023-12-05T09:57:11.340 INFO:tasks.workunit.client.0.smithi100.stdout:2/36: unlink d7/f8 0 2023-12-05T09:57:11.345 INFO:tasks.workunit.client.0.smithi100.stdout:1/11: dwrite f0 [0,4194304] 0 2023-12-05T09:57:11.345 INFO:tasks.workunit.client.0.smithi100.stdout:1/12: dread - f1 zero size 2023-12-05T09:57:11.345 INFO:tasks.workunit.client.0.smithi100.stdout:1/13: chown f1 175894121 1 2023-12-05T09:57:11.345 INFO:tasks.workunit.client.0.smithi100.stdout:7/11: unlink f0 0 2023-12-05T09:57:11.345 INFO:tasks.workunit.client.0.smithi100.stdout:0/61: dwrite da/fd [0,4194304] 0 2023-12-05T09:57:11.345 INFO:tasks.workunit.client.0.smithi100.stdout:0/62: dread - da/f11 zero size 2023-12-05T09:57:11.345 INFO:tasks.workunit.client.0.smithi100.stdout:0/63: write f1 [2016378,16170] 0 2023-12-05T09:57:11.345 INFO:tasks.workunit.client.0.smithi100.stdout:5/19: dwrite d0/f3 [0,4194304] 0 2023-12-05T09:57:11.345 INFO:tasks.workunit.client.0.smithi100.stdout:5/20: write d0/f2 [474808,5328] 0 2023-12-05T09:57:11.345 INFO:tasks.workunit.client.0.smithi100.stdout:5/21: fdatasync d0/f3 0 2023-12-05T09:57:11.354 INFO:tasks.workunit.client.0.smithi100.stdout:7/12: mkdir d3/d4 0 2023-12-05T09:57:11.354 INFO:tasks.workunit.client.0.smithi100.stdout:7/13: dwrite - no filename 2023-12-05T09:57:11.354 INFO:tasks.workunit.client.0.smithi100.stdout:7/14: readlink - no filename 2023-12-05T09:57:11.360 INFO:tasks.workunit.client.0.smithi100.stdout:0/64: creat da/f17 x:0 0 0 2023-12-05T09:57:11.368 INFO:tasks.workunit.client.0.smithi100.stdout:7/15: creat d3/f5 x:0 0 0 2023-12-05T09:57:11.368 INFO:tasks.workunit.client.0.smithi100.stdout:7/16: chown c2 51330944 1 2023-12-05T09:57:11.368 INFO:tasks.workunit.client.0.smithi100.stdout:7/17: dread - d3/f5 zero size 2023-12-05T09:57:11.368 INFO:tasks.workunit.client.0.smithi100.stdout:3/89: dread d0/f13 [0,4194304] 0 2023-12-05T09:57:11.368 INFO:tasks.workunit.client.0.smithi100.stdout:3/90: chown d0/d2/fd 399574540 1 2023-12-05T09:57:11.370 INFO:tasks.workunit.client.0.smithi100.stdout:0/65: unlink c3 0 2023-12-05T09:57:11.374 INFO:tasks.workunit.client.0.smithi100.stdout:3/91: creat d0/d4/f14 x:0 0 0 2023-12-05T09:57:11.374 INFO:tasks.workunit.client.0.smithi100.stdout:3/92: truncate d0/d2/fd 8808827 0 2023-12-05T09:57:11.377 INFO:tasks.workunit.client.0.smithi100.stdout:0/66: mknod da/c18 0 2023-12-05T09:57:11.381 INFO:tasks.workunit.client.0.smithi100.stdout:6/331: dwrite d7/d27/f38 [0,4194304] 0 2023-12-05T09:57:11.384 INFO:tasks.workunit.client.0.smithi100.stdout:3/93: mknod d0/d2/de/d12/c15 0 2023-12-05T09:57:11.390 INFO:tasks.workunit.client.0.smithi100.stdout:6/332: mknod d7/d2d/d6a/c71 0 2023-12-05T09:57:11.390 INFO:tasks.workunit.client.0.smithi100.stdout:0/67: read f2 [5010343,12592] 0 2023-12-05T09:57:11.396 INFO:tasks.workunit.client.0.smithi100.stdout:0/68: unlink f2 0 2023-12-05T09:57:11.396 INFO:tasks.workunit.client.1.smithi150.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2023-12-05T09:57:11.396 INFO:tasks.workunit.client.1.smithi150.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2023-12-05T09:57:11.397 INFO:tasks.workunit.client.1.smithi150.stderr:+ make 2023-12-05T09:57:11.400 INFO:tasks.workunit.client.0.smithi100.stdout:3/94: dread d0/d4/fc [0,4194304] 0 2023-12-05T09:57:11.400 INFO:tasks.workunit.client.0.smithi100.stdout:1/14: dwrite f1 [0,4194304] 0 2023-12-05T09:57:11.401 INFO:tasks.workunit.client.0.smithi100.stdout:1/15: chown f1 3052 1 2023-12-05T09:57:11.411 INFO:tasks.workunit.client.0.smithi100.stdout:0/69: dread da/fb [0,4194304] 0 2023-12-05T09:57:11.419 INFO:tasks.workunit.client.0.smithi100.stdout:3/95: rename d0/d2/de/d12/c15 to d0/d4/c16 0 2023-12-05T09:57:11.420 INFO:tasks.workunit.client.0.smithi100.stdout:1/16: read f1 [882605,97415] 0 2023-12-05T09:57:11.420 INFO:tasks.workunit.client.0.smithi100.stdout:2/37: dwrite f4 [0,4194304] 0 2023-12-05T09:57:11.420 INFO:tasks.workunit.client.0.smithi100.stdout:0/70: unlink da/c18 0 2023-12-05T09:57:11.425 INFO:tasks.workunit.client.0.smithi100.stdout:1/17: link c4 c6 0 2023-12-05T09:57:11.429 INFO:tasks.workunit.client.0.smithi100.stdout:7/18: dwrite d3/f5 [0,4194304] 0 2023-12-05T09:57:11.430 INFO:tasks.workunit.client.0.smithi100.stdout:7/19: fdatasync d3/f5 0 2023-12-05T09:57:11.444 INFO:tasks.workunit.client.0.smithi100.stdout:7/20: write d3/f5 [3152522,631] 0 2023-12-05T09:57:11.470 INFO:tasks.workunit.client.0.smithi100.stdout:0/71: dwrite da/fd [0,4194304] 0 2023-12-05T09:57:11.470 INFO:tasks.workunit.client.0.smithi100.stdout:0/72: write f1 [2212495,32834] 0 2023-12-05T09:57:11.485 INFO:tasks.workunit.client.0.smithi100.stdout:1/18: dread f0 [0,4194304] 0 2023-12-05T09:57:11.488 INFO:tasks.workunit.client.0.smithi100.stdout:2/38: dwrite f4 [0,4194304] 0 2023-12-05T09:57:11.489 INFO:tasks.workunit.client.0.smithi100.stdout:2/39: mknod d7/c9 0 2023-12-05T09:57:11.491 INFO:tasks.workunit.client.0.smithi100.stdout:2/40: unlink d7/c9 0 2023-12-05T09:57:11.492 INFO:tasks.workunit.client.0.smithi100.stdout:2/41: chown f4 906932 1 2023-12-05T09:57:11.493 INFO:tasks.workunit.client.0.smithi100.stdout:2/42: mkdir d7/da 0 2023-12-05T09:57:11.494 INFO:tasks.workunit.client.0.smithi100.stdout:1/19: dread f0 [0,4194304] 0 2023-12-05T09:57:11.501 INFO:tasks.workunit.client.0.smithi100.stdout:7/21: dwrite d3/f5 [0,4194304] 0 2023-12-05T09:57:11.538 INFO:tasks.workunit.client.0.smithi100.stdout:1/20: dwrite f0 [0,4194304] 0 2023-12-05T09:57:11.538 INFO:tasks.workunit.client.0.smithi100.stdout:1/21: readlink - no filename 2023-12-05T09:57:11.550 INFO:tasks.workunit.client.0.smithi100.stdout:1/22: dread f1 [0,4194304] 0 2023-12-05T09:57:11.551 INFO:tasks.workunit.client.0.smithi100.stdout:1/23: write f5 [243173,64135] 0 2023-12-05T09:57:11.551 INFO:tasks.workunit.client.0.smithi100.stdout:1/24: write f1 [568197,118813] 0 2023-12-05T09:57:11.551 INFO:tasks.workunit.client.0.smithi100.stdout:3/96: rename d0/f1 to d0/d4/f17 0 2023-12-05T09:57:11.554 INFO:tasks.workunit.client.0.smithi100.stdout:2/43: rename f4 to d7/fb 0 2023-12-05T09:57:11.555 INFO:tasks.workunit.client.0.smithi100.stdout:2/44: mkdir d7/da/dc 0 2023-12-05T09:57:11.556 INFO:tasks.workunit.client.0.smithi100.stdout:2/45: getdents d7/da/dc 0 2023-12-05T09:57:11.556 INFO:tasks.workunit.client.0.smithi100.stdout:2/46: symlink d7/ld 0 2023-12-05T09:57:11.573 INFO:tasks.workunit.client.0.smithi100.stdout:2/47: dread d7/fb [0,4194304] 0 2023-12-05T09:57:11.574 INFO:tasks.workunit.client.0.smithi100.stdout:2/48: write f5 [337798,23031] 0 2023-12-05T09:57:11.574 INFO:tasks.workunit.client.0.smithi100.stdout:2/49: chown d7/da/dc 4 1 2023-12-05T09:57:11.574 INFO:tasks.workunit.client.0.smithi100.stdout:2/50: write f5 [1085333,97866] 0 2023-12-05T09:57:11.575 INFO:tasks.workunit.client.0.smithi100.stdout:2/51: rename d7/ld to d7/da/le 0 2023-12-05T09:57:11.575 INFO:tasks.workunit.client.0.smithi100.stdout:2/52: creat d7/da/dc/ff x:0 0 0 2023-12-05T09:57:11.577 INFO:tasks.workunit.client.0.smithi100.stdout:2/53: read f5 [793668,49700] 0 2023-12-05T09:57:11.577 INFO:tasks.workunit.client.0.smithi100.stdout:2/54: chown c3 91210377 1 2023-12-05T09:57:11.577 INFO:tasks.workunit.client.0.smithi100.stdout:2/55: write f5 [1063408,1241] 0 2023-12-05T09:57:11.578 INFO:tasks.workunit.client.0.smithi100.stdout:2/56: mknod d7/c10 0 2023-12-05T09:57:11.579 INFO:tasks.workunit.client.0.smithi100.stdout:2/57: mknod d7/da/c11 0 2023-12-05T09:57:11.579 INFO:tasks.workunit.client.0.smithi100.stdout:2/58: creat d7/da/dc/f12 x:0 0 0 2023-12-05T09:57:11.591 INFO:tasks.workunit.client.0.smithi100.stdout:2/59: dread d7/fb [0,4194304] 0 2023-12-05T09:57:11.605 INFO:tasks.workunit.client.0.smithi100.stdout:9/55: rmdir d7/d10 39 2023-12-05T09:57:11.622 INFO:tasks.workunit.client.0.smithi100.stdout:9/56: write d7/fb [1632080,70546] 0 2023-12-05T09:57:11.624 INFO:tasks.workunit.client.0.smithi100.stdout:9/57: creat d7/d10/f17 x:0 0 0 2023-12-05T09:57:11.624 INFO:tasks.workunit.client.0.smithi100.stdout:2/60: dwrite d7/da/dc/ff [0,4194304] 0 2023-12-05T09:57:11.625 INFO:tasks.workunit.client.0.smithi100.stdout:9/58: symlink d7/d10/l18 0 2023-12-05T09:57:11.627 INFO:tasks.workunit.client.0.smithi100.stdout:9/59: getdents d7 0 2023-12-05T09:57:11.627 INFO:tasks.workunit.client.0.smithi100.stdout:9/60: dread - d7/fc zero size 2023-12-05T09:57:11.629 INFO:tasks.workunit.client.0.smithi100.stdout:9/61: symlink d7/l19 0 2023-12-05T09:57:11.630 INFO:tasks.workunit.client.0.smithi100.stdout:9/62: chown d7/l15 102 1 2023-12-05T09:57:11.630 INFO:tasks.workunit.client.0.smithi100.stdout:9/63: chown f1 2543 1 2023-12-05T09:57:11.633 INFO:tasks.workunit.client.0.smithi100.stdout:9/64: symlink d7/d10/l1a 0 2023-12-05T09:57:11.633 INFO:tasks.workunit.client.0.smithi100.stdout:9/65: write d7/d10/f11 [165137,55629] 0 2023-12-05T09:57:11.639 INFO:tasks.workunit.client.0.smithi100.stdout:5/22: truncate d0/f3 3765116 0 2023-12-05T09:57:11.641 INFO:tasks.workunit.client.0.smithi100.stdout:5/23: mkdir d0/d4/d5 0 2023-12-05T09:57:11.642 INFO:tasks.workunit.client.0.smithi100.stdout:5/24: mknod d0/d4/d5/c6 0 2023-12-05T09:57:11.643 INFO:tasks.workunit.client.0.smithi100.stdout:7/22: fsync d3/f5 0 2023-12-05T09:57:11.643 INFO:tasks.workunit.client.0.smithi100.stdout:7/23: rename d3/d4 to d3/d4/d6 22 2023-12-05T09:57:11.645 INFO:tasks.workunit.client.0.smithi100.stdout:7/24: creat d3/d4/f7 x:0 0 0 2023-12-05T09:57:11.649 INFO:tasks.workunit.client.0.smithi100.stdout:7/25: rename d3/d4/f7 to d3/f8 0 2023-12-05T09:57:11.650 INFO:tasks.workunit.client.0.smithi100.stdout:7/26: write d3/f8 [276049,70932] 0 2023-12-05T09:57:11.651 INFO:tasks.workunit.client.0.smithi100.stdout:9/66: write f1 [479310,43315] 0 2023-12-05T09:57:11.651 INFO:tasks.workunit.client.0.smithi100.stdout:7/27: symlink d3/l9 0 2023-12-05T09:57:11.653 INFO:tasks.workunit.client.0.smithi100.stdout:7/28: link d3/f5 d3/fa 0 2023-12-05T09:57:11.663 INFO:tasks.workunit.client.0.smithi100.stdout:9/67: dread d7/f8 [0,4194304] 0 2023-12-05T09:57:11.667 INFO:tasks.workunit.client.0.smithi100.stdout:1/25: getdents . 0 2023-12-05T09:57:11.672 INFO:tasks.workunit.client.0.smithi100.stdout:1/26: rename c4 to c7 0 2023-12-05T09:57:11.682 INFO:tasks.workunit.client.0.smithi100.stdout:1/27: rename f5 to f8 0 2023-12-05T09:57:11.686 INFO:tasks.workunit.client.0.smithi100.stdout:1/28: unlink f0 0 2023-12-05T09:57:11.689 INFO:tasks.workunit.client.0.smithi100.stdout:1/29: creat f9 x:0 0 0 2023-12-05T09:57:11.693 INFO:tasks.workunit.client.0.smithi100.stdout:2/61: dwrite d7/da/dc/f12 [0,4194304] 0 2023-12-05T09:57:11.696 INFO:tasks.workunit.client.0.smithi100.stdout:2/62: mkdir d7/da/d13 0 2023-12-05T09:57:11.703 INFO:tasks.workunit.client.0.smithi100.stdout:7/29: dwrite d3/f5 [0,4194304] 0 2023-12-05T09:57:11.703 INFO:tasks.workunit.client.0.smithi100.stdout:7/30: creat d3/d4/fb x:0 0 0 2023-12-05T09:57:11.705 INFO:tasks.workunit.client.0.smithi100.stdout:7/31: mkdir d3/dc 0 2023-12-05T09:57:11.719 INFO:tasks.workunit.client.0.smithi100.stdout:9/68: dwrite d7/d10/f17 [0,4194304] 0 2023-12-05T09:57:11.723 INFO:tasks.workunit.client.0.smithi100.stdout:7/32: write d3/fa [3168268,64612] 0 2023-12-05T09:57:11.723 INFO:tasks.workunit.client.0.smithi100.stdout:7/33: creat d3/fd x:0 0 0 2023-12-05T09:57:11.724 INFO:tasks.workunit.client.0.smithi100.stdout:2/63: unlink d7/fb 0 2023-12-05T09:57:11.724 INFO:tasks.workunit.client.0.smithi100.stdout:2/64: stat d7/c10 0 2023-12-05T09:57:11.732 INFO:tasks.workunit.client.0.smithi100.stdout:1/30: getdents . 0 2023-12-05T09:57:11.735 INFO:tasks.workunit.client.0.smithi100.stdout:2/65: rename c3 to d7/da/dc/c14 0 2023-12-05T09:57:11.735 INFO:tasks.workunit.client.0.smithi100.stdout:2/66: chown d7/da/dc/ff 99393 1 2023-12-05T09:57:11.736 INFO:tasks.workunit.client.0.smithi100.stdout:0/73: dwrite da/fb [0,4194304] 0 2023-12-05T09:57:11.737 INFO:tasks.workunit.client.0.smithi100.stdout:9/69: mkdir d7/d1b 0 2023-12-05T09:57:11.737 INFO:tasks.workunit.client.0.smithi100.stdout:1/31: symlink la 0 2023-12-05T09:57:11.737 INFO:tasks.workunit.client.0.smithi100.stdout:1/32: chown f1 6 1 2023-12-05T09:57:11.737 INFO:tasks.workunit.client.1.smithi150.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2023-12-05T09:57:11.738 INFO:tasks.workunit.client.0.smithi100.stdout:7/34: unlink d3/f8 0 2023-12-05T09:57:11.741 INFO:tasks.workunit.client.0.smithi100.stdout:7/35: fsync d3/f5 0 2023-12-05T09:57:11.743 INFO:tasks.workunit.client.0.smithi100.stdout:9/70: symlink d7/d1b/l1c 0 2023-12-05T09:57:11.744 INFO:tasks.workunit.client.0.smithi100.stdout:1/33: mkdir db 0 2023-12-05T09:57:11.745 INFO:tasks.workunit.client.0.smithi100.stdout:2/67: fdatasync f5 0 2023-12-05T09:57:11.746 INFO:tasks.workunit.client.0.smithi100.stdout:7/36: mkdir d3/d4/de 0 2023-12-05T09:57:11.752 INFO:tasks.workunit.client.0.smithi100.stdout:1/34: unlink f8 0 2023-12-05T09:57:11.754 INFO:tasks.workunit.client.0.smithi100.stdout:2/68: symlink d7/l15 0 2023-12-05T09:57:11.755 INFO:tasks.workunit.client.0.smithi100.stdout:7/37: mknod d3/dc/cf 0 2023-12-05T09:57:11.755 INFO:tasks.workunit.client.0.smithi100.stdout:7/38: write d3/d4/fb [806351,55436] 0 2023-12-05T09:57:11.757 INFO:tasks.workunit.client.0.smithi100.stdout:0/74: rmdir da 39 2023-12-05T09:57:11.758 INFO:tasks.workunit.client.0.smithi100.stdout:0/75: chown da/f11 31 1 2023-12-05T09:57:11.759 INFO:tasks.workunit.client.0.smithi100.stdout:9/71: rename d7/d10/f17 to d7/f1d 0 2023-12-05T09:57:11.760 INFO:tasks.workunit.client.0.smithi100.stdout:1/35: creat db/fc x:0 0 0 2023-12-05T09:57:11.761 INFO:tasks.workunit.client.0.smithi100.stdout:1/36: creat db/fd x:0 0 0 2023-12-05T09:57:11.762 INFO:tasks.workunit.client.0.smithi100.stdout:3/97: dwrite d0/d4/fc [0,4194304] 0 2023-12-05T09:57:11.762 INFO:tasks.workunit.client.0.smithi100.stdout:7/39: symlink d3/d4/l10 0 2023-12-05T09:57:11.763 INFO:tasks.workunit.client.0.smithi100.stdout:0/76: symlink da/l19 0 2023-12-05T09:57:11.765 INFO:tasks.workunit.client.0.smithi100.stdout:9/72: creat d7/d1b/f1e x:0 0 0 2023-12-05T09:57:11.765 INFO:tasks.workunit.client.0.smithi100.stdout:9/73: creat d7/d10/f1f x:0 0 0 2023-12-05T09:57:11.766 INFO:tasks.workunit.client.0.smithi100.stdout:1/37: symlink db/le 0 2023-12-05T09:57:11.766 INFO:tasks.workunit.client.0.smithi100.stdout:1/38: creat db/ff x:0 0 0 2023-12-05T09:57:11.771 INFO:tasks.workunit.client.0.smithi100.stdout:0/77: symlink da/l1a 0 2023-12-05T09:57:11.771 INFO:tasks.workunit.client.0.smithi100.stdout:3/98: creat d0/d2/de/d12/f18 x:0 0 0 2023-12-05T09:57:11.772 INFO:tasks.workunit.client.0.smithi100.stdout:0/78: mkdir da/d1b 0 2023-12-05T09:57:11.773 INFO:tasks.workunit.client.0.smithi100.stdout:9/74: mkdir d7/d20 0 2023-12-05T09:57:11.782 INFO:tasks.workunit.client.0.smithi100.stdout:9/75: rmdir d7/d1b 39 2023-12-05T09:57:11.789 INFO:tasks.workunit.client.0.smithi100.stdout:9/76: truncate d7/d10/f14 828567 0 2023-12-05T09:57:11.789 INFO:tasks.workunit.client.0.smithi100.stdout:9/77: write d7/d1b/f1e [636396,96015] 0 2023-12-05T09:57:11.790 INFO:tasks.workunit.client.0.smithi100.stdout:9/78: read f1 [246127,93266] 0 2023-12-05T09:57:11.790 INFO:tasks.workunit.client.0.smithi100.stdout:9/79: stat d7/d1b/l1c 0 2023-12-05T09:57:11.792 INFO:tasks.workunit.client.0.smithi100.stdout:9/80: rmdir d7 39 2023-12-05T09:57:11.795 INFO:tasks.workunit.client.0.smithi100.stdout:5/25: dwrite d0/f3 [4194304,4194304] 0 2023-12-05T09:57:11.795 INFO:tasks.workunit.client.0.smithi100.stdout:5/26: creat d0/f7 x:0 0 0 2023-12-05T09:57:11.795 INFO:tasks.workunit.client.0.smithi100.stdout:5/27: write d0/f7 [1032867,103229] 0 2023-12-05T09:57:11.803 INFO:tasks.workunit.client.0.smithi100.stdout:5/28: mknod d0/c8 0 2023-12-05T09:57:11.804 INFO:tasks.workunit.client.0.smithi100.stdout:5/29: rmdir d0/d4/d5 39 2023-12-05T09:57:11.804 INFO:tasks.workunit.client.0.smithi100.stdout:5/30: chown d0/d4 857 1 2023-12-05T09:57:11.812 INFO:tasks.workunit.client.0.smithi100.stdout:2/69: dwrite d7/da/dc/ff [4194304,4194304] 0 2023-12-05T09:57:11.813 INFO:tasks.workunit.client.0.smithi100.stdout:9/81: dread d7/fd [0,4194304] 0 2023-12-05T09:57:11.814 INFO:tasks.workunit.client.0.smithi100.stdout:9/82: dread - d7/fc zero size 2023-12-05T09:57:11.816 INFO:tasks.workunit.client.0.smithi100.stdout:9/83: read d7/fb [1893270,121323] 0 2023-12-05T09:57:11.816 INFO:tasks.workunit.client.0.smithi100.stdout:9/84: write d7/d10/f14 [1584232,13000] 0 2023-12-05T09:57:11.816 INFO:tasks.workunit.client.0.smithi100.stdout:9/85: write d7/d1b/f1e [1646660,59437] 0 2023-12-05T09:57:11.816 INFO:tasks.workunit.client.0.smithi100.stdout:9/86: chown d7/d10/f1f 0 1 2023-12-05T09:57:11.817 INFO:tasks.workunit.client.0.smithi100.stdout:9/87: rename d7/l19 to d7/d20/l21 0 2023-12-05T09:57:11.819 INFO:tasks.workunit.client.0.smithi100.stdout:5/31: rmdir d0 39 2023-12-05T09:57:11.826 INFO:tasks.workunit.client.0.smithi100.stdout:0/79: dwrite da/f11 [0,4194304] 0 2023-12-05T09:57:11.826 INFO:tasks.workunit.client.0.smithi100.stdout:5/32: rename d0/c1 to d0/d4/c9 0 2023-12-05T09:57:11.828 INFO:tasks.workunit.client.0.smithi100.stdout:5/33: creat d0/d4/fa x:0 0 0 2023-12-05T09:57:11.829 INFO:tasks.workunit.client.0.smithi100.stdout:5/34: unlink d0/d4/d5/c6 0 2023-12-05T09:57:11.831 INFO:tasks.workunit.client.0.smithi100.stdout:5/35: read d0/f7 [746556,4105] 0 2023-12-05T09:57:11.831 INFO:tasks.workunit.client.0.smithi100.stdout:5/36: readlink - no filename 2023-12-05T09:57:11.831 INFO:tasks.workunit.client.0.smithi100.stdout:5/37: write d0/f7 [1270305,98419] 0 2023-12-05T09:57:11.831 INFO:tasks.workunit.client.0.smithi100.stdout:5/38: fdatasync d0/f3 0 2023-12-05T09:57:11.838 INFO:tasks.workunit.client.0.smithi100.stdout:3/99: dwrite d0/d2/fd [0,4194304] 0 2023-12-05T09:57:11.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:11 smithi150 ceph-mon[116142]: Reconfiguring alertmanager.smithi100 (dependencies changed)... 2023-12-05T09:57:11.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:11 smithi150 ceph-mon[116142]: Reconfiguring daemon alertmanager.smithi100 on smithi100 2023-12-05T09:57:11.850 INFO:tasks.workunit.client.0.smithi100.stdout:5/39: getdents d0 0 2023-12-05T09:57:11.850 INFO:tasks.workunit.client.0.smithi100.stdout:2/70: write d7/da/dc/ff [3482463,121099] 0 2023-12-05T09:57:11.850 INFO:tasks.workunit.client.0.smithi100.stdout:0/80: dread da/f11 [0,4194304] 0 2023-12-05T09:57:11.851 INFO:tasks.workunit.client.0.smithi100.stdout:2/71: rename d7/c10 to d7/c16 0 2023-12-05T09:57:11.851 INFO:tasks.workunit.client.0.smithi100.stdout:5/40: getdents d0/d4/d5 0 2023-12-05T09:57:11.854 INFO:tasks.workunit.client.0.smithi100.stdout:2/72: creat d7/da/f17 x:0 0 0 2023-12-05T09:57:11.864 INFO:tasks.workunit.client.0.smithi100.stdout:9/88: dwrite d7/d10/f11 [0,4194304] 0 2023-12-05T09:57:11.865 INFO:tasks.workunit.client.0.smithi100.stdout:2/73: getdents d7 0 2023-12-05T09:57:11.869 INFO:tasks.workunit.client.0.smithi100.stdout:9/89: mkdir d7/d1b/d22 0 2023-12-05T09:57:11.869 INFO:tasks.workunit.client.0.smithi100.stdout:9/90: creat d7/d10/f23 x:0 0 0 2023-12-05T09:57:11.869 INFO:tasks.workunit.client.0.smithi100.stdout:9/91: readlink d7/l15 0 2023-12-05T09:57:11.869 INFO:tasks.workunit.client.0.smithi100.stdout:9/92: write d7/fc [62734,108547] 0 2023-12-05T09:57:11.869 INFO:tasks.workunit.client.0.smithi100.stdout:9/93: readlink l2 0 2023-12-05T09:57:11.870 INFO:tasks.workunit.client.0.smithi100.stdout:9/94: fdatasync d7/d10/f11 0 2023-12-05T09:57:11.870 INFO:tasks.workunit.client.0.smithi100.stdout:2/74: mkdir d7/da/d18 0 2023-12-05T09:57:11.870 INFO:tasks.workunit.client.0.smithi100.stdout:0/81: write da/fb [2288348,13971] 0 2023-12-05T09:57:11.870 INFO:tasks.workunit.client.0.smithi100.stdout:2/75: mkdir d7/da/dc/d19 0 2023-12-05T09:57:11.871 INFO:tasks.workunit.client.0.smithi100.stdout:9/95: rename d7/l15 to d7/d1b/d22/l24 0 2023-12-05T09:57:11.874 INFO:tasks.workunit.client.0.smithi100.stdout:2/76: mkdir d7/da/d1a 0 2023-12-05T09:57:11.875 INFO:tasks.workunit.client.0.smithi100.stdout:2/77: truncate d7/da/dc/f12 4241981 0 2023-12-05T09:57:11.875 INFO:tasks.workunit.client.0.smithi100.stdout:2/78: write d7/da/f17 [457600,83138] 0 2023-12-05T09:57:11.875 INFO:tasks.workunit.client.0.smithi100.stdout:2/79: mkdir d7/da/d18/d1b 0 2023-12-05T09:57:11.875 INFO:tasks.workunit.client.0.smithi100.stdout:2/80: chown d7/da/dc/ff 40717215 1 2023-12-05T09:57:11.875 INFO:tasks.workunit.client.0.smithi100.stdout:1/39: dwrite f1 [0,4194304] 0 2023-12-05T09:57:11.875 INFO:tasks.workunit.client.0.smithi100.stdout:1/40: read - db/fd zero size 2023-12-05T09:57:11.875 INFO:tasks.workunit.client.0.smithi100.stdout:1/41: creat db/f10 x:0 0 0 2023-12-05T09:57:11.875 INFO:tasks.workunit.client.0.smithi100.stdout:1/42: truncate db/ff 482307 0 2023-12-05T09:57:11.878 INFO:tasks.workunit.client.0.smithi100.stdout:1/43: write db/ff [19554,82458] 0 2023-12-05T09:57:11.878 INFO:tasks.workunit.client.0.smithi100.stdout:1/44: readlink la 0 2023-12-05T09:57:11.880 INFO:tasks.workunit.client.0.smithi100.stdout:1/45: mknod db/c11 0 2023-12-05T09:57:11.881 INFO:tasks.workunit.client.0.smithi100.stdout:1/46: mkdir db/d12 0 2023-12-05T09:57:11.883 INFO:tasks.workunit.client.0.smithi100.stdout:9/96: dread d7/fd [0,4194304] 0 2023-12-05T09:57:11.885 INFO:tasks.workunit.client.0.smithi100.stdout:9/97: mkdir d7/d1b/d22/d25 0 2023-12-05T09:57:11.886 INFO:tasks.workunit.client.0.smithi100.stdout:9/98: write d7/d10/f14 [2522166,18823] 0 2023-12-05T09:57:11.886 INFO:tasks.workunit.client.0.smithi100.stdout:9/99: stat d7/d10/f11 0 2023-12-05T09:57:11.894 INFO:tasks.workunit.client.0.smithi100.stdout:9/100: getdents d7/d1b 0 2023-12-05T09:57:11.895 INFO:tasks.workunit.client.0.smithi100.stdout:9/101: chown d7/d1b/l1c 54968548 1 2023-12-05T09:57:11.895 INFO:tasks.workunit.client.0.smithi100.stdout:9/102: readlink l4 0 2023-12-05T09:57:11.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:11 smithi100 ceph-mon[107145]: Reconfiguring alertmanager.smithi100 (dependencies changed)... 2023-12-05T09:57:11.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:11 smithi100 ceph-mon[107145]: Reconfiguring daemon alertmanager.smithi100 on smithi100 2023-12-05T09:57:11.897 INFO:tasks.workunit.client.0.smithi100.stdout:9/103: mknod d7/d1b/d22/d25/c26 0 2023-12-05T09:57:11.899 INFO:tasks.workunit.client.0.smithi100.stdout:5/41: dwrite d0/f7 [0,4194304] 0 2023-12-05T09:57:11.899 INFO:tasks.workunit.client.0.smithi100.stdout:5/42: chown d0/d4/c9 1199 1 2023-12-05T09:57:11.918 INFO:tasks.workunit.client.0.smithi100.stdout:9/104: fsync d7/fc 0 2023-12-05T09:57:11.918 INFO:tasks.workunit.client.0.smithi100.stdout:9/105: write d7/d10/f23 [487833,22032] 0 2023-12-05T09:57:11.918 INFO:tasks.workunit.client.0.smithi100.stdout:9/106: fsync d7/f1d 0 2023-12-05T09:57:11.919 INFO:tasks.workunit.client.0.smithi100.stdout:9/107: rename d7/d10/l16 to d7/d1b/d22/d25/l27 0 2023-12-05T09:57:11.927 INFO:tasks.workunit.client.0.smithi100.stdout:9/108: dread d7/fc [0,4194304] 0 2023-12-05T09:57:11.927 INFO:tasks.workunit.client.0.smithi100.stdout:9/109: write d7/d1b/f1e [2664135,36734] 0 2023-12-05T09:57:11.927 INFO:tasks.workunit.client.0.smithi100.stdout:0/82: dwrite da/f11 [4194304,4194304] 0 2023-12-05T09:57:11.928 INFO:tasks.workunit.client.0.smithi100.stdout:9/110: rename f1 to d7/d10/f28 0 2023-12-05T09:57:11.931 INFO:tasks.workunit.client.0.smithi100.stdout:9/111: creat d7/f29 x:0 0 0 2023-12-05T09:57:11.932 INFO:tasks.workunit.client.0.smithi100.stdout:9/112: mkdir d7/d1b/d22/d2a 0 2023-12-05T09:57:11.933 INFO:tasks.workunit.client.0.smithi100.stdout:9/113: write d7/d10/f28 [2769370,116120] 0 2023-12-05T09:57:11.948 INFO:tasks.workunit.client.0.smithi100.stdout:0/83: dread f1 [0,4194304] 0 2023-12-05T09:57:11.949 INFO:tasks.workunit.client.0.smithi100.stdout:0/84: symlink da/d1b/l1c 0 2023-12-05T09:57:11.953 INFO:tasks.workunit.client.0.smithi100.stdout:2/81: dwrite d7/da/dc/ff [0,4194304] 0 2023-12-05T09:57:11.988 INFO:tasks.workunit.client.0.smithi100.stdout:0/85: write da/f11 [5962685,84803] 0 2023-12-05T09:57:11.994 INFO:tasks.workunit.client.0.smithi100.stdout:9/114: dwrite d7/d10/f23 [0,4194304] 0 2023-12-05T09:57:12.000 INFO:tasks.workunit.client.0.smithi100.stdout:2/82: dwrite d7/da/dc/ff [0,4194304] 0 2023-12-05T09:57:12.001 INFO:tasks.workunit.client.0.smithi100.stdout:2/83: write f5 [712134,63469] 0 2023-12-05T09:57:12.003 INFO:tasks.workunit.client.0.smithi100.stdout:2/84: creat d7/da/d1a/f1c x:0 0 0 2023-12-05T09:57:12.004 INFO:tasks.workunit.client.0.smithi100.stdout:2/85: rename d7/da/le to d7/da/d13/l1d 0 2023-12-05T09:57:12.009 INFO:tasks.workunit.client.0.smithi100.stdout:2/86: mknod d7/da/d18/c1e 0 2023-12-05T09:57:12.051 INFO:tasks.workunit.client.0.smithi100.stdout:9/115: dwrite d7/d10/f23 [0,4194304] 0 2023-12-05T09:57:12.051 INFO:tasks.workunit.client.0.smithi100.stdout:9/116: stat d7/d10 0 2023-12-05T09:57:12.052 INFO:tasks.workunit.client.0.smithi100.stdout:9/117: write d7/d1b/f1e [2062616,124597] 0 2023-12-05T09:57:12.053 INFO:tasks.workunit.client.0.smithi100.stdout:9/118: symlink d7/d1b/d22/d2a/l2b 0 2023-12-05T09:57:12.055 INFO:tasks.workunit.client.0.smithi100.stdout:9/119: link d7/d10/f11 d7/d20/f2c 0 2023-12-05T09:57:12.056 INFO:tasks.workunit.client.0.smithi100.stdout:9/120: unlink d7/d10/f1f 0 2023-12-05T09:57:12.057 INFO:tasks.workunit.client.0.smithi100.stdout:9/121: fdatasync d7/f29 0 2023-12-05T09:57:12.057 INFO:tasks.workunit.client.0.smithi100.stdout:9/122: fsync d7/d10/f14 0 2023-12-05T09:57:12.063 INFO:tasks.workunit.client.0.smithi100.stdout:2/87: dwrite f5 [0,4194304] 0 2023-12-05T09:57:12.064 INFO:tasks.workunit.client.0.smithi100.stdout:2/88: symlink d7/da/d18/d1b/l1f 0 2023-12-05T09:57:12.065 INFO:tasks.workunit.client.0.smithi100.stdout:2/89: mknod d7/da/d18/c20 0 2023-12-05T09:57:12.066 INFO:tasks.workunit.client.0.smithi100.stdout:2/90: mkdir d7/da/d18/d21 0 2023-12-05T09:57:12.066 INFO:tasks.workunit.client.0.smithi100.stdout:2/91: truncate d7/da/f17 1362324 0 2023-12-05T09:57:12.066 INFO:tasks.workunit.client.0.smithi100.stdout:2/92: write d7/da/f17 [2213500,37303] 0 2023-12-05T09:57:12.067 INFO:tasks.workunit.client.1.smithi150.stderr:++ readlink -f fsstress 2023-12-05T09:57:12.067 INFO:tasks.workunit.client.0.smithi100.stdout:2/93: rename d7/da/c11 to d7/da/dc/d19/c22 0 2023-12-05T09:57:12.069 INFO:tasks.workunit.client.0.smithi100.stdout:2/94: link d7/da/d18/c20 d7/da/d1a/c23 0 2023-12-05T09:57:12.069 INFO:tasks.workunit.client.1.smithi150.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2023-12-05T09:57:12.069 INFO:tasks.workunit.client.1.smithi150.stderr:+ popd 2023-12-05T09:57:12.070 INFO:tasks.workunit.client.1.smithi150.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2023-12-05T09:57:12.070 INFO:tasks.workunit.client.1.smithi150.stderr:+ popd 2023-12-05T09:57:12.070 INFO:tasks.workunit.client.1.smithi150.stdout:~/cephtest/mnt.1/client.1/tmp 2023-12-05T09:57:12.071 INFO:tasks.workunit.client.1.smithi150.stderr:++ mktemp -d -p . 2023-12-05T09:57:12.072 INFO:tasks.workunit.client.1.smithi150.stderr:+ T=./tmp.ElShauuFLf 2023-12-05T09:57:12.072 INFO:tasks.workunit.client.1.smithi150.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.ElShauuFLf -l 1 -n 1000 -p 10 -v 2023-12-05T09:57:12.074 INFO:tasks.workunit.client.1.smithi150.stdout:seed = 1701822984 2023-12-05T09:57:12.078 INFO:tasks.workunit.client.1.smithi150.stdout:1/0: getdents . 0 2023-12-05T09:57:12.078 INFO:tasks.workunit.client.1.smithi150.stdout:1/1: write - no filename 2023-12-05T09:57:12.078 INFO:tasks.workunit.client.1.smithi150.stdout:1/2: dwrite - no filename 2023-12-05T09:57:12.078 INFO:tasks.workunit.client.1.smithi150.stdout:1/3: fsync - no filename 2023-12-05T09:57:12.079 INFO:tasks.workunit.client.1.smithi150.stdout:1/4: write - no filename 2023-12-05T09:57:12.079 INFO:tasks.workunit.client.1.smithi150.stdout:1/5: truncate - no filename 2023-12-05T09:57:12.079 INFO:tasks.workunit.client.1.smithi150.stdout:1/6: dwrite - no filename 2023-12-05T09:57:12.079 INFO:tasks.workunit.client.1.smithi150.stdout:1/7: dread - no filename 2023-12-05T09:57:12.080 INFO:tasks.workunit.client.1.smithi150.stdout:1/8: truncate - no filename 2023-12-05T09:57:12.081 INFO:tasks.workunit.client.1.smithi150.stdout:1/9: link - no file 2023-12-05T09:57:12.081 INFO:tasks.workunit.client.1.smithi150.stdout:1/10: dread - no filename 2023-12-05T09:57:12.081 INFO:tasks.workunit.client.1.smithi150.stdout:0/0: symlink l0 0 2023-12-05T09:57:12.081 INFO:tasks.workunit.client.1.smithi150.stdout:1/11: mknod c0 0 2023-12-05T09:57:12.081 INFO:tasks.workunit.client.1.smithi150.stdout:1/12: readlink - no filename 2023-12-05T09:57:12.081 INFO:tasks.workunit.client.1.smithi150.stdout:1/13: dwrite - no filename 2023-12-05T09:57:12.082 INFO:tasks.workunit.client.1.smithi150.stdout:1/14: write - no filename 2023-12-05T09:57:12.082 INFO:tasks.workunit.client.1.smithi150.stdout:1/15: write - no filename 2023-12-05T09:57:12.082 INFO:tasks.workunit.client.1.smithi150.stdout:0/1: link l0 l1 0 2023-12-05T09:57:12.083 INFO:tasks.workunit.client.1.smithi150.stdout:3/0: dwrite - no filename 2023-12-05T09:57:12.083 INFO:tasks.workunit.client.1.smithi150.stdout:3/1: dread - no filename 2023-12-05T09:57:12.083 INFO:tasks.workunit.client.1.smithi150.stdout:3/2: dwrite - no filename 2023-12-05T09:57:12.083 INFO:tasks.workunit.client.1.smithi150.stdout:3/3: getdents . 0 2023-12-05T09:57:12.083 INFO:tasks.workunit.client.1.smithi150.stdout:3/4: dwrite - no filename 2023-12-05T09:57:12.085 INFO:tasks.workunit.client.1.smithi150.stdout:2/0: mkdir d0 0 2023-12-05T09:57:12.085 INFO:tasks.workunit.client.1.smithi150.stdout:2/1: chown d0 14 1 2023-12-05T09:57:12.085 INFO:tasks.workunit.client.1.smithi150.stdout:2/2: stat d0 0 2023-12-05T09:57:12.085 INFO:tasks.workunit.client.1.smithi150.stdout:1/16: creat f1 x:0 0 0 2023-12-05T09:57:12.085 INFO:tasks.workunit.client.1.smithi150.stdout:1/17: creat f2 x:0 0 0 2023-12-05T09:57:12.086 INFO:tasks.workunit.client.1.smithi150.stdout:1/18: write f2 [449537,80916] 0 2023-12-05T09:57:12.087 INFO:tasks.workunit.client.1.smithi150.stdout:0/2: rename l0 to l2 0 2023-12-05T09:57:12.088 INFO:tasks.workunit.client.1.smithi150.stdout:4/0: dwrite - no filename 2023-12-05T09:57:12.088 INFO:tasks.workunit.client.1.smithi150.stdout:4/1: dread - no filename 2023-12-05T09:57:12.088 INFO:tasks.workunit.client.1.smithi150.stdout:4/2: chown . 1934836 1 2023-12-05T09:57:12.088 INFO:tasks.workunit.client.1.smithi150.stdout:4/3: stat - no entries 2023-12-05T09:57:12.088 INFO:tasks.workunit.client.1.smithi150.stdout:4/4: dread - no filename 2023-12-05T09:57:12.088 INFO:tasks.workunit.client.1.smithi150.stdout:4/5: link - no file 2023-12-05T09:57:12.088 INFO:tasks.workunit.client.1.smithi150.stdout:4/6: rmdir - no directory 2023-12-05T09:57:12.088 INFO:tasks.workunit.client.1.smithi150.stdout:3/5: mkdir d0 0 2023-12-05T09:57:12.089 INFO:tasks.workunit.client.1.smithi150.stdout:2/3: mkdir d0/d1 0 2023-12-05T09:57:12.092 INFO:tasks.workunit.client.0.smithi100.stdout:9/123: dwrite d7/d10/f11 [0,4194304] 0 2023-12-05T09:57:12.097 INFO:tasks.workunit.client.0.smithi100.stdout:9/124: creat d7/d10/f2d x:0 0 0 2023-12-05T09:57:12.097 INFO:tasks.workunit.client.1.smithi150.stdout:3/6: rmdir d0 0 2023-12-05T09:57:12.097 INFO:tasks.workunit.client.1.smithi150.stdout:3/7: chown . 4006 1 2023-12-05T09:57:12.097 INFO:tasks.workunit.client.1.smithi150.stdout:3/8: rename - no filename 2023-12-05T09:57:12.097 INFO:tasks.workunit.client.1.smithi150.stdout:3/9: truncate - no filename 2023-12-05T09:57:12.097 INFO:tasks.workunit.client.1.smithi150.stdout:5/0: fsync - no filename 2023-12-05T09:57:12.098 INFO:tasks.workunit.client.1.smithi150.stdout:5/1: unlink - no file 2023-12-05T09:57:12.098 INFO:tasks.workunit.client.1.smithi150.stdout:5/2: write - no filename 2023-12-05T09:57:12.098 INFO:tasks.workunit.client.1.smithi150.stdout:4/7: mkdir d0 0 2023-12-05T09:57:12.099 INFO:tasks.workunit.client.1.smithi150.stdout:4/8: creat d0/f1 x:0 0 0 2023-12-05T09:57:12.100 INFO:tasks.workunit.client.1.smithi150.stdout:1/19: rename f2 to f3 0 2023-12-05T09:57:12.100 INFO:tasks.workunit.client.1.smithi150.stdout:1/20: truncate f1 570905 0 2023-12-05T09:57:12.100 INFO:tasks.workunit.client.1.smithi150.stdout:5/3: symlink l0 0 2023-12-05T09:57:12.103 INFO:tasks.workunit.client.1.smithi150.stdout:6/0: dread - no filename 2023-12-05T09:57:12.103 INFO:tasks.workunit.client.1.smithi150.stdout:6/1: dread - no filename 2023-12-05T09:57:12.103 INFO:tasks.workunit.client.1.smithi150.stdout:6/2: readlink - no filename 2023-12-05T09:57:12.105 INFO:tasks.workunit.client.0.smithi100.stdout:9/125: dread d7/fc [0,4194304] 0 2023-12-05T09:57:12.105 INFO:tasks.workunit.client.1.smithi150.stdout:4/9: mknod d0/c2 0 2023-12-05T09:57:12.106 INFO:tasks.workunit.client.1.smithi150.stdout:5/4: mkdir d1 0 2023-12-05T09:57:12.108 INFO:tasks.workunit.client.1.smithi150.stdout:6/3: creat f0 x:0 0 0 2023-12-05T09:57:12.109 INFO:tasks.workunit.client.1.smithi150.stdout:6/4: stat f0 0 2023-12-05T09:57:12.114 INFO:tasks.workunit.client.0.smithi100.stdout:9/126: mkdir d7/d1b/d22/d25/d2e 0 2023-12-05T09:57:12.117 INFO:tasks.workunit.client.1.smithi150.stdout:5/5: mknod d1/c2 0 2023-12-05T09:57:12.117 INFO:tasks.workunit.client.1.smithi150.stdout:7/0: chown . 22 1 2023-12-05T09:57:12.126 INFO:tasks.workunit.client.0.smithi100.stdout:9/127: symlink d7/l2f 0 2023-12-05T09:57:12.126 INFO:tasks.workunit.client.0.smithi100.stdout:9/128: fdatasync d7/fb 0 2023-12-05T09:57:12.126 INFO:tasks.workunit.client.0.smithi100.stdout:9/129: chown d7/f1d 13 1 2023-12-05T09:57:12.126 INFO:tasks.workunit.client.0.smithi100.stdout:9/130: write d7/f29 [30181,18783] 0 2023-12-05T09:57:12.126 INFO:tasks.workunit.client.0.smithi100.stdout:9/131: fsync d7/d10/f14 0 2023-12-05T09:57:12.127 INFO:tasks.workunit.client.1.smithi150.stdout:5/6: mkdir d1/d3 0 2023-12-05T09:57:12.130 INFO:tasks.workunit.client.1.smithi150.stdout:8/0: dwrite - no filename 2023-12-05T09:57:12.133 INFO:tasks.workunit.client.0.smithi100.stdout:9/132: creat d7/d1b/f30 x:0 0 0 2023-12-05T09:57:12.134 INFO:tasks.workunit.client.0.smithi100.stdout:9/133: dread - d7/d1b/f30 zero size 2023-12-05T09:57:12.136 INFO:tasks.workunit.client.1.smithi150.stdout:7/1: creat f0 x:0 0 0 2023-12-05T09:57:12.136 INFO:tasks.workunit.client.1.smithi150.stdout:7/2: creat f1 x:0 0 0 2023-12-05T09:57:12.139 INFO:tasks.workunit.client.0.smithi100.stdout:9/134: creat d7/d1b/d22/f31 x:0 0 0 2023-12-05T09:57:12.141 INFO:tasks.workunit.client.1.smithi150.stdout:5/7: symlink d1/d3/l4 0 2023-12-05T09:57:12.152 INFO:tasks.workunit.client.1.smithi150.stdout:0/3: rename l2 to l3 0 2023-12-05T09:57:12.152 INFO:tasks.workunit.client.1.smithi150.stdout:0/4: truncate - no filename 2023-12-05T09:57:12.152 INFO:tasks.workunit.client.1.smithi150.stdout:0/5: chown l3 17 1 2023-12-05T09:57:12.152 INFO:tasks.workunit.client.1.smithi150.stdout:9/0: rmdir - no directory 2023-12-05T09:57:12.152 INFO:tasks.workunit.client.1.smithi150.stdout:9/1: dwrite - no filename 2023-12-05T09:57:12.152 INFO:tasks.workunit.client.1.smithi150.stdout:9/2: rmdir - no directory 2023-12-05T09:57:12.153 INFO:tasks.workunit.client.1.smithi150.stdout:9/3: write - no filename 2023-12-05T09:57:12.153 INFO:tasks.workunit.client.1.smithi150.stdout:9/4: dwrite - no filename 2023-12-05T09:57:12.153 INFO:tasks.workunit.client.1.smithi150.stdout:9/5: dwrite - no filename 2023-12-05T09:57:12.153 INFO:tasks.workunit.client.1.smithi150.stdout:9/6: dwrite - no filename 2023-12-05T09:57:12.153 INFO:tasks.workunit.client.1.smithi150.stdout:9/7: write - no filename 2023-12-05T09:57:12.153 INFO:tasks.workunit.client.1.smithi150.stdout:9/8: fdatasync - no filename 2023-12-05T09:57:12.153 INFO:tasks.workunit.client.1.smithi150.stdout:9/9: dwrite - no filename 2023-12-05T09:57:12.153 INFO:tasks.workunit.client.1.smithi150.stdout:9/10: rmdir - no directory 2023-12-05T09:57:12.153 INFO:tasks.workunit.client.1.smithi150.stdout:9/11: chown . 71188056 1 2023-12-05T09:57:12.154 INFO:tasks.workunit.client.1.smithi150.stdout:8/1: mkdir d0 0 2023-12-05T09:57:12.154 INFO:tasks.workunit.client.1.smithi150.stdout:8/2: dwrite - no filename 2023-12-05T09:57:12.155 INFO:tasks.workunit.client.1.smithi150.stdout:8/3: rename d0 to d0/d1 22 2023-12-05T09:57:12.155 INFO:tasks.workunit.client.1.smithi150.stdout:8/4: dwrite - no filename 2023-12-05T09:57:12.158 INFO:tasks.workunit.client.1.smithi150.stdout:7/3: mkdir d2 0 2023-12-05T09:57:12.159 INFO:tasks.workunit.client.1.smithi150.stdout:7/4: fdatasync f0 0 2023-12-05T09:57:12.159 INFO:tasks.workunit.client.1.smithi150.stdout:7/5: write f1 [996962,46884] 0 2023-12-05T09:57:12.164 INFO:tasks.workunit.client.1.smithi150.stdout:5/8: symlink d1/l5 0 2023-12-05T09:57:12.164 INFO:tasks.workunit.client.1.smithi150.stdout:5/9: fdatasync - no filename 2023-12-05T09:57:12.169 INFO:tasks.workunit.client.1.smithi150.stdout:0/6: mkdir d4 0 2023-12-05T09:57:12.170 INFO:tasks.workunit.client.1.smithi150.stdout:9/12: creat f0 x:0 0 0 2023-12-05T09:57:12.170 INFO:tasks.workunit.client.1.smithi150.stdout:9/13: truncate f0 638305 0 2023-12-05T09:57:12.170 INFO:tasks.workunit.client.1.smithi150.stdout:9/14: readlink - no filename 2023-12-05T09:57:12.170 INFO:tasks.workunit.client.1.smithi150.stdout:9/15: truncate f0 725074 0 2023-12-05T09:57:12.170 INFO:tasks.workunit.client.1.smithi150.stdout:9/16: stat f0 0 2023-12-05T09:57:12.170 INFO:tasks.workunit.client.1.smithi150.stdout:8/5: mkdir d0/d2 0 2023-12-05T09:57:12.183 INFO:tasks.workunit.client.1.smithi150.stdout:7/6: rename f0 to d2/f3 0 2023-12-05T09:57:12.183 INFO:tasks.workunit.client.1.smithi150.stdout:5/10: mkdir d1/d3/d6 0 2023-12-05T09:57:12.183 INFO:tasks.workunit.client.1.smithi150.stdout:0/7: rmdir d4 0 2023-12-05T09:57:12.183 INFO:tasks.workunit.client.1.smithi150.stdout:0/8: chown l3 1 1 2023-12-05T09:57:12.183 INFO:tasks.workunit.client.1.smithi150.stdout:0/9: dwrite - no filename 2023-12-05T09:57:12.183 INFO:tasks.workunit.client.1.smithi150.stdout:8/6: symlink d0/l3 0 2023-12-05T09:57:12.183 INFO:tasks.workunit.client.1.smithi150.stdout:8/7: write - no filename 2023-12-05T09:57:12.184 INFO:tasks.workunit.client.1.smithi150.stdout:8/8: read - no filename 2023-12-05T09:57:12.184 INFO:tasks.workunit.client.1.smithi150.stdout:8/9: truncate - no filename 2023-12-05T09:57:12.184 INFO:tasks.workunit.client.1.smithi150.stdout:8/10: fsync - no filename 2023-12-05T09:57:12.184 INFO:tasks.workunit.client.1.smithi150.stdout:8/11: write - no filename 2023-12-05T09:57:12.184 INFO:tasks.workunit.client.1.smithi150.stdout:8/12: readlink d0/l3 0 2023-12-05T09:57:12.184 INFO:tasks.workunit.client.1.smithi150.stdout:8/13: dwrite - no filename 2023-12-05T09:57:12.184 INFO:tasks.workunit.client.1.smithi150.stdout:8/14: truncate - no filename 2023-12-05T09:57:12.185 INFO:tasks.workunit.client.1.smithi150.stdout:8/15: readlink d0/l3 0 2023-12-05T09:57:12.185 INFO:tasks.workunit.client.1.smithi150.stdout:8/16: stat d0/d2 0 2023-12-05T09:57:12.185 INFO:tasks.workunit.client.1.smithi150.stdout:8/17: fsync - no filename 2023-12-05T09:57:12.186 INFO:tasks.workunit.client.1.smithi150.stdout:8/18: dread - no filename 2023-12-05T09:57:12.186 INFO:tasks.workunit.client.1.smithi150.stdout:8/19: dwrite - no filename 2023-12-05T09:57:12.202 INFO:tasks.workunit.client.1.smithi150.stdout:5/11: creat d1/d3/f7 x:0 0 0 2023-12-05T09:57:12.202 INFO:tasks.workunit.client.1.smithi150.stdout:0/10: mkdir d5 0 2023-12-05T09:57:12.202 INFO:tasks.workunit.client.1.smithi150.stdout:5/12: dread - d1/d3/f7 zero size 2023-12-05T09:57:12.202 INFO:tasks.workunit.client.1.smithi150.stdout:8/20: symlink d0/l4 0 2023-12-05T09:57:12.215 INFO:tasks.workunit.client.0.smithi100.stdout:2/95: dwrite d7/da/dc/f12 [0,4194304] 0 2023-12-05T09:57:12.221 INFO:tasks.workunit.client.1.smithi150.stdout:0/11: mknod d5/c6 0 2023-12-05T09:57:12.221 INFO:tasks.workunit.client.1.smithi150.stdout:0/12: write - no filename 2023-12-05T09:57:12.348 INFO:tasks.workunit.client.0.smithi100.stdout:2/96: dread d7/da/f17 [0,4194304] 0 2023-12-05T09:57:12.348 INFO:tasks.workunit.client.0.smithi100.stdout:2/97: readlink d7/l15 0 2023-12-05T09:57:12.558 INFO:tasks.workunit.client.0.smithi100.stdout:9/135: dwrite d7/d1b/f1e [0,4194304] 0 2023-12-05T09:57:12.561 INFO:tasks.workunit.client.0.smithi100.stdout:9/136: chown d7/ff 223 1 2023-12-05T09:57:12.561 INFO:tasks.workunit.client.0.smithi100.stdout:9/137: chown d7/d10/f2d 223895 1 2023-12-05T09:57:12.564 INFO:tasks.workunit.client.0.smithi100.stdout:9/138: unlink d7/d1b/d22/d25/l27 0 2023-12-05T09:57:12.567 INFO:tasks.workunit.client.0.smithi100.stdout:9/139: mkdir d7/d10/d32 0 2023-12-05T09:57:12.609 INFO:tasks.workunit.client.1.smithi150.stdout:9/17: dread f0 [0,4194304] 0 2023-12-05T09:57:12.609 INFO:tasks.workunit.client.1.smithi150.stdout:9/18: chown f0 79 1 2023-12-05T09:57:12.717 INFO:tasks.workunit.client.0.smithi100.stdout:2/98: dwrite d7/da/dc/ff [4194304,4194304] 0 2023-12-05T09:57:12.762 INFO:tasks.workunit.client.0.smithi100.stdout:2/99: dread d7/da/dc/f12 [0,4194304] 0 2023-12-05T09:57:12.766 INFO:tasks.workunit.client.0.smithi100.stdout:2/100: unlink f5 0 2023-12-05T09:57:12.771 INFO:tasks.workunit.client.0.smithi100.stdout:2/101: symlink d7/da/d18/d1b/l24 0 2023-12-05T09:57:12.772 INFO:tasks.workunit.client.0.smithi100.stdout:2/102: readlink d7/l15 0 2023-12-05T09:57:12.772 INFO:tasks.workunit.client.0.smithi100.stdout:2/103: creat d7/da/f25 x:0 0 0 2023-12-05T09:57:12.780 INFO:tasks.workunit.client.0.smithi100.stdout:2/104: creat d7/da/dc/d19/f26 x:0 0 0 2023-12-05T09:57:12.790 INFO:tasks.workunit.client.0.smithi100.stdout:9/140: dwrite d7/ff [0,4194304] 0 2023-12-05T09:57:12.791 INFO:tasks.workunit.client.0.smithi100.stdout:9/141: truncate d7/f8 645796 0 2023-12-05T09:57:12.791 INFO:tasks.workunit.client.0.smithi100.stdout:9/142: stat c3 0 2023-12-05T09:57:12.791 INFO:tasks.workunit.client.0.smithi100.stdout:9/143: write d7/f1d [4264563,93990] 0 2023-12-05T09:57:12.791 INFO:tasks.workunit.client.0.smithi100.stdout:9/144: write d7/fc [853848,124334] 0 2023-12-05T09:57:12.791 INFO:tasks.workunit.client.0.smithi100.stdout:9/145: creat d7/d1b/f33 x:0 0 0 2023-12-05T09:57:12.800 INFO:tasks.workunit.client.0.smithi100.stdout:9/146: symlink d7/d1b/d22/d25/l34 0 2023-12-05T09:57:12.805 INFO:tasks.workunit.client.0.smithi100.stdout:9/147: unlink d7/d1b/l1c 0 2023-12-05T09:57:12.805 INFO:tasks.workunit.client.0.smithi100.stdout:9/148: write d7/d1b/f1e [5008083,61568] 0 2023-12-05T09:57:12.811 INFO:tasks.workunit.client.0.smithi100.stdout:2/105: dread d7/da/f17 [0,4194304] 0 2023-12-05T09:57:12.812 INFO:tasks.workunit.client.0.smithi100.stdout:9/149: mkdir d7/d35 0 2023-12-05T09:57:12.816 INFO:tasks.workunit.client.0.smithi100.stdout:2/106: link c6 d7/da/dc/d19/c27 0 2023-12-05T09:57:12.821 INFO:tasks.workunit.client.0.smithi100.stdout:2/107: creat d7/da/d18/d1b/f28 x:0 0 0 2023-12-05T09:57:12.829 INFO:tasks.workunit.client.0.smithi100.stdout:2/108: mknod d7/da/d18/d1b/c29 0 2023-12-05T09:57:12.833 INFO:tasks.workunit.client.0.smithi100.stdout:2/109: creat d7/da/dc/d19/f2a x:0 0 0 2023-12-05T09:57:12.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:12 smithi150 ceph-mon[116142]: pgmap v22: 65 pgs: 65 active+clean; 328 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 17 MiB/s rd, 25 MiB/s wr, 392 op/s 2023-12-05T09:57:12.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:12 smithi100 ceph-mon[107145]: pgmap v22: 65 pgs: 65 active+clean; 328 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 17 MiB/s rd, 25 MiB/s wr, 392 op/s 2023-12-05T09:57:13.181 INFO:tasks.workunit.client.0.smithi100.stdout:2/110: dwrite d7/da/d18/d1b/f28 [0,4194304] 0 2023-12-05T09:57:13.181 INFO:tasks.workunit.client.0.smithi100.stdout:2/111: read - d7/da/d1a/f1c zero size 2023-12-05T09:57:13.352 INFO:tasks.workunit.client.1.smithi150.stdout:1/21: dread f3 [0,4194304] 0 2023-12-05T09:57:13.358 INFO:tasks.workunit.client.0.smithi100.stdout:2/112: dwrite d7/da/d1a/f1c [0,4194304] 0 2023-12-05T09:57:13.359 INFO:tasks.workunit.client.0.smithi100.stdout:2/113: chown d7/da/dc/ff 1171499037 1 2023-12-05T09:57:13.392 INFO:tasks.workunit.client.0.smithi100.stdout:2/114: read d7/da/dc/ff [4691304,50537] 0 2023-12-05T09:57:13.392 INFO:tasks.workunit.client.0.smithi100.stdout:2/115: truncate d7/da/dc/d19/f2a 279442 0 2023-12-05T09:57:13.397 INFO:tasks.workunit.client.0.smithi100.stdout:2/116: mkdir d7/da/d2b 0 2023-12-05T09:57:13.397 INFO:tasks.workunit.client.0.smithi100.stdout:2/117: readlink d7/l15 0 2023-12-05T09:57:13.420 INFO:tasks.workunit.client.0.smithi100.stdout:2/118: write d7/da/dc/f12 [2611319,99499] 0 2023-12-05T09:57:13.427 INFO:tasks.workunit.client.0.smithi100.stdout:2/119: mkdir d7/da/d18/d1b/d2c 0 2023-12-05T09:57:13.431 INFO:tasks.workunit.client.0.smithi100.stdout:2/120: mknod d7/da/d18/d1b/d2c/c2d 0 2023-12-05T09:57:13.431 INFO:tasks.workunit.client.0.smithi100.stdout:2/121: chown d7/da/d18/c1e 245609 1 2023-12-05T09:57:13.491 INFO:tasks.workunit.client.1.smithi150.stdout:6/5: getdents . 0 2023-12-05T09:57:13.491 INFO:tasks.workunit.client.1.smithi150.stdout:6/6: read - f0 zero size 2023-12-05T09:57:13.528 INFO:tasks.workunit.client.1.smithi150.stdout:7/7: unlink d2/f3 0 2023-12-05T09:57:13.528 INFO:tasks.workunit.client.1.smithi150.stdout:7/8: write f1 [1356071,70424] 0 2023-12-05T09:57:13.549 INFO:tasks.workunit.client.1.smithi150.stdout:5/13: fsync d1/d3/f7 0 2023-12-05T09:57:13.652 INFO:tasks.workunit.client.1.smithi150.stdout:0/13: getdents d5 0 2023-12-05T09:57:13.652 INFO:tasks.workunit.client.1.smithi150.stdout:0/14: read - no filename 2023-12-05T09:57:13.652 INFO:tasks.workunit.client.1.smithi150.stdout:0/15: dread - no filename 2023-12-05T09:57:13.783 INFO:tasks.workunit.client.1.smithi150.stdout:9/19: symlink l1 0 2023-12-05T09:57:13.787 INFO:tasks.workunit.client.1.smithi150.stdout:9/20: dread f0 [0,4194304] 0 2023-12-05T09:57:13.927 INFO:tasks.workunit.client.0.smithi100.stdout:9/150: getdents d7/d10 0 2023-12-05T09:57:13.928 INFO:tasks.workunit.client.0.smithi100.stdout:9/151: truncate d7/f8 671883 0 2023-12-05T09:57:13.928 INFO:tasks.workunit.client.0.smithi100.stdout:9/152: readlink l2 0 2023-12-05T09:57:13.928 INFO:tasks.workunit.client.0.smithi100.stdout:9/153: truncate d7/d1b/f33 820059 0 2023-12-05T09:57:13.944 INFO:tasks.workunit.client.0.smithi100.stdout:9/154: dread d7/d1b/f1e [0,4194304] 0 2023-12-05T09:57:13.944 INFO:tasks.workunit.client.0.smithi100.stdout:9/155: chown d7/d20/l21 647822 1 2023-12-05T09:57:13.947 INFO:tasks.workunit.client.0.smithi100.stdout:9/156: symlink d7/d1b/d22/l36 0 2023-12-05T09:57:14.137 INFO:tasks.workunit.client.0.smithi100.stdout:9/157: getdents d7/d1b 0 2023-12-05T09:57:14.192 INFO:tasks.workunit.client.0.smithi100.stdout:9/158: dwrite d7/d20/f2c [0,4194304] 0 2023-12-05T09:57:14.488 INFO:tasks.workunit.client.0.smithi100.stdout:2/122: truncate d7/da/dc/ff 1895347 0 2023-12-05T09:57:14.490 INFO:tasks.workunit.client.0.smithi100.stdout:2/123: mknod d7/da/d18/d1b/d2c/c2e 0 2023-12-05T09:57:14.491 INFO:tasks.workunit.client.0.smithi100.stdout:2/124: fsync d7/da/d1a/f1c 0 2023-12-05T09:57:14.493 INFO:tasks.workunit.client.0.smithi100.stdout:2/125: link d7/da/d18/d1b/l1f d7/da/d18/d1b/l2f 0 2023-12-05T09:57:14.496 INFO:tasks.workunit.client.0.smithi100.stdout:2/126: unlink d7/da/d18/d1b/d2c/c2d 0 2023-12-05T09:57:14.566 INFO:tasks.workunit.client.0.smithi100.stdout:2/127: dwrite d7/da/d18/d1b/f28 [0,4194304] 0 2023-12-05T09:57:14.569 INFO:tasks.workunit.client.0.smithi100.stdout:2/128: creat d7/da/d18/d21/f30 x:0 0 0 2023-12-05T09:57:14.603 INFO:tasks.workunit.client.0.smithi100.stdout:2/129: dwrite d7/da/dc/d19/f26 [0,4194304] 0 2023-12-05T09:57:14.607 INFO:tasks.workunit.client.0.smithi100.stdout:2/130: link c6 d7/da/d2b/c31 0 2023-12-05T09:57:14.611 INFO:tasks.workunit.client.0.smithi100.stdout:2/131: mknod d7/da/dc/c32 0 2023-12-05T09:57:14.612 INFO:tasks.workunit.client.0.smithi100.stdout:2/132: write d7/da/d18/d1b/f28 [4369963,19208] 0 2023-12-05T09:57:14.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:14 smithi100 ceph-mon[107145]: pgmap v23: 65 pgs: 65 active+clean; 328 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 16 MiB/s rd, 19 MiB/s wr, 111 op/s 2023-12-05T09:57:14.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:14 smithi150 ceph-mon[116142]: pgmap v23: 65 pgs: 65 active+clean; 328 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 16 MiB/s rd, 19 MiB/s wr, 111 op/s 2023-12-05T09:57:15.141 INFO:tasks.workunit.client.0.smithi100.stdout:9/159: dwrite d7/fd [0,4194304] 0 2023-12-05T09:57:15.184 INFO:tasks.workunit.client.0.smithi100.stdout:9/160: dwrite d7/d1b/f1e [0,4194304] 0 2023-12-05T09:57:15.186 INFO:tasks.workunit.client.0.smithi100.stdout:9/161: creat d7/d10/f37 x:0 0 0 2023-12-05T09:57:15.189 INFO:tasks.workunit.client.0.smithi100.stdout:9/162: truncate d7/d1b/f33 12198 0 2023-12-05T09:57:15.191 INFO:tasks.workunit.client.0.smithi100.stdout:9/163: link d7/d10/f14 d7/d1b/d22/f38 0 2023-12-05T09:57:15.192 INFO:tasks.workunit.client.0.smithi100.stdout:9/164: getdents d7/d10/d32 0 2023-12-05T09:57:15.193 INFO:tasks.workunit.client.0.smithi100.stdout:9/165: symlink d7/d1b/l39 0 2023-12-05T09:57:15.207 INFO:tasks.workunit.client.0.smithi100.stdout:9/166: dread d7/d10/f11 [0,4194304] 0 2023-12-05T09:57:15.209 INFO:tasks.workunit.client.0.smithi100.stdout:9/167: chown d7/f9 35169349 1 2023-12-05T09:57:15.209 INFO:tasks.workunit.client.0.smithi100.stdout:9/168: chown l5 526727646 1 2023-12-05T09:57:15.209 INFO:tasks.workunit.client.0.smithi100.stdout:9/169: readlink d7/d1b/d22/l24 0 2023-12-05T09:57:15.211 INFO:tasks.workunit.client.0.smithi100.stdout:9/170: creat d7/d20/f3a x:0 0 0 2023-12-05T09:57:15.211 INFO:tasks.workunit.client.0.smithi100.stdout:9/171: chown d7/d10/d32 326874 1 2023-12-05T09:57:15.212 INFO:tasks.workunit.client.0.smithi100.stdout:9/172: write d7/d1b/d22/f38 [1775013,121176] 0 2023-12-05T09:57:15.297 INFO:tasks.workunit.client.0.smithi100.stdout:9/173: dwrite d7/d10/f37 [0,4194304] 0 2023-12-05T09:57:15.301 INFO:tasks.workunit.client.0.smithi100.stdout:9/174: symlink d7/d35/l3b 0 2023-12-05T09:57:15.399 INFO:tasks.workunit.client.0.smithi100.stdout:2/133: unlink d7/da/dc/ff 0 2023-12-05T09:57:15.405 INFO:tasks.workunit.client.0.smithi100.stdout:3/100: sync 2023-12-05T09:57:15.405 INFO:tasks.workunit.client.0.smithi100.stdout:4/45: sync 2023-12-05T09:57:15.405 INFO:tasks.workunit.client.0.smithi100.stdout:8/31: sync 2023-12-05T09:57:15.405 INFO:tasks.workunit.client.0.smithi100.stdout:8/32: chown d0 4467765 1 2023-12-05T09:57:15.406 INFO:tasks.workunit.client.0.smithi100.stdout:8/33: fsync - no filename 2023-12-05T09:57:15.406 INFO:tasks.workunit.client.0.smithi100.stdout:8/34: chown d0 361 1 2023-12-05T09:57:15.406 INFO:tasks.workunit.client.0.smithi100.stdout:4/46: dread - fa zero size 2023-12-05T09:57:15.406 INFO:tasks.workunit.client.0.smithi100.stdout:5/43: sync 2023-12-05T09:57:15.406 INFO:tasks.workunit.client.0.smithi100.stdout:0/86: sync 2023-12-05T09:57:15.406 INFO:tasks.workunit.client.0.smithi100.stdout:1/47: sync 2023-12-05T09:57:15.406 INFO:tasks.workunit.client.0.smithi100.stdout:5/44: dread - d0/d4/fa zero size 2023-12-05T09:57:15.406 INFO:tasks.workunit.client.0.smithi100.stdout:1/48: truncate db/f10 355485 0 2023-12-05T09:57:15.406 INFO:tasks.workunit.client.0.smithi100.stdout:1/49: chown la 99073 1 2023-12-05T09:57:15.406 INFO:tasks.workunit.client.0.smithi100.stdout:5/45: write d0/f2 [623361,10005] 0 2023-12-05T09:57:15.406 INFO:tasks.workunit.client.0.smithi100.stdout:1/50: write db/fd [791523,17757] 0 2023-12-05T09:57:15.406 INFO:tasks.workunit.client.0.smithi100.stdout:7/40: sync 2023-12-05T09:57:15.406 INFO:tasks.workunit.client.0.smithi100.stdout:6/333: sync 2023-12-05T09:57:15.406 INFO:tasks.workunit.client.0.smithi100.stdout:7/41: dread - d3/fd zero size 2023-12-05T09:57:15.407 INFO:tasks.workunit.client.0.smithi100.stdout:7/42: stat d3/d4 0 2023-12-05T09:57:15.407 INFO:tasks.workunit.client.0.smithi100.stdout:7/43: read d3/f5 [3516087,108586] 0 2023-12-05T09:57:15.407 INFO:tasks.workunit.client.0.smithi100.stdout:7/44: write d3/fa [2262772,57997] 0 2023-12-05T09:57:15.415 INFO:tasks.workunit.client.0.smithi100.stdout:8/35: creat d0/f2 x:0 0 0 2023-12-05T09:57:15.415 INFO:tasks.workunit.client.0.smithi100.stdout:8/36: creat d0/f3 x:0 0 0 2023-12-05T09:57:15.415 INFO:tasks.workunit.client.0.smithi100.stdout:2/134: dread d7/da/dc/d19/f26 [0,4194304] 0 2023-12-05T09:57:15.416 INFO:tasks.workunit.client.0.smithi100.stdout:2/135: fdatasync d7/da/d1a/f1c 0 2023-12-05T09:57:15.416 INFO:tasks.workunit.client.0.smithi100.stdout:0/87: symlink da/d1b/l1d 0 2023-12-05T09:57:15.416 INFO:tasks.workunit.client.0.smithi100.stdout:2/136: chown d7/da/d18/d1b/c29 359 1 2023-12-05T09:57:15.418 INFO:tasks.workunit.client.0.smithi100.stdout:5/46: mkdir d0/db 0 2023-12-05T09:57:15.423 INFO:tasks.workunit.client.0.smithi100.stdout:7/45: dread d3/f5 [0,4194304] 0 2023-12-05T09:57:15.426 INFO:tasks.workunit.client.0.smithi100.stdout:8/37: symlink d0/l4 0 2023-12-05T09:57:15.429 INFO:tasks.workunit.client.0.smithi100.stdout:2/137: rmdir d7/da/d13 39 2023-12-05T09:57:15.431 INFO:tasks.workunit.client.0.smithi100.stdout:5/47: rmdir d0/db 0 2023-12-05T09:57:15.433 INFO:tasks.workunit.client.0.smithi100.stdout:1/51: getdents db 0 2023-12-05T09:57:15.433 INFO:tasks.workunit.client.0.smithi100.stdout:1/52: readlink db/le 0 2023-12-05T09:57:15.433 INFO:tasks.workunit.client.0.smithi100.stdout:1/53: chown f9 11617 1 2023-12-05T09:57:15.441 INFO:tasks.workunit.client.0.smithi100.stdout:2/138: mkdir d7/da/d33 0 2023-12-05T09:57:15.445 INFO:tasks.workunit.client.0.smithi100.stdout:2/139: creat d7/f34 x:0 0 0 2023-12-05T09:57:15.445 INFO:tasks.workunit.client.0.smithi100.stdout:2/140: dread - d7/f34 zero size 2023-12-05T09:57:15.447 INFO:tasks.workunit.client.0.smithi100.stdout:2/141: mknod d7/da/dc/c35 0 2023-12-05T09:57:15.461 INFO:tasks.workunit.client.0.smithi100.stdout:0/88: dwrite da/f17 [0,4194304] 0 2023-12-05T09:57:15.461 INFO:tasks.workunit.client.0.smithi100.stdout:0/89: write da/f11 [8889286,49434] 0 2023-12-05T09:57:15.463 INFO:tasks.workunit.client.0.smithi100.stdout:2/142: dread d7/da/f17 [0,4194304] 0 2023-12-05T09:57:15.467 INFO:tasks.workunit.client.0.smithi100.stdout:0/90: mknod da/d1b/c1e 0 2023-12-05T09:57:15.473 INFO:tasks.workunit.client.0.smithi100.stdout:6/334: dwrite d7/d2d/f5d [0,4194304] 0 2023-12-05T09:57:15.473 INFO:tasks.workunit.client.0.smithi100.stdout:6/335: write d7/d27/d35/d5a/f70 [840089,119023] 0 2023-12-05T09:57:15.492 INFO:tasks.workunit.client.0.smithi100.stdout:5/48: dwrite d0/f7 [4194304,4194304] 0 2023-12-05T09:57:15.495 INFO:tasks.workunit.client.0.smithi100.stdout:3/101: rmdir d0 39 2023-12-05T09:57:15.495 INFO:tasks.workunit.client.0.smithi100.stdout:3/102: truncate d0/d2/de/d12/f18 231886 0 2023-12-05T09:57:15.495 INFO:tasks.workunit.client.0.smithi100.stdout:3/103: creat d0/d4/f19 x:0 0 0 2023-12-05T09:57:15.498 INFO:tasks.workunit.client.0.smithi100.stdout:1/54: dwrite db/fc [0,4194304] 0 2023-12-05T09:57:15.498 INFO:tasks.workunit.client.0.smithi100.stdout:1/55: dread - f9 zero size 2023-12-05T09:57:15.507 INFO:tasks.workunit.client.0.smithi100.stdout:1/56: creat db/d12/f13 x:0 0 0 2023-12-05T09:57:15.507 INFO:tasks.workunit.client.0.smithi100.stdout:1/57: dread - db/d12/f13 zero size 2023-12-05T09:57:15.513 INFO:tasks.workunit.client.0.smithi100.stdout:1/58: write db/fd [214688,116665] 0 2023-12-05T09:57:15.513 INFO:tasks.workunit.client.0.smithi100.stdout:1/59: creat db/d12/f14 x:0 0 0 2023-12-05T09:57:15.520 INFO:tasks.workunit.client.0.smithi100.stdout:2/143: dwrite d7/da/f25 [0,4194304] 0 2023-12-05T09:57:15.527 INFO:tasks.workunit.client.0.smithi100.stdout:2/144: dread d7/da/dc/d19/f2a [0,4194304] 0 2023-12-05T09:57:15.528 INFO:tasks.workunit.client.0.smithi100.stdout:2/145: truncate d7/da/d18/d1b/f28 5397485 0 2023-12-05T09:57:15.531 INFO:tasks.workunit.client.0.smithi100.stdout:2/146: getdents d7/da/d18/d1b/d2c 0 2023-12-05T09:57:15.532 INFO:tasks.workunit.client.0.smithi100.stdout:5/49: dwrite d0/d4/fa [0,4194304] 0 2023-12-05T09:57:15.536 INFO:tasks.workunit.client.0.smithi100.stdout:2/147: symlink d7/da/d18/d1b/l36 0 2023-12-05T09:57:15.542 INFO:tasks.workunit.client.0.smithi100.stdout:2/148: link d7/da/d18/d1b/l36 d7/da/d18/d1b/d2c/l37 0 2023-12-05T09:57:15.542 INFO:tasks.workunit.client.0.smithi100.stdout:2/149: fdatasync d7/da/dc/f12 0 2023-12-05T09:57:15.542 INFO:tasks.workunit.client.0.smithi100.stdout:2/150: creat d7/da/d1a/f38 x:0 0 0 2023-12-05T09:57:15.548 INFO:tasks.workunit.client.0.smithi100.stdout:2/151: mknod d7/da/d18/d1b/c39 0 2023-12-05T09:57:15.548 INFO:tasks.workunit.client.0.smithi100.stdout:2/152: chown d7/da 11 1 2023-12-05T09:57:15.553 INFO:tasks.workunit.client.0.smithi100.stdout:2/153: unlink d7/da/d18/c1e 0 2023-12-05T09:57:15.553 INFO:tasks.workunit.client.0.smithi100.stdout:2/154: write d7/da/dc/d19/f2a [728204,89795] 0 2023-12-05T09:57:15.558 INFO:tasks.workunit.client.0.smithi100.stdout:2/155: unlink d7/da/d18/d1b/l36 0 2023-12-05T09:57:15.567 INFO:tasks.workunit.client.0.smithi100.stdout:5/50: dwrite d0/f3 [0,4194304] 0 2023-12-05T09:57:15.569 INFO:tasks.workunit.client.0.smithi100.stdout:5/51: mknod d0/cc 0 2023-12-05T09:57:15.569 INFO:tasks.workunit.client.0.smithi100.stdout:5/52: chown d0 402 1 2023-12-05T09:57:15.608 INFO:tasks.workunit.client.0.smithi100.stdout:2/156: dwrite d7/da/d1a/f38 [0,4194304] 0 2023-12-05T09:57:15.608 INFO:tasks.workunit.client.0.smithi100.stdout:2/157: write d7/da/d18/d21/f30 [235673,117456] 0 2023-12-05T09:57:15.608 INFO:tasks.workunit.client.0.smithi100.stdout:2/158: stat d7/da/d1a/f38 0 2023-12-05T09:57:15.608 INFO:tasks.workunit.client.0.smithi100.stdout:2/159: write d7/da/d18/d21/f30 [1038401,14595] 0 2023-12-05T09:57:15.621 INFO:tasks.workunit.client.0.smithi100.stdout:2/160: write d7/da/d18/d1b/f28 [2965791,119118] 0 2023-12-05T09:57:15.624 INFO:tasks.workunit.client.0.smithi100.stdout:2/161: rmdir d7/da/d33 0 2023-12-05T09:57:15.624 INFO:tasks.workunit.client.0.smithi100.stdout:2/162: truncate d7/da/d1a/f1c 4651724 0 2023-12-05T09:57:15.636 INFO:tasks.workunit.client.0.smithi100.stdout:2/163: dread d7/da/dc/f12 [0,4194304] 0 2023-12-05T09:57:15.652 INFO:tasks.workunit.client.0.smithi100.stdout:2/164: write d7/da/d1a/f1c [1496573,89212] 0 2023-12-05T09:57:16.231 INFO:tasks.workunit.client.0.smithi100.stdout:6/336: rename d7/d11/d1a/d53 to d7/d27/d72 0 2023-12-05T09:57:16.231 INFO:tasks.workunit.client.0.smithi100.stdout:6/337: readlink d7/d2d/l5f 0 2023-12-05T09:57:16.233 INFO:tasks.workunit.client.0.smithi100.stdout:5/53: rename d0/f7 to d0/d4/fd 0 2023-12-05T09:57:16.235 INFO:tasks.workunit.client.0.smithi100.stdout:6/338: link d7/d27/l4d d7/l73 0 2023-12-05T09:57:16.237 INFO:tasks.workunit.client.0.smithi100.stdout:5/54: mknod d0/d4/ce 0 2023-12-05T09:57:16.252 INFO:tasks.workunit.client.0.smithi100.stdout:6/339: dread d7/d2d/f5d [0,4194304] 0 2023-12-05T09:57:16.254 INFO:tasks.workunit.client.0.smithi100.stdout:6/340: rmdir d7/d2d 39 2023-12-05T09:57:16.257 INFO:tasks.workunit.client.0.smithi100.stdout:6/341: rmdir d7/d11 39 2023-12-05T09:57:16.259 INFO:tasks.workunit.client.0.smithi100.stdout:6/342: link d7/d11/d1a/f1b d7/d11/d1a/d1c/f74 0 2023-12-05T09:57:16.264 INFO:tasks.workunit.client.0.smithi100.stdout:6/343: unlink d7/d11/d1a/l21 0 2023-12-05T09:57:16.264 INFO:tasks.workunit.client.0.smithi100.stdout:6/344: fsync f5 0 2023-12-05T09:57:16.266 INFO:tasks.workunit.client.0.smithi100.stdout:6/345: mknod d7/d11/d1a/d1c/c75 0 2023-12-05T09:57:16.284 INFO:tasks.workunit.client.0.smithi100.stdout:6/346: read d7/d11/d1a/d1c/f28 [1109684,128781] 0 2023-12-05T09:57:16.286 INFO:tasks.workunit.client.0.smithi100.stdout:6/347: mkdir d7/d76 0 2023-12-05T09:57:16.290 INFO:tasks.workunit.client.0.smithi100.stdout:6/348: creat d7/d27/d72/f77 x:0 0 0 2023-12-05T09:57:16.290 INFO:tasks.workunit.client.0.smithi100.stdout:6/349: chown d7/d27/d35/c6c 1243 1 2023-12-05T09:57:16.293 INFO:tasks.workunit.client.0.smithi100.stdout:6/350: mkdir d7/d11/d1a/d78 0 2023-12-05T09:57:16.296 INFO:tasks.workunit.client.0.smithi100.stdout:6/351: symlink d7/d11/l79 0 2023-12-05T09:57:16.299 INFO:tasks.workunit.client.0.smithi100.stdout:6/352: creat d7/d2d/f7a x:0 0 0 2023-12-05T09:57:16.331 INFO:tasks.workunit.client.0.smithi100.stdout:9/175: getdents d7/d1b/d22 0 2023-12-05T09:57:16.331 INFO:tasks.workunit.client.0.smithi100.stdout:9/176: dread - d7/d1b/f30 zero size 2023-12-05T09:57:16.344 INFO:tasks.workunit.client.0.smithi100.stdout:9/177: dread d7/d1b/d22/f38 [0,4194304] 0 2023-12-05T09:57:16.352 INFO:tasks.workunit.client.0.smithi100.stdout:6/353: dwrite f3 [0,4194304] 0 2023-12-05T09:57:16.365 INFO:tasks.workunit.client.0.smithi100.stdout:6/354: dread d7/d27/d35/f3a [0,4194304] 0 2023-12-05T09:57:16.365 INFO:tasks.workunit.client.0.smithi100.stdout:6/355: write d7/d27/f50 [95223,124461] 0 2023-12-05T09:57:16.365 INFO:tasks.workunit.client.0.smithi100.stdout:6/356: write d7/d27/d35/f49 [1893331,56057] 0 2023-12-05T09:57:16.367 INFO:tasks.workunit.client.0.smithi100.stdout:6/357: rename d7/d2d/f5d to d7/d2d/d6a/f7b 0 2023-12-05T09:57:16.367 INFO:tasks.workunit.client.0.smithi100.stdout:6/358: truncate d7/d11/d1a/f52 360849 0 2023-12-05T09:57:16.369 INFO:tasks.workunit.client.0.smithi100.stdout:6/359: getdents d7/d27/d35 0 2023-12-05T09:57:16.372 INFO:tasks.workunit.client.0.smithi100.stdout:6/360: mkdir d7/d2d/d6a/d7c 0 2023-12-05T09:57:16.372 INFO:tasks.workunit.client.0.smithi100.stdout:6/361: fsync d7/d11/f2c 0 2023-12-05T09:57:16.372 INFO:tasks.workunit.client.0.smithi100.stdout:6/362: write f5 [4386678,60776] 0 2023-12-05T09:57:16.375 INFO:tasks.workunit.client.0.smithi100.stdout:6/363: unlink d7/d2d/f7a 0 2023-12-05T09:57:16.378 INFO:tasks.workunit.client.0.smithi100.stdout:6/364: creat d7/d27/f7d x:0 0 0 2023-12-05T09:57:16.378 INFO:tasks.workunit.client.0.smithi100.stdout:6/365: readlink d7/d27/d35/l60 0 2023-12-05T09:57:16.380 INFO:tasks.workunit.client.0.smithi100.stdout:6/366: mkdir d7/d11/d7e 0 2023-12-05T09:57:16.380 INFO:tasks.workunit.client.0.smithi100.stdout:6/367: creat d7/d27/d35/d5a/f7f x:0 0 0 2023-12-05T09:57:16.395 INFO:tasks.workunit.client.0.smithi100.stdout:6/368: write d7/d11/d1a/f2b [63775,28054] 0 2023-12-05T09:57:16.395 INFO:tasks.workunit.client.0.smithi100.stdout:6/369: readlink d7/d11/d1a/l45 0 2023-12-05T09:57:16.395 INFO:tasks.workunit.client.0.smithi100.stdout:6/370: dread - d7/d11/f4c zero size 2023-12-05T09:57:16.396 INFO:tasks.workunit.client.0.smithi100.stdout:9/178: dwrite d7/f1d [0,4194304] 0 2023-12-05T09:57:16.397 INFO:tasks.workunit.client.0.smithi100.stdout:6/371: mkdir d7/d11/d1a/d78/d80 0 2023-12-05T09:57:16.404 INFO:tasks.workunit.client.0.smithi100.stdout:9/179: dread d7/d10/f14 [0,4194304] 0 2023-12-05T09:57:16.409 INFO:tasks.workunit.client.0.smithi100.stdout:9/180: unlink d7/ca 0 2023-12-05T09:57:16.414 INFO:tasks.workunit.client.0.smithi100.stdout:6/372: read d7/d2d/f43 [3617577,120108] 0 2023-12-05T09:57:16.418 INFO:tasks.workunit.client.0.smithi100.stdout:6/373: unlink d7/d2d/c61 0 2023-12-05T09:57:16.418 INFO:tasks.workunit.client.0.smithi100.stdout:6/374: readlink d7/d11/d1a/d1c/l62 0 2023-12-05T09:57:16.418 INFO:tasks.workunit.client.0.smithi100.stdout:6/375: fsync d7/d11/f6d 0 2023-12-05T09:57:16.418 INFO:tasks.workunit.client.0.smithi100.stdout:6/376: dread - d7/d2d/f48 zero size 2023-12-05T09:57:16.418 INFO:tasks.workunit.client.0.smithi100.stdout:6/377: write d7/d27/f3b [366465,3364] 0 2023-12-05T09:57:16.418 INFO:tasks.workunit.client.0.smithi100.stdout:6/378: read d7/d11/f20 [2693835,119635] 0 2023-12-05T09:57:16.421 INFO:tasks.workunit.client.0.smithi100.stdout:6/379: link d7/d27/d35/c68 d7/d11/d1a/c81 0 2023-12-05T09:57:16.542 INFO:tasks.workunit.client.0.smithi100.stdout:4/47: write f2 [5197295,76666] 0 2023-12-05T09:57:16.543 INFO:tasks.workunit.client.0.smithi100.stdout:4/48: read - fa zero size 2023-12-05T09:57:16.543 INFO:tasks.workunit.client.0.smithi100.stdout:4/49: write f1 [2544236,65125] 0 2023-12-05T09:57:16.544 INFO:tasks.workunit.client.0.smithi100.stdout:4/50: link c8 cc 0 2023-12-05T09:57:16.577 INFO:tasks.workunit.client.0.smithi100.stdout:4/51: dwrite fa [0,4194304] 0 2023-12-05T09:57:16.581 INFO:tasks.workunit.client.0.smithi100.stdout:4/52: mkdir dd 0 2023-12-05T09:57:16.601 INFO:tasks.workunit.client.0.smithi100.stdout:3/104: rmdir d0/d4 39 2023-12-05T09:57:16.639 INFO:tasks.workunit.client.0.smithi100.stdout:1/60: dwrite db/fc [4194304,4194304] 0 2023-12-05T09:57:16.646 INFO:tasks.workunit.client.0.smithi100.stdout:1/61: mknod db/c15 0 2023-12-05T09:57:16.652 INFO:tasks.workunit.client.0.smithi100.stdout:3/105: dwrite d0/d4/f19 [0,4194304] 0 2023-12-05T09:57:16.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:16 smithi150 ceph-mon[116142]: pgmap v24: 65 pgs: 65 active+clean; 475 MiB data, 3.3 GiB used, 533 GiB / 536 GiB avail; 24 MiB/s rd, 37 MiB/s wr, 647 op/s 2023-12-05T09:57:16.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:16 smithi100 ceph-mon[107145]: pgmap v24: 65 pgs: 65 active+clean; 475 MiB data, 3.3 GiB used, 533 GiB / 536 GiB avail; 24 MiB/s rd, 37 MiB/s wr, 647 op/s 2023-12-05T09:57:17.158 INFO:tasks.workunit.client.1.smithi150.stdout:6/7: mknod c1 0 2023-12-05T09:57:17.193 INFO:tasks.workunit.client.1.smithi150.stdout:6/8: dwrite f0 [0,4194304] 0 2023-12-05T09:57:17.193 INFO:tasks.workunit.client.1.smithi150.stdout:6/9: readlink - no filename 2023-12-05T09:57:17.207 INFO:tasks.workunit.client.1.smithi150.stdout:7/9: mkdir d2/d4 0 2023-12-05T09:57:17.260 INFO:tasks.workunit.client.1.smithi150.stdout:7/10: dwrite f1 [0,4194304] 0 2023-12-05T09:57:17.325 INFO:tasks.workunit.client.0.smithi100.stdout:6/380: rename d7/d11/d1a/d1c to d7/d11/d82 0 2023-12-05T09:57:17.328 INFO:tasks.workunit.client.0.smithi100.stdout:3/106: rename d0/d2/fd to d0/d2/de/d12/f1a 0 2023-12-05T09:57:17.328 INFO:tasks.workunit.client.0.smithi100.stdout:3/107: fdatasync d0/d4/f14 0 2023-12-05T09:57:17.328 INFO:tasks.workunit.client.0.smithi100.stdout:3/108: chown d0/d4/f17 0 1 2023-12-05T09:57:17.328 INFO:tasks.workunit.client.0.smithi100.stdout:3/109: chown d0/d4/fc 435672265 1 2023-12-05T09:57:17.329 INFO:tasks.workunit.client.0.smithi100.stdout:3/110: stat d0/d4/fc 0 2023-12-05T09:57:17.329 INFO:tasks.workunit.client.0.smithi100.stdout:3/111: readlink d0/l6 0 2023-12-05T09:57:17.330 INFO:tasks.workunit.client.0.smithi100.stdout:3/112: truncate d0/f3 466106 0 2023-12-05T09:57:17.331 INFO:tasks.workunit.client.0.smithi100.stdout:6/381: dread d7/d11/d1a/f52 [0,4194304] 0 2023-12-05T09:57:17.331 INFO:tasks.workunit.client.0.smithi100.stdout:6/382: fdatasync d7/d11/d1a/f22 0 2023-12-05T09:57:17.336 INFO:tasks.workunit.client.0.smithi100.stdout:6/383: symlink d7/d2d/d6a/d7c/l83 0 2023-12-05T09:57:17.337 INFO:tasks.workunit.client.0.smithi100.stdout:6/384: stat d7/d27/d35/l4e 0 2023-12-05T09:57:17.339 INFO:tasks.workunit.client.0.smithi100.stdout:6/385: unlink d7/d27/f7d 0 2023-12-05T09:57:17.339 INFO:tasks.workunit.client.0.smithi100.stdout:6/386: dread - d7/f59 zero size 2023-12-05T09:57:17.342 INFO:tasks.workunit.client.0.smithi100.stdout:6/387: creat d7/d2d/d6a/d7c/f84 x:0 0 0 2023-12-05T09:57:17.344 INFO:tasks.workunit.client.0.smithi100.stdout:6/388: symlink d7/d2d/l85 0 2023-12-05T09:57:17.345 INFO:tasks.workunit.client.0.smithi100.stdout:3/113: dread d0/d4/f19 [0,4194304] 0 2023-12-05T09:57:17.348 INFO:tasks.workunit.client.0.smithi100.stdout:6/389: symlink d7/d11/d82/l86 0 2023-12-05T09:57:17.350 INFO:tasks.workunit.client.0.smithi100.stdout:6/390: rename d7/d27/d35/f49 to d7/d27/d72/f87 0 2023-12-05T09:57:17.385 INFO:tasks.workunit.client.0.smithi100.stdout:6/391: dread d7/d11/d1a/f1b [0,4194304] 0 2023-12-05T09:57:17.388 INFO:tasks.workunit.client.0.smithi100.stdout:6/392: truncate d7/d27/d72/f55 427405 0 2023-12-05T09:57:17.388 INFO:tasks.workunit.client.0.smithi100.stdout:6/393: dread - d7/d27/d72/f77 zero size 2023-12-05T09:57:17.392 INFO:tasks.workunit.client.0.smithi100.stdout:6/394: link d7/d2d/d6a/d7c/f84 d7/d2d/d6a/d7c/f88 0 2023-12-05T09:57:17.392 INFO:tasks.workunit.client.0.smithi100.stdout:6/395: write d7/d11/f6d [893301,102660] 0 2023-12-05T09:57:17.398 INFO:tasks.workunit.client.0.smithi100.stdout:3/114: dwrite d0/d2/de/d12/f1a [0,4194304] 0 2023-12-05T09:57:17.400 INFO:tasks.workunit.client.0.smithi100.stdout:3/115: unlink d0/f7 0 2023-12-05T09:57:17.402 INFO:tasks.workunit.client.0.smithi100.stdout:6/396: dread d7/d11/d1a/f22 [0,4194304] 0 2023-12-05T09:57:17.402 INFO:tasks.workunit.client.0.smithi100.stdout:6/397: stat d7/d27/d35/l60 0 2023-12-05T09:57:17.404 INFO:tasks.workunit.client.0.smithi100.stdout:3/116: write d0/d2/de/d12/f18 [1170398,62877] 0 2023-12-05T09:57:17.404 INFO:tasks.workunit.client.0.smithi100.stdout:3/117: fdatasync d0/d4/f17 0 2023-12-05T09:57:17.409 INFO:tasks.workunit.client.0.smithi100.stdout:3/118: mknod d0/d4/c1b 0 2023-12-05T09:57:17.414 INFO:tasks.workunit.client.0.smithi100.stdout:3/119: mknod d0/d4/c1c 0 2023-12-05T09:57:17.416 INFO:tasks.workunit.client.0.smithi100.stdout:3/120: symlink d0/d10/l1d 0 2023-12-05T09:57:17.416 INFO:tasks.workunit.client.0.smithi100.stdout:3/121: read - d0/d4/f14 zero size 2023-12-05T09:57:17.416 INFO:tasks.workunit.client.0.smithi100.stdout:3/122: chown d0/f13 101283 1 2023-12-05T09:57:17.420 INFO:tasks.workunit.client.0.smithi100.stdout:3/123: creat d0/d4/f1e x:0 0 0 2023-12-05T09:57:17.421 INFO:tasks.workunit.client.0.smithi100.stdout:3/124: write d0/d4/f14 [428900,40801] 0 2023-12-05T09:57:17.421 INFO:tasks.workunit.client.0.smithi100.stdout:3/125: truncate d0/d2/de/d12/f18 1350392 0 2023-12-05T09:57:17.454 INFO:tasks.workunit.client.0.smithi100.stdout:9/181: truncate d7/f1d 2104559 0 2023-12-05T09:57:17.454 INFO:tasks.workunit.client.0.smithi100.stdout:6/398: dwrite d7/f16 [0,4194304] 0 2023-12-05T09:57:17.482 INFO:tasks.workunit.client.0.smithi100.stdout:3/126: dwrite d0/f13 [4194304,4194304] 0 2023-12-05T09:57:17.493 INFO:tasks.workunit.client.0.smithi100.stdout:9/182: dwrite d7/d1b/f30 [0,4194304] 0 2023-12-05T09:57:17.493 INFO:tasks.workunit.client.0.smithi100.stdout:9/183: fdatasync d7/fc 0 2023-12-05T09:57:17.514 INFO:tasks.workunit.client.0.smithi100.stdout:9/184: link d7/d1b/f33 d7/d20/f3c 0 2023-12-05T09:57:17.527 INFO:tasks.workunit.client.0.smithi100.stdout:3/127: dwrite d0/d4/fc [0,4194304] 0 2023-12-05T09:57:17.530 INFO:tasks.workunit.client.0.smithi100.stdout:3/128: unlink d0/f13 0 2023-12-05T09:57:17.530 INFO:tasks.workunit.client.0.smithi100.stdout:3/129: stat d0/cb 0 2023-12-05T09:57:17.547 INFO:tasks.workunit.client.0.smithi100.stdout:9/185: dwrite d7/fc [0,4194304] 0 2023-12-05T09:57:17.659 INFO:tasks.workunit.client.0.smithi100.stdout:4/53: truncate f1 2058327 0 2023-12-05T09:57:17.679 INFO:tasks.workunit.client.0.smithi100.stdout:4/54: write fb [3413828,115356] 0 2023-12-05T09:57:17.680 INFO:tasks.workunit.client.0.smithi100.stdout:4/55: write fb [1357163,77475] 0 2023-12-05T09:57:17.684 INFO:tasks.workunit.client.0.smithi100.stdout:4/56: unlink cc 0 2023-12-05T09:57:17.701 INFO:tasks.workunit.client.0.smithi100.stdout:4/57: write f2 [1595865,39422] 0 2023-12-05T09:57:17.716 INFO:tasks.workunit.client.0.smithi100.stdout:1/62: getdents db 0 2023-12-05T09:57:17.716 INFO:tasks.workunit.client.0.smithi100.stdout:1/63: fsync db/f10 0 2023-12-05T09:57:17.716 INFO:tasks.workunit.client.0.smithi100.stdout:1/64: dread - db/d12/f13 zero size 2023-12-05T09:57:17.716 INFO:tasks.workunit.client.0.smithi100.stdout:1/65: chown db 27244 1 2023-12-05T09:57:17.716 INFO:tasks.workunit.client.0.smithi100.stdout:1/66: chown db/d12 13616190 1 2023-12-05T09:57:17.716 INFO:tasks.workunit.client.0.smithi100.stdout:1/67: chown db/c11 5265 1 2023-12-05T09:57:17.717 INFO:tasks.workunit.client.0.smithi100.stdout:1/68: chown db/d12/f13 3292209 1 2023-12-05T09:57:17.717 INFO:tasks.workunit.client.0.smithi100.stdout:1/69: creat db/d12/f16 x:0 0 0 2023-12-05T09:57:17.719 INFO:tasks.workunit.client.0.smithi100.stdout:4/58: dread f2 [4194304,4194304] 0 2023-12-05T09:57:17.730 INFO:tasks.workunit.client.0.smithi100.stdout:4/59: rmdir dd 0 2023-12-05T09:57:17.731 INFO:tasks.workunit.client.0.smithi100.stdout:4/60: stat c8 0 2023-12-05T09:57:17.731 INFO:tasks.workunit.client.0.smithi100.stdout:4/61: fsync f9 0 2023-12-05T09:57:17.735 INFO:tasks.workunit.client.0.smithi100.stdout:4/62: mkdir de 0 2023-12-05T09:57:17.774 INFO:tasks.workunit.client.0.smithi100.stdout:1/70: dwrite f1 [0,4194304] 0 2023-12-05T09:57:17.781 INFO:tasks.workunit.client.0.smithi100.stdout:1/71: mknod db/d12/c17 0 2023-12-05T09:57:17.816 INFO:tasks.workunit.client.0.smithi100.stdout:1/72: dwrite db/d12/f16 [0,4194304] 0 2023-12-05T09:57:17.822 INFO:tasks.workunit.client.0.smithi100.stdout:1/73: unlink db/d12/c17 0 2023-12-05T09:57:17.824 INFO:tasks.workunit.client.0.smithi100.stdout:1/74: stat c7 0 2023-12-05T09:57:17.828 INFO:tasks.workunit.client.0.smithi100.stdout:1/75: link db/d12/f13 db/d12/f18 0 2023-12-05T09:57:17.828 INFO:tasks.workunit.client.0.smithi100.stdout:1/76: chown db/d12/f18 459 1 2023-12-05T09:57:17.828 INFO:tasks.workunit.client.0.smithi100.stdout:1/77: dread - db/d12/f13 zero size 2023-12-05T09:57:17.897 INFO:tasks.workunit.client.0.smithi100.stdout:1/78: dwrite db/d12/f13 [0,4194304] 0 2023-12-05T09:57:18.111 INFO:tasks.workunit.client.1.smithi150.stdout:0/16: link l1 d5/l7 0 2023-12-05T09:57:18.111 INFO:tasks.workunit.client.1.smithi150.stdout:0/17: dwrite - no filename 2023-12-05T09:57:18.111 INFO:tasks.workunit.client.1.smithi150.stdout:0/18: read - no filename 2023-12-05T09:57:18.112 INFO:tasks.workunit.client.1.smithi150.stdout:9/21: mknod c2 0 2023-12-05T09:57:18.201 INFO:tasks.workunit.client.1.smithi150.stdout:1/22: getdents . 0 2023-12-05T09:57:18.204 INFO:tasks.workunit.client.1.smithi150.stdout:6/10: mkdir d2 0 2023-12-05T09:57:18.205 INFO:tasks.workunit.client.1.smithi150.stdout:5/14: getdents d1/d3 0 2023-12-05T09:57:18.206 INFO:tasks.workunit.client.1.smithi150.stdout:7/11: creat d2/f5 x:0 0 0 2023-12-05T09:57:18.206 INFO:tasks.workunit.client.1.smithi150.stdout:7/12: write d2/f5 [658924,127986] 0 2023-12-05T09:57:18.206 INFO:tasks.workunit.client.1.smithi150.stdout:7/13: write d2/f5 [666861,31806] 0 2023-12-05T09:57:18.210 INFO:tasks.workunit.client.1.smithi150.stdout:1/23: creat f4 x:0 0 0 2023-12-05T09:57:18.210 INFO:tasks.workunit.client.1.smithi150.stdout:1/24: write f4 [996500,115492] 0 2023-12-05T09:57:18.214 INFO:tasks.workunit.client.1.smithi150.stdout:1/25: creat f5 x:0 0 0 2023-12-05T09:57:18.216 INFO:tasks.workunit.client.1.smithi150.stdout:1/26: mkdir d6 0 2023-12-05T09:57:18.217 INFO:tasks.workunit.client.1.smithi150.stdout:1/27: chown c0 144268851 1 2023-12-05T09:57:18.222 INFO:tasks.workunit.client.1.smithi150.stdout:7/14: dread f1 [0,4194304] 0 2023-12-05T09:57:18.222 INFO:tasks.workunit.client.1.smithi150.stdout:7/15: fdatasync f1 0 2023-12-05T09:57:18.222 INFO:tasks.workunit.client.1.smithi150.stdout:1/28: write f4 [286120,32735] 0 2023-12-05T09:57:18.224 INFO:tasks.workunit.client.1.smithi150.stdout:7/16: mknod d2/d4/c6 0 2023-12-05T09:57:18.225 INFO:tasks.workunit.client.1.smithi150.stdout:1/29: creat d6/f7 x:0 0 0 2023-12-05T09:57:18.230 INFO:tasks.workunit.client.1.smithi150.stdout:1/30: mkdir d6/d8 0 2023-12-05T09:57:18.242 INFO:tasks.workunit.client.1.smithi150.stdout:7/17: dread d2/f5 [0,4194304] 0 2023-12-05T09:57:18.243 INFO:tasks.workunit.client.1.smithi150.stdout:1/31: dread f4 [0,4194304] 0 2023-12-05T09:57:18.245 INFO:tasks.workunit.client.1.smithi150.stdout:5/15: dwrite d1/d3/f7 [0,4194304] 0 2023-12-05T09:57:18.248 INFO:tasks.workunit.client.1.smithi150.stdout:5/16: creat d1/d3/d6/f8 x:0 0 0 2023-12-05T09:57:18.250 INFO:tasks.workunit.client.1.smithi150.stdout:5/17: symlink d1/d3/d6/l9 0 2023-12-05T09:57:18.251 INFO:tasks.workunit.client.1.smithi150.stdout:7/18: dread f1 [0,4194304] 0 2023-12-05T09:57:18.252 INFO:tasks.workunit.client.1.smithi150.stdout:6/11: dwrite f0 [0,4194304] 0 2023-12-05T09:57:18.252 INFO:tasks.workunit.client.1.smithi150.stdout:6/12: chown f0 3 1 2023-12-05T09:57:18.252 INFO:tasks.workunit.client.1.smithi150.stdout:5/18: symlink d1/la 0 2023-12-05T09:57:18.252 INFO:tasks.workunit.client.1.smithi150.stdout:5/19: dread - d1/d3/d6/f8 zero size 2023-12-05T09:57:18.254 INFO:tasks.workunit.client.1.smithi150.stdout:7/19: unlink d2/f5 0 2023-12-05T09:57:18.257 INFO:tasks.workunit.client.1.smithi150.stdout:5/20: creat d1/d3/fb x:0 0 0 2023-12-05T09:57:18.258 INFO:tasks.workunit.client.1.smithi150.stdout:5/21: creat d1/d3/d6/fc x:0 0 0 2023-12-05T09:57:18.258 INFO:tasks.workunit.client.1.smithi150.stdout:5/22: creat d1/d3/fd x:0 0 0 2023-12-05T09:57:18.258 INFO:tasks.workunit.client.1.smithi150.stdout:5/23: chown d1/d3/d6/f8 117803174 1 2023-12-05T09:57:18.258 INFO:tasks.workunit.client.1.smithi150.stdout:5/24: chown d1/d3/d6/fc 11 1 2023-12-05T09:57:18.260 INFO:tasks.workunit.client.1.smithi150.stdout:5/25: rename d1/c2 to d1/d3/ce 0 2023-12-05T09:57:18.270 INFO:tasks.workunit.client.1.smithi150.stdout:6/13: read f0 [268637,70811] 0 2023-12-05T09:57:18.271 INFO:tasks.workunit.client.1.smithi150.stdout:6/14: mknod d2/c3 0 2023-12-05T09:57:18.283 INFO:tasks.workunit.client.0.smithi100.stdout:6/399: truncate d7/f16 6388949 0 2023-12-05T09:57:18.283 INFO:tasks.workunit.client.0.smithi100.stdout:6/400: write d7/d2d/f42 [23960,95826] 0 2023-12-05T09:57:18.302 INFO:tasks.workunit.client.0.smithi100.stdout:3/130: getdents d0 0 2023-12-05T09:57:18.303 INFO:tasks.workunit.client.0.smithi100.stdout:6/401: dread d7/d11/f20 [0,4194304] 0 2023-12-05T09:57:18.304 INFO:tasks.workunit.client.0.smithi100.stdout:3/131: link d0/d2/de/d12/f18 d0/d4/f1f 0 2023-12-05T09:57:18.304 INFO:tasks.workunit.client.1.smithi150.stdout:7/20: dwrite f1 [0,4194304] 0 2023-12-05T09:57:18.305 INFO:tasks.workunit.client.0.smithi100.stdout:6/402: getdents d7 0 2023-12-05T09:57:18.305 INFO:tasks.workunit.client.0.smithi100.stdout:6/403: truncate d7/d27/f2e 148335 0 2023-12-05T09:57:18.306 INFO:tasks.workunit.client.0.smithi100.stdout:3/132: link d0/d4/f1f d0/d4/f20 0 2023-12-05T09:57:18.307 INFO:tasks.workunit.client.0.smithi100.stdout:6/404: creat d7/f89 x:0 0 0 2023-12-05T09:57:18.308 INFO:tasks.workunit.client.0.smithi100.stdout:3/133: creat d0/d2/de/d11/f21 x:0 0 0 2023-12-05T09:57:18.309 INFO:tasks.workunit.client.0.smithi100.stdout:6/405: truncate d7/d27/d72/f87 851964 0 2023-12-05T09:57:18.311 INFO:tasks.workunit.client.0.smithi100.stdout:6/406: write d7/d11/f20 [4162451,121174] 0 2023-12-05T09:57:18.311 INFO:tasks.workunit.client.0.smithi100.stdout:6/407: truncate d7/f23 400238 0 2023-12-05T09:57:18.311 INFO:tasks.workunit.client.0.smithi100.stdout:6/408: chown d7/d27/d35/d5a/f65 3496 1 2023-12-05T09:57:18.312 INFO:tasks.workunit.client.0.smithi100.stdout:3/134: mknod d0/d4/c22 0 2023-12-05T09:57:18.312 INFO:tasks.workunit.client.0.smithi100.stdout:3/135: chown d0/d10 240455 1 2023-12-05T09:57:18.312 INFO:tasks.workunit.client.0.smithi100.stdout:3/136: chown d0/d4/fc 30 1 2023-12-05T09:57:18.313 INFO:tasks.workunit.client.0.smithi100.stdout:6/409: symlink d7/d11/l8a 0 2023-12-05T09:57:18.314 INFO:tasks.workunit.client.0.smithi100.stdout:3/137: creat d0/d2/f23 x:0 0 0 2023-12-05T09:57:18.315 INFO:tasks.workunit.client.0.smithi100.stdout:3/138: fdatasync d0/f3 0 2023-12-05T09:57:18.315 INFO:tasks.workunit.client.0.smithi100.stdout:3/139: chown d0/d2/f23 15477200 1 2023-12-05T09:57:18.315 INFO:tasks.workunit.client.0.smithi100.stdout:3/140: readlink d0/l6 0 2023-12-05T09:57:18.315 INFO:tasks.workunit.client.0.smithi100.stdout:3/141: chown d0/d2/de/d12 45 1 2023-12-05T09:57:18.315 INFO:tasks.workunit.client.0.smithi100.stdout:3/142: dread - d0/d4/f1e zero size 2023-12-05T09:57:18.319 INFO:tasks.workunit.client.0.smithi100.stdout:3/143: rename d0/d4/c1b to d0/d2/de/d12/c24 0 2023-12-05T09:57:18.321 INFO:tasks.workunit.client.0.smithi100.stdout:3/144: truncate d0/d4/f17 4051740 0 2023-12-05T09:57:18.351 INFO:tasks.workunit.client.0.smithi100.stdout:6/410: dwrite d7/d11/d1a/f54 [0,4194304] 0 2023-12-05T09:57:18.354 INFO:tasks.workunit.client.0.smithi100.stdout:6/411: creat d7/d27/d35/f8b x:0 0 0 2023-12-05T09:57:18.375 INFO:tasks.workunit.client.0.smithi100.stdout:0/91: sync 2023-12-05T09:57:18.375 INFO:tasks.workunit.client.0.smithi100.stdout:8/38: sync 2023-12-05T09:57:18.376 INFO:tasks.workunit.client.0.smithi100.stdout:5/55: sync 2023-12-05T09:57:18.376 INFO:tasks.workunit.client.0.smithi100.stdout:2/165: sync 2023-12-05T09:57:18.376 INFO:tasks.workunit.client.0.smithi100.stdout:7/46: sync 2023-12-05T09:57:18.376 INFO:tasks.workunit.client.0.smithi100.stdout:2/166: read d7/da/d1a/f1c [2244162,14909] 0 2023-12-05T09:57:18.377 INFO:tasks.workunit.client.0.smithi100.stdout:5/56: mkdir d0/d4/d5/df 0 2023-12-05T09:57:18.378 INFO:tasks.workunit.client.0.smithi100.stdout:5/57: creat d0/d4/f10 x:0 0 0 2023-12-05T09:57:18.378 INFO:tasks.workunit.client.0.smithi100.stdout:5/58: rename d0/d4/d5 to d0/d4/d5/d11 22 2023-12-05T09:57:18.390 INFO:tasks.workunit.client.0.smithi100.stdout:2/167: dread d7/da/d18/d1b/f28 [0,4194304] 0 2023-12-05T09:57:18.391 INFO:tasks.workunit.client.0.smithi100.stdout:2/168: chown d7/da/d18/d1b/d2c 2088985 1 2023-12-05T09:57:18.408 INFO:tasks.workunit.client.0.smithi100.stdout:5/59: dread d0/d4/fa [0,4194304] 0 2023-12-05T09:57:18.409 INFO:tasks.workunit.client.0.smithi100.stdout:5/60: chown d0 1234 1 2023-12-05T09:57:18.409 INFO:tasks.workunit.client.0.smithi100.stdout:2/169: write d7/da/f17 [2135882,129112] 0 2023-12-05T09:57:18.409 INFO:tasks.workunit.client.0.smithi100.stdout:2/170: link d7/da/dc/c32 d7/da/d18/d1b/c3a 0 2023-12-05T09:57:18.411 INFO:tasks.workunit.client.0.smithi100.stdout:2/171: symlink d7/da/l3b 0 2023-12-05T09:57:18.413 INFO:tasks.workunit.client.0.smithi100.stdout:2/172: rename d7/da/dc/d19/c22 to d7/da/d18/d1b/d2c/c3c 0 2023-12-05T09:57:18.417 INFO:tasks.workunit.client.0.smithi100.stdout:2/173: write d7/da/d18/d21/f30 [971202,61783] 0 2023-12-05T09:57:18.418 INFO:tasks.workunit.client.0.smithi100.stdout:2/174: readlink d7/da/d18/d1b/d2c/l37 0 2023-12-05T09:57:18.420 INFO:tasks.workunit.client.0.smithi100.stdout:2/175: symlink d7/da/d18/d1b/d2c/l3d 0 2023-12-05T09:57:18.422 INFO:tasks.workunit.client.0.smithi100.stdout:2/176: stat d7/da/d13/l1d 0 2023-12-05T09:57:18.422 INFO:tasks.workunit.client.0.smithi100.stdout:2/177: write d7/da/d18/d21/f30 [488697,71508] 0 2023-12-05T09:57:18.422 INFO:tasks.workunit.client.0.smithi100.stdout:2/178: dread - d7/f34 zero size 2023-12-05T09:57:18.428 INFO:tasks.workunit.client.0.smithi100.stdout:2/179: symlink d7/da/d13/l3e 0 2023-12-05T09:57:18.428 INFO:tasks.workunit.client.0.smithi100.stdout:2/180: write d7/da/f17 [838803,47344] 0 2023-12-05T09:57:18.435 INFO:tasks.workunit.client.0.smithi100.stdout:7/47: dwrite d3/d4/fb [0,4194304] 0 2023-12-05T09:57:18.446 INFO:tasks.workunit.client.0.smithi100.stdout:7/48: mkdir d3/dc/d11 0 2023-12-05T09:57:18.462 INFO:tasks.workunit.client.0.smithi100.stdout:4/63: dwrite f9 [4194304,4194304] 0 2023-12-05T09:57:18.462 INFO:tasks.workunit.client.0.smithi100.stdout:4/64: readlink l4 0 2023-12-05T09:57:18.465 INFO:tasks.workunit.client.0.smithi100.stdout:4/65: symlink de/lf 0 2023-12-05T09:57:18.470 INFO:tasks.workunit.client.0.smithi100.stdout:8/39: dwrite d0/f3 [0,4194304] 0 2023-12-05T09:57:18.470 INFO:tasks.workunit.client.0.smithi100.stdout:8/40: fdatasync d0/f2 0 2023-12-05T09:57:18.476 INFO:tasks.workunit.client.0.smithi100.stdout:5/61: dwrite d0/d4/f10 [0,4194304] 0 2023-12-05T09:57:18.495 INFO:tasks.workunit.client.0.smithi100.stdout:0/92: dwrite da/fb [0,4194304] 0 2023-12-05T09:57:18.505 INFO:tasks.workunit.client.0.smithi100.stdout:5/62: dread d0/d4/f10 [0,4194304] 0 2023-12-05T09:57:18.509 INFO:tasks.workunit.client.0.smithi100.stdout:1/79: truncate db/d12/f13 3728287 0 2023-12-05T09:57:18.509 INFO:tasks.workunit.client.0.smithi100.stdout:5/63: creat d0/d4/d5/f12 x:0 0 0 2023-12-05T09:57:18.509 INFO:tasks.workunit.client.0.smithi100.stdout:5/64: write d0/f2 [1355741,87548] 0 2023-12-05T09:57:18.509 INFO:tasks.workunit.client.0.smithi100.stdout:5/65: creat d0/d4/d5/f13 x:0 0 0 2023-12-05T09:57:18.513 INFO:tasks.workunit.client.0.smithi100.stdout:5/66: mkdir d0/d4/d14 0 2023-12-05T09:57:18.517 INFO:tasks.workunit.client.0.smithi100.stdout:5/67: mknod d0/d4/d5/c15 0 2023-12-05T09:57:18.517 INFO:tasks.workunit.client.0.smithi100.stdout:5/68: stat d0/d4/f10 0 2023-12-05T09:57:18.519 INFO:tasks.workunit.client.0.smithi100.stdout:0/93: dread da/f17 [0,4194304] 0 2023-12-05T09:57:18.519 INFO:tasks.workunit.client.0.smithi100.stdout:7/49: dwrite d3/fd [0,4194304] 0 2023-12-05T09:57:18.519 INFO:tasks.workunit.client.0.smithi100.stdout:5/69: mkdir d0/d16 0 2023-12-05T09:57:18.519 INFO:tasks.workunit.client.0.smithi100.stdout:5/70: fsync d0/d4/fa 0 2023-12-05T09:57:18.523 INFO:tasks.workunit.client.0.smithi100.stdout:0/94: mknod da/d1b/c1f 0 2023-12-05T09:57:18.524 INFO:tasks.workunit.client.0.smithi100.stdout:8/41: dwrite d0/f2 [0,4194304] 0 2023-12-05T09:57:18.525 INFO:tasks.workunit.client.0.smithi100.stdout:7/50: creat d3/dc/f12 x:0 0 0 2023-12-05T09:57:18.526 INFO:tasks.workunit.client.0.smithi100.stdout:5/71: mknod d0/d16/c17 0 2023-12-05T09:57:18.527 INFO:tasks.workunit.client.0.smithi100.stdout:0/95: mknod da/d1b/c20 0 2023-12-05T09:57:18.527 INFO:tasks.workunit.client.0.smithi100.stdout:0/96: chown da/c13 0 1 2023-12-05T09:57:18.531 INFO:tasks.workunit.client.0.smithi100.stdout:1/80: dread f1 [0,4194304] 0 2023-12-05T09:57:18.536 INFO:tasks.workunit.client.0.smithi100.stdout:5/72: write d0/d4/fa [1314762,30519] 0 2023-12-05T09:57:18.536 INFO:tasks.workunit.client.0.smithi100.stdout:5/73: truncate d0/d4/d5/f13 996415 0 2023-12-05T09:57:18.537 INFO:tasks.workunit.client.0.smithi100.stdout:0/97: mknod da/d1b/c21 0 2023-12-05T09:57:18.537 INFO:tasks.workunit.client.0.smithi100.stdout:0/98: chown da/lf 534858512 1 2023-12-05T09:57:18.540 INFO:tasks.workunit.client.0.smithi100.stdout:8/42: getdents d0 0 2023-12-05T09:57:18.542 INFO:tasks.workunit.client.0.smithi100.stdout:5/74: creat d0/d4/d5/df/f18 x:0 0 0 2023-12-05T09:57:18.546 INFO:tasks.workunit.client.0.smithi100.stdout:5/75: mknod d0/c19 0 2023-12-05T09:57:18.548 INFO:tasks.workunit.client.0.smithi100.stdout:5/76: mknod d0/d4/c1a 0 2023-12-05T09:57:18.548 INFO:tasks.workunit.client.0.smithi100.stdout:5/77: dread - d0/d4/d5/df/f18 zero size 2023-12-05T09:57:18.548 INFO:tasks.workunit.client.0.smithi100.stdout:5/78: chown d0/d4/d5/f13 8 1 2023-12-05T09:57:18.552 INFO:tasks.workunit.client.0.smithi100.stdout:5/79: mkdir d0/d1b 0 2023-12-05T09:57:18.552 INFO:tasks.workunit.client.0.smithi100.stdout:0/99: read da/f17 [1950084,93359] 0 2023-12-05T09:57:18.555 INFO:tasks.workunit.client.0.smithi100.stdout:5/80: rename d0/d4/d5/c15 to d0/d1b/c1c 0 2023-12-05T09:57:18.555 INFO:tasks.workunit.client.0.smithi100.stdout:1/81: dread db/fc [0,4194304] 0 2023-12-05T09:57:18.562 INFO:tasks.workunit.client.0.smithi100.stdout:0/100: mkdir da/d22 0 2023-12-05T09:57:18.569 INFO:tasks.workunit.client.0.smithi100.stdout:0/101: unlink da/f17 0 2023-12-05T09:57:18.572 INFO:tasks.workunit.client.0.smithi100.stdout:0/102: creat da/d22/f23 x:0 0 0 2023-12-05T09:57:18.620 INFO:tasks.workunit.client.0.smithi100.stdout:5/81: dwrite d0/d4/d5/df/f18 [0,4194304] 0 2023-12-05T09:57:18.624 INFO:tasks.workunit.client.0.smithi100.stdout:5/82: creat d0/d16/f1d x:0 0 0 2023-12-05T09:57:18.625 INFO:tasks.workunit.client.0.smithi100.stdout:5/83: creat d0/d16/f1e x:0 0 0 2023-12-05T09:57:18.625 INFO:tasks.workunit.client.0.smithi100.stdout:5/84: fdatasync d0/d4/f10 0 2023-12-05T09:57:18.626 INFO:tasks.workunit.client.0.smithi100.stdout:5/85: mkdir d0/d1f 0 2023-12-05T09:57:18.627 INFO:tasks.workunit.client.0.smithi100.stdout:5/86: creat d0/d4/d5/df/f20 x:0 0 0 2023-12-05T09:57:18.629 INFO:tasks.workunit.client.0.smithi100.stdout:5/87: creat d0/d1f/f21 x:0 0 0 2023-12-05T09:57:18.630 INFO:tasks.workunit.client.0.smithi100.stdout:8/43: dwrite d0/f3 [0,4194304] 0 2023-12-05T09:57:18.630 INFO:tasks.workunit.client.0.smithi100.stdout:8/44: chown d0 0 1 2023-12-05T09:57:18.636 INFO:tasks.workunit.client.0.smithi100.stdout:5/88: link d0/d16/c17 d0/d4/d5/c22 0 2023-12-05T09:57:18.636 INFO:tasks.workunit.client.0.smithi100.stdout:5/89: stat d0/d4 0 2023-12-05T09:57:18.636 INFO:tasks.workunit.client.0.smithi100.stdout:5/90: stat d0/cc 0 2023-12-05T09:57:18.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:18 smithi100 ceph-mon[107145]: pgmap v25: 65 pgs: 65 active+clean; 475 MiB data, 3.3 GiB used, 533 GiB / 536 GiB avail; 15 MiB/s rd, 24 MiB/s wr, 623 op/s 2023-12-05T09:57:18.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:18 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:57:18.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:18 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:57:18.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:18 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:57:18.649 INFO:tasks.workunit.client.0.smithi100.stdout:8/45: write d0/f3 [3725618,35375] 0 2023-12-05T09:57:18.649 INFO:tasks.workunit.client.0.smithi100.stdout:8/46: fdatasync d0/f2 0 2023-12-05T09:57:18.650 INFO:tasks.workunit.client.0.smithi100.stdout:0/103: dwrite da/fb [0,4194304] 0 2023-12-05T09:57:18.651 INFO:tasks.workunit.client.1.smithi150.stdout:0/19: getdents d5 0 2023-12-05T09:57:18.653 INFO:tasks.workunit.client.1.smithi150.stdout:9/22: getdents . 0 2023-12-05T09:57:18.658 INFO:tasks.workunit.client.1.smithi150.stdout:9/23: dread f0 [0,4194304] 0 2023-12-05T09:57:18.659 INFO:tasks.workunit.client.1.smithi150.stdout:9/24: stat c2 0 2023-12-05T09:57:18.659 INFO:tasks.workunit.client.1.smithi150.stdout:9/25: chown c2 2446 1 2023-12-05T09:57:18.676 INFO:tasks.workunit.client.0.smithi100.stdout:8/47: mknod d0/c5 0 2023-12-05T09:57:18.680 INFO:tasks.workunit.client.1.smithi150.stdout:0/20: rename d5/l7 to d5/l8 0 2023-12-05T09:57:18.687 INFO:tasks.workunit.client.0.smithi100.stdout:0/104: mknod da/d22/c24 0 2023-12-05T09:57:18.687 INFO:tasks.workunit.client.1.smithi150.stdout:9/26: mkdir d3 0 2023-12-05T09:57:18.692 INFO:tasks.workunit.client.1.smithi150.stdout:9/27: dread f0 [0,4194304] 0 2023-12-05T09:57:18.698 INFO:tasks.workunit.client.0.smithi100.stdout:8/48: dread d0/f2 [0,4194304] 0 2023-12-05T09:57:18.721 INFO:tasks.workunit.client.0.smithi100.stdout:5/91: dwrite d0/d4/d5/df/f18 [0,4194304] 0 2023-12-05T09:57:18.721 INFO:tasks.workunit.client.0.smithi100.stdout:8/49: dread d0/f2 [0,4194304] 0 2023-12-05T09:57:18.735 INFO:tasks.workunit.client.1.smithi150.stdout:5/26: fsync d1/d3/d6/f8 0 2023-12-05T09:57:18.735 INFO:tasks.workunit.client.1.smithi150.stdout:5/27: creat d1/d3/ff x:0 0 0 2023-12-05T09:57:18.736 INFO:tasks.workunit.client.1.smithi150.stdout:9/28: dwrite f0 [0,4194304] 0 2023-12-05T09:57:18.738 INFO:tasks.workunit.client.1.smithi150.stdout:1/32: truncate f4 473122 0 2023-12-05T09:57:18.738 INFO:tasks.workunit.client.1.smithi150.stdout:1/33: stat f5 0 2023-12-05T09:57:18.739 INFO:tasks.workunit.client.1.smithi150.stdout:1/34: chown f4 1 1 2023-12-05T09:57:18.751 INFO:tasks.workunit.client.1.smithi150.stdout:9/29: read f0 [2989676,114854] 0 2023-12-05T09:57:18.752 INFO:tasks.workunit.client.1.smithi150.stdout:1/35: write f1 [377536,104216] 0 2023-12-05T09:57:18.752 INFO:tasks.workunit.client.1.smithi150.stdout:1/36: stat f4 0 2023-12-05T09:57:18.755 INFO:tasks.workunit.client.1.smithi150.stdout:1/37: unlink d6/f7 0 2023-12-05T09:57:18.756 INFO:tasks.workunit.client.1.smithi150.stdout:1/38: chown f5 13 1 2023-12-05T09:57:18.761 INFO:tasks.workunit.client.0.smithi100.stdout:5/92: dread d0/f3 [0,4194304] 0 2023-12-05T09:57:18.766 INFO:tasks.workunit.client.0.smithi100.stdout:5/93: truncate d0/d4/fd 8175487 0 2023-12-05T09:57:18.766 INFO:tasks.workunit.client.0.smithi100.stdout:5/94: read - d0/d4/d5/df/f20 zero size 2023-12-05T09:57:18.766 INFO:tasks.workunit.client.0.smithi100.stdout:0/105: dwrite da/fb [0,4194304] 0 2023-12-05T09:57:18.767 INFO:tasks.workunit.client.1.smithi150.stdout:1/39: rename f3 to d6/d8/f9 0 2023-12-05T09:57:18.767 INFO:tasks.workunit.client.1.smithi150.stdout:1/40: readlink - no filename 2023-12-05T09:57:18.768 INFO:tasks.workunit.client.1.smithi150.stdout:3/10: sync 2023-12-05T09:57:18.768 INFO:tasks.workunit.client.1.smithi150.stdout:4/10: sync 2023-12-05T09:57:18.771 INFO:tasks.workunit.client.0.smithi100.stdout:5/95: symlink d0/d16/l23 0 2023-12-05T09:57:18.771 INFO:tasks.workunit.client.0.smithi100.stdout:5/96: write d0/d1f/f21 [675470,102399] 0 2023-12-05T09:57:18.772 INFO:tasks.workunit.client.1.smithi150.stdout:2/4: sync 2023-12-05T09:57:18.773 INFO:tasks.workunit.client.1.smithi150.stdout:8/21: sync 2023-12-05T09:57:18.773 INFO:tasks.workunit.client.1.smithi150.stdout:2/5: dwrite - no filename 2023-12-05T09:57:18.773 INFO:tasks.workunit.client.0.smithi100.stdout:5/97: symlink d0/d1f/l24 0 2023-12-05T09:57:18.775 INFO:tasks.workunit.client.0.smithi100.stdout:6/412: rmdir d7/d27/d35 39 2023-12-05T09:57:18.775 INFO:tasks.workunit.client.0.smithi100.stdout:6/413: chown d7/d2d/f4a 1811507 1 2023-12-05T09:57:18.775 INFO:tasks.workunit.client.0.smithi100.stdout:6/414: readlink d7/d11/d82/l32 0 2023-12-05T09:57:18.775 INFO:tasks.workunit.client.1.smithi150.stdout:6/15: dwrite f0 [4194304,4194304] 0 2023-12-05T09:57:18.779 INFO:tasks.workunit.client.1.smithi150.stdout:1/41: symlink d6/d8/la 0 2023-12-05T09:57:18.779 INFO:tasks.workunit.client.1.smithi150.stdout:3/11: symlink l1 0 2023-12-05T09:57:18.779 INFO:tasks.workunit.client.1.smithi150.stdout:3/12: dread - no filename 2023-12-05T09:57:18.779 INFO:tasks.workunit.client.1.smithi150.stdout:3/13: truncate - no filename 2023-12-05T09:57:18.779 INFO:tasks.workunit.client.1.smithi150.stdout:3/14: stat l1 0 2023-12-05T09:57:18.779 INFO:tasks.workunit.client.1.smithi150.stdout:3/15: dread - no filename 2023-12-05T09:57:18.779 INFO:tasks.workunit.client.1.smithi150.stdout:3/16: dwrite - no filename 2023-12-05T09:57:18.782 INFO:tasks.workunit.client.1.smithi150.stdout:7/21: dwrite f1 [4194304,4194304] 0 2023-12-05T09:57:18.786 INFO:tasks.workunit.client.1.smithi150.stdout:2/6: rmdir d0/d1 0 2023-12-05T09:57:18.786 INFO:tasks.workunit.client.0.smithi100.stdout:5/98: mkdir d0/d1f/d25 0 2023-12-05T09:57:18.786 INFO:tasks.workunit.client.0.smithi100.stdout:5/99: creat d0/d4/d5/df/f26 x:0 0 0 2023-12-05T09:57:18.787 INFO:tasks.workunit.client.1.smithi150.stdout:8/22: rename d0/l3 to d0/l5 0 2023-12-05T09:57:18.788 INFO:tasks.workunit.client.0.smithi100.stdout:0/106: dread da/f11 [4194304,4194304] 0 2023-12-05T09:57:18.790 INFO:tasks.workunit.client.0.smithi100.stdout:2/181: rmdir d7/da/dc 39 2023-12-05T09:57:18.790 INFO:tasks.workunit.client.0.smithi100.stdout:2/182: read - d7/f34 zero size 2023-12-05T09:57:18.790 INFO:tasks.workunit.client.0.smithi100.stdout:2/183: chown d7/c16 1 1 2023-12-05T09:57:18.793 INFO:tasks.workunit.client.0.smithi100.stdout:0/107: symlink da/l25 0 2023-12-05T09:57:18.794 INFO:tasks.workunit.client.0.smithi100.stdout:6/415: dread d7/d27/f50 [0,4194304] 0 2023-12-05T09:57:18.795 INFO:tasks.workunit.client.1.smithi150.stdout:6/16: rename d2/c3 to d2/c4 0 2023-12-05T09:57:18.801 INFO:tasks.workunit.client.1.smithi150.stdout:9/30: dwrite f0 [0,4194304] 0 2023-12-05T09:57:18.801 INFO:tasks.workunit.client.1.smithi150.stdout:9/31: getdents d3 0 2023-12-05T09:57:18.803 INFO:tasks.workunit.client.1.smithi150.stdout:7/22: symlink d2/d4/l7 0 2023-12-05T09:57:18.803 INFO:tasks.workunit.client.1.smithi150.stdout:7/23: chown d2/d4/l7 2 1 2023-12-05T09:57:18.806 INFO:tasks.workunit.client.1.smithi150.stdout:2/7: mknod d0/c2 0 2023-12-05T09:57:18.806 INFO:tasks.workunit.client.1.smithi150.stdout:2/8: readlink - no filename 2023-12-05T09:57:18.806 INFO:tasks.workunit.client.1.smithi150.stdout:2/9: truncate - no filename 2023-12-05T09:57:18.806 INFO:tasks.workunit.client.1.smithi150.stdout:2/10: truncate - no filename 2023-12-05T09:57:18.806 INFO:tasks.workunit.client.1.smithi150.stdout:2/11: truncate - no filename 2023-12-05T09:57:18.806 INFO:tasks.workunit.client.1.smithi150.stdout:2/12: write - no filename 2023-12-05T09:57:18.807 INFO:tasks.workunit.client.1.smithi150.stdout:8/23: unlink d0/l4 0 2023-12-05T09:57:18.807 INFO:tasks.workunit.client.1.smithi150.stdout:8/24: write - no filename 2023-12-05T09:57:18.807 INFO:tasks.workunit.client.1.smithi150.stdout:8/25: write - no filename 2023-12-05T09:57:18.810 INFO:tasks.workunit.client.1.smithi150.stdout:5/28: dwrite d1/d3/f7 [0,4194304] 0 2023-12-05T09:57:18.810 INFO:tasks.workunit.client.1.smithi150.stdout:1/42: dwrite f5 [0,4194304] 0 2023-12-05T09:57:18.811 INFO:tasks.workunit.client.0.smithi100.stdout:5/100: dread d0/d4/d5/df/f18 [0,4194304] 0 2023-12-05T09:57:18.813 INFO:tasks.workunit.client.1.smithi150.stdout:6/17: dread f0 [0,4194304] 0 2023-12-05T09:57:18.816 INFO:tasks.workunit.client.0.smithi100.stdout:9/186: sync 2023-12-05T09:57:18.816 INFO:tasks.workunit.client.0.smithi100.stdout:9/187: truncate d7/fd 4383778 0 2023-12-05T09:57:18.820 INFO:tasks.workunit.client.1.smithi150.stdout:9/32: rename f0 to d3/f4 0 2023-12-05T09:57:18.820 INFO:tasks.workunit.client.1.smithi150.stdout:8/26: rename d0 to d0/d2/d6 22 2023-12-05T09:57:18.820 INFO:tasks.workunit.client.1.smithi150.stdout:8/27: write - no filename 2023-12-05T09:57:18.820 INFO:tasks.workunit.client.1.smithi150.stdout:8/28: dread - no filename 2023-12-05T09:57:18.821 INFO:tasks.workunit.client.1.smithi150.stdout:7/24: mkdir d2/d4/d8 0 2023-12-05T09:57:18.826 INFO:tasks.workunit.client.1.smithi150.stdout:2/13: mkdir d0/d3 0 2023-12-05T09:57:18.826 INFO:tasks.workunit.client.1.smithi150.stdout:2/14: chown d0/d3 7407349 1 2023-12-05T09:57:18.827 INFO:tasks.workunit.client.0.smithi100.stdout:6/416: creat d7/d76/f8c x:0 0 0 2023-12-05T09:57:18.827 INFO:tasks.workunit.client.0.smithi100.stdout:0/108: dwrite da/d22/f23 [0,4194304] 0 2023-12-05T09:57:18.827 INFO:tasks.workunit.client.0.smithi100.stdout:0/109: chown da/d22/c24 192574 1 2023-12-05T09:57:18.828 INFO:tasks.workunit.client.0.smithi100.stdout:5/101: mkdir d0/d27 0 2023-12-05T09:57:18.829 INFO:tasks.workunit.client.0.smithi100.stdout:5/102: dread - d0/d4/d5/f12 zero size 2023-12-05T09:57:18.832 INFO:tasks.workunit.client.0.smithi100.stdout:9/188: link d7/d10/c13 d7/d35/c3d 0 2023-12-05T09:57:18.835 INFO:tasks.workunit.client.1.smithi150.stdout:5/29: unlink d1/d3/fd 0 2023-12-05T09:57:18.835 INFO:tasks.workunit.client.1.smithi150.stdout:5/30: read - d1/d3/fb zero size 2023-12-05T09:57:18.836 INFO:tasks.workunit.client.0.smithi100.stdout:7/51: rmdir d3 39 2023-12-05T09:57:18.836 INFO:tasks.workunit.client.0.smithi100.stdout:7/52: chown d3/dc/f12 403628589 1 2023-12-05T09:57:18.838 INFO:tasks.workunit.client.1.smithi150.stdout:1/43: mkdir d6/d8/db 0 2023-12-05T09:57:18.838 INFO:tasks.workunit.client.1.smithi150.stdout:1/44: chown d6/d8/db 1826797 1 2023-12-05T09:57:18.840 INFO:tasks.workunit.client.1.smithi150.stdout:6/18: creat d2/f5 x:0 0 0 2023-12-05T09:57:18.840 INFO:tasks.workunit.client.1.smithi150.stdout:6/19: stat c1 0 2023-12-05T09:57:18.840 INFO:tasks.workunit.client.1.smithi150.stdout:6/20: truncate d2/f5 476641 0 2023-12-05T09:57:18.841 INFO:tasks.workunit.client.0.smithi100.stdout:8/50: truncate d0/f2 1726852 0 2023-12-05T09:57:18.841 INFO:tasks.workunit.client.0.smithi100.stdout:9/189: dread d7/f8 [0,4194304] 0 2023-12-05T09:57:18.844 INFO:tasks.workunit.client.1.smithi150.stdout:9/33: rmdir d3 39 2023-12-05T09:57:18.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:18 smithi150 ceph-mon[116142]: pgmap v25: 65 pgs: 65 active+clean; 475 MiB data, 3.3 GiB used, 533 GiB / 536 GiB avail; 15 MiB/s rd, 24 MiB/s wr, 623 op/s 2023-12-05T09:57:18.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:18 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:57:18.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:18 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:57:18.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:18 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:57:18.850 INFO:tasks.workunit.client.0.smithi100.stdout:2/184: rmdir d7 39 2023-12-05T09:57:18.851 INFO:tasks.workunit.client.1.smithi150.stdout:7/25: creat d2/d4/d8/f9 x:0 0 0 2023-12-05T09:57:18.851 INFO:tasks.workunit.client.1.smithi150.stdout:7/26: write d2/d4/d8/f9 [214485,23346] 0 2023-12-05T09:57:18.856 INFO:tasks.workunit.client.1.smithi150.stdout:2/15: symlink d0/d3/l4 0 2023-12-05T09:57:18.860 INFO:tasks.workunit.client.0.smithi100.stdout:7/53: dread d3/fd [0,4194304] 0 2023-12-05T09:57:18.861 INFO:tasks.workunit.client.1.smithi150.stdout:5/31: rename d1/d3/d6/fc to d1/d3/d6/f10 0 2023-12-05T09:57:18.861 INFO:tasks.workunit.client.1.smithi150.stdout:9/34: dread d3/f4 [0,4194304] 0 2023-12-05T09:57:18.862 INFO:tasks.workunit.client.0.smithi100.stdout:0/110: getdents da/d1b 0 2023-12-05T09:57:18.869 INFO:tasks.workunit.client.1.smithi150.stdout:2/16: mkdir d0/d3/d5 0 2023-12-05T09:57:18.870 INFO:tasks.workunit.client.1.smithi150.stdout:2/17: dwrite - no filename 2023-12-05T09:57:18.870 INFO:tasks.workunit.client.1.smithi150.stdout:2/18: dread - no filename 2023-12-05T09:57:18.870 INFO:tasks.workunit.client.1.smithi150.stdout:2/19: fsync - no filename 2023-12-05T09:57:18.870 INFO:tasks.workunit.client.1.smithi150.stdout:2/20: dwrite - no filename 2023-12-05T09:57:18.870 INFO:tasks.workunit.client.1.smithi150.stdout:2/21: dread - no filename 2023-12-05T09:57:18.870 INFO:tasks.workunit.client.1.smithi150.stdout:2/22: write - no filename 2023-12-05T09:57:18.871 INFO:tasks.workunit.client.1.smithi150.stdout:5/32: mkdir d1/d3/d6/d11 0 2023-12-05T09:57:18.871 INFO:tasks.workunit.client.0.smithi100.stdout:9/190: mkdir d7/d1b/d22/d3e 0 2023-12-05T09:57:18.871 INFO:tasks.workunit.client.0.smithi100.stdout:9/191: chown c6 27 1 2023-12-05T09:57:18.872 INFO:tasks.workunit.client.1.smithi150.stdout:9/35: dread d3/f4 [0,4194304] 0 2023-12-05T09:57:18.872 INFO:tasks.workunit.client.1.smithi150.stdout:7/27: write f1 [5899779,93188] 0 2023-12-05T09:57:18.873 INFO:tasks.workunit.client.0.smithi100.stdout:6/417: dwrite d7/f10 [0,4194304] 0 2023-12-05T09:57:18.875 INFO:tasks.workunit.client.0.smithi100.stdout:2/185: unlink d7/da/d1a/c23 0 2023-12-05T09:57:18.875 INFO:tasks.workunit.client.0.smithi100.stdout:2/186: fsync d7/da/dc/f12 0 2023-12-05T09:57:18.875 INFO:tasks.workunit.client.0.smithi100.stdout:2/187: readlink d7/da/d18/d1b/d2c/l37 0 2023-12-05T09:57:18.876 INFO:tasks.workunit.client.1.smithi150.stdout:0/21: getdents d5 0 2023-12-05T09:57:18.877 INFO:tasks.workunit.client.1.smithi150.stdout:2/23: symlink d0/d3/l6 0 2023-12-05T09:57:18.877 INFO:tasks.workunit.client.1.smithi150.stdout:2/24: write - no filename 2023-12-05T09:57:18.879 INFO:tasks.workunit.client.0.smithi100.stdout:7/54: truncate d3/fa 2191780 0 2023-12-05T09:57:18.880 INFO:tasks.workunit.client.0.smithi100.stdout:7/55: dread - d3/dc/f12 zero size 2023-12-05T09:57:18.880 INFO:tasks.workunit.client.1.smithi150.stdout:5/33: getdents d1 0 2023-12-05T09:57:18.883 INFO:tasks.workunit.client.1.smithi150.stdout:7/28: write f1 [3467055,83856] 0 2023-12-05T09:57:18.884 INFO:tasks.workunit.client.0.smithi100.stdout:0/111: creat da/d1b/f26 x:0 0 0 2023-12-05T09:57:18.884 INFO:tasks.workunit.client.1.smithi150.stdout:9/36: symlink d3/l5 0 2023-12-05T09:57:18.887 INFO:tasks.workunit.client.0.smithi100.stdout:5/103: unlink d0/d4/d5/df/f18 0 2023-12-05T09:57:18.888 INFO:tasks.workunit.client.0.smithi100.stdout:5/104: write d0/d4/d5/f12 [506224,131020] 0 2023-12-05T09:57:18.889 INFO:tasks.workunit.client.1.smithi150.stdout:0/22: mknod d5/c9 0 2023-12-05T09:57:18.891 INFO:tasks.workunit.client.0.smithi100.stdout:6/418: mkdir d7/d2d/d6a/d7c/d8d 0 2023-12-05T09:57:18.891 INFO:tasks.workunit.client.0.smithi100.stdout:6/419: chown d7/d27/l4d 6 1 2023-12-05T09:57:18.891 INFO:tasks.workunit.client.0.smithi100.stdout:6/420: truncate d7/d11/d1a/f52 1367892 0 2023-12-05T09:57:18.891 INFO:tasks.workunit.client.0.smithi100.stdout:6/421: read d7/d11/d82/f29 [822570,18691] 0 2023-12-05T09:57:18.892 INFO:tasks.workunit.client.1.smithi150.stdout:2/25: creat d0/f7 x:0 0 0 2023-12-05T09:57:18.892 INFO:tasks.workunit.client.1.smithi150.stdout:2/26: dread - d0/f7 zero size 2023-12-05T09:57:18.893 INFO:tasks.workunit.client.0.smithi100.stdout:7/56: dread d3/fd [0,4194304] 0 2023-12-05T09:57:18.893 INFO:tasks.workunit.client.1.smithi150.stdout:2/27: write d0/f7 [457800,110891] 0 2023-12-05T09:57:18.893 INFO:tasks.workunit.client.1.smithi150.stdout:2/28: creat d0/f8 x:0 0 0 2023-12-05T09:57:18.893 INFO:tasks.workunit.client.1.smithi150.stdout:9/37: dread d3/f4 [0,4194304] 0 2023-12-05T09:57:18.893 INFO:tasks.workunit.client.1.smithi150.stdout:2/29: write d0/f7 [775716,102376] 0 2023-12-05T09:57:18.894 INFO:tasks.workunit.client.1.smithi150.stdout:5/34: rename d1/la to d1/d3/d6/l12 0 2023-12-05T09:57:18.895 INFO:tasks.workunit.client.1.smithi150.stdout:5/35: chown d1/d3/ce 42232338 1 2023-12-05T09:57:18.896 INFO:tasks.workunit.client.0.smithi100.stdout:6/422: creat d7/d2d/d6a/d7c/d8d/f8e x:0 0 0 2023-12-05T09:57:18.896 INFO:tasks.workunit.client.0.smithi100.stdout:6/423: fsync d7/d11/d1a/f6b 0 2023-12-05T09:57:18.898 INFO:tasks.workunit.client.1.smithi150.stdout:7/29: mknod d2/d4/d8/ca 0 2023-12-05T09:57:18.898 INFO:tasks.workunit.client.1.smithi150.stdout:7/30: write f1 [13991,113149] 0 2023-12-05T09:57:18.899 INFO:tasks.workunit.client.1.smithi150.stdout:0/23: creat d5/fa x:0 0 0 2023-12-05T09:57:18.905 INFO:tasks.workunit.client.0.smithi100.stdout:6/424: creat d7/d11/f8f x:0 0 0 2023-12-05T09:57:18.905 INFO:tasks.workunit.client.0.smithi100.stdout:6/425: chown d7/d11/c26 1 1 2023-12-05T09:57:18.905 INFO:tasks.workunit.client.0.smithi100.stdout:6/426: chown d7/d11/d1a/c81 55449 1 2023-12-05T09:57:18.905 INFO:tasks.workunit.client.0.smithi100.stdout:6/427: creat d7/d76/f90 x:0 0 0 2023-12-05T09:57:18.905 INFO:tasks.workunit.client.0.smithi100.stdout:0/112: dread da/fb [0,4194304] 0 2023-12-05T09:57:18.905 INFO:tasks.workunit.client.0.smithi100.stdout:5/105: dread d0/d4/d5/f12 [0,4194304] 0 2023-12-05T09:57:18.905 INFO:tasks.workunit.client.0.smithi100.stdout:5/106: chown d0/d16/l23 2 1 2023-12-05T09:57:18.906 INFO:tasks.workunit.client.1.smithi150.stdout:9/38: creat d3/f6 x:0 0 0 2023-12-05T09:57:18.906 INFO:tasks.workunit.client.1.smithi150.stdout:9/39: readlink d3/l5 0 2023-12-05T09:57:18.906 INFO:tasks.workunit.client.1.smithi150.stdout:2/30: mknod d0/d3/c9 0 2023-12-05T09:57:18.906 INFO:tasks.workunit.client.1.smithi150.stdout:2/31: readlink d0/d3/l6 0 2023-12-05T09:57:18.908 INFO:tasks.workunit.client.1.smithi150.stdout:5/36: link l0 d1/l13 0 2023-12-05T09:57:18.914 INFO:tasks.workunit.client.1.smithi150.stdout:1/45: truncate f4 1493374 0 2023-12-05T09:57:18.914 INFO:tasks.workunit.client.0.smithi100.stdout:7/57: write d3/fd [3930110,48275] 0 2023-12-05T09:57:18.918 INFO:tasks.workunit.client.1.smithi150.stdout:2/32: rename d0/f8 to d0/fa 0 2023-12-05T09:57:18.918 INFO:tasks.workunit.client.0.smithi100.stdout:6/428: symlink d7/d2d/d6a/d7c/d8d/l91 0 2023-12-05T09:57:18.918 INFO:tasks.workunit.client.0.smithi100.stdout:6/429: chown d7/d2d/l5f 10499987 1 2023-12-05T09:57:18.918 INFO:tasks.workunit.client.0.smithi100.stdout:6/430: stat d7/d27/l2a 0 2023-12-05T09:57:18.918 INFO:tasks.workunit.client.0.smithi100.stdout:6/431: chown d7/d11/f12 13 1 2023-12-05T09:57:18.918 INFO:tasks.workunit.client.0.smithi100.stdout:6/432: readlink d7/d11/l69 0 2023-12-05T09:57:18.919 INFO:tasks.workunit.client.0.smithi100.stdout:5/107: creat d0/d27/f28 x:0 0 0 2023-12-05T09:57:18.919 INFO:tasks.workunit.client.0.smithi100.stdout:5/108: chown d0/c19 725490 1 2023-12-05T09:57:18.919 INFO:tasks.workunit.client.0.smithi100.stdout:5/109: chown d0/d4/ce 86195627 1 2023-12-05T09:57:18.919 INFO:tasks.workunit.client.0.smithi100.stdout:5/110: chown d0/d1f/d25 39 1 2023-12-05T09:57:18.922 INFO:tasks.workunit.client.1.smithi150.stdout:2/33: mknod d0/cb 0 2023-12-05T09:57:18.922 INFO:tasks.workunit.client.1.smithi150.stdout:2/34: read d0/f7 [819157,90011] 0 2023-12-05T09:57:18.925 INFO:tasks.workunit.client.0.smithi100.stdout:7/58: rename d3/d4 to d3/dc/d11/d13 0 2023-12-05T09:57:18.929 INFO:tasks.workunit.client.0.smithi100.stdout:6/433: link d7/d11/d1a/c81 d7/d2d/c92 0 2023-12-05T09:57:18.929 INFO:tasks.workunit.client.0.smithi100.stdout:6/434: creat d7/d76/f93 x:0 0 0 2023-12-05T09:57:18.931 INFO:tasks.workunit.client.1.smithi150.stdout:5/37: write d1/d3/f7 [861277,89571] 0 2023-12-05T09:57:18.932 INFO:tasks.workunit.client.0.smithi100.stdout:5/111: unlink d0/d4/ce 0 2023-12-05T09:57:18.932 INFO:tasks.workunit.client.0.smithi100.stdout:5/112: creat d0/d27/f29 x:0 0 0 2023-12-05T09:57:18.932 INFO:tasks.workunit.client.0.smithi100.stdout:5/113: dread - d0/d16/f1d zero size 2023-12-05T09:57:18.934 INFO:tasks.workunit.client.1.smithi150.stdout:3/17: getdents . 0 2023-12-05T09:57:18.934 INFO:tasks.workunit.client.1.smithi150.stdout:3/18: write - no filename 2023-12-05T09:57:18.936 INFO:tasks.workunit.client.0.smithi100.stdout:7/59: creat d3/dc/f14 x:0 0 0 2023-12-05T09:57:18.937 INFO:tasks.workunit.client.1.smithi150.stdout:7/31: dwrite d2/d4/d8/f9 [0,4194304] 0 2023-12-05T09:57:18.937 INFO:tasks.workunit.client.1.smithi150.stdout:7/32: chown d2/d4 13643 1 2023-12-05T09:57:18.939 INFO:tasks.workunit.client.1.smithi150.stdout:5/38: unlink d1/d3/ff 0 2023-12-05T09:57:18.941 INFO:tasks.workunit.client.0.smithi100.stdout:2/188: dwrite d7/da/dc/d19/f2a [0,4194304] 0 2023-12-05T09:57:18.944 INFO:tasks.workunit.client.1.smithi150.stdout:8/29: rename d0/l5 to d0/l7 0 2023-12-05T09:57:18.944 INFO:tasks.workunit.client.1.smithi150.stdout:8/30: chown d0/l7 918710 1 2023-12-05T09:57:18.945 INFO:tasks.workunit.client.1.smithi150.stdout:3/19: mknod c2 0 2023-12-05T09:57:18.945 INFO:tasks.workunit.client.1.smithi150.stdout:3/20: chown l1 2122887734 1 2023-12-05T09:57:18.946 INFO:tasks.workunit.client.0.smithi100.stdout:6/435: mknod d7/d2d/c94 0 2023-12-05T09:57:18.949 INFO:tasks.workunit.client.1.smithi150.stdout:7/33: unlink f1 0 2023-12-05T09:57:18.954 INFO:tasks.workunit.client.1.smithi150.stdout:8/31: rename d0/d2 to d0/d8 0 2023-12-05T09:57:18.954 INFO:tasks.workunit.client.1.smithi150.stdout:8/32: getdents d0/d8 0 2023-12-05T09:57:18.954 INFO:tasks.workunit.client.1.smithi150.stdout:8/33: write - no filename 2023-12-05T09:57:18.954 INFO:tasks.workunit.client.1.smithi150.stdout:8/34: dread - no filename 2023-12-05T09:57:18.954 INFO:tasks.workunit.client.1.smithi150.stdout:8/35: write - no filename 2023-12-05T09:57:18.954 INFO:tasks.workunit.client.1.smithi150.stdout:8/36: write - no filename 2023-12-05T09:57:18.955 INFO:tasks.workunit.client.0.smithi100.stdout:0/113: dwrite da/d22/f23 [0,4194304] 0 2023-12-05T09:57:18.961 INFO:tasks.workunit.client.1.smithi150.stdout:3/21: rename l1 to l3 0 2023-12-05T09:57:18.961 INFO:tasks.workunit.client.1.smithi150.stdout:3/22: fdatasync - no filename 2023-12-05T09:57:18.962 INFO:tasks.workunit.client.1.smithi150.stdout:7/34: write d2/d4/d8/f9 [106996,61233] 0 2023-12-05T09:57:18.963 INFO:tasks.workunit.client.1.smithi150.stdout:8/37: mknod d0/d8/c9 0 2023-12-05T09:57:18.964 INFO:tasks.workunit.client.1.smithi150.stdout:8/38: fdatasync - no filename 2023-12-05T09:57:18.965 INFO:tasks.workunit.client.1.smithi150.stdout:9/40: fsync d3/f4 0 2023-12-05T09:57:18.967 INFO:tasks.workunit.client.0.smithi100.stdout:6/436: unlink d7/d11/l79 0 2023-12-05T09:57:18.969 INFO:tasks.workunit.client.1.smithi150.stdout:3/23: mknod c4 0 2023-12-05T09:57:18.969 INFO:tasks.workunit.client.1.smithi150.stdout:8/39: mknod d0/d8/ca 0 2023-12-05T09:57:18.969 INFO:tasks.workunit.client.1.smithi150.stdout:8/40: readlink d0/l7 0 2023-12-05T09:57:18.971 INFO:tasks.workunit.client.1.smithi150.stdout:9/41: mknod d3/c7 0 2023-12-05T09:57:18.973 INFO:tasks.workunit.client.0.smithi100.stdout:3/145: truncate d0/d4/f17 2781545 0 2023-12-05T09:57:18.974 INFO:tasks.workunit.client.1.smithi150.stdout:3/24: mknod c5 0 2023-12-05T09:57:18.974 INFO:tasks.workunit.client.1.smithi150.stdout:3/25: write - no filename 2023-12-05T09:57:18.976 INFO:tasks.workunit.client.1.smithi150.stdout:2/35: dwrite d0/fa [0,4194304] 0 2023-12-05T09:57:18.977 INFO:tasks.workunit.client.0.smithi100.stdout:2/189: mkdir d7/da/d18/d1b/d2c/d3f 0 2023-12-05T09:57:18.978 INFO:tasks.workunit.client.0.smithi100.stdout:2/190: truncate d7/da/d1a/f38 4877344 0 2023-12-05T09:57:18.978 INFO:tasks.workunit.client.1.smithi150.stdout:8/41: symlink d0/d8/lb 0 2023-12-05T09:57:18.980 INFO:tasks.workunit.client.0.smithi100.stdout:6/437: creat d7/d2d/d6a/f95 x:0 0 0 2023-12-05T09:57:18.980 INFO:tasks.workunit.client.0.smithi100.stdout:6/438: dread - d7/d2d/d6a/f95 zero size 2023-12-05T09:57:18.981 INFO:tasks.workunit.client.1.smithi150.stdout:3/26: mkdir d6 0 2023-12-05T09:57:18.981 INFO:tasks.workunit.client.1.smithi150.stdout:3/27: chown c4 148 1 2023-12-05T09:57:18.982 INFO:tasks.workunit.client.1.smithi150.stdout:6/21: rmdir d2 39 2023-12-05T09:57:18.984 INFO:tasks.workunit.client.0.smithi100.stdout:8/51: truncate d0/f2 1762356 0 2023-12-05T09:57:18.991 INFO:tasks.workunit.client.1.smithi150.stdout:8/42: creat d0/fc x:0 0 0 2023-12-05T09:57:18.993 INFO:tasks.workunit.client.1.smithi150.stdout:3/28: link c5 d6/c7 0 2023-12-05T09:57:18.993 INFO:tasks.workunit.client.1.smithi150.stdout:3/29: chown c4 264916345 1 2023-12-05T09:57:18.995 INFO:tasks.workunit.client.1.smithi150.stdout:6/22: rename d2/f5 to d2/f6 0 2023-12-05T09:57:19.003 INFO:tasks.workunit.client.0.smithi100.stdout:5/114: dwrite d0/d4/d5/df/f20 [0,4194304] 0 2023-12-05T09:57:19.003 INFO:tasks.workunit.client.0.smithi100.stdout:5/115: stat d0/cc 0 2023-12-05T09:57:19.003 INFO:tasks.workunit.client.0.smithi100.stdout:5/116: stat d0/d4/d14 0 2023-12-05T09:57:19.005 INFO:tasks.workunit.client.1.smithi150.stdout:3/30: mknod d6/c8 0 2023-12-05T09:57:19.009 INFO:tasks.workunit.client.1.smithi150.stdout:6/23: link d2/c4 d2/c7 0 2023-12-05T09:57:19.012 INFO:tasks.workunit.client.1.smithi150.stdout:3/31: mkdir d6/d9 0 2023-12-05T09:57:19.015 INFO:tasks.workunit.client.1.smithi150.stdout:6/24: symlink d2/l8 0 2023-12-05T09:57:19.017 INFO:tasks.workunit.client.0.smithi100.stdout:7/60: rename d3/fa to d3/dc/d11/d13/f15 0 2023-12-05T09:57:19.021 INFO:tasks.workunit.client.1.smithi150.stdout:3/32: symlink d6/d9/la 0 2023-12-05T09:57:19.021 INFO:tasks.workunit.client.1.smithi150.stdout:3/33: fdatasync - no filename 2023-12-05T09:57:19.021 INFO:tasks.workunit.client.1.smithi150.stdout:3/34: truncate - no filename 2023-12-05T09:57:19.023 INFO:tasks.workunit.client.1.smithi150.stdout:9/42: dwrite d3/f4 [0,4194304] 0 2023-12-05T09:57:19.023 INFO:tasks.workunit.client.1.smithi150.stdout:9/43: write d3/f6 [651207,128302] 0 2023-12-05T09:57:19.024 INFO:tasks.workunit.client.1.smithi150.stdout:6/25: creat d2/f9 x:0 0 0 2023-12-05T09:57:19.028 INFO:tasks.workunit.client.0.smithi100.stdout:7/61: rename d3/l9 to d3/dc/l16 0 2023-12-05T09:57:19.028 INFO:tasks.workunit.client.0.smithi100.stdout:7/62: write d3/dc/f14 [744638,116596] 0 2023-12-05T09:57:19.029 INFO:tasks.workunit.client.1.smithi150.stdout:7/35: dwrite d2/d4/d8/f9 [0,4194304] 0 2023-12-05T09:57:19.031 INFO:tasks.workunit.client.1.smithi150.stdout:3/35: link c4 d6/cb 0 2023-12-05T09:57:19.031 INFO:tasks.workunit.client.1.smithi150.stdout:3/36: stat d6/d9 0 2023-12-05T09:57:19.031 INFO:tasks.workunit.client.1.smithi150.stdout:3/37: dwrite - no filename 2023-12-05T09:57:19.031 INFO:tasks.workunit.client.1.smithi150.stdout:3/38: readlink l3 0 2023-12-05T09:57:19.032 INFO:tasks.workunit.client.1.smithi150.stdout:0/24: fsync d5/fa 0 2023-12-05T09:57:19.032 INFO:tasks.workunit.client.1.smithi150.stdout:0/25: truncate d5/fa 319295 0 2023-12-05T09:57:19.032 INFO:tasks.workunit.client.0.smithi100.stdout:0/114: rename da/d1b to da/d1b/d27 22 2023-12-05T09:57:19.033 INFO:tasks.workunit.client.0.smithi100.stdout:8/52: rename d0 to d0/d6 22 2023-12-05T09:57:19.036 INFO:tasks.workunit.client.1.smithi150.stdout:7/36: mkdir d2/db 0 2023-12-05T09:57:19.038 INFO:tasks.workunit.client.0.smithi100.stdout:0/115: symlink da/l28 0 2023-12-05T09:57:19.039 INFO:tasks.workunit.client.0.smithi100.stdout:0/116: stat da/d1b 0 2023-12-05T09:57:19.043 INFO:tasks.workunit.client.1.smithi150.stdout:1/46: dread f4 [0,4194304] 0 2023-12-05T09:57:19.043 INFO:tasks.workunit.client.1.smithi150.stdout:1/47: chown f1 109043 1 2023-12-05T09:57:19.043 INFO:tasks.workunit.client.1.smithi150.stdout:2/36: unlink d0/fa 0 2023-12-05T09:57:19.048 INFO:tasks.workunit.client.1.smithi150.stdout:3/39: rename d6/cb to d6/cc 0 2023-12-05T09:57:19.054 INFO:tasks.workunit.client.1.smithi150.stdout:0/26: symlink d5/lb 0 2023-12-05T09:57:19.055 INFO:tasks.workunit.client.0.smithi100.stdout:8/53: dread d0/f3 [0,4194304] 0 2023-12-05T09:57:19.056 INFO:tasks.workunit.client.1.smithi150.stdout:8/43: dwrite d0/fc [0,4194304] 0 2023-12-05T09:57:19.057 INFO:tasks.workunit.client.0.smithi100.stdout:0/117: rename da/l28 to da/d22/l29 0 2023-12-05T09:57:19.059 INFO:tasks.workunit.client.0.smithi100.stdout:2/191: dwrite d7/da/d18/d1b/f28 [0,4194304] 0 2023-12-05T09:57:19.059 INFO:tasks.workunit.client.0.smithi100.stdout:2/192: read d7/da/d1a/f1c [3609851,41946] 0 2023-12-05T09:57:19.061 INFO:tasks.workunit.client.0.smithi100.stdout:5/117: dwrite d0/d1f/f21 [0,4194304] 0 2023-12-05T09:57:19.063 INFO:tasks.workunit.client.0.smithi100.stdout:1/82: truncate db/d12/f13 2431413 0 2023-12-05T09:57:19.064 INFO:tasks.workunit.client.0.smithi100.stdout:1/83: truncate f9 617598 0 2023-12-05T09:57:19.065 INFO:tasks.workunit.client.1.smithi150.stdout:1/48: link f5 d6/d8/fc 0 2023-12-05T09:57:19.068 INFO:tasks.workunit.client.0.smithi100.stdout:0/118: readlink da/d1b/l1c 0 2023-12-05T09:57:19.068 INFO:tasks.workunit.client.1.smithi150.stdout:3/40: rmdir d6 39 2023-12-05T09:57:19.069 INFO:tasks.workunit.client.1.smithi150.stdout:3/41: fsync - no filename 2023-12-05T09:57:19.069 INFO:tasks.workunit.client.1.smithi150.stdout:3/42: fdatasync - no filename 2023-12-05T09:57:19.069 INFO:tasks.workunit.client.1.smithi150.stdout:3/43: write - no filename 2023-12-05T09:57:19.069 INFO:tasks.workunit.client.1.smithi150.stdout:3/44: write - no filename 2023-12-05T09:57:19.069 INFO:tasks.workunit.client.1.smithi150.stdout:3/45: read - no filename 2023-12-05T09:57:19.069 INFO:tasks.workunit.client.0.smithi100.stdout:2/193: creat d7/da/d18/d21/f40 x:0 0 0 2023-12-05T09:57:19.070 INFO:tasks.workunit.client.0.smithi100.stdout:7/63: fsync d3/dc/f14 0 2023-12-05T09:57:19.085 INFO:tasks.workunit.client.0.smithi100.stdout:5/118: link d0/d4/c9 d0/d27/c2a 0 2023-12-05T09:57:19.085 INFO:tasks.workunit.client.1.smithi150.stdout:6/26: dwrite d2/f9 [0,4194304] 0 2023-12-05T09:57:19.085 INFO:tasks.workunit.client.1.smithi150.stdout:6/27: chown d2/f9 1003 1 2023-12-05T09:57:19.086 INFO:tasks.workunit.client.0.smithi100.stdout:6/439: truncate d7/d11/d1a/f52 538988 0 2023-12-05T09:57:19.086 INFO:tasks.workunit.client.0.smithi100.stdout:6/440: truncate d7/f89 672495 0 2023-12-05T09:57:19.091 INFO:tasks.workunit.client.0.smithi100.stdout:6/441: write d7/d27/f3b [51183,55640] 0 2023-12-05T09:57:19.094 INFO:tasks.workunit.client.0.smithi100.stdout:1/84: creat db/f19 x:0 0 0 2023-12-05T09:57:19.094 INFO:tasks.workunit.client.0.smithi100.stdout:1/85: stat db/ff 0 2023-12-05T09:57:19.095 INFO:tasks.workunit.client.1.smithi150.stdout:2/37: dwrite d0/f7 [0,4194304] 0 2023-12-05T09:57:19.104 INFO:tasks.workunit.client.0.smithi100.stdout:7/64: mknod d3/dc/d11/d13/de/c17 0 2023-12-05T09:57:19.105 INFO:tasks.workunit.client.0.smithi100.stdout:5/119: mkdir d0/d16/d2b 0 2023-12-05T09:57:19.107 INFO:tasks.workunit.client.1.smithi150.stdout:1/49: dwrite d6/d8/f9 [0,4194304] 0 2023-12-05T09:57:19.108 INFO:tasks.workunit.client.1.smithi150.stdout:1/50: write f1 [1099409,13289] 0 2023-12-05T09:57:19.112 INFO:tasks.workunit.client.1.smithi150.stdout:0/27: dwrite d5/fa [0,4194304] 0 2023-12-05T09:57:19.112 INFO:tasks.workunit.client.0.smithi100.stdout:1/86: rename db/f10 to db/f1a 0 2023-12-05T09:57:19.112 INFO:tasks.workunit.client.0.smithi100.stdout:1/87: chown c2 101 1 2023-12-05T09:57:19.116 INFO:tasks.workunit.client.0.smithi100.stdout:2/194: mkdir d7/da/d18/d1b/d2c/d41 0 2023-12-05T09:57:19.122 INFO:tasks.workunit.client.1.smithi150.stdout:2/38: dread d0/f7 [0,4194304] 0 2023-12-05T09:57:19.122 INFO:tasks.workunit.client.1.smithi150.stdout:2/39: chown d0/d3/c9 596 1 2023-12-05T09:57:19.125 INFO:tasks.workunit.client.1.smithi150.stdout:1/51: dread f5 [0,4194304] 0 2023-12-05T09:57:19.125 INFO:tasks.workunit.client.1.smithi150.stdout:1/52: write d6/d8/fc [4453900,95589] 0 2023-12-05T09:57:19.127 INFO:tasks.workunit.client.0.smithi100.stdout:0/119: dwrite da/d1b/f26 [0,4194304] 0 2023-12-05T09:57:19.127 INFO:tasks.workunit.client.0.smithi100.stdout:0/120: chown da/l25 126258272 1 2023-12-05T09:57:19.127 INFO:tasks.workunit.client.0.smithi100.stdout:0/121: chown da/l25 5540027 1 2023-12-05T09:57:19.127 INFO:tasks.workunit.client.0.smithi100.stdout:0/122: chown da/cc 3065 1 2023-12-05T09:57:19.130 INFO:tasks.workunit.client.1.smithi150.stdout:0/28: dread d5/fa [0,4194304] 0 2023-12-05T09:57:19.131 INFO:tasks.workunit.client.0.smithi100.stdout:1/88: symlink db/l1b 0 2023-12-05T09:57:19.131 INFO:tasks.workunit.client.0.smithi100.stdout:1/89: fdatasync db/d12/f13 0 2023-12-05T09:57:19.135 INFO:tasks.workunit.client.1.smithi150.stdout:8/44: rmdir d0 39 2023-12-05T09:57:19.136 INFO:tasks.workunit.client.1.smithi150.stdout:8/45: fdatasync d0/fc 0 2023-12-05T09:57:19.136 INFO:tasks.workunit.client.0.smithi100.stdout:2/195: mknod d7/da/c42 0 2023-12-05T09:57:19.142 INFO:tasks.workunit.client.1.smithi150.stdout:6/28: mkdir d2/da 0 2023-12-05T09:57:19.144 INFO:tasks.workunit.client.1.smithi150.stdout:2/40: write d0/f7 [1557879,67362] 0 2023-12-05T09:57:19.149 INFO:tasks.workunit.client.0.smithi100.stdout:2/196: creat d7/f43 x:0 0 0 2023-12-05T09:57:19.149 INFO:tasks.workunit.client.0.smithi100.stdout:2/197: chown d7/da/d18/d21/f40 1345 1 2023-12-05T09:57:19.149 INFO:tasks.workunit.client.0.smithi100.stdout:2/198: write d7/f43 [1028618,63515] 0 2023-12-05T09:57:19.158 INFO:tasks.workunit.client.0.smithi100.stdout:6/442: dwrite d7/d27/f50 [0,4194304] 0 2023-12-05T09:57:19.169 INFO:tasks.workunit.client.0.smithi100.stdout:3/146: dwrite d0/d4/f17 [0,4194304] 0 2023-12-05T09:57:19.170 INFO:tasks.workunit.client.0.smithi100.stdout:1/90: write db/d12/f16 [3211296,89075] 0 2023-12-05T09:57:19.171 INFO:tasks.workunit.client.0.smithi100.stdout:1/91: write db/f19 [143491,25497] 0 2023-12-05T09:57:19.171 INFO:tasks.workunit.client.0.smithi100.stdout:1/92: stat db/d12/f13 0 2023-12-05T09:57:19.172 INFO:tasks.workunit.client.1.smithi150.stdout:3/46: getdents d6/d9 0 2023-12-05T09:57:19.179 INFO:tasks.workunit.client.1.smithi150.stdout:7/37: rmdir d2 39 2023-12-05T09:57:19.179 INFO:tasks.workunit.client.1.smithi150.stdout:7/38: stat d2/d4/d8/ca 0 2023-12-05T09:57:19.179 INFO:tasks.workunit.client.1.smithi150.stdout:7/39: fdatasync d2/d4/d8/f9 0 2023-12-05T09:57:19.183 INFO:tasks.workunit.client.1.smithi150.stdout:1/53: symlink d6/ld 0 2023-12-05T09:57:19.184 INFO:tasks.workunit.client.1.smithi150.stdout:9/44: truncate d3/f4 2939820 0 2023-12-05T09:57:19.185 INFO:tasks.workunit.client.0.smithi100.stdout:1/93: mknod db/d12/c1c 0 2023-12-05T09:57:19.188 INFO:tasks.workunit.client.1.smithi150.stdout:6/29: creat d2/da/fb x:0 0 0 2023-12-05T09:57:19.197 INFO:tasks.workunit.client.0.smithi100.stdout:8/54: dwrite d0/f2 [0,4194304] 0 2023-12-05T09:57:19.204 INFO:tasks.workunit.client.0.smithi100.stdout:7/65: dwrite d3/dc/f14 [0,4194304] 0 2023-12-05T09:57:19.208 INFO:tasks.workunit.client.0.smithi100.stdout:5/120: dwrite d0/f2 [0,4194304] 0 2023-12-05T09:57:19.217 INFO:tasks.workunit.client.0.smithi100.stdout:5/121: dread d0/d4/d5/f13 [0,4194304] 0 2023-12-05T09:57:19.238 INFO:tasks.workunit.client.0.smithi100.stdout:0/123: dwrite f1 [0,4194304] 0 2023-12-05T09:57:19.238 INFO:tasks.workunit.client.0.smithi100.stdout:0/124: truncate f1 5594862 0 2023-12-05T09:57:19.239 INFO:tasks.workunit.client.0.smithi100.stdout:5/122: dread d0/f3 [0,4194304] 0 2023-12-05T09:57:19.240 INFO:tasks.workunit.client.0.smithi100.stdout:5/123: chown d0/d27/f28 4773795 1 2023-12-05T09:57:19.250 INFO:tasks.workunit.client.0.smithi100.stdout:6/443: dwrite d7/d2d/f40 [4194304,4194304] 0 2023-12-05T09:57:19.250 INFO:tasks.workunit.client.0.smithi100.stdout:6/444: stat d7/d11/d1a/f54 0 2023-12-05T09:57:19.251 INFO:tasks.workunit.client.0.smithi100.stdout:2/199: dwrite d7/da/d18/d1b/f28 [0,4194304] 0 2023-12-05T09:57:19.252 INFO:tasks.workunit.client.1.smithi150.stdout:9/45: dwrite d3/f6 [0,4194304] 0 2023-12-05T09:57:19.254 INFO:tasks.workunit.client.0.smithi100.stdout:3/147: dwrite d0/d2/f23 [0,4194304] 0 2023-12-05T09:57:19.278 INFO:tasks.workunit.client.1.smithi150.stdout:2/41: symlink d0/lc 0 2023-12-05T09:57:19.278 INFO:tasks.workunit.client.1.smithi150.stdout:3/47: stat d6/cc 0 2023-12-05T09:57:19.278 INFO:tasks.workunit.client.1.smithi150.stdout:7/40: creat d2/d4/fc x:0 0 0 2023-12-05T09:57:19.282 INFO:tasks.workunit.client.0.smithi100.stdout:8/55: mknod d0/c7 0 2023-12-05T09:57:19.283 INFO:tasks.workunit.client.0.smithi100.stdout:8/56: stat d0/f3 0 2023-12-05T09:57:19.288 INFO:tasks.workunit.client.1.smithi150.stdout:0/29: getdents d5 0 2023-12-05T09:57:19.289 INFO:tasks.workunit.client.1.smithi150.stdout:0/30: readlink d5/lb 0 2023-12-05T09:57:19.289 INFO:tasks.workunit.client.1.smithi150.stdout:0/31: fsync d5/fa 0 2023-12-05T09:57:19.292 INFO:tasks.workunit.client.1.smithi150.stdout:6/30: unlink d2/f6 0 2023-12-05T09:57:19.293 INFO:tasks.workunit.client.0.smithi100.stdout:7/66: mkdir d3/dc/d11/d13/de/d18 0 2023-12-05T09:57:19.298 INFO:tasks.workunit.client.1.smithi150.stdout:0/32: write d5/fa [2292590,124600] 0 2023-12-05T09:57:19.298 INFO:tasks.workunit.client.1.smithi150.stdout:0/33: write d5/fa [2953077,115323] 0 2023-12-05T09:57:19.298 INFO:tasks.workunit.client.1.smithi150.stdout:0/34: write d5/fa [2575446,121703] 0 2023-12-05T09:57:19.298 INFO:tasks.workunit.client.0.smithi100.stdout:1/94: dwrite db/f1a [0,4194304] 0 2023-12-05T09:57:19.308 INFO:tasks.workunit.client.0.smithi100.stdout:5/124: dwrite d0/d27/f28 [0,4194304] 0 2023-12-05T09:57:19.308 INFO:tasks.workunit.client.0.smithi100.stdout:5/125: chown d0/d27 46401 1 2023-12-05T09:57:19.309 INFO:tasks.workunit.client.0.smithi100.stdout:5/126: write d0/d4/d5/f13 [1421775,36206] 0 2023-12-05T09:57:19.311 INFO:tasks.workunit.client.0.smithi100.stdout:2/200: dwrite d7/da/d1a/f1c [4194304,4194304] 0 2023-12-05T09:57:19.311 INFO:tasks.workunit.client.0.smithi100.stdout:2/201: fdatasync d7/da/f17 0 2023-12-05T09:57:19.311 INFO:tasks.workunit.client.0.smithi100.stdout:2/202: creat d7/da/d18/d21/f44 x:0 0 0 2023-12-05T09:57:19.314 INFO:tasks.workunit.client.0.smithi100.stdout:4/66: sync 2023-12-05T09:57:19.314 INFO:tasks.workunit.client.0.smithi100.stdout:9/192: sync 2023-12-05T09:57:19.320 INFO:tasks.workunit.client.1.smithi150.stdout:3/48: mkdir d6/d9/dd 0 2023-12-05T09:57:19.320 INFO:tasks.workunit.client.1.smithi150.stdout:3/49: chown d6/cc 2785 1 2023-12-05T09:57:19.321 INFO:tasks.workunit.client.1.smithi150.stdout:3/50: fdatasync - no filename 2023-12-05T09:57:19.321 INFO:tasks.workunit.client.1.smithi150.stdout:3/51: chown d6/d9/dd 7221 1 2023-12-05T09:57:19.321 INFO:tasks.workunit.client.1.smithi150.stdout:3/52: fsync - no filename 2023-12-05T09:57:19.323 INFO:tasks.workunit.client.0.smithi100.stdout:1/95: dread f1 [0,4194304] 0 2023-12-05T09:57:19.327 INFO:tasks.workunit.client.1.smithi150.stdout:6/31: mknod d2/da/cc 0 2023-12-05T09:57:19.327 INFO:tasks.workunit.client.0.smithi100.stdout:3/148: dwrite d0/d4/f20 [0,4194304] 0 2023-12-05T09:57:19.334 INFO:tasks.workunit.client.1.smithi150.stdout:0/35: write d5/fa [4836547,128442] 0 2023-12-05T09:57:19.335 INFO:tasks.workunit.client.1.smithi150.stdout:0/36: readlink l3 0 2023-12-05T09:57:19.342 INFO:tasks.workunit.client.1.smithi150.stdout:3/53: symlink d6/d9/dd/le 0 2023-12-05T09:57:19.346 INFO:tasks.workunit.client.1.smithi150.stdout:6/32: mknod d2/da/cd 0 2023-12-05T09:57:19.346 INFO:tasks.workunit.client.1.smithi150.stdout:6/33: chown d2/da/cd 227787119 1 2023-12-05T09:57:19.348 INFO:tasks.workunit.client.1.smithi150.stdout:1/54: truncate f5 789331 0 2023-12-05T09:57:19.351 INFO:tasks.workunit.client.1.smithi150.stdout:4/11: sync 2023-12-05T09:57:19.352 INFO:tasks.workunit.client.1.smithi150.stdout:5/39: sync 2023-12-05T09:57:19.357 INFO:tasks.workunit.client.1.smithi150.stdout:0/37: creat d5/fc x:0 0 0 2023-12-05T09:57:19.357 INFO:tasks.workunit.client.1.smithi150.stdout:0/38: creat d5/fd x:0 0 0 2023-12-05T09:57:19.357 INFO:tasks.workunit.client.1.smithi150.stdout:0/39: write d5/fc [576106,125282] 0 2023-12-05T09:57:19.358 INFO:tasks.workunit.client.1.smithi150.stdout:2/42: dwrite d0/f7 [4194304,4194304] 0 2023-12-05T09:57:19.359 INFO:tasks.workunit.client.1.smithi150.stdout:3/54: unlink c4 0 2023-12-05T09:57:19.371 INFO:tasks.workunit.client.0.smithi100.stdout:6/445: creat d7/d27/d35/d5a/f96 x:0 0 0 2023-12-05T09:57:19.371 INFO:tasks.workunit.client.0.smithi100.stdout:9/193: dwrite d7/d1b/f33 [0,4194304] 0 2023-12-05T09:57:19.374 INFO:tasks.workunit.client.1.smithi150.stdout:6/34: rename f0 to d2/da/fe 0 2023-12-05T09:57:19.374 INFO:tasks.workunit.client.1.smithi150.stdout:6/35: creat d2/ff x:0 0 0 2023-12-05T09:57:19.381 INFO:tasks.workunit.client.1.smithi150.stdout:1/55: rmdir d6/d8 39 2023-12-05T09:57:19.381 INFO:tasks.workunit.client.1.smithi150.stdout:4/12: link d0/c2 d0/c3 0 2023-12-05T09:57:19.381 INFO:tasks.workunit.client.1.smithi150.stdout:4/13: chown d0/f1 26 1 2023-12-05T09:57:19.381 INFO:tasks.workunit.client.1.smithi150.stdout:4/14: dread - d0/f1 zero size 2023-12-05T09:57:19.382 INFO:tasks.workunit.client.0.smithi100.stdout:7/67: creat d3/dc/d11/d13/de/f19 x:0 0 0 2023-12-05T09:57:19.388 INFO:tasks.workunit.client.0.smithi100.stdout:5/127: write d0/d4/d5/df/f20 [1358764,62769] 0 2023-12-05T09:57:19.389 INFO:tasks.workunit.client.0.smithi100.stdout:8/57: dwrite d0/f3 [4194304,4194304] 0 2023-12-05T09:57:19.395 INFO:tasks.workunit.client.1.smithi150.stdout:2/43: mknod d0/d3/cd 0 2023-12-05T09:57:19.395 INFO:tasks.workunit.client.1.smithi150.stdout:2/44: fdatasync d0/f7 0 2023-12-05T09:57:19.407 INFO:tasks.workunit.client.1.smithi150.stdout:3/55: stat d6/c7 0 2023-12-05T09:57:19.407 INFO:tasks.workunit.client.1.smithi150.stdout:3/56: dwrite - no filename 2023-12-05T09:57:19.418 INFO:tasks.workunit.client.0.smithi100.stdout:4/67: creat de/f10 x:0 0 0 2023-12-05T09:57:19.418 INFO:tasks.workunit.client.0.smithi100.stdout:4/68: creat de/f11 x:0 0 0 2023-12-05T09:57:19.422 INFO:tasks.workunit.client.1.smithi150.stdout:1/56: mkdir d6/d8/db/de 0 2023-12-05T09:57:19.424 INFO:tasks.workunit.client.1.smithi150.stdout:4/15: unlink d0/c3 0 2023-12-05T09:57:19.425 INFO:tasks.workunit.client.0.smithi100.stdout:1/96: link db/f19 db/d12/f1d 0 2023-12-05T09:57:19.426 INFO:tasks.workunit.client.1.smithi150.stdout:9/46: dwrite d3/f4 [0,4194304] 0 2023-12-05T09:57:19.438 INFO:tasks.workunit.client.0.smithi100.stdout:9/194: dwrite d7/d20/f3c [0,4194304] 0 2023-12-05T09:57:19.445 INFO:tasks.workunit.client.0.smithi100.stdout:9/195: write d7/d10/f28 [841907,92064] 0 2023-12-05T09:57:19.446 INFO:tasks.workunit.client.0.smithi100.stdout:9/196: chown d7/d20/f2c 1134 1 2023-12-05T09:57:19.446 INFO:tasks.workunit.client.0.smithi100.stdout:9/197: write d7/d1b/d22/f38 [2960090,58151] 0 2023-12-05T09:57:19.446 INFO:tasks.workunit.client.0.smithi100.stdout:2/203: dwrite d7/da/dc/d19/f26 [0,4194304] 0 2023-12-05T09:57:19.446 INFO:tasks.workunit.client.0.smithi100.stdout:2/204: fsync d7/f34 0 2023-12-05T09:57:19.447 INFO:tasks.workunit.client.1.smithi150.stdout:3/57: creat d6/ff x:0 0 0 2023-12-05T09:57:19.447 INFO:tasks.workunit.client.1.smithi150.stdout:6/36: dwrite d2/ff [0,4194304] 0 2023-12-05T09:57:19.452 INFO:tasks.workunit.client.0.smithi100.stdout:8/58: dwrite d0/f3 [4194304,4194304] 0 2023-12-05T09:57:19.454 INFO:tasks.workunit.client.0.smithi100.stdout:3/149: rename d0/d2/de/d12/c24 to d0/d4/c25 0 2023-12-05T09:57:19.454 INFO:tasks.workunit.client.0.smithi100.stdout:3/150: readlink d0/d10/l1d 0 2023-12-05T09:57:19.458 INFO:tasks.workunit.client.0.smithi100.stdout:0/125: getdents da/d1b 0 2023-12-05T09:57:19.464 INFO:tasks.workunit.client.1.smithi150.stdout:4/16: rename d0/c2 to d0/c4 0 2023-12-05T09:57:19.464 INFO:tasks.workunit.client.1.smithi150.stdout:1/57: creat d6/d8/db/de/ff x:0 0 0 2023-12-05T09:57:19.464 INFO:tasks.workunit.client.1.smithi150.stdout:9/47: dwrite d3/f4 [0,4194304] 0 2023-12-05T09:57:19.464 INFO:tasks.workunit.client.1.smithi150.stdout:1/58: write d6/d8/db/de/ff [799225,106371] 0 2023-12-05T09:57:19.464 INFO:tasks.workunit.client.1.smithi150.stdout:4/17: write d0/f1 [456468,67486] 0 2023-12-05T09:57:19.464 INFO:tasks.workunit.client.1.smithi150.stdout:4/18: stat d0/f1 0 2023-12-05T09:57:19.466 INFO:tasks.workunit.client.0.smithi100.stdout:6/446: mkdir d7/d27/d97 0 2023-12-05T09:57:19.467 INFO:tasks.workunit.client.0.smithi100.stdout:6/447: dread - d7/f59 zero size 2023-12-05T09:57:19.472 INFO:tasks.workunit.client.1.smithi150.stdout:6/37: rename d2/da/fb to d2/da/f10 0 2023-12-05T09:57:19.474 INFO:tasks.workunit.client.0.smithi100.stdout:6/448: dread d7/d27/d72/f87 [0,4194304] 0 2023-12-05T09:57:19.475 INFO:tasks.workunit.client.1.smithi150.stdout:4/19: mknod d0/c5 0 2023-12-05T09:57:19.478 INFO:tasks.workunit.client.0.smithi100.stdout:1/97: dwrite db/d12/f1d [0,4194304] 0 2023-12-05T09:57:19.479 INFO:tasks.workunit.client.0.smithi100.stdout:9/198: mknod d7/d10/d32/c3f 0 2023-12-05T09:57:19.481 INFO:tasks.workunit.client.0.smithi100.stdout:8/59: dread d0/f2 [0,4194304] 0 2023-12-05T09:57:19.484 INFO:tasks.workunit.client.1.smithi150.stdout:1/59: symlink d6/d8/l10 0 2023-12-05T09:57:19.494 INFO:tasks.workunit.client.0.smithi100.stdout:2/205: creat d7/da/d1a/f45 x:0 0 0 2023-12-05T09:57:19.503 INFO:tasks.workunit.client.1.smithi150.stdout:5/40: mknod d1/c14 0 2023-12-05T09:57:19.506 INFO:tasks.workunit.client.1.smithi150.stdout:4/20: dread d0/f1 [0,4194304] 0 2023-12-05T09:57:19.508 INFO:tasks.workunit.client.0.smithi100.stdout:9/199: creat d7/d1b/d22/d2a/f40 x:0 0 0 2023-12-05T09:57:19.509 INFO:tasks.workunit.client.1.smithi150.stdout:5/41: mkdir d1/d15 0 2023-12-05T09:57:19.510 INFO:tasks.workunit.client.0.smithi100.stdout:8/60: dread d0/f2 [0,4194304] 0 2023-12-05T09:57:19.525 INFO:tasks.workunit.client.1.smithi150.stdout:6/38: dwrite d2/da/fe [0,4194304] 0 2023-12-05T09:57:19.526 INFO:tasks.workunit.client.1.smithi150.stdout:9/48: dwrite d3/f4 [0,4194304] 0 2023-12-05T09:57:19.527 INFO:tasks.workunit.client.0.smithi100.stdout:9/200: read d7/d20/f3c [2561972,37359] 0 2023-12-05T09:57:19.530 INFO:tasks.workunit.client.1.smithi150.stdout:9/49: symlink d3/l8 0 2023-12-05T09:57:19.531 INFO:tasks.workunit.client.0.smithi100.stdout:8/61: read d0/f2 [3425185,104527] 0 2023-12-05T09:57:19.538 INFO:tasks.workunit.client.0.smithi100.stdout:8/62: creat d0/f8 x:0 0 0 2023-12-05T09:57:19.539 INFO:tasks.workunit.client.0.smithi100.stdout:8/63: creat d0/f9 x:0 0 0 2023-12-05T09:57:19.539 INFO:tasks.workunit.client.1.smithi150.stdout:7/41: rmdir d2/d4 39 2023-12-05T09:57:19.545 INFO:tasks.workunit.client.1.smithi150.stdout:6/39: write d2/da/fe [5196057,4448] 0 2023-12-05T09:57:19.545 INFO:tasks.workunit.client.1.smithi150.stdout:7/42: unlink d2/d4/c6 0 2023-12-05T09:57:19.546 INFO:tasks.workunit.client.1.smithi150.stdout:9/50: write d3/f6 [121410,88905] 0 2023-12-05T09:57:19.549 INFO:tasks.workunit.client.1.smithi150.stdout:5/42: dwrite d1/d3/f7 [4194304,4194304] 0 2023-12-05T09:57:19.553 INFO:tasks.workunit.client.1.smithi150.stdout:6/40: unlink d2/l8 0 2023-12-05T09:57:19.553 INFO:tasks.workunit.client.1.smithi150.stdout:9/51: mkdir d3/d9 0 2023-12-05T09:57:19.553 INFO:tasks.workunit.client.1.smithi150.stdout:7/43: symlink d2/d4/d8/ld 0 2023-12-05T09:57:19.553 INFO:tasks.workunit.client.1.smithi150.stdout:6/41: write d2/da/f10 [656314,6448] 0 2023-12-05T09:57:19.553 INFO:tasks.workunit.client.1.smithi150.stdout:6/42: chown d2/f9 3190 1 2023-12-05T09:57:19.557 INFO:tasks.workunit.client.1.smithi150.stdout:7/44: symlink d2/le 0 2023-12-05T09:57:19.559 INFO:tasks.workunit.client.1.smithi150.stdout:6/43: rename d2/c7 to d2/da/c11 0 2023-12-05T09:57:19.564 INFO:tasks.workunit.client.1.smithi150.stdout:5/43: dread d1/d3/f7 [0,4194304] 0 2023-12-05T09:57:19.578 INFO:tasks.workunit.client.1.smithi150.stdout:6/44: write d2/ff [2352688,70416] 0 2023-12-05T09:57:19.587 INFO:tasks.workunit.client.1.smithi150.stdout:8/46: sync 2023-12-05T09:57:19.588 INFO:tasks.workunit.client.0.smithi100.stdout:0/126: mkdir da/d2a 0 2023-12-05T09:57:19.589 INFO:tasks.workunit.client.1.smithi150.stdout:7/45: dwrite d2/d4/fc [0,4194304] 0 2023-12-05T09:57:19.594 INFO:tasks.workunit.client.1.smithi150.stdout:8/47: truncate d0/fc 1723847 0 2023-12-05T09:57:19.594 INFO:tasks.workunit.client.1.smithi150.stdout:1/60: write d6/d8/fc [325842,635] 0 2023-12-05T09:57:19.601 INFO:tasks.workunit.client.1.smithi150.stdout:8/48: mknod d0/d8/cd 0 2023-12-05T09:57:19.603 INFO:tasks.workunit.client.1.smithi150.stdout:7/46: write d2/d4/d8/f9 [1027847,72306] 0 2023-12-05T09:57:19.603 INFO:tasks.workunit.client.1.smithi150.stdout:1/61: creat d6/d8/f11 x:0 0 0 2023-12-05T09:57:19.607 INFO:tasks.workunit.client.1.smithi150.stdout:5/44: dwrite d1/d3/f7 [0,4194304] 0 2023-12-05T09:57:19.609 INFO:tasks.workunit.client.0.smithi100.stdout:0/127: write f1 [1943478,21748] 0 2023-12-05T09:57:19.610 INFO:tasks.workunit.client.1.smithi150.stdout:1/62: creat d6/d8/db/f12 x:0 0 0 2023-12-05T09:57:19.610 INFO:tasks.workunit.client.1.smithi150.stdout:1/63: dread - d6/d8/db/f12 zero size 2023-12-05T09:57:19.613 INFO:tasks.workunit.client.1.smithi150.stdout:5/45: creat d1/d15/f16 x:0 0 0 2023-12-05T09:57:19.613 INFO:tasks.workunit.client.1.smithi150.stdout:5/46: dread - d1/d15/f16 zero size 2023-12-05T09:57:19.613 INFO:tasks.workunit.client.1.smithi150.stdout:5/47: dread - d1/d3/d6/f10 zero size 2023-12-05T09:57:19.614 INFO:tasks.workunit.client.1.smithi150.stdout:1/64: truncate f4 649888 0 2023-12-05T09:57:19.618 INFO:tasks.workunit.client.1.smithi150.stdout:1/65: unlink d6/d8/la 0 2023-12-05T09:57:19.625 INFO:tasks.workunit.client.1.smithi150.stdout:1/66: dread f1 [0,4194304] 0 2023-12-05T09:57:19.625 INFO:tasks.workunit.client.1.smithi150.stdout:1/67: creat d6/d8/db/de/f13 x:0 0 0 2023-12-05T09:57:19.630 INFO:tasks.workunit.client.1.smithi150.stdout:3/58: fsync d6/ff 0 2023-12-05T09:57:19.636 INFO:tasks.workunit.client.1.smithi150.stdout:3/59: link d6/c8 d6/d9/c10 0 2023-12-05T09:57:19.636 INFO:tasks.workunit.client.1.smithi150.stdout:3/60: chown d6/c7 14422 1 2023-12-05T09:57:19.638 INFO:tasks.workunit.client.1.smithi150.stdout:3/61: write d6/ff [150278,33290] 0 2023-12-05T09:57:19.640 INFO:tasks.workunit.client.1.smithi150.stdout:6/45: write d2/ff [4650396,75711] 0 2023-12-05T09:57:19.640 INFO:tasks.workunit.client.1.smithi150.stdout:6/46: chown d2/c4 17648 1 2023-12-05T09:57:19.640 INFO:tasks.workunit.client.1.smithi150.stdout:6/47: write d2/ff [305583,15176] 0 2023-12-05T09:57:19.641 INFO:tasks.workunit.client.1.smithi150.stdout:6/48: symlink d2/l12 0 2023-12-05T09:57:19.641 INFO:tasks.workunit.client.1.smithi150.stdout:6/49: readlink d2/l12 0 2023-12-05T09:57:19.641 INFO:tasks.workunit.client.1.smithi150.stdout:6/50: write d2/ff [2632377,3874] 0 2023-12-05T09:57:19.642 INFO:tasks.workunit.client.1.smithi150.stdout:6/51: chown d2/da/f10 153 1 2023-12-05T09:57:19.642 INFO:tasks.workunit.client.1.smithi150.stdout:6/52: creat d2/f13 x:0 0 0 2023-12-05T09:57:19.642 INFO:tasks.workunit.client.0.smithi100.stdout:4/69: getdents de 0 2023-12-05T09:57:19.642 INFO:tasks.workunit.client.0.smithi100.stdout:4/70: chown f1 8 1 2023-12-05T09:57:19.642 INFO:tasks.workunit.client.0.smithi100.stdout:4/71: chown fb 54 1 2023-12-05T09:57:19.643 INFO:tasks.workunit.client.0.smithi100.stdout:4/72: truncate f6 1077045 0 2023-12-05T09:57:19.649 INFO:tasks.workunit.client.1.smithi150.stdout:4/21: truncate d0/f1 320636 0 2023-12-05T09:57:19.650 INFO:tasks.workunit.client.1.smithi150.stdout:3/62: dread d6/ff [0,4194304] 0 2023-12-05T09:57:19.650 INFO:tasks.workunit.client.1.smithi150.stdout:4/22: getdents d0 0 2023-12-05T09:57:19.655 INFO:tasks.workunit.client.1.smithi150.stdout:3/63: link d6/d9/dd/le d6/d9/dd/l11 0 2023-12-05T09:57:19.655 INFO:tasks.workunit.client.1.smithi150.stdout:3/64: truncate d6/ff 414977 0 2023-12-05T09:57:19.655 INFO:tasks.workunit.client.1.smithi150.stdout:3/65: fsync d6/ff 0 2023-12-05T09:57:19.656 INFO:tasks.workunit.client.1.smithi150.stdout:1/68: dread f5 [0,4194304] 0 2023-12-05T09:57:19.656 INFO:tasks.workunit.client.1.smithi150.stdout:1/69: stat d6/d8/db/de/ff 0 2023-12-05T09:57:19.656 INFO:tasks.workunit.client.1.smithi150.stdout:1/70: fsync d6/d8/db/de/ff 0 2023-12-05T09:57:19.656 INFO:tasks.workunit.client.1.smithi150.stdout:1/71: creat d6/d8/db/de/f14 x:0 0 0 2023-12-05T09:57:19.656 INFO:tasks.workunit.client.1.smithi150.stdout:1/72: truncate d6/d8/db/f12 918069 0 2023-12-05T09:57:19.657 INFO:tasks.workunit.client.1.smithi150.stdout:3/66: creat d6/d9/dd/f12 x:0 0 0 2023-12-05T09:57:19.657 INFO:tasks.workunit.client.1.smithi150.stdout:3/67: creat d6/d9/dd/f13 x:0 0 0 2023-12-05T09:57:19.657 INFO:tasks.workunit.client.1.smithi150.stdout:3/68: rename d6/d9 to d6/d9/dd/d14 22 2023-12-05T09:57:19.657 INFO:tasks.workunit.client.1.smithi150.stdout:3/69: creat d6/d9/dd/f15 x:0 0 0 2023-12-05T09:57:19.658 INFO:tasks.workunit.client.1.smithi150.stdout:0/40: sync 2023-12-05T09:57:19.658 INFO:tasks.workunit.client.1.smithi150.stdout:2/45: sync 2023-12-05T09:57:19.659 INFO:tasks.workunit.client.1.smithi150.stdout:7/47: dwrite d2/d4/d8/f9 [0,4194304] 0 2023-12-05T09:57:19.660 INFO:tasks.workunit.client.1.smithi150.stdout:1/73: symlink d6/d8/l15 0 2023-12-05T09:57:19.661 INFO:tasks.workunit.client.0.smithi100.stdout:8/64: rmdir d0 39 2023-12-05T09:57:19.662 INFO:tasks.workunit.client.1.smithi150.stdout:3/70: dread d6/ff [0,4194304] 0 2023-12-05T09:57:19.663 INFO:tasks.workunit.client.1.smithi150.stdout:0/41: stat l3 0 2023-12-05T09:57:19.664 INFO:tasks.workunit.client.1.smithi150.stdout:0/42: dread - d5/fd zero size 2023-12-05T09:57:19.665 INFO:tasks.workunit.client.1.smithi150.stdout:2/46: creat d0/d3/fe x:0 0 0 2023-12-05T09:57:19.665 INFO:tasks.workunit.client.1.smithi150.stdout:2/47: write d0/d3/fe [263658,113220] 0 2023-12-05T09:57:19.665 INFO:tasks.workunit.client.1.smithi150.stdout:2/48: write d0/d3/fe [546648,33939] 0 2023-12-05T09:57:19.666 INFO:tasks.workunit.client.1.smithi150.stdout:2/49: chown d0/d3/cd 7 1 2023-12-05T09:57:19.666 INFO:tasks.workunit.client.1.smithi150.stdout:0/43: write d5/fa [4464729,33390] 0 2023-12-05T09:57:19.668 INFO:tasks.workunit.client.0.smithi100.stdout:5/128: rmdir d0/d27 39 2023-12-05T09:57:19.670 INFO:tasks.workunit.client.1.smithi150.stdout:6/53: getdents d2/da 0 2023-12-05T09:57:19.673 INFO:tasks.workunit.client.0.smithi100.stdout:6/449: creat d7/d11/f98 x:0 0 0 2023-12-05T09:57:19.673 INFO:tasks.workunit.client.0.smithi100.stdout:6/450: readlink d7/d2d/d6a/d7c/d8d/l91 0 2023-12-05T09:57:19.673 INFO:tasks.workunit.client.0.smithi100.stdout:6/451: chown d7/f17 550416934 1 2023-12-05T09:57:19.673 INFO:tasks.workunit.client.0.smithi100.stdout:6/452: write d7/d27/d35/f39 [1642076,107556] 0 2023-12-05T09:57:19.675 INFO:tasks.workunit.client.1.smithi150.stdout:2/50: rename d0/d3/l6 to d0/d3/d5/lf 0 2023-12-05T09:57:19.678 INFO:tasks.workunit.client.0.smithi100.stdout:7/68: rename d3/f5 to d3/dc/d11/d13/f1a 0 2023-12-05T09:57:19.678 INFO:tasks.workunit.client.0.smithi100.stdout:7/69: stat d3/dc 0 2023-12-05T09:57:19.680 INFO:tasks.workunit.client.1.smithi150.stdout:6/54: link d2/l12 d2/da/l14 0 2023-12-05T09:57:19.686 INFO:tasks.workunit.client.0.smithi100.stdout:2/206: rename d7/da/dc/d19 to d7/da/d18/d1b/d2c/d3f/d46 0 2023-12-05T09:57:19.689 INFO:tasks.workunit.client.0.smithi100.stdout:7/70: dread d3/dc/d11/d13/f1a [0,4194304] 0 2023-12-05T09:57:19.690 INFO:tasks.workunit.client.1.smithi150.stdout:2/51: mkdir d0/d3/d5/d10 0 2023-12-05T09:57:19.690 INFO:tasks.workunit.client.1.smithi150.stdout:0/44: getdents d5 0 2023-12-05T09:57:19.692 INFO:tasks.workunit.client.0.smithi100.stdout:4/73: rename fb to de/f12 0 2023-12-05T09:57:19.693 INFO:tasks.workunit.client.1.smithi150.stdout:6/55: chown d2/da/cd 17317263 1 2023-12-05T09:57:19.695 INFO:tasks.workunit.client.0.smithi100.stdout:7/71: truncate d3/fd 4187929 0 2023-12-05T09:57:19.700 INFO:tasks.workunit.client.0.smithi100.stdout:3/151: mknod d0/d2/c26 0 2023-12-05T09:57:19.700 INFO:tasks.workunit.client.1.smithi150.stdout:2/52: mkdir d0/d3/d11 0 2023-12-05T09:57:19.702 INFO:tasks.workunit.client.1.smithi150.stdout:2/53: write d0/d3/fe [852770,113183] 0 2023-12-05T09:57:19.705 INFO:tasks.workunit.client.1.smithi150.stdout:0/45: mknod d5/ce 0 2023-12-05T09:57:19.705 INFO:tasks.workunit.client.0.smithi100.stdout:9/201: symlink d7/l41 0 2023-12-05T09:57:19.705 INFO:tasks.workunit.client.0.smithi100.stdout:7/72: mkdir d3/dc/d11/d13/d1b 0 2023-12-05T09:57:19.707 INFO:tasks.workunit.client.1.smithi150.stdout:6/56: symlink d2/l15 0 2023-12-05T09:57:19.708 INFO:tasks.workunit.client.0.smithi100.stdout:5/129: mknod d0/d4/c2c 0 2023-12-05T09:57:19.708 INFO:tasks.workunit.client.0.smithi100.stdout:5/130: rename d0/d4/d14 to d0/d4/d14/d2d 22 2023-12-05T09:57:19.708 INFO:tasks.workunit.client.0.smithi100.stdout:9/202: creat d7/d10/d32/f42 x:0 0 0 2023-12-05T09:57:19.708 INFO:tasks.workunit.client.0.smithi100.stdout:9/203: truncate d7/d1b/d22/f31 553713 0 2023-12-05T09:57:19.708 INFO:tasks.workunit.client.0.smithi100.stdout:9/204: readlink d7/d1b/d22/d25/l34 0 2023-12-05T09:57:19.708 INFO:tasks.workunit.client.0.smithi100.stdout:9/205: dread - d7/d20/f3a zero size 2023-12-05T09:57:19.714 INFO:tasks.workunit.client.0.smithi100.stdout:7/73: mknod d3/c1c 0 2023-12-05T09:57:19.714 INFO:tasks.workunit.client.1.smithi150.stdout:0/46: creat d5/ff x:0 0 0 2023-12-05T09:57:19.714 INFO:tasks.workunit.client.1.smithi150.stdout:0/47: creat d5/f10 x:0 0 0 2023-12-05T09:57:19.716 INFO:tasks.workunit.client.0.smithi100.stdout:6/453: read d7/d11/f51 [2971277,115374] 0 2023-12-05T09:57:19.716 INFO:tasks.workunit.client.0.smithi100.stdout:6/454: write d7/d27/d35/f8b [538103,1328] 0 2023-12-05T09:57:19.716 INFO:tasks.workunit.client.0.smithi100.stdout:6/455: creat d7/d11/f99 x:0 0 0 2023-12-05T09:57:19.718 INFO:tasks.workunit.client.0.smithi100.stdout:0/128: getdents da 0 2023-12-05T09:57:19.719 INFO:tasks.workunit.client.0.smithi100.stdout:9/206: dread d7/d1b/d22/f31 [0,4194304] 0 2023-12-05T09:57:19.723 INFO:tasks.workunit.client.0.smithi100.stdout:9/207: rename d7/d1b/d22 to d7/d1b/d22/d25/d2e/d43 22 2023-12-05T09:57:19.723 INFO:tasks.workunit.client.0.smithi100.stdout:5/131: link d0/d4/d5/df/f20 d0/d1f/f2e 0 2023-12-05T09:57:19.724 INFO:tasks.workunit.client.1.smithi150.stdout:7/48: dwrite d2/d4/fc [0,4194304] 0 2023-12-05T09:57:19.726 INFO:tasks.workunit.client.0.smithi100.stdout:3/152: dread d0/d4/f17 [0,4194304] 0 2023-12-05T09:57:19.726 INFO:tasks.workunit.client.0.smithi100.stdout:3/153: dread - d0/d4/f1e zero size 2023-12-05T09:57:19.727 INFO:tasks.workunit.client.0.smithi100.stdout:3/154: fdatasync d0/d4/f14 0 2023-12-05T09:57:19.727 INFO:tasks.workunit.client.1.smithi150.stdout:1/74: dwrite d6/d8/fc [0,4194304] 0 2023-12-05T09:57:19.727 INFO:tasks.workunit.client.1.smithi150.stdout:1/75: creat d6/d8/db/f16 x:0 0 0 2023-12-05T09:57:19.727 INFO:tasks.workunit.client.0.smithi100.stdout:6/456: unlink d7/d11/f12 0 2023-12-05T09:57:19.731 INFO:tasks.workunit.client.0.smithi100.stdout:9/208: mknod d7/d1b/d22/d25/c44 0 2023-12-05T09:57:19.733 INFO:tasks.workunit.client.0.smithi100.stdout:8/65: dwrite d0/f2 [0,4194304] 0 2023-12-05T09:57:19.734 INFO:tasks.workunit.client.1.smithi150.stdout:0/48: mkdir d5/d11 0 2023-12-05T09:57:19.735 INFO:tasks.workunit.client.1.smithi150.stdout:6/57: mknod d2/da/c16 0 2023-12-05T09:57:19.737 INFO:tasks.workunit.client.1.smithi150.stdout:3/71: dwrite d6/d9/dd/f13 [0,4194304] 0 2023-12-05T09:57:19.739 INFO:tasks.workunit.client.0.smithi100.stdout:3/155: symlink d0/d2/de/d12/l27 0 2023-12-05T09:57:19.739 INFO:tasks.workunit.client.0.smithi100.stdout:3/156: creat d0/d2/de/d12/f28 x:0 0 0 2023-12-05T09:57:19.740 INFO:tasks.workunit.client.0.smithi100.stdout:3/157: chown d0/d4/fc 475 1 2023-12-05T09:57:19.740 INFO:tasks.workunit.client.0.smithi100.stdout:3/158: creat d0/d2/de/d12/f29 x:0 0 0 2023-12-05T09:57:19.740 INFO:tasks.workunit.client.0.smithi100.stdout:7/74: write d3/dc/d11/d13/fb [3370891,75131] 0 2023-12-05T09:57:19.741 INFO:tasks.workunit.client.1.smithi150.stdout:8/49: dread d0/fc [0,4194304] 0 2023-12-05T09:57:19.742 INFO:tasks.workunit.client.0.smithi100.stdout:9/209: creat d7/f45 x:0 0 0 2023-12-05T09:57:19.742 INFO:tasks.workunit.client.0.smithi100.stdout:9/210: chown d7/d1b/l39 112193 1 2023-12-05T09:57:19.743 INFO:tasks.workunit.client.1.smithi150.stdout:7/49: dread d2/d4/d8/f9 [0,4194304] 0 2023-12-05T09:57:19.743 INFO:tasks.workunit.client.1.smithi150.stdout:7/50: chown d2/d4/fc 13 1 2023-12-05T09:57:19.747 INFO:tasks.workunit.client.1.smithi150.stdout:1/76: write f5 [3373484,23824] 0 2023-12-05T09:57:19.747 INFO:tasks.workunit.client.1.smithi150.stdout:0/49: link d5/l8 d5/d11/l12 0 2023-12-05T09:57:19.747 INFO:tasks.workunit.client.1.smithi150.stdout:6/58: mknod d2/c17 0 2023-12-05T09:57:19.747 INFO:tasks.workunit.client.0.smithi100.stdout:8/66: unlink d0/f8 0 2023-12-05T09:57:19.748 INFO:tasks.workunit.client.1.smithi150.stdout:5/48: truncate d1/d3/f7 1453256 0 2023-12-05T09:57:19.749 INFO:tasks.workunit.client.1.smithi150.stdout:8/50: dread d0/fc [0,4194304] 0 2023-12-05T09:57:19.754 INFO:tasks.workunit.client.0.smithi100.stdout:0/129: write da/fb [2125171,122873] 0 2023-12-05T09:57:19.760 INFO:tasks.workunit.client.1.smithi150.stdout:1/77: symlink d6/d8/l17 0 2023-12-05T09:57:19.760 INFO:tasks.workunit.client.1.smithi150.stdout:1/78: write d6/d8/db/de/f13 [877247,55234] 0 2023-12-05T09:57:19.761 INFO:tasks.workunit.client.1.smithi150.stdout:1/79: creat d6/d8/db/de/f18 x:0 0 0 2023-12-05T09:57:19.761 INFO:tasks.workunit.client.1.smithi150.stdout:1/80: dread - d6/d8/db/f16 zero size 2023-12-05T09:57:19.761 INFO:tasks.workunit.client.1.smithi150.stdout:1/81: creat d6/d8/db/f19 x:0 0 0 2023-12-05T09:57:19.762 INFO:tasks.workunit.client.0.smithi100.stdout:3/159: rename d0/f3 to d0/d10/f2a 0 2023-12-05T09:57:19.762 INFO:tasks.workunit.client.0.smithi100.stdout:3/160: chown d0/d4/c25 59 1 2023-12-05T09:57:19.762 INFO:tasks.workunit.client.0.smithi100.stdout:3/161: stat d0/d2/de/d11/f21 0 2023-12-05T09:57:19.762 INFO:tasks.workunit.client.0.smithi100.stdout:5/132: write d0/d1f/f21 [3025263,27162] 0 2023-12-05T09:57:19.763 INFO:tasks.workunit.client.0.smithi100.stdout:2/207: dwrite d7/da/dc/f12 [0,4194304] 0 2023-12-05T09:57:19.763 INFO:tasks.workunit.client.0.smithi100.stdout:2/208: write d7/f34 [143253,84042] 0 2023-12-05T09:57:19.763 INFO:tasks.workunit.client.1.smithi150.stdout:5/49: getdents d1 0 2023-12-05T09:57:19.763 INFO:tasks.workunit.client.1.smithi150.stdout:5/50: getdents d1/d3/d6/d11 0 2023-12-05T09:57:19.768 INFO:tasks.workunit.client.1.smithi150.stdout:6/59: dread d2/ff [4194304,4194304] 0 2023-12-05T09:57:19.777 INFO:tasks.workunit.client.0.smithi100.stdout:8/67: mknod d0/ca 0 2023-12-05T09:57:19.777 INFO:tasks.workunit.client.0.smithi100.stdout:8/68: fsync d0/f2 0 2023-12-05T09:57:19.777 INFO:tasks.workunit.client.0.smithi100.stdout:8/69: fsync d0/f9 0 2023-12-05T09:57:19.777 INFO:tasks.workunit.client.0.smithi100.stdout:8/70: readlink d0/l4 0 2023-12-05T09:57:19.778 INFO:tasks.workunit.client.0.smithi100.stdout:8/71: readlink d0/l4 0 2023-12-05T09:57:19.779 INFO:tasks.workunit.client.1.smithi150.stdout:8/51: rename d0/d8/c9 to d0/ce 0 2023-12-05T09:57:19.779 INFO:tasks.workunit.client.1.smithi150.stdout:3/72: rename d6/c8 to d6/c16 0 2023-12-05T09:57:19.779 INFO:tasks.workunit.client.1.smithi150.stdout:7/51: dread d2/d4/fc [0,4194304] 0 2023-12-05T09:57:19.784 INFO:tasks.workunit.client.1.smithi150.stdout:5/51: symlink d1/d3/l17 0 2023-12-05T09:57:19.784 INFO:tasks.workunit.client.1.smithi150.stdout:5/52: readlink d1/d3/l4 0 2023-12-05T09:57:19.785 INFO:tasks.workunit.client.1.smithi150.stdout:8/52: dread d0/fc [0,4194304] 0 2023-12-05T09:57:19.788 INFO:tasks.workunit.client.1.smithi150.stdout:7/52: write d2/d4/fc [3519948,87564] 0 2023-12-05T09:57:19.789 INFO:tasks.workunit.client.0.smithi100.stdout:3/162: getdents d0/d2/de 0 2023-12-05T09:57:19.792 INFO:tasks.workunit.client.0.smithi100.stdout:5/133: truncate d0/d1f/f2e 2260160 0 2023-12-05T09:57:19.792 INFO:tasks.workunit.client.0.smithi100.stdout:5/134: write d0/d1f/f21 [3185488,45822] 0 2023-12-05T09:57:19.793 INFO:tasks.workunit.client.1.smithi150.stdout:3/73: creat d6/f17 x:0 0 0 2023-12-05T09:57:19.793 INFO:tasks.workunit.client.1.smithi150.stdout:3/74: truncate d6/d9/dd/f13 4503316 0 2023-12-05T09:57:19.793 INFO:tasks.workunit.client.1.smithi150.stdout:3/75: write d6/d9/dd/f15 [175981,1140] 0 2023-12-05T09:57:19.794 INFO:tasks.workunit.client.1.smithi150.stdout:0/50: dwrite d5/f10 [0,4194304] 0 2023-12-05T09:57:19.794 INFO:tasks.workunit.client.1.smithi150.stdout:0/51: chown d5/ff 13280 1 2023-12-05T09:57:19.795 INFO:tasks.workunit.client.0.smithi100.stdout:9/211: dwrite d7/fd [0,4194304] 0 2023-12-05T09:57:19.795 INFO:tasks.workunit.client.0.smithi100.stdout:2/209: truncate d7/da/d18/d1b/d2c/d3f/d46/f2a 2171152 0 2023-12-05T09:57:19.799 INFO:tasks.workunit.client.1.smithi150.stdout:1/82: rename d6/d8/db/de/f18 to d6/f1a 0 2023-12-05T09:57:19.800 INFO:tasks.workunit.client.0.smithi100.stdout:4/74: getdents de 0 2023-12-05T09:57:19.801 INFO:tasks.workunit.client.0.smithi100.stdout:0/130: rmdir da/d22 39 2023-12-05T09:57:19.801 INFO:tasks.workunit.client.0.smithi100.stdout:0/131: getdents da/d1b 0 2023-12-05T09:57:19.802 INFO:tasks.workunit.client.0.smithi100.stdout:0/132: write f1 [1436812,125747] 0 2023-12-05T09:57:19.802 INFO:tasks.workunit.client.0.smithi100.stdout:4/75: write f6 [916866,38221] 0 2023-12-05T09:57:19.803 INFO:tasks.workunit.client.1.smithi150.stdout:5/53: stat d1/l13 0 2023-12-05T09:57:19.808 INFO:tasks.workunit.client.1.smithi150.stdout:6/60: truncate d2/da/fe 1458229 0 2023-12-05T09:57:19.808 INFO:tasks.workunit.client.0.smithi100.stdout:3/163: symlink d0/d2/de/d11/l2b 0 2023-12-05T09:57:19.809 INFO:tasks.workunit.client.1.smithi150.stdout:7/53: creat d2/d4/ff x:0 0 0 2023-12-05T09:57:19.809 INFO:tasks.workunit.client.1.smithi150.stdout:7/54: creat d2/d4/f10 x:0 0 0 2023-12-05T09:57:19.810 INFO:tasks.workunit.client.1.smithi150.stdout:4/23: dwrite d0/f1 [0,4194304] 0 2023-12-05T09:57:19.810 INFO:tasks.workunit.client.1.smithi150.stdout:4/24: getdents d0 0 2023-12-05T09:57:19.812 INFO:tasks.workunit.client.0.smithi100.stdout:4/76: fsync f6 0 2023-12-05T09:57:19.814 INFO:tasks.workunit.client.0.smithi100.stdout:5/135: truncate d0/f3 1338630 0 2023-12-05T09:57:19.816 INFO:tasks.workunit.client.0.smithi100.stdout:9/212: chown d7/ce 540 1 2023-12-05T09:57:19.816 INFO:tasks.workunit.client.0.smithi100.stdout:9/213: read d7/d10/f28 [1596499,74222] 0 2023-12-05T09:57:19.819 INFO:tasks.workunit.client.0.smithi100.stdout:2/210: getdents d7/da/d18/d1b/d2c 0 2023-12-05T09:57:19.826 INFO:tasks.workunit.client.0.smithi100.stdout:4/77: dread f9 [4194304,4194304] 0 2023-12-05T09:57:19.826 INFO:tasks.workunit.client.0.smithi100.stdout:4/78: readlink de/lf 0 2023-12-05T09:57:19.826 INFO:tasks.workunit.client.0.smithi100.stdout:4/79: chown f1 211 1 2023-12-05T09:57:19.827 INFO:tasks.workunit.client.1.smithi150.stdout:1/83: mkdir d6/d8/db/d1b 0 2023-12-05T09:57:19.827 INFO:tasks.workunit.client.1.smithi150.stdout:1/84: write d6/d8/db/de/f13 [1461311,25896] 0 2023-12-05T09:57:19.827 INFO:tasks.workunit.client.1.smithi150.stdout:1/85: fdatasync d6/d8/db/f12 0 2023-12-05T09:57:19.827 INFO:tasks.workunit.client.1.smithi150.stdout:2/54: truncate d0/d3/fe 248540 0 2023-12-05T09:57:19.827 INFO:tasks.workunit.client.1.smithi150.stdout:2/55: readlink d0/lc 0 2023-12-05T09:57:19.827 INFO:tasks.workunit.client.1.smithi150.stdout:2/56: stat d0/cb 0 2023-12-05T09:57:19.827 INFO:tasks.workunit.client.1.smithi150.stdout:2/57: fsync d0/f7 0 2023-12-05T09:57:19.828 INFO:tasks.workunit.client.1.smithi150.stdout:2/58: chown d0/f7 97979298 1 2023-12-05T09:57:19.830 INFO:tasks.workunit.client.0.smithi100.stdout:2/211: dread d7/f43 [0,4194304] 0 2023-12-05T09:57:19.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:19 smithi150 ceph-mon[116142]: Reconfiguring grafana.smithi100 (dependencies changed)... 2023-12-05T09:57:19.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:19 smithi150 ceph-mon[116142]: Reconfiguring daemon grafana.smithi100 on smithi100 2023-12-05T09:57:19.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:19 smithi100 ceph-mon[107145]: Reconfiguring grafana.smithi100 (dependencies changed)... 2023-12-05T09:57:19.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:19 smithi100 ceph-mon[107145]: Reconfiguring daemon grafana.smithi100 on smithi100 2023-12-05T09:57:19.899 INFO:tasks.workunit.client.0.smithi100.stdout:0/133: creat da/d22/f2b x:0 0 0 2023-12-05T09:57:19.901 INFO:tasks.workunit.client.0.smithi100.stdout:2/212: dread d7/da/d18/d21/f30 [0,4194304] 0 2023-12-05T09:57:19.901 INFO:tasks.workunit.client.0.smithi100.stdout:2/213: write d7/da/d18/d21/f44 [201961,8536] 0 2023-12-05T09:57:19.901 INFO:tasks.workunit.client.1.smithi150.stdout:6/61: mknod d2/c18 0 2023-12-05T09:57:19.901 INFO:tasks.workunit.client.1.smithi150.stdout:6/62: read - d2/f13 zero size 2023-12-05T09:57:19.908 INFO:tasks.workunit.client.0.smithi100.stdout:7/75: unlink d3/fd 0 2023-12-05T09:57:19.908 INFO:tasks.workunit.client.0.smithi100.stdout:7/76: stat d3/dc 0 2023-12-05T09:57:19.909 INFO:tasks.workunit.client.0.smithi100.stdout:7/77: read d3/dc/d11/d13/f15 [518160,111581] 0 2023-12-05T09:57:19.910 INFO:tasks.workunit.client.1.smithi150.stdout:7/55: mknod d2/d4/c11 0 2023-12-05T09:57:19.910 INFO:tasks.workunit.client.1.smithi150.stdout:7/56: chown d2/le 1042 1 2023-12-05T09:57:19.910 INFO:tasks.workunit.client.1.smithi150.stdout:7/57: chown d2 1273 1 2023-12-05T09:57:19.913 INFO:tasks.workunit.client.0.smithi100.stdout:3/164: unlink d0/d4/f19 0 2023-12-05T09:57:19.913 INFO:tasks.workunit.client.0.smithi100.stdout:8/72: dwrite d0/f3 [4194304,4194304] 0 2023-12-05T09:57:19.914 INFO:tasks.workunit.client.1.smithi150.stdout:8/53: dwrite d0/fc [0,4194304] 0 2023-12-05T09:57:19.915 INFO:tasks.workunit.client.1.smithi150.stdout:5/54: dwrite d1/d3/fb [0,4194304] 0 2023-12-05T09:57:19.916 INFO:tasks.workunit.client.0.smithi100.stdout:5/136: getdents d0/d1b 0 2023-12-05T09:57:19.916 INFO:tasks.workunit.client.0.smithi100.stdout:5/137: chown d0/d4/d5/df/f20 31001614 1 2023-12-05T09:57:19.916 INFO:tasks.workunit.client.1.smithi150.stdout:0/52: getdents d5/d11 0 2023-12-05T09:57:19.919 INFO:tasks.workunit.client.1.smithi150.stdout:4/25: symlink d0/l6 0 2023-12-05T09:57:19.922 INFO:tasks.workunit.client.1.smithi150.stdout:3/76: rename d6/d9/dd/le to d6/l18 0 2023-12-05T09:57:19.923 INFO:tasks.workunit.client.1.smithi150.stdout:9/52: sync 2023-12-05T09:57:19.926 INFO:tasks.workunit.client.1.smithi150.stdout:7/58: write d2/d4/d8/f9 [806787,62454] 0 2023-12-05T09:57:19.928 INFO:tasks.workunit.client.1.smithi150.stdout:7/59: truncate d2/d4/f10 464543 0 2023-12-05T09:57:19.929 INFO:tasks.workunit.client.1.smithi150.stdout:2/59: creat d0/d3/d11/f12 x:0 0 0 2023-12-05T09:57:19.936 INFO:tasks.workunit.client.1.smithi150.stdout:8/54: dread d0/fc [0,4194304] 0 2023-12-05T09:57:19.936 INFO:tasks.workunit.client.0.smithi100.stdout:3/165: write d0/d4/f20 [3611593,96603] 0 2023-12-05T09:57:19.939 INFO:tasks.workunit.client.1.smithi150.stdout:5/55: dread d1/d3/f7 [0,4194304] 0 2023-12-05T09:57:19.943 INFO:tasks.workunit.client.1.smithi150.stdout:4/26: unlink d0/c5 0 2023-12-05T09:57:19.943 INFO:tasks.workunit.client.1.smithi150.stdout:6/63: read d2/da/f10 [69275,53093] 0 2023-12-05T09:57:19.944 INFO:tasks.workunit.client.1.smithi150.stdout:0/53: dread d5/f10 [0,4194304] 0 2023-12-05T09:57:19.944 INFO:tasks.workunit.client.1.smithi150.stdout:0/54: read - d5/ff zero size 2023-12-05T09:57:19.946 INFO:tasks.workunit.client.1.smithi150.stdout:3/77: write d6/d9/dd/f13 [1288640,45497] 0 2023-12-05T09:57:19.946 INFO:tasks.workunit.client.1.smithi150.stdout:3/78: readlink d6/d9/dd/l11 0 2023-12-05T09:57:19.947 INFO:tasks.workunit.client.0.smithi100.stdout:4/80: rename fa to de/f13 0 2023-12-05T09:57:19.949 INFO:tasks.workunit.client.1.smithi150.stdout:5/56: symlink d1/d15/l18 0 2023-12-05T09:57:19.950 INFO:tasks.workunit.client.0.smithi100.stdout:2/214: truncate d7/da/d1a/f1c 5113650 0 2023-12-05T09:57:19.950 INFO:tasks.workunit.client.0.smithi100.stdout:2/215: write d7/da/d18/d21/f40 [1001016,87343] 0 2023-12-05T09:57:19.952 INFO:tasks.workunit.client.1.smithi150.stdout:6/64: rename d2/ff to d2/f19 0 2023-12-05T09:57:19.957 INFO:tasks.workunit.client.1.smithi150.stdout:6/65: write d2/f19 [4523554,123809] 0 2023-12-05T09:57:19.957 INFO:tasks.workunit.client.1.smithi150.stdout:6/66: dread - d2/f13 zero size 2023-12-05T09:57:19.961 INFO:tasks.workunit.client.1.smithi150.stdout:8/55: read d0/fc [881178,65740] 0 2023-12-05T09:57:19.961 INFO:tasks.workunit.client.1.smithi150.stdout:8/56: write d0/fc [3396664,99339] 0 2023-12-05T09:57:19.964 INFO:tasks.workunit.client.1.smithi150.stdout:4/27: read d0/f1 [176323,30202] 0 2023-12-05T09:57:19.964 INFO:tasks.workunit.client.1.smithi150.stdout:4/28: chown d0 364 1 2023-12-05T09:57:19.964 INFO:tasks.workunit.client.1.smithi150.stdout:0/55: creat d5/d11/f13 x:0 0 0 2023-12-05T09:57:19.964 INFO:tasks.workunit.client.1.smithi150.stdout:0/56: chown d5/l8 22021 1 2023-12-05T09:57:19.966 INFO:tasks.workunit.client.0.smithi100.stdout:0/134: dwrite da/fd [0,4194304] 0 2023-12-05T09:57:19.967 INFO:tasks.workunit.client.0.smithi100.stdout:2/216: write d7/da/d18/d1b/f28 [75426,64591] 0 2023-12-05T09:57:19.974 INFO:tasks.workunit.client.0.smithi100.stdout:7/78: dwrite d3/dc/f12 [0,4194304] 0 2023-12-05T09:57:19.975 INFO:tasks.workunit.client.0.smithi100.stdout:7/79: creat d3/dc/f1d x:0 0 0 2023-12-05T09:57:19.977 INFO:tasks.workunit.client.0.smithi100.stdout:3/166: link d0/cb d0/d2/c2c 0 2023-12-05T09:57:19.978 INFO:tasks.workunit.client.1.smithi150.stdout:9/53: dwrite d3/f4 [0,4194304] 0 2023-12-05T09:57:19.981 INFO:tasks.workunit.client.0.smithi100.stdout:4/81: creat de/f14 x:0 0 0 2023-12-05T09:57:19.981 INFO:tasks.workunit.client.0.smithi100.stdout:5/138: dread d0/f3 [0,4194304] 0 2023-12-05T09:57:19.985 INFO:tasks.workunit.client.1.smithi150.stdout:5/57: mkdir d1/d3/d6/d11/d19 0 2023-12-05T09:57:19.985 INFO:tasks.workunit.client.1.smithi150.stdout:8/57: creat d0/ff x:0 0 0 2023-12-05T09:57:19.985 INFO:tasks.workunit.client.1.smithi150.stdout:8/58: fdatasync d0/ff 0 2023-12-05T09:57:19.986 INFO:tasks.workunit.client.0.smithi100.stdout:8/73: truncate d0/f2 2580422 0 2023-12-05T09:57:19.986 INFO:tasks.workunit.client.0.smithi100.stdout:8/74: read - d0/f9 zero size 2023-12-05T09:57:19.986 INFO:tasks.workunit.client.1.smithi150.stdout:4/29: dread d0/f1 [0,4194304] 0 2023-12-05T09:57:19.988 INFO:tasks.workunit.client.1.smithi150.stdout:0/57: rename d5/c9 to d5/d11/c14 0 2023-12-05T09:57:19.989 INFO:tasks.workunit.client.0.smithi100.stdout:0/135: creat da/f2c x:0 0 0 2023-12-05T09:57:19.990 INFO:tasks.workunit.client.0.smithi100.stdout:0/136: creat da/f2d x:0 0 0 2023-12-05T09:57:19.991 INFO:tasks.workunit.client.1.smithi150.stdout:3/79: mkdir d6/d19 0 2023-12-05T09:57:19.991 INFO:tasks.workunit.client.1.smithi150.stdout:3/80: creat d6/d9/dd/f1a x:0 0 0 2023-12-05T09:57:19.991 INFO:tasks.workunit.client.1.smithi150.stdout:3/81: chown d6/l18 6 1 2023-12-05T09:57:19.994 INFO:tasks.workunit.client.1.smithi150.stdout:9/54: unlink c2 0 2023-12-05T09:57:19.997 INFO:tasks.workunit.client.1.smithi150.stdout:5/58: rmdir d1/d3/d6/d11/d19 0 2023-12-05T09:57:19.997 INFO:tasks.workunit.client.1.smithi150.stdout:5/59: dread - d1/d3/d6/f10 zero size 2023-12-05T09:57:19.997 INFO:tasks.workunit.client.1.smithi150.stdout:5/60: dread - d1/d15/f16 zero size 2023-12-05T09:57:19.997 INFO:tasks.workunit.client.1.smithi150.stdout:5/61: dread - d1/d15/f16 zero size 2023-12-05T09:57:19.997 INFO:tasks.workunit.client.1.smithi150.stdout:5/62: write d1/d15/f16 [238006,18330] 0 2023-12-05T09:57:19.999 INFO:tasks.workunit.client.1.smithi150.stdout:8/59: getdents d0/d8 0 2023-12-05T09:57:20.001 INFO:tasks.workunit.client.0.smithi100.stdout:3/167: symlink d0/d2/l2d 0 2023-12-05T09:57:20.002 INFO:tasks.workunit.client.1.smithi150.stdout:4/30: mknod d0/c7 0 2023-12-05T09:57:20.005 INFO:tasks.workunit.client.1.smithi150.stdout:0/58: truncate d5/f10 946187 0 2023-12-05T09:57:20.016 INFO:tasks.workunit.client.1.smithi150.stdout:2/60: rmdir d0 39 2023-12-05T09:57:20.016 INFO:tasks.workunit.client.1.smithi150.stdout:9/55: rename d3/f6 to d3/d9/fa 0 2023-12-05T09:57:20.016 INFO:tasks.workunit.client.1.smithi150.stdout:9/56: readlink d3/l8 0 2023-12-05T09:57:20.017 INFO:tasks.workunit.client.1.smithi150.stdout:8/60: rmdir d0/d8 39 2023-12-05T09:57:20.018 INFO:tasks.workunit.client.0.smithi100.stdout:5/139: symlink d0/d1f/l2f 0 2023-12-05T09:57:20.018 INFO:tasks.workunit.client.0.smithi100.stdout:4/82: truncate de/f13 646315 0 2023-12-05T09:57:20.018 INFO:tasks.workunit.client.0.smithi100.stdout:2/217: dread d7/da/d18/d1b/f28 [0,4194304] 0 2023-12-05T09:57:20.019 INFO:tasks.workunit.client.1.smithi150.stdout:4/31: rename d0/f1 to d0/f8 0 2023-12-05T09:57:20.019 INFO:tasks.workunit.client.1.smithi150.stdout:4/32: write d0/f8 [768364,21306] 0 2023-12-05T09:57:20.021 INFO:tasks.workunit.client.1.smithi150.stdout:1/86: truncate f5 2576178 0 2023-12-05T09:57:20.022 INFO:tasks.workunit.client.0.smithi100.stdout:0/137: symlink da/d2a/l2e 0 2023-12-05T09:57:20.023 INFO:tasks.workunit.client.1.smithi150.stdout:5/63: truncate d1/d3/fb 3972802 0 2023-12-05T09:57:20.023 INFO:tasks.workunit.client.1.smithi150.stdout:5/64: chown d1/d3/d6/f8 1278 1 2023-12-05T09:57:20.024 INFO:tasks.workunit.client.0.smithi100.stdout:3/168: mknod d0/d10/c2e 0 2023-12-05T09:57:20.024 INFO:tasks.workunit.client.0.smithi100.stdout:3/169: stat d0/d10/f2a 0 2023-12-05T09:57:20.026 INFO:tasks.workunit.client.1.smithi150.stdout:2/61: mkdir d0/d3/d5/d13 0 2023-12-05T09:57:20.026 INFO:tasks.workunit.client.1.smithi150.stdout:2/62: write d0/d3/fe [342518,78035] 0 2023-12-05T09:57:20.026 INFO:tasks.workunit.client.1.smithi150.stdout:2/63: write d0/d3/d11/f12 [523385,32679] 0 2023-12-05T09:57:20.026 INFO:tasks.workunit.client.1.smithi150.stdout:2/64: chown d0/d3/l4 3 1 2023-12-05T09:57:20.027 INFO:tasks.workunit.client.0.smithi100.stdout:4/83: truncate f9 2281568 0 2023-12-05T09:57:20.030 INFO:tasks.workunit.client.1.smithi150.stdout:9/57: unlink d3/l5 0 2023-12-05T09:57:20.032 INFO:tasks.workunit.client.0.smithi100.stdout:2/218: creat d7/da/d18/d1b/d2c/d3f/d46/f47 x:0 0 0 2023-12-05T09:57:20.038 INFO:tasks.workunit.client.1.smithi150.stdout:2/65: creat d0/d3/f14 x:0 0 0 2023-12-05T09:57:20.039 INFO:tasks.workunit.client.0.smithi100.stdout:3/170: mknod d0/d10/c2f 0 2023-12-05T09:57:20.041 INFO:tasks.workunit.client.1.smithi150.stdout:9/58: symlink d3/d9/lb 0 2023-12-05T09:57:20.042 INFO:tasks.workunit.client.0.smithi100.stdout:5/140: write d0/d4/fd [4758332,24694] 0 2023-12-05T09:57:20.045 INFO:tasks.workunit.client.0.smithi100.stdout:4/84: unlink c8 0 2023-12-05T09:57:20.045 INFO:tasks.workunit.client.0.smithi100.stdout:4/85: fsync de/f11 0 2023-12-05T09:57:20.048 INFO:tasks.workunit.client.0.smithi100.stdout:4/86: creat de/f15 x:0 0 0 2023-12-05T09:57:20.049 INFO:tasks.workunit.client.1.smithi150.stdout:2/66: rmdir d0/d3/d5 39 2023-12-05T09:57:20.049 INFO:tasks.workunit.client.0.smithi100.stdout:2/219: symlink d7/da/d18/l48 0 2023-12-05T09:57:20.052 INFO:tasks.workunit.client.1.smithi150.stdout:6/67: dwrite d2/f19 [0,4194304] 0 2023-12-05T09:57:20.052 INFO:tasks.workunit.client.1.smithi150.stdout:6/68: stat d2/da/cd 0 2023-12-05T09:57:20.052 INFO:tasks.workunit.client.1.smithi150.stdout:6/69: dread - d2/f13 zero size 2023-12-05T09:57:20.056 INFO:tasks.workunit.client.1.smithi150.stdout:7/60: dwrite d2/d4/fc [0,4194304] 0 2023-12-05T09:57:20.056 INFO:tasks.workunit.client.1.smithi150.stdout:7/61: stat d2/d4/l7 0 2023-12-05T09:57:20.057 INFO:tasks.workunit.client.1.smithi150.stdout:0/59: fsync d5/fa 0 2023-12-05T09:57:20.057 INFO:tasks.workunit.client.1.smithi150.stdout:0/60: write d5/fc [1202365,94141] 0 2023-12-05T09:57:20.057 INFO:tasks.workunit.client.1.smithi150.stdout:0/61: write d5/ff [453106,41182] 0 2023-12-05T09:57:20.057 INFO:tasks.workunit.client.1.smithi150.stdout:0/62: readlink d5/l8 0 2023-12-05T09:57:20.058 INFO:tasks.workunit.client.1.smithi150.stdout:3/82: dwrite d6/d9/dd/f15 [0,4194304] 0 2023-12-05T09:57:20.058 INFO:tasks.workunit.client.1.smithi150.stdout:3/83: write d6/d9/dd/f1a [431160,108367] 0 2023-12-05T09:57:20.059 INFO:tasks.workunit.client.1.smithi150.stdout:9/59: mkdir d3/d9/dc 0 2023-12-05T09:57:20.059 INFO:tasks.workunit.client.1.smithi150.stdout:9/60: chown d3 1822716 1 2023-12-05T09:57:20.059 INFO:tasks.workunit.client.0.smithi100.stdout:7/80: dwrite d3/dc/d11/d13/f15 [0,4194304] 0 2023-12-05T09:57:20.060 INFO:tasks.workunit.client.0.smithi100.stdout:7/81: dread - d3/dc/f1d zero size 2023-12-05T09:57:20.061 INFO:tasks.workunit.client.1.smithi150.stdout:2/67: mkdir d0/d3/d5/d13/d15 0 2023-12-05T09:57:20.061 INFO:tasks.workunit.client.1.smithi150.stdout:2/68: chown d0/d3/d5 10146 1 2023-12-05T09:57:20.068 INFO:tasks.workunit.client.0.smithi100.stdout:5/141: rmdir d0/d27 39 2023-12-05T09:57:20.068 INFO:tasks.workunit.client.0.smithi100.stdout:3/171: write d0/d2/f23 [333428,123760] 0 2023-12-05T09:57:20.068 INFO:tasks.workunit.client.0.smithi100.stdout:3/172: dread - d0/d2/de/d12/f29 zero size 2023-12-05T09:57:20.068 INFO:tasks.workunit.client.0.smithi100.stdout:3/173: write d0/d2/f23 [1396271,82224] 0 2023-12-05T09:57:20.068 INFO:tasks.workunit.client.0.smithi100.stdout:3/174: fdatasync d0/d4/f20 0 2023-12-05T09:57:20.068 INFO:tasks.workunit.client.0.smithi100.stdout:8/75: write d0/f2 [82921,5357] 0 2023-12-05T09:57:20.069 INFO:tasks.workunit.client.1.smithi150.stdout:8/61: dread d0/fc [0,4194304] 0 2023-12-05T09:57:20.069 INFO:tasks.workunit.client.1.smithi150.stdout:8/62: creat d0/f10 x:0 0 0 2023-12-05T09:57:20.069 INFO:tasks.workunit.client.1.smithi150.stdout:8/63: readlink d0/l7 0 2023-12-05T09:57:20.069 INFO:tasks.workunit.client.1.smithi150.stdout:5/65: dread d1/d15/f16 [0,4194304] 0 2023-12-05T09:57:20.070 INFO:tasks.workunit.client.1.smithi150.stdout:6/70: write d2/f19 [1027504,38533] 0 2023-12-05T09:57:20.070 INFO:tasks.workunit.client.1.smithi150.stdout:0/63: mknod d5/c15 0 2023-12-05T09:57:20.070 INFO:tasks.workunit.client.1.smithi150.stdout:0/64: truncate d5/ff 544955 0 2023-12-05T09:57:20.071 INFO:tasks.workunit.client.1.smithi150.stdout:3/84: creat d6/d9/f1b x:0 0 0 2023-12-05T09:57:20.071 INFO:tasks.workunit.client.1.smithi150.stdout:0/65: truncate d5/fd 544297 0 2023-12-05T09:57:20.073 INFO:tasks.workunit.client.1.smithi150.stdout:9/61: truncate d3/d9/fa 3333099 0 2023-12-05T09:57:20.076 INFO:tasks.workunit.client.1.smithi150.stdout:0/66: write d5/f10 [1887140,25303] 0 2023-12-05T09:57:20.076 INFO:tasks.workunit.client.1.smithi150.stdout:0/67: dread - d5/d11/f13 zero size 2023-12-05T09:57:20.077 INFO:tasks.workunit.client.1.smithi150.stdout:2/69: creat d0/f16 x:0 0 0 2023-12-05T09:57:20.078 INFO:tasks.workunit.client.1.smithi150.stdout:7/62: dread d2/d4/d8/f9 [0,4194304] 0 2023-12-05T09:57:20.081 INFO:tasks.workunit.client.1.smithi150.stdout:8/64: creat d0/d8/f11 x:0 0 0 2023-12-05T09:57:20.082 INFO:tasks.workunit.client.1.smithi150.stdout:8/65: dread - d0/f10 zero size 2023-12-05T09:57:20.082 INFO:tasks.workunit.client.1.smithi150.stdout:8/66: chown d0/d8 593564 1 2023-12-05T09:57:20.082 INFO:tasks.workunit.client.1.smithi150.stdout:8/67: dread - d0/d8/f11 zero size 2023-12-05T09:57:20.084 INFO:tasks.workunit.client.1.smithi150.stdout:5/66: mknod d1/d15/c1a 0 2023-12-05T09:57:20.086 INFO:tasks.workunit.client.0.smithi100.stdout:8/76: creat d0/fb x:0 0 0 2023-12-05T09:57:20.086 INFO:tasks.workunit.client.0.smithi100.stdout:8/77: write d0/f2 [766738,123803] 0 2023-12-05T09:57:20.086 INFO:tasks.workunit.client.0.smithi100.stdout:8/78: fdatasync d0/f9 0 2023-12-05T09:57:20.086 INFO:tasks.workunit.client.0.smithi100.stdout:8/79: chown d0 36 1 2023-12-05T09:57:20.086 INFO:tasks.workunit.client.0.smithi100.stdout:8/80: fdatasync d0/f9 0 2023-12-05T09:57:20.087 INFO:tasks.workunit.client.0.smithi100.stdout:8/81: truncate d0/f9 670123 0 2023-12-05T09:57:20.087 INFO:tasks.workunit.client.1.smithi150.stdout:6/71: write d2/f9 [2223238,24714] 0 2023-12-05T09:57:20.087 INFO:tasks.workunit.client.1.smithi150.stdout:6/72: write d2/f9 [4485429,107225] 0 2023-12-05T09:57:20.087 INFO:tasks.workunit.client.0.smithi100.stdout:0/138: truncate da/fd 1326774 0 2023-12-05T09:57:20.089 INFO:tasks.workunit.client.1.smithi150.stdout:4/33: rmdir d0 39 2023-12-05T09:57:20.090 INFO:tasks.workunit.client.1.smithi150.stdout:4/34: chown d0/l6 1892 1 2023-12-05T09:57:20.090 INFO:tasks.workunit.client.1.smithi150.stdout:4/35: chown d0 1381980 1 2023-12-05T09:57:20.091 INFO:tasks.workunit.client.0.smithi100.stdout:4/87: dwrite f1 [0,4194304] 0 2023-12-05T09:57:20.092 INFO:tasks.workunit.client.1.smithi150.stdout:9/62: rename d3/c7 to d3/d9/cd 0 2023-12-05T09:57:20.097 INFO:tasks.workunit.client.1.smithi150.stdout:4/36: fsync d0/f8 0 2023-12-05T09:57:20.097 INFO:tasks.workunit.client.1.smithi150.stdout:3/85: dread d6/d9/dd/f1a [0,4194304] 0 2023-12-05T09:57:20.098 INFO:tasks.workunit.client.0.smithi100.stdout:7/82: getdents d3 0 2023-12-05T09:57:20.098 INFO:tasks.workunit.client.0.smithi100.stdout:7/83: fdatasync d3/dc/d11/d13/fb 0 2023-12-05T09:57:20.098 INFO:tasks.workunit.client.0.smithi100.stdout:7/84: chown d3/dc/l16 0 1 2023-12-05T09:57:20.099 INFO:tasks.workunit.client.1.smithi150.stdout:0/68: mkdir d5/d11/d16 0 2023-12-05T09:57:20.101 INFO:tasks.workunit.client.1.smithi150.stdout:2/70: symlink d0/d3/d5/d13/d15/l17 0 2023-12-05T09:57:20.101 INFO:tasks.workunit.client.1.smithi150.stdout:2/71: dread - d0/d3/f14 zero size 2023-12-05T09:57:20.102 INFO:tasks.workunit.client.0.smithi100.stdout:0/139: symlink da/d1b/l2f 0 2023-12-05T09:57:20.108 INFO:tasks.workunit.client.1.smithi150.stdout:8/68: unlink d0/l7 0 2023-12-05T09:57:20.109 INFO:tasks.workunit.client.1.smithi150.stdout:8/69: dread - d0/f10 zero size 2023-12-05T09:57:20.109 INFO:tasks.workunit.client.1.smithi150.stdout:8/70: creat d0/d8/f12 x:0 0 0 2023-12-05T09:57:20.109 INFO:tasks.workunit.client.1.smithi150.stdout:1/87: dread d6/d8/fc [0,4194304] 0 2023-12-05T09:57:20.109 INFO:tasks.workunit.client.0.smithi100.stdout:4/88: mkdir de/d16 0 2023-12-05T09:57:20.109 INFO:tasks.workunit.client.0.smithi100.stdout:4/89: getdents de/d16 0 2023-12-05T09:57:20.111 INFO:tasks.workunit.client.0.smithi100.stdout:5/142: dwrite d0/d27/f28 [0,4194304] 0 2023-12-05T09:57:20.111 INFO:tasks.workunit.client.1.smithi150.stdout:5/67: mkdir d1/d3/d6/d1b 0 2023-12-05T09:57:20.113 INFO:tasks.workunit.client.1.smithi150.stdout:9/63: dread d3/f4 [0,4194304] 0 2023-12-05T09:57:20.114 INFO:tasks.workunit.client.0.smithi100.stdout:7/85: creat d3/dc/d11/f1e x:0 0 0 2023-12-05T09:57:20.120 INFO:tasks.workunit.client.1.smithi150.stdout:4/37: rename d0/c7 to d0/c9 0 2023-12-05T09:57:20.121 INFO:tasks.workunit.client.1.smithi150.stdout:4/38: write d0/f8 [976956,62215] 0 2023-12-05T09:57:20.122 INFO:tasks.workunit.client.0.smithi100.stdout:4/90: truncate f6 560577 0 2023-12-05T09:57:20.123 INFO:tasks.workunit.client.0.smithi100.stdout:0/140: dread da/fb [0,4194304] 0 2023-12-05T09:57:20.124 INFO:tasks.workunit.client.1.smithi150.stdout:3/86: rename d6/d9/dd/f12 to d6/d9/f1c 0 2023-12-05T09:57:20.124 INFO:tasks.workunit.client.1.smithi150.stdout:3/87: read d6/d9/dd/f13 [875775,99124] 0 2023-12-05T09:57:20.124 INFO:tasks.workunit.client.1.smithi150.stdout:3/88: creat d6/d9/f1d x:0 0 0 2023-12-05T09:57:20.127 INFO:tasks.workunit.client.1.smithi150.stdout:2/72: creat d0/d3/d11/f18 x:0 0 0 2023-12-05T09:57:20.128 INFO:tasks.workunit.client.0.smithi100.stdout:7/86: creat d3/f1f x:0 0 0 2023-12-05T09:57:20.130 INFO:tasks.workunit.client.0.smithi100.stdout:4/91: symlink de/d16/l17 0 2023-12-05T09:57:20.133 INFO:tasks.workunit.client.0.smithi100.stdout:0/141: unlink f1 0 2023-12-05T09:57:20.134 INFO:tasks.workunit.client.0.smithi100.stdout:0/142: creat da/f30 x:0 0 0 2023-12-05T09:57:20.138 INFO:tasks.workunit.client.0.smithi100.stdout:7/87: symlink d3/dc/d11/d13/de/l20 0 2023-12-05T09:57:20.139 INFO:tasks.workunit.client.0.smithi100.stdout:3/175: dwrite d0/d2/de/d12/f29 [0,4194304] 0 2023-12-05T09:57:20.139 INFO:tasks.workunit.client.0.smithi100.stdout:3/176: write d0/d2/de/d11/f21 [633326,58987] 0 2023-12-05T09:57:20.142 INFO:tasks.workunit.client.0.smithi100.stdout:4/92: mknod de/c18 0 2023-12-05T09:57:20.148 INFO:tasks.workunit.client.1.smithi150.stdout:4/39: dread d0/f8 [0,4194304] 0 2023-12-05T09:57:20.148 INFO:tasks.workunit.client.0.smithi100.stdout:0/143: symlink da/d22/l31 0 2023-12-05T09:57:20.151 INFO:tasks.workunit.client.1.smithi150.stdout:2/73: creat d0/d3/d5/d10/f19 x:0 0 0 2023-12-05T09:57:20.151 INFO:tasks.workunit.client.1.smithi150.stdout:2/74: chown d0 15683 1 2023-12-05T09:57:20.151 INFO:tasks.workunit.client.1.smithi150.stdout:2/75: stat d0/f16 0 2023-12-05T09:57:20.151 INFO:tasks.workunit.client.1.smithi150.stdout:2/76: stat d0/lc 0 2023-12-05T09:57:20.152 INFO:tasks.workunit.client.0.smithi100.stdout:8/82: rmdir d0 39 2023-12-05T09:57:20.155 INFO:tasks.workunit.client.1.smithi150.stdout:0/69: fdatasync d5/fc 0 2023-12-05T09:57:20.155 INFO:tasks.workunit.client.1.smithi150.stdout:0/70: read d5/fa [3254692,33944] 0 2023-12-05T09:57:20.155 INFO:tasks.workunit.client.1.smithi150.stdout:6/73: dwrite d2/f13 [0,4194304] 0 2023-12-05T09:57:20.155 INFO:tasks.workunit.client.1.smithi150.stdout:6/74: fdatasync d2/da/fe 0 2023-12-05T09:57:20.156 INFO:tasks.workunit.client.1.smithi150.stdout:4/40: unlink d0/c4 0 2023-12-05T09:57:20.161 INFO:tasks.workunit.client.1.smithi150.stdout:3/89: rename d6/d9/dd/f15 to d6/d19/f1e 0 2023-12-05T09:57:20.166 INFO:tasks.workunit.client.1.smithi150.stdout:2/77: mknod d0/d3/c1a 0 2023-12-05T09:57:20.166 INFO:tasks.workunit.client.1.smithi150.stdout:2/78: creat d0/d3/d5/d10/f1b x:0 0 0 2023-12-05T09:57:20.168 INFO:tasks.workunit.client.0.smithi100.stdout:0/144: symlink da/l32 0 2023-12-05T09:57:20.170 INFO:tasks.workunit.client.0.smithi100.stdout:8/83: creat d0/fc x:0 0 0 2023-12-05T09:57:20.170 INFO:tasks.workunit.client.0.smithi100.stdout:8/84: fdatasync d0/f2 0 2023-12-05T09:57:20.172 INFO:tasks.workunit.client.1.smithi150.stdout:6/75: creat d2/da/f1a x:0 0 0 2023-12-05T09:57:20.173 INFO:tasks.workunit.client.1.smithi150.stdout:9/64: dread d3/d9/fa [0,4194304] 0 2023-12-05T09:57:20.173 INFO:tasks.workunit.client.1.smithi150.stdout:9/65: write d3/d9/fa [4070813,103234] 0 2023-12-05T09:57:20.173 INFO:tasks.workunit.client.0.smithi100.stdout:0/145: mkdir da/d22/d33 0 2023-12-05T09:57:20.179 INFO:tasks.workunit.client.1.smithi150.stdout:3/90: creat d6/f1f x:0 0 0 2023-12-05T09:57:20.179 INFO:tasks.workunit.client.1.smithi150.stdout:0/71: rename d5/d11/f13 to d5/d11/d16/f17 0 2023-12-05T09:57:20.179 INFO:tasks.workunit.client.1.smithi150.stdout:3/91: fdatasync d6/d9/dd/f1a 0 2023-12-05T09:57:20.181 INFO:tasks.workunit.client.0.smithi100.stdout:8/85: dread d0/f2 [0,4194304] 0 2023-12-05T09:57:20.181 INFO:tasks.workunit.client.0.smithi100.stdout:8/86: creat d0/fd x:0 0 0 2023-12-05T09:57:20.184 INFO:tasks.workunit.client.0.smithi100.stdout:8/87: mknod d0/ce 0 2023-12-05T09:57:20.184 INFO:tasks.workunit.client.0.smithi100.stdout:8/88: write d0/fd [720365,81229] 0 2023-12-05T09:57:20.184 INFO:tasks.workunit.client.1.smithi150.stdout:1/88: dwrite d6/d8/db/de/f13 [0,4194304] 0 2023-12-05T09:57:20.189 INFO:tasks.workunit.client.1.smithi150.stdout:2/79: unlink d0/d3/d11/f12 0 2023-12-05T09:57:20.190 INFO:tasks.workunit.client.0.smithi100.stdout:0/146: write da/d22/f23 [1672698,126943] 0 2023-12-05T09:57:20.190 INFO:tasks.workunit.client.0.smithi100.stdout:0/147: chown da/d22/c24 11907 1 2023-12-05T09:57:20.190 INFO:tasks.workunit.client.0.smithi100.stdout:0/148: write da/f30 [52908,72036] 0 2023-12-05T09:57:20.190 INFO:tasks.workunit.client.0.smithi100.stdout:0/149: fdatasync da/fd 0 2023-12-05T09:57:20.190 INFO:tasks.workunit.client.0.smithi100.stdout:0/150: write da/d22/f23 [2429679,25662] 0 2023-12-05T09:57:20.191 INFO:tasks.workunit.client.1.smithi150.stdout:7/63: truncate d2/d4/d8/f9 1286084 0 2023-12-05T09:57:20.191 INFO:tasks.workunit.client.1.smithi150.stdout:7/64: readlink d2/d4/d8/ld 0 2023-12-05T09:57:20.193 INFO:tasks.workunit.client.1.smithi150.stdout:3/92: unlink c2 0 2023-12-05T09:57:20.193 INFO:tasks.workunit.client.1.smithi150.stdout:3/93: stat d6/d9 0 2023-12-05T09:57:20.193 INFO:tasks.workunit.client.1.smithi150.stdout:3/94: readlink l3 0 2023-12-05T09:57:20.195 INFO:tasks.workunit.client.1.smithi150.stdout:1/89: symlink d6/d8/db/d1b/l1c 0 2023-12-05T09:57:20.196 INFO:tasks.workunit.client.1.smithi150.stdout:7/65: creat d2/f12 x:0 0 0 2023-12-05T09:57:20.197 INFO:tasks.workunit.client.1.smithi150.stdout:3/95: rmdir d6/d19 39 2023-12-05T09:57:20.201 INFO:tasks.workunit.client.1.smithi150.stdout:1/90: unlink d6/d8/db/f12 0 2023-12-05T09:57:20.205 INFO:tasks.workunit.client.1.smithi150.stdout:2/80: write d0/f7 [6142072,88679] 0 2023-12-05T09:57:20.206 INFO:tasks.workunit.client.1.smithi150.stdout:8/71: dwrite d0/fc [0,4194304] 0 2023-12-05T09:57:20.212 INFO:tasks.workunit.client.1.smithi150.stdout:1/91: dread f4 [0,4194304] 0 2023-12-05T09:57:20.220 INFO:tasks.workunit.client.1.smithi150.stdout:8/72: rename d0/f10 to d0/f13 0 2023-12-05T09:57:20.220 INFO:tasks.workunit.client.1.smithi150.stdout:8/73: chown d0/d8/f11 0 1 2023-12-05T09:57:20.220 INFO:tasks.workunit.client.1.smithi150.stdout:1/92: link d6/d8/l10 d6/l1d 0 2023-12-05T09:57:20.220 INFO:tasks.workunit.client.1.smithi150.stdout:1/93: write d6/f1a [752893,21350] 0 2023-12-05T09:57:20.221 INFO:tasks.workunit.client.1.smithi150.stdout:8/74: mkdir d0/d8/d14 0 2023-12-05T09:57:20.223 INFO:tasks.workunit.client.1.smithi150.stdout:1/94: symlink d6/d8/db/de/l1e 0 2023-12-05T09:57:20.223 INFO:tasks.workunit.client.1.smithi150.stdout:8/75: creat d0/d8/d14/f15 x:0 0 0 2023-12-05T09:57:20.223 INFO:tasks.workunit.client.1.smithi150.stdout:8/76: creat d0/f16 x:0 0 0 2023-12-05T09:57:20.237 INFO:tasks.workunit.client.0.smithi100.stdout:0/151: dwrite da/f2c [0,4194304] 0 2023-12-05T09:57:20.242 INFO:tasks.workunit.client.1.smithi150.stdout:0/72: dwrite d5/d11/d16/f17 [0,4194304] 0 2023-12-05T09:57:20.249 INFO:tasks.workunit.client.0.smithi100.stdout:0/152: write da/d1b/f26 [95222,57810] 0 2023-12-05T09:57:20.255 INFO:tasks.workunit.client.0.smithi100.stdout:1/98: sync 2023-12-05T09:57:20.256 INFO:tasks.workunit.client.0.smithi100.stdout:0/153: dread da/f30 [0,4194304] 0 2023-12-05T09:57:20.256 INFO:tasks.workunit.client.0.smithi100.stdout:0/154: dread - da/f2d zero size 2023-12-05T09:57:20.256 INFO:tasks.workunit.client.0.smithi100.stdout:0/155: write da/fb [1836478,114445] 0 2023-12-05T09:57:20.257 INFO:tasks.workunit.client.0.smithi100.stdout:1/99: mkdir db/d12/d1e 0 2023-12-05T09:57:20.257 INFO:tasks.workunit.client.0.smithi100.stdout:1/100: read db/ff [288621,69306] 0 2023-12-05T09:57:20.258 INFO:tasks.workunit.client.0.smithi100.stdout:1/101: truncate db/d12/f18 2134176 0 2023-12-05T09:57:20.268 INFO:tasks.workunit.client.0.smithi100.stdout:1/102: symlink db/l1f 0 2023-12-05T09:57:20.280 INFO:tasks.workunit.client.1.smithi150.stdout:4/41: dread d0/f8 [0,4194304] 0 2023-12-05T09:57:20.280 INFO:tasks.workunit.client.1.smithi150.stdout:4/42: write d0/f8 [1810339,120399] 0 2023-12-05T09:57:20.286 INFO:tasks.workunit.client.1.smithi150.stdout:3/96: dwrite d6/d9/f1c [0,4194304] 0 2023-12-05T09:57:20.289 INFO:tasks.workunit.client.0.smithi100.stdout:5/143: dwrite d0/d4/d5/df/f20 [0,4194304] 0 2023-12-05T09:57:20.290 INFO:tasks.workunit.client.1.smithi150.stdout:9/66: dwrite d3/f4 [4194304,4194304] 0 2023-12-05T09:57:20.290 INFO:tasks.workunit.client.1.smithi150.stdout:4/43: fdatasync d0/f8 0 2023-12-05T09:57:20.290 INFO:tasks.workunit.client.1.smithi150.stdout:4/44: rename d0 to d0/da 22 2023-12-05T09:57:20.290 INFO:tasks.workunit.client.1.smithi150.stdout:4/45: truncate d0/f8 4649153 0 2023-12-05T09:57:20.294 INFO:tasks.workunit.client.0.smithi100.stdout:5/144: mknod d0/d1f/c30 0 2023-12-05T09:57:20.301 INFO:tasks.workunit.client.0.smithi100.stdout:5/145: mkdir d0/d1f/d25/d31 0 2023-12-05T09:57:20.301 INFO:tasks.workunit.client.0.smithi100.stdout:5/146: write d0/d1f/f21 [557408,9209] 0 2023-12-05T09:57:20.302 INFO:tasks.workunit.client.1.smithi150.stdout:9/67: mknod d3/d9/ce 0 2023-12-05T09:57:20.302 INFO:tasks.workunit.client.1.smithi150.stdout:9/68: read d3/d9/fa [1401004,27429] 0 2023-12-05T09:57:20.302 INFO:tasks.workunit.client.1.smithi150.stdout:9/69: readlink d3/d9/lb 0 2023-12-05T09:57:20.306 INFO:tasks.workunit.client.0.smithi100.stdout:5/147: creat d0/d1b/f32 x:0 0 0 2023-12-05T09:57:20.307 INFO:tasks.workunit.client.0.smithi100.stdout:5/148: creat d0/d1b/f33 x:0 0 0 2023-12-05T09:57:20.315 INFO:tasks.workunit.client.1.smithi150.stdout:0/73: getdents d5/d11 0 2023-12-05T09:57:20.316 INFO:tasks.workunit.client.1.smithi150.stdout:0/74: chown d5/c6 0 1 2023-12-05T09:57:20.316 INFO:tasks.workunit.client.1.smithi150.stdout:0/75: write d5/fa [3600556,106875] 0 2023-12-05T09:57:20.322 INFO:tasks.workunit.client.1.smithi150.stdout:2/81: rmdir d0/d3/d11 39 2023-12-05T09:57:20.322 INFO:tasks.workunit.client.1.smithi150.stdout:2/82: fdatasync d0/d3/fe 0 2023-12-05T09:57:20.328 INFO:tasks.workunit.client.1.smithi150.stdout:7/66: write d2/d4/d8/f9 [1656602,43980] 0 2023-12-05T09:57:20.332 INFO:tasks.workunit.client.1.smithi150.stdout:1/95: rmdir d6/d8/db/de 39 2023-12-05T09:57:20.336 INFO:tasks.workunit.client.1.smithi150.stdout:1/96: symlink d6/l1f 0 2023-12-05T09:57:20.337 INFO:tasks.workunit.client.1.smithi150.stdout:1/97: creat d6/d8/db/f20 x:0 0 0 2023-12-05T09:57:20.340 INFO:tasks.workunit.client.0.smithi100.stdout:1/103: read db/f19 [2041191,22448] 0 2023-12-05T09:57:20.340 INFO:tasks.workunit.client.0.smithi100.stdout:1/104: creat db/f20 x:0 0 0 2023-12-05T09:57:20.340 INFO:tasks.workunit.client.0.smithi100.stdout:0/156: dwrite da/fd [0,4194304] 0 2023-12-05T09:57:20.342 INFO:tasks.workunit.client.1.smithi150.stdout:1/98: rename d6/ld to d6/d8/db/de/l21 0 2023-12-05T09:57:20.346 INFO:tasks.workunit.client.1.smithi150.stdout:1/99: link d6/f1a d6/d8/db/de/f22 0 2023-12-05T09:57:20.346 INFO:tasks.workunit.client.1.smithi150.stdout:1/100: chown d6/d8/f11 1229157 1 2023-12-05T09:57:20.352 INFO:tasks.workunit.client.1.smithi150.stdout:1/101: rename d6/d8/l15 to d6/d8/db/d1b/l23 0 2023-12-05T09:57:20.352 INFO:tasks.workunit.client.1.smithi150.stdout:1/102: truncate d6/d8/db/de/f14 6151 0 2023-12-05T09:57:20.355 INFO:tasks.workunit.client.1.smithi150.stdout:2/83: dread d0/d3/fe [0,4194304] 0 2023-12-05T09:57:20.355 INFO:tasks.workunit.client.1.smithi150.stdout:9/70: dread d3/f4 [4194304,4194304] 0 2023-12-05T09:57:20.355 INFO:tasks.workunit.client.0.smithi100.stdout:3/177: dwrite d0/d2/de/d12/f29 [4194304,4194304] 0 2023-12-05T09:57:20.358 INFO:tasks.workunit.client.1.smithi150.stdout:1/103: rename c0 to d6/d8/db/c24 0 2023-12-05T09:57:20.358 INFO:tasks.workunit.client.1.smithi150.stdout:1/104: chown d6/d8/db/de/l21 3 1 2023-12-05T09:57:20.361 INFO:tasks.workunit.client.1.smithi150.stdout:2/84: symlink d0/d3/d5/l1c 0 2023-12-05T09:57:20.361 INFO:tasks.workunit.client.0.smithi100.stdout:5/149: dwrite d0/d4/fa [4194304,4194304] 0 2023-12-05T09:57:20.362 INFO:tasks.workunit.client.0.smithi100.stdout:1/105: dread db/d12/f16 [0,4194304] 0 2023-12-05T09:57:20.364 INFO:tasks.workunit.client.0.smithi100.stdout:5/150: mknod d0/d16/d2b/c34 0 2023-12-05T09:57:20.364 INFO:tasks.workunit.client.0.smithi100.stdout:5/151: truncate d0/d1b/f32 760485 0 2023-12-05T09:57:20.365 INFO:tasks.workunit.client.0.smithi100.stdout:1/106: symlink db/l21 0 2023-12-05T09:57:20.366 INFO:tasks.workunit.client.1.smithi150.stdout:2/85: mkdir d0/d3/d11/d1d 0 2023-12-05T09:57:20.366 INFO:tasks.workunit.client.1.smithi150.stdout:2/86: fsync d0/d3/f14 0 2023-12-05T09:57:20.368 INFO:tasks.workunit.client.0.smithi100.stdout:5/152: getdents d0/d4/d5 0 2023-12-05T09:57:20.369 INFO:tasks.workunit.client.0.smithi100.stdout:5/153: mkdir d0/d4/d14/d35 0 2023-12-05T09:57:20.370 INFO:tasks.workunit.client.0.smithi100.stdout:6/457: sync 2023-12-05T09:57:20.371 INFO:tasks.workunit.client.0.smithi100.stdout:6/458: fdatasync d7/d2d/f40 0 2023-12-05T09:57:20.371 INFO:tasks.workunit.client.0.smithi100.stdout:5/154: creat d0/f36 x:0 0 0 2023-12-05T09:57:20.371 INFO:tasks.workunit.client.0.smithi100.stdout:5/155: readlink d0/d1f/l2f 0 2023-12-05T09:57:20.372 INFO:tasks.workunit.client.0.smithi100.stdout:5/156: mkdir d0/d16/d37 0 2023-12-05T09:57:20.372 INFO:tasks.workunit.client.0.smithi100.stdout:0/157: dread da/f11 [4194304,4194304] 0 2023-12-05T09:57:20.374 INFO:tasks.workunit.client.0.smithi100.stdout:6/459: write d7/d27/d35/f8b [25924,106933] 0 2023-12-05T09:57:20.375 INFO:tasks.workunit.client.0.smithi100.stdout:6/460: truncate d7/f16 7075835 0 2023-12-05T09:57:20.375 INFO:tasks.workunit.client.0.smithi100.stdout:6/461: dread - d7/d2d/d6a/d7c/f84 zero size 2023-12-05T09:57:20.375 INFO:tasks.workunit.client.0.smithi100.stdout:0/158: truncate da/d1b/f26 63626 0 2023-12-05T09:57:20.376 INFO:tasks.workunit.client.1.smithi150.stdout:0/76: dwrite d5/fd [0,4194304] 0 2023-12-05T09:57:20.376 INFO:tasks.workunit.client.1.smithi150.stdout:3/97: dwrite d6/d9/dd/f13 [0,4194304] 0 2023-12-05T09:57:20.376 INFO:tasks.workunit.client.1.smithi150.stdout:3/98: chown d6/ff 15877 1 2023-12-05T09:57:20.383 INFO:tasks.workunit.client.1.smithi150.stdout:3/99: dread d6/ff [0,4194304] 0 2023-12-05T09:57:20.384 INFO:tasks.workunit.client.0.smithi100.stdout:1/107: dread db/f19 [0,4194304] 0 2023-12-05T09:57:20.384 INFO:tasks.workunit.client.0.smithi100.stdout:1/108: read db/ff [465679,89419] 0 2023-12-05T09:57:20.387 INFO:tasks.workunit.client.1.smithi150.stdout:1/105: dread d6/d8/db/de/ff [0,4194304] 0 2023-12-05T09:57:20.387 INFO:tasks.workunit.client.1.smithi150.stdout:3/100: creat d6/f20 x:0 0 0 2023-12-05T09:57:20.389 INFO:tasks.workunit.client.0.smithi100.stdout:1/109: link db/l1b db/l22 0 2023-12-05T09:57:20.389 INFO:tasks.workunit.client.0.smithi100.stdout:6/462: dread d7/d11/d1a/f52 [0,4194304] 0 2023-12-05T09:57:20.389 INFO:tasks.workunit.client.0.smithi100.stdout:1/110: dread - db/f20 zero size 2023-12-05T09:57:20.389 INFO:tasks.workunit.client.0.smithi100.stdout:6/463: creat d7/d27/f9a x:0 0 0 2023-12-05T09:57:20.390 INFO:tasks.workunit.client.1.smithi150.stdout:4/46: dwrite d0/f8 [4194304,4194304] 0 2023-12-05T09:57:20.392 INFO:tasks.workunit.client.1.smithi150.stdout:7/67: dwrite d2/d4/d8/f9 [0,4194304] 0 2023-12-05T09:57:20.393 INFO:tasks.workunit.client.1.smithi150.stdout:0/77: rmdir d5 39 2023-12-05T09:57:20.393 INFO:tasks.workunit.client.1.smithi150.stdout:1/106: symlink d6/d8/db/l25 0 2023-12-05T09:57:20.393 INFO:tasks.workunit.client.1.smithi150.stdout:1/107: fsync d6/d8/db/de/f13 0 2023-12-05T09:57:20.394 INFO:tasks.workunit.client.1.smithi150.stdout:3/101: mknod d6/d9/dd/c21 0 2023-12-05T09:57:20.394 INFO:tasks.workunit.client.1.smithi150.stdout:3/102: write d6/d9/f1d [1028004,12930] 0 2023-12-05T09:57:20.394 INFO:tasks.workunit.client.1.smithi150.stdout:3/103: write d6/d9/f1d [1185587,88824] 0 2023-12-05T09:57:20.394 INFO:tasks.workunit.client.0.smithi100.stdout:1/111: symlink db/l23 0 2023-12-05T09:57:20.395 INFO:tasks.workunit.client.0.smithi100.stdout:1/112: readlink db/l23 0 2023-12-05T09:57:20.397 INFO:tasks.workunit.client.0.smithi100.stdout:0/159: read da/f2c [1182635,26568] 0 2023-12-05T09:57:20.402 INFO:tasks.workunit.client.0.smithi100.stdout:6/464: fdatasync d7/d11/d82/f29 0 2023-12-05T09:57:20.403 INFO:tasks.workunit.client.0.smithi100.stdout:6/465: chown d7/d27/d72/f87 5 1 2023-12-05T09:57:20.403 INFO:tasks.workunit.client.0.smithi100.stdout:3/178: dwrite d0/d2/de/d11/f21 [0,4194304] 0 2023-12-05T09:57:20.403 INFO:tasks.workunit.client.0.smithi100.stdout:3/179: creat d0/d2/de/d11/f30 x:0 0 0 2023-12-05T09:57:20.406 INFO:tasks.workunit.client.0.smithi100.stdout:1/113: dread db/ff [0,4194304] 0 2023-12-05T09:57:20.406 INFO:tasks.workunit.client.0.smithi100.stdout:0/160: symlink da/l34 0 2023-12-05T09:57:20.406 INFO:tasks.workunit.client.0.smithi100.stdout:0/161: fdatasync da/f11 0 2023-12-05T09:57:20.412 INFO:tasks.workunit.client.0.smithi100.stdout:6/466: creat d7/d11/d1a/f9b x:0 0 0 2023-12-05T09:57:20.413 INFO:tasks.workunit.client.1.smithi150.stdout:3/104: write d6/d19/f1e [2901016,110571] 0 2023-12-05T09:57:20.413 INFO:tasks.workunit.client.1.smithi150.stdout:3/105: read - d6/f17 zero size 2023-12-05T09:57:20.417 INFO:tasks.workunit.client.1.smithi150.stdout:7/68: mkdir d2/d4/d8/d13 0 2023-12-05T09:57:20.419 INFO:tasks.workunit.client.0.smithi100.stdout:3/180: link d0/d10/c2f d0/d2/de/d12/c31 0 2023-12-05T09:57:20.419 INFO:tasks.workunit.client.0.smithi100.stdout:3/181: creat d0/d2/de/d12/f32 x:0 0 0 2023-12-05T09:57:20.422 INFO:tasks.workunit.client.1.smithi150.stdout:2/87: dwrite d0/d3/f14 [0,4194304] 0 2023-12-05T09:57:20.423 INFO:tasks.workunit.client.1.smithi150.stdout:0/78: rename d5/f10 to d5/d11/f18 0 2023-12-05T09:57:20.427 INFO:tasks.workunit.client.0.smithi100.stdout:0/162: rmdir da/d1b 39 2023-12-05T09:57:20.427 INFO:tasks.workunit.client.0.smithi100.stdout:0/163: read - da/f2d zero size 2023-12-05T09:57:20.437 INFO:tasks.workunit.client.1.smithi150.stdout:8/77: sync 2023-12-05T09:57:20.437 INFO:tasks.workunit.client.1.smithi150.stdout:5/68: sync 2023-12-05T09:57:20.437 INFO:tasks.workunit.client.1.smithi150.stdout:6/76: sync 2023-12-05T09:57:20.437 INFO:tasks.workunit.client.1.smithi150.stdout:5/69: creat d1/d3/d6/f1c x:0 0 0 2023-12-05T09:57:20.438 INFO:tasks.workunit.client.1.smithi150.stdout:5/70: write d1/d3/d6/f8 [598849,124457] 0 2023-12-05T09:57:20.438 INFO:tasks.workunit.client.1.smithi150.stdout:5/71: getdents d1 0 2023-12-05T09:57:20.440 INFO:tasks.workunit.client.0.smithi100.stdout:5/157: dwrite d0/d4/d5/f13 [0,4194304] 0 2023-12-05T09:57:20.442 INFO:tasks.workunit.client.1.smithi150.stdout:7/69: unlink d2/d4/f10 0 2023-12-05T09:57:20.450 INFO:tasks.workunit.client.0.smithi100.stdout:0/164: dread da/d1b/f26 [0,4194304] 0 2023-12-05T09:57:20.451 INFO:tasks.workunit.client.0.smithi100.stdout:0/165: fdatasync da/f11 0 2023-12-05T09:57:20.451 INFO:tasks.workunit.client.0.smithi100.stdout:0/166: chown da/l34 476042 1 2023-12-05T09:57:20.458 INFO:tasks.workunit.client.1.smithi150.stdout:0/79: dread d5/fd [0,4194304] 0 2023-12-05T09:57:20.471 INFO:tasks.workunit.client.1.smithi150.stdout:5/72: write d1/d3/fb [1524219,18770] 0 2023-12-05T09:57:20.486 INFO:tasks.workunit.client.1.smithi150.stdout:7/70: dwrite d2/d4/fc [0,4194304] 0 2023-12-05T09:57:20.486 INFO:tasks.workunit.client.1.smithi150.stdout:7/71: chown d2/d4 348585 1 2023-12-05T09:57:20.486 INFO:tasks.workunit.client.1.smithi150.stdout:7/72: write d2/d4/fc [4763628,73893] 0 2023-12-05T09:57:20.500 INFO:tasks.workunit.client.1.smithi150.stdout:4/47: dwrite d0/f8 [0,4194304] 0 2023-12-05T09:57:20.502 INFO:tasks.workunit.client.1.smithi150.stdout:1/108: rmdir d6 39 2023-12-05T09:57:20.506 INFO:tasks.workunit.client.1.smithi150.stdout:8/78: mknod d0/d8/c17 0 2023-12-05T09:57:20.506 INFO:tasks.workunit.client.1.smithi150.stdout:8/79: fsync d0/d8/f11 0 2023-12-05T09:57:20.512 INFO:tasks.workunit.client.1.smithi150.stdout:3/106: mkdir d6/d22 0 2023-12-05T09:57:20.514 INFO:tasks.workunit.client.0.smithi100.stdout:3/182: dwrite d0/d2/de/d12/f28 [0,4194304] 0 2023-12-05T09:57:20.514 INFO:tasks.workunit.client.0.smithi100.stdout:3/183: dread - d0/d4/f1e zero size 2023-12-05T09:57:20.515 INFO:tasks.workunit.client.0.smithi100.stdout:3/184: write d0/d4/f1f [851991,3392] 0 2023-12-05T09:57:20.515 INFO:tasks.workunit.client.1.smithi150.stdout:0/80: mknod d5/d11/c19 0 2023-12-05T09:57:20.516 INFO:tasks.workunit.client.0.smithi100.stdout:1/114: dwrite db/ff [0,4194304] 0 2023-12-05T09:57:20.517 INFO:tasks.workunit.client.0.smithi100.stdout:5/158: dwrite d0/d4/d5/df/f20 [0,4194304] 0 2023-12-05T09:57:20.517 INFO:tasks.workunit.client.0.smithi100.stdout:6/467: write d7/d27/d35/d5a/f65 [1752800,63714] 0 2023-12-05T09:57:20.518 INFO:tasks.workunit.client.1.smithi150.stdout:7/73: creat d2/d4/d8/d13/f14 x:0 0 0 2023-12-05T09:57:20.525 INFO:tasks.workunit.client.0.smithi100.stdout:3/185: mkdir d0/d2/d33 0 2023-12-05T09:57:20.525 INFO:tasks.workunit.client.0.smithi100.stdout:3/186: stat d0/d2/de/d12/f28 0 2023-12-05T09:57:20.525 INFO:tasks.workunit.client.0.smithi100.stdout:3/187: fsync d0/d4/f1e 0 2023-12-05T09:57:20.525 INFO:tasks.workunit.client.0.smithi100.stdout:3/188: write d0/d10/f2a [1238164,74887] 0 2023-12-05T09:57:20.525 INFO:tasks.workunit.client.0.smithi100.stdout:2/220: sync 2023-12-05T09:57:20.529 INFO:tasks.workunit.client.1.smithi150.stdout:1/109: mknod d6/d8/c26 0 2023-12-05T09:57:20.529 INFO:tasks.workunit.client.1.smithi150.stdout:1/110: fsync d6/d8/f11 0 2023-12-05T09:57:20.532 INFO:tasks.workunit.client.1.smithi150.stdout:8/80: rename d0/d8/ca to d0/d8/c18 0 2023-12-05T09:57:20.532 INFO:tasks.workunit.client.1.smithi150.stdout:8/81: write d0/f13 [994891,14715] 0 2023-12-05T09:57:20.533 INFO:tasks.workunit.client.1.smithi150.stdout:8/82: creat d0/f19 x:0 0 0 2023-12-05T09:57:20.533 INFO:tasks.workunit.client.0.smithi100.stdout:1/115: mknod db/c24 0 2023-12-05T09:57:20.533 INFO:tasks.workunit.client.0.smithi100.stdout:1/116: stat db/fc 0 2023-12-05T09:57:20.533 INFO:tasks.workunit.client.0.smithi100.stdout:5/159: dread d0/d27/f28 [0,4194304] 0 2023-12-05T09:57:20.534 INFO:tasks.workunit.client.1.smithi150.stdout:6/77: mknod d2/da/c1b 0 2023-12-05T09:57:20.536 INFO:tasks.workunit.client.1.smithi150.stdout:5/73: dwrite d1/d3/d6/f8 [0,4194304] 0 2023-12-05T09:57:20.536 INFO:tasks.workunit.client.1.smithi150.stdout:5/74: creat d1/d3/f1d x:0 0 0 2023-12-05T09:57:20.536 INFO:tasks.workunit.client.1.smithi150.stdout:5/75: stat d1/d3/d6/f8 0 2023-12-05T09:57:20.536 INFO:tasks.workunit.client.1.smithi150.stdout:5/76: truncate d1/d3/f1d 1013106 0 2023-12-05T09:57:20.536 INFO:tasks.workunit.client.1.smithi150.stdout:3/107: mknod d6/d9/c23 0 2023-12-05T09:57:20.536 INFO:tasks.workunit.client.1.smithi150.stdout:3/108: chown d6/d22 92493903 1 2023-12-05T09:57:20.536 INFO:tasks.workunit.client.1.smithi150.stdout:3/109: dread - d6/f17 zero size 2023-12-05T09:57:20.536 INFO:tasks.workunit.client.1.smithi150.stdout:3/110: dread - d6/f17 zero size 2023-12-05T09:57:20.537 INFO:tasks.workunit.client.0.smithi100.stdout:3/189: mknod d0/d10/c34 0 2023-12-05T09:57:20.537 INFO:tasks.workunit.client.1.smithi150.stdout:7/74: mknod d2/d4/d8/d13/c15 0 2023-12-05T09:57:20.537 INFO:tasks.workunit.client.1.smithi150.stdout:7/75: dread - d2/f12 zero size 2023-12-05T09:57:20.538 INFO:tasks.workunit.client.0.smithi100.stdout:2/221: creat d7/da/d18/d1b/d2c/f49 x:0 0 0 2023-12-05T09:57:20.539 INFO:tasks.workunit.client.1.smithi150.stdout:1/111: creat d6/d8/f27 x:0 0 0 2023-12-05T09:57:20.540 INFO:tasks.workunit.client.0.smithi100.stdout:1/117: symlink db/d12/l25 0 2023-12-05T09:57:20.540 INFO:tasks.workunit.client.0.smithi100.stdout:1/118: read db/d12/f16 [63546,78724] 0 2023-12-05T09:57:20.540 INFO:tasks.workunit.client.0.smithi100.stdout:1/119: read db/f19 [1880709,19745] 0 2023-12-05T09:57:20.541 INFO:tasks.workunit.client.1.smithi150.stdout:9/71: sync 2023-12-05T09:57:20.543 INFO:tasks.workunit.client.1.smithi150.stdout:3/111: dread d6/ff [0,4194304] 0 2023-12-05T09:57:20.543 INFO:tasks.workunit.client.0.smithi100.stdout:5/160: creat d0/d4/d14/f38 x:0 0 0 2023-12-05T09:57:20.543 INFO:tasks.workunit.client.0.smithi100.stdout:5/161: creat d0/d1b/f39 x:0 0 0 2023-12-05T09:57:20.543 INFO:tasks.workunit.client.0.smithi100.stdout:9/214: sync 2023-12-05T09:57:20.545 INFO:tasks.workunit.client.0.smithi100.stdout:9/215: write d7/d10/f14 [1488166,115324] 0 2023-12-05T09:57:20.545 INFO:tasks.workunit.client.0.smithi100.stdout:3/190: creat d0/d2/d33/f35 x:0 0 0 2023-12-05T09:57:20.549 INFO:tasks.workunit.client.0.smithi100.stdout:2/222: link d7/da/d18/d1b/d2c/d3f/d46/f2a d7/da/d13/f4a 0 2023-12-05T09:57:20.550 INFO:tasks.workunit.client.0.smithi100.stdout:2/223: chown d7/f43 80424550 1 2023-12-05T09:57:20.553 INFO:tasks.workunit.client.0.smithi100.stdout:1/120: mkdir db/d12/d1e/d26 0 2023-12-05T09:57:20.558 INFO:tasks.workunit.client.0.smithi100.stdout:5/162: rename d0/d16/f1d to d0/d16/d2b/f3a 0 2023-12-05T09:57:20.560 INFO:tasks.workunit.client.0.smithi100.stdout:9/216: mknod d7/d1b/d22/d2a/c46 0 2023-12-05T09:57:20.563 INFO:tasks.workunit.client.1.smithi150.stdout:7/76: mkdir d2/d4/d16 0 2023-12-05T09:57:20.563 INFO:tasks.workunit.client.1.smithi150.stdout:7/77: write d2/d4/d8/d13/f14 [321738,27601] 0 2023-12-05T09:57:20.564 INFO:tasks.workunit.client.0.smithi100.stdout:3/191: creat d0/f36 x:0 0 0 2023-12-05T09:57:20.565 INFO:tasks.workunit.client.1.smithi150.stdout:1/112: rename d6/d8/l10 to d6/d8/l28 0 2023-12-05T09:57:20.565 INFO:tasks.workunit.client.1.smithi150.stdout:1/113: fsync d6/d8/db/de/f22 0 2023-12-05T09:57:20.567 INFO:tasks.workunit.client.0.smithi100.stdout:2/224: creat d7/f4b x:0 0 0 2023-12-05T09:57:20.568 INFO:tasks.workunit.client.1.smithi150.stdout:9/72: truncate d3/f4 6504324 0 2023-12-05T09:57:20.570 INFO:tasks.workunit.client.1.smithi150.stdout:2/88: sync 2023-12-05T09:57:20.575 INFO:tasks.workunit.client.0.smithi100.stdout:5/163: rmdir d0/d4/d14 39 2023-12-05T09:57:20.575 INFO:tasks.workunit.client.0.smithi100.stdout:5/164: write d0/d1b/f33 [774198,129352] 0 2023-12-05T09:57:20.576 INFO:tasks.workunit.client.0.smithi100.stdout:5/165: creat d0/d16/f3b x:0 0 0 2023-12-05T09:57:20.576 INFO:tasks.workunit.client.0.smithi100.stdout:5/166: chown d0/d16/d2b/f3a 39 1 2023-12-05T09:57:20.576 INFO:tasks.workunit.client.1.smithi150.stdout:0/81: dwrite d5/fc [0,4194304] 0 2023-12-05T09:57:20.576 INFO:tasks.workunit.client.1.smithi150.stdout:0/82: write d5/ff [736994,126303] 0 2023-12-05T09:57:20.576 INFO:tasks.workunit.client.1.smithi150.stdout:0/83: write d5/fa [1896792,26319] 0 2023-12-05T09:57:20.579 INFO:tasks.workunit.client.0.smithi100.stdout:1/121: read db/fc [3183333,42030] 0 2023-12-05T09:57:20.580 INFO:tasks.workunit.client.0.smithi100.stdout:6/468: dwrite d7/d11/d1a/f52 [0,4194304] 0 2023-12-05T09:57:20.580 INFO:tasks.workunit.client.0.smithi100.stdout:6/469: stat d7/d11/d82/c36 0 2023-12-05T09:57:20.580 INFO:tasks.workunit.client.0.smithi100.stdout:6/470: dread - d7/d27/f5b zero size 2023-12-05T09:57:20.580 INFO:tasks.workunit.client.0.smithi100.stdout:6/471: truncate d7/f56 542595 0 2023-12-05T09:57:20.581 INFO:tasks.workunit.client.0.smithi100.stdout:9/217: dread d7/fb [0,4194304] 0 2023-12-05T09:57:20.581 INFO:tasks.workunit.client.0.smithi100.stdout:2/225: dread d7/f43 [0,4194304] 0 2023-12-05T09:57:20.586 INFO:tasks.workunit.client.0.smithi100.stdout:3/192: write d0/d2/de/d11/f21 [4025536,40745] 0 2023-12-05T09:57:20.586 INFO:tasks.workunit.client.0.smithi100.stdout:5/167: mkdir d0/d1b/d3c 0 2023-12-05T09:57:20.586 INFO:tasks.workunit.client.0.smithi100.stdout:5/168: fsync d0/d16/f1e 0 2023-12-05T09:57:20.588 INFO:tasks.workunit.client.1.smithi150.stdout:3/112: mknod d6/d22/c24 0 2023-12-05T09:57:20.588 INFO:tasks.workunit.client.1.smithi150.stdout:8/83: getdents d0/d8/d14 0 2023-12-05T09:57:20.588 INFO:tasks.workunit.client.1.smithi150.stdout:8/84: chown d0/d8/f11 400 1 2023-12-05T09:57:20.588 INFO:tasks.workunit.client.1.smithi150.stdout:5/77: getdents d1/d3/d6 0 2023-12-05T09:57:20.588 INFO:tasks.workunit.client.1.smithi150.stdout:2/89: creat d0/d3/d5/f1e x:0 0 0 2023-12-05T09:57:20.594 INFO:tasks.workunit.client.0.smithi100.stdout:1/122: rename db/f19 to db/d12/d1e/d26/f27 0 2023-12-05T09:57:20.595 INFO:tasks.workunit.client.1.smithi150.stdout:0/84: dread d5/d11/d16/f17 [0,4194304] 0 2023-12-05T09:57:20.595 INFO:tasks.workunit.client.1.smithi150.stdout:0/85: write d5/fa [5448613,41289] 0 2023-12-05T09:57:20.599 INFO:tasks.workunit.client.1.smithi150.stdout:5/78: mkdir d1/d3/d1e 0 2023-12-05T09:57:20.604 INFO:tasks.workunit.client.1.smithi150.stdout:2/90: link d0/d3/c9 d0/d3/d11/d1d/c1f 0 2023-12-05T09:57:20.604 INFO:tasks.workunit.client.1.smithi150.stdout:2/91: write d0/d3/d5/d10/f19 [283283,100953] 0 2023-12-05T09:57:20.609 INFO:tasks.workunit.client.1.smithi150.stdout:6/78: dwrite d2/da/f1a [0,4194304] 0 2023-12-05T09:57:20.609 INFO:tasks.workunit.client.1.smithi150.stdout:6/79: creat d2/f1c x:0 0 0 2023-12-05T09:57:20.610 INFO:tasks.workunit.client.0.smithi100.stdout:2/226: rename d7/da/d18/c20 to d7/da/d18/d1b/d2c/d3f/c4c 0 2023-12-05T09:57:20.612 INFO:tasks.workunit.client.1.smithi150.stdout:5/79: truncate d1/d3/f7 599225 0 2023-12-05T09:57:20.614 INFO:tasks.workunit.client.0.smithi100.stdout:3/193: dread d0/d4/f1f [0,4194304] 0 2023-12-05T09:57:20.614 INFO:tasks.workunit.client.1.smithi150.stdout:5/80: symlink d1/d3/d6/d11/l1f 0 2023-12-05T09:57:20.614 INFO:tasks.workunit.client.0.smithi100.stdout:9/218: dread d7/fd [0,4194304] 0 2023-12-05T09:57:20.621 INFO:tasks.workunit.client.0.smithi100.stdout:1/123: getdents db/d12/d1e 0 2023-12-05T09:57:20.621 INFO:tasks.workunit.client.0.smithi100.stdout:1/124: read db/d12/d1e/d26/f27 [3383456,74555] 0 2023-12-05T09:57:20.621 INFO:tasks.workunit.client.0.smithi100.stdout:1/125: fsync db/d12/f13 0 2023-12-05T09:57:20.621 INFO:tasks.workunit.client.0.smithi100.stdout:1/126: write db/d12/f13 [2981318,113563] 0 2023-12-05T09:57:20.621 INFO:tasks.workunit.client.0.smithi100.stdout:2/227: rename d7/da/d18/d1b/d2c/d41 to d7/da/d18/d21/d4d 0 2023-12-05T09:57:20.629 INFO:tasks.workunit.client.0.smithi100.stdout:1/127: symlink db/d12/l28 0 2023-12-05T09:57:20.644 INFO:tasks.workunit.client.0.smithi100.stdout:6/472: dread d7/d11/f20 [0,4194304] 0 2023-12-05T09:57:20.644 INFO:tasks.workunit.client.0.smithi100.stdout:6/473: chown d7/d2d/f4a 86 1 2023-12-05T09:57:20.645 INFO:tasks.workunit.client.0.smithi100.stdout:6/474: truncate d7/d27/f2e 13703 0 2023-12-05T09:57:20.645 INFO:tasks.workunit.client.0.smithi100.stdout:6/475: creat d7/d2d/f9c x:0 0 0 2023-12-05T09:57:20.645 INFO:tasks.workunit.client.0.smithi100.stdout:6/476: write d7/d2d/f43 [4050615,122418] 0 2023-12-05T09:57:20.654 INFO:tasks.workunit.client.1.smithi150.stdout:7/78: dwrite d2/d4/fc [4194304,4194304] 0 2023-12-05T09:57:20.663 INFO:tasks.workunit.client.0.smithi100.stdout:1/128: write db/f1a [2454878,9902] 0 2023-12-05T09:57:20.663 INFO:tasks.workunit.client.0.smithi100.stdout:1/129: write db/d12/f14 [191115,92093] 0 2023-12-05T09:57:20.663 INFO:tasks.workunit.client.0.smithi100.stdout:1/130: write db/f1a [934886,15653] 0 2023-12-05T09:57:20.664 INFO:tasks.workunit.client.0.smithi100.stdout:6/477: write d7/d2d/f40 [6707950,86605] 0 2023-12-05T09:57:20.664 INFO:tasks.workunit.client.0.smithi100.stdout:1/131: creat db/f29 x:0 0 0 2023-12-05T09:57:20.666 INFO:tasks.workunit.client.0.smithi100.stdout:1/132: link db/c24 db/c2a 0 2023-12-05T09:57:20.668 INFO:tasks.workunit.client.0.smithi100.stdout:1/133: unlink db/f29 0 2023-12-05T09:57:20.668 INFO:tasks.workunit.client.0.smithi100.stdout:1/134: read - db/f20 zero size 2023-12-05T09:57:20.668 INFO:tasks.workunit.client.0.smithi100.stdout:1/135: chown db/l1f 58 1 2023-12-05T09:57:20.669 INFO:tasks.workunit.client.0.smithi100.stdout:3/194: dread d0/d2/de/d11/f21 [0,4194304] 0 2023-12-05T09:57:20.669 INFO:tasks.workunit.client.0.smithi100.stdout:1/136: mknod db/d12/d1e/d26/c2b 0 2023-12-05T09:57:20.671 INFO:tasks.workunit.client.0.smithi100.stdout:3/195: creat d0/d2/f37 x:0 0 0 2023-12-05T09:57:20.671 INFO:tasks.workunit.client.0.smithi100.stdout:3/196: truncate d0/d2/de/d11/f21 4839188 0 2023-12-05T09:57:20.671 INFO:tasks.workunit.client.0.smithi100.stdout:2/228: write d7/da/f25 [1750287,116705] 0 2023-12-05T09:57:20.671 INFO:tasks.workunit.client.0.smithi100.stdout:2/229: truncate d7/f43 1626219 0 2023-12-05T09:57:20.671 INFO:tasks.workunit.client.0.smithi100.stdout:2/230: write d7/da/d18/d21/f30 [853290,45008] 0 2023-12-05T09:57:20.671 INFO:tasks.workunit.client.0.smithi100.stdout:2/231: write d7/da/d1a/f1c [5800225,5525] 0 2023-12-05T09:57:20.672 INFO:tasks.workunit.client.1.smithi150.stdout:9/73: dwrite d3/d9/fa [0,4194304] 0 2023-12-05T09:57:20.672 INFO:tasks.workunit.client.1.smithi150.stdout:9/74: stat d3/d9/fa 0 2023-12-05T09:57:20.674 INFO:tasks.workunit.client.0.smithi100.stdout:3/197: rename d0/d4/f1f to d0/d2/de/f38 0 2023-12-05T09:57:20.675 INFO:tasks.workunit.client.1.smithi150.stdout:9/75: mknod d3/d9/cf 0 2023-12-05T09:57:20.680 INFO:tasks.workunit.client.0.smithi100.stdout:6/478: truncate d7/f56 615289 0 2023-12-05T09:57:20.680 INFO:tasks.workunit.client.0.smithi100.stdout:6/479: creat d7/d27/d35/d5a/f9d x:0 0 0 2023-12-05T09:57:20.680 INFO:tasks.workunit.client.1.smithi150.stdout:1/114: dwrite d6/d8/db/de/ff [0,4194304] 0 2023-12-05T09:57:20.681 INFO:tasks.workunit.client.1.smithi150.stdout:8/85: dwrite d0/f19 [0,4194304] 0 2023-12-05T09:57:20.681 INFO:tasks.workunit.client.1.smithi150.stdout:8/86: chown d0/ce 5035573 1 2023-12-05T09:57:20.681 INFO:tasks.workunit.client.1.smithi150.stdout:9/76: link d3/d9/cf d3/d9/dc/c10 0 2023-12-05T09:57:20.681 INFO:tasks.workunit.client.1.smithi150.stdout:9/77: chown d3/f4 0 1 2023-12-05T09:57:20.683 INFO:tasks.workunit.client.0.smithi100.stdout:5/169: dwrite d0/d1b/f32 [0,4194304] 0 2023-12-05T09:57:20.684 INFO:tasks.workunit.client.0.smithi100.stdout:5/170: write d0/f3 [1637876,100439] 0 2023-12-05T09:57:20.686 INFO:tasks.workunit.client.0.smithi100.stdout:2/232: mkdir d7/da/d13/d4e 0 2023-12-05T09:57:20.686 INFO:tasks.workunit.client.0.smithi100.stdout:2/233: stat d7/l15 0 2023-12-05T09:57:20.686 INFO:tasks.workunit.client.0.smithi100.stdout:2/234: readlink d7/da/d18/l48 0 2023-12-05T09:57:20.688 INFO:tasks.workunit.client.0.smithi100.stdout:9/219: dwrite d7/ff [0,4194304] 0 2023-12-05T09:57:20.688 INFO:tasks.workunit.client.1.smithi150.stdout:2/92: dwrite d0/f7 [0,4194304] 0 2023-12-05T09:57:20.690 INFO:tasks.workunit.client.1.smithi150.stdout:0/86: dwrite d5/ff [0,4194304] 0 2023-12-05T09:57:20.691 INFO:tasks.workunit.client.1.smithi150.stdout:3/113: dwrite d6/f1f [0,4194304] 0 2023-12-05T09:57:20.694 INFO:tasks.workunit.client.0.smithi100.stdout:3/198: rmdir d0/d10 39 2023-12-05T09:57:20.694 INFO:tasks.workunit.client.0.smithi100.stdout:3/199: chown d0/d2/de/d11/l2b 11036 1 2023-12-05T09:57:20.696 INFO:tasks.workunit.client.0.smithi100.stdout:7/88: sync 2023-12-05T09:57:20.696 INFO:tasks.workunit.client.1.smithi150.stdout:2/93: dread d0/d3/fe [0,4194304] 0 2023-12-05T09:57:20.699 INFO:tasks.workunit.client.0.smithi100.stdout:6/480: stat d7/d11/c47 0 2023-12-05T09:57:20.701 INFO:tasks.workunit.client.0.smithi100.stdout:1/137: dread db/d12/f14 [0,4194304] 0 2023-12-05T09:57:20.703 INFO:tasks.workunit.client.0.smithi100.stdout:9/220: dread d7/fb [0,4194304] 0 2023-12-05T09:57:20.703 INFO:tasks.workunit.client.0.smithi100.stdout:9/221: rename d7/d10 to d7/d10/d32/d47 22 2023-12-05T09:57:20.703 INFO:tasks.workunit.client.0.smithi100.stdout:9/222: truncate d7/d20/f2c 4770223 0 2023-12-05T09:57:20.704 INFO:tasks.workunit.client.0.smithi100.stdout:9/223: creat d7/d1b/d22/d2a/f48 x:0 0 0 2023-12-05T09:57:20.706 INFO:tasks.workunit.client.1.smithi150.stdout:1/115: mknod d6/d8/db/c29 0 2023-12-05T09:57:20.709 INFO:tasks.workunit.client.1.smithi150.stdout:5/81: dread d1/d3/d6/f8 [0,4194304] 0 2023-12-05T09:57:20.710 INFO:tasks.workunit.client.1.smithi150.stdout:0/87: read d5/ff [1751114,2175] 0 2023-12-05T09:57:20.710 INFO:tasks.workunit.client.1.smithi150.stdout:5/82: write d1/d3/f1d [1658825,127055] 0 2023-12-05T09:57:20.713 INFO:tasks.workunit.client.1.smithi150.stdout:5/83: write d1/d3/f7 [343815,3177] 0 2023-12-05T09:57:20.714 INFO:tasks.workunit.client.0.smithi100.stdout:5/171: unlink d0/c8 0 2023-12-05T09:57:20.714 INFO:tasks.workunit.client.1.smithi150.stdout:8/87: rename d0/d8/f12 to d0/d8/d14/f1a 0 2023-12-05T09:57:20.714 INFO:tasks.workunit.client.1.smithi150.stdout:8/88: write d0/ff [655015,127082] 0 2023-12-05T09:57:20.715 INFO:tasks.workunit.client.0.smithi100.stdout:2/235: link d7/da/d1a/f45 d7/da/dc/f4f 0 2023-12-05T09:57:20.715 INFO:tasks.workunit.client.1.smithi150.stdout:6/80: dwrite d2/f13 [0,4194304] 0 2023-12-05T09:57:20.715 INFO:tasks.workunit.client.1.smithi150.stdout:6/81: chown d2/da/f1a 16241 1 2023-12-05T09:57:20.717 INFO:tasks.workunit.client.1.smithi150.stdout:2/94: dread d0/f7 [0,4194304] 0 2023-12-05T09:57:20.718 INFO:tasks.workunit.client.1.smithi150.stdout:2/95: dread - d0/d3/d11/f18 zero size 2023-12-05T09:57:20.718 INFO:tasks.workunit.client.1.smithi150.stdout:2/96: creat d0/d3/d5/d10/f20 x:0 0 0 2023-12-05T09:57:20.718 INFO:tasks.workunit.client.1.smithi150.stdout:7/79: dread d2/d4/d8/d13/f14 [0,4194304] 0 2023-12-05T09:57:20.718 INFO:tasks.workunit.client.1.smithi150.stdout:7/80: read - d2/d4/ff zero size 2023-12-05T09:57:20.724 INFO:tasks.workunit.client.1.smithi150.stdout:9/78: mknod d3/d9/dc/c11 0 2023-12-05T09:57:20.725 INFO:tasks.workunit.client.1.smithi150.stdout:0/88: mknod d5/c1a 0 2023-12-05T09:57:20.725 INFO:tasks.workunit.client.0.smithi100.stdout:3/200: mkdir d0/d10/d39 0 2023-12-05T09:57:20.727 INFO:tasks.workunit.client.0.smithi100.stdout:7/89: mknod d3/dc/d11/d13/d1b/c21 0 2023-12-05T09:57:20.727 INFO:tasks.workunit.client.0.smithi100.stdout:7/90: creat d3/dc/d11/d13/de/f22 x:0 0 0 2023-12-05T09:57:20.727 INFO:tasks.workunit.client.0.smithi100.stdout:7/91: fdatasync d3/dc/f1d 0 2023-12-05T09:57:20.728 INFO:tasks.workunit.client.1.smithi150.stdout:4/48: sync 2023-12-05T09:57:20.729 INFO:tasks.workunit.client.0.smithi100.stdout:6/481: write d7/d11/f98 [557178,102709] 0 2023-12-05T09:57:20.730 INFO:tasks.workunit.client.1.smithi150.stdout:2/97: mkdir d0/d3/d21 0 2023-12-05T09:57:20.733 INFO:tasks.workunit.client.1.smithi150.stdout:9/79: mkdir d3/d12 0 2023-12-05T09:57:20.734 INFO:tasks.workunit.client.0.smithi100.stdout:9/224: mknod d7/d10/c49 0 2023-12-05T09:57:20.735 INFO:tasks.workunit.client.1.smithi150.stdout:3/114: mkdir d6/d25 0 2023-12-05T09:57:20.736 INFO:tasks.workunit.client.0.smithi100.stdout:5/172: symlink d0/d16/l3d 0 2023-12-05T09:57:20.738 INFO:tasks.workunit.client.1.smithi150.stdout:0/89: mkdir d5/d1b 0 2023-12-05T09:57:20.738 INFO:tasks.workunit.client.1.smithi150.stdout:0/90: rename d5 to d5/d11/d16/d1c 22 2023-12-05T09:57:20.739 INFO:tasks.workunit.client.0.smithi100.stdout:2/236: creat d7/da/d2b/f50 x:0 0 0 2023-12-05T09:57:20.739 INFO:tasks.workunit.client.1.smithi150.stdout:6/82: mknod d2/da/c1d 0 2023-12-05T09:57:20.741 INFO:tasks.workunit.client.1.smithi150.stdout:5/84: fsync d1/d3/f1d 0 2023-12-05T09:57:20.741 INFO:tasks.workunit.client.1.smithi150.stdout:4/49: rename d0/c9 to d0/cb 0 2023-12-05T09:57:20.744 INFO:tasks.workunit.client.0.smithi100.stdout:8/89: sync 2023-12-05T09:57:20.750 INFO:tasks.workunit.client.0.smithi100.stdout:1/138: getdents db 0 2023-12-05T09:57:20.750 INFO:tasks.workunit.client.0.smithi100.stdout:1/139: fsync f9 0 2023-12-05T09:57:20.750 INFO:tasks.workunit.client.0.smithi100.stdout:0/167: sync 2023-12-05T09:57:20.750 INFO:tasks.workunit.client.0.smithi100.stdout:4/93: sync 2023-12-05T09:57:20.753 INFO:tasks.workunit.client.1.smithi150.stdout:3/115: dread d6/d9/f1d [0,4194304] 0 2023-12-05T09:57:20.753 INFO:tasks.workunit.client.1.smithi150.stdout:2/98: mkdir d0/d3/d5/d22 0 2023-12-05T09:57:20.753 INFO:tasks.workunit.client.1.smithi150.stdout:2/99: readlink d0/d3/d5/d13/d15/l17 0 2023-12-05T09:57:20.753 INFO:tasks.workunit.client.1.smithi150.stdout:0/91: mknod d5/c1d 0 2023-12-05T09:57:20.753 INFO:tasks.workunit.client.1.smithi150.stdout:5/85: symlink d1/d15/l20 0 2023-12-05T09:57:20.753 INFO:tasks.workunit.client.1.smithi150.stdout:5/86: write d1/d3/fb [4713902,128320] 0 2023-12-05T09:57:20.753 INFO:tasks.workunit.client.1.smithi150.stdout:5/87: readlink d1/d3/l4 0 2023-12-05T09:57:20.753 INFO:tasks.workunit.client.1.smithi150.stdout:5/88: truncate d1/d3/d6/f10 975867 0 2023-12-05T09:57:20.754 INFO:tasks.workunit.client.0.smithi100.stdout:9/225: rmdir d7/d1b 39 2023-12-05T09:57:20.755 INFO:tasks.workunit.client.0.smithi100.stdout:2/237: mkdir d7/da/d18/d1b/d51 0 2023-12-05T09:57:20.757 INFO:tasks.workunit.client.1.smithi150.stdout:4/50: creat d0/fc x:0 0 0 2023-12-05T09:57:20.757 INFO:tasks.workunit.client.1.smithi150.stdout:4/51: creat d0/fd x:0 0 0 2023-12-05T09:57:20.758 INFO:tasks.workunit.client.0.smithi100.stdout:6/482: symlink d7/d11/l9e 0 2023-12-05T09:57:20.765 INFO:tasks.workunit.client.1.smithi150.stdout:4/52: unlink d0/l6 0 2023-12-05T09:57:20.768 INFO:tasks.workunit.client.0.smithi100.stdout:4/94: symlink de/l19 0 2023-12-05T09:57:20.770 INFO:tasks.workunit.client.1.smithi150.stdout:4/53: symlink d0/le 0 2023-12-05T09:57:20.771 INFO:tasks.workunit.client.0.smithi100.stdout:9/226: creat d7/d1b/d22/f4a x:0 0 0 2023-12-05T09:57:20.775 INFO:tasks.workunit.client.0.smithi100.stdout:2/238: unlink d7/da/d2b/c31 0 2023-12-05T09:57:20.778 INFO:tasks.workunit.client.0.smithi100.stdout:8/90: rmdir d0 39 2023-12-05T09:57:20.779 INFO:tasks.workunit.client.0.smithi100.stdout:6/483: truncate d7/d27/d35/d5a/f65 1572741 0 2023-12-05T09:57:20.789 INFO:tasks.workunit.client.0.smithi100.stdout:1/140: getdents db/d12 0 2023-12-05T09:57:20.790 INFO:tasks.workunit.client.0.smithi100.stdout:7/92: dwrite d3/dc/f1d [0,4194304] 0 2023-12-05T09:57:20.790 INFO:tasks.workunit.client.0.smithi100.stdout:7/93: truncate d3/f1f 213144 0 2023-12-05T09:57:20.791 INFO:tasks.workunit.client.1.smithi150.stdout:1/116: dwrite d6/d8/f27 [0,4194304] 0 2023-12-05T09:57:20.793 INFO:tasks.workunit.client.1.smithi150.stdout:9/80: dwrite d3/f4 [0,4194304] 0 2023-12-05T09:57:20.794 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:20 smithi100 ceph-mon[107145]: pgmap v26: 65 pgs: 65 active+clean; 475 MiB data, 3.3 GiB used, 533 GiB / 536 GiB avail; 15 MiB/s rd, 24 MiB/s wr, 623 op/s 2023-12-05T09:57:20.805 INFO:tasks.workunit.client.0.smithi100.stdout:9/227: mknod d7/d20/c4b 0 2023-12-05T09:57:20.813 INFO:tasks.workunit.client.0.smithi100.stdout:3/201: dwrite d0/d2/de/d11/f21 [4194304,4194304] 0 2023-12-05T09:57:20.814 INFO:tasks.workunit.client.0.smithi100.stdout:3/202: chown d0/d2/de/d11/l2b 349 1 2023-12-05T09:57:20.814 INFO:tasks.workunit.client.1.smithi150.stdout:8/89: dwrite d0/f19 [4194304,4194304] 0 2023-12-05T09:57:20.819 INFO:tasks.workunit.client.0.smithi100.stdout:8/91: symlink d0/lf 0 2023-12-05T09:57:20.819 INFO:tasks.workunit.client.0.smithi100.stdout:8/92: readlink d0/l4 0 2023-12-05T09:57:20.819 INFO:tasks.workunit.client.0.smithi100.stdout:8/93: write d0/fb [695308,23999] 0 2023-12-05T09:57:20.820 INFO:tasks.workunit.client.0.smithi100.stdout:8/94: dread - d0/fc zero size 2023-12-05T09:57:20.826 INFO:tasks.workunit.client.1.smithi150.stdout:1/117: symlink d6/d8/db/de/l2a 0 2023-12-05T09:57:20.836 INFO:tasks.workunit.client.0.smithi100.stdout:7/94: creat d3/dc/d11/d13/d1b/f23 x:0 0 0 2023-12-05T09:57:20.837 INFO:tasks.workunit.client.0.smithi100.stdout:7/95: creat d3/f24 x:0 0 0 2023-12-05T09:57:20.837 INFO:tasks.workunit.client.0.smithi100.stdout:4/95: getdents de 0 2023-12-05T09:57:20.837 INFO:tasks.workunit.client.0.smithi100.stdout:4/96: dread - de/f11 zero size 2023-12-05T09:57:20.837 INFO:tasks.workunit.client.0.smithi100.stdout:4/97: fdatasync f9 0 2023-12-05T09:57:20.837 INFO:tasks.workunit.client.1.smithi150.stdout:8/90: write d0/fc [3769216,48203] 0 2023-12-05T09:57:20.838 INFO:tasks.workunit.client.1.smithi150.stdout:4/54: getdents d0 0 2023-12-05T09:57:20.842 INFO:tasks.workunit.client.0.smithi100.stdout:6/484: dread f3 [0,4194304] 0 2023-12-05T09:57:20.842 INFO:tasks.workunit.client.0.smithi100.stdout:2/239: rmdir d7/da/d18/d1b/d2c 39 2023-12-05T09:57:20.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:20 smithi150 ceph-mon[116142]: pgmap v26: 65 pgs: 65 active+clean; 475 MiB data, 3.3 GiB used, 533 GiB / 536 GiB avail; 15 MiB/s rd, 24 MiB/s wr, 623 op/s 2023-12-05T09:57:20.846 INFO:tasks.workunit.client.0.smithi100.stdout:9/228: unlink d7/d1b/d22/d25/c44 0 2023-12-05T09:57:20.846 INFO:tasks.workunit.client.1.smithi150.stdout:9/81: rename d3/d9/cf to d3/d9/c13 0 2023-12-05T09:57:20.849 INFO:tasks.workunit.client.1.smithi150.stdout:1/118: dread d6/d8/f9 [0,4194304] 0 2023-12-05T09:57:20.850 INFO:tasks.workunit.client.0.smithi100.stdout:3/203: mkdir d0/d4/d3a 0 2023-12-05T09:57:20.850 INFO:tasks.workunit.client.0.smithi100.stdout:3/204: creat d0/f3b x:0 0 0 2023-12-05T09:57:20.850 INFO:tasks.workunit.client.0.smithi100.stdout:3/205: read d0/d2/de/d11/f21 [1119703,73714] 0 2023-12-05T09:57:20.850 INFO:tasks.workunit.client.0.smithi100.stdout:5/173: dwrite d0/d4/d5/df/f20 [0,4194304] 0 2023-12-05T09:57:20.850 INFO:tasks.workunit.client.0.smithi100.stdout:5/174: chown d0/d4/d14/d35 39699 1 2023-12-05T09:57:20.850 INFO:tasks.workunit.client.0.smithi100.stdout:0/168: dwrite da/d22/f23 [0,4194304] 0 2023-12-05T09:57:20.850 INFO:tasks.workunit.client.0.smithi100.stdout:0/169: chown da/d22/d33 364 1 2023-12-05T09:57:20.850 INFO:tasks.workunit.client.0.smithi100.stdout:0/170: fdatasync da/f2d 0 2023-12-05T09:57:20.850 INFO:tasks.workunit.client.0.smithi100.stdout:0/171: read - da/f2d zero size 2023-12-05T09:57:20.851 INFO:tasks.workunit.client.0.smithi100.stdout:8/95: mknod d0/c10 0 2023-12-05T09:57:20.853 INFO:tasks.workunit.client.1.smithi150.stdout:3/116: dwrite d6/d9/dd/f13 [4194304,4194304] 0 2023-12-05T09:57:20.853 INFO:tasks.workunit.client.1.smithi150.stdout:6/83: dwrite d2/f19 [4194304,4194304] 0 2023-12-05T09:57:20.853 INFO:tasks.workunit.client.1.smithi150.stdout:2/100: dwrite d0/f16 [0,4194304] 0 2023-12-05T09:57:20.853 INFO:tasks.workunit.client.1.smithi150.stdout:2/101: dread - d0/d3/d5/d10/f20 zero size 2023-12-05T09:57:20.853 INFO:tasks.workunit.client.1.smithi150.stdout:2/102: chown d0/d3/d21 0 1 2023-12-05T09:57:20.854 INFO:tasks.workunit.client.1.smithi150.stdout:2/103: stat d0/d3/d5/d13 0 2023-12-05T09:57:20.854 INFO:tasks.workunit.client.1.smithi150.stdout:4/55: creat d0/ff x:0 0 0 2023-12-05T09:57:20.856 INFO:tasks.workunit.client.1.smithi150.stdout:8/91: unlink d0/d8/d14/f15 0 2023-12-05T09:57:20.856 INFO:tasks.workunit.client.1.smithi150.stdout:8/92: truncate d0/ff 1799925 0 2023-12-05T09:57:20.859 INFO:tasks.workunit.client.0.smithi100.stdout:7/96: unlink c2 0 2023-12-05T09:57:20.859 INFO:tasks.workunit.client.0.smithi100.stdout:4/98: symlink de/d16/l1a 0 2023-12-05T09:57:20.862 INFO:tasks.workunit.client.1.smithi150.stdout:1/119: creat d6/d8/db/f2b x:0 0 0 2023-12-05T09:57:20.862 INFO:tasks.workunit.client.1.smithi150.stdout:1/120: read f4 [133411,60680] 0 2023-12-05T09:57:20.862 INFO:tasks.workunit.client.0.smithi100.stdout:2/240: symlink d7/da/d2b/l52 0 2023-12-05T09:57:20.864 INFO:tasks.workunit.client.1.smithi150.stdout:3/117: rename d6/d9/dd/c21 to d6/d22/c26 0 2023-12-05T09:57:20.864 INFO:tasks.workunit.client.1.smithi150.stdout:3/118: readlink d6/d9/la 0 2023-12-05T09:57:20.865 INFO:tasks.workunit.client.1.smithi150.stdout:5/89: dwrite d1/d3/d6/f1c [0,4194304] 0 2023-12-05T09:57:20.869 INFO:tasks.workunit.client.0.smithi100.stdout:3/206: link d0/d2/de/d12/f28 d0/d2/f3c 0 2023-12-05T09:57:20.870 INFO:tasks.workunit.client.1.smithi150.stdout:8/93: dread d0/f13 [0,4194304] 0 2023-12-05T09:57:20.870 INFO:tasks.workunit.client.1.smithi150.stdout:8/94: readlink d0/d8/lb 0 2023-12-05T09:57:20.873 INFO:tasks.workunit.client.0.smithi100.stdout:5/175: creat d0/d1f/d25/d31/f3e x:0 0 0 2023-12-05T09:57:20.873 INFO:tasks.workunit.client.1.smithi150.stdout:1/121: dread d6/d8/db/de/f22 [0,4194304] 0 2023-12-05T09:57:20.873 INFO:tasks.workunit.client.1.smithi150.stdout:1/122: truncate f4 1103069 0 2023-12-05T09:57:20.873 INFO:tasks.workunit.client.1.smithi150.stdout:6/84: mknod d2/c1e 0 2023-12-05T09:57:20.875 INFO:tasks.workunit.client.0.smithi100.stdout:8/96: dread d0/fb [0,4194304] 0 2023-12-05T09:57:20.876 INFO:tasks.workunit.client.0.smithi100.stdout:0/172: mkdir da/d22/d33/d35 0 2023-12-05T09:57:20.876 INFO:tasks.workunit.client.0.smithi100.stdout:5/176: write d0/d1b/f33 [506388,56705] 0 2023-12-05T09:57:20.877 INFO:tasks.workunit.client.1.smithi150.stdout:0/92: dwrite d5/fd [0,4194304] 0 2023-12-05T09:57:20.877 INFO:tasks.workunit.client.0.smithi100.stdout:4/99: truncate f6 174200 0 2023-12-05T09:57:20.880 INFO:tasks.workunit.client.1.smithi150.stdout:3/119: dread d6/d9/f1d [0,4194304] 0 2023-12-05T09:57:20.881 INFO:tasks.workunit.client.1.smithi150.stdout:2/104: rename d0/d3/fe to d0/d3/d11/f23 0 2023-12-05T09:57:20.881 INFO:tasks.workunit.client.1.smithi150.stdout:6/85: dread d2/da/f10 [0,4194304] 0 2023-12-05T09:57:20.881 INFO:tasks.workunit.client.1.smithi150.stdout:6/86: chown d2/c4 6 1 2023-12-05T09:57:20.894 INFO:tasks.workunit.client.0.smithi100.stdout:6/485: rmdir d7/d2d 39 2023-12-05T09:57:20.896 INFO:tasks.workunit.client.1.smithi150.stdout:8/95: mkdir d0/d8/d14/d1b 0 2023-12-05T09:57:20.896 INFO:tasks.workunit.client.1.smithi150.stdout:1/123: unlink d6/d8/db/de/l21 0 2023-12-05T09:57:20.896 INFO:tasks.workunit.client.1.smithi150.stdout:1/124: write d6/d8/f11 [966589,78842] 0 2023-12-05T09:57:20.897 INFO:tasks.workunit.client.0.smithi100.stdout:3/207: truncate d0/d2/f23 2642375 0 2023-12-05T09:57:20.902 INFO:tasks.workunit.client.0.smithi100.stdout:8/97: link d0/c5 d0/c11 0 2023-12-05T09:57:20.902 INFO:tasks.workunit.client.0.smithi100.stdout:9/229: dwrite d7/d10/f28 [0,4194304] 0 2023-12-05T09:57:20.902 INFO:tasks.workunit.client.0.smithi100.stdout:9/230: chown d7/d10/f14 17074280 1 2023-12-05T09:57:20.903 INFO:tasks.workunit.client.1.smithi150.stdout:4/56: dwrite d0/ff [0,4194304] 0 2023-12-05T09:57:20.903 INFO:tasks.workunit.client.1.smithi150.stdout:4/57: truncate d0/fd 194577 0 2023-12-05T09:57:20.903 INFO:tasks.workunit.client.0.smithi100.stdout:0/173: mkdir da/d1b/d36 0 2023-12-05T09:57:20.903 INFO:tasks.workunit.client.0.smithi100.stdout:0/174: chown da/c13 9068 1 2023-12-05T09:57:20.903 INFO:tasks.workunit.client.0.smithi100.stdout:0/175: creat da/f37 x:0 0 0 2023-12-05T09:57:20.910 INFO:tasks.workunit.client.0.smithi100.stdout:5/177: getdents d0/d4/d14 0 2023-12-05T09:57:20.910 INFO:tasks.workunit.client.0.smithi100.stdout:5/178: creat d0/d1f/d25/d31/f3f x:0 0 0 2023-12-05T09:57:20.910 INFO:tasks.workunit.client.0.smithi100.stdout:5/179: chown d0/d1b 4806 1 2023-12-05T09:57:20.912 INFO:tasks.workunit.client.0.smithi100.stdout:1/141: dwrite f1 [0,4194304] 0 2023-12-05T09:57:20.912 INFO:tasks.workunit.client.0.smithi100.stdout:1/142: write db/d12/f16 [4886377,110808] 0 2023-12-05T09:57:20.917 INFO:tasks.workunit.client.0.smithi100.stdout:2/241: dread d7/f34 [0,4194304] 0 2023-12-05T09:57:20.920 INFO:tasks.workunit.client.0.smithi100.stdout:4/100: rename de/f10 to de/f1b 0 2023-12-05T09:57:20.920 INFO:tasks.workunit.client.0.smithi100.stdout:4/101: dread - de/f1b zero size 2023-12-05T09:57:20.923 INFO:tasks.workunit.client.1.smithi150.stdout:5/90: dwrite d1/d3/fb [0,4194304] 0 2023-12-05T09:57:20.924 INFO:tasks.workunit.client.0.smithi100.stdout:6/486: creat d7/d11/d82/f9f x:0 0 0 2023-12-05T09:57:20.924 INFO:tasks.workunit.client.0.smithi100.stdout:6/487: write d7/f59 [1013067,36774] 0 2023-12-05T09:57:20.924 INFO:tasks.workunit.client.0.smithi100.stdout:6/488: write d7/d27/d35/d5a/f7f [393726,118617] 0 2023-12-05T09:57:20.924 INFO:tasks.workunit.client.0.smithi100.stdout:6/489: chown d7/d2d/c92 299 1 2023-12-05T09:57:20.925 INFO:tasks.workunit.client.1.smithi150.stdout:9/82: truncate d3/f4 1796835 0 2023-12-05T09:57:20.925 INFO:tasks.workunit.client.1.smithi150.stdout:4/58: write d0/f8 [7974695,40734] 0 2023-12-05T09:57:20.925 INFO:tasks.workunit.client.1.smithi150.stdout:4/59: dread - d0/fc zero size 2023-12-05T09:57:20.925 INFO:tasks.workunit.client.1.smithi150.stdout:4/60: readlink d0/le 0 2023-12-05T09:57:20.927 INFO:tasks.workunit.client.1.smithi150.stdout:0/93: creat d5/d11/d16/f1e x:0 0 0 2023-12-05T09:57:20.927 INFO:tasks.workunit.client.0.smithi100.stdout:3/208: mkdir d0/d3d 0 2023-12-05T09:57:20.927 INFO:tasks.workunit.client.0.smithi100.stdout:9/231: mknod d7/d20/c4c 0 2023-12-05T09:57:20.930 INFO:tasks.workunit.client.1.smithi150.stdout:6/87: dwrite d2/da/f1a [0,4194304] 0 2023-12-05T09:57:20.931 INFO:tasks.workunit.client.1.smithi150.stdout:6/88: truncate d2/f19 8454398 0 2023-12-05T09:57:20.931 INFO:tasks.workunit.client.1.smithi150.stdout:3/120: mkdir d6/d9/dd/d27 0 2023-12-05T09:57:20.931 INFO:tasks.workunit.client.1.smithi150.stdout:2/105: mknod d0/d3/d21/c24 0 2023-12-05T09:57:20.931 INFO:tasks.workunit.client.1.smithi150.stdout:3/121: chown d6/d9/f1b 22 1 2023-12-05T09:57:20.932 INFO:tasks.workunit.client.1.smithi150.stdout:8/96: creat d0/d8/d14/d1b/f1c x:0 0 0 2023-12-05T09:57:20.933 INFO:tasks.workunit.client.1.smithi150.stdout:8/97: readlink d0/d8/lb 0 2023-12-05T09:57:20.934 INFO:tasks.workunit.client.0.smithi100.stdout:7/97: dwrite d3/dc/d11/d13/de/f22 [0,4194304] 0 2023-12-05T09:57:20.939 INFO:tasks.workunit.client.1.smithi150.stdout:1/125: mknod d6/c2c 0 2023-12-05T09:57:20.939 INFO:tasks.workunit.client.1.smithi150.stdout:1/126: fsync d6/d8/db/de/f13 0 2023-12-05T09:57:20.939 INFO:tasks.workunit.client.0.smithi100.stdout:5/180: rmdir d0/d1b/d3c 0 2023-12-05T09:57:20.939 INFO:tasks.workunit.client.0.smithi100.stdout:5/181: truncate d0/d1f/d25/d31/f3f 543626 0 2023-12-05T09:57:20.943 INFO:tasks.workunit.client.0.smithi100.stdout:1/143: mknod db/d12/c2c 0 2023-12-05T09:57:20.943 INFO:tasks.workunit.client.0.smithi100.stdout:1/144: readlink db/l23 0 2023-12-05T09:57:20.943 INFO:tasks.workunit.client.0.smithi100.stdout:1/145: chown db/c24 148438 1 2023-12-05T09:57:20.943 INFO:tasks.workunit.client.0.smithi100.stdout:2/242: getdents d7/da/d13 0 2023-12-05T09:57:20.946 INFO:tasks.workunit.client.0.smithi100.stdout:4/102: truncate de/f13 186515 0 2023-12-05T09:57:20.948 INFO:tasks.workunit.client.0.smithi100.stdout:0/176: dwrite da/d22/f23 [0,4194304] 0 2023-12-05T09:57:20.949 INFO:tasks.workunit.client.1.smithi150.stdout:0/94: dread d5/fc [0,4194304] 0 2023-12-05T09:57:20.949 INFO:tasks.workunit.client.1.smithi150.stdout:5/91: rmdir d1/d3/d6 39 2023-12-05T09:57:20.949 INFO:tasks.workunit.client.0.smithi100.stdout:6/490: mkdir d7/d27/da0 0 2023-12-05T09:57:20.951 INFO:tasks.workunit.client.1.smithi150.stdout:9/83: write d3/d9/fa [1903596,10198] 0 2023-12-05T09:57:20.952 INFO:tasks.workunit.client.0.smithi100.stdout:7/98: dread d3/dc/d11/d13/de/f22 [0,4194304] 0 2023-12-05T09:57:20.953 INFO:tasks.workunit.client.0.smithi100.stdout:3/209: symlink d0/d3d/l3e 0 2023-12-05T09:57:20.953 INFO:tasks.workunit.client.0.smithi100.stdout:3/210: readlink d0/d2/de/d12/l27 0 2023-12-05T09:57:20.953 INFO:tasks.workunit.client.0.smithi100.stdout:3/211: readlink d0/d3d/l3e 0 2023-12-05T09:57:20.954 INFO:tasks.workunit.client.0.smithi100.stdout:3/212: chown d0/d2/de/d11 24 1 2023-12-05T09:57:20.954 INFO:tasks.workunit.client.0.smithi100.stdout:3/213: write d0/d2/de/d12/f29 [8623565,46640] 0 2023-12-05T09:57:20.956 INFO:tasks.workunit.client.0.smithi100.stdout:5/182: write d0/d4/d5/df/f20 [795500,18928] 0 2023-12-05T09:57:20.956 INFO:tasks.workunit.client.1.smithi150.stdout:4/61: mknod d0/c10 0 2023-12-05T09:57:20.957 INFO:tasks.workunit.client.1.smithi150.stdout:4/62: write d0/fd [115539,54647] 0 2023-12-05T09:57:20.957 INFO:tasks.workunit.client.0.smithi100.stdout:1/146: write db/d12/f13 [314176,63118] 0 2023-12-05T09:57:20.957 INFO:tasks.workunit.client.0.smithi100.stdout:1/147: truncate f9 743505 0 2023-12-05T09:57:20.961 INFO:tasks.workunit.client.0.smithi100.stdout:9/232: creat d7/f4d x:0 0 0 2023-12-05T09:57:20.962 INFO:tasks.workunit.client.1.smithi150.stdout:7/81: sync 2023-12-05T09:57:20.965 INFO:tasks.workunit.client.1.smithi150.stdout:3/122: mkdir d6/d25/d28 0 2023-12-05T09:57:20.966 INFO:tasks.workunit.client.1.smithi150.stdout:2/106: symlink d0/d3/d5/d22/l25 0 2023-12-05T09:57:20.966 INFO:tasks.workunit.client.1.smithi150.stdout:2/107: rename d0 to d0/d3/d21/d26 22 2023-12-05T09:57:20.966 INFO:tasks.workunit.client.1.smithi150.stdout:2/108: chown d0/cb 268310 1 2023-12-05T09:57:20.972 INFO:tasks.workunit.client.0.smithi100.stdout:0/177: write da/fd [1322028,56196] 0 2023-12-05T09:57:20.974 INFO:tasks.workunit.client.0.smithi100.stdout:2/243: truncate d7/da/d1a/f38 2072771 0 2023-12-05T09:57:20.976 INFO:tasks.workunit.client.1.smithi150.stdout:2/109: dread d0/d3/d5/d10/f19 [0,4194304] 0 2023-12-05T09:57:20.977 INFO:tasks.workunit.client.1.smithi150.stdout:1/127: mknod d6/d8/c2d 0 2023-12-05T09:57:20.979 INFO:tasks.workunit.client.0.smithi100.stdout:8/98: dwrite d0/fc [0,4194304] 0 2023-12-05T09:57:20.979 INFO:tasks.workunit.client.0.smithi100.stdout:8/99: write d0/fd [1471328,2584] 0 2023-12-05T09:57:20.981 INFO:tasks.workunit.client.0.smithi100.stdout:4/103: symlink de/l1c 0 2023-12-05T09:57:20.981 INFO:tasks.workunit.client.1.smithi150.stdout:3/123: dread d6/d9/f1d [0,4194304] 0 2023-12-05T09:57:20.981 INFO:tasks.workunit.client.1.smithi150.stdout:3/124: stat d6 0 2023-12-05T09:57:20.981 INFO:tasks.workunit.client.1.smithi150.stdout:4/63: fdatasync d0/f8 0 2023-12-05T09:57:20.986 INFO:tasks.workunit.client.1.smithi150.stdout:5/92: dread d1/d3/d6/f8 [0,4194304] 0 2023-12-05T09:57:20.986 INFO:tasks.workunit.client.1.smithi150.stdout:0/95: truncate d5/d11/f18 229613 0 2023-12-05T09:57:20.987 INFO:tasks.workunit.client.1.smithi150.stdout:9/84: rename d3/d9/fa to d3/d9/f14 0 2023-12-05T09:57:20.987 INFO:tasks.workunit.client.1.smithi150.stdout:9/85: creat d3/f15 x:0 0 0 2023-12-05T09:57:20.989 INFO:tasks.workunit.client.0.smithi100.stdout:3/214: rename d0/d2/de/d12/f32 to d0/d2/de/d12/f3f 0 2023-12-05T09:57:20.991 INFO:tasks.workunit.client.1.smithi150.stdout:7/82: mkdir d2/db/d17 0 2023-12-05T09:57:20.993 INFO:tasks.workunit.client.0.smithi100.stdout:1/148: symlink db/d12/l2d 0 2023-12-05T09:57:20.994 INFO:tasks.workunit.client.1.smithi150.stdout:8/98: getdents d0/d8 0 2023-12-05T09:57:20.995 INFO:tasks.workunit.client.1.smithi150.stdout:5/93: write d1/d3/d6/f8 [1980525,66442] 0 2023-12-05T09:57:20.995 INFO:tasks.workunit.client.1.smithi150.stdout:5/94: chown d1/d15 0 1 2023-12-05T09:57:20.996 INFO:tasks.workunit.client.0.smithi100.stdout:9/233: link d7/d10/d32/c3f d7/d1b/d22/d25/c4e 0 2023-12-05T09:57:20.997 INFO:tasks.workunit.client.1.smithi150.stdout:6/89: dwrite d2/da/f1a [0,4194304] 0 2023-12-05T09:57:20.997 INFO:tasks.workunit.client.1.smithi150.stdout:6/90: chown d2/da/f1a 3 1 2023-12-05T09:57:20.998 INFO:tasks.workunit.client.1.smithi150.stdout:0/96: truncate d5/fc 593526 0 2023-12-05T09:57:20.998 INFO:tasks.workunit.client.1.smithi150.stdout:0/97: read d5/fa [3469007,123852] 0 2023-12-05T09:57:20.999 INFO:tasks.workunit.client.0.smithi100.stdout:4/104: dread de/f13 [0,4194304] 0 2023-12-05T09:57:21.000 INFO:tasks.workunit.client.0.smithi100.stdout:0/178: rename da/d22/l29 to da/d1b/l38 0 2023-12-05T09:57:21.003 INFO:tasks.workunit.client.1.smithi150.stdout:1/128: dread d6/d8/db/de/ff [0,4194304] 0 2023-12-05T09:57:21.006 INFO:tasks.workunit.client.0.smithi100.stdout:2/244: mkdir d7/d53 0 2023-12-05T09:57:21.012 INFO:tasks.workunit.client.1.smithi150.stdout:9/86: symlink d3/d9/dc/l16 0 2023-12-05T09:57:21.012 INFO:tasks.workunit.client.1.smithi150.stdout:7/83: rename d2/d4/d16 to d2/d4/d8/d18 0 2023-12-05T09:57:21.012 INFO:tasks.workunit.client.1.smithi150.stdout:7/84: dread - d2/d4/ff zero size 2023-12-05T09:57:21.012 INFO:tasks.workunit.client.1.smithi150.stdout:9/87: write d3/f15 [410525,84677] 0 2023-12-05T09:57:21.012 INFO:tasks.workunit.client.1.smithi150.stdout:9/88: chown d3/d9/ce 982818832 1 2023-12-05T09:57:21.020 INFO:tasks.workunit.client.1.smithi150.stdout:5/95: mkdir d1/d3/d1e/d21 0 2023-12-05T09:57:21.022 INFO:tasks.workunit.client.1.smithi150.stdout:2/110: dwrite d0/d3/d5/f1e [0,4194304] 0 2023-12-05T09:57:21.024 INFO:tasks.workunit.client.1.smithi150.stdout:9/89: write d3/f4 [102704,35187] 0 2023-12-05T09:57:21.030 INFO:tasks.workunit.client.1.smithi150.stdout:9/90: fsync d3/f4 0 2023-12-05T09:57:21.035 INFO:tasks.workunit.client.1.smithi150.stdout:7/85: write d2/d4/fc [7962577,82997] 0 2023-12-05T09:57:21.039 INFO:tasks.workunit.client.1.smithi150.stdout:8/99: dwrite d0/d8/d14/f1a [0,4194304] 0 2023-12-05T09:57:21.041 INFO:tasks.workunit.client.1.smithi150.stdout:1/129: getdents d6 0 2023-12-05T09:57:21.046 INFO:tasks.workunit.client.0.smithi100.stdout:0/179: dwrite da/f11 [8388608,4194304] 0 2023-12-05T09:57:21.046 INFO:tasks.workunit.client.0.smithi100.stdout:0/180: stat da/l1a 0 2023-12-05T09:57:21.047 INFO:tasks.workunit.client.0.smithi100.stdout:6/491: creat d7/d11/d7e/fa1 x:0 0 0 2023-12-05T09:57:21.047 INFO:tasks.workunit.client.1.smithi150.stdout:5/96: mkdir d1/d3/d6/d1b/d22 0 2023-12-05T09:57:21.047 INFO:tasks.workunit.client.1.smithi150.stdout:1/130: write f4 [1061076,52389] 0 2023-12-05T09:57:21.050 INFO:tasks.workunit.client.0.smithi100.stdout:7/99: truncate d3/dc/d11/d13/de/f22 3509633 0 2023-12-05T09:57:21.051 INFO:tasks.workunit.client.0.smithi100.stdout:3/215: dwrite d0/d4/f20 [0,4194304] 0 2023-12-05T09:57:21.052 INFO:tasks.workunit.client.0.smithi100.stdout:1/149: creat db/d12/d1e/f2e x:0 0 0 2023-12-05T09:57:21.053 INFO:tasks.workunit.client.1.smithi150.stdout:2/111: mkdir d0/d3/d27 0 2023-12-05T09:57:21.055 INFO:tasks.workunit.client.0.smithi100.stdout:9/234: mknod d7/d1b/c4f 0 2023-12-05T09:57:21.055 INFO:tasks.workunit.client.1.smithi150.stdout:6/91: mknod d2/da/c1f 0 2023-12-05T09:57:21.058 INFO:tasks.workunit.client.0.smithi100.stdout:4/105: mkdir de/d1d 0 2023-12-05T09:57:21.058 INFO:tasks.workunit.client.0.smithi100.stdout:4/106: chown f9 155099 1 2023-12-05T09:57:21.059 INFO:tasks.workunit.client.0.smithi100.stdout:2/245: symlink d7/da/d18/d21/l54 0 2023-12-05T09:57:21.061 INFO:tasks.workunit.client.1.smithi150.stdout:9/91: creat d3/d9/f17 x:0 0 0 2023-12-05T09:57:21.063 INFO:tasks.workunit.client.1.smithi150.stdout:7/86: creat d2/db/d17/f19 x:0 0 0 2023-12-05T09:57:21.063 INFO:tasks.workunit.client.1.smithi150.stdout:7/87: getdents d2/d4/d8/d18 0 2023-12-05T09:57:21.064 INFO:tasks.workunit.client.0.smithi100.stdout:6/492: write d7/d11/d1a/f54 [1657845,106428] 0 2023-12-05T09:57:21.064 INFO:tasks.workunit.client.0.smithi100.stdout:6/493: creat d7/d27/fa2 x:0 0 0 2023-12-05T09:57:21.067 INFO:tasks.workunit.client.1.smithi150.stdout:0/98: dwrite d5/d11/f18 [0,4194304] 0 2023-12-05T09:57:21.067 INFO:tasks.workunit.client.0.smithi100.stdout:0/181: mkdir da/d2a/d39 0 2023-12-05T09:57:21.070 INFO:tasks.workunit.client.0.smithi100.stdout:4/107: mkdir de/d16/d1e 0 2023-12-05T09:57:21.073 INFO:tasks.workunit.client.0.smithi100.stdout:2/246: symlink d7/da/d18/d21/d4d/l55 0 2023-12-05T09:57:21.074 INFO:tasks.workunit.client.0.smithi100.stdout:2/247: fdatasync d7/da/d1a/f45 0 2023-12-05T09:57:21.076 INFO:tasks.workunit.client.1.smithi150.stdout:1/131: symlink d6/d8/l2e 0 2023-12-05T09:57:21.076 INFO:tasks.workunit.client.1.smithi150.stdout:1/132: creat d6/d8/db/f2f x:0 0 0 2023-12-05T09:57:21.076 INFO:tasks.workunit.client.1.smithi150.stdout:1/133: creat d6/d8/db/f30 x:0 0 0 2023-12-05T09:57:21.078 INFO:tasks.workunit.client.0.smithi100.stdout:1/150: read f1 [2968138,127788] 0 2023-12-05T09:57:21.079 INFO:tasks.workunit.client.1.smithi150.stdout:9/92: symlink d3/l18 0 2023-12-05T09:57:21.082 INFO:tasks.workunit.client.0.smithi100.stdout:4/108: mknod de/c1f 0 2023-12-05T09:57:21.083 INFO:tasks.workunit.client.1.smithi150.stdout:7/88: write d2/d4/fc [2020947,39547] 0 2023-12-05T09:57:21.089 INFO:tasks.workunit.client.0.smithi100.stdout:2/248: creat d7/da/dc/f56 x:0 0 0 2023-12-05T09:57:21.091 INFO:tasks.workunit.client.1.smithi150.stdout:2/112: dwrite d0/d3/d5/d10/f20 [0,4194304] 0 2023-12-05T09:57:21.093 INFO:tasks.workunit.client.0.smithi100.stdout:8/100: truncate d0/fd 1794 0 2023-12-05T09:57:21.096 INFO:tasks.workunit.client.0.smithi100.stdout:7/100: write d3/dc/d11/d13/de/f22 [3392001,66579] 0 2023-12-05T09:57:21.096 INFO:tasks.workunit.client.0.smithi100.stdout:7/101: write d3/dc/d11/d13/fb [4843539,81603] 0 2023-12-05T09:57:21.096 INFO:tasks.workunit.client.0.smithi100.stdout:7/102: creat d3/dc/d11/f25 x:0 0 0 2023-12-05T09:57:21.099 INFO:tasks.workunit.client.1.smithi150.stdout:0/99: mkdir d5/d11/d16/d1f 0 2023-12-05T09:57:21.104 INFO:tasks.workunit.client.1.smithi150.stdout:8/100: rmdir d0/d8/d14 39 2023-12-05T09:57:21.107 INFO:tasks.workunit.client.0.smithi100.stdout:4/109: creat de/d16/f20 x:0 0 0 2023-12-05T09:57:21.108 INFO:tasks.workunit.client.1.smithi150.stdout:5/97: rmdir d1/d15 39 2023-12-05T09:57:21.113 INFO:tasks.workunit.client.1.smithi150.stdout:6/92: symlink d2/da/l20 0 2023-12-05T09:57:21.115 INFO:tasks.workunit.client.1.smithi150.stdout:9/93: creat d3/d9/dc/f19 x:0 0 0 2023-12-05T09:57:21.118 INFO:tasks.workunit.client.1.smithi150.stdout:7/89: mkdir d2/d4/d8/d18/d1a 0 2023-12-05T09:57:21.126 INFO:tasks.workunit.client.0.smithi100.stdout:4/110: creat de/d1d/f21 x:0 0 0 2023-12-05T09:57:21.131 INFO:tasks.workunit.client.0.smithi100.stdout:7/103: rmdir d3/dc/d11/d13/de 39 2023-12-05T09:57:21.131 INFO:tasks.workunit.client.0.smithi100.stdout:7/104: readlink d3/dc/l16 0 2023-12-05T09:57:21.131 INFO:tasks.workunit.client.0.smithi100.stdout:7/105: dread - d3/f24 zero size 2023-12-05T09:57:21.133 INFO:tasks.workunit.client.1.smithi150.stdout:2/113: mknod d0/d3/d11/c28 0 2023-12-05T09:57:21.139 INFO:tasks.workunit.client.1.smithi150.stdout:5/98: getdents d1/d3/d6/d1b 0 2023-12-05T09:57:21.141 INFO:tasks.workunit.client.0.smithi100.stdout:3/216: dwrite d0/d2/f3c [0,4194304] 0 2023-12-05T09:57:21.144 INFO:tasks.workunit.client.1.smithi150.stdout:6/93: unlink d2/da/c1f 0 2023-12-05T09:57:21.146 INFO:tasks.workunit.client.1.smithi150.stdout:7/90: mkdir d2/d1b 0 2023-12-05T09:57:21.146 INFO:tasks.workunit.client.1.smithi150.stdout:7/91: chown d2/d4/c11 258655 1 2023-12-05T09:57:21.147 INFO:tasks.workunit.client.1.smithi150.stdout:7/92: fdatasync d2/f12 0 2023-12-05T09:57:21.148 INFO:tasks.workunit.client.1.smithi150.stdout:3/125: sync 2023-12-05T09:57:21.148 INFO:tasks.workunit.client.1.smithi150.stdout:4/64: sync 2023-12-05T09:57:21.148 INFO:tasks.workunit.client.1.smithi150.stdout:4/65: fdatasync d0/fc 0 2023-12-05T09:57:21.148 INFO:tasks.workunit.client.1.smithi150.stdout:3/126: fsync d6/d9/f1c 0 2023-12-05T09:57:21.150 INFO:tasks.workunit.client.1.smithi150.stdout:2/114: creat d0/d3/d11/d1d/f29 x:0 0 0 2023-12-05T09:57:21.153 INFO:tasks.workunit.client.1.smithi150.stdout:2/115: mknod d0/d3/d5/d22/c2a 0 2023-12-05T09:57:21.156 INFO:tasks.workunit.client.1.smithi150.stdout:5/99: unlink d1/d3/d6/l12 0 2023-12-05T09:57:21.156 INFO:tasks.workunit.client.1.smithi150.stdout:3/127: mknod d6/c29 0 2023-12-05T09:57:21.157 INFO:tasks.workunit.client.1.smithi150.stdout:3/128: chown l3 47696009 1 2023-12-05T09:57:21.157 INFO:tasks.workunit.client.1.smithi150.stdout:3/129: read - d6/f17 zero size 2023-12-05T09:57:21.157 INFO:tasks.workunit.client.1.smithi150.stdout:3/130: chown d6/d9/c23 61 1 2023-12-05T09:57:21.164 INFO:tasks.workunit.client.1.smithi150.stdout:8/101: dread d0/f19 [4194304,4194304] 0 2023-12-05T09:57:21.185 INFO:tasks.workunit.client.1.smithi150.stdout:6/94: dread d2/da/f1a [0,4194304] 0 2023-12-05T09:57:21.188 INFO:tasks.workunit.client.0.smithi100.stdout:2/249: dwrite d7/da/d18/d1b/f28 [4194304,4194304] 0 2023-12-05T09:57:21.188 INFO:tasks.workunit.client.0.smithi100.stdout:2/250: chown d7/da/d18/d21/f30 988751465 1 2023-12-05T09:57:21.188 INFO:tasks.workunit.client.0.smithi100.stdout:2/251: truncate d7/f4b 891021 0 2023-12-05T09:57:21.188 INFO:tasks.workunit.client.0.smithi100.stdout:2/252: write d7/da/d18/d1b/d2c/d3f/d46/f47 [641871,112962] 0 2023-12-05T09:57:21.192 INFO:tasks.workunit.client.1.smithi150.stdout:6/95: rename d2/da/l20 to d2/l21 0 2023-12-05T09:57:21.194 INFO:tasks.workunit.client.1.smithi150.stdout:1/134: dwrite d6/d8/db/f2f [0,4194304] 0 2023-12-05T09:57:21.196 INFO:tasks.workunit.client.0.smithi100.stdout:2/253: unlink d7/da/d18/d1b/d2c/d3f/d46/f2a 0 2023-12-05T09:57:21.196 INFO:tasks.workunit.client.1.smithi150.stdout:6/96: creat d2/da/f22 x:0 0 0 2023-12-05T09:57:21.197 INFO:tasks.workunit.client.0.smithi100.stdout:6/494: dwrite d7/d11/f51 [0,4194304] 0 2023-12-05T09:57:21.199 INFO:tasks.workunit.client.1.smithi150.stdout:5/100: dread d1/d3/fb [0,4194304] 0 2023-12-05T09:57:21.201 INFO:tasks.workunit.client.1.smithi150.stdout:4/66: dread d0/ff [0,4194304] 0 2023-12-05T09:57:21.202 INFO:tasks.workunit.client.1.smithi150.stdout:1/135: mknod d6/c31 0 2023-12-05T09:57:21.203 INFO:tasks.workunit.client.0.smithi100.stdout:7/106: dwrite d3/f24 [0,4194304] 0 2023-12-05T09:57:21.203 INFO:tasks.workunit.client.0.smithi100.stdout:7/107: fsync d3/dc/d11/d13/d1b/f23 0 2023-12-05T09:57:21.203 INFO:tasks.workunit.client.1.smithi150.stdout:0/100: dwrite d5/d11/f18 [0,4194304] 0 2023-12-05T09:57:21.206 INFO:tasks.workunit.client.0.smithi100.stdout:1/151: dwrite db/fc [8388608,4194304] 0 2023-12-05T09:57:21.208 INFO:tasks.workunit.client.0.smithi100.stdout:6/495: mknod d7/d11/d7e/ca3 0 2023-12-05T09:57:21.209 INFO:tasks.workunit.client.1.smithi150.stdout:5/101: mknod d1/d3/d6/d11/c23 0 2023-12-05T09:57:21.209 INFO:tasks.workunit.client.1.smithi150.stdout:5/102: fdatasync d1/d3/f1d 0 2023-12-05T09:57:21.211 INFO:tasks.workunit.client.0.smithi100.stdout:7/108: dread d3/f1f [0,4194304] 0 2023-12-05T09:57:21.211 INFO:tasks.workunit.client.0.smithi100.stdout:7/109: chown d3/dc/d11/d13/de/c17 16 1 2023-12-05T09:57:21.211 INFO:tasks.workunit.client.0.smithi100.stdout:7/110: fsync d3/dc/f14 0 2023-12-05T09:57:21.212 INFO:tasks.workunit.client.0.smithi100.stdout:1/152: dread db/d12/f14 [0,4194304] 0 2023-12-05T09:57:21.212 INFO:tasks.workunit.client.0.smithi100.stdout:2/254: dread d7/da/d18/d21/f30 [0,4194304] 0 2023-12-05T09:57:21.215 INFO:tasks.workunit.client.1.smithi150.stdout:1/136: fdatasync f4 0 2023-12-05T09:57:21.215 INFO:tasks.workunit.client.1.smithi150.stdout:1/137: dread - d6/d8/db/f2b zero size 2023-12-05T09:57:21.216 INFO:tasks.workunit.client.1.smithi150.stdout:7/93: dwrite d2/d4/d8/d13/f14 [0,4194304] 0 2023-12-05T09:57:21.216 INFO:tasks.workunit.client.1.smithi150.stdout:7/94: rename d2 to d2/d4/d1c 22 2023-12-05T09:57:21.216 INFO:tasks.workunit.client.1.smithi150.stdout:0/101: write d5/d11/d16/f17 [33211,32051] 0 2023-12-05T09:57:21.216 INFO:tasks.workunit.client.1.smithi150.stdout:7/95: truncate d2/d4/ff 720625 0 2023-12-05T09:57:21.218 INFO:tasks.workunit.client.0.smithi100.stdout:6/496: link d7/d11/c26 d7/d27/ca4 0 2023-12-05T09:57:21.218 INFO:tasks.workunit.client.0.smithi100.stdout:8/101: dwrite d0/f3 [0,4194304] 0 2023-12-05T09:57:21.220 INFO:tasks.workunit.client.0.smithi100.stdout:7/111: dread d3/f1f [0,4194304] 0 2023-12-05T09:57:21.222 INFO:tasks.workunit.client.0.smithi100.stdout:1/153: rename db/d12/l25 to db/d12/d1e/l2f 0 2023-12-05T09:57:21.223 INFO:tasks.workunit.client.0.smithi100.stdout:4/111: dwrite f1 [0,4194304] 0 2023-12-05T09:57:21.223 INFO:tasks.workunit.client.0.smithi100.stdout:4/112: getdents de/d16/d1e 0 2023-12-05T09:57:21.224 INFO:tasks.workunit.client.1.smithi150.stdout:9/94: dwrite d3/f15 [0,4194304] 0 2023-12-05T09:57:21.224 INFO:tasks.workunit.client.1.smithi150.stdout:9/95: dread - d3/d9/dc/f19 zero size 2023-12-05T09:57:21.225 INFO:tasks.workunit.client.1.smithi150.stdout:5/103: mkdir d1/d3/d6/d1b/d22/d24 0 2023-12-05T09:57:21.225 INFO:tasks.workunit.client.1.smithi150.stdout:5/104: getdents d1 0 2023-12-05T09:57:21.226 INFO:tasks.workunit.client.0.smithi100.stdout:4/113: write de/f13 [493824,126737] 0 2023-12-05T09:57:21.226 INFO:tasks.workunit.client.0.smithi100.stdout:4/114: chown de/f11 94771579 1 2023-12-05T09:57:21.226 INFO:tasks.workunit.client.0.smithi100.stdout:3/217: dwrite d0/d4/f1e [0,4194304] 0 2023-12-05T09:57:21.227 INFO:tasks.workunit.client.0.smithi100.stdout:2/255: dread d7/f43 [0,4194304] 0 2023-12-05T09:57:21.228 INFO:tasks.workunit.client.1.smithi150.stdout:8/102: dwrite d0/f19 [4194304,4194304] 0 2023-12-05T09:57:21.231 INFO:tasks.workunit.client.1.smithi150.stdout:8/103: write d0/ff [183035,113867] 0 2023-12-05T09:57:21.232 INFO:tasks.workunit.client.1.smithi150.stdout:5/105: read d1/d3/f1d [799869,107376] 0 2023-12-05T09:57:21.232 INFO:tasks.workunit.client.1.smithi150.stdout:5/106: rename d1/d3/d6/d1b/d22 to d1/d3/d6/d1b/d22/d24/d25 22 2023-12-05T09:57:21.242 INFO:tasks.workunit.client.1.smithi150.stdout:5/107: write d1/d3/fb [3151346,1366] 0 2023-12-05T09:57:21.258 INFO:tasks.workunit.client.1.smithi150.stdout:6/97: rmdir d2 39 2023-12-05T09:57:21.264 INFO:tasks.workunit.client.1.smithi150.stdout:1/138: dwrite d6/d8/db/f30 [0,4194304] 0 2023-12-05T09:57:21.267 INFO:tasks.workunit.client.1.smithi150.stdout:0/102: stat d5/d11/l12 0 2023-12-05T09:57:21.267 INFO:tasks.workunit.client.1.smithi150.stdout:0/103: stat d5/d1b 0 2023-12-05T09:57:21.274 INFO:tasks.workunit.client.1.smithi150.stdout:7/96: dwrite d2/db/d17/f19 [0,4194304] 0 2023-12-05T09:57:21.274 INFO:tasks.workunit.client.1.smithi150.stdout:7/97: creat d2/d4/d8/d13/f1d x:0 0 0 2023-12-05T09:57:21.274 INFO:tasks.workunit.client.1.smithi150.stdout:9/96: creat d3/d12/f1a x:0 0 0 2023-12-05T09:57:21.274 INFO:tasks.workunit.client.1.smithi150.stdout:9/97: truncate d3/d12/f1a 55873 0 2023-12-05T09:57:21.275 INFO:tasks.workunit.client.1.smithi150.stdout:8/104: creat d0/d8/d14/d1b/f1d x:0 0 0 2023-12-05T09:57:21.278 INFO:tasks.workunit.client.1.smithi150.stdout:6/98: mkdir d2/d23 0 2023-12-05T09:57:21.285 INFO:tasks.workunit.client.1.smithi150.stdout:1/139: rename d6/d8/f9 to d6/d8/db/de/f32 0 2023-12-05T09:57:21.285 INFO:tasks.workunit.client.1.smithi150.stdout:1/140: rename d6/d8 to d6/d8/d33 22 2023-12-05T09:57:21.285 INFO:tasks.workunit.client.1.smithi150.stdout:1/141: read - d6/d8/db/f16 zero size 2023-12-05T09:57:21.286 INFO:tasks.workunit.client.0.smithi100.stdout:4/115: dwrite de/f15 [0,4194304] 0 2023-12-05T09:57:21.291 INFO:tasks.workunit.client.1.smithi150.stdout:5/108: dwrite d1/d15/f16 [0,4194304] 0 2023-12-05T09:57:21.292 INFO:tasks.workunit.client.0.smithi100.stdout:8/102: dwrite d0/f3 [0,4194304] 0 2023-12-05T09:57:21.292 INFO:tasks.workunit.client.0.smithi100.stdout:6/497: creat d7/d11/d1a/d78/d80/fa5 x:0 0 0 2023-12-05T09:57:21.292 INFO:tasks.workunit.client.1.smithi150.stdout:7/98: rmdir d2/d4/d8/d18 39 2023-12-05T09:57:21.292 INFO:tasks.workunit.client.1.smithi150.stdout:7/99: truncate d2/d4/d8/f9 4514278 0 2023-12-05T09:57:21.293 INFO:tasks.workunit.client.0.smithi100.stdout:7/112: rmdir d3/dc/d11/d13 39 2023-12-05T09:57:21.294 INFO:tasks.workunit.client.1.smithi150.stdout:9/98: mkdir d3/d1b 0 2023-12-05T09:57:21.294 INFO:tasks.workunit.client.1.smithi150.stdout:9/99: chown d3 0 1 2023-12-05T09:57:21.295 INFO:tasks.workunit.client.1.smithi150.stdout:9/100: write d3/d9/dc/f19 [38975,17203] 0 2023-12-05T09:57:21.295 INFO:tasks.workunit.client.0.smithi100.stdout:1/154: mkdir db/d12/d1e/d26/d30 0 2023-12-05T09:57:21.299 INFO:tasks.workunit.client.1.smithi150.stdout:6/99: mknod d2/d23/c24 0 2023-12-05T09:57:21.302 INFO:tasks.workunit.client.1.smithi150.stdout:1/142: rename d6/l1f to d6/d8/db/de/l34 0 2023-12-05T09:57:21.305 INFO:tasks.workunit.client.0.smithi100.stdout:3/218: link d0/d2/de/d12/f3f d0/d2/d33/f40 0 2023-12-05T09:57:21.309 INFO:tasks.workunit.client.1.smithi150.stdout:5/109: mkdir d1/d3/d6/d26 0 2023-12-05T09:57:21.310 INFO:tasks.workunit.client.0.smithi100.stdout:2/256: mknod d7/da/d18/d1b/c57 0 2023-12-05T09:57:21.312 INFO:tasks.workunit.client.1.smithi150.stdout:7/100: mkdir d2/d4/d8/d18/d1a/d1e 0 2023-12-05T09:57:21.312 INFO:tasks.workunit.client.1.smithi150.stdout:7/101: chown d2/d4/l7 1057 1 2023-12-05T09:57:21.312 INFO:tasks.workunit.client.1.smithi150.stdout:7/102: read - d2/f12 zero size 2023-12-05T09:57:21.318 INFO:tasks.workunit.client.0.smithi100.stdout:4/116: symlink de/l22 0 2023-12-05T09:57:21.318 INFO:tasks.workunit.client.0.smithi100.stdout:4/117: chown de/d16/l17 15 1 2023-12-05T09:57:21.318 INFO:tasks.workunit.client.0.smithi100.stdout:4/118: write de/f13 [1092506,68548] 0 2023-12-05T09:57:21.319 INFO:tasks.workunit.client.1.smithi150.stdout:8/105: rmdir d0 39 2023-12-05T09:57:21.321 INFO:tasks.workunit.client.1.smithi150.stdout:1/143: stat d6/l1d 0 2023-12-05T09:57:21.321 INFO:tasks.workunit.client.1.smithi150.stdout:1/144: read - d6/d8/db/f16 zero size 2023-12-05T09:57:21.321 INFO:tasks.workunit.client.1.smithi150.stdout:1/145: chown d6/d8/db/f16 21118066 1 2023-12-05T09:57:21.321 INFO:tasks.workunit.client.1.smithi150.stdout:1/146: truncate d6/f1a 1499204 0 2023-12-05T09:57:21.321 INFO:tasks.workunit.client.1.smithi150.stdout:1/147: creat d6/d8/db/f35 x:0 0 0 2023-12-05T09:57:21.321 INFO:tasks.workunit.client.1.smithi150.stdout:1/148: readlink d6/d8/db/l25 0 2023-12-05T09:57:21.322 INFO:tasks.workunit.client.0.smithi100.stdout:8/103: rmdir d0 39 2023-12-05T09:57:21.322 INFO:tasks.workunit.client.1.smithi150.stdout:0/104: dwrite d5/d11/d16/f17 [0,4194304] 0 2023-12-05T09:57:21.322 INFO:tasks.workunit.client.1.smithi150.stdout:0/105: chown d5/d11/d16/f1e 1109 1 2023-12-05T09:57:21.322 INFO:tasks.workunit.client.1.smithi150.stdout:5/110: mknod d1/d3/d1e/c27 0 2023-12-05T09:57:21.323 INFO:tasks.workunit.client.0.smithi100.stdout:6/498: write d7/d11/f4c [183286,24738] 0 2023-12-05T09:57:21.325 INFO:tasks.workunit.client.1.smithi150.stdout:7/103: unlink d2/d4/d8/d13/c15 0 2023-12-05T09:57:21.326 INFO:tasks.workunit.client.0.smithi100.stdout:7/113: rename d3/dc/d11/d13/d1b/f23 to d3/dc/d11/d13/d1b/f26 0 2023-12-05T09:57:21.326 INFO:tasks.workunit.client.0.smithi100.stdout:7/114: write d3/f24 [4218063,87734] 0 2023-12-05T09:57:21.327 INFO:tasks.workunit.client.1.smithi150.stdout:9/101: getdents d3 0 2023-12-05T09:57:21.331 INFO:tasks.workunit.client.0.smithi100.stdout:1/155: mkdir db/d31 0 2023-12-05T09:57:21.331 INFO:tasks.workunit.client.1.smithi150.stdout:5/111: dread d1/d3/f7 [0,4194304] 0 2023-12-05T09:57:21.331 INFO:tasks.workunit.client.1.smithi150.stdout:8/106: creat d0/f1e x:0 0 0 2023-12-05T09:57:21.331 INFO:tasks.workunit.client.1.smithi150.stdout:8/107: write d0/f1e [696475,3835] 0 2023-12-05T09:57:21.332 INFO:tasks.workunit.client.0.smithi100.stdout:3/219: creat d0/d10/d39/f41 x:0 0 0 2023-12-05T09:57:21.335 INFO:tasks.workunit.client.0.smithi100.stdout:8/104: write d0/fc [499368,69677] 0 2023-12-05T09:57:21.336 INFO:tasks.workunit.client.0.smithi100.stdout:8/105: write d0/fb [827016,116114] 0 2023-12-05T09:57:21.336 INFO:tasks.workunit.client.0.smithi100.stdout:2/257: creat d7/da/d18/d21/d4d/f58 x:0 0 0 2023-12-05T09:57:21.337 INFO:tasks.workunit.client.1.smithi150.stdout:1/149: rename d6/d8/db/de/l2a to d6/d8/db/de/l36 0 2023-12-05T09:57:21.339 INFO:tasks.workunit.client.0.smithi100.stdout:4/119: mkdir de/d16/d23 0 2023-12-05T09:57:21.339 INFO:tasks.workunit.client.0.smithi100.stdout:4/120: chown de/d1d 163120 1 2023-12-05T09:57:21.339 INFO:tasks.workunit.client.1.smithi150.stdout:0/106: truncate d5/fd 4043104 0 2023-12-05T09:57:21.340 INFO:tasks.workunit.client.0.smithi100.stdout:6/499: mknod d7/d2d/ca6 0 2023-12-05T09:57:21.341 INFO:tasks.workunit.client.1.smithi150.stdout:7/104: creat d2/d4/d8/d18/d1a/f1f x:0 0 0 2023-12-05T09:57:21.342 INFO:tasks.workunit.client.1.smithi150.stdout:5/112: truncate d1/d3/f7 340908 0 2023-12-05T09:57:21.343 INFO:tasks.workunit.client.0.smithi100.stdout:7/115: symlink d3/dc/d11/d13/de/l27 0 2023-12-05T09:57:21.345 INFO:tasks.workunit.client.1.smithi150.stdout:8/108: creat d0/d8/f1f x:0 0 0 2023-12-05T09:57:21.346 INFO:tasks.workunit.client.1.smithi150.stdout:1/150: getdents d6/d8/db/d1b 0 2023-12-05T09:57:21.346 INFO:tasks.workunit.client.1.smithi150.stdout:1/151: chown d6/d8/c26 505 1 2023-12-05T09:57:21.348 INFO:tasks.workunit.client.0.smithi100.stdout:5/183: sync 2023-12-05T09:57:21.348 INFO:tasks.workunit.client.1.smithi150.stdout:6/100: dwrite d2/da/f1a [0,4194304] 0 2023-12-05T09:57:21.348 INFO:tasks.workunit.client.1.smithi150.stdout:8/109: symlink d0/l20 0 2023-12-05T09:57:21.353 INFO:tasks.workunit.client.0.smithi100.stdout:1/156: getdents db 0 2023-12-05T09:57:21.356 INFO:tasks.workunit.client.1.smithi150.stdout:7/105: write d2/db/d17/f19 [4139824,91993] 0 2023-12-05T09:57:21.356 INFO:tasks.workunit.client.1.smithi150.stdout:7/106: write d2/d4/fc [8790254,57748] 0 2023-12-05T09:57:21.356 INFO:tasks.workunit.client.1.smithi150.stdout:6/101: rename d2/l12 to d2/d23/l25 0 2023-12-05T09:57:21.357 INFO:tasks.workunit.client.1.smithi150.stdout:6/102: write d2/da/f10 [1596774,75650] 0 2023-12-05T09:57:21.357 INFO:tasks.workunit.client.1.smithi150.stdout:6/103: write d2/da/f10 [1862369,25666] 0 2023-12-05T09:57:21.357 INFO:tasks.workunit.client.1.smithi150.stdout:6/104: fsync d2/da/f1a 0 2023-12-05T09:57:21.358 INFO:tasks.workunit.client.1.smithi150.stdout:6/105: write d2/da/fe [2479327,116692] 0 2023-12-05T09:57:21.359 INFO:tasks.workunit.client.1.smithi150.stdout:8/110: symlink d0/d8/d14/l21 0 2023-12-05T09:57:21.360 INFO:tasks.workunit.client.0.smithi100.stdout:8/106: mkdir d0/d12 0 2023-12-05T09:57:21.365 INFO:tasks.workunit.client.1.smithi150.stdout:0/107: fsync d5/fd 0 2023-12-05T09:57:21.365 INFO:tasks.workunit.client.0.smithi100.stdout:2/258: rmdir d7/da/d18/d1b/d51 0 2023-12-05T09:57:21.365 INFO:tasks.workunit.client.0.smithi100.stdout:2/259: write d7/da/d18/d21/f44 [177199,103092] 0 2023-12-05T09:57:21.367 INFO:tasks.workunit.client.1.smithi150.stdout:1/152: rmdir d6/d8 39 2023-12-05T09:57:21.370 INFO:tasks.workunit.client.0.smithi100.stdout:6/500: rename d7/d2d/c6f to d7/d27/da0/ca7 0 2023-12-05T09:57:21.374 INFO:tasks.workunit.client.0.smithi100.stdout:7/116: creat d3/dc/d11/d13/de/f28 x:0 0 0 2023-12-05T09:57:21.375 INFO:tasks.workunit.client.1.smithi150.stdout:8/111: mknod d0/d8/d14/d1b/c22 0 2023-12-05T09:57:21.375 INFO:tasks.workunit.client.1.smithi150.stdout:8/112: chown d0/ff 383 1 2023-12-05T09:57:21.376 INFO:tasks.workunit.client.0.smithi100.stdout:1/157: mknod db/d12/d1e/d26/c32 0 2023-12-05T09:57:21.376 INFO:tasks.workunit.client.0.smithi100.stdout:1/158: read db/f1a [1305074,100869] 0 2023-12-05T09:57:21.378 INFO:tasks.workunit.client.1.smithi150.stdout:1/153: unlink d6/d8/l28 0 2023-12-05T09:57:21.381 INFO:tasks.workunit.client.0.smithi100.stdout:2/260: creat d7/da/d18/d1b/f59 x:0 0 0 2023-12-05T09:57:21.382 INFO:tasks.workunit.client.0.smithi100.stdout:0/182: sync 2023-12-05T09:57:21.382 INFO:tasks.workunit.client.0.smithi100.stdout:0/183: chown da/d1b/d36 103857884 1 2023-12-05T09:57:21.382 INFO:tasks.workunit.client.0.smithi100.stdout:9/235: sync 2023-12-05T09:57:21.383 INFO:tasks.workunit.client.0.smithi100.stdout:9/236: write d7/d1b/d22/d2a/f40 [837066,65382] 0 2023-12-05T09:57:21.383 INFO:tasks.workunit.client.0.smithi100.stdout:9/237: fsync d7/ff 0 2023-12-05T09:57:21.383 INFO:tasks.workunit.client.0.smithi100.stdout:4/121: rmdir de/d16 39 2023-12-05T09:57:21.384 INFO:tasks.workunit.client.1.smithi150.stdout:0/108: read d5/d11/d16/f17 [512805,83115] 0 2023-12-05T09:57:21.386 INFO:tasks.workunit.client.0.smithi100.stdout:5/184: rename d0/d16/l23 to d0/d27/l40 0 2023-12-05T09:57:21.386 INFO:tasks.workunit.client.0.smithi100.stdout:7/117: symlink d3/dc/d11/d13/d1b/l29 0 2023-12-05T09:57:21.388 INFO:tasks.workunit.client.1.smithi150.stdout:0/109: symlink d5/d11/d16/d1f/l20 0 2023-12-05T09:57:21.394 INFO:tasks.workunit.client.0.smithi100.stdout:0/184: mkdir da/d22/d33/d35/d3a 0 2023-12-05T09:57:21.394 INFO:tasks.workunit.client.0.smithi100.stdout:0/185: stat da/d1b/f26 0 2023-12-05T09:57:21.394 INFO:tasks.workunit.client.0.smithi100.stdout:0/186: creat da/d22/f3b x:0 0 0 2023-12-05T09:57:21.394 INFO:tasks.workunit.client.0.smithi100.stdout:0/187: write da/d1b/f26 [796439,49183] 0 2023-12-05T09:57:21.397 INFO:tasks.workunit.client.0.smithi100.stdout:9/238: mkdir d7/d1b/d22/d25/d2e/d50 0 2023-12-05T09:57:21.398 INFO:tasks.workunit.client.1.smithi150.stdout:5/113: write d1/d3/d6/f10 [788005,790] 0 2023-12-05T09:57:21.398 INFO:tasks.workunit.client.1.smithi150.stdout:8/113: write d0/f19 [7165679,47115] 0 2023-12-05T09:57:21.398 INFO:tasks.workunit.client.1.smithi150.stdout:8/114: fdatasync d0/d8/f11 0 2023-12-05T09:57:21.398 INFO:tasks.workunit.client.1.smithi150.stdout:8/115: creat d0/d8/f23 x:0 0 0 2023-12-05T09:57:21.399 INFO:tasks.workunit.client.1.smithi150.stdout:8/116: chown d0/d8/d14/d1b/f1d 215853 1 2023-12-05T09:57:21.399 INFO:tasks.workunit.client.1.smithi150.stdout:8/117: dread - d0/d8/f1f zero size 2023-12-05T09:57:21.399 INFO:tasks.workunit.client.1.smithi150.stdout:8/118: chown d0/d8/cd 40120 1 2023-12-05T09:57:21.399 INFO:tasks.workunit.client.1.smithi150.stdout:8/119: truncate d0/f13 1069799 0 2023-12-05T09:57:21.402 INFO:tasks.workunit.client.0.smithi100.stdout:5/185: symlink d0/d4/d14/l41 0 2023-12-05T09:57:21.402 INFO:tasks.workunit.client.0.smithi100.stdout:4/122: creat de/d16/d23/f24 x:0 0 0 2023-12-05T09:57:21.402 INFO:tasks.workunit.client.0.smithi100.stdout:4/123: chown de/d1d 141 1 2023-12-05T09:57:21.402 INFO:tasks.workunit.client.0.smithi100.stdout:4/124: getdents de/d16/d1e 0 2023-12-05T09:57:21.404 INFO:tasks.workunit.client.0.smithi100.stdout:7/118: mknod d3/dc/d11/d13/de/c2a 0 2023-12-05T09:57:21.404 INFO:tasks.workunit.client.0.smithi100.stdout:2/261: mknod d7/da/d13/d4e/c5a 0 2023-12-05T09:57:21.406 INFO:tasks.workunit.client.0.smithi100.stdout:1/159: rmdir db/d12/d1e 39 2023-12-05T09:57:21.406 INFO:tasks.workunit.client.0.smithi100.stdout:7/119: creat d3/dc/d11/d13/de/f2b x:0 0 0 2023-12-05T09:57:21.406 INFO:tasks.workunit.client.0.smithi100.stdout:1/160: write db/d12/f13 [2986100,64139] 0 2023-12-05T09:57:21.406 INFO:tasks.workunit.client.0.smithi100.stdout:7/120: stat d3/dc/d11/d13/f15 0 2023-12-05T09:57:21.406 INFO:tasks.workunit.client.0.smithi100.stdout:7/121: stat d3/dc/d11/d13/de/f2b 0 2023-12-05T09:57:21.406 INFO:tasks.workunit.client.0.smithi100.stdout:7/122: write d3/dc/d11/d13/de/f28 [101588,120565] 0 2023-12-05T09:57:21.406 INFO:tasks.workunit.client.0.smithi100.stdout:2/262: fsync d7/da/d18/d1b/d2c/f49 0 2023-12-05T09:57:21.406 INFO:tasks.workunit.client.0.smithi100.stdout:2/263: write d7/da/d2b/f50 [205633,89201] 0 2023-12-05T09:57:21.409 INFO:tasks.workunit.client.1.smithi150.stdout:8/120: getdents d0 0 2023-12-05T09:57:21.412 INFO:tasks.workunit.client.0.smithi100.stdout:0/188: creat da/d1b/f3c x:0 0 0 2023-12-05T09:57:21.413 INFO:tasks.workunit.client.0.smithi100.stdout:0/189: write da/f2d [859559,96331] 0 2023-12-05T09:57:21.414 INFO:tasks.workunit.client.1.smithi150.stdout:8/121: unlink d0/ce 0 2023-12-05T09:57:21.414 INFO:tasks.workunit.client.1.smithi150.stdout:1/154: dread d6/d8/db/f2f [0,4194304] 0 2023-12-05T09:57:21.420 INFO:tasks.workunit.client.0.smithi100.stdout:4/125: link de/d16/f20 de/f25 0 2023-12-05T09:57:21.421 INFO:tasks.workunit.client.0.smithi100.stdout:4/126: write f1 [4331685,68467] 0 2023-12-05T09:57:21.421 INFO:tasks.workunit.client.0.smithi100.stdout:4/127: chown de/lf 212075 1 2023-12-05T09:57:21.425 INFO:tasks.workunit.client.0.smithi100.stdout:2/264: creat d7/da/f5b x:0 0 0 2023-12-05T09:57:21.425 INFO:tasks.workunit.client.0.smithi100.stdout:0/190: symlink da/d2a/d39/l3d 0 2023-12-05T09:57:21.425 INFO:tasks.workunit.client.0.smithi100.stdout:2/265: truncate d7/da/d18/d21/f40 2073953 0 2023-12-05T09:57:21.425 INFO:tasks.workunit.client.0.smithi100.stdout:0/191: dread - da/d1b/f3c zero size 2023-12-05T09:57:21.430 INFO:tasks.workunit.client.0.smithi100.stdout:4/128: link de/f25 de/d16/d23/f26 0 2023-12-05T09:57:21.430 INFO:tasks.workunit.client.0.smithi100.stdout:4/129: stat de/d1d 0 2023-12-05T09:57:21.430 INFO:tasks.workunit.client.0.smithi100.stdout:7/123: rmdir d3/dc/d11/d13/d1b 39 2023-12-05T09:57:21.430 INFO:tasks.workunit.client.0.smithi100.stdout:8/107: dwrite d0/f2 [0,4194304] 0 2023-12-05T09:57:21.430 INFO:tasks.workunit.client.0.smithi100.stdout:8/108: readlink d0/lf 0 2023-12-05T09:57:21.432 INFO:tasks.workunit.client.0.smithi100.stdout:3/220: dwrite d0/d4/f14 [0,4194304] 0 2023-12-05T09:57:21.433 INFO:tasks.workunit.client.0.smithi100.stdout:1/161: dread db/f1a [0,4194304] 0 2023-12-05T09:57:21.433 INFO:tasks.workunit.client.0.smithi100.stdout:1/162: getdents db/d31 0 2023-12-05T09:57:21.433 INFO:tasks.workunit.client.0.smithi100.stdout:1/163: write db/d12/d1e/f2e [397905,37801] 0 2023-12-05T09:57:21.434 INFO:tasks.workunit.client.1.smithi150.stdout:8/122: readlink d0/l20 0 2023-12-05T09:57:21.435 INFO:tasks.workunit.client.1.smithi150.stdout:2/116: dwrite d0/d3/d11/f18 [0,4194304] 0 2023-12-05T09:57:21.435 INFO:tasks.workunit.client.1.smithi150.stdout:9/102: dread d3/f15 [0,4194304] 0 2023-12-05T09:57:21.436 INFO:tasks.workunit.client.0.smithi100.stdout:4/130: dread f6 [0,4194304] 0 2023-12-05T09:57:21.436 INFO:tasks.workunit.client.0.smithi100.stdout:4/131: write f6 [1162631,101287] 0 2023-12-05T09:57:21.436 INFO:tasks.workunit.client.0.smithi100.stdout:4/132: dread - de/d16/d23/f26 zero size 2023-12-05T09:57:21.437 INFO:tasks.workunit.client.0.smithi100.stdout:8/109: mkdir d0/d12/d13 0 2023-12-05T09:57:21.438 INFO:tasks.workunit.client.1.smithi150.stdout:6/106: dwrite d2/da/f1a [0,4194304] 0 2023-12-05T09:57:21.442 INFO:tasks.workunit.client.0.smithi100.stdout:3/221: rename d0/d10/c2e to d0/d2/de/c42 0 2023-12-05T09:57:21.442 INFO:tasks.workunit.client.0.smithi100.stdout:3/222: chown d0/d4/fc 72632 1 2023-12-05T09:57:21.447 INFO:tasks.workunit.client.0.smithi100.stdout:2/266: unlink d7/da/d13/l3e 0 2023-12-05T09:57:21.447 INFO:tasks.workunit.client.0.smithi100.stdout:1/164: creat db/d12/d1e/d26/d30/f33 x:0 0 0 2023-12-05T09:57:21.458 INFO:tasks.workunit.client.0.smithi100.stdout:8/110: rename d0/c5 to d0/d12/d13/c14 0 2023-12-05T09:57:21.458 INFO:tasks.workunit.client.0.smithi100.stdout:8/111: stat d0/d12 0 2023-12-05T09:57:21.458 INFO:tasks.workunit.client.1.smithi150.stdout:2/117: dread d0/f7 [4194304,4194304] 0 2023-12-05T09:57:21.459 INFO:tasks.workunit.client.1.smithi150.stdout:2/118: write d0/d3/d11/f23 [1324189,40650] 0 2023-12-05T09:57:21.459 INFO:tasks.workunit.client.0.smithi100.stdout:8/112: symlink d0/d12/l15 0 2023-12-05T09:57:21.460 INFO:tasks.workunit.client.1.smithi150.stdout:7/107: dread d2/db/d17/f19 [0,4194304] 0 2023-12-05T09:57:21.460 INFO:tasks.workunit.client.1.smithi150.stdout:7/108: chown d2/d4/d8/f9 20327 1 2023-12-05T09:57:21.460 INFO:tasks.workunit.client.0.smithi100.stdout:9/239: dwrite d7/f1d [0,4194304] 0 2023-12-05T09:57:21.465 INFO:tasks.workunit.client.0.smithi100.stdout:5/186: dwrite d0/d4/d5/df/f26 [0,4194304] 0 2023-12-05T09:57:21.467 INFO:tasks.workunit.client.1.smithi150.stdout:0/110: dwrite d5/ff [0,4194304] 0 2023-12-05T09:57:21.469 INFO:tasks.workunit.client.1.smithi150.stdout:1/155: unlink d6/d8/db/d1b/l1c 0 2023-12-05T09:57:21.473 INFO:tasks.workunit.client.1.smithi150.stdout:6/107: creat d2/f26 x:0 0 0 2023-12-05T09:57:21.474 INFO:tasks.workunit.client.0.smithi100.stdout:5/187: creat d0/d4/d14/d35/f42 x:0 0 0 2023-12-05T09:57:21.475 INFO:tasks.workunit.client.1.smithi150.stdout:6/108: fsync d2/f9 0 2023-12-05T09:57:21.475 INFO:tasks.workunit.client.1.smithi150.stdout:6/109: chown d2/c18 0 1 2023-12-05T09:57:21.475 INFO:tasks.workunit.client.1.smithi150.stdout:6/110: truncate d2/f9 5114372 0 2023-12-05T09:57:21.475 INFO:tasks.workunit.client.1.smithi150.stdout:6/111: write d2/f1c [638639,108625] 0 2023-12-05T09:57:21.477 INFO:tasks.workunit.client.1.smithi150.stdout:2/119: rename d0/d3/c1a to d0/d3/d5/d13/d15/c2b 0 2023-12-05T09:57:21.477 INFO:tasks.workunit.client.1.smithi150.stdout:2/120: write d0/d3/d5/d10/f1b [964775,121078] 0 2023-12-05T09:57:21.479 INFO:tasks.workunit.client.1.smithi150.stdout:0/111: link d5/ff d5/d11/f21 0 2023-12-05T09:57:21.482 INFO:tasks.workunit.client.1.smithi150.stdout:9/103: getdents d3/d9 0 2023-12-05T09:57:21.486 INFO:tasks.workunit.client.1.smithi150.stdout:1/156: creat d6/d8/db/d1b/f37 x:0 0 0 2023-12-05T09:57:21.487 INFO:tasks.workunit.client.1.smithi150.stdout:5/114: dwrite d1/d3/d6/f10 [0,4194304] 0 2023-12-05T09:57:21.487 INFO:tasks.workunit.client.1.smithi150.stdout:5/115: write d1/d3/fb [5665347,36923] 0 2023-12-05T09:57:21.491 INFO:tasks.workunit.client.1.smithi150.stdout:2/121: truncate d0/f7 2905081 0 2023-12-05T09:57:21.491 INFO:tasks.workunit.client.1.smithi150.stdout:2/122: fsync d0/d3/d11/d1d/f29 0 2023-12-05T09:57:21.495 INFO:tasks.workunit.client.1.smithi150.stdout:0/112: symlink d5/d11/d16/l22 0 2023-12-05T09:57:21.495 INFO:tasks.workunit.client.1.smithi150.stdout:0/113: write d5/d11/d16/f1e [13530,56532] 0 2023-12-05T09:57:21.495 INFO:tasks.workunit.client.0.smithi100.stdout:3/223: dread d0/d10/f2a [0,4194304] 0 2023-12-05T09:57:21.496 INFO:tasks.workunit.client.0.smithi100.stdout:9/240: rename d7/d10 to d7/d1b/d22/d51 0 2023-12-05T09:57:21.498 INFO:tasks.workunit.client.1.smithi150.stdout:9/104: creat d3/d9/f1c x:0 0 0 2023-12-05T09:57:21.499 INFO:tasks.workunit.client.1.smithi150.stdout:9/105: creat d3/d9/dc/f1d x:0 0 0 2023-12-05T09:57:21.499 INFO:tasks.workunit.client.1.smithi150.stdout:9/106: chown d3/d9/dc/c11 14 1 2023-12-05T09:57:21.499 INFO:tasks.workunit.client.1.smithi150.stdout:9/107: write d3/d9/f1c [848533,3355] 0 2023-12-05T09:57:21.505 INFO:tasks.workunit.client.0.smithi100.stdout:3/224: creat d0/d10/f43 x:0 0 0 2023-12-05T09:57:21.505 INFO:tasks.workunit.client.1.smithi150.stdout:9/108: dread d3/d12/f1a [0,4194304] 0 2023-12-05T09:57:21.507 INFO:tasks.workunit.client.0.smithi100.stdout:5/188: read d0/f2 [2147642,96273] 0 2023-12-05T09:57:21.508 INFO:tasks.workunit.client.0.smithi100.stdout:5/189: read - d0/d4/d14/d35/f42 zero size 2023-12-05T09:57:21.508 INFO:tasks.workunit.client.0.smithi100.stdout:5/190: creat d0/d4/d5/df/f43 x:0 0 0 2023-12-05T09:57:21.508 INFO:tasks.workunit.client.0.smithi100.stdout:5/191: write d0/d16/f3b [247526,82891] 0 2023-12-05T09:57:21.515 INFO:tasks.workunit.client.0.smithi100.stdout:9/241: symlink d7/d1b/d22/d2a/l52 0 2023-12-05T09:57:21.517 INFO:tasks.workunit.client.0.smithi100.stdout:3/225: rename d0/d10/c2f to d0/d2/c44 0 2023-12-05T09:57:21.518 INFO:tasks.workunit.client.1.smithi150.stdout:5/116: creat d1/d3/d6/d26/f28 x:0 0 0 2023-12-05T09:57:21.518 INFO:tasks.workunit.client.1.smithi150.stdout:5/117: fsync d1/d3/d6/f10 0 2023-12-05T09:57:21.519 INFO:tasks.workunit.client.1.smithi150.stdout:2/123: write d0/f16 [1137938,70904] 0 2023-12-05T09:57:21.519 INFO:tasks.workunit.client.1.smithi150.stdout:2/124: chown d0/d3/d11/d1d 61537887 1 2023-12-05T09:57:21.523 INFO:tasks.workunit.client.1.smithi150.stdout:0/114: creat d5/f23 x:0 0 0 2023-12-05T09:57:21.524 INFO:tasks.workunit.client.0.smithi100.stdout:3/226: mkdir d0/d4/d3a/d45 0 2023-12-05T09:57:21.524 INFO:tasks.workunit.client.0.smithi100.stdout:3/227: write d0/d2/f23 [3137440,106776] 0 2023-12-05T09:57:21.524 INFO:tasks.workunit.client.0.smithi100.stdout:3/228: fsync d0/d4/f14 0 2023-12-05T09:57:21.526 INFO:tasks.workunit.client.1.smithi150.stdout:9/109: link l1 d3/d1b/l1e 0 2023-12-05T09:57:21.527 INFO:tasks.workunit.client.1.smithi150.stdout:9/110: write d3/d9/f14 [2145519,74] 0 2023-12-05T09:57:21.527 INFO:tasks.workunit.client.1.smithi150.stdout:8/123: dwrite d0/fc [0,4194304] 0 2023-12-05T09:57:21.530 INFO:tasks.workunit.client.0.smithi100.stdout:5/192: dread d0/f2 [0,4194304] 0 2023-12-05T09:57:21.534 INFO:tasks.workunit.client.1.smithi150.stdout:2/125: creat d0/d3/d21/f2c x:0 0 0 2023-12-05T09:57:21.534 INFO:tasks.workunit.client.0.smithi100.stdout:3/229: symlink d0/d10/l46 0 2023-12-05T09:57:21.534 INFO:tasks.workunit.client.1.smithi150.stdout:2/126: write d0/d3/d11/d1d/f29 [638528,102979] 0 2023-12-05T09:57:21.535 INFO:tasks.workunit.client.1.smithi150.stdout:2/127: write d0/d3/d21/f2c [165936,48572] 0 2023-12-05T09:57:21.535 INFO:tasks.workunit.client.0.smithi100.stdout:5/193: rename d0/d1b/c1c to d0/d1f/d25/c44 0 2023-12-05T09:57:21.535 INFO:tasks.workunit.client.1.smithi150.stdout:1/157: dwrite d6/d8/db/de/f32 [0,4194304] 0 2023-12-05T09:57:21.535 INFO:tasks.workunit.client.1.smithi150.stdout:1/158: write d6/d8/db/f30 [4645524,98309] 0 2023-12-05T09:57:21.536 INFO:tasks.workunit.client.0.smithi100.stdout:1/165: dwrite db/d12/f16 [0,4194304] 0 2023-12-05T09:57:21.536 INFO:tasks.workunit.client.0.smithi100.stdout:1/166: write f9 [1338332,47853] 0 2023-12-05T09:57:21.536 INFO:tasks.workunit.client.0.smithi100.stdout:7/124: dwrite d3/dc/d11/d13/d1b/f26 [0,4194304] 0 2023-12-05T09:57:21.538 INFO:tasks.workunit.client.1.smithi150.stdout:5/118: dread d1/d15/f16 [0,4194304] 0 2023-12-05T09:57:21.541 INFO:tasks.workunit.client.0.smithi100.stdout:3/230: creat d0/d2/de/f47 x:0 0 0 2023-12-05T09:57:21.541 INFO:tasks.workunit.client.0.smithi100.stdout:0/192: dwrite da/fb [0,4194304] 0 2023-12-05T09:57:21.541 INFO:tasks.workunit.client.0.smithi100.stdout:4/133: dwrite de/d16/f20 [0,4194304] 0 2023-12-05T09:57:21.543 INFO:tasks.workunit.client.1.smithi150.stdout:0/115: write d5/d11/f21 [1149072,14502] 0 2023-12-05T09:57:21.543 INFO:tasks.workunit.client.0.smithi100.stdout:0/193: fdatasync da/d1b/f26 0 2023-12-05T09:57:21.543 INFO:tasks.workunit.client.0.smithi100.stdout:0/194: write da/d22/f3b [791074,57354] 0 2023-12-05T09:57:21.544 INFO:tasks.workunit.client.0.smithi100.stdout:5/194: mknod d0/d4/c45 0 2023-12-05T09:57:21.545 INFO:tasks.workunit.client.0.smithi100.stdout:5/195: read - d0/d16/f1e zero size 2023-12-05T09:57:21.545 INFO:tasks.workunit.client.0.smithi100.stdout:5/196: write d0/d1f/d25/d31/f3e [960883,91989] 0 2023-12-05T09:57:21.547 INFO:tasks.workunit.client.0.smithi100.stdout:5/197: write d0/d16/f1e [414003,107333] 0 2023-12-05T09:57:21.547 INFO:tasks.workunit.client.1.smithi150.stdout:2/128: mknod d0/d3/d27/c2d 0 2023-12-05T09:57:21.552 INFO:tasks.workunit.client.0.smithi100.stdout:7/125: symlink d3/l2c 0 2023-12-05T09:57:21.554 INFO:tasks.workunit.client.0.smithi100.stdout:8/113: getdents d0 0 2023-12-05T09:57:21.558 INFO:tasks.workunit.client.0.smithi100.stdout:7/126: mkdir d3/dc/d11/d13/de/d2d 0 2023-12-05T09:57:21.562 INFO:tasks.workunit.client.1.smithi150.stdout:3/131: sync 2023-12-05T09:57:21.562 INFO:tasks.workunit.client.1.smithi150.stdout:4/67: sync 2023-12-05T09:57:21.562 INFO:tasks.workunit.client.1.smithi150.stdout:4/68: dread - d0/fc zero size 2023-12-05T09:57:21.562 INFO:tasks.workunit.client.1.smithi150.stdout:4/69: stat d0/ff 0 2023-12-05T09:57:21.562 INFO:tasks.workunit.client.1.smithi150.stdout:1/159: dread d6/d8/db/f30 [0,4194304] 0 2023-12-05T09:57:21.563 INFO:tasks.workunit.client.0.smithi100.stdout:7/127: unlink d3/dc/d11/d13/f1a 0 2023-12-05T09:57:21.563 INFO:tasks.workunit.client.0.smithi100.stdout:7/128: creat d3/f2e x:0 0 0 2023-12-05T09:57:21.566 INFO:tasks.workunit.client.0.smithi100.stdout:1/167: read db/d12/f16 [2424574,245] 0 2023-12-05T09:57:21.569 INFO:tasks.workunit.client.0.smithi100.stdout:9/242: dwrite d7/d1b/d22/d2a/f40 [0,4194304] 0 2023-12-05T09:57:21.569 INFO:tasks.workunit.client.0.smithi100.stdout:9/243: write d7/fc [5162864,62962] 0 2023-12-05T09:57:21.569 INFO:tasks.workunit.client.0.smithi100.stdout:9/244: fdatasync d7/d1b/d22/d51/d32/f42 0 2023-12-05T09:57:21.577 INFO:tasks.workunit.client.1.smithi150.stdout:3/132: dread d6/d19/f1e [0,4194304] 0 2023-12-05T09:57:21.577 INFO:tasks.workunit.client.1.smithi150.stdout:3/133: truncate d6/f17 499277 0 2023-12-05T09:57:21.581 INFO:tasks.workunit.client.1.smithi150.stdout:8/124: mkdir d0/d8/d14/d1b/d24 0 2023-12-05T09:57:21.582 INFO:tasks.workunit.client.1.smithi150.stdout:9/111: getdents d3/d9 0 2023-12-05T09:57:21.584 INFO:tasks.workunit.client.1.smithi150.stdout:2/129: mknod d0/d3/c2e 0 2023-12-05T09:57:21.584 INFO:tasks.workunit.client.0.smithi100.stdout:1/168: creat db/d12/d1e/f34 x:0 0 0 2023-12-05T09:57:21.584 INFO:tasks.workunit.client.0.smithi100.stdout:1/169: stat db/d12/d1e/d26/d30 0 2023-12-05T09:57:21.589 INFO:tasks.workunit.client.1.smithi150.stdout:3/134: rmdir d6/d9/dd/d27 0 2023-12-05T09:57:21.593 INFO:tasks.workunit.client.1.smithi150.stdout:5/119: truncate d1/d3/d6/f10 2762608 0 2023-12-05T09:57:21.598 INFO:tasks.workunit.client.0.smithi100.stdout:9/245: getdents d7/d35 0 2023-12-05T09:57:21.599 INFO:tasks.workunit.client.1.smithi150.stdout:2/130: rmdir d0/d3/d5/d13/d15 39 2023-12-05T09:57:21.606 INFO:tasks.workunit.client.0.smithi100.stdout:1/170: truncate db/d12/f1d 4085880 0 2023-12-05T09:57:21.608 INFO:tasks.workunit.client.1.smithi150.stdout:0/116: dwrite d5/d11/f18 [0,4194304] 0 2023-12-05T09:57:21.608 INFO:tasks.workunit.client.1.smithi150.stdout:0/117: truncate d5/d11/f18 4307571 0 2023-12-05T09:57:21.608 INFO:tasks.workunit.client.1.smithi150.stdout:0/118: stat d5/fc 0 2023-12-05T09:57:21.608 INFO:tasks.workunit.client.1.smithi150.stdout:0/119: write d5/ff [2844926,94581] 0 2023-12-05T09:57:21.608 INFO:tasks.workunit.client.1.smithi150.stdout:0/120: fdatasync d5/fc 0 2023-12-05T09:57:21.608 INFO:tasks.workunit.client.1.smithi150.stdout:0/121: chown d5/d11/f21 1 1 2023-12-05T09:57:21.609 INFO:tasks.workunit.client.1.smithi150.stdout:1/160: mkdir d6/d38 0 2023-12-05T09:57:21.609 INFO:tasks.workunit.client.1.smithi150.stdout:3/135: creat d6/f2a x:0 0 0 2023-12-05T09:57:21.610 INFO:tasks.workunit.client.1.smithi150.stdout:5/120: creat d1/d15/f29 x:0 0 0 2023-12-05T09:57:21.617 INFO:tasks.workunit.client.0.smithi100.stdout:1/171: creat db/f35 x:0 0 0 2023-12-05T09:57:21.617 INFO:tasks.workunit.client.0.smithi100.stdout:1/172: truncate db/d12/d1e/f34 555859 0 2023-12-05T09:57:21.620 INFO:tasks.workunit.client.1.smithi150.stdout:0/122: creat d5/d11/f24 x:0 0 0 2023-12-05T09:57:21.620 INFO:tasks.workunit.client.0.smithi100.stdout:4/134: dwrite de/d16/d23/f26 [0,4194304] 0 2023-12-05T09:57:21.621 INFO:tasks.workunit.client.0.smithi100.stdout:4/135: fdatasync de/d16/d23/f24 0 2023-12-05T09:57:21.627 INFO:tasks.workunit.client.1.smithi150.stdout:3/136: symlink d6/d19/l2b 0 2023-12-05T09:57:21.631 INFO:tasks.workunit.client.1.smithi150.stdout:5/121: link d1/d3/d6/d11/l1f d1/d3/d1e/l2a 0 2023-12-05T09:57:21.632 INFO:tasks.workunit.client.0.smithi100.stdout:1/173: creat db/d31/f36 x:0 0 0 2023-12-05T09:57:21.633 INFO:tasks.workunit.client.0.smithi100.stdout:0/195: write da/f11 [9488230,62949] 0 2023-12-05T09:57:21.635 INFO:tasks.workunit.client.1.smithi150.stdout:0/123: rename d5/d11/c14 to d5/d11/d16/d1f/c25 0 2023-12-05T09:57:21.635 INFO:tasks.workunit.client.1.smithi150.stdout:0/124: dread - d5/d11/f24 zero size 2023-12-05T09:57:21.635 INFO:tasks.workunit.client.1.smithi150.stdout:0/125: creat d5/d11/f26 x:0 0 0 2023-12-05T09:57:21.636 INFO:tasks.workunit.client.0.smithi100.stdout:8/114: dwrite d0/fc [0,4194304] 0 2023-12-05T09:57:21.641 INFO:tasks.workunit.client.1.smithi150.stdout:3/137: creat d6/f2c x:0 0 0 2023-12-05T09:57:21.643 INFO:tasks.workunit.client.1.smithi150.stdout:8/125: truncate d0/fc 881033 0 2023-12-05T09:57:21.645 INFO:tasks.workunit.client.0.smithi100.stdout:2/267: dwrite d7/da/d1a/f38 [0,4194304] 0 2023-12-05T09:57:21.650 INFO:tasks.workunit.client.0.smithi100.stdout:4/136: symlink de/d16/d23/l27 0 2023-12-05T09:57:21.650 INFO:tasks.workunit.client.0.smithi100.stdout:4/137: write f9 [3209140,4100] 0 2023-12-05T09:57:21.650 INFO:tasks.workunit.client.0.smithi100.stdout:4/138: fdatasync f2 0 2023-12-05T09:57:21.651 INFO:tasks.workunit.client.0.smithi100.stdout:4/139: creat de/d16/d23/f28 x:0 0 0 2023-12-05T09:57:21.651 INFO:tasks.workunit.client.0.smithi100.stdout:4/140: write de/f14 [851235,13967] 0 2023-12-05T09:57:21.655 INFO:tasks.workunit.client.1.smithi150.stdout:4/70: dwrite d0/fd [0,4194304] 0 2023-12-05T09:57:21.655 INFO:tasks.workunit.client.1.smithi150.stdout:4/71: fsync d0/fc 0 2023-12-05T09:57:21.655 INFO:tasks.workunit.client.1.smithi150.stdout:3/138: rename d6/f2c to d6/d25/d28/f2d 0 2023-12-05T09:57:21.655 INFO:tasks.workunit.client.0.smithi100.stdout:3/231: dwrite d0/d10/f2a [0,4194304] 0 2023-12-05T09:57:21.655 INFO:tasks.workunit.client.0.smithi100.stdout:3/232: truncate d0/d2/d33/f40 1045722 0 2023-12-05T09:57:21.657 INFO:tasks.workunit.client.0.smithi100.stdout:1/174: dread db/d12/f18 [0,4194304] 0 2023-12-05T09:57:21.663 INFO:tasks.workunit.client.1.smithi150.stdout:8/126: read d0/f1e [79965,32239] 0 2023-12-05T09:57:21.663 INFO:tasks.workunit.client.0.smithi100.stdout:0/196: mknod da/d2a/d39/c3e 0 2023-12-05T09:57:21.663 INFO:tasks.workunit.client.0.smithi100.stdout:8/115: mkdir d0/d12/d13/d16 0 2023-12-05T09:57:21.664 INFO:tasks.workunit.client.1.smithi150.stdout:1/161: dread d6/f1a [0,4194304] 0 2023-12-05T09:57:21.672 INFO:tasks.workunit.client.1.smithi150.stdout:4/72: mkdir d0/d11 0 2023-12-05T09:57:21.674 INFO:tasks.workunit.client.1.smithi150.stdout:1/162: link d6/d8/db/f2f d6/d8/db/de/f39 0 2023-12-05T09:57:21.679 INFO:tasks.workunit.client.0.smithi100.stdout:2/268: rmdir d7/d53 0 2023-12-05T09:57:21.686 INFO:tasks.workunit.client.1.smithi150.stdout:9/112: dwrite d3/d9/dc/f19 [0,4194304] 0 2023-12-05T09:57:21.687 INFO:tasks.workunit.client.1.smithi150.stdout:2/131: dwrite d0/d3/d11/f23 [0,4194304] 0 2023-12-05T09:57:21.687 INFO:tasks.workunit.client.1.smithi150.stdout:2/132: read d0/f16 [2328444,2802] 0 2023-12-05T09:57:21.688 INFO:tasks.workunit.client.0.smithi100.stdout:5/198: dwrite d0/d4/d5/df/f43 [0,4194304] 0 2023-12-05T09:57:21.688 INFO:tasks.workunit.client.1.smithi150.stdout:1/163: unlink d6/d8/c2d 0 2023-12-05T09:57:21.689 INFO:tasks.workunit.client.0.smithi100.stdout:3/233: dread d0/d4/f14 [0,4194304] 0 2023-12-05T09:57:21.689 INFO:tasks.workunit.client.0.smithi100.stdout:3/234: dread - d0/d2/d33/f35 zero size 2023-12-05T09:57:21.689 INFO:tasks.workunit.client.1.smithi150.stdout:4/73: dread d0/ff [0,4194304] 0 2023-12-05T09:57:21.694 INFO:tasks.workunit.client.0.smithi100.stdout:2/269: dread d7/da/d18/d21/f40 [0,4194304] 0 2023-12-05T09:57:21.697 INFO:tasks.workunit.client.1.smithi150.stdout:5/122: dwrite d1/d3/f7 [0,4194304] 0 2023-12-05T09:57:21.701 INFO:tasks.workunit.client.1.smithi150.stdout:7/109: sync 2023-12-05T09:57:21.702 INFO:tasks.workunit.client.1.smithi150.stdout:7/110: read - d2/d4/d8/d18/d1a/f1f zero size 2023-12-05T09:57:21.702 INFO:tasks.workunit.client.1.smithi150.stdout:6/112: sync 2023-12-05T09:57:21.703 INFO:tasks.workunit.client.1.smithi150.stdout:0/126: dwrite d5/d11/d16/f1e [0,4194304] 0 2023-12-05T09:57:21.703 INFO:tasks.workunit.client.0.smithi100.stdout:8/116: dwrite d0/f9 [0,4194304] 0 2023-12-05T09:57:21.705 INFO:tasks.workunit.client.1.smithi150.stdout:5/123: dread d1/d15/f16 [0,4194304] 0 2023-12-05T09:57:21.705 INFO:tasks.workunit.client.1.smithi150.stdout:5/124: readlink d1/l5 0 2023-12-05T09:57:21.711 INFO:tasks.workunit.client.1.smithi150.stdout:9/113: unlink d3/f4 0 2023-12-05T09:57:21.711 INFO:tasks.workunit.client.1.smithi150.stdout:9/114: readlink d3/d1b/l1e 0 2023-12-05T09:57:21.711 INFO:tasks.workunit.client.1.smithi150.stdout:9/115: chown d3/d9/cd 58725 1 2023-12-05T09:57:21.711 INFO:tasks.workunit.client.1.smithi150.stdout:9/116: fsync d3/d9/dc/f19 0 2023-12-05T09:57:21.712 INFO:tasks.workunit.client.0.smithi100.stdout:1/175: mknod db/d12/d1e/d26/c37 0 2023-12-05T09:57:21.712 INFO:tasks.workunit.client.0.smithi100.stdout:1/176: chown db/d12/d1e/l2f 114738575 1 2023-12-05T09:57:21.712 INFO:tasks.workunit.client.0.smithi100.stdout:1/177: readlink db/l22 0 2023-12-05T09:57:21.713 INFO:tasks.workunit.client.0.smithi100.stdout:1/178: creat db/d12/d1e/f38 x:0 0 0 2023-12-05T09:57:21.715 INFO:tasks.workunit.client.1.smithi150.stdout:1/164: unlink d6/d8/db/f2f 0 2023-12-05T09:57:21.717 INFO:tasks.workunit.client.0.smithi100.stdout:0/197: link da/d1b/f3c da/d2a/f3f 0 2023-12-05T09:57:21.717 INFO:tasks.workunit.client.0.smithi100.stdout:0/198: write da/f2d [1277523,128858] 0 2023-12-05T09:57:21.721 INFO:tasks.workunit.client.1.smithi150.stdout:4/74: creat d0/d11/f12 x:0 0 0 2023-12-05T09:57:21.721 INFO:tasks.workunit.client.1.smithi150.stdout:4/75: write d0/fc [341251,88456] 0 2023-12-05T09:57:21.722 INFO:tasks.workunit.client.1.smithi150.stdout:7/111: mkdir d2/db/d17/d20 0 2023-12-05T09:57:21.722 INFO:tasks.workunit.client.1.smithi150.stdout:7/112: fdatasync d2/d4/d8/d18/d1a/f1f 0 2023-12-05T09:57:21.733 INFO:tasks.workunit.client.1.smithi150.stdout:1/165: dread d6/d8/db/de/f32 [0,4194304] 0 2023-12-05T09:57:21.740 INFO:tasks.workunit.client.1.smithi150.stdout:0/127: mkdir d5/d11/d16/d27 0 2023-12-05T09:57:21.742 INFO:tasks.workunit.client.1.smithi150.stdout:0/128: read d5/fc [441692,3674] 0 2023-12-05T09:57:21.743 INFO:tasks.workunit.client.1.smithi150.stdout:5/125: symlink d1/l2b 0 2023-12-05T09:57:21.747 INFO:tasks.workunit.client.1.smithi150.stdout:9/117: mkdir d3/d9/dc/d1f 0 2023-12-05T09:57:21.750 INFO:tasks.workunit.client.1.smithi150.stdout:6/113: rename d2/f19 to d2/da/f27 0 2023-12-05T09:57:21.752 INFO:tasks.workunit.client.1.smithi150.stdout:4/76: dread d0/f8 [4194304,4194304] 0 2023-12-05T09:57:21.752 INFO:tasks.workunit.client.1.smithi150.stdout:4/77: write d0/f8 [6054570,92292] 0 2023-12-05T09:57:21.758 INFO:tasks.workunit.client.1.smithi150.stdout:8/127: truncate d0/fc 708255 0 2023-12-05T09:57:21.764 INFO:tasks.workunit.client.1.smithi150.stdout:0/129: dread d5/d11/f21 [0,4194304] 0 2023-12-05T09:57:21.764 INFO:tasks.workunit.client.0.smithi100.stdout:3/235: truncate d0/d2/de/d12/f18 86581 0 2023-12-05T09:57:21.766 INFO:tasks.workunit.client.1.smithi150.stdout:4/78: symlink d0/l13 0 2023-12-05T09:57:21.767 INFO:tasks.workunit.client.1.smithi150.stdout:4/79: chown d0 38340839 1 2023-12-05T09:57:21.767 INFO:tasks.workunit.client.1.smithi150.stdout:4/80: chown d0/c10 111 1 2023-12-05T09:57:21.767 INFO:tasks.workunit.client.1.smithi150.stdout:4/81: stat d0/c10 0 2023-12-05T09:57:21.767 INFO:tasks.workunit.client.0.smithi100.stdout:1/179: dwrite db/d12/d1e/f38 [0,4194304] 0 2023-12-05T09:57:21.767 INFO:tasks.workunit.client.0.smithi100.stdout:1/180: fdatasync db/d12/d1e/f2e 0 2023-12-05T09:57:21.769 INFO:tasks.workunit.client.0.smithi100.stdout:4/141: truncate de/d16/f20 2457590 0 2023-12-05T09:57:21.771 INFO:tasks.workunit.client.1.smithi150.stdout:1/166: rename d6/l1d to d6/d8/db/d1b/l3a 0 2023-12-05T09:57:21.773 INFO:tasks.workunit.client.1.smithi150.stdout:7/113: dwrite d2/db/d17/f19 [4194304,4194304] 0 2023-12-05T09:57:21.774 INFO:tasks.workunit.client.1.smithi150.stdout:8/128: write d0/f13 [888040,4101] 0 2023-12-05T09:57:21.775 INFO:tasks.workunit.client.1.smithi150.stdout:6/114: link c1 d2/da/c28 0 2023-12-05T09:57:21.777 INFO:tasks.workunit.client.1.smithi150.stdout:5/126: dread d1/d3/d6/f1c [0,4194304] 0 2023-12-05T09:57:21.778 INFO:tasks.workunit.client.1.smithi150.stdout:0/130: mkdir d5/d11/d28 0 2023-12-05T09:57:21.778 INFO:tasks.workunit.client.0.smithi100.stdout:8/117: creat d0/f17 x:0 0 0 2023-12-05T09:57:21.782 INFO:tasks.workunit.client.1.smithi150.stdout:4/82: mknod d0/c14 0 2023-12-05T09:57:21.782 INFO:tasks.workunit.client.1.smithi150.stdout:4/83: stat d0/le 0 2023-12-05T09:57:21.782 INFO:tasks.workunit.client.1.smithi150.stdout:4/84: creat d0/d11/f15 x:0 0 0 2023-12-05T09:57:21.784 INFO:tasks.workunit.client.0.smithi100.stdout:4/142: write de/f15 [820515,57798] 0 2023-12-05T09:57:21.788 INFO:tasks.workunit.client.1.smithi150.stdout:1/167: mknod d6/d8/c3b 0 2023-12-05T09:57:21.790 INFO:tasks.workunit.client.1.smithi150.stdout:6/115: dread d2/f13 [0,4194304] 0 2023-12-05T09:57:21.790 INFO:tasks.workunit.client.1.smithi150.stdout:6/116: write d2/f1c [1576898,104748] 0 2023-12-05T09:57:21.794 INFO:tasks.workunit.client.0.smithi100.stdout:5/199: getdents d0/d4/d5/df 0 2023-12-05T09:57:21.795 INFO:tasks.workunit.client.0.smithi100.stdout:8/118: write d0/f9 [1405781,22178] 0 2023-12-05T09:57:21.795 INFO:tasks.workunit.client.0.smithi100.stdout:8/119: fdatasync d0/fd 0 2023-12-05T09:57:21.796 INFO:tasks.workunit.client.1.smithi150.stdout:7/114: link d2/d4/fc d2/d4/d8/d18/d1a/d1e/f21 0 2023-12-05T09:57:21.796 INFO:tasks.workunit.client.1.smithi150.stdout:7/115: chown d2/d4/d8/d18/d1a/d1e/f21 14 1 2023-12-05T09:57:21.797 INFO:tasks.workunit.client.0.smithi100.stdout:3/236: mkdir d0/d48 0 2023-12-05T09:57:21.800 INFO:tasks.workunit.client.0.smithi100.stdout:1/181: rmdir db/d12 39 2023-12-05T09:57:21.800 INFO:tasks.workunit.client.1.smithi150.stdout:4/85: write d0/f8 [1892357,1311] 0 2023-12-05T09:57:21.801 INFO:tasks.workunit.client.1.smithi150.stdout:9/118: dwrite d3/d9/dc/f1d [0,4194304] 0 2023-12-05T09:57:21.801 INFO:tasks.workunit.client.1.smithi150.stdout:9/119: dread - d3/d9/f17 zero size 2023-12-05T09:57:21.802 INFO:tasks.workunit.client.1.smithi150.stdout:8/129: mknod d0/d8/d14/c25 0 2023-12-05T09:57:21.803 INFO:tasks.workunit.client.1.smithi150.stdout:4/86: fsync d0/f8 0 2023-12-05T09:57:21.803 INFO:tasks.workunit.client.1.smithi150.stdout:4/87: fdatasync d0/ff 0 2023-12-05T09:57:21.803 INFO:tasks.workunit.client.1.smithi150.stdout:4/88: fdatasync d0/d11/f15 0 2023-12-05T09:57:21.803 INFO:tasks.workunit.client.1.smithi150.stdout:4/89: creat d0/f16 x:0 0 0 2023-12-05T09:57:21.803 INFO:tasks.workunit.client.1.smithi150.stdout:4/90: readlink d0/le 0 2023-12-05T09:57:21.803 INFO:tasks.workunit.client.1.smithi150.stdout:4/91: creat d0/f17 x:0 0 0 2023-12-05T09:57:21.803 INFO:tasks.workunit.client.1.smithi150.stdout:4/92: write d0/f16 [74388,118199] 0 2023-12-05T09:57:21.803 INFO:tasks.workunit.client.1.smithi150.stdout:4/93: dread - d0/d11/f12 zero size 2023-12-05T09:57:21.804 INFO:tasks.workunit.client.1.smithi150.stdout:4/94: readlink d0/l13 0 2023-12-05T09:57:21.804 INFO:tasks.workunit.client.0.smithi100.stdout:2/270: rename d7/da/dc/c32 to d7/da/d13/c5c 0 2023-12-05T09:57:21.806 INFO:tasks.workunit.client.1.smithi150.stdout:5/127: unlink d1/d3/d6/d11/l1f 0 2023-12-05T09:57:21.808 INFO:tasks.workunit.client.1.smithi150.stdout:0/131: symlink d5/d1b/l29 0 2023-12-05T09:57:21.809 INFO:tasks.workunit.client.0.smithi100.stdout:4/143: truncate de/f14 238229 0 2023-12-05T09:57:21.811 INFO:tasks.workunit.client.0.smithi100.stdout:5/200: mknod d0/d16/d37/c46 0 2023-12-05T09:57:21.814 INFO:tasks.workunit.client.1.smithi150.stdout:6/117: creat d2/d23/f29 x:0 0 0 2023-12-05T09:57:21.816 INFO:tasks.workunit.client.0.smithi100.stdout:8/120: mknod d0/d12/d13/d16/c18 0 2023-12-05T09:57:21.818 INFO:tasks.workunit.client.0.smithi100.stdout:3/237: link d0/d2/de/d11/f21 d0/d10/f49 0 2023-12-05T09:57:21.822 INFO:tasks.workunit.client.0.smithi100.stdout:1/182: mkdir db/d12/d1e/d26/d39 0 2023-12-05T09:57:21.827 INFO:tasks.workunit.client.1.smithi150.stdout:0/132: write d5/d11/d16/f1e [3188272,11955] 0 2023-12-05T09:57:21.827 INFO:tasks.workunit.client.0.smithi100.stdout:5/201: link d0/d1f/d25/c44 d0/d4/d5/df/c47 0 2023-12-05T09:57:21.832 INFO:tasks.workunit.client.0.smithi100.stdout:8/121: link d0/f17 d0/f19 0 2023-12-05T09:57:21.833 INFO:tasks.workunit.client.0.smithi100.stdout:8/122: write d0/f9 [5152631,1471] 0 2023-12-05T09:57:21.835 INFO:tasks.workunit.client.0.smithi100.stdout:1/183: mkdir db/d31/d3a 0 2023-12-05T09:57:21.835 INFO:tasks.workunit.client.0.smithi100.stdout:1/184: stat db/d12/l28 0 2023-12-05T09:57:21.835 INFO:tasks.workunit.client.0.smithi100.stdout:1/185: chown db/c11 3358 1 2023-12-05T09:57:21.835 INFO:tasks.workunit.client.0.smithi100.stdout:1/186: fsync db/d12/d1e/d26/d30/f33 0 2023-12-05T09:57:21.838 INFO:tasks.workunit.client.0.smithi100.stdout:2/271: rename d7/da/d18/d21/f30 to d7/da/d13/f5d 0 2023-12-05T09:57:21.840 INFO:tasks.workunit.client.1.smithi150.stdout:9/120: creat d3/d9/f20 x:0 0 0 2023-12-05T09:57:21.843 INFO:tasks.workunit.client.1.smithi150.stdout:7/116: dwrite d2/d4/ff [0,4194304] 0 2023-12-05T09:57:21.843 INFO:tasks.workunit.client.1.smithi150.stdout:7/117: fsync d2/d4/d8/d13/f1d 0 2023-12-05T09:57:21.851 INFO:tasks.workunit.client.0.smithi100.stdout:8/123: unlink d0/d12/d13/d16/c18 0 2023-12-05T09:57:21.852 INFO:tasks.workunit.client.1.smithi150.stdout:8/130: dread d0/ff [0,4194304] 0 2023-12-05T09:57:21.852 INFO:tasks.workunit.client.0.smithi100.stdout:1/187: mkdir db/d31/d3a/d3b 0 2023-12-05T09:57:21.852 INFO:tasks.workunit.client.0.smithi100.stdout:1/188: chown db/c15 20214 1 2023-12-05T09:57:21.852 INFO:tasks.workunit.client.0.smithi100.stdout:1/189: truncate db/d12/f14 665790 0 2023-12-05T09:57:21.855 INFO:tasks.workunit.client.0.smithi100.stdout:5/202: rename d0/d4/d5 to d0/d16/d2b/d48 0 2023-12-05T09:57:21.856 INFO:tasks.workunit.client.0.smithi100.stdout:5/203: readlink d0/d1f/l24 0 2023-12-05T09:57:21.857 INFO:tasks.workunit.client.1.smithi150.stdout:3/139: sync 2023-12-05T09:57:21.857 INFO:tasks.workunit.client.1.smithi150.stdout:2/133: sync 2023-12-05T09:57:21.857 INFO:tasks.workunit.client.1.smithi150.stdout:2/134: creat d0/d3/d11/d1d/f2f x:0 0 0 2023-12-05T09:57:21.858 INFO:tasks.workunit.client.0.smithi100.stdout:8/124: symlink d0/d12/d13/d16/l1a 0 2023-12-05T09:57:21.858 INFO:tasks.workunit.client.0.smithi100.stdout:8/125: chown d0/fd 567722 1 2023-12-05T09:57:21.859 INFO:tasks.workunit.client.1.smithi150.stdout:9/121: dread d3/d9/dc/f1d [0,4194304] 0 2023-12-05T09:57:21.859 INFO:tasks.workunit.client.1.smithi150.stdout:9/122: creat d3/d12/f21 x:0 0 0 2023-12-05T09:57:21.860 INFO:tasks.workunit.client.1.smithi150.stdout:5/128: unlink d1/c14 0 2023-12-05T09:57:21.861 INFO:tasks.workunit.client.1.smithi150.stdout:5/129: write d1/d15/f29 [932291,81322] 0 2023-12-05T09:57:21.865 INFO:tasks.workunit.client.1.smithi150.stdout:1/168: mkdir d6/d3c 0 2023-12-05T09:57:21.868 INFO:tasks.workunit.client.1.smithi150.stdout:0/133: link d5/d11/l12 d5/d11/d16/d1f/l2a 0 2023-12-05T09:57:21.868 INFO:tasks.workunit.client.1.smithi150.stdout:0/134: fdatasync d5/d11/f26 0 2023-12-05T09:57:21.868 INFO:tasks.workunit.client.1.smithi150.stdout:0/135: chown d5/d11/f18 15648887 1 2023-12-05T09:57:21.874 INFO:tasks.workunit.client.1.smithi150.stdout:1/169: dread d6/d8/fc [0,4194304] 0 2023-12-05T09:57:21.874 INFO:tasks.workunit.client.1.smithi150.stdout:1/170: chown d6/d8/l2e 416159 1 2023-12-05T09:57:21.876 INFO:tasks.workunit.client.0.smithi100.stdout:4/144: dwrite f9 [0,4194304] 0 2023-12-05T09:57:21.876 INFO:tasks.workunit.client.0.smithi100.stdout:4/145: creat de/d16/d23/f29 x:0 0 0 2023-12-05T09:57:21.876 INFO:tasks.workunit.client.0.smithi100.stdout:4/146: getdents de/d16/d1e 0 2023-12-05T09:57:21.876 INFO:tasks.workunit.client.1.smithi150.stdout:8/131: rmdir d0/d8/d14/d1b 39 2023-12-05T09:57:21.878 INFO:tasks.workunit.client.0.smithi100.stdout:3/238: dwrite d0/d4/f1e [0,4194304] 0 2023-12-05T09:57:21.878 INFO:tasks.workunit.client.0.smithi100.stdout:3/239: creat d0/d4/f4a x:0 0 0 2023-12-05T09:57:21.878 INFO:tasks.workunit.client.0.smithi100.stdout:3/240: readlink d0/l6 0 2023-12-05T09:57:21.879 INFO:tasks.workunit.client.0.smithi100.stdout:8/126: write d0/f2 [1827778,121049] 0 2023-12-05T09:57:21.879 INFO:tasks.workunit.client.1.smithi150.stdout:4/95: rename d0/f16 to d0/d11/f18 0 2023-12-05T09:57:21.884 INFO:tasks.workunit.client.0.smithi100.stdout:4/147: rmdir de/d16 39 2023-12-05T09:57:21.884 INFO:tasks.workunit.client.1.smithi150.stdout:3/140: creat d6/d25/d28/f2e x:0 0 0 2023-12-05T09:57:21.888 INFO:tasks.workunit.client.0.smithi100.stdout:1/190: rmdir db 39 2023-12-05T09:57:21.888 INFO:tasks.workunit.client.0.smithi100.stdout:1/191: read db/d12/f13 [574847,50964] 0 2023-12-05T09:57:21.890 INFO:tasks.workunit.client.1.smithi150.stdout:2/135: mkdir d0/d3/d5/d13/d15/d30 0 2023-12-05T09:57:21.891 INFO:tasks.workunit.client.0.smithi100.stdout:3/241: symlink d0/l4b 0 2023-12-05T09:57:21.895 INFO:tasks.workunit.client.0.smithi100.stdout:8/127: mknod d0/d12/d13/c1b 0 2023-12-05T09:57:21.895 INFO:tasks.workunit.client.0.smithi100.stdout:8/128: readlink d0/d12/l15 0 2023-12-05T09:57:21.895 INFO:tasks.workunit.client.0.smithi100.stdout:8/129: write d0/f17 [622216,69082] 0 2023-12-05T09:57:21.898 INFO:tasks.workunit.client.1.smithi150.stdout:9/123: mknod d3/d9/dc/d1f/c22 0 2023-12-05T09:57:21.899 INFO:tasks.workunit.client.0.smithi100.stdout:4/148: link de/c1f de/d16/d1e/c2a 0 2023-12-05T09:57:21.899 INFO:tasks.workunit.client.0.smithi100.stdout:4/149: chown de/d1d 1 1 2023-12-05T09:57:21.899 INFO:tasks.workunit.client.0.smithi100.stdout:4/150: fsync de/f14 0 2023-12-05T09:57:21.899 INFO:tasks.workunit.client.1.smithi150.stdout:5/130: creat d1/d3/d6/d11/f2c x:0 0 0 2023-12-05T09:57:21.901 INFO:tasks.workunit.client.0.smithi100.stdout:1/192: stat db/l1b 0 2023-12-05T09:57:21.903 INFO:tasks.workunit.client.1.smithi150.stdout:0/136: mknod d5/d11/d16/d1f/c2b 0 2023-12-05T09:57:21.903 INFO:tasks.workunit.client.0.smithi100.stdout:5/204: dwrite d0/f3 [0,4194304] 0 2023-12-05T09:57:21.904 INFO:tasks.workunit.client.0.smithi100.stdout:3/242: unlink d0/d10/l1d 0 2023-12-05T09:57:21.904 INFO:tasks.workunit.client.0.smithi100.stdout:2/272: dwrite d7/da/dc/f56 [0,4194304] 0 2023-12-05T09:57:21.905 INFO:tasks.workunit.client.0.smithi100.stdout:8/130: symlink d0/d12/d13/l1c 0 2023-12-05T09:57:21.905 INFO:tasks.workunit.client.0.smithi100.stdout:8/131: stat d0/d12/d13/l1c 0 2023-12-05T09:57:21.906 INFO:tasks.workunit.client.0.smithi100.stdout:4/151: mknod de/d16/d23/c2b 0 2023-12-05T09:57:21.906 INFO:tasks.workunit.client.0.smithi100.stdout:4/152: creat de/d16/d23/f2c x:0 0 0 2023-12-05T09:57:21.907 INFO:tasks.workunit.client.0.smithi100.stdout:1/193: mknod db/d31/d3a/c3c 0 2023-12-05T09:57:21.907 INFO:tasks.workunit.client.0.smithi100.stdout:1/194: write db/d31/f36 [601897,50782] 0 2023-12-05T09:57:21.909 INFO:tasks.workunit.client.0.smithi100.stdout:5/205: rename d0/d16/d2b/c34 to d0/d4/d14/d35/c49 0 2023-12-05T09:57:21.909 INFO:tasks.workunit.client.1.smithi150.stdout:7/118: rmdir d2/d4 39 2023-12-05T09:57:21.909 INFO:tasks.workunit.client.1.smithi150.stdout:7/119: readlink d2/d4/d8/ld 0 2023-12-05T09:57:21.909 INFO:tasks.workunit.client.1.smithi150.stdout:7/120: dread - d2/f12 zero size 2023-12-05T09:57:21.911 INFO:tasks.workunit.client.1.smithi150.stdout:8/132: link d0/d8/f11 d0/d8/d14/f26 0 2023-12-05T09:57:21.918 INFO:tasks.workunit.client.1.smithi150.stdout:6/118: rename d2/c17 to d2/d23/c2a 0 2023-12-05T09:57:21.918 INFO:tasks.workunit.client.1.smithi150.stdout:8/133: rename d0/d8 to d0/d8/d14/d1b/d24/d27 22 2023-12-05T09:57:21.923 INFO:tasks.workunit.client.1.smithi150.stdout:5/131: mknod d1/d3/d6/d26/c2d 0 2023-12-05T09:57:21.923 INFO:tasks.workunit.client.1.smithi150.stdout:0/137: mknod d5/c2c 0 2023-12-05T09:57:21.924 INFO:tasks.workunit.client.1.smithi150.stdout:5/132: dread - d1/d3/d6/d11/f2c zero size 2023-12-05T09:57:21.924 INFO:tasks.workunit.client.1.smithi150.stdout:9/124: truncate d3/d9/f14 3380972 0 2023-12-05T09:57:21.924 INFO:tasks.workunit.client.1.smithi150.stdout:9/125: write d3/d9/f17 [686035,64186] 0 2023-12-05T09:57:21.924 INFO:tasks.workunit.client.0.smithi100.stdout:8/132: write d0/fc [2345174,115416] 0 2023-12-05T09:57:21.924 INFO:tasks.workunit.client.0.smithi100.stdout:8/133: fdatasync d0/f3 0 2023-12-05T09:57:21.924 INFO:tasks.workunit.client.0.smithi100.stdout:8/134: creat d0/f1d x:0 0 0 2023-12-05T09:57:21.931 INFO:tasks.workunit.client.1.smithi150.stdout:7/121: unlink d2/d4/c11 0 2023-12-05T09:57:21.931 INFO:tasks.workunit.client.1.smithi150.stdout:7/122: chown d2/d4/d8/d18/d1a/d1e 0 1 2023-12-05T09:57:21.931 INFO:tasks.workunit.client.1.smithi150.stdout:8/134: rename d0/f1e to d0/d8/d14/d1b/f28 0 2023-12-05T09:57:21.931 INFO:tasks.workunit.client.1.smithi150.stdout:0/138: mknod d5/d11/d16/d27/c2d 0 2023-12-05T09:57:21.931 INFO:tasks.workunit.client.1.smithi150.stdout:5/133: mkdir d1/d2e 0 2023-12-05T09:57:21.931 INFO:tasks.workunit.client.0.smithi100.stdout:3/243: symlink d0/d4/l4c 0 2023-12-05T09:57:21.931 INFO:tasks.workunit.client.0.smithi100.stdout:2/273: fdatasync d7/da/d13/f4a 0 2023-12-05T09:57:21.932 INFO:tasks.workunit.client.0.smithi100.stdout:2/274: stat d7/da/dc/f4f 0 2023-12-05T09:57:21.932 INFO:tasks.workunit.client.1.smithi150.stdout:9/126: mknod d3/d9/dc/c23 0 2023-12-05T09:57:21.937 INFO:tasks.workunit.client.0.smithi100.stdout:5/206: mknod d0/d16/c4a 0 2023-12-05T09:57:21.937 INFO:tasks.workunit.client.1.smithi150.stdout:7/123: rename d2/db/d17/f19 to d2/db/d17/f22 0 2023-12-05T09:57:21.937 INFO:tasks.workunit.client.1.smithi150.stdout:7/124: write d2/d4/d8/d18/d1a/f1f [748628,116548] 0 2023-12-05T09:57:21.937 INFO:tasks.workunit.client.1.smithi150.stdout:7/125: write d2/d4/d8/d18/d1a/f1f [1106310,16897] 0 2023-12-05T09:57:21.940 INFO:tasks.workunit.client.1.smithi150.stdout:0/139: creat d5/d11/d16/d1f/f2e x:0 0 0 2023-12-05T09:57:21.942 INFO:tasks.workunit.client.0.smithi100.stdout:2/275: rename d7/f4b to d7/da/d18/d1b/d2c/d3f/f5e 0 2023-12-05T09:57:21.942 INFO:tasks.workunit.client.0.smithi100.stdout:2/276: stat d7/da/c42 0 2023-12-05T09:57:21.942 INFO:tasks.workunit.client.0.smithi100.stdout:2/277: chown d7/da/d1a 101 1 2023-12-05T09:57:21.943 INFO:tasks.workunit.client.1.smithi150.stdout:0/140: rename d5/d11/c19 to d5/c2f 0 2023-12-05T09:57:21.946 INFO:tasks.workunit.client.1.smithi150.stdout:0/141: creat d5/d1b/f30 x:0 0 0 2023-12-05T09:57:21.946 INFO:tasks.workunit.client.1.smithi150.stdout:0/142: dread - d5/f23 zero size 2023-12-05T09:57:21.946 INFO:tasks.workunit.client.1.smithi150.stdout:0/143: write d5/fc [1124226,45816] 0 2023-12-05T09:57:21.946 INFO:tasks.workunit.client.0.smithi100.stdout:2/278: getdents d7/da/d18/d1b/d2c/d3f/d46 0 2023-12-05T09:57:21.947 INFO:tasks.workunit.client.1.smithi150.stdout:6/119: dread d2/da/f10 [0,4194304] 0 2023-12-05T09:57:21.950 INFO:tasks.workunit.client.1.smithi150.stdout:3/141: dwrite d6/f17 [0,4194304] 0 2023-12-05T09:57:21.950 INFO:tasks.workunit.client.1.smithi150.stdout:3/142: chown d6/d9/dd/f13 1401480044 1 2023-12-05T09:57:21.972 INFO:tasks.workunit.client.0.smithi100.stdout:1/195: dwrite db/d12/d1e/d26/f27 [0,4194304] 0 2023-12-05T09:57:21.972 INFO:tasks.workunit.client.0.smithi100.stdout:1/196: chown db/d12/d1e/l2f 1 1 2023-12-05T09:57:21.975 INFO:tasks.workunit.client.0.smithi100.stdout:5/207: read d0/f3 [3242372,70989] 0 2023-12-05T09:57:21.975 INFO:tasks.workunit.client.0.smithi100.stdout:1/197: unlink db/fc 0 2023-12-05T09:57:21.979 INFO:tasks.workunit.client.1.smithi150.stdout:3/143: dread d6/d9/f1d [0,4194304] 0 2023-12-05T09:57:21.980 INFO:tasks.workunit.client.0.smithi100.stdout:5/208: creat d0/d27/f4b x:0 0 0 2023-12-05T09:57:21.980 INFO:tasks.workunit.client.0.smithi100.stdout:1/198: mknod db/d31/d3a/d3b/c3d 0 2023-12-05T09:57:21.980 INFO:tasks.workunit.client.0.smithi100.stdout:1/199: creat db/d31/d3a/f3e x:0 0 0 2023-12-05T09:57:21.981 INFO:tasks.workunit.client.0.smithi100.stdout:1/200: rename db/d12/c1c to db/d12/d1e/d26/c3f 0 2023-12-05T09:57:21.983 INFO:tasks.workunit.client.1.smithi150.stdout:1/171: dwrite d6/d8/db/de/f13 [4194304,4194304] 0 2023-12-05T09:57:21.983 INFO:tasks.workunit.client.1.smithi150.stdout:5/134: dread d1/d15/f29 [0,4194304] 0 2023-12-05T09:57:21.984 INFO:tasks.workunit.client.0.smithi100.stdout:1/201: truncate db/ff 2384155 0 2023-12-05T09:57:21.985 INFO:tasks.workunit.client.1.smithi150.stdout:1/172: creat d6/d38/f3d x:0 0 0 2023-12-05T09:57:21.987 INFO:tasks.workunit.client.1.smithi150.stdout:5/135: rename d1/d3/d6/d11/f2c to d1/d3/d6/d11/f2f 0 2023-12-05T09:57:21.987 INFO:tasks.workunit.client.1.smithi150.stdout:5/136: creat d1/d3/d6/d26/f30 x:0 0 0 2023-12-05T09:57:21.987 INFO:tasks.workunit.client.1.smithi150.stdout:5/137: write d1/d3/f1d [916092,92768] 0 2023-12-05T09:57:21.988 INFO:tasks.workunit.client.1.smithi150.stdout:2/136: dwrite d0/d3/d11/f18 [0,4194304] 0 2023-12-05T09:57:21.988 INFO:tasks.workunit.client.1.smithi150.stdout:2/137: dread - d0/d3/d11/d1d/f2f zero size 2023-12-05T09:57:21.990 INFO:tasks.workunit.client.1.smithi150.stdout:1/173: link f5 d6/d3c/f3e 0 2023-12-05T09:57:21.992 INFO:tasks.workunit.client.1.smithi150.stdout:2/138: unlink d0/d3/c2e 0 2023-12-05T09:57:21.994 INFO:tasks.workunit.client.1.smithi150.stdout:1/174: rmdir d6/d8/db/d1b 39 2023-12-05T09:57:21.995 INFO:tasks.workunit.client.1.smithi150.stdout:1/175: creat d6/f3f x:0 0 0 2023-12-05T09:57:21.995 INFO:tasks.workunit.client.1.smithi150.stdout:1/176: dread - d6/d8/db/d1b/f37 zero size 2023-12-05T09:57:21.997 INFO:tasks.workunit.client.1.smithi150.stdout:1/177: rename d6/d3c/f3e to d6/d3c/f40 0 2023-12-05T09:57:21.998 INFO:tasks.workunit.client.1.smithi150.stdout:8/135: dwrite d0/d8/d14/d1b/f28 [0,4194304] 0 2023-12-05T09:57:22.002 INFO:tasks.workunit.client.1.smithi150.stdout:6/120: dwrite d2/da/fe [0,4194304] 0 2023-12-05T09:57:22.005 INFO:tasks.workunit.client.1.smithi150.stdout:6/121: rename d2/f9 to d2/da/f2b 0 2023-12-05T09:57:22.007 INFO:tasks.workunit.client.1.smithi150.stdout:6/122: unlink d2/da/c28 0 2023-12-05T09:57:22.007 INFO:tasks.workunit.client.1.smithi150.stdout:6/123: readlink d2/l15 0 2023-12-05T09:57:22.008 INFO:tasks.workunit.client.1.smithi150.stdout:0/144: dwrite d5/d11/f18 [4194304,4194304] 0 2023-12-05T09:57:22.008 INFO:tasks.workunit.client.1.smithi150.stdout:0/145: creat d5/f31 x:0 0 0 2023-12-05T09:57:22.009 INFO:tasks.workunit.client.0.smithi100.stdout:1/202: dread db/d12/d1e/d26/f27 [0,4194304] 0 2023-12-05T09:57:22.009 INFO:tasks.workunit.client.0.smithi100.stdout:1/203: readlink db/le 0 2023-12-05T09:57:22.010 INFO:tasks.workunit.client.0.smithi100.stdout:1/204: write db/d12/f18 [3958392,114326] 0 2023-12-05T09:57:22.010 INFO:tasks.workunit.client.0.smithi100.stdout:1/205: chown db/fd 2117 1 2023-12-05T09:57:22.010 INFO:tasks.workunit.client.0.smithi100.stdout:1/206: write db/d12/d1e/f34 [770393,93271] 0 2023-12-05T09:57:22.013 INFO:tasks.workunit.client.1.smithi150.stdout:2/139: read d0/d3/d5/f1e [409352,54287] 0 2023-12-05T09:57:22.013 INFO:tasks.workunit.client.1.smithi150.stdout:0/146: mkdir d5/d11/d32 0 2023-12-05T09:57:22.016 INFO:tasks.workunit.client.1.smithi150.stdout:2/140: mknod d0/d3/d11/c31 0 2023-12-05T09:57:22.016 INFO:tasks.workunit.client.1.smithi150.stdout:5/138: dread d1/d3/fb [0,4194304] 0 2023-12-05T09:57:22.034 INFO:tasks.workunit.client.1.smithi150.stdout:5/139: dread d1/d3/fb [0,4194304] 0 2023-12-05T09:57:22.034 INFO:tasks.workunit.client.1.smithi150.stdout:5/140: write d1/d3/d6/f8 [264198,84478] 0 2023-12-05T09:57:22.035 INFO:tasks.workunit.client.1.smithi150.stdout:5/141: mkdir d1/d3/d1e/d31 0 2023-12-05T09:57:22.061 INFO:tasks.workunit.client.0.smithi100.stdout:2/279: dread d7/da/f17 [0,4194304] 0 2023-12-05T09:57:22.061 INFO:tasks.workunit.client.0.smithi100.stdout:7/129: sync 2023-12-05T09:57:22.061 INFO:tasks.workunit.client.0.smithi100.stdout:6/501: sync 2023-12-05T09:57:22.061 INFO:tasks.workunit.client.0.smithi100.stdout:9/246: sync 2023-12-05T09:57:22.061 INFO:tasks.workunit.client.0.smithi100.stdout:6/502: write d7/f89 [876726,89652] 0 2023-12-05T09:57:22.062 INFO:tasks.workunit.client.1.smithi150.stdout:2/141: dread d0/d3/d5/d10/f1b [0,4194304] 0 2023-12-05T09:57:22.067 INFO:tasks.workunit.client.1.smithi150.stdout:2/142: symlink d0/d3/d21/l32 0 2023-12-05T09:57:22.067 INFO:tasks.workunit.client.1.smithi150.stdout:2/143: fdatasync d0/d3/d5/d10/f1b 0 2023-12-05T09:57:22.067 INFO:tasks.workunit.client.1.smithi150.stdout:2/144: write d0/d3/d5/d10/f19 [354774,31335] 0 2023-12-05T09:57:22.067 INFO:tasks.workunit.client.1.smithi150.stdout:2/145: stat d0/d3/d5/d13/d15 0 2023-12-05T09:57:22.067 INFO:tasks.workunit.client.1.smithi150.stdout:2/146: fsync d0/f7 0 2023-12-05T09:57:22.069 INFO:tasks.workunit.client.0.smithi100.stdout:3/244: dwrite d0/d2/d33/f40 [0,4194304] 0 2023-12-05T09:57:22.070 INFO:tasks.workunit.client.0.smithi100.stdout:3/245: truncate d0/d2/de/d12/f18 863905 0 2023-12-05T09:57:22.070 INFO:tasks.workunit.client.0.smithi100.stdout:3/246: fsync d0/d10/f49 0 2023-12-05T09:57:22.071 INFO:tasks.workunit.client.0.smithi100.stdout:7/130: write d3/dc/d11/d13/de/f22 [4022005,128070] 0 2023-12-05T09:57:22.071 INFO:tasks.workunit.client.0.smithi100.stdout:7/131: chown d3/dc/d11/d13/de/f2b 150938 1 2023-12-05T09:57:22.071 INFO:tasks.workunit.client.0.smithi100.stdout:9/247: creat d7/d1b/d22/d25/d2e/f53 x:0 0 0 2023-12-05T09:57:22.073 INFO:tasks.workunit.client.0.smithi100.stdout:6/503: symlink d7/la8 0 2023-12-05T09:57:22.073 INFO:tasks.workunit.client.0.smithi100.stdout:6/504: write d7/d11/d1a/f22 [1343332,11758] 0 2023-12-05T09:57:22.075 INFO:tasks.workunit.client.0.smithi100.stdout:1/207: dwrite db/f35 [0,4194304] 0 2023-12-05T09:57:22.075 INFO:tasks.workunit.client.0.smithi100.stdout:1/208: read - db/d31/d3a/f3e zero size 2023-12-05T09:57:22.075 INFO:tasks.workunit.client.1.smithi150.stdout:3/144: dwrite d6/d9/dd/f13 [0,4194304] 0 2023-12-05T09:57:22.076 INFO:tasks.workunit.client.1.smithi150.stdout:3/145: write d6/d9/f1c [4331741,95197] 0 2023-12-05T09:57:22.076 INFO:tasks.workunit.client.1.smithi150.stdout:3/146: read - d6/d25/d28/f2d zero size 2023-12-05T09:57:22.083 INFO:tasks.workunit.client.0.smithi100.stdout:9/248: unlink d7/f1d 0 2023-12-05T09:57:22.083 INFO:tasks.workunit.client.0.smithi100.stdout:5/209: dwrite d0/d16/f3b [0,4194304] 0 2023-12-05T09:57:22.083 INFO:tasks.workunit.client.1.smithi150.stdout:7/126: link d2/db/d17/f22 d2/d4/f23 0 2023-12-05T09:57:22.084 INFO:tasks.workunit.client.0.smithi100.stdout:3/247: symlink d0/l4d 0 2023-12-05T09:57:22.089 INFO:tasks.workunit.client.1.smithi150.stdout:8/136: dwrite d0/ff [0,4194304] 0 2023-12-05T09:57:22.091 INFO:tasks.workunit.client.0.smithi100.stdout:6/505: stat d7/d11/l13 0 2023-12-05T09:57:22.092 INFO:tasks.workunit.client.1.smithi150.stdout:7/127: creat d2/d4/d8/d18/d1a/d1e/f24 x:0 0 0 2023-12-05T09:57:22.093 INFO:tasks.workunit.client.0.smithi100.stdout:1/209: mknod db/d12/d1e/c40 0 2023-12-05T09:57:22.094 INFO:tasks.workunit.client.0.smithi100.stdout:0/199: sync 2023-12-05T09:57:22.101 INFO:tasks.workunit.client.1.smithi150.stdout:8/137: dread d0/f13 [0,4194304] 0 2023-12-05T09:57:22.101 INFO:tasks.workunit.client.1.smithi150.stdout:8/138: write d0/d8/f1f [927383,34745] 0 2023-12-05T09:57:22.103 INFO:tasks.workunit.client.1.smithi150.stdout:7/128: link d2/d4/f23 d2/f25 0 2023-12-05T09:57:22.109 INFO:tasks.workunit.client.1.smithi150.stdout:7/129: creat d2/db/f26 x:0 0 0 2023-12-05T09:57:22.110 INFO:tasks.workunit.client.0.smithi100.stdout:3/248: symlink d0/d4/l4e 0 2023-12-05T09:57:22.112 INFO:tasks.workunit.client.0.smithi100.stdout:0/200: dread da/d22/f23 [0,4194304] 0 2023-12-05T09:57:22.112 INFO:tasks.workunit.client.0.smithi100.stdout:0/201: dread - da/d1b/f3c zero size 2023-12-05T09:57:22.112 INFO:tasks.workunit.client.0.smithi100.stdout:0/202: chown da/l25 7 1 2023-12-05T09:57:22.112 INFO:tasks.workunit.client.0.smithi100.stdout:2/280: dwrite d7/da/d1a/f45 [0,4194304] 0 2023-12-05T09:57:22.113 INFO:tasks.workunit.client.1.smithi150.stdout:5/142: dwrite d1/d3/d6/d26/f28 [0,4194304] 0 2023-12-05T09:57:22.113 INFO:tasks.workunit.client.1.smithi150.stdout:7/130: rmdir d2/d4/d8/d18 39 2023-12-05T09:57:22.113 INFO:tasks.workunit.client.1.smithi150.stdout:7/131: fdatasync d2/f12 0 2023-12-05T09:57:22.113 INFO:tasks.workunit.client.1.smithi150.stdout:7/132: stat d2/d4/d8/d18/d1a/d1e 0 2023-12-05T09:57:22.114 INFO:tasks.workunit.client.0.smithi100.stdout:5/210: dread d0/d1b/f32 [0,4194304] 0 2023-12-05T09:57:22.114 INFO:tasks.workunit.client.0.smithi100.stdout:5/211: truncate d0/f36 447894 0 2023-12-05T09:57:22.121 INFO:tasks.workunit.client.0.smithi100.stdout:7/132: dwrite d3/dc/d11/d13/de/f19 [0,4194304] 0 2023-12-05T09:57:22.122 INFO:tasks.workunit.client.0.smithi100.stdout:6/506: dread d7/d27/d35/d5a/f65 [0,4194304] 0 2023-12-05T09:57:22.125 INFO:tasks.workunit.client.0.smithi100.stdout:1/210: creat db/d12/d1e/f41 x:0 0 0 2023-12-05T09:57:22.127 INFO:tasks.workunit.client.1.smithi150.stdout:1/178: rmdir d6 39 2023-12-05T09:57:22.128 INFO:tasks.workunit.client.1.smithi150.stdout:5/143: read d1/d3/d6/f1c [513332,117512] 0 2023-12-05T09:57:22.130 INFO:tasks.workunit.client.0.smithi100.stdout:3/249: link d0/d10/d39/f41 d0/d2/f4f 0 2023-12-05T09:57:22.130 INFO:tasks.workunit.client.0.smithi100.stdout:3/250: write d0/f36 [166922,56269] 0 2023-12-05T09:57:22.132 INFO:tasks.workunit.client.0.smithi100.stdout:0/203: read da/f11 [2381608,16704] 0 2023-12-05T09:57:22.132 INFO:tasks.workunit.client.0.smithi100.stdout:0/204: stat da/d1b/f26 0 2023-12-05T09:57:22.136 INFO:tasks.workunit.client.1.smithi150.stdout:6/124: rename d2/da/f2b to d2/f2c 0 2023-12-05T09:57:22.136 INFO:tasks.workunit.client.1.smithi150.stdout:0/147: rename d5/d11/d16 to d5/d11/d16/d27/d33 22 2023-12-05T09:57:22.137 INFO:tasks.workunit.client.1.smithi150.stdout:0/148: chown d5/d11 42787468 1 2023-12-05T09:57:22.138 INFO:tasks.workunit.client.1.smithi150.stdout:7/133: creat d2/d4/f27 x:0 0 0 2023-12-05T09:57:22.143 INFO:tasks.workunit.client.0.smithi100.stdout:2/281: unlink d7/da/dc/f4f 0 2023-12-05T09:57:22.143 INFO:tasks.workunit.client.0.smithi100.stdout:9/249: dwrite d7/d1b/f1e [0,4194304] 0 2023-12-05T09:57:22.143 INFO:tasks.workunit.client.0.smithi100.stdout:9/250: fsync d7/d1b/d22/d51/f28 0 2023-12-05T09:57:22.143 INFO:tasks.workunit.client.0.smithi100.stdout:1/211: dread db/d12/f16 [0,4194304] 0 2023-12-05T09:57:22.143 INFO:tasks.workunit.client.0.smithi100.stdout:1/212: chown db/d12/d1e/d26/c37 42160 1 2023-12-05T09:57:22.143 INFO:tasks.workunit.client.0.smithi100.stdout:1/213: fdatasync db/d31/d3a/f3e 0 2023-12-05T09:57:22.143 INFO:tasks.workunit.client.0.smithi100.stdout:1/214: dread - db/d12/d1e/f41 zero size 2023-12-05T09:57:22.144 INFO:tasks.workunit.client.1.smithi150.stdout:1/179: creat d6/d38/f41 x:0 0 0 2023-12-05T09:57:22.144 INFO:tasks.workunit.client.1.smithi150.stdout:1/180: dread - d6/d8/db/d1b/f37 zero size 2023-12-05T09:57:22.144 INFO:tasks.workunit.client.1.smithi150.stdout:5/144: write d1/d3/d6/f10 [1047146,69760] 0 2023-12-05T09:57:22.149 INFO:tasks.workunit.client.0.smithi100.stdout:5/212: link d0/d4/d14/f38 d0/d1f/f4c 0 2023-12-05T09:57:22.151 INFO:tasks.workunit.client.1.smithi150.stdout:6/125: mknod d2/d23/c2d 0 2023-12-05T09:57:22.151 INFO:tasks.workunit.client.1.smithi150.stdout:6/126: readlink d2/l21 0 2023-12-05T09:57:22.153 INFO:tasks.workunit.client.1.smithi150.stdout:2/147: rename d0/d3/d5/lf to d0/d3/d5/d10/l33 0 2023-12-05T09:57:22.153 INFO:tasks.workunit.client.1.smithi150.stdout:3/147: rename d6 to d6/d22/d2f 22 2023-12-05T09:57:22.153 INFO:tasks.workunit.client.1.smithi150.stdout:8/139: rename d0/d8 to d0/d8/d14/d1b/d29 22 2023-12-05T09:57:22.153 INFO:tasks.workunit.client.1.smithi150.stdout:8/140: truncate d0/d8/f11 1043351 0 2023-12-05T09:57:22.155 INFO:tasks.workunit.client.1.smithi150.stdout:0/149: symlink d5/d11/d16/d27/l34 0 2023-12-05T09:57:22.158 INFO:tasks.workunit.client.0.smithi100.stdout:7/133: chown d3/dc/d11/d13/d1b 2 1 2023-12-05T09:57:22.160 INFO:tasks.workunit.client.1.smithi150.stdout:7/134: creat d2/d4/d8/f28 x:0 0 0 2023-12-05T09:57:22.160 INFO:tasks.workunit.client.1.smithi150.stdout:7/135: chown d2/d4/d8/d18/d1a/d1e/f24 1470 1 2023-12-05T09:57:22.160 INFO:tasks.workunit.client.1.smithi150.stdout:7/136: chown d2/d4/d8/f9 482 1 2023-12-05T09:57:22.164 INFO:tasks.workunit.client.1.smithi150.stdout:3/148: mkdir d6/d19/d30 0 2023-12-05T09:57:22.166 INFO:tasks.workunit.client.0.smithi100.stdout:2/282: dread d7/da/dc/f12 [0,4194304] 0 2023-12-05T09:57:22.168 INFO:tasks.workunit.client.1.smithi150.stdout:2/148: mknod d0/d3/d5/d22/c34 0 2023-12-05T09:57:22.168 INFO:tasks.workunit.client.1.smithi150.stdout:2/149: dread - d0/d3/d11/d1d/f2f zero size 2023-12-05T09:57:22.168 INFO:tasks.workunit.client.1.smithi150.stdout:2/150: stat d0/d3/d5/d13 0 2023-12-05T09:57:22.168 INFO:tasks.workunit.client.1.smithi150.stdout:2/151: fsync d0/d3/d5/d10/f20 0 2023-12-05T09:57:22.168 INFO:tasks.workunit.client.1.smithi150.stdout:2/152: stat d0/d3/d5/d13 0 2023-12-05T09:57:22.170 INFO:tasks.workunit.client.0.smithi100.stdout:3/251: creat d0/d4/d3a/d45/f50 x:0 0 0 2023-12-05T09:57:22.170 INFO:tasks.workunit.client.0.smithi100.stdout:3/252: dread - d0/d4/d3a/d45/f50 zero size 2023-12-05T09:57:22.171 INFO:tasks.workunit.client.0.smithi100.stdout:3/253: creat d0/d10/d39/f51 x:0 0 0 2023-12-05T09:57:22.171 INFO:tasks.workunit.client.1.smithi150.stdout:8/141: stat d0/f16 0 2023-12-05T09:57:22.173 INFO:tasks.workunit.client.1.smithi150.stdout:4/96: sync 2023-12-05T09:57:22.181 INFO:tasks.workunit.client.0.smithi100.stdout:9/251: truncate d7/d1b/d22/d2a/f40 1240346 0 2023-12-05T09:57:22.181 INFO:tasks.workunit.client.0.smithi100.stdout:1/215: getdents db/d12 0 2023-12-05T09:57:22.181 INFO:tasks.workunit.client.0.smithi100.stdout:1/216: stat la 0 2023-12-05T09:57:22.189 INFO:tasks.workunit.client.1.smithi150.stdout:4/97: rename d0/l13 to d0/l19 0 2023-12-05T09:57:22.190 INFO:tasks.workunit.client.0.smithi100.stdout:0/205: dwrite da/f2d [0,4194304] 0 2023-12-05T09:57:22.195 INFO:tasks.workunit.client.1.smithi150.stdout:4/98: symlink d0/l1a 0 2023-12-05T09:57:22.198 INFO:tasks.workunit.client.0.smithi100.stdout:7/134: mknod d3/dc/d11/d13/de/d18/c2f 0 2023-12-05T09:57:22.198 INFO:tasks.workunit.client.0.smithi100.stdout:7/135: write d3/dc/d11/d13/de/f22 [384736,104235] 0 2023-12-05T09:57:22.203 INFO:tasks.workunit.client.0.smithi100.stdout:6/507: dread d7/d27/f2e [0,4194304] 0 2023-12-05T09:57:22.203 INFO:tasks.workunit.client.0.smithi100.stdout:6/508: chown d7/d2d/c92 13507 1 2023-12-05T09:57:22.203 INFO:tasks.workunit.client.0.smithi100.stdout:1/217: write db/d12/f1d [2828352,66578] 0 2023-12-05T09:57:22.203 INFO:tasks.workunit.client.0.smithi100.stdout:1/218: creat db/d31/d3a/f42 x:0 0 0 2023-12-05T09:57:22.204 INFO:tasks.workunit.client.1.smithi150.stdout:7/137: write d2/d4/f23 [4472646,86940] 0 2023-12-05T09:57:22.211 INFO:tasks.workunit.client.1.smithi150.stdout:5/145: dwrite d1/d3/d6/f1c [4194304,4194304] 0 2023-12-05T09:57:22.211 INFO:tasks.workunit.client.1.smithi150.stdout:5/146: readlink d1/d15/l20 0 2023-12-05T09:57:22.212 INFO:tasks.workunit.client.0.smithi100.stdout:9/252: dread d7/d1b/d22/d51/f28 [0,4194304] 0 2023-12-05T09:57:22.213 INFO:tasks.workunit.client.0.smithi100.stdout:0/206: dread da/d1b/f26 [0,4194304] 0 2023-12-05T09:57:22.213 INFO:tasks.workunit.client.0.smithi100.stdout:0/207: write da/d1b/f26 [1153567,11291] 0 2023-12-05T09:57:22.214 INFO:tasks.workunit.client.1.smithi150.stdout:6/127: dwrite d2/d23/f29 [0,4194304] 0 2023-12-05T09:57:22.214 INFO:tasks.workunit.client.1.smithi150.stdout:6/128: chown d2/da/c1d 17958 1 2023-12-05T09:57:22.214 INFO:tasks.workunit.client.1.smithi150.stdout:7/138: mkdir d2/d29 0 2023-12-05T09:57:22.215 INFO:tasks.workunit.client.0.smithi100.stdout:3/254: dread d0/d4/f17 [0,4194304] 0 2023-12-05T09:57:22.215 INFO:tasks.workunit.client.0.smithi100.stdout:3/255: stat d0/d2/de/d11/l2b 0 2023-12-05T09:57:22.215 INFO:tasks.workunit.client.0.smithi100.stdout:3/256: fdatasync d0/d2/de/d11/f21 0 2023-12-05T09:57:22.216 INFO:tasks.workunit.client.1.smithi150.stdout:9/127: sync 2023-12-05T09:57:22.221 INFO:tasks.workunit.client.1.smithi150.stdout:5/147: read d1/d15/f16 [1163641,20619] 0 2023-12-05T09:57:22.236 INFO:tasks.workunit.client.0.smithi100.stdout:1/219: creat db/d12/d1e/d26/f43 x:0 0 0 2023-12-05T09:57:22.252 INFO:tasks.workunit.client.1.smithi150.stdout:6/129: mkdir d2/d23/d2e 0 2023-12-05T09:57:22.255 INFO:tasks.workunit.client.1.smithi150.stdout:7/139: mknod d2/db/c2a 0 2023-12-05T09:57:22.256 INFO:tasks.workunit.client.1.smithi150.stdout:0/150: getdents d5/d11/d16/d27 0 2023-12-05T09:57:22.256 INFO:tasks.workunit.client.1.smithi150.stdout:0/151: chown d5/d1b/l29 13671 1 2023-12-05T09:57:22.256 INFO:tasks.workunit.client.1.smithi150.stdout:0/152: write d5/d11/d16/f17 [1551153,81809] 0 2023-12-05T09:57:22.259 INFO:tasks.workunit.client.1.smithi150.stdout:8/142: dwrite d0/d8/d14/d1b/f28 [4194304,4194304] 0 2023-12-05T09:57:22.263 INFO:tasks.workunit.client.1.smithi150.stdout:9/128: mkdir d3/d9/dc/d1f/d24 0 2023-12-05T09:57:22.265 INFO:tasks.workunit.client.0.smithi100.stdout:2/283: dwrite d7/da/dc/f12 [0,4194304] 0 2023-12-05T09:57:22.266 INFO:tasks.workunit.client.0.smithi100.stdout:2/284: write d7/da/d18/d1b/d2c/d3f/f5e [274332,93456] 0 2023-12-05T09:57:22.267 INFO:tasks.workunit.client.0.smithi100.stdout:9/253: dread d7/d1b/d22/f38 [0,4194304] 0 2023-12-05T09:57:22.268 INFO:tasks.workunit.client.1.smithi150.stdout:5/148: creat d1/d3/d6/d1b/d22/f32 x:0 0 0 2023-12-05T09:57:22.270 INFO:tasks.workunit.client.1.smithi150.stdout:6/130: rmdir d2/da 39 2023-12-05T09:57:22.270 INFO:tasks.workunit.client.1.smithi150.stdout:6/131: read - d2/f26 zero size 2023-12-05T09:57:22.272 INFO:tasks.workunit.client.0.smithi100.stdout:3/257: rmdir d0/d2 39 2023-12-05T09:57:22.280 INFO:tasks.workunit.client.1.smithi150.stdout:4/99: link d0/l19 d0/d11/l1b 0 2023-12-05T09:57:22.281 INFO:tasks.workunit.client.0.smithi100.stdout:1/220: dread db/d12/f1d [0,4194304] 0 2023-12-05T09:57:22.281 INFO:tasks.workunit.client.0.smithi100.stdout:1/221: chown db/d31/d3a/f3e 485006214 1 2023-12-05T09:57:22.283 INFO:tasks.workunit.client.0.smithi100.stdout:2/285: mkdir d7/da/d18/d21/d4d/d5f 0 2023-12-05T09:57:22.286 INFO:tasks.workunit.client.1.smithi150.stdout:5/149: dread d1/d3/d6/f10 [0,4194304] 0 2023-12-05T09:57:22.287 INFO:tasks.workunit.client.0.smithi100.stdout:6/509: dwrite d7/d27/d72/f87 [0,4194304] 0 2023-12-05T09:57:22.291 INFO:tasks.workunit.client.0.smithi100.stdout:1/222: rmdir db/d31 39 2023-12-05T09:57:22.296 INFO:tasks.workunit.client.0.smithi100.stdout:2/286: mknod d7/da/d18/d1b/c60 0 2023-12-05T09:57:22.296 INFO:tasks.workunit.client.0.smithi100.stdout:2/287: write d7/da/f25 [2560113,64091] 0 2023-12-05T09:57:22.300 INFO:tasks.workunit.client.0.smithi100.stdout:6/510: mknod d7/d27/d97/ca9 0 2023-12-05T09:57:22.300 INFO:tasks.workunit.client.0.smithi100.stdout:6/511: write d7/d2d/d6a/d7c/f88 [868475,43018] 0 2023-12-05T09:57:22.303 INFO:tasks.workunit.client.0.smithi100.stdout:1/223: mknod db/d31/c44 0 2023-12-05T09:57:22.304 INFO:tasks.workunit.client.0.smithi100.stdout:7/136: dwrite d3/dc/d11/d13/de/f19 [0,4194304] 0 2023-12-05T09:57:22.305 INFO:tasks.workunit.client.1.smithi150.stdout:4/100: mknod d0/d11/c1c 0 2023-12-05T09:57:22.306 INFO:tasks.workunit.client.0.smithi100.stdout:2/288: rename d7/da/d18/d21/d4d/d5f to d7/d61 0 2023-12-05T09:57:22.308 INFO:tasks.workunit.client.0.smithi100.stdout:0/208: dwrite da/d2a/f3f [0,4194304] 0 2023-12-05T09:57:22.308 INFO:tasks.workunit.client.0.smithi100.stdout:0/209: write da/fd [2138084,6908] 0 2023-12-05T09:57:22.310 INFO:tasks.workunit.client.0.smithi100.stdout:6/512: creat d7/faa x:0 0 0 2023-12-05T09:57:22.310 INFO:tasks.workunit.client.0.smithi100.stdout:6/513: stat d7/d11/d7e/fa1 0 2023-12-05T09:57:22.311 INFO:tasks.workunit.client.1.smithi150.stdout:8/143: symlink d0/l2a 0 2023-12-05T09:57:22.311 INFO:tasks.workunit.client.1.smithi150.stdout:4/101: rename d0/l1a to d0/d11/l1d 0 2023-12-05T09:57:22.312 INFO:tasks.workunit.client.1.smithi150.stdout:4/102: truncate d0/d11/f15 207062 0 2023-12-05T09:57:22.313 INFO:tasks.workunit.client.0.smithi100.stdout:2/289: creat d7/da/d18/f62 x:0 0 0 2023-12-05T09:57:22.314 INFO:tasks.workunit.client.1.smithi150.stdout:4/103: unlink d0/c14 0 2023-12-05T09:57:22.317 INFO:tasks.workunit.client.0.smithi100.stdout:0/210: rename da/fb to da/d1b/d36/f40 0 2023-12-05T09:57:22.317 INFO:tasks.workunit.client.1.smithi150.stdout:6/132: read d2/d23/f29 [502195,95326] 0 2023-12-05T09:57:22.319 INFO:tasks.workunit.client.0.smithi100.stdout:2/290: mknod d7/da/d2b/c63 0 2023-12-05T09:57:22.319 INFO:tasks.workunit.client.0.smithi100.stdout:2/291: chown d7/da/d18/d1b/f28 6 1 2023-12-05T09:57:22.322 INFO:tasks.workunit.client.0.smithi100.stdout:2/292: symlink d7/da/d18/d1b/d2c/d3f/l64 0 2023-12-05T09:57:22.324 INFO:tasks.workunit.client.0.smithi100.stdout:2/293: mkdir d7/da/d65 0 2023-12-05T09:57:22.325 INFO:tasks.workunit.client.1.smithi150.stdout:4/104: dread d0/fc [0,4194304] 0 2023-12-05T09:57:22.336 INFO:tasks.workunit.client.0.smithi100.stdout:7/137: dread d3/dc/d11/d13/fb [0,4194304] 0 2023-12-05T09:57:22.337 INFO:tasks.workunit.client.1.smithi150.stdout:2/153: sync 2023-12-05T09:57:22.337 INFO:tasks.workunit.client.1.smithi150.stdout:3/149: sync 2023-12-05T09:57:22.337 INFO:tasks.workunit.client.1.smithi150.stdout:1/181: sync 2023-12-05T09:57:22.337 INFO:tasks.workunit.client.1.smithi150.stdout:1/182: write d6/d8/db/f30 [4569425,39222] 0 2023-12-05T09:57:22.339 INFO:tasks.workunit.client.1.smithi150.stdout:9/129: dwrite d3/d9/dc/f19 [0,4194304] 0 2023-12-05T09:57:22.350 INFO:tasks.workunit.client.1.smithi150.stdout:2/154: rename d0/d3/d5/f1e to d0/d3/d5/d22/f35 0 2023-12-05T09:57:22.350 INFO:tasks.workunit.client.1.smithi150.stdout:3/150: creat d6/d22/f31 x:0 0 0 2023-12-05T09:57:22.350 INFO:tasks.workunit.client.1.smithi150.stdout:3/151: readlink d6/d9/la 0 2023-12-05T09:57:22.351 INFO:tasks.workunit.client.1.smithi150.stdout:0/153: dwrite d5/f23 [0,4194304] 0 2023-12-05T09:57:22.351 INFO:tasks.workunit.client.0.smithi100.stdout:7/138: creat d3/dc/d11/d13/f30 x:0 0 0 2023-12-05T09:57:22.351 INFO:tasks.workunit.client.0.smithi100.stdout:7/139: creat d3/dc/d11/f31 x:0 0 0 2023-12-05T09:57:22.351 INFO:tasks.workunit.client.0.smithi100.stdout:2/294: truncate d7/da/f25 496182 0 2023-12-05T09:57:22.351 INFO:tasks.workunit.client.0.smithi100.stdout:2/295: creat d7/f66 x:0 0 0 2023-12-05T09:57:22.354 INFO:tasks.workunit.client.1.smithi150.stdout:3/152: truncate d6/f17 3274068 0 2023-12-05T09:57:22.354 INFO:tasks.workunit.client.1.smithi150.stdout:1/183: rename d6/d8/db/d1b/l23 to d6/d3c/l42 0 2023-12-05T09:57:22.354 INFO:tasks.workunit.client.1.smithi150.stdout:3/153: truncate d6/d9/f1b 602226 0 2023-12-05T09:57:22.357 INFO:tasks.workunit.client.1.smithi150.stdout:5/150: dwrite d1/d3/d6/d26/f30 [0,4194304] 0 2023-12-05T09:57:22.357 INFO:tasks.workunit.client.1.smithi150.stdout:5/151: readlink d1/d3/l17 0 2023-12-05T09:57:22.358 INFO:tasks.workunit.client.1.smithi150.stdout:6/133: dread d2/da/fe [0,4194304] 0 2023-12-05T09:57:22.358 INFO:tasks.workunit.client.1.smithi150.stdout:0/154: symlink d5/d11/l35 0 2023-12-05T09:57:22.358 INFO:tasks.workunit.client.1.smithi150.stdout:0/155: write d5/d11/f26 [630040,104230] 0 2023-12-05T09:57:22.358 INFO:tasks.workunit.client.0.smithi100.stdout:9/254: dwrite d7/d1b/f30 [0,4194304] 0 2023-12-05T09:57:22.358 INFO:tasks.workunit.client.0.smithi100.stdout:9/255: write d7/fb [4946385,82391] 0 2023-12-05T09:57:22.360 INFO:tasks.workunit.client.1.smithi150.stdout:5/152: symlink d1/d3/d6/d1b/d22/d24/l33 0 2023-12-05T09:57:22.360 INFO:tasks.workunit.client.0.smithi100.stdout:2/296: dread d7/da/d18/d21/f44 [0,4194304] 0 2023-12-05T09:57:22.361 INFO:tasks.workunit.client.0.smithi100.stdout:9/256: rename d7/d20/l21 to d7/d1b/d22/d2a/l54 0 2023-12-05T09:57:22.363 INFO:tasks.workunit.client.0.smithi100.stdout:2/297: creat d7/da/d18/d1b/d2c/d3f/f67 x:0 0 0 2023-12-05T09:57:22.365 INFO:tasks.workunit.client.1.smithi150.stdout:0/156: link d5/c1a d5/d11/d16/c36 0 2023-12-05T09:57:22.368 INFO:tasks.workunit.client.1.smithi150.stdout:5/153: unlink d1/d15/f29 0 2023-12-05T09:57:22.368 INFO:tasks.workunit.client.0.smithi100.stdout:2/298: unlink d7/da/d18/d21/d4d/l55 0 2023-12-05T09:57:22.369 INFO:tasks.workunit.client.1.smithi150.stdout:6/134: mknod d2/da/c2f 0 2023-12-05T09:57:22.369 INFO:tasks.workunit.client.1.smithi150.stdout:6/135: stat d2/d23/c2d 0 2023-12-05T09:57:22.376 INFO:tasks.workunit.client.0.smithi100.stdout:2/299: mknod d7/da/d13/d4e/c68 0 2023-12-05T09:57:22.377 INFO:tasks.workunit.client.0.smithi100.stdout:2/300: write d7/f34 [811637,37814] 0 2023-12-05T09:57:22.380 INFO:tasks.workunit.client.1.smithi150.stdout:5/154: mknod d1/d15/c34 0 2023-12-05T09:57:22.384 INFO:tasks.workunit.client.1.smithi150.stdout:6/136: symlink d2/l30 0 2023-12-05T09:57:22.384 INFO:tasks.workunit.client.1.smithi150.stdout:6/137: fsync d2/f2c 0 2023-12-05T09:57:22.387 INFO:tasks.workunit.client.1.smithi150.stdout:6/138: creat d2/da/f31 x:0 0 0 2023-12-05T09:57:22.388 INFO:tasks.workunit.client.1.smithi150.stdout:6/139: readlink d2/l30 0 2023-12-05T09:57:22.388 INFO:tasks.workunit.client.0.smithi100.stdout:0/211: dwrite da/d2a/f3f [0,4194304] 0 2023-12-05T09:57:22.389 INFO:tasks.workunit.client.0.smithi100.stdout:6/514: dwrite d7/d11/f8f [0,4194304] 0 2023-12-05T09:57:22.389 INFO:tasks.workunit.client.0.smithi100.stdout:6/515: read f5 [816043,118959] 0 2023-12-05T09:57:22.390 INFO:tasks.workunit.client.1.smithi150.stdout:5/155: creat d1/d3/d1e/d21/f35 x:0 0 0 2023-12-05T09:57:22.392 INFO:tasks.workunit.client.0.smithi100.stdout:7/140: dread d3/dc/d11/d13/f15 [0,4194304] 0 2023-12-05T09:57:22.393 INFO:tasks.workunit.client.0.smithi100.stdout:7/141: fdatasync d3/dc/d11/f1e 0 2023-12-05T09:57:22.395 INFO:tasks.workunit.client.1.smithi150.stdout:2/155: read d0/d3/d11/f23 [1666927,81985] 0 2023-12-05T09:57:22.395 INFO:tasks.workunit.client.1.smithi150.stdout:1/184: write d6/d8/db/de/f39 [3749272,48753] 0 2023-12-05T09:57:22.395 INFO:tasks.workunit.client.1.smithi150.stdout:1/185: write d6/d8/db/f2b [710643,53863] 0 2023-12-05T09:57:22.395 INFO:tasks.workunit.client.1.smithi150.stdout:5/156: rename d1/l13 to d1/d3/d6/d1b/l36 0 2023-12-05T09:57:22.395 INFO:tasks.workunit.client.1.smithi150.stdout:9/130: dwrite d3/d9/dc/f19 [0,4194304] 0 2023-12-05T09:57:22.398 INFO:tasks.workunit.client.0.smithi100.stdout:6/516: getdents d7/d2d/d6a 0 2023-12-05T09:57:22.399 INFO:tasks.workunit.client.0.smithi100.stdout:0/212: rename l6 to da/l41 0 2023-12-05T09:57:22.401 INFO:tasks.workunit.client.1.smithi150.stdout:2/156: mkdir d0/d3/d5/d36 0 2023-12-05T09:57:22.401 INFO:tasks.workunit.client.1.smithi150.stdout:2/157: chown d0/d3/d5/d13/d15/c2b 0 1 2023-12-05T09:57:22.402 INFO:tasks.workunit.client.0.smithi100.stdout:7/142: unlink d3/dc/d11/d13/de/f19 0 2023-12-05T09:57:22.402 INFO:tasks.workunit.client.0.smithi100.stdout:7/143: fsync d3/dc/d11/f25 0 2023-12-05T09:57:22.403 INFO:tasks.workunit.client.1.smithi150.stdout:9/131: creat d3/d9/dc/d1f/f25 x:0 0 0 2023-12-05T09:57:22.404 INFO:tasks.workunit.client.1.smithi150.stdout:9/132: chown d3/d9/dc/d1f/c22 17 1 2023-12-05T09:57:22.406 INFO:tasks.workunit.client.1.smithi150.stdout:4/105: dwrite d0/fd [0,4194304] 0 2023-12-05T09:57:22.407 INFO:tasks.workunit.client.0.smithi100.stdout:6/517: creat d7/d27/d35/fab x:0 0 0 2023-12-05T09:57:22.407 INFO:tasks.workunit.client.0.smithi100.stdout:6/518: fsync d7/d11/d82/f28 0 2023-12-05T09:57:22.410 INFO:tasks.workunit.client.0.smithi100.stdout:0/213: rename da/cc to da/d22/d33/d35/d3a/c42 0 2023-12-05T09:57:22.411 INFO:tasks.workunit.client.1.smithi150.stdout:3/154: dwrite d6/d25/d28/f2d [0,4194304] 0 2023-12-05T09:57:22.411 INFO:tasks.workunit.client.1.smithi150.stdout:3/155: fsync d6/d9/f1b 0 2023-12-05T09:57:22.411 INFO:tasks.workunit.client.1.smithi150.stdout:3/156: creat d6/d9/f32 x:0 0 0 2023-12-05T09:57:22.414 INFO:tasks.workunit.client.1.smithi150.stdout:5/157: write d1/d3/d6/d26/f28 [4138578,97499] 0 2023-12-05T09:57:22.418 INFO:tasks.workunit.client.1.smithi150.stdout:4/106: rename d0/cb to d0/c1e 0 2023-12-05T09:57:22.418 INFO:tasks.workunit.client.0.smithi100.stdout:2/301: getdents d7/da/d18/d1b/d2c/d3f 0 2023-12-05T09:57:22.418 INFO:tasks.workunit.client.0.smithi100.stdout:2/302: readlink d7/da/d18/d1b/l24 0 2023-12-05T09:57:22.422 INFO:tasks.workunit.client.0.smithi100.stdout:0/214: read da/d22/f3b [27815,18865] 0 2023-12-05T09:57:22.424 INFO:tasks.workunit.client.0.smithi100.stdout:6/519: rename d7/d11/l19 to d7/d27/d97/lac 0 2023-12-05T09:57:22.429 INFO:tasks.workunit.client.1.smithi150.stdout:9/133: dread d3/d9/dc/f19 [0,4194304] 0 2023-12-05T09:57:22.429 INFO:tasks.workunit.client.1.smithi150.stdout:9/134: readlink d3/d9/dc/l16 0 2023-12-05T09:57:22.429 INFO:tasks.workunit.client.0.smithi100.stdout:0/215: mknod da/d22/d33/c43 0 2023-12-05T09:57:22.430 INFO:tasks.workunit.client.0.smithi100.stdout:0/216: fsync da/f2c 0 2023-12-05T09:57:22.431 INFO:tasks.workunit.client.1.smithi150.stdout:3/157: link d6/d22/c26 d6/d19/c33 0 2023-12-05T09:57:22.431 INFO:tasks.workunit.client.1.smithi150.stdout:3/158: truncate d6/d9/f32 287699 0 2023-12-05T09:57:22.431 INFO:tasks.workunit.client.1.smithi150.stdout:7/140: sync 2023-12-05T09:57:22.432 INFO:tasks.workunit.client.0.smithi100.stdout:6/520: truncate d7/f23 1326208 0 2023-12-05T09:57:22.432 INFO:tasks.workunit.client.0.smithi100.stdout:6/521: chown d7/d11/c47 1 1 2023-12-05T09:57:22.435 INFO:tasks.workunit.client.0.smithi100.stdout:2/303: mkdir d7/da/d13/d69 0 2023-12-05T09:57:22.436 INFO:tasks.workunit.client.0.smithi100.stdout:2/304: getdents d7/da/d18/d1b/d2c/d3f 0 2023-12-05T09:57:22.437 INFO:tasks.workunit.client.1.smithi150.stdout:4/107: mknod d0/c1f 0 2023-12-05T09:57:22.437 INFO:tasks.workunit.client.1.smithi150.stdout:4/108: write d0/d11/f12 [658436,48601] 0 2023-12-05T09:57:22.438 INFO:tasks.workunit.client.1.smithi150.stdout:6/140: rmdir d2/da 39 2023-12-05T09:57:22.438 INFO:tasks.workunit.client.0.smithi100.stdout:8/135: sync 2023-12-05T09:57:22.439 INFO:tasks.workunit.client.0.smithi100.stdout:4/153: sync 2023-12-05T09:57:22.443 INFO:tasks.workunit.client.1.smithi150.stdout:5/158: read d1/d3/d6/f1c [7350562,94030] 0 2023-12-05T09:57:22.443 INFO:tasks.workunit.client.1.smithi150.stdout:5/159: write d1/d3/d6/f8 [377052,98104] 0 2023-12-05T09:57:22.443 INFO:tasks.workunit.client.1.smithi150.stdout:5/160: dread - d1/d3/d1e/d21/f35 zero size 2023-12-05T09:57:22.443 INFO:tasks.workunit.client.1.smithi150.stdout:2/158: dwrite d0/f16 [0,4194304] 0 2023-12-05T09:57:22.443 INFO:tasks.workunit.client.1.smithi150.stdout:2/159: readlink d0/d3/d5/d22/l25 0 2023-12-05T09:57:22.444 INFO:tasks.workunit.client.0.smithi100.stdout:4/154: chown de/d16/f20 119942883 1 2023-12-05T09:57:22.444 INFO:tasks.workunit.client.0.smithi100.stdout:8/136: write d0/fd [1030719,122967] 0 2023-12-05T09:57:22.444 INFO:tasks.workunit.client.0.smithi100.stdout:4/155: truncate de/f1b 93001 0 2023-12-05T09:57:22.444 INFO:tasks.workunit.client.0.smithi100.stdout:4/156: fsync de/d16/d23/f26 0 2023-12-05T09:57:22.444 INFO:tasks.workunit.client.0.smithi100.stdout:4/157: stat de/d16/d1e 0 2023-12-05T09:57:22.444 INFO:tasks.workunit.client.0.smithi100.stdout:6/522: creat d7/d2d/d6a/fad x:0 0 0 2023-12-05T09:57:22.444 INFO:tasks.workunit.client.0.smithi100.stdout:6/523: stat f5 0 2023-12-05T09:57:22.444 INFO:tasks.workunit.client.0.smithi100.stdout:6/524: fdatasync d7/d2d/f9c 0 2023-12-05T09:57:22.446 INFO:tasks.workunit.client.0.smithi100.stdout:2/305: mkdir d7/da/d18/d1b/d2c/d3f/d46/d6a 0 2023-12-05T09:57:22.453 INFO:tasks.workunit.client.1.smithi150.stdout:7/141: mkdir d2/d4/d8/d18/d1a/d1e/d2b 0 2023-12-05T09:57:22.453 INFO:tasks.workunit.client.0.smithi100.stdout:0/217: dread da/d2a/f3f [0,4194304] 0 2023-12-05T09:57:22.453 INFO:tasks.workunit.client.0.smithi100.stdout:7/144: dwrite d3/f2e [0,4194304] 0 2023-12-05T09:57:22.457 INFO:tasks.workunit.client.0.smithi100.stdout:8/137: symlink d0/d12/d13/l1e 0 2023-12-05T09:57:22.457 INFO:tasks.workunit.client.0.smithi100.stdout:8/138: fdatasync d0/f1d 0 2023-12-05T09:57:22.459 INFO:tasks.workunit.client.1.smithi150.stdout:2/160: write d0/f7 [1136664,91990] 0 2023-12-05T09:57:22.459 INFO:tasks.workunit.client.1.smithi150.stdout:2/161: write d0/f16 [4444584,19124] 0 2023-12-05T09:57:22.460 INFO:tasks.workunit.client.0.smithi100.stdout:4/158: truncate f1 209093 0 2023-12-05T09:57:22.460 INFO:tasks.workunit.client.0.smithi100.stdout:4/159: dread - de/d1d/f21 zero size 2023-12-05T09:57:22.464 INFO:tasks.workunit.client.0.smithi100.stdout:2/306: creat d7/d61/f6b x:0 0 0 2023-12-05T09:57:22.465 INFO:tasks.workunit.client.1.smithi150.stdout:8/144: sync 2023-12-05T09:57:22.465 INFO:tasks.workunit.client.1.smithi150.stdout:8/145: read - d0/d8/f23 zero size 2023-12-05T09:57:22.467 INFO:tasks.workunit.client.0.smithi100.stdout:0/218: link da/d1b/c20 da/d22/d33/d35/c44 0 2023-12-05T09:57:22.468 INFO:tasks.workunit.client.1.smithi150.stdout:4/109: dread d0/fc [0,4194304] 0 2023-12-05T09:57:22.472 INFO:tasks.workunit.client.0.smithi100.stdout:8/139: dread d0/fc [0,4194304] 0 2023-12-05T09:57:22.474 INFO:tasks.workunit.client.1.smithi150.stdout:7/142: rmdir d2/d4/d8/d18 39 2023-12-05T09:57:22.476 INFO:tasks.workunit.client.1.smithi150.stdout:4/110: dread d0/d11/f12 [0,4194304] 0 2023-12-05T09:57:22.476 INFO:tasks.workunit.client.1.smithi150.stdout:4/111: write d0/d11/f15 [1016810,130428] 0 2023-12-05T09:57:22.477 INFO:tasks.workunit.client.0.smithi100.stdout:4/160: link c5 de/c2d 0 2023-12-05T09:57:22.477 INFO:tasks.workunit.client.0.smithi100.stdout:4/161: chown de/d16 1 1 2023-12-05T09:57:22.483 INFO:tasks.workunit.client.1.smithi150.stdout:2/162: mkdir d0/d3/d5/d37 0 2023-12-05T09:57:22.487 INFO:tasks.workunit.client.0.smithi100.stdout:0/219: truncate da/d22/f23 780019 0 2023-12-05T09:57:22.489 INFO:tasks.workunit.client.1.smithi150.stdout:9/135: rename d3/d12 to d3/d9/d26 0 2023-12-05T09:57:22.490 INFO:tasks.workunit.client.1.smithi150.stdout:9/136: truncate d3/d9/d26/f1a 247894 0 2023-12-05T09:57:22.490 INFO:tasks.workunit.client.0.smithi100.stdout:8/140: symlink d0/d12/d13/d16/l1f 0 2023-12-05T09:57:22.490 INFO:tasks.workunit.client.0.smithi100.stdout:8/141: dread - d0/f1d zero size 2023-12-05T09:57:22.491 INFO:tasks.workunit.client.1.smithi150.stdout:7/143: getdents d2/d4/d8/d13 0 2023-12-05T09:57:22.496 INFO:tasks.workunit.client.0.smithi100.stdout:0/220: mkdir da/d2a/d45 0 2023-12-05T09:57:22.497 INFO:tasks.workunit.client.0.smithi100.stdout:0/221: write da/f37 [589309,82389] 0 2023-12-05T09:57:22.500 INFO:tasks.workunit.client.1.smithi150.stdout:2/163: mkdir d0/d3/d11/d1d/d38 0 2023-12-05T09:57:22.500 INFO:tasks.workunit.client.1.smithi150.stdout:2/164: creat d0/d3/d21/f39 x:0 0 0 2023-12-05T09:57:22.502 INFO:tasks.workunit.client.0.smithi100.stdout:0/222: symlink da/d1b/l46 0 2023-12-05T09:57:22.502 INFO:tasks.workunit.client.0.smithi100.stdout:2/307: rmdir d7/d61 39 2023-12-05T09:57:22.502 INFO:tasks.workunit.client.0.smithi100.stdout:2/308: chown d7/da/d65 40 1 2023-12-05T09:57:22.502 INFO:tasks.workunit.client.0.smithi100.stdout:2/309: creat d7/da/d18/d1b/f6c x:0 0 0 2023-12-05T09:57:22.502 INFO:tasks.workunit.client.0.smithi100.stdout:2/310: chown d7/da/d18/d1b/d2c/l37 13712223 1 2023-12-05T09:57:22.503 INFO:tasks.workunit.client.1.smithi150.stdout:5/161: dwrite d1/d3/d1e/d21/f35 [0,4194304] 0 2023-12-05T09:57:22.503 INFO:tasks.workunit.client.0.smithi100.stdout:8/142: dread d0/f19 [0,4194304] 0 2023-12-05T09:57:22.503 INFO:tasks.workunit.client.0.smithi100.stdout:8/143: dread - d0/f1d zero size 2023-12-05T09:57:22.505 INFO:tasks.workunit.client.1.smithi150.stdout:9/137: unlink d3/d9/d26/f1a 0 2023-12-05T09:57:22.506 INFO:tasks.workunit.client.0.smithi100.stdout:6/525: dwrite d7/d27/d35/d5a/f96 [0,4194304] 0 2023-12-05T09:57:22.506 INFO:tasks.workunit.client.0.smithi100.stdout:6/526: write d7/d76/f8c [223115,64896] 0 2023-12-05T09:57:22.507 INFO:tasks.workunit.client.0.smithi100.stdout:0/223: chown c5 119952024 1 2023-12-05T09:57:22.510 INFO:tasks.workunit.client.1.smithi150.stdout:7/144: unlink d2/d4/d8/f28 0 2023-12-05T09:57:22.512 INFO:tasks.workunit.client.1.smithi150.stdout:8/146: write d0/f19 [365424,60015] 0 2023-12-05T09:57:22.512 INFO:tasks.workunit.client.1.smithi150.stdout:8/147: chown d0/fc 0 1 2023-12-05T09:57:22.514 INFO:tasks.workunit.client.1.smithi150.stdout:2/165: write d0/d3/d5/d10/f20 [353652,122151] 0 2023-12-05T09:57:22.514 INFO:tasks.workunit.client.1.smithi150.stdout:2/166: write d0/d3/d21/f2c [944394,19369] 0 2023-12-05T09:57:22.515 INFO:tasks.workunit.client.0.smithi100.stdout:8/144: unlink d0/d12/d13/c1b 0 2023-12-05T09:57:22.518 INFO:tasks.workunit.client.1.smithi150.stdout:3/159: dwrite d6/d9/f1c [0,4194304] 0 2023-12-05T09:57:22.518 INFO:tasks.workunit.client.1.smithi150.stdout:3/160: chown d6/d25/d28/f2e 258767225 1 2023-12-05T09:57:22.522 INFO:tasks.workunit.client.1.smithi150.stdout:0/157: sync 2023-12-05T09:57:22.530 INFO:tasks.workunit.client.0.smithi100.stdout:0/224: rename da/d1b/d36/f40 to da/d22/d33/d35/d3a/f47 0 2023-12-05T09:57:22.530 INFO:tasks.workunit.client.1.smithi150.stdout:8/148: creat d0/d8/d14/d1b/f2b x:0 0 0 2023-12-05T09:57:22.532 INFO:tasks.workunit.client.1.smithi150.stdout:2/167: mknod d0/d3/d5/d13/d15/d30/c3a 0 2023-12-05T09:57:22.537 INFO:tasks.workunit.client.1.smithi150.stdout:3/161: rename d6/d19/c33 to d6/d25/d28/c34 0 2023-12-05T09:57:22.542 INFO:tasks.workunit.client.1.smithi150.stdout:2/168: mkdir d0/d3/d5/d3b 0 2023-12-05T09:57:22.543 INFO:tasks.workunit.client.1.smithi150.stdout:2/169: write d0/d3/d11/d1d/f2f [1028383,47519] 0 2023-12-05T09:57:22.543 INFO:tasks.workunit.client.1.smithi150.stdout:2/170: chown d0/d3/d11/d1d/d38 883662 1 2023-12-05T09:57:22.543 INFO:tasks.workunit.client.1.smithi150.stdout:2/171: write d0/d3/d5/d22/f35 [5242155,120923] 0 2023-12-05T09:57:22.544 INFO:tasks.workunit.client.1.smithi150.stdout:8/149: rename d0/fc to d0/d8/f2c 0 2023-12-05T09:57:22.548 INFO:tasks.workunit.client.1.smithi150.stdout:8/150: symlink d0/d8/d14/d1b/d24/l2d 0 2023-12-05T09:57:22.550 INFO:tasks.workunit.client.1.smithi150.stdout:8/151: mkdir d0/d8/d14/d1b/d24/d2e 0 2023-12-05T09:57:22.554 INFO:tasks.workunit.client.1.smithi150.stdout:3/162: read d6/d9/f1d [580297,46104] 0 2023-12-05T09:57:22.571 INFO:tasks.workunit.client.1.smithi150.stdout:4/112: dwrite d0/d11/f18 [0,4194304] 0 2023-12-05T09:57:22.571 INFO:tasks.workunit.client.1.smithi150.stdout:4/113: creat d0/f20 x:0 0 0 2023-12-05T09:57:22.571 INFO:tasks.workunit.client.1.smithi150.stdout:4/114: write d0/f17 [491027,129196] 0 2023-12-05T09:57:22.575 INFO:tasks.workunit.client.0.smithi100.stdout:8/145: write d0/f3 [2683587,95834] 0 2023-12-05T09:57:22.576 INFO:tasks.workunit.client.1.smithi150.stdout:2/172: dread d0/d3/d11/d1d/f2f [0,4194304] 0 2023-12-05T09:57:22.577 INFO:tasks.workunit.client.1.smithi150.stdout:4/115: truncate d0/f8 7777043 0 2023-12-05T09:57:22.577 INFO:tasks.workunit.client.1.smithi150.stdout:4/116: chown d0/fd 61983881 1 2023-12-05T09:57:22.577 INFO:tasks.workunit.client.1.smithi150.stdout:3/163: dread d6/d19/f1e [0,4194304] 0 2023-12-05T09:57:22.577 INFO:tasks.workunit.client.1.smithi150.stdout:3/164: chown d6/d19/d30 3759 1 2023-12-05T09:57:22.577 INFO:tasks.workunit.client.1.smithi150.stdout:3/165: chown d6/d19/d30 2018 1 2023-12-05T09:57:22.578 INFO:tasks.workunit.client.1.smithi150.stdout:2/173: mknod d0/d3/d11/d1d/c3c 0 2023-12-05T09:57:22.579 INFO:tasks.workunit.client.1.smithi150.stdout:4/117: write d0/fc [260995,113626] 0 2023-12-05T09:57:22.579 INFO:tasks.workunit.client.1.smithi150.stdout:3/166: mknod d6/d9/dd/c35 0 2023-12-05T09:57:22.582 INFO:tasks.workunit.client.0.smithi100.stdout:0/225: truncate da/d1b/f3c 2957825 0 2023-12-05T09:57:22.584 INFO:tasks.workunit.client.1.smithi150.stdout:3/167: mkdir d6/d19/d30/d36 0 2023-12-05T09:57:22.584 INFO:tasks.workunit.client.1.smithi150.stdout:3/168: stat c5 0 2023-12-05T09:57:22.584 INFO:tasks.workunit.client.1.smithi150.stdout:3/169: chown d6/d9/f32 25093185 1 2023-12-05T09:57:22.584 INFO:tasks.workunit.client.1.smithi150.stdout:3/170: fsync d6/d9/dd/f13 0 2023-12-05T09:57:22.586 INFO:tasks.workunit.client.1.smithi150.stdout:1/186: sync 2023-12-05T09:57:22.586 INFO:tasks.workunit.client.1.smithi150.stdout:5/162: dwrite d1/d3/d6/d26/f28 [4194304,4194304] 0 2023-12-05T09:57:22.586 INFO:tasks.workunit.client.1.smithi150.stdout:1/187: creat d6/d38/f43 x:0 0 0 2023-12-05T09:57:22.586 INFO:tasks.workunit.client.1.smithi150.stdout:9/138: dwrite d3/f15 [0,4194304] 0 2023-12-05T09:57:22.587 INFO:tasks.workunit.client.0.smithi100.stdout:8/146: dread d0/fd [0,4194304] 0 2023-12-05T09:57:22.587 INFO:tasks.workunit.client.1.smithi150.stdout:7/145: dwrite d2/d4/d8/f9 [0,4194304] 0 2023-12-05T09:57:22.587 INFO:tasks.workunit.client.1.smithi150.stdout:7/146: write d2/d4/d8/d18/d1a/d1e/f24 [266923,43825] 0 2023-12-05T09:57:22.588 INFO:tasks.workunit.client.0.smithi100.stdout:2/311: dwrite d7/da/dc/f12 [0,4194304] 0 2023-12-05T09:57:22.589 INFO:tasks.workunit.client.0.smithi100.stdout:2/312: chown d7/da/dc/f56 27 1 2023-12-05T09:57:22.589 INFO:tasks.workunit.client.0.smithi100.stdout:6/527: dwrite d7/d27/f3b [0,4194304] 0 2023-12-05T09:57:22.589 INFO:tasks.workunit.client.0.smithi100.stdout:6/528: fsync d7/d2d/f9c 0 2023-12-05T09:57:22.589 INFO:tasks.workunit.client.0.smithi100.stdout:0/226: link da/d22/f3b da/d1b/d36/f48 0 2023-12-05T09:57:22.590 INFO:tasks.workunit.client.0.smithi100.stdout:0/227: write da/f11 [3172858,123938] 0 2023-12-05T09:57:22.590 INFO:tasks.workunit.client.0.smithi100.stdout:0/228: write da/f11 [5499391,73102] 0 2023-12-05T09:57:22.592 INFO:tasks.workunit.client.1.smithi150.stdout:8/152: rmdir d0/d8 39 2023-12-05T09:57:22.592 INFO:tasks.workunit.client.1.smithi150.stdout:8/153: readlink d0/d8/lb 0 2023-12-05T09:57:22.594 INFO:tasks.workunit.client.0.smithi100.stdout:2/313: symlink d7/da/l6d 0 2023-12-05T09:57:22.597 INFO:tasks.workunit.client.1.smithi150.stdout:8/154: dread d0/d8/d14/f26 [0,4194304] 0 2023-12-05T09:57:22.597 INFO:tasks.workunit.client.1.smithi150.stdout:0/158: dwrite d5/fa [0,4194304] 0 2023-12-05T09:57:22.597 INFO:tasks.workunit.client.1.smithi150.stdout:0/159: dread - d5/d11/d16/d1f/f2e zero size 2023-12-05T09:57:22.597 INFO:tasks.workunit.client.1.smithi150.stdout:4/118: rmdir d0 39 2023-12-05T09:57:22.606 INFO:tasks.workunit.client.0.smithi100.stdout:6/529: symlink d7/lae 0 2023-12-05T09:57:22.608 INFO:tasks.workunit.client.0.smithi100.stdout:8/147: getdents d0/d12/d13/d16 0 2023-12-05T09:57:22.609 INFO:tasks.workunit.client.1.smithi150.stdout:3/171: mkdir d6/d22/d37 0 2023-12-05T09:57:22.609 INFO:tasks.workunit.client.1.smithi150.stdout:3/172: stat d6/f17 0 2023-12-05T09:57:22.609 INFO:tasks.workunit.client.1.smithi150.stdout:1/188: rmdir d6/d8 39 2023-12-05T09:57:22.609 INFO:tasks.workunit.client.1.smithi150.stdout:9/139: write d3/d9/dc/f19 [400015,121075] 0 2023-12-05T09:57:22.612 INFO:tasks.workunit.client.1.smithi150.stdout:5/163: mkdir d1/d15/d37 0 2023-12-05T09:57:22.613 INFO:tasks.workunit.client.1.smithi150.stdout:2/174: dwrite d0/d3/d5/d10/f19 [0,4194304] 0 2023-12-05T09:57:22.614 INFO:tasks.workunit.client.1.smithi150.stdout:2/175: fdatasync d0/d3/d11/d1d/f2f 0 2023-12-05T09:57:22.614 INFO:tasks.workunit.client.0.smithi100.stdout:2/314: truncate d7/da/dc/f56 2263353 0 2023-12-05T09:57:22.614 INFO:tasks.workunit.client.0.smithi100.stdout:2/315: chown d7/da/d18/f62 22866550 1 2023-12-05T09:57:22.619 INFO:tasks.workunit.client.0.smithi100.stdout:2/316: mkdir d7/da/d13/d69/d6e 0 2023-12-05T09:57:22.620 INFO:tasks.workunit.client.0.smithi100.stdout:0/229: dread da/d2a/f3f [0,4194304] 0 2023-12-05T09:57:22.621 INFO:tasks.workunit.client.0.smithi100.stdout:2/317: chown d7/da/d13/d4e/c68 9784681 1 2023-12-05T09:57:22.621 INFO:tasks.workunit.client.0.smithi100.stdout:2/318: write d7/da/d18/d1b/d2c/f49 [93827,13237] 0 2023-12-05T09:57:22.621 INFO:tasks.workunit.client.0.smithi100.stdout:2/319: read d7/da/d18/d21/f44 [12771,117020] 0 2023-12-05T09:57:22.621 INFO:tasks.workunit.client.0.smithi100.stdout:2/320: creat d7/da/f6f x:0 0 0 2023-12-05T09:57:22.621 INFO:tasks.workunit.client.0.smithi100.stdout:0/230: creat da/d2a/d45/f49 x:0 0 0 2023-12-05T09:57:22.622 INFO:tasks.workunit.client.0.smithi100.stdout:0/231: write da/f2c [3115092,127575] 0 2023-12-05T09:57:22.625 INFO:tasks.workunit.client.0.smithi100.stdout:2/321: creat d7/da/d18/d1b/d2c/f70 x:0 0 0 2023-12-05T09:57:22.625 INFO:tasks.workunit.client.0.smithi100.stdout:2/322: truncate d7/d61/f6b 263728 0 2023-12-05T09:57:22.630 INFO:tasks.workunit.client.1.smithi150.stdout:7/147: rename d2/db/d17/f22 to d2/db/f2c 0 2023-12-05T09:57:22.631 INFO:tasks.workunit.client.1.smithi150.stdout:4/119: symlink d0/d11/l21 0 2023-12-05T09:57:22.636 INFO:tasks.workunit.client.0.smithi100.stdout:5/213: sync 2023-12-05T09:57:22.636 INFO:tasks.workunit.client.0.smithi100.stdout:5/214: fsync d0/d16/d2b/d48/df/f43 0 2023-12-05T09:57:22.642 INFO:tasks.workunit.client.0.smithi100.stdout:2/323: rmdir d7/da/d1a 39 2023-12-05T09:57:22.644 INFO:tasks.workunit.client.0.smithi100.stdout:5/215: rmdir d0/d16/d37 39 2023-12-05T09:57:22.647 INFO:tasks.workunit.client.1.smithi150.stdout:9/140: mknod d3/d9/c27 0 2023-12-05T09:57:22.647 INFO:tasks.workunit.client.1.smithi150.stdout:9/141: write d3/d9/dc/f1d [4576067,46157] 0 2023-12-05T09:57:22.647 INFO:tasks.workunit.client.1.smithi150.stdout:9/142: fdatasync d3/d9/d26/f21 0 2023-12-05T09:57:22.647 INFO:tasks.workunit.client.1.smithi150.stdout:9/143: read d3/d9/f14 [2646684,108392] 0 2023-12-05T09:57:22.650 INFO:tasks.workunit.client.1.smithi150.stdout:5/164: mkdir d1/d3/d38 0 2023-12-05T09:57:22.650 INFO:tasks.workunit.client.1.smithi150.stdout:5/165: fdatasync d1/d3/d1e/d21/f35 0 2023-12-05T09:57:22.653 INFO:tasks.workunit.client.1.smithi150.stdout:8/155: dwrite d0/d8/d14/f1a [0,4194304] 0 2023-12-05T09:57:22.653 INFO:tasks.workunit.client.1.smithi150.stdout:8/156: chown d0/d8/d14/c25 434 1 2023-12-05T09:57:22.653 INFO:tasks.workunit.client.0.smithi100.stdout:2/324: mkdir d7/da/d13/d69/d6e/d71 0 2023-12-05T09:57:22.654 INFO:tasks.workunit.client.0.smithi100.stdout:2/325: truncate d7/da/d18/d1b/f59 621439 0 2023-12-05T09:57:22.654 INFO:tasks.workunit.client.0.smithi100.stdout:2/326: write d7/da/d18/d21/d4d/f58 [297195,8863] 0 2023-12-05T09:57:22.658 INFO:tasks.workunit.client.1.smithi150.stdout:1/189: mknod d6/d8/db/c44 0 2023-12-05T09:57:22.659 INFO:tasks.workunit.client.1.smithi150.stdout:9/144: symlink d3/d9/d26/l28 0 2023-12-05T09:57:22.662 INFO:tasks.workunit.client.1.smithi150.stdout:5/166: symlink d1/d3/d6/d1b/d22/l39 0 2023-12-05T09:57:22.667 INFO:tasks.workunit.client.1.smithi150.stdout:6/141: sync 2023-12-05T09:57:22.667 INFO:tasks.workunit.client.1.smithi150.stdout:9/145: creat d3/f29 x:0 0 0 2023-12-05T09:57:22.668 INFO:tasks.workunit.client.1.smithi150.stdout:9/146: write d3/d9/f20 [873879,82061] 0 2023-12-05T09:57:22.668 INFO:tasks.workunit.client.1.smithi150.stdout:1/190: dread d6/f1a [0,4194304] 0 2023-12-05T09:57:22.668 INFO:tasks.workunit.client.1.smithi150.stdout:5/167: creat d1/d2e/f3a x:0 0 0 2023-12-05T09:57:22.668 INFO:tasks.workunit.client.1.smithi150.stdout:5/168: fdatasync d1/d3/d6/f10 0 2023-12-05T09:57:22.669 INFO:tasks.workunit.client.0.smithi100.stdout:2/327: mkdir d7/da/d18/d1b/d2c/d3f/d72 0 2023-12-05T09:57:22.672 INFO:tasks.workunit.client.0.smithi100.stdout:6/530: dwrite d7/d27/d35/d5a/f96 [0,4194304] 0 2023-12-05T09:57:22.673 INFO:tasks.workunit.client.1.smithi150.stdout:3/173: dwrite d6/f2a [0,4194304] 0 2023-12-05T09:57:22.673 INFO:tasks.workunit.client.1.smithi150.stdout:0/160: rename d5/d1b to d5/d11/d32/d37 0 2023-12-05T09:57:22.673 INFO:tasks.workunit.client.1.smithi150.stdout:0/161: fsync d5/fd 0 2023-12-05T09:57:22.674 INFO:tasks.workunit.client.0.smithi100.stdout:2/328: creat d7/da/d1a/f73 x:0 0 0 2023-12-05T09:57:22.675 INFO:tasks.workunit.client.0.smithi100.stdout:6/531: link d7/d27/l4d d7/d11/d1a/laf 0 2023-12-05T09:57:22.682 INFO:tasks.workunit.client.0.smithi100.stdout:8/148: dwrite d0/f1d [0,4194304] 0 2023-12-05T09:57:22.682 INFO:tasks.workunit.client.0.smithi100.stdout:8/149: readlink d0/d12/l15 0 2023-12-05T09:57:22.686 INFO:tasks.workunit.client.1.smithi150.stdout:0/162: rmdir d5/d11/d16/d27 39 2023-12-05T09:57:22.688 INFO:tasks.workunit.client.1.smithi150.stdout:4/120: dread d0/ff [0,4194304] 0 2023-12-05T09:57:22.692 INFO:tasks.workunit.client.0.smithi100.stdout:2/329: mknod d7/da/d13/d4e/c74 0 2023-12-05T09:57:22.694 INFO:tasks.workunit.client.1.smithi150.stdout:1/191: dread d6/d8/f11 [0,4194304] 0 2023-12-05T09:57:22.694 INFO:tasks.workunit.client.1.smithi150.stdout:1/192: truncate d6/d38/f43 382656 0 2023-12-05T09:57:22.694 INFO:tasks.workunit.client.1.smithi150.stdout:1/193: fdatasync d6/d8/db/d1b/f37 0 2023-12-05T09:57:22.694 INFO:tasks.workunit.client.1.smithi150.stdout:1/194: chown d6/d8/db/f16 10299409 1 2023-12-05T09:57:22.694 INFO:tasks.workunit.client.1.smithi150.stdout:6/142: write d2/da/f1a [2710294,92605] 0 2023-12-05T09:57:22.696 INFO:tasks.workunit.client.1.smithi150.stdout:1/195: write d6/d8/f11 [547186,107475] 0 2023-12-05T09:57:22.697 INFO:tasks.workunit.client.1.smithi150.stdout:0/163: write d5/d11/f26 [77150,74961] 0 2023-12-05T09:57:22.697 INFO:tasks.workunit.client.1.smithi150.stdout:0/164: write d5/d11/f26 [1751561,115921] 0 2023-12-05T09:57:22.700 INFO:tasks.workunit.client.1.smithi150.stdout:2/176: dwrite d0/d3/d21/f2c [0,4194304] 0 2023-12-05T09:57:22.701 INFO:tasks.workunit.client.0.smithi100.stdout:8/150: dread d0/fc [0,4194304] 0 2023-12-05T09:57:22.702 INFO:tasks.workunit.client.1.smithi150.stdout:3/174: mkdir d6/d38 0 2023-12-05T09:57:22.704 INFO:tasks.workunit.client.0.smithi100.stdout:6/532: dread d7/d11/d1a/f22 [0,4194304] 0 2023-12-05T09:57:22.704 INFO:tasks.workunit.client.0.smithi100.stdout:6/533: stat d7/d11/d82/f74 0 2023-12-05T09:57:22.705 INFO:tasks.workunit.client.1.smithi150.stdout:7/148: dwrite d2/d4/d8/d18/d1a/d1e/f21 [0,4194304] 0 2023-12-05T09:57:22.706 INFO:tasks.workunit.client.1.smithi150.stdout:4/121: link d0/d11/c1c d0/c22 0 2023-12-05T09:57:22.708 INFO:tasks.workunit.client.0.smithi100.stdout:2/330: rename d7/da/dc/c35 to d7/da/d18/c75 0 2023-12-05T09:57:22.714 INFO:tasks.workunit.client.1.smithi150.stdout:6/143: unlink d2/c18 0 2023-12-05T09:57:22.717 INFO:tasks.workunit.client.0.smithi100.stdout:5/216: dwrite d0/d27/f28 [0,4194304] 0 2023-12-05T09:57:22.719 INFO:tasks.workunit.client.1.smithi150.stdout:0/165: rename d5/d11/d16/l22 to d5/d11/d32/l38 0 2023-12-05T09:57:22.721 INFO:tasks.workunit.client.0.smithi100.stdout:8/151: creat d0/d12/d13/d16/f20 x:0 0 0 2023-12-05T09:57:22.721 INFO:tasks.workunit.client.0.smithi100.stdout:8/152: chown d0/f3 215 1 2023-12-05T09:57:22.721 INFO:tasks.workunit.client.0.smithi100.stdout:0/232: dwrite da/d2a/f3f [0,4194304] 0 2023-12-05T09:57:22.723 INFO:tasks.workunit.client.0.smithi100.stdout:6/534: truncate d7/d2d/d6a/d7c/f88 688816 0 2023-12-05T09:57:22.726 INFO:tasks.workunit.client.1.smithi150.stdout:8/157: dwrite d0/d8/f1f [0,4194304] 0 2023-12-05T09:57:22.726 INFO:tasks.workunit.client.1.smithi150.stdout:5/169: dread d1/d3/f7 [0,4194304] 0 2023-12-05T09:57:22.727 INFO:tasks.workunit.client.0.smithi100.stdout:0/233: mkdir da/d1b/d4a 0 2023-12-05T09:57:22.727 INFO:tasks.workunit.client.0.smithi100.stdout:0/234: fsync da/d2a/f3f 0 2023-12-05T09:57:22.732 INFO:tasks.workunit.client.1.smithi150.stdout:7/149: symlink d2/d4/d8/d13/l2d 0 2023-12-05T09:57:22.734 INFO:tasks.workunit.client.1.smithi150.stdout:4/122: creat d0/d11/f23 x:0 0 0 2023-12-05T09:57:22.740 INFO:tasks.workunit.client.0.smithi100.stdout:2/331: write d7/da/d1a/f38 [1720001,73414] 0 2023-12-05T09:57:22.741 INFO:tasks.workunit.client.1.smithi150.stdout:1/196: symlink d6/l45 0 2023-12-05T09:57:22.741 INFO:tasks.workunit.client.1.smithi150.stdout:7/150: dread d2/db/f2c [0,4194304] 0 2023-12-05T09:57:22.751 INFO:tasks.workunit.client.1.smithi150.stdout:6/144: dread d2/d23/f29 [0,4194304] 0 2023-12-05T09:57:22.757 INFO:tasks.workunit.client.0.smithi100.stdout:5/217: write d0/d4/f10 [1123826,72681] 0 2023-12-05T09:57:22.759 INFO:tasks.workunit.client.1.smithi150.stdout:3/175: rename c5 to d6/d22/c39 0 2023-12-05T09:57:22.759 INFO:tasks.workunit.client.1.smithi150.stdout:3/176: creat d6/d25/d28/f3a x:0 0 0 2023-12-05T09:57:22.760 INFO:tasks.workunit.client.0.smithi100.stdout:6/535: mkdir d7/d27/d35/d5a/db0 0 2023-12-05T09:57:22.767 INFO:tasks.workunit.client.0.smithi100.stdout:2/332: rmdir d7/da/d18/d1b/d2c/d3f/d46/d6a 0 2023-12-05T09:57:22.767 INFO:tasks.workunit.client.0.smithi100.stdout:2/333: dread - d7/da/f5b zero size 2023-12-05T09:57:22.767 INFO:tasks.workunit.client.1.smithi150.stdout:0/166: dwrite d5/f23 [0,4194304] 0 2023-12-05T09:57:22.767 INFO:tasks.workunit.client.1.smithi150.stdout:2/177: dwrite d0/d3/d11/f23 [0,4194304] 0 2023-12-05T09:57:22.770 INFO:tasks.workunit.client.0.smithi100.stdout:5/218: mkdir d0/d1b/d4d 0 2023-12-05T09:57:22.773 INFO:tasks.workunit.client.0.smithi100.stdout:0/235: dwrite da/d1b/f26 [0,4194304] 0 2023-12-05T09:57:22.777 INFO:tasks.workunit.client.0.smithi100.stdout:2/334: creat d7/da/d18/d1b/d2c/d3f/d46/f76 x:0 0 0 2023-12-05T09:57:22.777 INFO:tasks.workunit.client.0.smithi100.stdout:6/536: dread d7/d27/d35/f39 [0,4194304] 0 2023-12-05T09:57:22.777 INFO:tasks.workunit.client.0.smithi100.stdout:6/537: truncate d7/d11/f98 1035111 0 2023-12-05T09:57:22.777 INFO:tasks.workunit.client.0.smithi100.stdout:6/538: readlink d7/d11/l9e 0 2023-12-05T09:57:22.781 INFO:tasks.workunit.client.0.smithi100.stdout:5/219: mknod d0/d4/d14/c4e 0 2023-12-05T09:57:22.786 INFO:tasks.workunit.client.0.smithi100.stdout:8/153: dwrite d0/f9 [4194304,4194304] 0 2023-12-05T09:57:22.786 INFO:tasks.workunit.client.0.smithi100.stdout:5/220: mknod d0/d1b/c4f 0 2023-12-05T09:57:22.787 INFO:tasks.workunit.client.0.smithi100.stdout:5/221: chown d0/d16/d2b/f3a 24781439 1 2023-12-05T09:57:22.787 INFO:tasks.workunit.client.0.smithi100.stdout:5/222: stat d0/d16/d2b/d48/df/f26 0 2023-12-05T09:57:22.787 INFO:tasks.workunit.client.0.smithi100.stdout:5/223: chown d0/d16/d2b/d48 1 1 2023-12-05T09:57:22.787 INFO:tasks.workunit.client.0.smithi100.stdout:5/224: chown d0/d4/d14/d35/c49 7927 1 2023-12-05T09:57:22.788 INFO:tasks.workunit.client.1.smithi150.stdout:8/158: link d0/d8/d14/d1b/f28 d0/d8/d14/d1b/f2f 0 2023-12-05T09:57:22.788 INFO:tasks.workunit.client.1.smithi150.stdout:8/159: dread - d0/f16 zero size 2023-12-05T09:57:22.788 INFO:tasks.workunit.client.1.smithi150.stdout:8/160: truncate d0/f16 370055 0 2023-12-05T09:57:22.788 INFO:tasks.workunit.client.1.smithi150.stdout:8/161: chown d0/d8/d14/f26 393133 1 2023-12-05T09:57:22.791 INFO:tasks.workunit.client.1.smithi150.stdout:5/170: unlink d1/d15/f16 0 2023-12-05T09:57:22.791 INFO:tasks.workunit.client.0.smithi100.stdout:5/225: creat d0/d1f/d25/f50 x:0 0 0 2023-12-05T09:57:22.792 INFO:tasks.workunit.client.1.smithi150.stdout:4/123: creat d0/f24 x:0 0 0 2023-12-05T09:57:22.794 INFO:tasks.workunit.client.0.smithi100.stdout:8/154: unlink d0/d12/d13/l1c 0 2023-12-05T09:57:22.797 INFO:tasks.workunit.client.0.smithi100.stdout:5/226: mkdir d0/d16/d2b/d48/df/d51 0 2023-12-05T09:57:22.797 INFO:tasks.workunit.client.0.smithi100.stdout:5/227: stat d0/d4/d14/c4e 0 2023-12-05T09:57:22.800 INFO:tasks.workunit.client.1.smithi150.stdout:7/151: mkdir d2/db/d2e 0 2023-12-05T09:57:22.801 INFO:tasks.workunit.client.1.smithi150.stdout:7/152: fsync d2/f25 0 2023-12-05T09:57:22.801 INFO:tasks.workunit.client.1.smithi150.stdout:7/153: readlink d2/d4/l7 0 2023-12-05T09:57:22.801 INFO:tasks.workunit.client.1.smithi150.stdout:7/154: write d2/f12 [529009,112606] 0 2023-12-05T09:57:22.802 INFO:tasks.workunit.client.0.smithi100.stdout:8/155: unlink d0/c11 0 2023-12-05T09:57:22.802 INFO:tasks.workunit.client.1.smithi150.stdout:0/167: dwrite d5/d11/d16/f17 [0,4194304] 0 2023-12-05T09:57:22.804 INFO:tasks.workunit.client.1.smithi150.stdout:6/145: creat d2/d23/d2e/f32 x:0 0 0 2023-12-05T09:57:22.805 INFO:tasks.workunit.client.0.smithi100.stdout:5/228: truncate d0/d1b/f32 2502673 0 2023-12-05T09:57:22.813 INFO:tasks.workunit.client.1.smithi150.stdout:3/177: creat d6/d19/f3b x:0 0 0 2023-12-05T09:57:22.813 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:22 smithi100 ceph-mon[107145]: pgmap v27: 65 pgs: 65 active+clean; 627 MiB data, 3.6 GiB used, 533 GiB / 536 GiB avail; 32 MiB/s rd, 48 MiB/s wr, 661 op/s 2023-12-05T09:57:22.816 INFO:tasks.workunit.client.0.smithi100.stdout:8/156: symlink d0/d12/l21 0 2023-12-05T09:57:22.816 INFO:tasks.workunit.client.0.smithi100.stdout:8/157: write d0/f3 [2123694,82103] 0 2023-12-05T09:57:22.825 INFO:tasks.workunit.client.0.smithi100.stdout:0/236: dread da/d2a/f3f [0,4194304] 0 2023-12-05T09:57:22.827 INFO:tasks.workunit.client.0.smithi100.stdout:5/229: dread d0/d1f/f21 [0,4194304] 0 2023-12-05T09:57:22.827 INFO:tasks.workunit.client.0.smithi100.stdout:5/230: dread - d0/d1f/f4c zero size 2023-12-05T09:57:22.834 INFO:tasks.workunit.client.0.smithi100.stdout:6/539: dread d7/d11/d1a/f52 [0,4194304] 0 2023-12-05T09:57:22.837 INFO:tasks.workunit.client.1.smithi150.stdout:2/178: mkdir d0/d3/d5/d10/d3d 0 2023-12-05T09:57:22.837 INFO:tasks.workunit.client.1.smithi150.stdout:2/179: fdatasync d0/f16 0 2023-12-05T09:57:22.839 INFO:tasks.workunit.client.1.smithi150.stdout:8/162: unlink d0/d8/d14/d1b/f28 0 2023-12-05T09:57:22.844 INFO:tasks.workunit.client.1.smithi150.stdout:7/155: rmdir d2/d4/d8/d13 39 2023-12-05T09:57:22.845 INFO:tasks.workunit.client.1.smithi150.stdout:1/197: dwrite d6/d8/db/de/f14 [0,4194304] 0 2023-12-05T09:57:22.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:22 smithi150 ceph-mon[116142]: pgmap v27: 65 pgs: 65 active+clean; 627 MiB data, 3.6 GiB used, 533 GiB / 536 GiB avail; 32 MiB/s rd, 48 MiB/s wr, 661 op/s 2023-12-05T09:57:22.850 INFO:tasks.workunit.client.1.smithi150.stdout:4/124: dwrite d0/d11/f12 [0,4194304] 0 2023-12-05T09:57:22.850 INFO:tasks.workunit.client.1.smithi150.stdout:4/125: creat d0/d11/f25 x:0 0 0 2023-12-05T09:57:22.850 INFO:tasks.workunit.client.1.smithi150.stdout:4/126: creat d0/f26 x:0 0 0 2023-12-05T09:57:22.855 INFO:tasks.workunit.client.0.smithi100.stdout:5/231: truncate d0/d16/d2b/d48/f13 482897 0 2023-12-05T09:57:22.856 INFO:tasks.workunit.client.1.smithi150.stdout:3/178: creat d6/d22/d37/f3c x:0 0 0 2023-12-05T09:57:22.857 INFO:tasks.workunit.client.1.smithi150.stdout:2/180: dread d0/d3/d5/d10/f19 [0,4194304] 0 2023-12-05T09:57:22.857 INFO:tasks.workunit.client.0.smithi100.stdout:6/540: mkdir d7/d11/d1a/db1 0 2023-12-05T09:57:22.857 INFO:tasks.workunit.client.0.smithi100.stdout:6/541: readlink d7/lae 0 2023-12-05T09:57:22.859 INFO:tasks.workunit.client.1.smithi150.stdout:8/163: mkdir d0/d8/d14/d1b/d24/d2e/d30 0 2023-12-05T09:57:22.859 INFO:tasks.workunit.client.1.smithi150.stdout:9/147: sync 2023-12-05T09:57:22.861 INFO:tasks.workunit.client.0.smithi100.stdout:8/158: rmdir d0/d12/d13 39 2023-12-05T09:57:22.862 INFO:tasks.workunit.client.0.smithi100.stdout:2/335: dwrite d7/f34 [0,4194304] 0 2023-12-05T09:57:22.862 INFO:tasks.workunit.client.0.smithi100.stdout:2/336: write d7/da/d18/d1b/f6c [826876,65959] 0 2023-12-05T09:57:22.863 INFO:tasks.workunit.client.1.smithi150.stdout:1/198: dread d6/d8/fc [0,4194304] 0 2023-12-05T09:57:22.863 INFO:tasks.workunit.client.1.smithi150.stdout:1/199: dread - d6/f3f zero size 2023-12-05T09:57:22.863 INFO:tasks.workunit.client.1.smithi150.stdout:1/200: write d6/d8/db/f2b [1630980,121379] 0 2023-12-05T09:57:22.865 INFO:tasks.workunit.client.0.smithi100.stdout:5/232: rename d0/d1f/l2f to d0/d1f/d25/d31/l52 0 2023-12-05T09:57:22.866 INFO:tasks.workunit.client.1.smithi150.stdout:7/156: write d2/d4/d8/d13/f14 [752445,53090] 0 2023-12-05T09:57:22.867 INFO:tasks.workunit.client.0.smithi100.stdout:1/224: sync 2023-12-05T09:57:22.868 INFO:tasks.workunit.client.0.smithi100.stdout:4/162: sync 2023-12-05T09:57:22.868 INFO:tasks.workunit.client.0.smithi100.stdout:7/145: sync 2023-12-05T09:57:22.868 INFO:tasks.workunit.client.0.smithi100.stdout:4/163: fdatasync de/d16/d23/f26 0 2023-12-05T09:57:22.868 INFO:tasks.workunit.client.0.smithi100.stdout:3/258: sync 2023-12-05T09:57:22.868 INFO:tasks.workunit.client.0.smithi100.stdout:3/259: truncate d0/d4/f20 1512772 0 2023-12-05T09:57:22.868 INFO:tasks.workunit.client.0.smithi100.stdout:7/146: creat d3/dc/d11/f32 x:0 0 0 2023-12-05T09:57:22.868 INFO:tasks.workunit.client.0.smithi100.stdout:7/147: stat d3/dc/d11/d13/de/c17 0 2023-12-05T09:57:22.869 INFO:tasks.workunit.client.0.smithi100.stdout:7/148: write d3/dc/d11/d13/de/f2b [1034540,74637] 0 2023-12-05T09:57:22.869 INFO:tasks.workunit.client.0.smithi100.stdout:9/257: sync 2023-12-05T09:57:22.877 INFO:tasks.workunit.client.0.smithi100.stdout:8/159: mkdir d0/d12/d13/d16/d22 0 2023-12-05T09:57:22.877 INFO:tasks.workunit.client.0.smithi100.stdout:8/160: write d0/f9 [657304,108829] 0 2023-12-05T09:57:22.877 INFO:tasks.workunit.client.0.smithi100.stdout:4/164: dread de/f1b [0,4194304] 0 2023-12-05T09:57:22.879 INFO:tasks.workunit.client.1.smithi150.stdout:0/168: truncate d5/fa 666183 0 2023-12-05T09:57:22.881 INFO:tasks.workunit.client.0.smithi100.stdout:0/237: dwrite da/f2c [0,4194304] 0 2023-12-05T09:57:22.881 INFO:tasks.workunit.client.0.smithi100.stdout:5/233: mkdir d0/d1f/d53 0 2023-12-05T09:57:22.882 INFO:tasks.workunit.client.1.smithi150.stdout:6/146: rmdir d2/d23/d2e 39 2023-12-05T09:57:22.882 INFO:tasks.workunit.client.1.smithi150.stdout:6/147: write d2/f1c [2405093,60182] 0 2023-12-05T09:57:22.885 INFO:tasks.workunit.client.0.smithi100.stdout:1/225: creat db/d12/f45 x:0 0 0 2023-12-05T09:57:22.885 INFO:tasks.workunit.client.0.smithi100.stdout:3/260: symlink d0/d10/l52 0 2023-12-05T09:57:22.885 INFO:tasks.workunit.client.0.smithi100.stdout:3/261: fsync d0/d4/f17 0 2023-12-05T09:57:22.885 INFO:tasks.workunit.client.0.smithi100.stdout:6/542: rename f3 to d7/d27/d97/fb2 0 2023-12-05T09:57:22.893 INFO:tasks.workunit.client.1.smithi150.stdout:2/181: mknod d0/d3/d11/c3e 0 2023-12-05T09:57:22.898 INFO:tasks.workunit.client.1.smithi150.stdout:3/179: dwrite d6/d9/f1d [0,4194304] 0 2023-12-05T09:57:22.899 INFO:tasks.workunit.client.0.smithi100.stdout:7/149: mkdir d3/dc/d11/d33 0 2023-12-05T09:57:22.901 INFO:tasks.workunit.client.1.smithi150.stdout:9/148: symlink d3/d9/dc/d1f/d24/l2a 0 2023-12-05T09:57:22.902 INFO:tasks.workunit.client.0.smithi100.stdout:8/161: creat d0/d12/d13/d16/f23 x:0 0 0 2023-12-05T09:57:22.902 INFO:tasks.workunit.client.0.smithi100.stdout:8/162: write d0/f9 [3441423,65041] 0 2023-12-05T09:57:22.902 INFO:tasks.workunit.client.0.smithi100.stdout:8/163: write d0/fd [2122696,94257] 0 2023-12-05T09:57:22.904 INFO:tasks.workunit.client.1.smithi150.stdout:5/171: rename d1/d15 to d1/d3/d1e/d21/d3b 0 2023-12-05T09:57:22.904 INFO:tasks.workunit.client.1.smithi150.stdout:5/172: chown d1/d3/d1e/d21/f35 111 1 2023-12-05T09:57:22.906 INFO:tasks.workunit.client.0.smithi100.stdout:4/165: creat de/d16/d1e/f2e x:0 0 0 2023-12-05T09:57:22.910 INFO:tasks.workunit.client.1.smithi150.stdout:9/149: read d3/d9/f1c [60261,61771] 0 2023-12-05T09:57:22.911 INFO:tasks.workunit.client.1.smithi150.stdout:9/150: creat d3/d9/dc/d1f/f2b x:0 0 0 2023-12-05T09:57:22.911 INFO:tasks.workunit.client.1.smithi150.stdout:9/151: stat d3/d9/dc/f1d 0 2023-12-05T09:57:22.911 INFO:tasks.workunit.client.1.smithi150.stdout:9/152: fdatasync d3/d9/f17 0 2023-12-05T09:57:22.913 INFO:tasks.workunit.client.0.smithi100.stdout:1/226: creat db/d31/f46 x:0 0 0 2023-12-05T09:57:22.914 INFO:tasks.workunit.client.1.smithi150.stdout:7/157: dwrite d2/db/f26 [0,4194304] 0 2023-12-05T09:57:22.917 INFO:tasks.workunit.client.1.smithi150.stdout:2/182: dread d0/d3/d5/d10/f19 [0,4194304] 0 2023-12-05T09:57:22.918 INFO:tasks.workunit.client.1.smithi150.stdout:2/183: chown d0/d3/d5/d36 26112 1 2023-12-05T09:57:22.920 INFO:tasks.workunit.client.1.smithi150.stdout:0/169: link d5/f31 d5/d11/d32/f39 0 2023-12-05T09:57:22.920 INFO:tasks.workunit.client.1.smithi150.stdout:0/170: write d5/d11/f21 [4424442,106621] 0 2023-12-05T09:57:22.921 INFO:tasks.workunit.client.0.smithi100.stdout:3/262: rmdir d0/d2/de/d12 39 2023-12-05T09:57:22.926 INFO:tasks.workunit.client.0.smithi100.stdout:7/150: mknod d3/c34 0 2023-12-05T09:57:22.926 INFO:tasks.workunit.client.0.smithi100.stdout:7/151: chown d3/c34 60186388 1 2023-12-05T09:57:22.937 INFO:tasks.workunit.client.0.smithi100.stdout:8/164: mkdir d0/d12/d13/d16/d22/d24 0 2023-12-05T09:57:22.939 INFO:tasks.workunit.client.1.smithi150.stdout:4/127: rename d0/c1f to d0/d11/c27 0 2023-12-05T09:57:22.939 INFO:tasks.workunit.client.0.smithi100.stdout:4/166: rename de/d16/f20 to de/d16/f2f 0 2023-12-05T09:57:22.940 INFO:tasks.workunit.client.0.smithi100.stdout:2/337: dread d7/da/d1a/f45 [0,4194304] 0 2023-12-05T09:57:22.940 INFO:tasks.workunit.client.0.smithi100.stdout:4/167: creat de/d16/d1e/f30 x:0 0 0 2023-12-05T09:57:22.942 INFO:tasks.workunit.client.1.smithi150.stdout:5/173: creat d1/d3/d1e/f3c x:0 0 0 2023-12-05T09:57:22.942 INFO:tasks.workunit.client.1.smithi150.stdout:5/174: truncate d1/d3/d6/f10 3342191 0 2023-12-05T09:57:22.945 INFO:tasks.workunit.client.1.smithi150.stdout:1/201: symlink d6/l46 0 2023-12-05T09:57:22.946 INFO:tasks.workunit.client.1.smithi150.stdout:1/202: truncate f4 1666515 0 2023-12-05T09:57:22.950 INFO:tasks.workunit.client.1.smithi150.stdout:3/180: dwrite d6/d9/f1c [0,4194304] 0 2023-12-05T09:57:22.950 INFO:tasks.workunit.client.1.smithi150.stdout:3/181: write d6/d25/d28/f2e [676383,39679] 0 2023-12-05T09:57:22.951 INFO:tasks.workunit.client.0.smithi100.stdout:8/165: creat d0/d12/d13/f25 x:0 0 0 2023-12-05T09:57:22.952 INFO:tasks.workunit.client.0.smithi100.stdout:2/338: link d7/da/f25 d7/da/d65/f77 0 2023-12-05T09:57:22.952 INFO:tasks.workunit.client.0.smithi100.stdout:2/339: readlink d7/da/d18/d1b/l2f 0 2023-12-05T09:57:22.952 INFO:tasks.workunit.client.0.smithi100.stdout:2/340: fsync d7/da/d18/d1b/f28 0 2023-12-05T09:57:22.956 INFO:tasks.workunit.client.0.smithi100.stdout:4/168: rename de/d16/d23/f28 to de/d1d/f31 0 2023-12-05T09:57:22.959 INFO:tasks.workunit.client.1.smithi150.stdout:7/158: unlink d2/d4/d8/d18/d1a/d1e/f24 0 2023-12-05T09:57:22.960 INFO:tasks.workunit.client.1.smithi150.stdout:7/159: chown d2/d4/l7 387615 1 2023-12-05T09:57:22.961 INFO:tasks.workunit.client.1.smithi150.stdout:2/184: mkdir d0/d3/d11/d1d/d38/d3f 0 2023-12-05T09:57:22.961 INFO:tasks.workunit.client.1.smithi150.stdout:2/185: stat d0/d3/d5/l1c 0 2023-12-05T09:57:22.961 INFO:tasks.workunit.client.1.smithi150.stdout:2/186: creat d0/d3/d5/f40 x:0 0 0 2023-12-05T09:57:22.965 INFO:tasks.workunit.client.0.smithi100.stdout:4/169: symlink de/d16/d23/l32 0 2023-12-05T09:57:22.965 INFO:tasks.workunit.client.0.smithi100.stdout:4/170: chown c5 4 1 2023-12-05T09:57:22.966 INFO:tasks.workunit.client.1.smithi150.stdout:5/175: mknod d1/c3d 0 2023-12-05T09:57:22.967 INFO:tasks.workunit.client.1.smithi150.stdout:7/160: link d2/d4/d8/d13/l2d d2/db/d17/d20/l2f 0 2023-12-05T09:57:22.967 INFO:tasks.workunit.client.1.smithi150.stdout:5/176: creat d1/d3/d6/d26/f3e x:0 0 0 2023-12-05T09:57:22.967 INFO:tasks.workunit.client.1.smithi150.stdout:7/161: write d2/d4/f27 [413387,55131] 0 2023-12-05T09:57:22.968 INFO:tasks.workunit.client.1.smithi150.stdout:6/148: getdents d2 0 2023-12-05T09:57:22.975 INFO:tasks.workunit.client.1.smithi150.stdout:1/203: mkdir d6/d47 0 2023-12-05T09:57:22.975 INFO:tasks.workunit.client.1.smithi150.stdout:1/204: chown d6/d8/fc 105551039 1 2023-12-05T09:57:22.975 INFO:tasks.workunit.client.1.smithi150.stdout:1/205: chown d6/d47 384407892 1 2023-12-05T09:57:22.975 INFO:tasks.workunit.client.1.smithi150.stdout:5/177: creat d1/d3/d6/f3f x:0 0 0 2023-12-05T09:57:22.975 INFO:tasks.workunit.client.1.smithi150.stdout:6/149: symlink d2/d23/l33 0 2023-12-05T09:57:22.975 INFO:tasks.workunit.client.1.smithi150.stdout:6/150: chown d2/da/f10 206889142 1 2023-12-05T09:57:22.976 INFO:tasks.workunit.client.1.smithi150.stdout:0/171: rmdir d5/d11 39 2023-12-05T09:57:22.978 INFO:tasks.workunit.client.1.smithi150.stdout:1/206: symlink d6/d47/l48 0 2023-12-05T09:57:22.978 INFO:tasks.workunit.client.1.smithi150.stdout:1/207: truncate d6/d8/db/f20 999124 0 2023-12-05T09:57:22.978 INFO:tasks.workunit.client.1.smithi150.stdout:5/178: mknod d1/d3/d38/c40 0 2023-12-05T09:57:22.986 INFO:tasks.workunit.client.1.smithi150.stdout:2/187: dread d0/d3/d5/d10/f20 [0,4194304] 0 2023-12-05T09:57:22.991 INFO:tasks.workunit.client.0.smithi100.stdout:5/234: dwrite d0/d4/fa [4194304,4194304] 0 2023-12-05T09:57:22.996 INFO:tasks.workunit.client.1.smithi150.stdout:2/188: mkdir d0/d3/d5/d10/d3d/d41 0 2023-12-05T09:57:23.000 INFO:tasks.workunit.client.0.smithi100.stdout:5/235: truncate d0/d16/d2b/d48/df/f26 374030 0 2023-12-05T09:57:23.005 INFO:tasks.workunit.client.1.smithi150.stdout:2/189: mkdir d0/d42 0 2023-12-05T09:57:23.006 INFO:tasks.workunit.client.0.smithi100.stdout:6/543: dwrite d7/d11/f4c [0,4194304] 0 2023-12-05T09:57:23.006 INFO:tasks.workunit.client.0.smithi100.stdout:6/544: chown d7/d2d/c63 2 1 2023-12-05T09:57:23.006 INFO:tasks.workunit.client.0.smithi100.stdout:6/545: fsync d7/d27/f3b 0 2023-12-05T09:57:23.011 INFO:tasks.workunit.client.0.smithi100.stdout:0/238: dwrite da/d2a/f3f [0,4194304] 0 2023-12-05T09:57:23.014 INFO:tasks.workunit.client.0.smithi100.stdout:8/166: write d0/f1d [3074087,43192] 0 2023-12-05T09:57:23.014 INFO:tasks.workunit.client.0.smithi100.stdout:8/167: chown d0/d12/d13/l1e 33242093 1 2023-12-05T09:57:23.021 INFO:tasks.workunit.client.1.smithi150.stdout:9/153: rmdir d3/d9 39 2023-12-05T09:57:23.021 INFO:tasks.workunit.client.1.smithi150.stdout:8/164: dwrite d0/d8/d14/d1b/f2f [4194304,4194304] 0 2023-12-05T09:57:23.025 INFO:tasks.workunit.client.0.smithi100.stdout:9/258: dwrite d7/d1b/d22/d51/f14 [0,4194304] 0 2023-12-05T09:57:23.029 INFO:tasks.workunit.client.0.smithi100.stdout:5/236: dread d0/d1b/f32 [0,4194304] 0 2023-12-05T09:57:23.029 INFO:tasks.workunit.client.0.smithi100.stdout:5/237: chown d0/d16/c17 1404499 1 2023-12-05T09:57:23.029 INFO:tasks.workunit.client.0.smithi100.stdout:5/238: chown d0/d4/d14/l41 937967 1 2023-12-05T09:57:23.032 INFO:tasks.workunit.client.1.smithi150.stdout:4/128: dwrite d0/f17 [0,4194304] 0 2023-12-05T09:57:23.032 INFO:tasks.workunit.client.1.smithi150.stdout:4/129: truncate d0/f24 310394 0 2023-12-05T09:57:23.038 INFO:tasks.workunit.client.1.smithi150.stdout:8/165: creat d0/d8/d14/d1b/f31 x:0 0 0 2023-12-05T09:57:23.042 INFO:tasks.workunit.client.1.smithi150.stdout:3/182: dwrite d6/d9/dd/f1a [0,4194304] 0 2023-12-05T09:57:23.045 INFO:tasks.workunit.client.0.smithi100.stdout:7/152: dwrite d3/dc/d11/f31 [0,4194304] 0 2023-12-05T09:57:23.045 INFO:tasks.workunit.client.0.smithi100.stdout:7/153: creat d3/dc/d11/d13/de/f35 x:0 0 0 2023-12-05T09:57:23.045 INFO:tasks.workunit.client.0.smithi100.stdout:8/168: creat d0/d12/d13/d16/d22/f26 x:0 0 0 2023-12-05T09:57:23.045 INFO:tasks.workunit.client.0.smithi100.stdout:8/169: creat d0/d12/d13/d16/f27 x:0 0 0 2023-12-05T09:57:23.046 INFO:tasks.workunit.client.0.smithi100.stdout:8/170: chown d0/d12/l21 1453125 1 2023-12-05T09:57:23.046 INFO:tasks.workunit.client.0.smithi100.stdout:8/171: readlink d0/l4 0 2023-12-05T09:57:23.047 INFO:tasks.workunit.client.0.smithi100.stdout:9/259: rmdir d7/d1b/d22/d3e 0 2023-12-05T09:57:23.047 INFO:tasks.workunit.client.0.smithi100.stdout:9/260: dread - d7/f45 zero size 2023-12-05T09:57:23.048 INFO:tasks.workunit.client.0.smithi100.stdout:2/341: dwrite d7/da/d2b/f50 [0,4194304] 0 2023-12-05T09:57:23.053 INFO:tasks.workunit.client.1.smithi150.stdout:1/208: getdents d6/d47 0 2023-12-05T09:57:23.053 INFO:tasks.workunit.client.1.smithi150.stdout:1/209: readlink d6/d8/l17 0 2023-12-05T09:57:23.055 INFO:tasks.workunit.client.1.smithi150.stdout:0/172: dwrite d5/d11/f26 [0,4194304] 0 2023-12-05T09:57:23.055 INFO:tasks.workunit.client.1.smithi150.stdout:0/173: write d5/fc [1679651,34479] 0 2023-12-05T09:57:23.057 INFO:tasks.workunit.client.1.smithi150.stdout:6/151: truncate d2/f1c 2189238 0 2023-12-05T09:57:23.057 INFO:tasks.workunit.client.1.smithi150.stdout:6/152: read d2/f2c [2501901,53762] 0 2023-12-05T09:57:23.062 INFO:tasks.workunit.client.0.smithi100.stdout:5/239: dread d0/f36 [0,4194304] 0 2023-12-05T09:57:23.065 INFO:tasks.workunit.client.1.smithi150.stdout:8/166: rename d0/d8/lb to d0/d8/d14/d1b/l32 0 2023-12-05T09:57:23.065 INFO:tasks.workunit.client.0.smithi100.stdout:6/546: dwrite d7/d11/f20 [4194304,4194304] 0 2023-12-05T09:57:23.073 INFO:tasks.workunit.client.0.smithi100.stdout:7/154: symlink d3/dc/d11/d13/d1b/l36 0 2023-12-05T09:57:23.078 INFO:tasks.workunit.client.1.smithi150.stdout:7/162: dwrite d2/d4/d8/d13/f14 [0,4194304] 0 2023-12-05T09:57:23.079 INFO:tasks.workunit.client.0.smithi100.stdout:3/263: dwrite d0/d2/de/f47 [0,4194304] 0 2023-12-05T09:57:23.079 INFO:tasks.workunit.client.0.smithi100.stdout:1/227: dwrite db/fd [0,4194304] 0 2023-12-05T09:57:23.080 INFO:tasks.workunit.client.1.smithi150.stdout:0/174: mknod d5/c3a 0 2023-12-05T09:57:23.080 INFO:tasks.workunit.client.1.smithi150.stdout:0/175: fsync d5/f31 0 2023-12-05T09:57:23.080 INFO:tasks.workunit.client.1.smithi150.stdout:0/176: chown d5/ce 61 1 2023-12-05T09:57:23.081 INFO:tasks.workunit.client.0.smithi100.stdout:9/261: truncate d7/fd 4057338 0 2023-12-05T09:57:23.082 INFO:tasks.workunit.client.1.smithi150.stdout:6/153: creat d2/f34 x:0 0 0 2023-12-05T09:57:23.083 INFO:tasks.workunit.client.1.smithi150.stdout:9/154: dwrite d3/d9/f17 [0,4194304] 0 2023-12-05T09:57:23.083 INFO:tasks.workunit.client.1.smithi150.stdout:9/155: chown d3/d9/d26/f21 119 1 2023-12-05T09:57:23.083 INFO:tasks.workunit.client.1.smithi150.stdout:9/156: readlink d3/l18 0 2023-12-05T09:57:23.084 INFO:tasks.workunit.client.1.smithi150.stdout:5/179: dwrite d1/d3/d6/f3f [0,4194304] 0 2023-12-05T09:57:23.085 INFO:tasks.workunit.client.0.smithi100.stdout:3/264: dread d0/d2/de/f38 [0,4194304] 0 2023-12-05T09:57:23.085 INFO:tasks.workunit.client.0.smithi100.stdout:3/265: stat d0/d2/de/d11/f21 0 2023-12-05T09:57:23.085 INFO:tasks.workunit.client.0.smithi100.stdout:0/239: dwrite da/d22/f3b [0,4194304] 0 2023-12-05T09:57:23.086 INFO:tasks.workunit.client.0.smithi100.stdout:2/342: mknod d7/da/c78 0 2023-12-05T09:57:23.089 INFO:tasks.workunit.client.1.smithi150.stdout:1/210: rename f5 to d6/d3c/f49 0 2023-12-05T09:57:23.089 INFO:tasks.workunit.client.1.smithi150.stdout:1/211: fsync d6/d8/db/f19 0 2023-12-05T09:57:23.089 INFO:tasks.workunit.client.1.smithi150.stdout:1/212: chown d6/d8/db/c29 17 1 2023-12-05T09:57:23.095 INFO:tasks.workunit.client.0.smithi100.stdout:8/172: dwrite d0/f2 [0,4194304] 0 2023-12-05T09:57:23.095 INFO:tasks.workunit.client.1.smithi150.stdout:2/190: dwrite d0/d3/d11/d1d/f2f [0,4194304] 0 2023-12-05T09:57:23.098 INFO:tasks.workunit.client.0.smithi100.stdout:6/547: creat d7/d2d/d6a/d7c/d8d/fb3 x:0 0 0 2023-12-05T09:57:23.098 INFO:tasks.workunit.client.0.smithi100.stdout:6/548: chown d7/d2d/f42 3 1 2023-12-05T09:57:23.098 INFO:tasks.workunit.client.0.smithi100.stdout:6/549: stat d7/d27/fa2 0 2023-12-05T09:57:23.100 INFO:tasks.workunit.client.0.smithi100.stdout:6/550: read d7/d11/f98 [963015,113154] 0 2023-12-05T09:57:23.101 INFO:tasks.workunit.client.1.smithi150.stdout:0/177: truncate d5/f23 2705730 0 2023-12-05T09:57:23.106 INFO:tasks.workunit.client.0.smithi100.stdout:8/173: dread d0/fb [0,4194304] 0 2023-12-05T09:57:23.112 INFO:tasks.workunit.client.1.smithi150.stdout:3/183: dwrite d6/d25/d28/f2e [0,4194304] 0 2023-12-05T09:57:23.113 INFO:tasks.workunit.client.0.smithi100.stdout:9/262: creat d7/d35/f55 x:0 0 0 2023-12-05T09:57:23.116 INFO:tasks.workunit.client.1.smithi150.stdout:9/157: truncate d3/d9/f1c 15926 0 2023-12-05T09:57:23.122 INFO:tasks.workunit.client.0.smithi100.stdout:0/240: mknod da/d22/d33/c4b 0 2023-12-05T09:57:23.124 INFO:tasks.workunit.client.0.smithi100.stdout:1/228: dwrite db/d12/d1e/f41 [0,4194304] 0 2023-12-05T09:57:23.125 INFO:tasks.workunit.client.0.smithi100.stdout:2/343: mknod d7/da/d13/d69/c79 0 2023-12-05T09:57:23.125 INFO:tasks.workunit.client.0.smithi100.stdout:2/344: read - d7/f66 zero size 2023-12-05T09:57:23.126 INFO:tasks.workunit.client.0.smithi100.stdout:5/240: rmdir d0/d4/d14/d35 39 2023-12-05T09:57:23.130 INFO:tasks.workunit.client.0.smithi100.stdout:6/551: truncate d7/d2d/f40 5672854 0 2023-12-05T09:57:23.131 INFO:tasks.workunit.client.0.smithi100.stdout:6/552: write d7/d27/d35/f3a [748019,51037] 0 2023-12-05T09:57:23.131 INFO:tasks.workunit.client.1.smithi150.stdout:3/184: dread d6/d9/f1c [0,4194304] 0 2023-12-05T09:57:23.131 INFO:tasks.workunit.client.1.smithi150.stdout:3/185: fdatasync d6/d9/dd/f13 0 2023-12-05T09:57:23.135 INFO:tasks.workunit.client.0.smithi100.stdout:7/155: mkdir d3/dc/d11/d13/d37 0 2023-12-05T09:57:23.135 INFO:tasks.workunit.client.0.smithi100.stdout:9/263: truncate d7/d20/f2c 1015437 0 2023-12-05T09:57:23.136 INFO:tasks.workunit.client.0.smithi100.stdout:3/266: getdents d0 0 2023-12-05T09:57:23.139 INFO:tasks.workunit.client.1.smithi150.stdout:5/180: unlink d1/d3/d1e/f3c 0 2023-12-05T09:57:23.142 INFO:tasks.workunit.client.0.smithi100.stdout:0/241: rename da/d1b/c1f to da/d22/d33/d35/c4c 0 2023-12-05T09:57:23.142 INFO:tasks.workunit.client.1.smithi150.stdout:1/213: mkdir d6/d38/d4a 0 2023-12-05T09:57:23.145 INFO:tasks.workunit.client.0.smithi100.stdout:0/242: write da/f37 [229039,102647] 0 2023-12-05T09:57:23.145 INFO:tasks.workunit.client.0.smithi100.stdout:0/243: write da/f2d [5115157,93202] 0 2023-12-05T09:57:23.146 INFO:tasks.workunit.client.1.smithi150.stdout:8/167: getdents d0/d8/d14/d1b/d24/d2e 0 2023-12-05T09:57:23.150 INFO:tasks.workunit.client.0.smithi100.stdout:7/156: write d3/dc/d11/d13/d1b/f26 [3464271,90150] 0 2023-12-05T09:57:23.150 INFO:tasks.workunit.client.0.smithi100.stdout:7/157: fsync d3/dc/d11/d13/de/f35 0 2023-12-05T09:57:23.150 INFO:tasks.workunit.client.0.smithi100.stdout:7/158: stat d3/dc/d11/f31 0 2023-12-05T09:57:23.150 INFO:tasks.workunit.client.0.smithi100.stdout:5/241: unlink d0/d27/f28 0 2023-12-05T09:57:23.156 INFO:tasks.workunit.client.0.smithi100.stdout:9/264: dread d7/d1b/f30 [0,4194304] 0 2023-12-05T09:57:23.158 INFO:tasks.workunit.client.1.smithi150.stdout:2/191: mknod d0/d3/d5/d13/d15/c43 0 2023-12-05T09:57:23.158 INFO:tasks.workunit.client.1.smithi150.stdout:2/192: creat d0/d3/d21/f44 x:0 0 0 2023-12-05T09:57:23.158 INFO:tasks.workunit.client.1.smithi150.stdout:2/193: creat d0/d3/d5/d10/f45 x:0 0 0 2023-12-05T09:57:23.158 INFO:tasks.workunit.client.1.smithi150.stdout:2/194: fsync d0/d3/d5/d10/f20 0 2023-12-05T09:57:23.159 INFO:tasks.workunit.client.0.smithi100.stdout:1/229: rename db/d12/c2c to db/d31/c47 0 2023-12-05T09:57:23.160 INFO:tasks.workunit.client.0.smithi100.stdout:1/230: chown db/d12/d1e/d26/d30/f33 2 1 2023-12-05T09:57:23.160 INFO:tasks.workunit.client.0.smithi100.stdout:1/231: write f1 [2625252,51674] 0 2023-12-05T09:57:23.162 INFO:tasks.workunit.client.1.smithi150.stdout:0/178: mkdir d5/d11/d16/d27/d3b 0 2023-12-05T09:57:23.162 INFO:tasks.workunit.client.1.smithi150.stdout:0/179: write d5/fa [789922,120529] 0 2023-12-05T09:57:23.169 INFO:tasks.workunit.client.0.smithi100.stdout:0/244: rename da/d2a/d39 to da/d2a/d4d 0 2023-12-05T09:57:23.172 INFO:tasks.workunit.client.0.smithi100.stdout:1/232: dread db/d31/f36 [0,4194304] 0 2023-12-05T09:57:23.173 INFO:tasks.workunit.client.1.smithi150.stdout:9/158: mknod d3/d9/dc/c2c 0 2023-12-05T09:57:23.173 INFO:tasks.workunit.client.1.smithi150.stdout:9/159: read d3/d9/f14 [145167,85479] 0 2023-12-05T09:57:23.173 INFO:tasks.workunit.client.1.smithi150.stdout:9/160: write d3/d9/f1c [144520,95146] 0 2023-12-05T09:57:23.173 INFO:tasks.workunit.client.1.smithi150.stdout:9/161: truncate d3/d9/d26/f21 61118 0 2023-12-05T09:57:23.182 INFO:tasks.workunit.client.0.smithi100.stdout:6/553: dread d7/d11/f2c [0,4194304] 0 2023-12-05T09:57:23.182 INFO:tasks.workunit.client.0.smithi100.stdout:5/242: symlink d0/d16/d2b/d48/l54 0 2023-12-05T09:57:23.183 INFO:tasks.workunit.client.1.smithi150.stdout:3/186: mkdir d6/d9/d3d 0 2023-12-05T09:57:23.183 INFO:tasks.workunit.client.1.smithi150.stdout:3/187: stat d6/d9/f1d 0 2023-12-05T09:57:23.183 INFO:tasks.workunit.client.1.smithi150.stdout:3/188: chown d6/d19/f3b 6 1 2023-12-05T09:57:23.188 INFO:tasks.workunit.client.0.smithi100.stdout:2/345: rename d7/da/d18/d1b/d2c/d3f/f5e to d7/da/dc/f7a 0 2023-12-05T09:57:23.189 INFO:tasks.workunit.client.1.smithi150.stdout:5/181: creat d1/d3/d6/d1b/d22/d24/f41 x:0 0 0 2023-12-05T09:57:23.196 INFO:tasks.workunit.client.0.smithi100.stdout:6/554: truncate d7/d27/f3b 2633901 0 2023-12-05T09:57:23.201 INFO:tasks.workunit.client.0.smithi100.stdout:7/159: dread d3/dc/d11/d13/f15 [0,4194304] 0 2023-12-05T09:57:23.201 INFO:tasks.workunit.client.0.smithi100.stdout:7/160: truncate d3/dc/d11/f32 91142 0 2023-12-05T09:57:23.203 INFO:tasks.workunit.client.0.smithi100.stdout:3/267: dwrite d0/d10/f49 [0,4194304] 0 2023-12-05T09:57:23.205 INFO:tasks.workunit.client.0.smithi100.stdout:2/346: mknod d7/da/d18/d1b/d2c/d3f/d72/c7b 0 2023-12-05T09:57:23.205 INFO:tasks.workunit.client.0.smithi100.stdout:1/233: rename c2 to db/d12/c48 0 2023-12-05T09:57:23.206 INFO:tasks.workunit.client.0.smithi100.stdout:1/234: write db/d12/d1e/d26/d30/f33 [994903,29850] 0 2023-12-05T09:57:23.207 INFO:tasks.workunit.client.1.smithi150.stdout:8/168: mknod d0/d8/c33 0 2023-12-05T09:57:23.216 INFO:tasks.workunit.client.0.smithi100.stdout:2/347: dread d7/da/d13/f5d [0,4194304] 0 2023-12-05T09:57:23.216 INFO:tasks.workunit.client.0.smithi100.stdout:2/348: chown d7/da/dc/f56 44994 1 2023-12-05T09:57:23.218 INFO:tasks.workunit.client.1.smithi150.stdout:0/180: dwrite d5/d11/d32/f39 [0,4194304] 0 2023-12-05T09:57:23.218 INFO:tasks.workunit.client.1.smithi150.stdout:0/181: chown d5/d11/d16/f1e 2319 1 2023-12-05T09:57:23.218 INFO:tasks.workunit.client.0.smithi100.stdout:3/268: link d0/d10/f43 d0/d3d/f53 0 2023-12-05T09:57:23.220 INFO:tasks.workunit.client.1.smithi150.stdout:2/195: truncate d0/f16 3773401 0 2023-12-05T09:57:23.223 INFO:tasks.workunit.client.1.smithi150.stdout:8/169: dread d0/d8/d14/f1a [0,4194304] 0 2023-12-05T09:57:23.223 INFO:tasks.workunit.client.0.smithi100.stdout:1/235: unlink db/l23 0 2023-12-05T09:57:23.224 INFO:tasks.workunit.client.0.smithi100.stdout:1/236: write db/f1a [558716,124264] 0 2023-12-05T09:57:23.224 INFO:tasks.workunit.client.1.smithi150.stdout:9/162: symlink d3/d1b/l2d 0 2023-12-05T09:57:23.224 INFO:tasks.workunit.client.1.smithi150.stdout:9/163: truncate d3/d9/d26/f21 90895 0 2023-12-05T09:57:23.224 INFO:tasks.workunit.client.1.smithi150.stdout:9/164: creat d3/f2e x:0 0 0 2023-12-05T09:57:23.225 INFO:tasks.workunit.client.0.smithi100.stdout:2/349: dread d7/da/d18/d21/f40 [0,4194304] 0 2023-12-05T09:57:23.226 INFO:tasks.workunit.client.0.smithi100.stdout:2/350: dread - d7/da/d18/d1b/d2c/d3f/f67 zero size 2023-12-05T09:57:23.226 INFO:tasks.workunit.client.0.smithi100.stdout:3/269: rename d0/d4/c25 to d0/d2/de/c54 0 2023-12-05T09:57:23.226 INFO:tasks.workunit.client.0.smithi100.stdout:3/270: creat d0/d10/d39/f55 x:0 0 0 2023-12-05T09:57:23.227 INFO:tasks.workunit.client.1.smithi150.stdout:3/189: mknod d6/d22/c3e 0 2023-12-05T09:57:23.230 INFO:tasks.workunit.client.1.smithi150.stdout:5/182: symlink d1/d3/d6/d1b/l42 0 2023-12-05T09:57:23.230 INFO:tasks.workunit.client.0.smithi100.stdout:1/237: symlink db/l49 0 2023-12-05T09:57:23.231 INFO:tasks.workunit.client.0.smithi100.stdout:5/243: dwrite d0/d1f/d25/d31/f3e [0,4194304] 0 2023-12-05T09:57:23.232 INFO:tasks.workunit.client.0.smithi100.stdout:5/244: stat d0/d1f/d25/f50 0 2023-12-05T09:57:23.232 INFO:tasks.workunit.client.0.smithi100.stdout:9/265: truncate d7/d20/f2c 1955959 0 2023-12-05T09:57:23.234 INFO:tasks.workunit.client.0.smithi100.stdout:3/271: unlink d0/d2/c44 0 2023-12-05T09:57:23.235 INFO:tasks.workunit.client.1.smithi150.stdout:1/214: mknod d6/c4b 0 2023-12-05T09:57:23.244 INFO:tasks.workunit.client.0.smithi100.stdout:2/351: write d7/da/d18/d1b/d2c/d3f/d46/f26 [1439690,20284] 0 2023-12-05T09:57:23.244 INFO:tasks.workunit.client.1.smithi150.stdout:7/163: rename d2/d4/d8 to d2/db/d30 0 2023-12-05T09:57:23.247 INFO:tasks.workunit.client.0.smithi100.stdout:7/161: dread d3/dc/f1d [0,4194304] 0 2023-12-05T09:57:23.252 INFO:tasks.workunit.client.0.smithi100.stdout:5/245: creat d0/d4/d14/f55 x:0 0 0 2023-12-05T09:57:23.254 INFO:tasks.workunit.client.0.smithi100.stdout:6/555: dwrite d7/d2d/f9c [0,4194304] 0 2023-12-05T09:57:23.255 INFO:tasks.workunit.client.1.smithi150.stdout:2/196: mknod d0/d3/d21/c46 0 2023-12-05T09:57:23.257 INFO:tasks.workunit.client.0.smithi100.stdout:3/272: write d0/d2/de/d12/f3f [2846291,57323] 0 2023-12-05T09:57:23.259 INFO:tasks.workunit.client.1.smithi150.stdout:8/170: mkdir d0/d8/d14/d1b/d24/d34 0 2023-12-05T09:57:23.262 INFO:tasks.workunit.client.1.smithi150.stdout:0/182: dwrite d5/d11/d16/d1f/f2e [0,4194304] 0 2023-12-05T09:57:23.264 INFO:tasks.workunit.client.0.smithi100.stdout:1/238: rmdir db/d12 39 2023-12-05T09:57:23.264 INFO:tasks.workunit.client.0.smithi100.stdout:1/239: chown db/d12/l28 596870830 1 2023-12-05T09:57:23.266 INFO:tasks.workunit.client.1.smithi150.stdout:9/165: creat d3/d9/f2f x:0 0 0 2023-12-05T09:57:23.271 INFO:tasks.workunit.client.1.smithi150.stdout:1/215: dwrite d6/d38/f3d [0,4194304] 0 2023-12-05T09:57:23.351 INFO:tasks.workunit.client.1.smithi150.stdout:3/190: rename d6/d19/f1e to d6/d19/f3f 0 2023-12-05T09:57:23.356 INFO:tasks.workunit.client.0.smithi100.stdout:2/352: mknod d7/da/d13/d69/d6e/c7c 0 2023-12-05T09:57:23.357 INFO:tasks.workunit.client.1.smithi150.stdout:7/164: mkdir d2/d1b/d31 0 2023-12-05T09:57:23.358 INFO:tasks.workunit.client.0.smithi100.stdout:7/162: mknod d3/dc/d11/d13/d37/c38 0 2023-12-05T09:57:23.358 INFO:tasks.workunit.client.0.smithi100.stdout:7/163: write d3/dc/d11/d13/de/f35 [275631,77943] 0 2023-12-05T09:57:23.359 INFO:tasks.workunit.client.1.smithi150.stdout:2/197: mknod d0/d3/d11/d1d/d38/c47 0 2023-12-05T09:57:23.359 INFO:tasks.workunit.client.0.smithi100.stdout:2/353: read d7/da/d18/d21/f40 [821931,23882] 0 2023-12-05T09:57:23.360 INFO:tasks.workunit.client.0.smithi100.stdout:5/246: symlink d0/d16/d37/l56 0 2023-12-05T09:57:23.361 INFO:tasks.workunit.client.1.smithi150.stdout:8/171: write d0/d8/d14/d1b/f2b [932830,29164] 0 2023-12-05T09:57:23.362 INFO:tasks.workunit.client.1.smithi150.stdout:0/183: dwrite d5/d11/f21 [0,4194304] 0 2023-12-05T09:57:23.363 INFO:tasks.workunit.client.1.smithi150.stdout:0/184: truncate d5/d11/f24 291901 0 2023-12-05T09:57:23.363 INFO:tasks.workunit.client.1.smithi150.stdout:0/185: stat d5/d11/f26 0 2023-12-05T09:57:23.367 INFO:tasks.workunit.client.0.smithi100.stdout:6/556: creat d7/d11/d1a/db1/fb4 x:0 0 0 2023-12-05T09:57:23.367 INFO:tasks.workunit.client.1.smithi150.stdout:7/165: dread d2/f12 [0,4194304] 0 2023-12-05T09:57:23.368 INFO:tasks.workunit.client.0.smithi100.stdout:2/354: dread d7/da/d18/d21/f44 [0,4194304] 0 2023-12-05T09:57:23.368 INFO:tasks.workunit.client.0.smithi100.stdout:2/355: stat d7/da/dc 0 2023-12-05T09:57:23.369 INFO:tasks.workunit.client.0.smithi100.stdout:2/356: write d7/da/d13/f4a [2712666,16743] 0 2023-12-05T09:57:23.370 INFO:tasks.workunit.client.1.smithi150.stdout:9/166: rename d3/l8 to d3/d9/l30 0 2023-12-05T09:57:23.370 INFO:tasks.workunit.client.1.smithi150.stdout:9/167: write d3/d9/f1c [770711,128525] 0 2023-12-05T09:57:23.370 INFO:tasks.workunit.client.1.smithi150.stdout:9/168: truncate d3/d9/f17 5068041 0 2023-12-05T09:57:23.371 INFO:tasks.workunit.client.0.smithi100.stdout:7/164: dread d3/dc/d11/d13/de/f2b [0,4194304] 0 2023-12-05T09:57:23.371 INFO:tasks.workunit.client.0.smithi100.stdout:7/165: chown d3/dc/d11/d13/d37 255 1 2023-12-05T09:57:23.373 INFO:tasks.workunit.client.0.smithi100.stdout:1/240: dwrite db/d12/f16 [0,4194304] 0 2023-12-05T09:57:23.376 INFO:tasks.workunit.client.1.smithi150.stdout:2/198: write d0/d3/d11/f18 [266115,36328] 0 2023-12-05T09:57:23.377 INFO:tasks.workunit.client.1.smithi150.stdout:1/216: mkdir d6/d47/d4c 0 2023-12-05T09:57:23.380 INFO:tasks.workunit.client.1.smithi150.stdout:3/191: mknod d6/d19/d30/c40 0 2023-12-05T09:57:23.380 INFO:tasks.workunit.client.1.smithi150.stdout:3/192: write d6/f20 [258928,1381] 0 2023-12-05T09:57:23.380 INFO:tasks.workunit.client.1.smithi150.stdout:3/193: dread - d6/d22/f31 zero size 2023-12-05T09:57:23.385 INFO:tasks.workunit.client.1.smithi150.stdout:5/183: link d1/d3/d1e/c27 d1/d3/c43 0 2023-12-05T09:57:23.386 INFO:tasks.workunit.client.0.smithi100.stdout:3/273: creat d0/d2/f56 x:0 0 0 2023-12-05T09:57:23.386 INFO:tasks.workunit.client.0.smithi100.stdout:3/274: chown d0/d4/c1c 808162163 1 2023-12-05T09:57:23.388 INFO:tasks.workunit.client.1.smithi150.stdout:7/166: write d2/d4/ff [1629132,94688] 0 2023-12-05T09:57:23.390 INFO:tasks.workunit.client.1.smithi150.stdout:8/172: rmdir d0/d8/d14 39 2023-12-05T09:57:23.391 INFO:tasks.workunit.client.1.smithi150.stdout:0/186: rename d5/d11/f18 to d5/d11/d16/d27/f3c 0 2023-12-05T09:57:23.402 INFO:tasks.workunit.client.1.smithi150.stdout:3/194: mknod d6/d9/c41 0 2023-12-05T09:57:23.402 INFO:tasks.workunit.client.1.smithi150.stdout:2/199: dread d0/d3/d5/d10/f19 [0,4194304] 0 2023-12-05T09:57:23.402 INFO:tasks.workunit.client.1.smithi150.stdout:2/200: dread - d0/d3/d5/f40 zero size 2023-12-05T09:57:23.406 INFO:tasks.workunit.client.0.smithi100.stdout:3/275: write d0/d4/f1e [1132239,39937] 0 2023-12-05T09:57:23.406 INFO:tasks.workunit.client.0.smithi100.stdout:3/276: creat d0/d10/d39/f57 x:0 0 0 2023-12-05T09:57:23.406 INFO:tasks.workunit.client.0.smithi100.stdout:3/277: readlink d0/l4b 0 2023-12-05T09:57:23.406 INFO:tasks.workunit.client.0.smithi100.stdout:5/247: dwrite d0/d4/d14/f38 [0,4194304] 0 2023-12-05T09:57:23.406 INFO:tasks.workunit.client.1.smithi150.stdout:6/154: sync 2023-12-05T09:57:23.407 INFO:tasks.workunit.client.1.smithi150.stdout:4/130: sync 2023-12-05T09:57:23.407 INFO:tasks.workunit.client.1.smithi150.stdout:4/131: dread - d0/d11/f25 zero size 2023-12-05T09:57:23.408 INFO:tasks.workunit.client.1.smithi150.stdout:5/184: truncate d1/d3/fb 2569413 0 2023-12-05T09:57:23.408 INFO:tasks.workunit.client.1.smithi150.stdout:0/187: dread d5/d11/d16/d1f/f2e [0,4194304] 0 2023-12-05T09:57:23.409 INFO:tasks.workunit.client.1.smithi150.stdout:0/188: readlink d5/d11/l12 0 2023-12-05T09:57:23.413 INFO:tasks.workunit.client.1.smithi150.stdout:4/132: write d0/d11/f15 [232748,80963] 0 2023-12-05T09:57:23.414 INFO:tasks.workunit.client.1.smithi150.stdout:8/173: truncate d0/ff 68964 0 2023-12-05T09:57:23.414 INFO:tasks.workunit.client.1.smithi150.stdout:8/174: truncate d0/f19 8739205 0 2023-12-05T09:57:23.415 INFO:tasks.workunit.client.1.smithi150.stdout:8/175: rename d0/d8/d14/d1b to d0/d8/d14/d1b/d24/d2e/d30/d35 22 2023-12-05T09:57:23.417 INFO:tasks.workunit.client.1.smithi150.stdout:1/217: mknod d6/c4d 0 2023-12-05T09:57:23.420 INFO:tasks.workunit.client.1.smithi150.stdout:3/195: truncate d6/d19/f3f 3904415 0 2023-12-05T09:57:23.420 INFO:tasks.workunit.client.1.smithi150.stdout:3/196: readlink l3 0 2023-12-05T09:57:23.420 INFO:tasks.workunit.client.1.smithi150.stdout:3/197: dread - d6/d25/d28/f3a zero size 2023-12-05T09:57:23.421 INFO:tasks.workunit.client.0.smithi100.stdout:2/357: symlink d7/da/d18/d21/d4d/l7d 0 2023-12-05T09:57:23.421 INFO:tasks.workunit.client.0.smithi100.stdout:2/358: creat d7/da/d18/d21/f7e x:0 0 0 2023-12-05T09:57:23.421 INFO:tasks.workunit.client.0.smithi100.stdout:2/359: write d7/da/f6f [166936,46915] 0 2023-12-05T09:57:23.424 INFO:tasks.workunit.client.0.smithi100.stdout:7/166: mknod d3/dc/d11/c39 0 2023-12-05T09:57:23.424 INFO:tasks.workunit.client.0.smithi100.stdout:7/167: fsync d3/dc/d11/f1e 0 2023-12-05T09:57:23.424 INFO:tasks.workunit.client.0.smithi100.stdout:7/168: creat d3/dc/f3a x:0 0 0 2023-12-05T09:57:23.425 INFO:tasks.workunit.client.0.smithi100.stdout:1/241: dwrite db/d12/f1d [4194304,4194304] 0 2023-12-05T09:57:23.425 INFO:tasks.workunit.client.0.smithi100.stdout:1/242: fsync db/d12/f14 0 2023-12-05T09:57:23.425 INFO:tasks.workunit.client.0.smithi100.stdout:1/243: write db/d12/f45 [617584,25233] 0 2023-12-05T09:57:23.425 INFO:tasks.workunit.client.0.smithi100.stdout:1/244: fsync db/f1a 0 2023-12-05T09:57:23.426 INFO:tasks.workunit.client.1.smithi150.stdout:2/201: rename d0/d3/d5/d37 to d0/d3/d5/d48 0 2023-12-05T09:57:23.426 INFO:tasks.workunit.client.1.smithi150.stdout:6/155: truncate d2/f13 3927726 0 2023-12-05T09:57:23.426 INFO:tasks.workunit.client.1.smithi150.stdout:2/202: dread - d0/d3/d5/f40 zero size 2023-12-05T09:57:23.426 INFO:tasks.workunit.client.1.smithi150.stdout:2/203: truncate d0/d3/d5/f40 894749 0 2023-12-05T09:57:23.426 INFO:tasks.workunit.client.1.smithi150.stdout:6/156: write d2/da/f27 [3699757,1393] 0 2023-12-05T09:57:23.426 INFO:tasks.workunit.client.1.smithi150.stdout:2/204: stat d0/d3/d5/d10/f20 0 2023-12-05T09:57:23.428 INFO:tasks.workunit.client.1.smithi150.stdout:0/189: creat d5/d11/d16/d27/f3d x:0 0 0 2023-12-05T09:57:23.497 INFO:tasks.workunit.client.0.smithi100.stdout:9/266: rename d7/d1b/d22/d25 to d7/d1b/d22/d2a/d56 0 2023-12-05T09:57:23.497 INFO:tasks.workunit.client.0.smithi100.stdout:9/267: chown d7/d1b/d22/f4a 100600215 1 2023-12-05T09:57:23.497 INFO:tasks.workunit.client.0.smithi100.stdout:3/278: mkdir d0/d2/de/d11/d58 0 2023-12-05T09:57:23.497 INFO:tasks.workunit.client.0.smithi100.stdout:5/248: link d0/d4/fa d0/d27/f57 0 2023-12-05T09:57:23.497 INFO:tasks.workunit.client.0.smithi100.stdout:1/245: dread db/d12/f18 [0,4194304] 0 2023-12-05T09:57:23.498 INFO:tasks.workunit.client.0.smithi100.stdout:6/557: getdents d7/d2d/d6a 0 2023-12-05T09:57:23.498 INFO:tasks.workunit.client.0.smithi100.stdout:6/558: creat d7/d27/fb5 x:0 0 0 2023-12-05T09:57:23.498 INFO:tasks.workunit.client.0.smithi100.stdout:6/559: truncate d7/d11/d82/f9f 721530 0 2023-12-05T09:57:23.498 INFO:tasks.workunit.client.0.smithi100.stdout:2/360: mknod d7/da/d13/d69/c7f 0 2023-12-05T09:57:23.498 INFO:tasks.workunit.client.0.smithi100.stdout:1/246: dread db/d12/f45 [0,4194304] 0 2023-12-05T09:57:23.498 INFO:tasks.workunit.client.0.smithi100.stdout:7/169: mkdir d3/dc/d11/d13/de/d18/d3b 0 2023-12-05T09:57:23.498 INFO:tasks.workunit.client.0.smithi100.stdout:9/268: link c3 d7/d1b/d22/d2a/d56/d2e/c57 0 2023-12-05T09:57:23.498 INFO:tasks.workunit.client.0.smithi100.stdout:3/279: link d0/f3b d0/d2/f59 0 2023-12-05T09:57:23.498 INFO:tasks.workunit.client.0.smithi100.stdout:6/560: dwrite d7/d27/fb5 [0,4194304] 0 2023-12-05T09:57:23.499 INFO:tasks.workunit.client.0.smithi100.stdout:6/561: write d7/d11/d1a/f9b [439599,200] 0 2023-12-05T09:57:23.499 INFO:tasks.workunit.client.0.smithi100.stdout:6/562: chown d7/d27/d35/l3d 29765018 1 2023-12-05T09:57:23.499 INFO:tasks.workunit.client.0.smithi100.stdout:5/249: creat d0/d1b/d4d/f58 x:0 0 0 2023-12-05T09:57:23.499 INFO:tasks.workunit.client.0.smithi100.stdout:5/250: stat d0/d1f/f4c 0 2023-12-05T09:57:23.499 INFO:tasks.workunit.client.0.smithi100.stdout:5/251: creat d0/f59 x:0 0 0 2023-12-05T09:57:23.502 INFO:tasks.workunit.client.1.smithi150.stdout:4/133: link d0/fd d0/f28 0 2023-12-05T09:57:23.502 INFO:tasks.workunit.client.1.smithi150.stdout:6/157: mknod d2/d23/d2e/c35 0 2023-12-05T09:57:23.502 INFO:tasks.workunit.client.1.smithi150.stdout:5/185: dread d1/d3/d6/f10 [0,4194304] 0 2023-12-05T09:57:23.502 INFO:tasks.workunit.client.1.smithi150.stdout:2/205: truncate d0/d3/d5/d10/f19 943009 0 2023-12-05T09:57:23.502 INFO:tasks.workunit.client.1.smithi150.stdout:0/190: rmdir d5/d11/d28 0 2023-12-05T09:57:23.502 INFO:tasks.workunit.client.1.smithi150.stdout:4/134: mknod d0/d11/c29 0 2023-12-05T09:57:23.503 INFO:tasks.workunit.client.1.smithi150.stdout:6/158: rename d2/da/c16 to d2/c36 0 2023-12-05T09:57:23.503 INFO:tasks.workunit.client.1.smithi150.stdout:6/159: stat d2/da/fe 0 2023-12-05T09:57:23.503 INFO:tasks.workunit.client.1.smithi150.stdout:6/160: creat d2/d23/f37 x:0 0 0 2023-12-05T09:57:23.503 INFO:tasks.workunit.client.1.smithi150.stdout:5/186: dread d1/d3/f1d [0,4194304] 0 2023-12-05T09:57:23.503 INFO:tasks.workunit.client.1.smithi150.stdout:6/161: read d2/f1c [1397103,101429] 0 2023-12-05T09:57:23.503 INFO:tasks.workunit.client.1.smithi150.stdout:6/162: write d2/da/f10 [2922900,52127] 0 2023-12-05T09:57:23.503 INFO:tasks.workunit.client.1.smithi150.stdout:6/163: fdatasync d2/f2c 0 2023-12-05T09:57:23.503 INFO:tasks.workunit.client.1.smithi150.stdout:7/167: dwrite d2/d4/f27 [0,4194304] 0 2023-12-05T09:57:23.503 INFO:tasks.workunit.client.1.smithi150.stdout:0/191: symlink d5/d11/d32/l3e 0 2023-12-05T09:57:23.503 INFO:tasks.workunit.client.1.smithi150.stdout:8/176: dwrite d0/f16 [0,4194304] 0 2023-12-05T09:57:23.504 INFO:tasks.workunit.client.1.smithi150.stdout:1/218: dwrite d6/d8/db/de/f13 [4194304,4194304] 0 2023-12-05T09:57:23.504 INFO:tasks.workunit.client.1.smithi150.stdout:4/135: unlink d0/d11/f25 0 2023-12-05T09:57:23.504 INFO:tasks.workunit.client.1.smithi150.stdout:5/187: symlink d1/d3/d1e/d21/d3b/l44 0 2023-12-05T09:57:23.504 INFO:tasks.workunit.client.1.smithi150.stdout:5/188: fsync d1/d3/d6/f8 0 2023-12-05T09:57:23.504 INFO:tasks.workunit.client.1.smithi150.stdout:5/189: write d1/d3/fb [2217034,34426] 0 2023-12-05T09:57:23.504 INFO:tasks.workunit.client.1.smithi150.stdout:5/190: dread - d1/d3/d6/d26/f3e zero size 2023-12-05T09:57:23.504 INFO:tasks.workunit.client.1.smithi150.stdout:5/191: truncate d1/d3/d6/d1b/d22/f32 604164 0 2023-12-05T09:57:23.504 INFO:tasks.workunit.client.1.smithi150.stdout:2/206: rmdir d0/d3/d5 39 2023-12-05T09:57:23.504 INFO:tasks.workunit.client.1.smithi150.stdout:2/207: fsync d0/d3/d5/d10/f45 0 2023-12-05T09:57:23.504 INFO:tasks.workunit.client.1.smithi150.stdout:2/208: fsync d0/d3/d11/f18 0 2023-12-05T09:57:23.505 INFO:tasks.workunit.client.1.smithi150.stdout:2/209: creat d0/f49 x:0 0 0 2023-12-05T09:57:23.505 INFO:tasks.workunit.client.1.smithi150.stdout:1/219: write d6/d8/f27 [2898029,16650] 0 2023-12-05T09:57:23.505 INFO:tasks.workunit.client.1.smithi150.stdout:1/220: chown d6/d38/d4a 759 1 2023-12-05T09:57:23.505 INFO:tasks.workunit.client.1.smithi150.stdout:6/164: unlink d2/d23/d2e/f32 0 2023-12-05T09:57:23.505 INFO:tasks.workunit.client.1.smithi150.stdout:7/168: mknod d2/db/d30/d18/d1a/d1e/d2b/c32 0 2023-12-05T09:57:23.505 INFO:tasks.workunit.client.1.smithi150.stdout:7/169: readlink d2/d4/l7 0 2023-12-05T09:57:23.505 INFO:tasks.workunit.client.1.smithi150.stdout:7/170: write d2/d4/fc [7047393,11381] 0 2023-12-05T09:57:23.506 INFO:tasks.workunit.client.0.smithi100.stdout:1/247: mkdir db/d31/d3a/d4a 0 2023-12-05T09:57:23.507 INFO:tasks.workunit.client.0.smithi100.stdout:8/174: sync 2023-12-05T09:57:23.507 INFO:tasks.workunit.client.0.smithi100.stdout:4/171: sync 2023-12-05T09:57:23.507 INFO:tasks.workunit.client.0.smithi100.stdout:8/175: write d0/fc [2833920,61936] 0 2023-12-05T09:57:23.507 INFO:tasks.workunit.client.0.smithi100.stdout:8/176: dread - d0/d12/d13/f25 zero size 2023-12-05T09:57:23.507 INFO:tasks.workunit.client.0.smithi100.stdout:7/170: truncate d3/dc/f14 1775623 0 2023-12-05T09:57:23.507 INFO:tasks.workunit.client.0.smithi100.stdout:4/172: read de/f13 [364240,12981] 0 2023-12-05T09:57:23.507 INFO:tasks.workunit.client.0.smithi100.stdout:3/280: dread d0/d2/de/d11/f21 [0,4194304] 0 2023-12-05T09:57:23.510 INFO:tasks.workunit.client.0.smithi100.stdout:3/281: truncate d0/d4/f4a 244680 0 2023-12-05T09:57:23.511 INFO:tasks.workunit.client.0.smithi100.stdout:3/282: write d0/d10/d39/f55 [1020304,127594] 0 2023-12-05T09:57:23.511 INFO:tasks.workunit.client.0.smithi100.stdout:3/283: fdatasync d0/d3d/f53 0 2023-12-05T09:57:23.511 INFO:tasks.workunit.client.0.smithi100.stdout:3/284: truncate d0/d4/d3a/d45/f50 437793 0 2023-12-05T09:57:23.511 INFO:tasks.workunit.client.0.smithi100.stdout:9/269: link d7/d20/c4b d7/d1b/d22/d51/d32/c58 0 2023-12-05T09:57:23.511 INFO:tasks.workunit.client.0.smithi100.stdout:3/285: fsync d0/d4/d3a/d45/f50 0 2023-12-05T09:57:23.518 INFO:tasks.workunit.client.0.smithi100.stdout:5/252: creat d0/d1f/d53/f5a x:0 0 0 2023-12-05T09:57:23.519 INFO:tasks.workunit.client.0.smithi100.stdout:8/177: fdatasync d0/fc 0 2023-12-05T09:57:23.519 INFO:tasks.workunit.client.0.smithi100.stdout:8/178: readlink d0/l4 0 2023-12-05T09:57:23.520 INFO:tasks.workunit.client.1.smithi150.stdout:5/192: dwrite d1/d3/f7 [0,4194304] 0 2023-12-05T09:57:23.524 INFO:tasks.workunit.client.0.smithi100.stdout:1/248: creat db/d31/d3a/d3b/f4b x:0 0 0 2023-12-05T09:57:23.525 INFO:tasks.workunit.client.1.smithi150.stdout:8/177: rename d0/d8/d14/f26 to d0/d8/d14/d1b/d24/d2e/d30/f36 0 2023-12-05T09:57:23.526 INFO:tasks.workunit.client.1.smithi150.stdout:4/136: dwrite d0/ff [4194304,4194304] 0 2023-12-05T09:57:23.526 INFO:tasks.workunit.client.1.smithi150.stdout:4/137: creat d0/d11/f2a x:0 0 0 2023-12-05T09:57:23.526 INFO:tasks.workunit.client.1.smithi150.stdout:4/138: chown d0/fd 5575 1 2023-12-05T09:57:23.527 INFO:tasks.workunit.client.0.smithi100.stdout:4/173: mkdir de/d16/d23/d33 0 2023-12-05T09:57:23.527 INFO:tasks.workunit.client.0.smithi100.stdout:4/174: creat de/d16/d23/f34 x:0 0 0 2023-12-05T09:57:23.527 INFO:tasks.workunit.client.0.smithi100.stdout:4/175: stat de/d1d/f31 0 2023-12-05T09:57:23.532 INFO:tasks.workunit.client.1.smithi150.stdout:1/221: mknod d6/d8/db/d1b/c4e 0 2023-12-05T09:57:23.532 INFO:tasks.workunit.client.1.smithi150.stdout:1/222: chown d6/l45 0 1 2023-12-05T09:57:23.537 INFO:tasks.workunit.client.0.smithi100.stdout:3/286: mknod d0/d2/de/d11/d58/c5a 0 2023-12-05T09:57:23.541 INFO:tasks.workunit.client.0.smithi100.stdout:5/253: rename d0/d16/d2b/d48/df/f26 to d0/d4/d14/f5b 0 2023-12-05T09:57:23.542 INFO:tasks.workunit.client.0.smithi100.stdout:5/254: stat d0/d4/d14/l41 0 2023-12-05T09:57:23.543 INFO:tasks.workunit.client.0.smithi100.stdout:0/245: sync 2023-12-05T09:57:23.543 INFO:tasks.workunit.client.0.smithi100.stdout:0/246: dread - da/d2a/d45/f49 zero size 2023-12-05T09:57:23.551 INFO:tasks.workunit.client.1.smithi150.stdout:5/193: symlink d1/d3/d6/l45 0 2023-12-05T09:57:23.551 INFO:tasks.workunit.client.0.smithi100.stdout:8/179: mknod d0/d12/d13/d16/c28 0 2023-12-05T09:57:23.553 INFO:tasks.workunit.client.0.smithi100.stdout:9/270: dwrite d7/f8 [0,4194304] 0 2023-12-05T09:57:23.553 INFO:tasks.workunit.client.0.smithi100.stdout:9/271: read d7/d20/f3c [3203832,39697] 0 2023-12-05T09:57:23.553 INFO:tasks.workunit.client.0.smithi100.stdout:9/272: fsync d7/d1b/d22/d2a/f48 0 2023-12-05T09:57:23.553 INFO:tasks.workunit.client.0.smithi100.stdout:9/273: creat d7/d35/f59 x:0 0 0 2023-12-05T09:57:23.554 INFO:tasks.workunit.client.0.smithi100.stdout:6/563: write d7/d27/fb5 [5039617,96420] 0 2023-12-05T09:57:23.556 INFO:tasks.workunit.client.1.smithi150.stdout:2/210: rename d0/d3/d5/d22/c2a to d0/d3/d5/c4a 0 2023-12-05T09:57:23.558 INFO:tasks.workunit.client.0.smithi100.stdout:7/171: link d3/dc/d11/d13/de/f22 d3/dc/d11/d13/f3c 0 2023-12-05T09:57:23.562 INFO:tasks.workunit.client.0.smithi100.stdout:0/247: write da/d2a/f3f [486599,18129] 0 2023-12-05T09:57:23.563 INFO:tasks.workunit.client.0.smithi100.stdout:3/287: mknod d0/d10/c5b 0 2023-12-05T09:57:23.568 INFO:tasks.workunit.client.0.smithi100.stdout:1/249: rename db/d12/d1e/d26/f27 to db/d31/d3a/f4c 0 2023-12-05T09:57:23.575 INFO:tasks.workunit.client.1.smithi150.stdout:4/139: link d0/f20 d0/d11/f2b 0 2023-12-05T09:57:23.576 INFO:tasks.workunit.client.0.smithi100.stdout:9/274: mknod d7/d1b/d22/d51/d32/c5a 0 2023-12-05T09:57:23.577 INFO:tasks.workunit.client.1.smithi150.stdout:1/223: symlink d6/d38/d4a/l4f 0 2023-12-05T09:57:23.584 INFO:tasks.workunit.client.1.smithi150.stdout:0/192: rename d5/d11/d16/d27 to d5/d11/d16/d3f 0 2023-12-05T09:57:23.584 INFO:tasks.workunit.client.1.smithi150.stdout:0/193: chown d5/d11/l35 7 1 2023-12-05T09:57:23.584 INFO:tasks.workunit.client.1.smithi150.stdout:5/194: symlink d1/d3/d38/l46 0 2023-12-05T09:57:23.584 INFO:tasks.workunit.client.1.smithi150.stdout:5/195: truncate d1/d3/d6/d1b/d22/d24/f41 369175 0 2023-12-05T09:57:23.592 INFO:tasks.workunit.client.0.smithi100.stdout:7/172: symlink d3/dc/d11/d33/l3d 0 2023-12-05T09:57:23.592 INFO:tasks.workunit.client.0.smithi100.stdout:0/248: symlink da/d22/d33/d35/l4e 0 2023-12-05T09:57:23.592 INFO:tasks.workunit.client.0.smithi100.stdout:0/249: write da/f11 [9988910,2744] 0 2023-12-05T09:57:23.592 INFO:tasks.workunit.client.0.smithi100.stdout:0/250: fdatasync da/d22/f3b 0 2023-12-05T09:57:23.593 INFO:tasks.workunit.client.1.smithi150.stdout:6/165: rename d2/d23/l33 to d2/l38 0 2023-12-05T09:57:23.594 INFO:tasks.workunit.client.1.smithi150.stdout:5/196: dread d1/d3/fb [0,4194304] 0 2023-12-05T09:57:23.595 INFO:tasks.workunit.client.1.smithi150.stdout:4/140: dread d0/f8 [4194304,4194304] 0 2023-12-05T09:57:23.595 INFO:tasks.workunit.client.1.smithi150.stdout:5/197: chown d1/d3/d6/d26/c2d 24442407 1 2023-12-05T09:57:23.595 INFO:tasks.workunit.client.1.smithi150.stdout:5/198: truncate d1/d3/d6/d1b/d22/d24/f41 1078181 0 2023-12-05T09:57:23.595 INFO:tasks.workunit.client.0.smithi100.stdout:3/288: mkdir d0/d3d/d5c 0 2023-12-05T09:57:23.598 INFO:tasks.workunit.client.1.smithi150.stdout:8/178: dwrite d0/d8/d14/d1b/f1c [0,4194304] 0 2023-12-05T09:57:23.598 INFO:tasks.workunit.client.1.smithi150.stdout:2/211: mknod d0/d3/c4b 0 2023-12-05T09:57:23.598 INFO:tasks.workunit.client.1.smithi150.stdout:2/212: chown d0/lc 346 1 2023-12-05T09:57:23.600 INFO:tasks.workunit.client.1.smithi150.stdout:1/224: fsync d6/d8/db/de/ff 0 2023-12-05T09:57:23.603 INFO:tasks.workunit.client.0.smithi100.stdout:5/255: rmdir d0/d27 39 2023-12-05T09:57:23.607 INFO:tasks.workunit.client.1.smithi150.stdout:0/194: symlink d5/d11/d16/l40 0 2023-12-05T09:57:23.612 INFO:tasks.workunit.client.0.smithi100.stdout:4/176: rename de/l22 to de/d16/d23/l35 0 2023-12-05T09:57:23.614 INFO:tasks.workunit.client.1.smithi150.stdout:4/141: mkdir d0/d11/d2c 0 2023-12-05T09:57:23.620 INFO:tasks.workunit.client.0.smithi100.stdout:1/250: symlink db/d12/d1e/d26/d39/l4d 0 2023-12-05T09:57:23.623 INFO:tasks.workunit.client.1.smithi150.stdout:3/198: sync 2023-12-05T09:57:23.623 INFO:tasks.workunit.client.1.smithi150.stdout:9/169: sync 2023-12-05T09:57:23.623 INFO:tasks.workunit.client.1.smithi150.stdout:3/199: truncate d6/d9/f1b 1629268 0 2023-12-05T09:57:23.623 INFO:tasks.workunit.client.1.smithi150.stdout:9/170: creat d3/d9/f31 x:0 0 0 2023-12-05T09:57:23.624 INFO:tasks.workunit.client.1.smithi150.stdout:2/213: write d0/d3/f14 [1580926,19312] 0 2023-12-05T09:57:23.627 INFO:tasks.workunit.client.0.smithi100.stdout:6/564: truncate d7/d11/f6d 654333 0 2023-12-05T09:57:23.628 INFO:tasks.workunit.client.1.smithi150.stdout:7/171: sync 2023-12-05T09:57:23.628 INFO:tasks.workunit.client.1.smithi150.stdout:7/172: chown d2/d4/fc 29 1 2023-12-05T09:57:23.628 INFO:tasks.workunit.client.1.smithi150.stdout:7/173: chown d2/db/d30/d18/d1a/d1e/d2b/c32 63275822 1 2023-12-05T09:57:23.641 INFO:tasks.workunit.client.0.smithi100.stdout:5/256: getdents d0/d4/d14/d35 0 2023-12-05T09:57:23.641 INFO:tasks.workunit.client.0.smithi100.stdout:7/173: mkdir d3/dc/d11/d13/de/d2d/d3e 0 2023-12-05T09:57:23.642 INFO:tasks.workunit.client.1.smithi150.stdout:1/225: mknod d6/d8/db/d1b/c50 0 2023-12-05T09:57:23.643 INFO:tasks.workunit.client.0.smithi100.stdout:8/180: dwrite d0/f3 [4194304,4194304] 0 2023-12-05T09:57:23.643 INFO:tasks.workunit.client.0.smithi100.stdout:8/181: read - d0/d12/d13/d16/d22/f26 zero size 2023-12-05T09:57:23.653 INFO:tasks.workunit.client.0.smithi100.stdout:6/565: write d7/f59 [821284,64153] 0 2023-12-05T09:57:23.653 INFO:tasks.workunit.client.0.smithi100.stdout:6/566: creat d7/d11/d1a/db1/fb6 x:0 0 0 2023-12-05T09:57:23.654 INFO:tasks.workunit.client.1.smithi150.stdout:4/142: rmdir d0/d11/d2c 0 2023-12-05T09:57:23.654 INFO:tasks.workunit.client.1.smithi150.stdout:2/214: write d0/d3/d11/d1d/f2f [1021949,25218] 0 2023-12-05T09:57:23.654 INFO:tasks.workunit.client.1.smithi150.stdout:9/171: getdents d3/d1b 0 2023-12-05T09:57:23.654 INFO:tasks.workunit.client.1.smithi150.stdout:4/143: write d0/d11/f2a [704807,90986] 0 2023-12-05T09:57:23.657 INFO:tasks.workunit.client.0.smithi100.stdout:5/257: symlink d0/d1f/l5c 0 2023-12-05T09:57:23.660 INFO:tasks.workunit.client.1.smithi150.stdout:4/144: dread d0/f24 [0,4194304] 0 2023-12-05T09:57:23.660 INFO:tasks.workunit.client.1.smithi150.stdout:7/174: symlink d2/db/d17/d20/l33 0 2023-12-05T09:57:23.661 INFO:tasks.workunit.client.0.smithi100.stdout:7/174: link d3/dc/d11/d13/f15 d3/dc/d11/d33/f3f 0 2023-12-05T09:57:23.663 INFO:tasks.workunit.client.1.smithi150.stdout:8/179: symlink d0/d8/d14/d1b/l37 0 2023-12-05T09:57:23.665 INFO:tasks.workunit.client.0.smithi100.stdout:8/182: link d0/d12/l15 d0/d12/d13/d16/d22/d24/l29 0 2023-12-05T09:57:23.669 INFO:tasks.workunit.client.0.smithi100.stdout:3/289: rename d0/d2/de/d12/c31 to d0/d4/d3a/c5d 0 2023-12-05T09:57:23.669 INFO:tasks.workunit.client.1.smithi150.stdout:1/226: mknod d6/d8/db/d1b/c51 0 2023-12-05T09:57:23.669 INFO:tasks.workunit.client.1.smithi150.stdout:3/200: mkdir d6/d42 0 2023-12-05T09:57:23.670 INFO:tasks.workunit.client.1.smithi150.stdout:3/201: write d6/d9/f1d [4325044,70995] 0 2023-12-05T09:57:23.672 INFO:tasks.workunit.client.1.smithi150.stdout:2/215: rmdir d0/d3/d5/d48 0 2023-12-05T09:57:23.673 INFO:tasks.workunit.client.1.smithi150.stdout:0/195: dwrite d5/f23 [0,4194304] 0 2023-12-05T09:57:23.673 INFO:tasks.workunit.client.1.smithi150.stdout:0/196: fdatasync d5/d11/f21 0 2023-12-05T09:57:23.673 INFO:tasks.workunit.client.1.smithi150.stdout:0/197: creat d5/f41 x:0 0 0 2023-12-05T09:57:23.674 INFO:tasks.workunit.client.1.smithi150.stdout:9/172: creat d3/d1b/f32 x:0 0 0 2023-12-05T09:57:23.675 INFO:tasks.workunit.client.0.smithi100.stdout:7/175: unlink d3/dc/d11/d13/de/f35 0 2023-12-05T09:57:23.675 INFO:tasks.workunit.client.0.smithi100.stdout:7/176: truncate d3/dc/d11/d13/f30 611995 0 2023-12-05T09:57:23.676 INFO:tasks.workunit.client.1.smithi150.stdout:7/175: creat d2/db/d30/d18/d1a/d1e/d2b/f34 x:0 0 0 2023-12-05T09:57:23.676 INFO:tasks.workunit.client.1.smithi150.stdout:7/176: write d2/f25 [3348921,102789] 0 2023-12-05T09:57:23.676 INFO:tasks.workunit.client.1.smithi150.stdout:7/177: fdatasync d2/db/d30/d13/f14 0 2023-12-05T09:57:23.680 INFO:tasks.workunit.client.0.smithi100.stdout:8/183: link d0/d12/d13/d16/f20 d0/d12/f2a 0 2023-12-05T09:57:23.680 INFO:tasks.workunit.client.0.smithi100.stdout:8/184: creat d0/f2b x:0 0 0 2023-12-05T09:57:23.682 INFO:tasks.workunit.client.0.smithi100.stdout:9/275: dwrite d7/fb [0,4194304] 0 2023-12-05T09:57:23.683 INFO:tasks.workunit.client.0.smithi100.stdout:3/290: truncate d0/d10/d39/f55 223335 0 2023-12-05T09:57:23.685 INFO:tasks.workunit.client.1.smithi150.stdout:3/202: unlink d6/f2a 0 2023-12-05T09:57:23.694 INFO:tasks.workunit.client.1.smithi150.stdout:0/198: symlink d5/d11/d32/d37/l42 0 2023-12-05T09:57:23.694 INFO:tasks.workunit.client.1.smithi150.stdout:0/199: fdatasync d5/fa 0 2023-12-05T09:57:23.694 INFO:tasks.workunit.client.1.smithi150.stdout:0/200: rename d5 to d5/d11/d16/d3f/d3b/d43 22 2023-12-05T09:57:23.694 INFO:tasks.workunit.client.1.smithi150.stdout:4/145: write d0/d11/f12 [4159504,103827] 0 2023-12-05T09:57:23.694 INFO:tasks.workunit.client.1.smithi150.stdout:4/146: chown d0/d11 16182105 1 2023-12-05T09:57:23.694 INFO:tasks.workunit.client.1.smithi150.stdout:4/147: truncate d0/f24 655581 0 2023-12-05T09:57:23.694 INFO:tasks.workunit.client.1.smithi150.stdout:7/178: creat d2/d1b/f35 x:0 0 0 2023-12-05T09:57:23.694 INFO:tasks.workunit.client.1.smithi150.stdout:7/179: write d2/db/d30/d18/d1a/d1e/d2b/f34 [1022343,111157] 0 2023-12-05T09:57:23.695 INFO:tasks.workunit.client.1.smithi150.stdout:3/203: mkdir d6/d9/d43 0 2023-12-05T09:57:23.696 INFO:tasks.workunit.client.0.smithi100.stdout:5/258: dread d0/d4/d14/f5b [0,4194304] 0 2023-12-05T09:57:23.698 INFO:tasks.workunit.client.1.smithi150.stdout:5/199: dwrite d1/d3/d6/f8 [4194304,4194304] 0 2023-12-05T09:57:23.698 INFO:tasks.workunit.client.1.smithi150.stdout:5/200: readlink d1/d3/d6/d1b/d22/d24/l33 0 2023-12-05T09:57:23.700 INFO:tasks.workunit.client.0.smithi100.stdout:8/185: dread d0/fd [0,4194304] 0 2023-12-05T09:57:23.700 INFO:tasks.workunit.client.1.smithi150.stdout:8/180: dread d0/d8/d14/d1b/f2b [0,4194304] 0 2023-12-05T09:57:23.701 INFO:tasks.workunit.client.1.smithi150.stdout:9/173: dread d3/d9/f1c [0,4194304] 0 2023-12-05T09:57:23.702 INFO:tasks.workunit.client.1.smithi150.stdout:3/204: link d6/f1f d6/d42/f44 0 2023-12-05T09:57:23.702 INFO:tasks.workunit.client.1.smithi150.stdout:3/205: chown d6/d22/f31 154323973 1 2023-12-05T09:57:23.702 INFO:tasks.workunit.client.0.smithi100.stdout:6/567: dread d7/d27/d97/fb2 [0,4194304] 0 2023-12-05T09:57:23.702 INFO:tasks.workunit.client.0.smithi100.stdout:6/568: truncate d7/d2d/f48 287627 0 2023-12-05T09:57:23.708 INFO:tasks.workunit.client.0.smithi100.stdout:5/259: rename d0/d16/f3b to d0/d16/d2b/d48/f5d 0 2023-12-05T09:57:23.708 INFO:tasks.workunit.client.0.smithi100.stdout:5/260: truncate d0/d16/d2b/d48/f12 1669817 0 2023-12-05T09:57:23.709 INFO:tasks.workunit.client.1.smithi150.stdout:0/201: dread d5/d11/f26 [0,4194304] 0 2023-12-05T09:57:23.709 INFO:tasks.workunit.client.1.smithi150.stdout:7/180: write d2/db/f26 [846824,112890] 0 2023-12-05T09:57:23.712 INFO:tasks.workunit.client.0.smithi100.stdout:6/569: mkdir d7/d11/d1a/db7 0 2023-12-05T09:57:23.713 INFO:tasks.workunit.client.0.smithi100.stdout:6/570: getdents d7/d11/d1a/db7 0 2023-12-05T09:57:23.713 INFO:tasks.workunit.client.0.smithi100.stdout:6/571: write d7/d2d/d6a/f95 [3079,42685] 0 2023-12-05T09:57:23.714 INFO:tasks.workunit.client.1.smithi150.stdout:5/201: symlink d1/d3/d6/d26/l47 0 2023-12-05T09:57:23.715 INFO:tasks.workunit.client.1.smithi150.stdout:6/166: dwrite d2/da/f10 [0,4194304] 0 2023-12-05T09:57:23.717 INFO:tasks.workunit.client.1.smithi150.stdout:8/181: mkdir d0/d8/d14/d1b/d24/d38 0 2023-12-05T09:57:23.719 INFO:tasks.workunit.client.0.smithi100.stdout:5/261: creat d0/d27/f5e x:0 0 0 2023-12-05T09:57:23.719 INFO:tasks.workunit.client.0.smithi100.stdout:8/186: getdents d0/d12/d13/d16/d22 0 2023-12-05T09:57:23.721 INFO:tasks.workunit.client.0.smithi100.stdout:8/187: write d0/f17 [1538138,3922] 0 2023-12-05T09:57:23.721 INFO:tasks.workunit.client.0.smithi100.stdout:6/572: creat d7/d2d/d6a/d7c/fb8 x:0 0 0 2023-12-05T09:57:23.722 INFO:tasks.workunit.client.1.smithi150.stdout:9/174: creat d3/d9/dc/f33 x:0 0 0 2023-12-05T09:57:23.724 INFO:tasks.workunit.client.0.smithi100.stdout:0/251: dwrite da/d1b/f3c [0,4194304] 0 2023-12-05T09:57:23.727 INFO:tasks.workunit.client.1.smithi150.stdout:3/206: symlink d6/d9/dd/l45 0 2023-12-05T09:57:23.727 INFO:tasks.workunit.client.1.smithi150.stdout:3/207: creat d6/d19/f46 x:0 0 0 2023-12-05T09:57:23.731 INFO:tasks.workunit.client.0.smithi100.stdout:8/188: symlink d0/d12/d13/d16/d22/d24/l2c 0 2023-12-05T09:57:23.734 INFO:tasks.workunit.client.0.smithi100.stdout:6/573: mkdir d7/d11/d82/db9 0 2023-12-05T09:57:23.735 INFO:tasks.workunit.client.1.smithi150.stdout:4/148: getdents d0/d11 0 2023-12-05T09:57:23.738 INFO:tasks.workunit.client.1.smithi150.stdout:0/202: creat d5/d11/d16/d1f/f44 x:0 0 0 2023-12-05T09:57:23.739 INFO:tasks.workunit.client.0.smithi100.stdout:3/291: dwrite d0/d2/f3c [0,4194304] 0 2023-12-05T09:57:23.741 INFO:tasks.workunit.client.0.smithi100.stdout:5/262: dread d0/d4/f10 [0,4194304] 0 2023-12-05T09:57:23.742 INFO:tasks.workunit.client.1.smithi150.stdout:7/181: link d2/db/d30/d13/f1d d2/d1b/d31/f36 0 2023-12-05T09:57:23.742 INFO:tasks.workunit.client.0.smithi100.stdout:7/177: dwrite d3/dc/d11/f31 [0,4194304] 0 2023-12-05T09:57:23.742 INFO:tasks.workunit.client.0.smithi100.stdout:7/178: fdatasync d3/dc/d11/d13/f15 0 2023-12-05T09:57:23.752 INFO:tasks.workunit.client.1.smithi150.stdout:4/149: dread d0/f28 [0,4194304] 0 2023-12-05T09:57:23.753 INFO:tasks.workunit.client.1.smithi150.stdout:0/203: dread d5/d11/d16/f1e [0,4194304] 0 2023-12-05T09:57:23.753 INFO:tasks.workunit.client.1.smithi150.stdout:0/204: write d5/d11/d16/d1f/f44 [947774,22194] 0 2023-12-05T09:57:23.755 INFO:tasks.workunit.client.0.smithi100.stdout:9/276: dread d7/d1b/d22/f38 [0,4194304] 0 2023-12-05T09:57:23.755 INFO:tasks.workunit.client.0.smithi100.stdout:8/189: unlink d0/f3 0 2023-12-05T09:57:23.756 INFO:tasks.workunit.client.1.smithi150.stdout:4/150: write d0/d11/f2a [240054,53647] 0 2023-12-05T09:57:23.756 INFO:tasks.workunit.client.1.smithi150.stdout:4/151: chown d0/d11/f12 14 1 2023-12-05T09:57:23.757 INFO:tasks.workunit.client.1.smithi150.stdout:5/202: dwrite d1/d3/d6/f3f [0,4194304] 0 2023-12-05T09:57:23.766 INFO:tasks.workunit.client.0.smithi100.stdout:4/177: dwrite de/d16/d1e/f2e [0,4194304] 0 2023-12-05T09:57:23.766 INFO:tasks.workunit.client.0.smithi100.stdout:4/178: read - de/d16/d23/f34 zero size 2023-12-05T09:57:23.767 INFO:tasks.workunit.client.0.smithi100.stdout:7/179: mkdir d3/dc/d11/d13/de/d18/d3b/d40 0 2023-12-05T09:57:23.770 INFO:tasks.workunit.client.0.smithi100.stdout:1/251: dwrite db/ff [0,4194304] 0 2023-12-05T09:57:23.773 INFO:tasks.workunit.client.1.smithi150.stdout:0/205: write d5/f23 [1787538,56813] 0 2023-12-05T09:57:23.774 INFO:tasks.workunit.client.0.smithi100.stdout:5/263: dread d0/f2 [0,4194304] 0 2023-12-05T09:57:23.775 INFO:tasks.workunit.client.0.smithi100.stdout:0/252: rmdir da/d22 39 2023-12-05T09:57:23.783 INFO:tasks.workunit.client.1.smithi150.stdout:0/206: write d5/d11/f26 [2967204,112546] 0 2023-12-05T09:57:23.794 INFO:tasks.workunit.client.0.smithi100.stdout:6/574: dwrite d7/d27/d97/fb2 [0,4194304] 0 2023-12-05T09:57:23.794 INFO:tasks.workunit.client.0.smithi100.stdout:6/575: chown d7/d2d/d6a/d7c 112013574 1 2023-12-05T09:57:23.794 INFO:tasks.workunit.client.0.smithi100.stdout:8/190: rename d0/d12/d13/d16/d22/d24/l29 to d0/l2d 0 2023-12-05T09:57:23.794 INFO:tasks.workunit.client.0.smithi100.stdout:8/191: dread - d0/d12/d13/d16/f27 zero size 2023-12-05T09:57:23.796 INFO:tasks.workunit.client.1.smithi150.stdout:6/167: mkdir d2/d23/d2e/d39 0 2023-12-05T09:57:23.799 INFO:tasks.workunit.client.1.smithi150.stdout:8/182: rename d0/f19 to d0/d8/d14/d1b/d24/d34/f39 0 2023-12-05T09:57:23.803 INFO:tasks.workunit.client.1.smithi150.stdout:9/175: mkdir d3/d9/d26/d34 0 2023-12-05T09:57:23.804 INFO:tasks.workunit.client.1.smithi150.stdout:9/176: fdatasync d3/d9/f14 0 2023-12-05T09:57:23.821 INFO:tasks.workunit.client.0.smithi100.stdout:3/292: dwrite d0/d2/de/d12/f1a [4194304,4194304] 0 2023-12-05T09:57:23.826 INFO:tasks.workunit.client.1.smithi150.stdout:0/207: link d5/c15 d5/d11/d32/c45 0 2023-12-05T09:57:23.827 INFO:tasks.workunit.client.1.smithi150.stdout:0/208: truncate d5/d11/d32/f39 4940619 0 2023-12-05T09:57:23.827 INFO:tasks.workunit.client.0.smithi100.stdout:7/180: creat d3/dc/d11/d13/de/d18/d3b/d40/f41 x:0 0 0 2023-12-05T09:57:23.830 INFO:tasks.workunit.client.0.smithi100.stdout:1/252: getdents db/d12/d1e/d26 0 2023-12-05T09:57:23.830 INFO:tasks.workunit.client.0.smithi100.stdout:1/253: chown db/d12/f18 1 1 2023-12-05T09:57:23.831 INFO:tasks.workunit.client.0.smithi100.stdout:1/254: write db/d31/d3a/f42 [103175,108802] 0 2023-12-05T09:57:23.832 INFO:tasks.workunit.client.1.smithi150.stdout:9/177: mknod d3/d9/d26/c35 0 2023-12-05T09:57:23.834 INFO:tasks.workunit.client.0.smithi100.stdout:5/264: mknod d0/d16/d2b/d48/df/c5f 0 2023-12-05T09:57:23.837 INFO:tasks.workunit.client.1.smithi150.stdout:7/182: link d2/db/d30/d18/d1a/d1e/d2b/f34 d2/db/d30/d13/f37 0 2023-12-05T09:57:23.839 INFO:tasks.workunit.client.0.smithi100.stdout:6/576: mknod d7/d11/d82/cba 0 2023-12-05T09:57:23.840 INFO:tasks.workunit.client.0.smithi100.stdout:6/577: write f5 [8455987,46959] 0 2023-12-05T09:57:23.842 INFO:tasks.workunit.client.0.smithi100.stdout:0/253: rename da/d1b/f26 to da/d1b/d36/f4f 0 2023-12-05T09:57:23.844 INFO:tasks.workunit.client.0.smithi100.stdout:3/293: chown d0/d2/de/d12/f3f 72317 1 2023-12-05T09:57:23.845 INFO:tasks.workunit.client.1.smithi150.stdout:0/209: dread d5/d11/d16/d1f/f2e [0,4194304] 0 2023-12-05T09:57:23.845 INFO:tasks.workunit.client.1.smithi150.stdout:0/210: fdatasync d5/d11/f21 0 2023-12-05T09:57:23.846 INFO:tasks.workunit.client.1.smithi150.stdout:7/183: dread d2/db/d30/d13/f37 [0,4194304] 0 2023-12-05T09:57:23.847 INFO:tasks.workunit.client.0.smithi100.stdout:7/181: mkdir d3/dc/d11/d13/de/d2d/d42 0 2023-12-05T09:57:23.849 INFO:tasks.workunit.client.0.smithi100.stdout:1/255: mknod db/d12/d1e/c4e 0 2023-12-05T09:57:23.850 INFO:tasks.workunit.client.0.smithi100.stdout:4/179: dwrite de/d1d/f21 [0,4194304] 0 2023-12-05T09:57:23.853 INFO:tasks.workunit.client.1.smithi150.stdout:6/168: dwrite d2/f13 [0,4194304] 0 2023-12-05T09:57:23.853 INFO:tasks.workunit.client.1.smithi150.stdout:6/169: creat d2/d23/f3a x:0 0 0 2023-12-05T09:57:23.853 INFO:tasks.workunit.client.1.smithi150.stdout:6/170: chown d2/f13 11 1 2023-12-05T09:57:23.853 INFO:tasks.workunit.client.0.smithi100.stdout:8/192: dwrite d0/d12/d13/f25 [0,4194304] 0 2023-12-05T09:57:23.854 INFO:tasks.workunit.client.0.smithi100.stdout:8/193: creat d0/d12/d13/d16/f2e x:0 0 0 2023-12-05T09:57:23.854 INFO:tasks.workunit.client.0.smithi100.stdout:8/194: chown d0/d12/d13/d16/f2e 2 1 2023-12-05T09:57:23.854 INFO:tasks.workunit.client.0.smithi100.stdout:8/195: stat d0/d12/f2a 0 2023-12-05T09:57:23.855 INFO:tasks.workunit.client.1.smithi150.stdout:4/152: truncate d0/d11/f12 421904 0 2023-12-05T09:57:23.858 INFO:tasks.workunit.client.0.smithi100.stdout:5/265: dread d0/d16/d2b/d48/f5d [0,4194304] 0 2023-12-05T09:57:23.860 INFO:tasks.workunit.client.0.smithi100.stdout:3/294: mknod d0/d4/d3a/c5e 0 2023-12-05T09:57:23.863 INFO:tasks.workunit.client.0.smithi100.stdout:7/182: creat d3/dc/d11/d13/f43 x:0 0 0 2023-12-05T09:57:23.864 INFO:tasks.workunit.client.1.smithi150.stdout:7/184: mkdir d2/db/d17/d38 0 2023-12-05T09:57:23.864 INFO:tasks.workunit.client.1.smithi150.stdout:7/185: chown d2/db/d17/d20 82 1 2023-12-05T09:57:23.867 INFO:tasks.workunit.client.0.smithi100.stdout:1/256: mkdir db/d31/d4f 0 2023-12-05T09:57:23.867 INFO:tasks.workunit.client.0.smithi100.stdout:1/257: chown db/d12/l2d 58125 1 2023-12-05T09:57:23.873 INFO:tasks.workunit.client.0.smithi100.stdout:8/196: dread d0/fc [0,4194304] 0 2023-12-05T09:57:23.873 INFO:tasks.workunit.client.0.smithi100.stdout:8/197: creat d0/d12/d13/f2f x:0 0 0 2023-12-05T09:57:23.873 INFO:tasks.workunit.client.0.smithi100.stdout:8/198: creat d0/d12/d13/f30 x:0 0 0 2023-12-05T09:57:23.888 INFO:tasks.workunit.client.0.smithi100.stdout:7/183: dread d3/dc/d11/d13/f30 [0,4194304] 0 2023-12-05T09:57:23.889 INFO:tasks.workunit.client.1.smithi150.stdout:6/171: mkdir d2/d23/d3b 0 2023-12-05T09:57:23.889 INFO:tasks.workunit.client.1.smithi150.stdout:6/172: truncate d2/da/f22 656799 0 2023-12-05T09:57:23.894 INFO:tasks.workunit.client.1.smithi150.stdout:4/153: mknod d0/c2d 0 2023-12-05T09:57:23.895 INFO:tasks.workunit.client.1.smithi150.stdout:3/208: rename d6/d9/dd to d6/d9/d43/d47 0 2023-12-05T09:57:23.902 INFO:tasks.workunit.client.1.smithi150.stdout:7/186: mkdir d2/d39 0 2023-12-05T09:57:23.902 INFO:tasks.workunit.client.1.smithi150.stdout:4/154: creat d0/d11/f2e x:0 0 0 2023-12-05T09:57:23.902 INFO:tasks.workunit.client.1.smithi150.stdout:4/155: stat d0/f8 0 2023-12-05T09:57:23.902 INFO:tasks.workunit.client.1.smithi150.stdout:4/156: chown d0 1 1 2023-12-05T09:57:23.902 INFO:tasks.workunit.client.1.smithi150.stdout:7/187: fsync d2/db/f2c 0 2023-12-05T09:57:23.902 INFO:tasks.workunit.client.1.smithi150.stdout:7/188: chown d2/db/d30/d18 450130 1 2023-12-05T09:57:23.906 INFO:tasks.workunit.client.1.smithi150.stdout:5/203: rename d1/d2e/f3a to d1/d3/d1e/d21/d3b/d37/f48 0 2023-12-05T09:57:23.906 INFO:tasks.workunit.client.1.smithi150.stdout:5/204: write d1/d3/d6/d11/f2f [864285,46556] 0 2023-12-05T09:57:23.909 INFO:tasks.workunit.client.0.smithi100.stdout:5/266: dwrite d0/d16/d2b/f3a [0,4194304] 0 2023-12-05T09:57:23.916 INFO:tasks.workunit.client.0.smithi100.stdout:9/277: dwrite d7/d1b/d22/d51/f11 [0,4194304] 0 2023-12-05T09:57:23.917 INFO:tasks.workunit.client.1.smithi150.stdout:7/189: dread d2/db/d30/d18/d1a/d1e/d2b/f34 [0,4194304] 0 2023-12-05T09:57:23.918 INFO:tasks.workunit.client.1.smithi150.stdout:9/178: dwrite d3/f2e [0,4194304] 0 2023-12-05T09:57:23.924 INFO:tasks.workunit.client.1.smithi150.stdout:5/205: truncate d1/d3/d6/d26/f28 7104351 0 2023-12-05T09:57:23.924 INFO:tasks.workunit.client.1.smithi150.stdout:5/206: stat d1/d3/d6 0 2023-12-05T09:57:23.931 INFO:tasks.workunit.client.0.smithi100.stdout:2/361: sync 2023-12-05T09:57:23.937 INFO:tasks.workunit.client.1.smithi150.stdout:0/211: getdents d5/d11/d32 0 2023-12-05T09:57:23.941 INFO:tasks.workunit.client.1.smithi150.stdout:7/190: mkdir d2/db/d17/d3a 0 2023-12-05T09:57:23.941 INFO:tasks.workunit.client.1.smithi150.stdout:7/191: readlink d2/db/d30/ld 0 2023-12-05T09:57:23.945 INFO:tasks.workunit.client.1.smithi150.stdout:9/179: rename d3/d9/dc/f19 to d3/d1b/f36 0 2023-12-05T09:57:23.956 INFO:tasks.workunit.client.0.smithi100.stdout:3/295: mkdir d0/d3d/d5c/d5f 0 2023-12-05T09:57:23.956 INFO:tasks.workunit.client.0.smithi100.stdout:3/296: fsync d0/d2/de/f47 0 2023-12-05T09:57:23.957 INFO:tasks.workunit.client.1.smithi150.stdout:0/212: mkdir d5/d11/d16/d3f/d46 0 2023-12-05T09:57:23.957 INFO:tasks.workunit.client.0.smithi100.stdout:7/184: rmdir d3/dc/d11/d13/de/d2d 39 2023-12-05T09:57:23.959 INFO:tasks.workunit.client.1.smithi150.stdout:2/216: sync 2023-12-05T09:57:23.959 INFO:tasks.workunit.client.1.smithi150.stdout:1/227: sync 2023-12-05T09:57:23.959 INFO:tasks.workunit.client.1.smithi150.stdout:1/228: dread - d6/d8/db/f35 zero size 2023-12-05T09:57:23.959 INFO:tasks.workunit.client.1.smithi150.stdout:1/229: fsync d6/d8/db/de/f13 0 2023-12-05T09:57:23.963 INFO:tasks.workunit.client.1.smithi150.stdout:7/192: truncate d2/db/d30/f9 3878242 0 2023-12-05T09:57:23.968 INFO:tasks.workunit.client.0.smithi100.stdout:6/578: rmdir d7 39 2023-12-05T09:57:23.969 INFO:tasks.workunit.client.1.smithi150.stdout:9/180: mknod d3/d9/d26/d34/c37 0 2023-12-05T09:57:23.969 INFO:tasks.workunit.client.1.smithi150.stdout:9/181: dread - d3/f29 zero size 2023-12-05T09:57:23.969 INFO:tasks.workunit.client.1.smithi150.stdout:9/182: truncate d3/f29 409628 0 2023-12-05T09:57:23.969 INFO:tasks.workunit.client.1.smithi150.stdout:9/183: dread - d3/d9/f2f zero size 2023-12-05T09:57:23.969 INFO:tasks.workunit.client.0.smithi100.stdout:0/254: getdents da/d1b/d36 0 2023-12-05T09:57:23.969 INFO:tasks.workunit.client.0.smithi100.stdout:0/255: readlink da/l34 0 2023-12-05T09:57:23.970 INFO:tasks.workunit.client.0.smithi100.stdout:0/256: write da/fd [3945955,88668] 0 2023-12-05T09:57:23.976 INFO:tasks.workunit.client.1.smithi150.stdout:0/213: rename d5/d11/d16/d1f/c25 to d5/d11/d16/c47 0 2023-12-05T09:57:23.978 INFO:tasks.workunit.client.1.smithi150.stdout:6/173: dwrite d2/da/f1a [0,4194304] 0 2023-12-05T09:57:23.978 INFO:tasks.workunit.client.0.smithi100.stdout:7/185: write d3/dc/d11/d13/fb [4766395,78894] 0 2023-12-05T09:57:23.979 INFO:tasks.workunit.client.1.smithi150.stdout:6/174: write d2/da/f22 [180335,79066] 0 2023-12-05T09:57:23.979 INFO:tasks.workunit.client.1.smithi150.stdout:2/217: mkdir d0/d3/d5/d3b/d4c 0 2023-12-05T09:57:23.979 INFO:tasks.workunit.client.1.smithi150.stdout:2/218: write d0/d3/d11/d1d/f2f [4840928,2359] 0 2023-12-05T09:57:23.980 INFO:tasks.workunit.client.1.smithi150.stdout:4/157: dwrite d0/fc [0,4194304] 0 2023-12-05T09:57:23.980 INFO:tasks.workunit.client.1.smithi150.stdout:4/158: write d0/d11/f2e [705152,5607] 0 2023-12-05T09:57:23.980 INFO:tasks.workunit.client.1.smithi150.stdout:4/159: fdatasync d0/f8 0 2023-12-05T09:57:23.983 INFO:tasks.workunit.client.1.smithi150.stdout:1/230: symlink d6/d38/l52 0 2023-12-05T09:57:23.983 INFO:tasks.workunit.client.0.smithi100.stdout:6/579: write d7/d11/f4c [574800,116372] 0 2023-12-05T09:57:23.983 INFO:tasks.workunit.client.0.smithi100.stdout:6/580: truncate d7/d27/d35/d5a/f7f 1390966 0 2023-12-05T09:57:23.989 INFO:tasks.workunit.client.1.smithi150.stdout:3/209: dwrite d6/d22/f31 [0,4194304] 0 2023-12-05T09:57:23.989 INFO:tasks.workunit.client.1.smithi150.stdout:3/210: dread - d6/d25/d28/f3a zero size 2023-12-05T09:57:23.990 INFO:tasks.workunit.client.0.smithi100.stdout:9/278: mkdir d7/d1b/d22/d2a/d56/d2e/d50/d5b 0 2023-12-05T09:57:23.991 INFO:tasks.workunit.client.1.smithi150.stdout:6/175: creat d2/d23/d2e/f3c x:0 0 0 2023-12-05T09:57:23.992 INFO:tasks.workunit.client.1.smithi150.stdout:0/214: dread d5/fa [0,4194304] 0 2023-12-05T09:57:23.992 INFO:tasks.workunit.client.1.smithi150.stdout:0/215: chown d5/d11/d16/d3f/c2d 3 1 2023-12-05T09:57:23.996 INFO:tasks.workunit.client.0.smithi100.stdout:3/297: symlink d0/d2/de/d11/d58/l60 0 2023-12-05T09:57:23.996 INFO:tasks.workunit.client.0.smithi100.stdout:3/298: truncate d0/d10/f2a 4817617 0 2023-12-05T09:57:23.996 INFO:tasks.workunit.client.0.smithi100.stdout:3/299: chown d0/d2/d33/f35 224946948 1 2023-12-05T09:57:23.998 INFO:tasks.workunit.client.1.smithi150.stdout:7/193: write d2/d4/f27 [2986191,35678] 0 2023-12-05T09:57:23.998 INFO:tasks.workunit.client.1.smithi150.stdout:7/194: chown d2/db/d17/d38 28379857 1 2023-12-05T09:57:23.998 INFO:tasks.workunit.client.1.smithi150.stdout:2/219: mkdir d0/d3/d21/d4d 0 2023-12-05T09:57:23.999 INFO:tasks.workunit.client.1.smithi150.stdout:4/160: unlink d0/d11/c29 0 2023-12-05T09:57:24.001 INFO:tasks.workunit.client.0.smithi100.stdout:4/180: rename de/d1d to de/d16/d23/d36 0 2023-12-05T09:57:24.001 INFO:tasks.workunit.client.0.smithi100.stdout:4/181: creat de/d16/d23/f37 x:0 0 0 2023-12-05T09:57:24.006 INFO:tasks.workunit.client.0.smithi100.stdout:0/257: unlink da/l16 0 2023-12-05T09:57:24.010 INFO:tasks.workunit.client.1.smithi150.stdout:1/231: dread d6/d8/db/de/f39 [0,4194304] 0 2023-12-05T09:57:24.011 INFO:tasks.workunit.client.1.smithi150.stdout:0/216: truncate d5/d11/f26 1119648 0 2023-12-05T09:57:24.012 INFO:tasks.workunit.client.0.smithi100.stdout:2/362: dwrite d7/da/f17 [0,4194304] 0 2023-12-05T09:57:24.013 INFO:tasks.workunit.client.0.smithi100.stdout:2/363: truncate d7/da/d2b/f50 4838003 0 2023-12-05T09:57:24.014 INFO:tasks.workunit.client.1.smithi150.stdout:6/176: dread d2/da/f1a [0,4194304] 0 2023-12-05T09:57:24.015 INFO:tasks.workunit.client.1.smithi150.stdout:5/207: dwrite d1/d3/d6/d26/f3e [0,4194304] 0 2023-12-05T09:57:24.017 INFO:tasks.workunit.client.0.smithi100.stdout:7/186: truncate d3/dc/f1d 3673248 0 2023-12-05T09:57:24.017 INFO:tasks.workunit.client.0.smithi100.stdout:5/267: getdents d0/d1f/d25/d31 0 2023-12-05T09:57:24.019 INFO:tasks.workunit.client.1.smithi150.stdout:3/211: write d6/d9/f1c [1941143,100106] 0 2023-12-05T09:57:24.019 INFO:tasks.workunit.client.0.smithi100.stdout:6/581: dread - d7/d11/f99 zero size 2023-12-05T09:57:24.022 INFO:tasks.workunit.client.1.smithi150.stdout:7/195: symlink d2/d1b/d31/l3b 0 2023-12-05T09:57:24.024 INFO:tasks.workunit.client.1.smithi150.stdout:2/220: dread d0/f16 [0,4194304] 0 2023-12-05T09:57:24.026 INFO:tasks.workunit.client.1.smithi150.stdout:7/196: write d2/f12 [349473,39798] 0 2023-12-05T09:57:24.034 INFO:tasks.workunit.client.1.smithi150.stdout:4/161: stat d0/c22 0 2023-12-05T09:57:24.034 INFO:tasks.workunit.client.1.smithi150.stdout:4/162: chown d0/c10 0 1 2023-12-05T09:57:24.034 INFO:tasks.workunit.client.1.smithi150.stdout:4/163: creat d0/d11/f2f x:0 0 0 2023-12-05T09:57:24.034 INFO:tasks.workunit.client.1.smithi150.stdout:4/164: readlink d0/le 0 2023-12-05T09:57:24.035 INFO:tasks.workunit.client.0.smithi100.stdout:9/279: dread d7/fb [0,4194304] 0 2023-12-05T09:57:24.035 INFO:tasks.workunit.client.0.smithi100.stdout:8/199: fsync d0/d12/d13/f30 0 2023-12-05T09:57:24.035 INFO:tasks.workunit.client.0.smithi100.stdout:8/200: dread - d0/d12/d13/d16/d22/f26 zero size 2023-12-05T09:57:24.035 INFO:tasks.workunit.client.0.smithi100.stdout:8/201: read - d0/d12/d13/d16/f23 zero size 2023-12-05T09:57:24.035 INFO:tasks.workunit.client.0.smithi100.stdout:8/202: creat d0/f31 x:0 0 0 2023-12-05T09:57:24.035 INFO:tasks.workunit.client.0.smithi100.stdout:8/203: chown d0/d12/d13/d16/c28 50709 1 2023-12-05T09:57:24.036 INFO:tasks.workunit.client.0.smithi100.stdout:8/204: chown d0/ce 2221 1 2023-12-05T09:57:24.036 INFO:tasks.workunit.client.0.smithi100.stdout:8/205: stat d0/fb 0 2023-12-05T09:57:24.036 INFO:tasks.workunit.client.0.smithi100.stdout:8/206: truncate d0/f2 4534658 0 2023-12-05T09:57:24.036 INFO:tasks.workunit.client.0.smithi100.stdout:8/207: getdents d0/d12/d13/d16/d22 0 2023-12-05T09:57:24.036 INFO:tasks.workunit.client.0.smithi100.stdout:0/258: dread da/f2c [0,4194304] 0 2023-12-05T09:57:24.036 INFO:tasks.workunit.client.0.smithi100.stdout:0/259: chown da/fd 163419269 1 2023-12-05T09:57:24.036 INFO:tasks.workunit.client.1.smithi150.stdout:8/183: sync 2023-12-05T09:57:24.037 INFO:tasks.workunit.client.1.smithi150.stdout:8/184: chown d0/l20 330763567 1 2023-12-05T09:57:24.040 INFO:tasks.workunit.client.1.smithi150.stdout:9/184: dwrite d3/d9/dc/f33 [0,4194304] 0 2023-12-05T09:57:24.040 INFO:tasks.workunit.client.1.smithi150.stdout:9/185: chown l1 70398 1 2023-12-05T09:57:24.043 INFO:tasks.workunit.client.1.smithi150.stdout:0/217: unlink d5/d11/d32/l3e 0 2023-12-05T09:57:24.050 INFO:tasks.workunit.client.1.smithi150.stdout:4/165: dread d0/ff [0,4194304] 0 2023-12-05T09:57:24.050 INFO:tasks.workunit.client.1.smithi150.stdout:4/166: chown d0/fc 642048 1 2023-12-05T09:57:24.055 INFO:tasks.workunit.client.1.smithi150.stdout:6/177: unlink d2/d23/f37 0 2023-12-05T09:57:24.059 INFO:tasks.workunit.client.1.smithi150.stdout:5/208: creat d1/d3/d1e/d31/f49 x:0 0 0 2023-12-05T09:57:24.062 INFO:tasks.workunit.client.0.smithi100.stdout:3/300: unlink d0/cb 0 2023-12-05T09:57:24.068 INFO:tasks.workunit.client.1.smithi150.stdout:3/212: symlink d6/d9/d43/d47/l48 0 2023-12-05T09:57:24.071 INFO:tasks.workunit.client.1.smithi150.stdout:7/197: creat d2/db/d30/d18/d1a/f3c x:0 0 0 2023-12-05T09:57:24.073 INFO:tasks.workunit.client.0.smithi100.stdout:4/182: mkdir de/d38 0 2023-12-05T09:57:24.073 INFO:tasks.workunit.client.0.smithi100.stdout:4/183: fdatasync de/d16/d23/f2c 0 2023-12-05T09:57:24.073 INFO:tasks.workunit.client.0.smithi100.stdout:4/184: readlink de/d16/l1a 0 2023-12-05T09:57:24.073 INFO:tasks.workunit.client.0.smithi100.stdout:4/185: write de/f1b [854139,78146] 0 2023-12-05T09:57:24.075 INFO:tasks.workunit.client.0.smithi100.stdout:6/582: dwrite f4 [4194304,4194304] 0 2023-12-05T09:57:24.076 INFO:tasks.workunit.client.0.smithi100.stdout:2/364: rename d7/da/f25 to d7/da/d2b/f80 0 2023-12-05T09:57:24.076 INFO:tasks.workunit.client.0.smithi100.stdout:2/365: read - d7/f66 zero size 2023-12-05T09:57:24.076 INFO:tasks.workunit.client.0.smithi100.stdout:2/366: write d7/da/d18/d1b/d2c/d3f/d46/f26 [5125188,69668] 0 2023-12-05T09:57:24.077 INFO:tasks.workunit.client.1.smithi150.stdout:1/232: truncate d6/d8/db/de/f22 715426 0 2023-12-05T09:57:24.077 INFO:tasks.workunit.client.1.smithi150.stdout:1/233: dread - d6/d8/db/d1b/f37 zero size 2023-12-05T09:57:24.079 INFO:tasks.workunit.client.0.smithi100.stdout:7/187: unlink d3/dc/d11/d33/l3d 0 2023-12-05T09:57:24.081 INFO:tasks.workunit.client.1.smithi150.stdout:8/185: rmdir d0/d8/d14/d1b/d24/d2e/d30 39 2023-12-05T09:57:24.081 INFO:tasks.workunit.client.1.smithi150.stdout:2/221: dwrite d0/d3/d21/f39 [0,4194304] 0 2023-12-05T09:57:24.081 INFO:tasks.workunit.client.0.smithi100.stdout:5/268: mkdir d0/d1b/d4d/d60 0 2023-12-05T09:57:24.082 INFO:tasks.workunit.client.0.smithi100.stdout:5/269: readlink d0/d1f/l24 0 2023-12-05T09:57:24.082 INFO:tasks.workunit.client.0.smithi100.stdout:5/270: chown d0/d4/c1a 163142 1 2023-12-05T09:57:24.082 INFO:tasks.workunit.client.0.smithi100.stdout:5/271: readlink d0/d4/d14/l41 0 2023-12-05T09:57:24.082 INFO:tasks.workunit.client.0.smithi100.stdout:5/272: chown d0/d1b 92 1 2023-12-05T09:57:24.082 INFO:tasks.workunit.client.0.smithi100.stdout:5/273: write d0/d1f/f4c [5069179,94080] 0 2023-12-05T09:57:24.084 INFO:tasks.workunit.client.0.smithi100.stdout:0/260: symlink da/d22/l50 0 2023-12-05T09:57:24.085 INFO:tasks.workunit.client.1.smithi150.stdout:3/213: dread d6/f1f [0,4194304] 0 2023-12-05T09:57:24.087 INFO:tasks.workunit.client.0.smithi100.stdout:3/301: getdents d0/d2/de 0 2023-12-05T09:57:24.089 INFO:tasks.workunit.client.1.smithi150.stdout:0/218: unlink d5/d11/f21 0 2023-12-05T09:57:24.089 INFO:tasks.workunit.client.1.smithi150.stdout:0/219: chown d5/fc 162521742 1 2023-12-05T09:57:24.089 INFO:tasks.workunit.client.1.smithi150.stdout:0/220: readlink d5/lb 0 2023-12-05T09:57:24.089 INFO:tasks.workunit.client.1.smithi150.stdout:0/221: chown d5/d11/d16 341154 1 2023-12-05T09:57:24.089 INFO:tasks.workunit.client.1.smithi150.stdout:0/222: read - d5/f41 zero size 2023-12-05T09:57:24.090 INFO:tasks.workunit.client.1.smithi150.stdout:4/167: unlink d0/f8 0 2023-12-05T09:57:24.090 INFO:tasks.workunit.client.1.smithi150.stdout:4/168: fdatasync d0/f24 0 2023-12-05T09:57:24.092 INFO:tasks.workunit.client.1.smithi150.stdout:6/178: mknod d2/d23/d3b/c3d 0 2023-12-05T09:57:24.092 INFO:tasks.workunit.client.1.smithi150.stdout:6/179: creat d2/d23/d2e/f3e x:0 0 0 2023-12-05T09:57:24.095 INFO:tasks.workunit.client.1.smithi150.stdout:9/186: dwrite d3/d9/dc/f1d [0,4194304] 0 2023-12-05T09:57:24.095 INFO:tasks.workunit.client.1.smithi150.stdout:9/187: rename d3 to d3/d9/d26/d38 22 2023-12-05T09:57:24.096 INFO:tasks.workunit.client.1.smithi150.stdout:9/188: readlink l1 0 2023-12-05T09:57:24.096 INFO:tasks.workunit.client.0.smithi100.stdout:6/583: creat d7/d27/d97/fbb x:0 0 0 2023-12-05T09:57:24.096 INFO:tasks.workunit.client.1.smithi150.stdout:5/209: mknod d1/d3/d1e/d31/c4a 0 2023-12-05T09:57:24.096 INFO:tasks.workunit.client.1.smithi150.stdout:5/210: rename d1/d3 to d1/d3/d4b 22 2023-12-05T09:57:24.099 INFO:tasks.workunit.client.0.smithi100.stdout:4/186: read de/d16/d23/f26 [275999,41597] 0 2023-12-05T09:57:24.099 INFO:tasks.workunit.client.0.smithi100.stdout:4/187: write de/d16/d23/f29 [811847,89764] 0 2023-12-05T09:57:24.100 INFO:tasks.workunit.client.0.smithi100.stdout:7/188: creat d3/dc/d11/d13/de/d2d/f44 x:0 0 0 2023-12-05T09:57:24.100 INFO:tasks.workunit.client.1.smithi150.stdout:7/198: mkdir d2/db/d30/d13/d3d 0 2023-12-05T09:57:24.101 INFO:tasks.workunit.client.1.smithi150.stdout:7/199: dread - d2/db/d30/d13/f1d zero size 2023-12-05T09:57:24.102 INFO:tasks.workunit.client.0.smithi100.stdout:7/189: read d3/f1f [12071,7513] 0 2023-12-05T09:57:24.102 INFO:tasks.workunit.client.0.smithi100.stdout:7/190: chown d3/dc/d11/d33 219527 1 2023-12-05T09:57:24.102 INFO:tasks.workunit.client.0.smithi100.stdout:7/191: dread - d3/dc/d11/f1e zero size 2023-12-05T09:57:24.103 INFO:tasks.workunit.client.0.smithi100.stdout:5/274: symlink d0/d1b/d4d/l61 0 2023-12-05T09:57:24.104 INFO:tasks.workunit.client.0.smithi100.stdout:0/261: rmdir da/d2a 39 2023-12-05T09:57:24.104 INFO:tasks.workunit.client.0.smithi100.stdout:0/262: write da/d22/d33/d35/d3a/f47 [4446789,102777] 0 2023-12-05T09:57:24.106 INFO:tasks.workunit.client.1.smithi150.stdout:2/222: dread d0/f7 [0,4194304] 0 2023-12-05T09:57:24.109 INFO:tasks.workunit.client.1.smithi150.stdout:0/223: mknod d5/c48 0 2023-12-05T09:57:24.110 INFO:tasks.workunit.client.1.smithi150.stdout:0/224: truncate d5/d11/d16/d3f/f3c 9287426 0 2023-12-05T09:57:24.110 INFO:tasks.workunit.client.0.smithi100.stdout:9/280: dwrite d7/f8 [0,4194304] 0 2023-12-05T09:57:24.110 INFO:tasks.workunit.client.1.smithi150.stdout:8/186: dread d0/d8/d14/d1b/d24/d34/f39 [0,4194304] 0 2023-12-05T09:57:24.113 INFO:tasks.workunit.client.1.smithi150.stdout:9/189: symlink d3/d9/dc/d1f/l39 0 2023-12-05T09:57:24.115 INFO:tasks.workunit.client.0.smithi100.stdout:3/302: mknod d0/d3d/d5c/d5f/c61 0 2023-12-05T09:57:24.115 INFO:tasks.workunit.client.0.smithi100.stdout:7/192: creat d3/dc/d11/d13/d1b/f45 x:0 0 0 2023-12-05T09:57:24.115 INFO:tasks.workunit.client.0.smithi100.stdout:7/193: write d3/dc/d11/d13/de/f2b [1519933,67031] 0 2023-12-05T09:57:24.115 INFO:tasks.workunit.client.0.smithi100.stdout:7/194: chown d3/dc/d11/d13/d1b/c21 127873956 1 2023-12-05T09:57:24.115 INFO:tasks.workunit.client.0.smithi100.stdout:6/584: dread d7/d11/d1a/f9b [0,4194304] 0 2023-12-05T09:57:24.118 INFO:tasks.workunit.client.0.smithi100.stdout:9/281: dread d7/d1b/d22/f31 [0,4194304] 0 2023-12-05T09:57:24.119 INFO:tasks.workunit.client.0.smithi100.stdout:0/263: symlink da/d1b/d36/l51 0 2023-12-05T09:57:24.121 INFO:tasks.workunit.client.1.smithi150.stdout:5/211: rename d1/d3/d1e/d31/c4a to d1/d3/c4c 0 2023-12-05T09:57:24.126 INFO:tasks.workunit.client.1.smithi150.stdout:2/223: dread d0/d3/d11/d1d/f29 [0,4194304] 0 2023-12-05T09:57:24.126 INFO:tasks.workunit.client.1.smithi150.stdout:2/224: chown d0/d3/d11/f18 0 1 2023-12-05T09:57:24.126 INFO:tasks.workunit.client.1.smithi150.stdout:2/225: write d0/f49 [226693,25937] 0 2023-12-05T09:57:24.127 INFO:tasks.workunit.client.1.smithi150.stdout:2/226: read d0/d3/d5/f40 [889907,128425] 0 2023-12-05T09:57:24.131 INFO:tasks.workunit.client.1.smithi150.stdout:6/180: write d2/da/f27 [8375667,37612] 0 2023-12-05T09:57:24.131 INFO:tasks.workunit.client.1.smithi150.stdout:6/181: truncate d2/f34 388800 0 2023-12-05T09:57:24.131 INFO:tasks.workunit.client.1.smithi150.stdout:6/182: creat d2/d23/f3f x:0 0 0 2023-12-05T09:57:24.134 INFO:tasks.workunit.client.0.smithi100.stdout:7/195: dread d3/dc/d11/d13/de/f22 [0,4194304] 0 2023-12-05T09:57:24.134 INFO:tasks.workunit.client.0.smithi100.stdout:7/196: stat d3/dc/f1d 0 2023-12-05T09:57:24.136 INFO:tasks.workunit.client.1.smithi150.stdout:7/200: link d2/db/d30/d13/f14 d2/db/d30/d13/f3e 0 2023-12-05T09:57:24.136 INFO:tasks.workunit.client.1.smithi150.stdout:7/201: write d2/d4/f27 [4577690,50115] 0 2023-12-05T09:57:24.136 INFO:tasks.workunit.client.1.smithi150.stdout:7/202: fdatasync d2/db/d30/d13/f3e 0 2023-12-05T09:57:24.136 INFO:tasks.workunit.client.1.smithi150.stdout:7/203: fsync d2/db/d30/d13/f1d 0 2023-12-05T09:57:24.137 INFO:tasks.workunit.client.0.smithi100.stdout:6/585: symlink d7/d11/d82/lbc 0 2023-12-05T09:57:24.139 INFO:tasks.workunit.client.1.smithi150.stdout:1/234: rmdir d6/d38 39 2023-12-05T09:57:24.139 INFO:tasks.workunit.client.1.smithi150.stdout:1/235: truncate d6/d8/db/f16 380388 0 2023-12-05T09:57:24.141 INFO:tasks.workunit.client.0.smithi100.stdout:3/303: dread d0/d10/f2a [0,4194304] 0 2023-12-05T09:57:24.143 INFO:tasks.workunit.client.0.smithi100.stdout:9/282: creat d7/d1b/d22/d2a/d56/f5c x:0 0 0 2023-12-05T09:57:24.145 INFO:tasks.workunit.client.1.smithi150.stdout:0/225: truncate d5/d11/f26 560373 0 2023-12-05T09:57:24.147 INFO:tasks.workunit.client.0.smithi100.stdout:7/197: mkdir d3/dc/d11/d13/de/d18/d3b/d40/d46 0 2023-12-05T09:57:24.147 INFO:tasks.workunit.client.0.smithi100.stdout:7/198: readlink d3/dc/l16 0 2023-12-05T09:57:24.148 INFO:tasks.workunit.client.0.smithi100.stdout:7/199: readlink d3/dc/d11/d13/d1b/l29 0 2023-12-05T09:57:24.149 INFO:tasks.workunit.client.1.smithi150.stdout:8/187: creat d0/d8/d14/d1b/d24/d38/f3a x:0 0 0 2023-12-05T09:57:24.151 INFO:tasks.workunit.client.0.smithi100.stdout:6/586: creat d7/d2d/fbd x:0 0 0 2023-12-05T09:57:24.154 INFO:tasks.workunit.client.1.smithi150.stdout:9/190: mkdir d3/d9/d26/d34/d3a 0 2023-12-05T09:57:24.154 INFO:tasks.workunit.client.1.smithi150.stdout:9/191: write d3/d9/f14 [2016752,76078] 0 2023-12-05T09:57:24.154 INFO:tasks.workunit.client.1.smithi150.stdout:5/212: mkdir d1/d2e/d4d 0 2023-12-05T09:57:24.155 INFO:tasks.workunit.client.0.smithi100.stdout:2/367: dwrite d7/da/d65/f77 [0,4194304] 0 2023-12-05T09:57:24.155 INFO:tasks.workunit.client.0.smithi100.stdout:2/368: chown d7/da/d18/d1b/d2c/d3f/d46/c27 23209028 1 2023-12-05T09:57:24.157 INFO:tasks.workunit.client.1.smithi150.stdout:2/227: symlink d0/d3/d11/d1d/l4e 0 2023-12-05T09:57:24.158 INFO:tasks.workunit.client.0.smithi100.stdout:9/283: link d7/d1b/d22/d51/d32/c5a d7/d1b/d22/d2a/d56/d2e/d50/c5d 0 2023-12-05T09:57:24.159 INFO:tasks.workunit.client.0.smithi100.stdout:9/284: chown d7/d1b/d22/f4a 11931230 1 2023-12-05T09:57:24.161 INFO:tasks.workunit.client.0.smithi100.stdout:7/200: mkdir d3/dc/d11/d13/de/d2d/d47 0 2023-12-05T09:57:24.161 INFO:tasks.workunit.client.0.smithi100.stdout:7/201: truncate d3/dc/d11/d13/d1b/f45 503533 0 2023-12-05T09:57:24.166 INFO:tasks.workunit.client.1.smithi150.stdout:6/183: creat d2/d23/d2e/d39/f40 x:0 0 0 2023-12-05T09:57:24.166 INFO:tasks.workunit.client.0.smithi100.stdout:4/188: dwrite de/d16/d23/f34 [0,4194304] 0 2023-12-05T09:57:24.168 INFO:tasks.workunit.client.1.smithi150.stdout:3/214: dwrite d6/d19/f3f [0,4194304] 0 2023-12-05T09:57:24.168 INFO:tasks.workunit.client.1.smithi150.stdout:3/215: readlink d6/d9/d43/d47/l11 0 2023-12-05T09:57:24.169 INFO:tasks.workunit.client.1.smithi150.stdout:4/169: dwrite d0/d11/f2b [0,4194304] 0 2023-12-05T09:57:24.170 INFO:tasks.workunit.client.0.smithi100.stdout:6/587: creat d7/fbe x:0 0 0 2023-12-05T09:57:24.172 INFO:tasks.workunit.client.1.smithi150.stdout:1/236: creat d6/f53 x:0 0 0 2023-12-05T09:57:24.175 INFO:tasks.workunit.client.1.smithi150.stdout:3/216: dread d6/d9/f32 [0,4194304] 0 2023-12-05T09:57:24.176 INFO:tasks.workunit.client.1.smithi150.stdout:0/226: mknod d5/d11/d32/d37/c49 0 2023-12-05T09:57:24.180 INFO:tasks.workunit.client.1.smithi150.stdout:8/188: fsync d0/d8/d14/d1b/f2f 0 2023-12-05T09:57:24.180 INFO:tasks.workunit.client.1.smithi150.stdout:8/189: dread - d0/d8/d14/d1b/d24/d38/f3a zero size 2023-12-05T09:57:24.182 INFO:tasks.workunit.client.0.smithi100.stdout:7/202: dread d3/dc/f12 [0,4194304] 0 2023-12-05T09:57:24.183 INFO:tasks.workunit.client.0.smithi100.stdout:9/285: creat d7/d1b/d22/d2a/d56/d2e/f5e x:0 0 0 2023-12-05T09:57:24.183 INFO:tasks.workunit.client.0.smithi100.stdout:9/286: chown d7/d1b/d22/f38 205618 1 2023-12-05T09:57:24.183 INFO:tasks.workunit.client.0.smithi100.stdout:9/287: fdatasync d7/d1b/d22/d2a/f40 0 2023-12-05T09:57:24.186 INFO:tasks.workunit.client.0.smithi100.stdout:5/275: dwrite d0/d1b/f33 [0,4194304] 0 2023-12-05T09:57:24.186 INFO:tasks.workunit.client.1.smithi150.stdout:9/192: unlink d3/d1b/f32 0 2023-12-05T09:57:24.194 INFO:tasks.workunit.client.0.smithi100.stdout:6/588: write d7/d11/d1a/f52 [3485211,21557] 0 2023-12-05T09:57:24.194 INFO:tasks.workunit.client.0.smithi100.stdout:5/276: read d0/d16/d2b/d48/f12 [1465003,8016] 0 2023-12-05T09:57:24.203 INFO:tasks.workunit.client.1.smithi150.stdout:7/204: dwrite d2/d1b/f35 [0,4194304] 0 2023-12-05T09:57:24.203 INFO:tasks.workunit.client.0.smithi100.stdout:0/264: dwrite da/d2a/d45/f49 [0,4194304] 0 2023-12-05T09:57:24.203 INFO:tasks.workunit.client.0.smithi100.stdout:0/265: chown da/f2d 45559 1 2023-12-05T09:57:24.208 INFO:tasks.workunit.client.0.smithi100.stdout:2/369: dwrite d7/d61/f6b [0,4194304] 0 2023-12-05T09:57:24.210 INFO:tasks.workunit.client.0.smithi100.stdout:2/370: write d7/f43 [1449078,91135] 0 2023-12-05T09:57:24.216 INFO:tasks.workunit.client.0.smithi100.stdout:6/589: dread d7/d11/d82/f28 [0,4194304] 0 2023-12-05T09:57:24.223 INFO:tasks.workunit.client.0.smithi100.stdout:0/266: dread da/f2d [0,4194304] 0 2023-12-05T09:57:24.235 INFO:tasks.workunit.client.0.smithi100.stdout:3/304: mkdir d0/d2/d62 0 2023-12-05T09:57:24.236 INFO:tasks.workunit.client.1.smithi150.stdout:6/184: symlink d2/d23/d2e/d39/l41 0 2023-12-05T09:57:24.239 INFO:tasks.workunit.client.0.smithi100.stdout:4/189: rename de/l1c to de/d16/l39 0 2023-12-05T09:57:24.241 INFO:tasks.workunit.client.1.smithi150.stdout:5/213: dwrite d1/d3/d6/d11/f2f [0,4194304] 0 2023-12-05T09:57:24.242 INFO:tasks.workunit.client.0.smithi100.stdout:7/203: truncate d3/dc/f14 764944 0 2023-12-05T09:57:24.250 INFO:tasks.workunit.client.0.smithi100.stdout:9/288: truncate d7/d1b/d22/d51/f23 2544575 0 2023-12-05T09:57:24.250 INFO:tasks.workunit.client.0.smithi100.stdout:9/289: fdatasync d7/d1b/d22/d51/f2d 0 2023-12-05T09:57:24.253 INFO:tasks.workunit.client.1.smithi150.stdout:4/170: truncate d0/d11/f18 950941 0 2023-12-05T09:57:24.259 INFO:tasks.workunit.client.1.smithi150.stdout:1/237: mkdir d6/d8/d54 0 2023-12-05T09:57:24.259 INFO:tasks.workunit.client.1.smithi150.stdout:1/238: fdatasync d6/d8/db/de/f22 0 2023-12-05T09:57:24.264 INFO:tasks.workunit.client.1.smithi150.stdout:3/217: rename d6/d9/c23 to d6/d9/d43/c49 0 2023-12-05T09:57:24.265 INFO:tasks.workunit.client.1.smithi150.stdout:3/218: chown d6/d19/f3b 6434 1 2023-12-05T09:57:24.267 INFO:tasks.workunit.client.1.smithi150.stdout:0/227: symlink d5/d11/d16/d3f/d46/l4a 0 2023-12-05T09:57:24.267 INFO:tasks.workunit.client.1.smithi150.stdout:0/228: fdatasync d5/fc 0 2023-12-05T09:57:24.267 INFO:tasks.workunit.client.1.smithi150.stdout:0/229: fsync d5/d11/d16/f17 0 2023-12-05T09:57:24.270 INFO:tasks.workunit.client.1.smithi150.stdout:3/219: dread d6/d9/f1b [0,4194304] 0 2023-12-05T09:57:24.270 INFO:tasks.workunit.client.1.smithi150.stdout:3/220: fdatasync d6/d9/f1c 0 2023-12-05T09:57:24.270 INFO:tasks.workunit.client.1.smithi150.stdout:3/221: fsync d6/d9/f32 0 2023-12-05T09:57:24.276 INFO:tasks.workunit.client.1.smithi150.stdout:8/190: rmdir d0/d8/d14/d1b/d24/d34 39 2023-12-05T09:57:24.281 INFO:tasks.workunit.client.0.smithi100.stdout:5/277: mkdir d0/d4/d14/d35/d62 0 2023-12-05T09:57:24.282 INFO:tasks.workunit.client.0.smithi100.stdout:5/278: creat d0/d1f/d25/f63 x:0 0 0 2023-12-05T09:57:24.282 INFO:tasks.workunit.client.0.smithi100.stdout:5/279: chown d0/d16/d2b/f3a 1897 1 2023-12-05T09:57:24.287 INFO:tasks.workunit.client.1.smithi150.stdout:3/222: write d6/d19/f3f [74603,20503] 0 2023-12-05T09:57:24.307 INFO:tasks.workunit.client.1.smithi150.stdout:1/239: dwrite f1 [0,4194304] 0 2023-12-05T09:57:24.307 INFO:tasks.workunit.client.1.smithi150.stdout:7/205: rmdir d2/db/d17/d20 39 2023-12-05T09:57:24.309 INFO:tasks.workunit.client.0.smithi100.stdout:7/204: dwrite d3/dc/d11/f32 [0,4194304] 0 2023-12-05T09:57:24.313 INFO:tasks.workunit.client.1.smithi150.stdout:4/171: dwrite d0/fc [0,4194304] 0 2023-12-05T09:57:24.328 INFO:tasks.workunit.client.1.smithi150.stdout:3/223: dwrite d6/d25/d28/f2e [4194304,4194304] 0 2023-12-05T09:57:24.333 INFO:tasks.workunit.client.1.smithi150.stdout:3/224: dread d6/d9/f32 [0,4194304] 0 2023-12-05T09:57:24.333 INFO:tasks.workunit.client.1.smithi150.stdout:3/225: truncate d6/d9/f32 704545 0 2023-12-05T09:57:24.337 INFO:tasks.workunit.client.0.smithi100.stdout:6/590: unlink d7/c18 0 2023-12-05T09:57:24.356 INFO:tasks.workunit.client.1.smithi150.stdout:7/206: dwrite d2/f12 [0,4194304] 0 2023-12-05T09:57:24.356 INFO:tasks.workunit.client.1.smithi150.stdout:7/207: stat d2/d4/ff 0 2023-12-05T09:57:24.374 INFO:tasks.workunit.client.0.smithi100.stdout:9/290: unlink d7/d1b/d22/d2a/d56/d2e/c57 0 2023-12-05T09:57:24.380 INFO:tasks.workunit.client.0.smithi100.stdout:5/280: creat d0/d16/d2b/f64 x:0 0 0 2023-12-05T09:57:24.381 INFO:tasks.workunit.client.1.smithi150.stdout:6/185: link d2/c1e d2/d23/d3b/c42 0 2023-12-05T09:57:24.385 INFO:tasks.workunit.client.1.smithi150.stdout:5/214: truncate d1/d3/d1e/d21/f35 2202505 0 2023-12-05T09:57:24.385 INFO:tasks.workunit.client.1.smithi150.stdout:5/215: write d1/d3/d1e/d21/d3b/d37/f48 [380545,108089] 0 2023-12-05T09:57:24.385 INFO:tasks.workunit.client.1.smithi150.stdout:5/216: chown d1/d3/ce 2 1 2023-12-05T09:57:24.385 INFO:tasks.workunit.client.1.smithi150.stdout:5/217: chown d1/d3/d1e/d21/f35 3637082 1 2023-12-05T09:57:24.387 INFO:tasks.workunit.client.1.smithi150.stdout:0/230: symlink d5/d11/d16/d3f/l4b 0 2023-12-05T09:57:24.387 INFO:tasks.workunit.client.0.smithi100.stdout:6/591: stat d7/f23 0 2023-12-05T09:57:24.389 INFO:tasks.workunit.client.1.smithi150.stdout:8/191: creat d0/d8/d14/d1b/d24/f3b x:0 0 0 2023-12-05T09:57:24.389 INFO:tasks.workunit.client.1.smithi150.stdout:8/192: fsync d0/d8/d14/f1a 0 2023-12-05T09:57:24.392 INFO:tasks.workunit.client.0.smithi100.stdout:4/190: truncate de/d16/d23/f29 207748 0 2023-12-05T09:57:24.399 INFO:tasks.workunit.client.0.smithi100.stdout:9/291: creat d7/d1b/d22/d51/f5f x:0 0 0 2023-12-05T09:57:24.402 INFO:tasks.workunit.client.1.smithi150.stdout:0/231: write d5/fd [3571574,49317] 0 2023-12-05T09:57:24.403 INFO:tasks.workunit.client.1.smithi150.stdout:0/232: write d5/d11/d32/d37/f30 [746946,109086] 0 2023-12-05T09:57:24.405 INFO:tasks.workunit.client.0.smithi100.stdout:6/592: dread d7/d2d/f43 [0,4194304] 0 2023-12-05T09:57:24.409 INFO:tasks.workunit.client.0.smithi100.stdout:5/281: creat d0/d16/d2b/d48/f65 x:0 0 0 2023-12-05T09:57:24.409 INFO:tasks.workunit.client.0.smithi100.stdout:5/282: stat d0/d1f/d25/f63 0 2023-12-05T09:57:24.409 INFO:tasks.workunit.client.1.smithi150.stdout:1/240: stat d6/d8/db/de/l1e 0 2023-12-05T09:57:24.414 INFO:tasks.workunit.client.0.smithi100.stdout:2/371: rename d7/da/d2b to d7/da/d18/d21/d4d/d81 0 2023-12-05T09:57:24.415 INFO:tasks.workunit.client.0.smithi100.stdout:2/372: dread - d7/da/f5b zero size 2023-12-05T09:57:24.415 INFO:tasks.workunit.client.0.smithi100.stdout:2/373: stat d7/da/d18/d21/f40 0 2023-12-05T09:57:24.415 INFO:tasks.workunit.client.0.smithi100.stdout:2/374: chown d7/da/dc/f7a 6862869 1 2023-12-05T09:57:24.415 INFO:tasks.workunit.client.0.smithi100.stdout:2/375: write d7/da/d1a/f38 [4437574,27561] 0 2023-12-05T09:57:24.419 INFO:tasks.workunit.client.0.smithi100.stdout:1/258: sync 2023-12-05T09:57:24.420 INFO:tasks.workunit.client.0.smithi100.stdout:6/593: symlink d7/d27/d35/d5a/db0/lbf 0 2023-12-05T09:57:24.423 INFO:tasks.workunit.client.0.smithi100.stdout:3/305: rename d0/d2/de/d12/f28 to d0/d2/de/d12/f63 0 2023-12-05T09:57:24.432 INFO:tasks.workunit.client.0.smithi100.stdout:1/259: dread db/d12/f14 [0,4194304] 0 2023-12-05T09:57:24.433 INFO:tasks.workunit.client.0.smithi100.stdout:1/260: stat db/d12/d1e/f34 0 2023-12-05T09:57:24.433 INFO:tasks.workunit.client.0.smithi100.stdout:3/306: creat d0/d4/d3a/f64 x:0 0 0 2023-12-05T09:57:24.435 INFO:tasks.workunit.client.0.smithi100.stdout:5/283: dread d0/d1f/f4c [0,4194304] 0 2023-12-05T09:57:24.435 INFO:tasks.workunit.client.0.smithi100.stdout:5/284: chown d0/d1b/f32 1431 1 2023-12-05T09:57:24.435 INFO:tasks.workunit.client.0.smithi100.stdout:5/285: creat d0/d1b/f66 x:0 0 0 2023-12-05T09:57:24.436 INFO:tasks.workunit.client.1.smithi150.stdout:7/208: truncate d2/db/d30/d13/f37 428709 0 2023-12-05T09:57:24.443 INFO:tasks.workunit.client.0.smithi100.stdout:3/307: symlink d0/d10/d39/l65 0 2023-12-05T09:57:24.450 INFO:tasks.workunit.client.1.smithi150.stdout:5/218: symlink d1/d3/d6/d1b/d22/l4e 0 2023-12-05T09:57:24.451 INFO:tasks.workunit.client.1.smithi150.stdout:1/241: dread d6/d8/db/de/f14 [0,4194304] 0 2023-12-05T09:57:24.451 INFO:tasks.workunit.client.1.smithi150.stdout:4/172: rename d0/d11/f2b to d0/f30 0 2023-12-05T09:57:24.452 INFO:tasks.workunit.client.1.smithi150.stdout:1/242: creat d6/d8/d54/f55 x:0 0 0 2023-12-05T09:57:24.452 INFO:tasks.workunit.client.1.smithi150.stdout:1/243: creat d6/d8/d54/f56 x:0 0 0 2023-12-05T09:57:24.454 INFO:tasks.workunit.client.1.smithi150.stdout:0/233: rename d5/lb to d5/d11/d16/d3f/d46/l4c 0 2023-12-05T09:57:24.454 INFO:tasks.workunit.client.0.smithi100.stdout:8/208: sync 2023-12-05T09:57:24.454 INFO:tasks.workunit.client.0.smithi100.stdout:8/209: dread - d0/d12/d13/d16/d22/f26 zero size 2023-12-05T09:57:24.457 INFO:tasks.workunit.client.1.smithi150.stdout:8/193: dwrite d0/f13 [0,4194304] 0 2023-12-05T09:57:24.457 INFO:tasks.workunit.client.1.smithi150.stdout:8/194: dread - d0/d8/d14/d1b/d24/d38/f3a zero size 2023-12-05T09:57:24.460 INFO:tasks.workunit.client.1.smithi150.stdout:4/173: mknod d0/c31 0 2023-12-05T09:57:24.461 INFO:tasks.workunit.client.0.smithi100.stdout:8/210: creat d0/d12/f32 x:0 0 0 2023-12-05T09:57:24.464 INFO:tasks.workunit.client.1.smithi150.stdout:1/244: creat d6/d38/d4a/f57 x:0 0 0 2023-12-05T09:57:24.465 INFO:tasks.workunit.client.0.smithi100.stdout:8/211: write d0/f17 [174267,12379] 0 2023-12-05T09:57:24.469 INFO:tasks.workunit.client.0.smithi100.stdout:4/191: dwrite de/f15 [0,4194304] 0 2023-12-05T09:57:24.469 INFO:tasks.workunit.client.0.smithi100.stdout:4/192: chown de/f11 62940 1 2023-12-05T09:57:24.478 INFO:tasks.workunit.client.0.smithi100.stdout:4/193: creat de/d16/d23/d36/f3a x:0 0 0 2023-12-05T09:57:24.478 INFO:tasks.workunit.client.0.smithi100.stdout:4/194: truncate de/f1b 946269 0 2023-12-05T09:57:24.481 INFO:tasks.workunit.client.1.smithi150.stdout:8/195: dread d0/d8/d14/d1b/f1c [0,4194304] 0 2023-12-05T09:57:24.481 INFO:tasks.workunit.client.1.smithi150.stdout:5/219: dread d1/d3/d6/f10 [0,4194304] 0 2023-12-05T09:57:24.484 INFO:tasks.workunit.client.1.smithi150.stdout:4/174: dread d0/f30 [0,4194304] 0 2023-12-05T09:57:24.484 INFO:tasks.workunit.client.1.smithi150.stdout:4/175: truncate d0/f20 4633062 0 2023-12-05T09:57:24.486 INFO:tasks.workunit.client.1.smithi150.stdout:1/245: rename d6/d3c/l42 to d6/d3c/l58 0 2023-12-05T09:57:24.487 INFO:tasks.workunit.client.0.smithi100.stdout:9/292: dwrite d7/d1b/d22/f4a [0,4194304] 0 2023-12-05T09:57:24.488 INFO:tasks.workunit.client.1.smithi150.stdout:0/234: rmdir d5/d11/d16/d1f 39 2023-12-05T09:57:24.488 INFO:tasks.workunit.client.1.smithi150.stdout:0/235: fdatasync d5/ff 0 2023-12-05T09:57:24.488 INFO:tasks.workunit.client.1.smithi150.stdout:0/236: truncate d5/fd 4923359 0 2023-12-05T09:57:24.489 INFO:tasks.workunit.client.1.smithi150.stdout:0/237: write d5/f31 [4519058,17221] 0 2023-12-05T09:57:24.491 INFO:tasks.workunit.client.0.smithi100.stdout:9/293: truncate d7/fb 4742936 0 2023-12-05T09:57:24.491 INFO:tasks.workunit.client.0.smithi100.stdout:4/195: dread de/f14 [0,4194304] 0 2023-12-05T09:57:24.494 INFO:tasks.workunit.client.1.smithi150.stdout:1/246: mkdir d6/d8/d59 0 2023-12-05T09:57:24.502 INFO:tasks.workunit.client.1.smithi150.stdout:1/247: rename d6/d8/db/d1b/c50 to d6/d8/db/d1b/c5a 0 2023-12-05T09:57:24.502 INFO:tasks.workunit.client.1.smithi150.stdout:1/248: chown d6/d8/l17 2840068 1 2023-12-05T09:57:24.505 INFO:tasks.workunit.client.0.smithi100.stdout:1/261: dwrite db/f1a [0,4194304] 0 2023-12-05T09:57:24.505 INFO:tasks.workunit.client.1.smithi150.stdout:8/196: rmdir d0/d8/d14/d1b/d24 39 2023-12-05T09:57:24.506 INFO:tasks.workunit.client.0.smithi100.stdout:1/262: chown db/d31/d3a/d3b/f4b 500 1 2023-12-05T09:57:24.506 INFO:tasks.workunit.client.0.smithi100.stdout:3/308: dwrite d0/f3b [0,4194304] 0 2023-12-05T09:57:24.506 INFO:tasks.workunit.client.1.smithi150.stdout:1/249: fsync d6/d8/db/de/f32 0 2023-12-05T09:57:24.506 INFO:tasks.workunit.client.1.smithi150.stdout:1/250: truncate d6/f3f 599825 0 2023-12-05T09:57:24.509 INFO:tasks.workunit.client.0.smithi100.stdout:4/196: truncate de/d16/d23/f29 919442 0 2023-12-05T09:57:24.510 INFO:tasks.workunit.client.1.smithi150.stdout:7/209: dwrite d2/db/d30/d18/d1a/f1f [0,4194304] 0 2023-12-05T09:57:24.510 INFO:tasks.workunit.client.1.smithi150.stdout:7/210: chown d2/db/d30/d13/f1d 799 1 2023-12-05T09:57:24.510 INFO:tasks.workunit.client.1.smithi150.stdout:0/238: write d5/d11/d16/f17 [1322573,1431] 0 2023-12-05T09:57:24.514 INFO:tasks.workunit.client.0.smithi100.stdout:3/309: link d0/d4/d3a/c5d d0/d10/d39/c66 0 2023-12-05T09:57:24.515 INFO:tasks.workunit.client.1.smithi150.stdout:5/220: write d1/d3/d6/f3f [1969878,124683] 0 2023-12-05T09:57:24.515 INFO:tasks.workunit.client.1.smithi150.stdout:5/221: fdatasync d1/d3/d1e/d21/f35 0 2023-12-05T09:57:24.516 INFO:tasks.workunit.client.1.smithi150.stdout:5/222: stat d1/d3/d6/d26/l47 0 2023-12-05T09:57:24.516 INFO:tasks.workunit.client.0.smithi100.stdout:4/197: link de/c1f de/d16/d23/c3b 0 2023-12-05T09:57:24.516 INFO:tasks.workunit.client.0.smithi100.stdout:4/198: chown de/d16/d23/c3b 35723 1 2023-12-05T09:57:24.516 INFO:tasks.workunit.client.0.smithi100.stdout:4/199: write de/d16/f2f [2527359,97349] 0 2023-12-05T09:57:24.520 INFO:tasks.workunit.client.0.smithi100.stdout:3/310: mkdir d0/d3d/d5c/d5f/d67 0 2023-12-05T09:57:24.523 INFO:tasks.workunit.client.1.smithi150.stdout:2/228: sync 2023-12-05T09:57:24.523 INFO:tasks.workunit.client.1.smithi150.stdout:9/193: sync 2023-12-05T09:57:24.523 INFO:tasks.workunit.client.1.smithi150.stdout:2/229: read d0/d3/d5/f40 [121387,52124] 0 2023-12-05T09:57:24.523 INFO:tasks.workunit.client.1.smithi150.stdout:2/230: read d0/d3/d11/f18 [2889952,19933] 0 2023-12-05T09:57:24.523 INFO:tasks.workunit.client.1.smithi150.stdout:9/194: write d3/d1b/f36 [3463312,119280] 0 2023-12-05T09:57:24.524 INFO:tasks.workunit.client.1.smithi150.stdout:1/251: creat d6/d8/db/f5b x:0 0 0 2023-12-05T09:57:24.524 INFO:tasks.workunit.client.1.smithi150.stdout:1/252: dread - d6/f53 zero size 2023-12-05T09:57:24.531 INFO:tasks.workunit.client.0.smithi100.stdout:9/294: dwrite d7/d1b/d22/d51/f2d [0,4194304] 0 2023-12-05T09:57:24.531 INFO:tasks.workunit.client.0.smithi100.stdout:9/295: fsync d7/f9 0 2023-12-05T09:57:24.531 INFO:tasks.workunit.client.0.smithi100.stdout:9/296: fdatasync d7/d1b/d22/f38 0 2023-12-05T09:57:24.532 INFO:tasks.workunit.client.0.smithi100.stdout:3/311: unlink d0/d2/de/d12/f3f 0 2023-12-05T09:57:24.538 INFO:tasks.workunit.client.1.smithi150.stdout:7/211: unlink d2/db/d30/d13/f3e 0 2023-12-05T09:57:24.539 INFO:tasks.workunit.client.0.smithi100.stdout:9/297: read d7/f29 [8622,77442] 0 2023-12-05T09:57:24.539 INFO:tasks.workunit.client.0.smithi100.stdout:9/298: chown d7/d1b/d22/d51/f11 2324750 1 2023-12-05T09:57:24.539 INFO:tasks.workunit.client.0.smithi100.stdout:1/263: dread db/fd [0,4194304] 0 2023-12-05T09:57:24.543 INFO:tasks.workunit.client.0.smithi100.stdout:8/212: dwrite d0/f31 [0,4194304] 0 2023-12-05T09:57:24.544 INFO:tasks.workunit.client.0.smithi100.stdout:8/213: truncate d0/d12/d13/d16/d22/f26 251027 0 2023-12-05T09:57:24.549 INFO:tasks.workunit.client.1.smithi150.stdout:9/195: rename d3/d9/dc/d1f/c22 to d3/d1b/c3b 0 2023-12-05T09:57:24.550 INFO:tasks.workunit.client.1.smithi150.stdout:1/253: symlink d6/d38/l5c 0 2023-12-05T09:57:24.552 INFO:tasks.workunit.client.0.smithi100.stdout:3/312: mknod d0/d2/de/d11/c68 0 2023-12-05T09:57:24.554 INFO:tasks.workunit.client.1.smithi150.stdout:7/212: creat d2/db/d17/d20/f3f x:0 0 0 2023-12-05T09:57:24.554 INFO:tasks.workunit.client.1.smithi150.stdout:7/213: read d2/d4/fc [6015647,54248] 0 2023-12-05T09:57:24.558 INFO:tasks.workunit.client.1.smithi150.stdout:8/197: dwrite d0/ff [0,4194304] 0 2023-12-05T09:57:24.558 INFO:tasks.workunit.client.1.smithi150.stdout:8/198: stat d0/d8/cd 0 2023-12-05T09:57:24.558 INFO:tasks.workunit.client.1.smithi150.stdout:8/199: chown d0/d8/c17 137 1 2023-12-05T09:57:24.561 INFO:tasks.workunit.client.1.smithi150.stdout:4/176: dwrite d0/f17 [0,4194304] 0 2023-12-05T09:57:24.561 INFO:tasks.workunit.client.1.smithi150.stdout:4/177: creat d0/d11/f32 x:0 0 0 2023-12-05T09:57:24.564 INFO:tasks.workunit.client.1.smithi150.stdout:5/223: dwrite d1/d3/d6/d1b/d22/d24/f41 [0,4194304] 0 2023-12-05T09:57:24.564 INFO:tasks.workunit.client.1.smithi150.stdout:5/224: write d1/d3/d6/d26/f30 [4307209,116865] 0 2023-12-05T09:57:24.564 INFO:tasks.workunit.client.1.smithi150.stdout:5/225: write d1/d3/f1d [1599165,7139] 0 2023-12-05T09:57:24.571 INFO:tasks.workunit.client.1.smithi150.stdout:0/239: link d5/d11/d16/d3f/d46/l4c d5/d11/d16/l4d 0 2023-12-05T09:57:24.576 INFO:tasks.workunit.client.0.smithi100.stdout:3/313: write d0/d2/de/d12/f63 [1980725,106424] 0 2023-12-05T09:57:24.576 INFO:tasks.workunit.client.0.smithi100.stdout:9/299: mkdir d7/d60 0 2023-12-05T09:57:24.576 INFO:tasks.workunit.client.1.smithi150.stdout:9/196: symlink d3/d9/l3c 0 2023-12-05T09:57:24.578 INFO:tasks.workunit.client.0.smithi100.stdout:7/205: rename d3/dc/f14 to d3/dc/d11/d13/de/f48 0 2023-12-05T09:57:24.579 INFO:tasks.workunit.client.1.smithi150.stdout:1/254: truncate d6/d8/db/de/f32 1754229 0 2023-12-05T09:57:24.586 INFO:tasks.workunit.client.0.smithi100.stdout:6/594: rename d7/d2d/d6a/d7c/f84 to d7/d11/d1a/db7/fc0 0 2023-12-05T09:57:24.587 INFO:tasks.workunit.client.0.smithi100.stdout:6/595: dread - d7/d27/d97/fbb zero size 2023-12-05T09:57:24.589 INFO:tasks.workunit.client.0.smithi100.stdout:1/264: dwrite db/d12/d1e/f41 [4194304,4194304] 0 2023-12-05T09:57:24.589 INFO:tasks.workunit.client.0.smithi100.stdout:5/286: rename d0/d4/d14/f38 to d0/d1f/d25/f67 0 2023-12-05T09:57:24.589 INFO:tasks.workunit.client.0.smithi100.stdout:5/287: dread - d0/d1f/d25/f63 zero size 2023-12-05T09:57:24.590 INFO:tasks.workunit.client.1.smithi150.stdout:4/178: dread d0/fd [0,4194304] 0 2023-12-05T09:57:24.591 INFO:tasks.workunit.client.1.smithi150.stdout:8/200: truncate d0/d8/d14/d1b/d24/d34/f39 5100771 0 2023-12-05T09:57:24.592 INFO:tasks.workunit.client.1.smithi150.stdout:8/201: dread - d0/d8/d14/d1b/d24/f3b zero size 2023-12-05T09:57:24.592 INFO:tasks.workunit.client.1.smithi150.stdout:0/240: dread d5/d11/d16/d1f/f44 [0,4194304] 0 2023-12-05T09:57:24.595 INFO:tasks.workunit.client.0.smithi100.stdout:1/265: creat db/d12/d1e/f50 x:0 0 0 2023-12-05T09:57:24.595 INFO:tasks.workunit.client.0.smithi100.stdout:1/266: stat c6 0 2023-12-05T09:57:24.595 INFO:tasks.workunit.client.0.smithi100.stdout:1/267: chown db/d12/d1e/f34 1471 1 2023-12-05T09:57:24.595 INFO:tasks.workunit.client.0.smithi100.stdout:1/268: dread - db/d31/f46 zero size 2023-12-05T09:57:24.595 INFO:tasks.workunit.client.0.smithi100.stdout:1/269: creat db/d31/f51 x:0 0 0 2023-12-05T09:57:24.595 INFO:tasks.workunit.client.0.smithi100.stdout:1/270: chown db/d12/f16 68620461 1 2023-12-05T09:57:24.595 INFO:tasks.workunit.client.0.smithi100.stdout:5/288: rmdir d0/d16/d2b/d48/df 39 2023-12-05T09:57:24.595 INFO:tasks.workunit.client.0.smithi100.stdout:5/289: creat d0/d16/f68 x:0 0 0 2023-12-05T09:57:24.598 INFO:tasks.workunit.client.0.smithi100.stdout:4/200: rename de/c2d to de/d38/c3c 0 2023-12-05T09:57:24.604 INFO:tasks.workunit.client.1.smithi150.stdout:3/226: rmdir d6/d25 39 2023-12-05T09:57:24.608 INFO:tasks.workunit.client.0.smithi100.stdout:1/271: mkdir db/d12/d1e/d26/d30/d52 0 2023-12-05T09:57:24.609 INFO:tasks.workunit.client.0.smithi100.stdout:1/272: getdents db/d31/d4f 0 2023-12-05T09:57:24.610 INFO:tasks.workunit.client.0.smithi100.stdout:1/273: write db/d12/d1e/f34 [533603,17501] 0 2023-12-05T09:57:24.614 INFO:tasks.workunit.client.1.smithi150.stdout:7/214: dwrite d2/db/f26 [0,4194304] 0 2023-12-05T09:57:24.617 INFO:tasks.workunit.client.1.smithi150.stdout:6/186: unlink d2/l15 0 2023-12-05T09:57:24.617 INFO:tasks.workunit.client.1.smithi150.stdout:6/187: write d2/f2c [2778172,72948] 0 2023-12-05T09:57:24.617 INFO:tasks.workunit.client.1.smithi150.stdout:6/188: creat d2/d23/d2e/f43 x:0 0 0 2023-12-05T09:57:24.617 INFO:tasks.workunit.client.1.smithi150.stdout:6/189: write d2/d23/d2e/f43 [287682,18577] 0 2023-12-05T09:57:24.623 INFO:tasks.workunit.client.0.smithi100.stdout:4/201: mkdir de/d16/d23/d33/d3d 0 2023-12-05T09:57:24.625 INFO:tasks.workunit.client.1.smithi150.stdout:3/227: write d6/d25/d28/f2d [3196947,65039] 0 2023-12-05T09:57:24.627 INFO:tasks.workunit.client.0.smithi100.stdout:5/290: rename d0/d16/d2b/d48/f12 to d0/d4/d14/d35/f69 0 2023-12-05T09:57:24.633 INFO:tasks.workunit.client.0.smithi100.stdout:4/202: link f2 de/d16/d23/d36/f3e 0 2023-12-05T09:57:24.633 INFO:tasks.workunit.client.0.smithi100.stdout:4/203: stat de/d16/d1e/f30 0 2023-12-05T09:57:24.634 INFO:tasks.workunit.client.0.smithi100.stdout:4/204: chown de/d16/d1e/c2a 17442946 1 2023-12-05T09:57:24.643 INFO:tasks.workunit.client.0.smithi100.stdout:5/291: truncate d0/d16/d2b/d48/f5d 4114669 0 2023-12-05T09:57:24.645 INFO:tasks.workunit.client.0.smithi100.stdout:3/314: dwrite d0/d10/d39/f51 [0,4194304] 0 2023-12-05T09:57:24.648 INFO:tasks.workunit.client.1.smithi150.stdout:4/179: dwrite d0/d11/f2e [0,4194304] 0 2023-12-05T09:57:24.648 INFO:tasks.workunit.client.1.smithi150.stdout:4/180: write d0/f24 [937561,47919] 0 2023-12-05T09:57:24.655 INFO:tasks.workunit.client.1.smithi150.stdout:5/226: creat d1/d3/d38/f4f x:0 0 0 2023-12-05T09:57:24.659 INFO:tasks.workunit.client.1.smithi150.stdout:9/197: link d3/d9/d26/d34/c37 d3/d9/dc/c3d 0 2023-12-05T09:57:24.661 INFO:tasks.workunit.client.1.smithi150.stdout:1/255: getdents d6/d8/db/de 0 2023-12-05T09:57:24.666 INFO:tasks.workunit.client.1.smithi150.stdout:8/202: symlink d0/d8/d14/l3c 0 2023-12-05T09:57:24.666 INFO:tasks.workunit.client.1.smithi150.stdout:8/203: getdents d0/d8/d14/d1b/d24/d2e 0 2023-12-05T09:57:24.670 INFO:tasks.workunit.client.1.smithi150.stdout:0/241: link d5/d11/d16/d1f/c2b d5/d11/d16/c4e 0 2023-12-05T09:57:24.673 INFO:tasks.workunit.client.1.smithi150.stdout:4/181: dread d0/d11/f2e [0,4194304] 0 2023-12-05T09:57:24.673 INFO:tasks.workunit.client.1.smithi150.stdout:4/182: fsync d0/f20 0 2023-12-05T09:57:24.674 INFO:tasks.workunit.client.1.smithi150.stdout:4/183: stat d0/d11/f15 0 2023-12-05T09:57:24.675 INFO:tasks.workunit.client.0.smithi100.stdout:1/274: dwrite db/d12/d1e/f50 [0,4194304] 0 2023-12-05T09:57:24.675 INFO:tasks.workunit.client.1.smithi150.stdout:7/215: dwrite d2/db/d30/d18/d1a/d1e/f21 [8388608,4194304] 0 2023-12-05T09:57:24.677 INFO:tasks.workunit.client.0.smithi100.stdout:7/206: dwrite d3/f24 [0,4194304] 0 2023-12-05T09:57:24.677 INFO:tasks.workunit.client.0.smithi100.stdout:7/207: fsync d3/dc/f12 0 2023-12-05T09:57:24.680 INFO:tasks.workunit.client.1.smithi150.stdout:6/190: mkdir d2/d23/d2e/d44 0 2023-12-05T09:57:24.687 INFO:tasks.workunit.client.1.smithi150.stdout:3/228: rename d6/ff to d6/d22/d37/f4a 0 2023-12-05T09:57:24.697 INFO:tasks.workunit.client.0.smithi100.stdout:5/292: dwrite d0/d4/d14/f5b [0,4194304] 0 2023-12-05T09:57:24.701 INFO:tasks.workunit.client.1.smithi150.stdout:5/227: link d1/d3/d6/d1b/l42 d1/l50 0 2023-12-05T09:57:24.703 INFO:tasks.workunit.client.0.smithi100.stdout:1/275: mknod db/d12/d1e/d26/d30/d52/c53 0 2023-12-05T09:57:24.706 INFO:tasks.workunit.client.1.smithi150.stdout:1/256: creat d6/d47/d4c/f5d x:0 0 0 2023-12-05T09:57:24.706 INFO:tasks.workunit.client.1.smithi150.stdout:1/257: write d6/d8/db/f5b [927750,10315] 0 2023-12-05T09:57:24.709 INFO:tasks.workunit.client.0.smithi100.stdout:1/276: fsync db/d12/d1e/f50 0 2023-12-05T09:57:24.711 INFO:tasks.workunit.client.0.smithi100.stdout:3/315: rename d0/d2/f3c to d0/d3d/d5c/d5f/d67/f69 0 2023-12-05T09:57:24.714 INFO:tasks.workunit.client.0.smithi100.stdout:7/208: write d3/dc/f1d [3230414,63198] 0 2023-12-05T09:57:24.714 INFO:tasks.workunit.client.0.smithi100.stdout:4/205: dwrite de/d16/d23/f26 [0,4194304] 0 2023-12-05T09:57:24.715 INFO:tasks.workunit.client.0.smithi100.stdout:6/596: dwrite d7/d2d/f42 [0,4194304] 0 2023-12-05T09:57:24.715 INFO:tasks.workunit.client.0.smithi100.stdout:6/597: chown d7/d11/f8f 1989 1 2023-12-05T09:57:24.715 INFO:tasks.workunit.client.0.smithi100.stdout:6/598: chown d7/d11/d82/f29 103 1 2023-12-05T09:57:24.716 INFO:tasks.workunit.client.1.smithi150.stdout:8/204: dwrite d0/d8/d14/d1b/f2b [0,4194304] 0 2023-12-05T09:57:24.720 INFO:tasks.workunit.client.0.smithi100.stdout:5/293: link d0/d1b/f39 d0/d1f/f6a 0 2023-12-05T09:57:24.723 INFO:tasks.workunit.client.1.smithi150.stdout:7/216: truncate d2/d1b/f35 2182472 0 2023-12-05T09:57:24.725 INFO:tasks.workunit.client.0.smithi100.stdout:1/277: link db/d31/d3a/c3c db/d12/d1e/d26/d39/c54 0 2023-12-05T09:57:24.727 INFO:tasks.workunit.client.1.smithi150.stdout:6/191: link d2/f13 d2/d23/f45 0 2023-12-05T09:57:24.728 INFO:tasks.workunit.client.1.smithi150.stdout:6/192: write d2/d23/f29 [3343626,42288] 0 2023-12-05T09:57:24.728 INFO:tasks.workunit.client.1.smithi150.stdout:0/242: dwrite d5/d11/d16/d3f/f3d [0,4194304] 0 2023-12-05T09:57:24.729 INFO:tasks.workunit.client.0.smithi100.stdout:5/294: dread d0/d16/f1e [0,4194304] 0 2023-12-05T09:57:24.729 INFO:tasks.workunit.client.1.smithi150.stdout:3/229: symlink d6/d9/d3d/l4b 0 2023-12-05T09:57:24.729 INFO:tasks.workunit.client.1.smithi150.stdout:3/230: chown d6/f1f 32717731 1 2023-12-05T09:57:24.732 INFO:tasks.workunit.client.1.smithi150.stdout:9/198: rename d3/d1b/l1e to d3/d9/dc/l3e 0 2023-12-05T09:57:24.734 INFO:tasks.workunit.client.1.smithi150.stdout:5/228: creat d1/f51 x:0 0 0 2023-12-05T09:57:24.736 INFO:tasks.workunit.client.0.smithi100.stdout:7/209: rmdir d3/dc/d11/d13/de/d2d/d3e 0 2023-12-05T09:57:24.736 INFO:tasks.workunit.client.0.smithi100.stdout:7/210: stat d3/dc/f12 0 2023-12-05T09:57:24.738 INFO:tasks.workunit.client.1.smithi150.stdout:1/258: mknod d6/d8/c5e 0 2023-12-05T09:57:24.741 INFO:tasks.workunit.client.1.smithi150.stdout:1/259: write d6/d8/db/de/f22 [380204,32857] 0 2023-12-05T09:57:24.744 INFO:tasks.workunit.client.0.smithi100.stdout:4/206: creat de/d16/d23/d33/d3d/f3f x:0 0 0 2023-12-05T09:57:24.747 INFO:tasks.workunit.client.1.smithi150.stdout:7/217: mkdir d2/db/d30/d18/d40 0 2023-12-05T09:57:24.748 INFO:tasks.workunit.client.0.smithi100.stdout:6/599: link d7/d2d/f40 d7/d76/fc1 0 2023-12-05T09:57:24.748 INFO:tasks.workunit.client.0.smithi100.stdout:6/600: write d7/d2d/d6a/fad [63109,2079] 0 2023-12-05T09:57:24.748 INFO:tasks.workunit.client.0.smithi100.stdout:6/601: creat d7/d27/d97/fc2 x:0 0 0 2023-12-05T09:57:24.752 INFO:tasks.workunit.client.0.smithi100.stdout:5/295: mknod d0/d1f/d25/c6b 0 2023-12-05T09:57:24.756 INFO:tasks.workunit.client.1.smithi150.stdout:6/193: mkdir d2/d23/d3b/d46 0 2023-12-05T09:57:24.756 INFO:tasks.workunit.client.1.smithi150.stdout:6/194: write d2/d23/f3f [27181,107670] 0 2023-12-05T09:57:24.756 INFO:tasks.workunit.client.1.smithi150.stdout:6/195: read d2/f2c [2186524,127995] 0 2023-12-05T09:57:24.759 INFO:tasks.workunit.client.1.smithi150.stdout:0/243: truncate d5/d11/d16/f17 906146 0 2023-12-05T09:57:24.761 INFO:tasks.workunit.client.1.smithi150.stdout:7/218: dread d2/d4/f23 [0,4194304] 0 2023-12-05T09:57:24.761 INFO:tasks.workunit.client.1.smithi150.stdout:7/219: readlink d2/d4/l7 0 2023-12-05T09:57:24.761 INFO:tasks.workunit.client.1.smithi150.stdout:8/205: dwrite d0/d8/d14/d1b/f31 [0,4194304] 0 2023-12-05T09:57:24.761 INFO:tasks.workunit.client.1.smithi150.stdout:3/231: link d6/d25/d28/c34 d6/d19/d30/c4c 0 2023-12-05T09:57:24.763 INFO:tasks.workunit.client.1.smithi150.stdout:4/184: rename d0/d11/l21 to d0/l33 0 2023-12-05T09:57:24.763 INFO:tasks.workunit.client.1.smithi150.stdout:4/185: write d0/d11/f23 [988162,109637] 0 2023-12-05T09:57:24.763 INFO:tasks.workunit.client.1.smithi150.stdout:4/186: fdatasync d0/ff 0 2023-12-05T09:57:24.764 INFO:tasks.workunit.client.1.smithi150.stdout:4/187: fsync d0/ff 0 2023-12-05T09:57:24.764 INFO:tasks.workunit.client.1.smithi150.stdout:4/188: creat d0/d11/f34 x:0 0 0 2023-12-05T09:57:24.766 INFO:tasks.workunit.client.1.smithi150.stdout:9/199: creat d3/d9/d26/f3f x:0 0 0 2023-12-05T09:57:24.766 INFO:tasks.workunit.client.1.smithi150.stdout:9/200: dread - d3/d9/f31 zero size 2023-12-05T09:57:24.766 INFO:tasks.workunit.client.0.smithi100.stdout:0/267: sync 2023-12-05T09:57:24.766 INFO:tasks.workunit.client.0.smithi100.stdout:0/268: readlink da/d1b/l46 0 2023-12-05T09:57:24.766 INFO:tasks.workunit.client.0.smithi100.stdout:0/269: chown da/d22/d33/d35/d3a/f47 125830582 1 2023-12-05T09:57:24.766 INFO:tasks.workunit.client.0.smithi100.stdout:0/270: write da/d1b/d36/f4f [4780633,65959] 0 2023-12-05T09:57:24.767 INFO:tasks.workunit.client.0.smithi100.stdout:0/271: write da/f37 [119490,120072] 0 2023-12-05T09:57:24.767 INFO:tasks.workunit.client.0.smithi100.stdout:0/272: read da/f11 [9721925,84745] 0 2023-12-05T09:57:24.767 INFO:tasks.workunit.client.0.smithi100.stdout:5/296: dread d0/d1f/d25/f67 [0,4194304] 0 2023-12-05T09:57:24.769 INFO:tasks.workunit.client.1.smithi150.stdout:1/260: getdents d6/d47 0 2023-12-05T09:57:24.773 INFO:tasks.workunit.client.1.smithi150.stdout:0/244: link d5/d11/d32/d37/c49 d5/c4f 0 2023-12-05T09:57:24.773 INFO:tasks.workunit.client.1.smithi150.stdout:0/245: write d5/fa [954143,97062] 0 2023-12-05T09:57:24.773 INFO:tasks.workunit.client.1.smithi150.stdout:0/246: truncate d5/fa 2066992 0 2023-12-05T09:57:24.773 INFO:tasks.workunit.client.1.smithi150.stdout:0/247: write d5/d11/d16/f1e [4615744,42381] 0 2023-12-05T09:57:24.773 INFO:tasks.workunit.client.1.smithi150.stdout:0/248: dread - d5/f41 zero size 2023-12-05T09:57:24.774 INFO:tasks.workunit.client.1.smithi150.stdout:9/201: dread d3/d9/f1c [0,4194304] 0 2023-12-05T09:57:24.777 INFO:tasks.workunit.client.0.smithi100.stdout:7/211: rename d3/dc/d11/d13/d37/c38 to d3/dc/d11/d13/de/d18/c49 0 2023-12-05T09:57:24.777 INFO:tasks.workunit.client.0.smithi100.stdout:4/207: symlink de/d16/d1e/l40 0 2023-12-05T09:57:24.777 INFO:tasks.workunit.client.0.smithi100.stdout:4/208: creat de/d16/d1e/f41 x:0 0 0 2023-12-05T09:57:24.779 INFO:tasks.workunit.client.1.smithi150.stdout:7/220: mknod d2/d1b/d31/c41 0 2023-12-05T09:57:24.780 INFO:tasks.workunit.client.1.smithi150.stdout:7/221: chown d2/db 16185506 1 2023-12-05T09:57:24.780 INFO:tasks.workunit.client.0.smithi100.stdout:3/316: rmdir d0 39 2023-12-05T09:57:24.782 INFO:tasks.workunit.client.0.smithi100.stdout:6/602: symlink d7/d11/d1a/lc3 0 2023-12-05T09:57:24.785 INFO:tasks.workunit.client.1.smithi150.stdout:3/232: creat d6/d38/f4d x:0 0 0 2023-12-05T09:57:24.785 INFO:tasks.workunit.client.1.smithi150.stdout:3/233: chown d6/d22/c39 540350 1 2023-12-05T09:57:24.785 INFO:tasks.workunit.client.1.smithi150.stdout:3/234: write d6/d9/d43/d47/f1a [4369220,86792] 0 2023-12-05T09:57:24.786 INFO:tasks.workunit.client.0.smithi100.stdout:0/273: write da/d1b/d36/f4f [4110980,129715] 0 2023-12-05T09:57:24.790 INFO:tasks.workunit.client.1.smithi150.stdout:8/206: rename d0/d8/d14/d1b/d24/d34/f39 to d0/d8/d14/d1b/d24/d38/f3d 0 2023-12-05T09:57:24.790 INFO:tasks.workunit.client.1.smithi150.stdout:8/207: dread - d0/d8/d14/d1b/d24/d38/f3a zero size 2023-12-05T09:57:24.790 INFO:tasks.workunit.client.1.smithi150.stdout:8/208: stat d0/d8/f11 0 2023-12-05T09:57:24.791 INFO:tasks.workunit.client.0.smithi100.stdout:7/212: dread d3/dc/d11/d13/f15 [0,4194304] 0 2023-12-05T09:57:24.791 INFO:tasks.workunit.client.0.smithi100.stdout:7/213: read d3/dc/f1d [1842218,56151] 0 2023-12-05T09:57:24.796 INFO:tasks.workunit.client.0.smithi100.stdout:1/278: getdents db/d12/d1e/d26/d39 0 2023-12-05T09:57:24.797 INFO:tasks.workunit.client.1.smithi150.stdout:9/202: dread d3/f2e [0,4194304] 0 2023-12-05T09:57:24.801 INFO:tasks.workunit.client.0.smithi100.stdout:5/297: mkdir d0/d1b/d4d/d6c 0 2023-12-05T09:57:24.801 INFO:tasks.workunit.client.0.smithi100.stdout:5/298: fsync d0/d16/d2b/d48/f5d 0 2023-12-05T09:57:24.804 INFO:tasks.workunit.client.1.smithi150.stdout:5/229: getdents d1/d3/d6/d1b/d22/d24 0 2023-12-05T09:57:24.804 INFO:tasks.workunit.client.0.smithi100.stdout:0/274: read da/f2d [707534,85623] 0 2023-12-05T09:57:24.807 INFO:tasks.workunit.client.0.smithi100.stdout:5/299: dread d0/d1f/d25/d31/f3f [0,4194304] 0 2023-12-05T09:57:24.808 INFO:tasks.workunit.client.1.smithi150.stdout:1/261: mknod d6/d8/d54/c5f 0 2023-12-05T09:57:24.809 INFO:tasks.workunit.client.1.smithi150.stdout:6/196: dwrite d2/f26 [0,4194304] 0 2023-12-05T09:57:24.810 INFO:tasks.workunit.client.1.smithi150.stdout:9/203: write d3/d9/f17 [296143,14371] 0 2023-12-05T09:57:24.810 INFO:tasks.workunit.client.1.smithi150.stdout:9/204: creat d3/f40 x:0 0 0 2023-12-05T09:57:24.810 INFO:tasks.workunit.client.1.smithi150.stdout:8/209: write d0/d8/d14/d1b/f2b [1930828,86919] 0 2023-12-05T09:57:24.810 INFO:tasks.workunit.client.1.smithi150.stdout:9/205: chown d3/d1b 16373 1 2023-12-05T09:57:24.810 INFO:tasks.workunit.client.1.smithi150.stdout:8/210: stat d0/d8/d14/d1b/d24/d2e/d30 0 2023-12-05T09:57:24.810 INFO:tasks.workunit.client.1.smithi150.stdout:9/206: creat d3/d9/d26/f41 x:0 0 0 2023-12-05T09:57:24.813 INFO:tasks.workunit.client.0.smithi100.stdout:3/317: read d0/d2/de/d12/f1a [7569210,49316] 0 2023-12-05T09:57:24.814 INFO:tasks.workunit.client.1.smithi150.stdout:0/249: creat d5/d11/d32/f50 x:0 0 0 2023-12-05T09:57:24.814 INFO:tasks.workunit.client.1.smithi150.stdout:0/250: write d5/fd [3507529,79778] 0 2023-12-05T09:57:24.814 INFO:tasks.workunit.client.1.smithi150.stdout:7/222: creat d2/d4/f42 x:0 0 0 2023-12-05T09:57:24.814 INFO:tasks.workunit.client.1.smithi150.stdout:7/223: write d2/f25 [5012160,65237] 0 2023-12-05T09:57:24.819 INFO:tasks.workunit.client.0.smithi100.stdout:4/209: rename de/f15 to de/d38/f42 0 2023-12-05T09:57:24.819 INFO:tasks.workunit.client.1.smithi150.stdout:5/230: dread d1/d3/d6/d11/f2f [0,4194304] 0 2023-12-05T09:57:24.823 INFO:tasks.workunit.client.0.smithi100.stdout:0/275: dread da/f37 [0,4194304] 0 2023-12-05T09:57:24.823 INFO:tasks.workunit.client.0.smithi100.stdout:6/603: creat d7/d11/d1a/db1/fc4 x:0 0 0 2023-12-05T09:57:24.824 INFO:tasks.workunit.client.0.smithi100.stdout:6/604: creat d7/d27/d97/fc5 x:0 0 0 2023-12-05T09:57:24.824 INFO:tasks.workunit.client.0.smithi100.stdout:6/605: truncate d7/d2d/d6a/fad 522261 0 2023-12-05T09:57:24.824 INFO:tasks.workunit.client.1.smithi150.stdout:3/235: mknod d6/d25/c4e 0 2023-12-05T09:57:24.828 INFO:tasks.workunit.client.0.smithi100.stdout:7/214: creat d3/dc/f4a x:0 0 0 2023-12-05T09:57:24.828 INFO:tasks.workunit.client.0.smithi100.stdout:1/279: creat db/f55 x:0 0 0 2023-12-05T09:57:24.828 INFO:tasks.workunit.client.0.smithi100.stdout:1/280: fdatasync db/d31/d3a/f4c 0 2023-12-05T09:57:24.832 INFO:tasks.workunit.client.1.smithi150.stdout:2/231: sync 2023-12-05T09:57:24.833 INFO:tasks.workunit.client.1.smithi150.stdout:1/262: mkdir d6/d47/d4c/d60 0 2023-12-05T09:57:24.836 INFO:tasks.workunit.client.0.smithi100.stdout:4/210: dread de/f12 [0,4194304] 0 2023-12-05T09:57:24.837 INFO:tasks.workunit.client.0.smithi100.stdout:4/211: readlink de/d16/d1e/l40 0 2023-12-05T09:57:24.840 INFO:tasks.workunit.client.1.smithi150.stdout:6/197: link d2/da/c2f d2/d23/d2e/d44/c47 0 2023-12-05T09:57:24.840 INFO:tasks.workunit.client.1.smithi150.stdout:6/198: dread - d2/d23/d2e/d39/f40 zero size 2023-12-05T09:57:24.844 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:24 smithi100 ceph-mon[107145]: pgmap v28: 65 pgs: 65 active+clean; 627 MiB data, 3.6 GiB used, 533 GiB / 536 GiB avail; 26 MiB/s rd, 41 MiB/s wr, 574 op/s 2023-12-05T09:57:24.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:24 smithi150 ceph-mon[116142]: pgmap v28: 65 pgs: 65 active+clean; 627 MiB data, 3.6 GiB used, 533 GiB / 536 GiB avail; 26 MiB/s rd, 41 MiB/s wr, 574 op/s 2023-12-05T09:57:24.846 INFO:tasks.workunit.client.0.smithi100.stdout:5/300: creat d0/d1b/d4d/d60/f6d x:0 0 0 2023-12-05T09:57:24.847 INFO:tasks.workunit.client.0.smithi100.stdout:5/301: truncate d0/d27/f4b 661753 0 2023-12-05T09:57:24.847 INFO:tasks.workunit.client.1.smithi150.stdout:1/263: dread d6/d8/db/f2b [0,4194304] 0 2023-12-05T09:57:24.847 INFO:tasks.workunit.client.0.smithi100.stdout:0/276: dread da/d22/f3b [0,4194304] 0 2023-12-05T09:57:24.847 INFO:tasks.workunit.client.0.smithi100.stdout:0/277: creat da/d1b/f52 x:0 0 0 2023-12-05T09:57:24.857 INFO:tasks.workunit.client.1.smithi150.stdout:8/211: link d0/d8/d14/d1b/d24/l2d d0/d8/d14/d1b/d24/d2e/d30/l3e 0 2023-12-05T09:57:24.857 INFO:tasks.workunit.client.1.smithi150.stdout:9/207: dwrite d3/d9/d26/f21 [0,4194304] 0 2023-12-05T09:57:24.859 INFO:tasks.workunit.client.0.smithi100.stdout:6/606: unlink d7/d11/c47 0 2023-12-05T09:57:24.861 INFO:tasks.workunit.client.0.smithi100.stdout:4/212: truncate de/f25 851027 0 2023-12-05T09:57:24.864 INFO:tasks.workunit.client.1.smithi150.stdout:7/224: creat d2/d29/f43 x:0 0 0 2023-12-05T09:57:24.864 INFO:tasks.workunit.client.1.smithi150.stdout:7/225: write d2/db/d17/d20/f3f [212883,56788] 0 2023-12-05T09:57:24.864 INFO:tasks.workunit.client.1.smithi150.stdout:7/226: readlink d2/db/d17/d20/l33 0 2023-12-05T09:57:24.865 INFO:tasks.workunit.client.0.smithi100.stdout:5/302: mknod d0/d16/d2b/d48/df/c6e 0 2023-12-05T09:57:24.865 INFO:tasks.workunit.client.0.smithi100.stdout:5/303: dread - d0/d1b/d4d/f58 zero size 2023-12-05T09:57:24.867 INFO:tasks.workunit.client.1.smithi150.stdout:5/231: unlink d1/d3/c4c 0 2023-12-05T09:57:24.869 INFO:tasks.workunit.client.0.smithi100.stdout:7/215: dwrite d3/dc/d11/d13/de/d2d/f44 [0,4194304] 0 2023-12-05T09:57:24.871 INFO:tasks.workunit.client.1.smithi150.stdout:3/236: truncate d6/d9/f1d 2886951 0 2023-12-05T09:57:24.872 INFO:tasks.workunit.client.0.smithi100.stdout:0/278: rename da/l41 to da/d2a/d4d/l53 0 2023-12-05T09:57:24.872 INFO:tasks.workunit.client.0.smithi100.stdout:0/279: creat da/d1b/f54 x:0 0 0 2023-12-05T09:57:24.877 INFO:tasks.workunit.client.0.smithi100.stdout:6/607: link d7/d2d/d6a/f95 d7/d11/d82/fc6 0 2023-12-05T09:57:24.880 INFO:tasks.workunit.client.0.smithi100.stdout:6/608: creat d7/fc7 x:0 0 0 2023-12-05T09:57:24.881 INFO:tasks.workunit.client.0.smithi100.stdout:5/304: truncate d0/d16/d2b/d48/df/f20 1373490 0 2023-12-05T09:57:24.883 INFO:tasks.workunit.client.1.smithi150.stdout:4/189: rmdir d0/d11 39 2023-12-05T09:57:24.883 INFO:tasks.workunit.client.1.smithi150.stdout:4/190: write d0/d11/f34 [310442,115876] 0 2023-12-05T09:57:24.883 INFO:tasks.workunit.client.1.smithi150.stdout:5/232: dread d1/d3/d6/d26/f3e [0,4194304] 0 2023-12-05T09:57:24.883 INFO:tasks.workunit.client.1.smithi150.stdout:5/233: creat d1/d2e/f52 x:0 0 0 2023-12-05T09:57:24.884 INFO:tasks.workunit.client.1.smithi150.stdout:5/234: dread - d1/d2e/f52 zero size 2023-12-05T09:57:24.886 INFO:tasks.workunit.client.1.smithi150.stdout:3/237: write d6/d25/d28/f2e [497366,85158] 0 2023-12-05T09:57:24.886 INFO:tasks.workunit.client.1.smithi150.stdout:2/232: symlink d0/d3/d11/l4f 0 2023-12-05T09:57:24.886 INFO:tasks.workunit.client.0.smithi100.stdout:2/376: sync 2023-12-05T09:57:24.888 INFO:tasks.workunit.client.0.smithi100.stdout:7/216: creat d3/dc/d11/d13/d37/f4b x:0 0 0 2023-12-05T09:57:24.889 INFO:tasks.workunit.client.0.smithi100.stdout:7/217: write d3/dc/f3a [868289,25654] 0 2023-12-05T09:57:24.894 INFO:tasks.workunit.client.1.smithi150.stdout:1/264: symlink d6/d47/l61 0 2023-12-05T09:57:24.894 INFO:tasks.workunit.client.1.smithi150.stdout:1/265: write d6/d8/db/f30 [4278269,72990] 0 2023-12-05T09:57:24.897 INFO:tasks.workunit.client.0.smithi100.stdout:0/280: mknod da/d2a/d4d/c55 0 2023-12-05T09:57:24.897 INFO:tasks.workunit.client.0.smithi100.stdout:0/281: write da/d2a/f3f [4459503,26747] 0 2023-12-05T09:57:24.899 INFO:tasks.workunit.client.0.smithi100.stdout:5/305: symlink d0/d1f/l6f 0 2023-12-05T09:57:24.899 INFO:tasks.workunit.client.0.smithi100.stdout:5/306: chown d0/f2 3 1 2023-12-05T09:57:24.899 INFO:tasks.workunit.client.0.smithi100.stdout:5/307: truncate d0/d4/fa 9149015 0 2023-12-05T09:57:24.900 INFO:tasks.workunit.client.0.smithi100.stdout:6/609: dread d7/d11/f8f [0,4194304] 0 2023-12-05T09:57:24.900 INFO:tasks.workunit.client.0.smithi100.stdout:6/610: stat d7/d27/d35/f3a 0 2023-12-05T09:57:24.900 INFO:tasks.workunit.client.0.smithi100.stdout:8/214: sync 2023-12-05T09:57:24.900 INFO:tasks.workunit.client.0.smithi100.stdout:9/300: sync 2023-12-05T09:57:24.900 INFO:tasks.workunit.client.0.smithi100.stdout:9/301: dread - d7/d1b/d22/d2a/f48 zero size 2023-12-05T09:57:24.901 INFO:tasks.workunit.client.0.smithi100.stdout:8/215: write d0/f2b [947125,23715] 0 2023-12-05T09:57:24.901 INFO:tasks.workunit.client.0.smithi100.stdout:9/302: write d7/d35/f55 [204945,13657] 0 2023-12-05T09:57:24.901 INFO:tasks.workunit.client.0.smithi100.stdout:2/377: stat d7/da/dc/c14 0 2023-12-05T09:57:24.901 INFO:tasks.workunit.client.0.smithi100.stdout:2/378: fdatasync d7/da/d18/d1b/d2c/f70 0 2023-12-05T09:57:24.902 INFO:tasks.workunit.client.0.smithi100.stdout:2/379: creat d7/da/d18/d1b/d2c/f82 x:0 0 0 2023-12-05T09:57:24.905 INFO:tasks.workunit.client.0.smithi100.stdout:7/218: mkdir d3/dc/d11/d13/de/d18/d3b/d40/d4c 0 2023-12-05T09:57:24.909 INFO:tasks.workunit.client.0.smithi100.stdout:7/219: fsync d3/dc/f4a 0 2023-12-05T09:57:24.909 INFO:tasks.workunit.client.0.smithi100.stdout:7/220: stat d3/dc/d11/d33 0 2023-12-05T09:57:24.913 INFO:tasks.workunit.client.1.smithi150.stdout:8/212: symlink d0/d8/d14/d1b/d24/d2e/l3f 0 2023-12-05T09:57:24.914 INFO:tasks.workunit.client.0.smithi100.stdout:3/318: rename d0/d3d/d5c/d5f/c61 to d0/d2/d33/c6a 0 2023-12-05T09:57:24.922 INFO:tasks.workunit.client.0.smithi100.stdout:8/216: truncate d0/fb 655506 0 2023-12-05T09:57:24.923 INFO:tasks.workunit.client.1.smithi150.stdout:7/227: creat d2/db/d30/d13/f44 x:0 0 0 2023-12-05T09:57:24.923 INFO:tasks.workunit.client.1.smithi150.stdout:7/228: write d2/db/d30/d18/d1a/f1f [4566624,114036] 0 2023-12-05T09:57:24.923 INFO:tasks.workunit.client.1.smithi150.stdout:7/229: creat d2/db/f45 x:0 0 0 2023-12-05T09:57:24.925 INFO:tasks.workunit.client.0.smithi100.stdout:9/303: unlink d7/d1b/d22/d2a/l54 0 2023-12-05T09:57:24.928 INFO:tasks.workunit.client.1.smithi150.stdout:5/235: rename d1/l5 to d1/d3/d1e/d31/l53 0 2023-12-05T09:57:24.928 INFO:tasks.workunit.client.0.smithi100.stdout:4/213: write de/d16/d23/f26 [854536,116485] 0 2023-12-05T09:57:24.932 INFO:tasks.workunit.client.1.smithi150.stdout:2/233: getdents d0 0 2023-12-05T09:57:24.933 INFO:tasks.workunit.client.1.smithi150.stdout:1/266: symlink d6/d8/db/de/l62 0 2023-12-05T09:57:24.935 INFO:tasks.workunit.client.0.smithi100.stdout:3/319: symlink d0/d48/l6b 0 2023-12-05T09:57:24.937 INFO:tasks.workunit.client.0.smithi100.stdout:8/217: creat d0/d12/d13/d16/d22/f33 x:0 0 0 2023-12-05T09:57:24.938 INFO:tasks.workunit.client.1.smithi150.stdout:4/191: dwrite d0/d11/f32 [0,4194304] 0 2023-12-05T09:57:24.953 INFO:tasks.workunit.client.0.smithi100.stdout:3/320: creat d0/d3d/f6c x:0 0 0 2023-12-05T09:57:24.953 INFO:tasks.workunit.client.0.smithi100.stdout:3/321: dread - d0/d4/d3a/f64 zero size 2023-12-05T09:57:24.953 INFO:tasks.workunit.client.0.smithi100.stdout:3/322: chown d0/l4b 517912954 1 2023-12-05T09:57:24.953 INFO:tasks.workunit.client.0.smithi100.stdout:3/323: fdatasync d0/f3b 0 2023-12-05T09:57:24.954 INFO:tasks.workunit.client.0.smithi100.stdout:5/308: dwrite d0/d27/f4b [0,4194304] 0 2023-12-05T09:57:24.954 INFO:tasks.workunit.client.0.smithi100.stdout:5/309: chown d0/d1b/d4d/d60 219815 1 2023-12-05T09:57:24.956 INFO:tasks.workunit.client.0.smithi100.stdout:8/218: symlink d0/d12/d13/d16/d22/l34 0 2023-12-05T09:57:24.964 INFO:tasks.workunit.client.1.smithi150.stdout:3/238: dread d6/d9/f1d [0,4194304] 0 2023-12-05T09:57:24.968 INFO:tasks.workunit.client.0.smithi100.stdout:2/380: dwrite d7/da/d18/d1b/d2c/d3f/d46/f76 [0,4194304] 0 2023-12-05T09:57:24.969 INFO:tasks.workunit.client.1.smithi150.stdout:5/236: truncate d1/d3/d6/f1c 2985593 0 2023-12-05T09:57:24.970 INFO:tasks.workunit.client.0.smithi100.stdout:5/310: creat d0/d4/d14/d35/f70 x:0 0 0 2023-12-05T09:57:24.971 INFO:tasks.workunit.client.1.smithi150.stdout:1/267: creat d6/d47/d4c/d60/f63 x:0 0 0 2023-12-05T09:57:24.972 INFO:tasks.workunit.client.0.smithi100.stdout:8/219: mkdir d0/d35 0 2023-12-05T09:57:24.972 INFO:tasks.workunit.client.0.smithi100.stdout:8/220: creat d0/d12/f36 x:0 0 0 2023-12-05T09:57:24.974 INFO:tasks.workunit.client.1.smithi150.stdout:8/213: mknod d0/d8/d14/d1b/c40 0 2023-12-05T09:57:24.974 INFO:tasks.workunit.client.1.smithi150.stdout:8/214: stat d0/d8/c18 0 2023-12-05T09:57:24.983 INFO:tasks.workunit.client.0.smithi100.stdout:7/221: dwrite d3/dc/d11/d13/de/f28 [0,4194304] 0 2023-12-05T09:57:24.983 INFO:tasks.workunit.client.0.smithi100.stdout:7/222: fsync d3/dc/d11/d13/de/f28 0 2023-12-05T09:57:24.990 INFO:tasks.workunit.client.0.smithi100.stdout:5/311: rename d0/d27/c2a to d0/d1f/d25/c71 0 2023-12-05T09:57:24.990 INFO:tasks.workunit.client.0.smithi100.stdout:5/312: readlink d0/d16/l3d 0 2023-12-05T09:57:24.996 INFO:tasks.workunit.client.1.smithi150.stdout:4/192: symlink d0/l35 0 2023-12-05T09:57:24.996 INFO:tasks.workunit.client.1.smithi150.stdout:4/193: dread - d0/f26 zero size 2023-12-05T09:57:25.003 INFO:tasks.workunit.client.0.smithi100.stdout:3/324: dwrite d0/d2/d33/f40 [0,4194304] 0 2023-12-05T09:57:25.003 INFO:tasks.workunit.client.1.smithi150.stdout:5/237: mknod d1/d3/c54 0 2023-12-05T09:57:25.009 INFO:tasks.workunit.client.0.smithi100.stdout:7/223: mknod d3/dc/d11/d13/de/d2d/d47/c4d 0 2023-12-05T09:57:25.010 INFO:tasks.workunit.client.1.smithi150.stdout:3/239: dwrite d6/f17 [0,4194304] 0 2023-12-05T09:57:25.012 INFO:tasks.workunit.client.1.smithi150.stdout:4/194: mknod d0/c36 0 2023-12-05T09:57:25.016 INFO:tasks.workunit.client.0.smithi100.stdout:7/224: rename d3/dc/d11/d13/f3c to d3/dc/d11/d13/de/d2d/f4e 0 2023-12-05T09:57:25.017 INFO:tasks.workunit.client.1.smithi150.stdout:1/268: rmdir d6/d8/d54 39 2023-12-05T09:57:25.018 INFO:tasks.workunit.client.0.smithi100.stdout:2/381: write d7/da/d18/d21/d4d/d81/f50 [684168,105656] 0 2023-12-05T09:57:25.021 INFO:tasks.workunit.client.0.smithi100.stdout:4/214: dwrite de/d16/d1e/f41 [0,4194304] 0 2023-12-05T09:57:25.021 INFO:tasks.workunit.client.0.smithi100.stdout:4/215: chown de/d38 271969 1 2023-12-05T09:57:25.022 INFO:tasks.workunit.client.1.smithi150.stdout:8/215: mkdir d0/d41 0 2023-12-05T09:57:25.026 INFO:tasks.workunit.client.1.smithi150.stdout:7/230: truncate d2/db/d30/d18/d1a/f1f 4673247 0 2023-12-05T09:57:25.035 INFO:tasks.workunit.client.1.smithi150.stdout:3/240: mknod d6/d22/d37/c4f 0 2023-12-05T09:57:25.035 INFO:tasks.workunit.client.1.smithi150.stdout:3/241: creat d6/d9/f50 x:0 0 0 2023-12-05T09:57:25.040 INFO:tasks.workunit.client.0.smithi100.stdout:9/304: write d7/d1b/d22/d51/f23 [2009417,3533] 0 2023-12-05T09:57:25.040 INFO:tasks.workunit.client.0.smithi100.stdout:9/305: fsync d7/d1b/d22/d51/f37 0 2023-12-05T09:57:25.042 INFO:tasks.workunit.client.1.smithi150.stdout:3/242: dread d6/d9/f1b [0,4194304] 0 2023-12-05T09:57:25.047 INFO:tasks.workunit.client.1.smithi150.stdout:1/269: write d6/d8/db/de/f14 [142211,110594] 0 2023-12-05T09:57:25.047 INFO:tasks.workunit.client.1.smithi150.stdout:1/270: chown d6/d8/db/f5b 2216 1 2023-12-05T09:57:25.047 INFO:tasks.workunit.client.1.smithi150.stdout:1/271: read - d6/d8/db/f35 zero size 2023-12-05T09:57:25.047 INFO:tasks.workunit.client.0.smithi100.stdout:2/382: creat d7/da/d18/d21/d4d/f83 x:0 0 0 2023-12-05T09:57:25.047 INFO:tasks.workunit.client.1.smithi150.stdout:4/195: creat d0/d11/f37 x:0 0 0 2023-12-05T09:57:25.050 INFO:tasks.workunit.client.0.smithi100.stdout:8/221: dwrite d0/d12/d13/d16/f2e [0,4194304] 0 2023-12-05T09:57:25.050 INFO:tasks.workunit.client.0.smithi100.stdout:5/313: dwrite d0/d1b/f39 [0,4194304] 0 2023-12-05T09:57:25.052 INFO:tasks.workunit.client.1.smithi150.stdout:5/238: dwrite d1/d3/d6/d26/f3e [0,4194304] 0 2023-12-05T09:57:25.052 INFO:tasks.workunit.client.1.smithi150.stdout:5/239: stat d1/d3/d6 0 2023-12-05T09:57:25.054 INFO:tasks.workunit.client.1.smithi150.stdout:8/216: mknod d0/d8/d14/d1b/d24/d34/c42 0 2023-12-05T09:57:25.055 INFO:tasks.workunit.client.0.smithi100.stdout:4/216: dwrite de/d16/f2f [0,4194304] 0 2023-12-05T09:57:25.057 INFO:tasks.workunit.client.1.smithi150.stdout:7/231: unlink d2/db/c2a 0 2023-12-05T09:57:25.057 INFO:tasks.workunit.client.1.smithi150.stdout:7/232: write d2/d4/f23 [8714713,26641] 0 2023-12-05T09:57:25.057 INFO:tasks.workunit.client.1.smithi150.stdout:7/233: fdatasync d2/d4/ff 0 2023-12-05T09:57:25.111 INFO:tasks.workunit.client.1.smithi150.stdout:3/243: mkdir d6/d19/d30/d36/d51 0 2023-12-05T09:57:25.115 INFO:tasks.workunit.client.1.smithi150.stdout:4/196: unlink d0/d11/f15 0 2023-12-05T09:57:25.117 INFO:tasks.workunit.client.1.smithi150.stdout:5/240: chown d1/d3/d1e/l2a 1353 1 2023-12-05T09:57:25.119 INFO:tasks.workunit.client.1.smithi150.stdout:8/217: mkdir d0/d8/d14/d1b/d24/d43 0 2023-12-05T09:57:25.121 INFO:tasks.workunit.client.0.smithi100.stdout:9/306: creat d7/d1b/d22/d2a/d56/d2e/d50/f61 x:0 0 0 2023-12-05T09:57:25.122 INFO:tasks.workunit.client.0.smithi100.stdout:9/307: creat d7/d35/f62 x:0 0 0 2023-12-05T09:57:25.122 INFO:tasks.workunit.client.0.smithi100.stdout:9/308: creat d7/d35/f63 x:0 0 0 2023-12-05T09:57:25.122 INFO:tasks.workunit.client.1.smithi150.stdout:7/234: write d2/db/d30/d13/f14 [4725702,128225] 0 2023-12-05T09:57:25.123 INFO:tasks.workunit.client.0.smithi100.stdout:2/383: symlink d7/da/d1a/l84 0 2023-12-05T09:57:25.123 INFO:tasks.workunit.client.0.smithi100.stdout:2/384: fdatasync d7/da/d13/f5d 0 2023-12-05T09:57:25.125 INFO:tasks.workunit.client.1.smithi150.stdout:5/241: link d1/d3/f7 d1/f55 0 2023-12-05T09:57:25.125 INFO:tasks.workunit.client.0.smithi100.stdout:8/222: dwrite d0/f17 [0,4194304] 0 2023-12-05T09:57:25.126 INFO:tasks.workunit.client.0.smithi100.stdout:8/223: fsync d0/d12/d13/d16/f20 0 2023-12-05T09:57:25.127 INFO:tasks.workunit.client.0.smithi100.stdout:7/225: rmdir d3/dc 39 2023-12-05T09:57:25.129 INFO:tasks.workunit.client.1.smithi150.stdout:1/272: dwrite d6/d8/db/f35 [0,4194304] 0 2023-12-05T09:57:25.130 INFO:tasks.workunit.client.1.smithi150.stdout:1/273: truncate d6/d8/d54/f55 651411 0 2023-12-05T09:57:25.131 INFO:tasks.workunit.client.1.smithi150.stdout:9/208: sync 2023-12-05T09:57:25.131 INFO:tasks.workunit.client.1.smithi150.stdout:0/251: sync 2023-12-05T09:57:25.131 INFO:tasks.workunit.client.1.smithi150.stdout:6/199: sync 2023-12-05T09:57:25.131 INFO:tasks.workunit.client.1.smithi150.stdout:0/252: chown d5/d11/d32/d37/l42 12 1 2023-12-05T09:57:25.131 INFO:tasks.workunit.client.1.smithi150.stdout:6/200: truncate d2/da/f22 1159851 0 2023-12-05T09:57:25.131 INFO:tasks.workunit.client.1.smithi150.stdout:9/209: write d3/f29 [610953,57949] 0 2023-12-05T09:57:25.135 INFO:tasks.workunit.client.1.smithi150.stdout:2/234: sync 2023-12-05T09:57:25.136 INFO:tasks.workunit.client.1.smithi150.stdout:2/235: truncate d0/d3/d5/d22/f35 5468823 0 2023-12-05T09:57:25.136 INFO:tasks.workunit.client.1.smithi150.stdout:2/236: fdatasync d0/d3/f14 0 2023-12-05T09:57:25.136 INFO:tasks.workunit.client.1.smithi150.stdout:2/237: stat d0/d3/c4b 0 2023-12-05T09:57:25.139 INFO:tasks.workunit.client.0.smithi100.stdout:5/314: truncate d0/d1f/d25/f67 2635685 0 2023-12-05T09:57:25.139 INFO:tasks.workunit.client.0.smithi100.stdout:7/226: write d3/dc/d11/d33/f3f [2584756,9000] 0 2023-12-05T09:57:25.139 INFO:tasks.workunit.client.0.smithi100.stdout:5/315: fdatasync d0/d1f/f21 0 2023-12-05T09:57:25.139 INFO:tasks.workunit.client.0.smithi100.stdout:5/316: chown d0/f36 1380 1 2023-12-05T09:57:25.140 INFO:tasks.workunit.client.0.smithi100.stdout:5/317: write d0/d27/f29 [449176,419] 0 2023-12-05T09:57:25.140 INFO:tasks.workunit.client.0.smithi100.stdout:5/318: read d0/d16/d2b/d48/df/f20 [290853,91953] 0 2023-12-05T09:57:25.141 INFO:tasks.workunit.client.1.smithi150.stdout:1/274: getdents d6/d3c 0 2023-12-05T09:57:25.144 INFO:tasks.workunit.client.1.smithi150.stdout:0/253: creat d5/d11/d16/f51 x:0 0 0 2023-12-05T09:57:25.148 INFO:tasks.workunit.client.1.smithi150.stdout:6/201: mkdir d2/d23/d2e/d44/d48 0 2023-12-05T09:57:25.150 INFO:tasks.workunit.client.1.smithi150.stdout:9/210: mkdir d3/d42 0 2023-12-05T09:57:25.150 INFO:tasks.workunit.client.1.smithi150.stdout:9/211: readlink d3/d9/dc/l16 0 2023-12-05T09:57:25.152 INFO:tasks.workunit.client.0.smithi100.stdout:4/217: mknod de/d16/d23/d36/c43 0 2023-12-05T09:57:25.152 INFO:tasks.workunit.client.0.smithi100.stdout:4/218: chown de/d38/c3c 199911524 1 2023-12-05T09:57:25.154 INFO:tasks.workunit.client.1.smithi150.stdout:5/242: getdents d1/d3/d1e 0 2023-12-05T09:57:25.154 INFO:tasks.workunit.client.1.smithi150.stdout:5/243: chown d1/d3/d1e/d21/d3b/c1a 4194 1 2023-12-05T09:57:25.157 INFO:tasks.workunit.client.1.smithi150.stdout:2/238: mknod d0/d3/d5/d3b/d4c/c50 0 2023-12-05T09:57:25.160 INFO:tasks.workunit.client.1.smithi150.stdout:1/275: mknod d6/d3c/c64 0 2023-12-05T09:57:25.162 INFO:tasks.workunit.client.0.smithi100.stdout:9/309: link d7/d35/l3b d7/d1b/d22/d51/l64 0 2023-12-05T09:57:25.163 INFO:tasks.workunit.client.0.smithi100.stdout:9/310: creat d7/d35/f65 x:0 0 0 2023-12-05T09:57:25.166 INFO:tasks.workunit.client.1.smithi150.stdout:0/254: unlink d5/c2c 0 2023-12-05T09:57:25.166 INFO:tasks.workunit.client.1.smithi150.stdout:0/255: read d5/f23 [466544,99053] 0 2023-12-05T09:57:25.166 INFO:tasks.workunit.client.1.smithi150.stdout:7/235: dwrite d2/db/d30/d18/d1a/d1e/d2b/f34 [0,4194304] 0 2023-12-05T09:57:25.168 INFO:tasks.workunit.client.1.smithi150.stdout:6/202: truncate d2/f26 3381399 0 2023-12-05T09:57:25.171 INFO:tasks.workunit.client.0.smithi100.stdout:2/385: creat d7/da/d18/d1b/d2c/d3f/f85 x:0 0 0 2023-12-05T09:57:25.171 INFO:tasks.workunit.client.0.smithi100.stdout:2/386: stat d7/da/d65 0 2023-12-05T09:57:25.171 INFO:tasks.workunit.client.0.smithi100.stdout:2/387: chown d7/da/f17 15635560 1 2023-12-05T09:57:25.173 INFO:tasks.workunit.client.0.smithi100.stdout:8/224: dwrite d0/fc [0,4194304] 0 2023-12-05T09:57:25.173 INFO:tasks.workunit.client.0.smithi100.stdout:8/225: read - d0/d12/f36 zero size 2023-12-05T09:57:25.173 INFO:tasks.workunit.client.0.smithi100.stdout:8/226: creat d0/f37 x:0 0 0 2023-12-05T09:57:25.173 INFO:tasks.workunit.client.1.smithi150.stdout:9/212: dread d3/d9/dc/f1d [0,4194304] 0 2023-12-05T09:57:25.174 INFO:tasks.workunit.client.1.smithi150.stdout:5/244: symlink d1/d3/d6/d1b/d22/l56 0 2023-12-05T09:57:25.177 INFO:tasks.workunit.client.1.smithi150.stdout:9/213: read d3/d9/f20 [851424,6075] 0 2023-12-05T09:57:25.177 INFO:tasks.workunit.client.1.smithi150.stdout:1/276: write f1 [2507555,31453] 0 2023-12-05T09:57:25.177 INFO:tasks.workunit.client.1.smithi150.stdout:2/239: rename d0/d3/d11/d1d/d38/d3f to d0/d3/d27/d51 0 2023-12-05T09:57:25.177 INFO:tasks.workunit.client.1.smithi150.stdout:6/203: rename d2/d23 to d2/d23/d2e/d49 22 2023-12-05T09:57:25.184 INFO:tasks.workunit.client.0.smithi100.stdout:8/227: dread d0/d12/d13/d16/d22/f26 [0,4194304] 0 2023-12-05T09:57:25.187 INFO:tasks.workunit.client.0.smithi100.stdout:7/227: creat d3/dc/d11/d13/de/d2d/f4f x:0 0 0 2023-12-05T09:57:25.189 INFO:tasks.workunit.client.1.smithi150.stdout:0/256: creat d5/d11/d16/d3f/d3b/f52 x:0 0 0 2023-12-05T09:57:25.190 INFO:tasks.workunit.client.0.smithi100.stdout:5/319: mknod d0/d16/d2b/c72 0 2023-12-05T09:57:25.190 INFO:tasks.workunit.client.0.smithi100.stdout:5/320: truncate d0/d16/d2b/d48/f65 727216 0 2023-12-05T09:57:25.190 INFO:tasks.workunit.client.0.smithi100.stdout:5/321: chown d0/d4/c9 89 1 2023-12-05T09:57:25.192 INFO:tasks.workunit.client.1.smithi150.stdout:7/236: unlink d2/db/f2c 0 2023-12-05T09:57:25.199 INFO:tasks.workunit.client.1.smithi150.stdout:9/214: getdents d3/d9/dc/d1f 0 2023-12-05T09:57:25.199 INFO:tasks.workunit.client.1.smithi150.stdout:9/215: fdatasync d3/f40 0 2023-12-05T09:57:25.200 INFO:tasks.workunit.client.0.smithi100.stdout:7/228: creat d3/dc/d11/d13/de/d18/d3b/d40/d46/f50 x:0 0 0 2023-12-05T09:57:25.203 INFO:tasks.workunit.client.1.smithi150.stdout:1/277: rename d6/d8/db/f2b to d6/d8/d59/f65 0 2023-12-05T09:57:25.203 INFO:tasks.workunit.client.1.smithi150.stdout:1/278: dread - d6/f53 zero size 2023-12-05T09:57:25.204 INFO:tasks.workunit.client.1.smithi150.stdout:1/279: write d6/f3f [260414,62175] 0 2023-12-05T09:57:25.205 INFO:tasks.workunit.client.0.smithi100.stdout:5/322: symlink d0/d16/d37/l73 0 2023-12-05T09:57:25.206 INFO:tasks.workunit.client.0.smithi100.stdout:5/323: creat d0/d16/f74 x:0 0 0 2023-12-05T09:57:25.206 INFO:tasks.workunit.client.0.smithi100.stdout:5/324: readlink d0/d27/l40 0 2023-12-05T09:57:25.210 INFO:tasks.workunit.client.1.smithi150.stdout:6/204: dread d2/da/f27 [0,4194304] 0 2023-12-05T09:57:25.210 INFO:tasks.workunit.client.1.smithi150.stdout:6/205: truncate d2/d23/f45 4409005 0 2023-12-05T09:57:25.210 INFO:tasks.workunit.client.1.smithi150.stdout:6/206: truncate d2/d23/d2e/f43 647444 0 2023-12-05T09:57:25.211 INFO:tasks.workunit.client.1.smithi150.stdout:6/207: truncate d2/d23/d2e/f3e 820079 0 2023-12-05T09:57:25.212 INFO:tasks.workunit.client.0.smithi100.stdout:8/228: write d0/f17 [1918445,64046] 0 2023-12-05T09:57:25.213 INFO:tasks.workunit.client.0.smithi100.stdout:8/229: chown d0/d12/d13/f25 16970063 1 2023-12-05T09:57:25.213 INFO:tasks.workunit.client.0.smithi100.stdout:8/230: truncate d0/f9 8754786 0 2023-12-05T09:57:25.213 INFO:tasks.workunit.client.0.smithi100.stdout:4/219: dwrite de/d16/d23/f24 [0,4194304] 0 2023-12-05T09:57:25.213 INFO:tasks.workunit.client.0.smithi100.stdout:4/220: truncate f1 973294 0 2023-12-05T09:57:25.220 INFO:tasks.workunit.client.0.smithi100.stdout:9/311: dwrite d7/ff [0,4194304] 0 2023-12-05T09:57:25.220 INFO:tasks.workunit.client.0.smithi100.stdout:9/312: dread - d7/f4d zero size 2023-12-05T09:57:25.220 INFO:tasks.workunit.client.0.smithi100.stdout:9/313: stat d7/d1b/d22/d2a/l2b 0 2023-12-05T09:57:25.220 INFO:tasks.workunit.client.0.smithi100.stdout:9/314: truncate d7/d1b/d22/d2a/d56/d2e/f5e 979062 0 2023-12-05T09:57:25.223 INFO:tasks.workunit.client.0.smithi100.stdout:5/325: mkdir d0/d16/d2b/d75 0 2023-12-05T09:57:25.237 INFO:tasks.workunit.client.1.smithi150.stdout:9/216: rmdir d3/d9/dc/d1f/d24 39 2023-12-05T09:57:25.238 INFO:tasks.workunit.client.0.smithi100.stdout:4/221: mkdir de/d16/d23/d33/d3d/d44 0 2023-12-05T09:57:25.240 INFO:tasks.workunit.client.1.smithi150.stdout:5/245: dwrite d1/d3/d6/d1b/d22/f32 [0,4194304] 0 2023-12-05T09:57:25.240 INFO:tasks.workunit.client.1.smithi150.stdout:5/246: fdatasync d1/d3/d6/f8 0 2023-12-05T09:57:25.240 INFO:tasks.workunit.client.1.smithi150.stdout:5/247: creat d1/d3/d1e/d21/f57 x:0 0 0 2023-12-05T09:57:25.240 INFO:tasks.workunit.client.0.smithi100.stdout:7/229: symlink d3/dc/d11/d13/l51 0 2023-12-05T09:57:25.241 INFO:tasks.workunit.client.0.smithi100.stdout:7/230: truncate d3/dc/d11/d13/f30 768371 0 2023-12-05T09:57:25.241 INFO:tasks.workunit.client.0.smithi100.stdout:7/231: chown d3/dc/d11 162 1 2023-12-05T09:57:25.243 INFO:tasks.workunit.client.1.smithi150.stdout:1/280: rename d6/d8/l17 to d6/d8/db/l66 0 2023-12-05T09:57:25.243 INFO:tasks.workunit.client.1.smithi150.stdout:1/281: write d6/d8/f11 [1313645,60026] 0 2023-12-05T09:57:25.243 INFO:tasks.workunit.client.1.smithi150.stdout:1/282: readlink d6/d47/l48 0 2023-12-05T09:57:25.243 INFO:tasks.workunit.client.1.smithi150.stdout:1/283: write d6/d8/db/f19 [1038118,96506] 0 2023-12-05T09:57:25.244 INFO:tasks.workunit.client.1.smithi150.stdout:6/208: mknod d2/d23/c4a 0 2023-12-05T09:57:25.244 INFO:tasks.workunit.client.1.smithi150.stdout:7/237: dread d2/f25 [4194304,4194304] 0 2023-12-05T09:57:25.245 INFO:tasks.workunit.client.0.smithi100.stdout:9/315: write d7/d1b/f30 [1390237,52430] 0 2023-12-05T09:57:25.250 INFO:tasks.workunit.client.1.smithi150.stdout:1/284: dread d6/d38/f43 [0,4194304] 0 2023-12-05T09:57:25.254 INFO:tasks.workunit.client.1.smithi150.stdout:0/257: dwrite d5/d11/d32/d37/f30 [0,4194304] 0 2023-12-05T09:57:25.256 INFO:tasks.workunit.client.0.smithi100.stdout:5/326: truncate d0/f3 3572654 0 2023-12-05T09:57:25.256 INFO:tasks.workunit.client.0.smithi100.stdout:5/327: chown d0/d4/c45 6063440 1 2023-12-05T09:57:25.256 INFO:tasks.workunit.client.0.smithi100.stdout:5/328: stat d0/d1f/f6a 0 2023-12-05T09:57:25.257 INFO:tasks.workunit.client.0.smithi100.stdout:8/231: dwrite d0/d12/d13/d16/f23 [0,4194304] 0 2023-12-05T09:57:25.258 INFO:tasks.workunit.client.1.smithi150.stdout:7/238: unlink d2/f25 0 2023-12-05T09:57:25.258 INFO:tasks.workunit.client.1.smithi150.stdout:7/239: chown d2/db/d30 0 1 2023-12-05T09:57:25.258 INFO:tasks.workunit.client.1.smithi150.stdout:7/240: readlink d2/db/d17/d20/l33 0 2023-12-05T09:57:25.258 INFO:tasks.workunit.client.0.smithi100.stdout:2/388: dwrite d7/da/d1a/f1c [4194304,4194304] 0 2023-12-05T09:57:25.259 INFO:tasks.workunit.client.1.smithi150.stdout:9/217: rmdir d3/d9/dc/d1f/d24 39 2023-12-05T09:57:25.259 INFO:tasks.workunit.client.1.smithi150.stdout:9/218: truncate d3/d9/d26/f21 4679175 0 2023-12-05T09:57:25.259 INFO:tasks.workunit.client.1.smithi150.stdout:9/219: readlink d3/d9/l3c 0 2023-12-05T09:57:25.259 INFO:tasks.workunit.client.1.smithi150.stdout:9/220: truncate d3/f29 1547468 0 2023-12-05T09:57:25.260 INFO:tasks.workunit.client.0.smithi100.stdout:7/232: symlink d3/dc/d11/d13/de/d2d/l52 0 2023-12-05T09:57:25.262 INFO:tasks.workunit.client.1.smithi150.stdout:1/285: creat d6/d8/d54/f67 x:0 0 0 2023-12-05T09:57:25.262 INFO:tasks.workunit.client.1.smithi150.stdout:1/286: read - d6/d8/d54/f56 zero size 2023-12-05T09:57:25.265 INFO:tasks.workunit.client.1.smithi150.stdout:5/248: link d1/d3/d1e/d21/f57 d1/d3/d1e/f58 0 2023-12-05T09:57:25.269 INFO:tasks.workunit.client.0.smithi100.stdout:4/222: write de/d16/d23/f24 [4220628,86533] 0 2023-12-05T09:57:25.269 INFO:tasks.workunit.client.0.smithi100.stdout:4/223: chown de/d16/d23/f37 37 1 2023-12-05T09:57:25.269 INFO:tasks.workunit.client.0.smithi100.stdout:9/316: mknod d7/d1b/c66 0 2023-12-05T09:57:25.277 INFO:tasks.workunit.client.0.smithi100.stdout:8/232: mknod d0/d12/d13/d16/d22/c38 0 2023-12-05T09:57:25.286 INFO:tasks.workunit.client.0.smithi100.stdout:2/389: dread d7/da/d1a/f45 [0,4194304] 0 2023-12-05T09:57:25.296 INFO:tasks.workunit.client.0.smithi100.stdout:4/224: creat de/d16/f45 x:0 0 0 2023-12-05T09:57:25.298 INFO:tasks.workunit.client.0.smithi100.stdout:9/317: creat d7/d1b/d22/d2a/d56/d2e/d50/d5b/f67 x:0 0 0 2023-12-05T09:57:25.298 INFO:tasks.workunit.client.0.smithi100.stdout:9/318: truncate d7/d35/f63 143301 0 2023-12-05T09:57:25.298 INFO:tasks.workunit.client.0.smithi100.stdout:9/319: write d7/f29 [866959,10673] 0 2023-12-05T09:57:25.301 INFO:tasks.workunit.client.0.smithi100.stdout:2/390: unlink d7/da/d18/c75 0 2023-12-05T09:57:25.303 INFO:tasks.workunit.client.1.smithi150.stdout:0/258: mknod d5/d11/c53 0 2023-12-05T09:57:25.305 INFO:tasks.workunit.client.0.smithi100.stdout:2/391: read - d7/da/d18/d21/d4d/f83 zero size 2023-12-05T09:57:25.305 INFO:tasks.workunit.client.1.smithi150.stdout:7/241: readlink d2/d4/l7 0 2023-12-05T09:57:25.306 INFO:tasks.workunit.client.0.smithi100.stdout:4/225: getdents de/d38 0 2023-12-05T09:57:25.307 INFO:tasks.workunit.client.0.smithi100.stdout:1/281: sync 2023-12-05T09:57:25.307 INFO:tasks.workunit.client.0.smithi100.stdout:0/282: sync 2023-12-05T09:57:25.308 INFO:tasks.workunit.client.1.smithi150.stdout:9/221: mknod d3/d1b/c43 0 2023-12-05T09:57:25.309 INFO:tasks.workunit.client.1.smithi150.stdout:6/209: truncate d2/d23/f45 4178783 0 2023-12-05T09:57:25.316 INFO:tasks.workunit.client.0.smithi100.stdout:2/392: dread d7/da/d18/d21/d4d/f58 [0,4194304] 0 2023-12-05T09:57:25.316 INFO:tasks.workunit.client.0.smithi100.stdout:4/226: rename de/d16/d23/c2b to de/d38/c46 0 2023-12-05T09:57:25.317 INFO:tasks.workunit.client.0.smithi100.stdout:6/611: sync 2023-12-05T09:57:25.317 INFO:tasks.workunit.client.0.smithi100.stdout:3/325: sync 2023-12-05T09:57:25.321 INFO:tasks.workunit.client.1.smithi150.stdout:7/242: write d2/db/d30/d13/f37 [2801158,34622] 0 2023-12-05T09:57:25.329 INFO:tasks.workunit.client.1.smithi150.stdout:5/249: rename d1/d2e/d4d to d1/d3/d6/d1b/d22/d24/d59 0 2023-12-05T09:57:25.331 INFO:tasks.workunit.client.0.smithi100.stdout:4/227: rename f6 to de/d16/d23/f47 0 2023-12-05T09:57:25.339 INFO:tasks.workunit.client.1.smithi150.stdout:0/259: unlink d5/l8 0 2023-12-05T09:57:25.339 INFO:tasks.workunit.client.1.smithi150.stdout:0/260: chown d5/d11/d32/f39 141769 1 2023-12-05T09:57:25.339 INFO:tasks.workunit.client.0.smithi100.stdout:6/612: rename d7/d27/d35/l60 to d7/d2d/d6a/d7c/d8d/lc8 0 2023-12-05T09:57:25.347 INFO:tasks.workunit.client.1.smithi150.stdout:6/210: creat d2/da/f4b x:0 0 0 2023-12-05T09:57:25.352 INFO:tasks.workunit.client.0.smithi100.stdout:5/329: dwrite d0/d16/f68 [0,4194304] 0 2023-12-05T09:57:25.357 INFO:tasks.workunit.client.0.smithi100.stdout:6/613: symlink d7/d11/d7e/lc9 0 2023-12-05T09:57:25.358 INFO:tasks.workunit.client.0.smithi100.stdout:4/228: creat de/f48 x:0 0 0 2023-12-05T09:57:25.358 INFO:tasks.workunit.client.0.smithi100.stdout:6/614: readlink d7/d11/d7e/lc9 0 2023-12-05T09:57:25.359 INFO:tasks.workunit.client.1.smithi150.stdout:1/287: truncate d6/d8/db/f19 39407 0 2023-12-05T09:57:25.361 INFO:tasks.workunit.client.0.smithi100.stdout:8/233: dwrite d0/f2 [4194304,4194304] 0 2023-12-05T09:57:25.362 INFO:tasks.workunit.client.0.smithi100.stdout:8/234: write d0/d12/d13/d16/f2e [5208186,37546] 0 2023-12-05T09:57:25.362 INFO:tasks.workunit.client.1.smithi150.stdout:3/244: sync 2023-12-05T09:57:25.362 INFO:tasks.workunit.client.1.smithi150.stdout:4/197: sync 2023-12-05T09:57:25.362 INFO:tasks.workunit.client.1.smithi150.stdout:2/240: sync 2023-12-05T09:57:25.363 INFO:tasks.workunit.client.1.smithi150.stdout:8/218: sync 2023-12-05T09:57:25.363 INFO:tasks.workunit.client.1.smithi150.stdout:8/219: write d0/f16 [4261858,12209] 0 2023-12-05T09:57:25.369 INFO:tasks.workunit.client.1.smithi150.stdout:7/243: read d2/d4/f27 [1427691,26567] 0 2023-12-05T09:57:25.371 INFO:tasks.workunit.client.0.smithi100.stdout:9/320: dwrite d7/d1b/d22/d51/f23 [0,4194304] 0 2023-12-05T09:57:25.372 INFO:tasks.workunit.client.1.smithi150.stdout:4/198: dread d0/d11/f34 [0,4194304] 0 2023-12-05T09:57:25.373 INFO:tasks.workunit.client.1.smithi150.stdout:9/222: rename d3/d9/c27 to d3/d1b/c44 0 2023-12-05T09:57:25.376 INFO:tasks.workunit.client.1.smithi150.stdout:0/261: mknod d5/d11/d32/c54 0 2023-12-05T09:57:25.377 INFO:tasks.workunit.client.0.smithi100.stdout:1/282: dwrite db/f1a [0,4194304] 0 2023-12-05T09:57:25.378 INFO:tasks.workunit.client.0.smithi100.stdout:6/615: creat d7/d11/d82/db9/fca x:0 0 0 2023-12-05T09:57:25.378 INFO:tasks.workunit.client.0.smithi100.stdout:6/616: chown d7/d2d/d6a/d7c/d8d 370 1 2023-12-05T09:57:25.382 INFO:tasks.workunit.client.0.smithi100.stdout:8/235: dread d0/fc [0,4194304] 0 2023-12-05T09:57:25.383 INFO:tasks.workunit.client.1.smithi150.stdout:6/211: symlink d2/d23/l4c 0 2023-12-05T09:57:25.384 INFO:tasks.workunit.client.1.smithi150.stdout:3/245: mkdir d6/d9/d3d/d52 0 2023-12-05T09:57:25.385 INFO:tasks.workunit.client.0.smithi100.stdout:2/393: dwrite d7/da/f6f [0,4194304] 0 2023-12-05T09:57:25.386 INFO:tasks.workunit.client.1.smithi150.stdout:2/241: mkdir d0/d3/d5/d22/d52 0 2023-12-05T09:57:25.387 INFO:tasks.workunit.client.0.smithi100.stdout:0/283: dwrite da/f11 [8388608,4194304] 0 2023-12-05T09:57:25.389 INFO:tasks.workunit.client.0.smithi100.stdout:9/321: mkdir d7/d20/d68 0 2023-12-05T09:57:25.390 INFO:tasks.workunit.client.0.smithi100.stdout:3/326: dwrite d0/d10/f49 [0,4194304] 0 2023-12-05T09:57:25.392 INFO:tasks.workunit.client.0.smithi100.stdout:4/229: rmdir de/d16/d23/d36 39 2023-12-05T09:57:25.393 INFO:tasks.workunit.client.0.smithi100.stdout:4/230: fdatasync de/d16/d23/f47 0 2023-12-05T09:57:25.395 INFO:tasks.workunit.client.1.smithi150.stdout:8/220: creat d0/d8/d14/d1b/d24/d2e/f44 x:0 0 0 2023-12-05T09:57:25.395 INFO:tasks.workunit.client.1.smithi150.stdout:8/221: truncate d0/d8/f2c 1127407 0 2023-12-05T09:57:25.396 INFO:tasks.workunit.client.0.smithi100.stdout:1/283: rename db/fd to db/d12/d1e/d26/d30/f56 0 2023-12-05T09:57:25.397 INFO:tasks.workunit.client.1.smithi150.stdout:7/244: mknod d2/c46 0 2023-12-05T09:57:25.400 INFO:tasks.workunit.client.1.smithi150.stdout:4/199: symlink d0/d11/l38 0 2023-12-05T09:57:25.403 INFO:tasks.workunit.client.1.smithi150.stdout:5/250: rename d1/d3/l4 to d1/d3/d6/l5a 0 2023-12-05T09:57:25.403 INFO:tasks.workunit.client.0.smithi100.stdout:2/394: mkdir d7/da/d18/d21/d86 0 2023-12-05T09:57:25.403 INFO:tasks.workunit.client.0.smithi100.stdout:2/395: write d7/da/d18/d21/f7e [755327,129262] 0 2023-12-05T09:57:25.403 INFO:tasks.workunit.client.0.smithi100.stdout:2/396: readlink d7/da/d18/d1b/d2c/d3f/l64 0 2023-12-05T09:57:25.407 INFO:tasks.workunit.client.0.smithi100.stdout:0/284: link da/fd da/d2a/f56 0 2023-12-05T09:57:25.409 INFO:tasks.workunit.client.0.smithi100.stdout:4/231: write de/d38/f42 [1448768,111934] 0 2023-12-05T09:57:25.409 INFO:tasks.workunit.client.0.smithi100.stdout:4/232: truncate de/d16/d23/f37 324016 0 2023-12-05T09:57:25.409 INFO:tasks.workunit.client.0.smithi100.stdout:4/233: creat de/d16/d23/d33/d3d/f49 x:0 0 0 2023-12-05T09:57:25.410 INFO:tasks.workunit.client.0.smithi100.stdout:9/322: stat d7/d1b/d22/d2a/d56/d2e/d50/c5d 0 2023-12-05T09:57:25.410 INFO:tasks.workunit.client.0.smithi100.stdout:9/323: readlink l4 0 2023-12-05T09:57:25.415 INFO:tasks.workunit.client.1.smithi150.stdout:3/246: unlink d6/d19/d30/c40 0 2023-12-05T09:57:25.417 INFO:tasks.workunit.client.1.smithi150.stdout:2/242: link d0/d3/d5/d3b/d4c/c50 d0/d3/d27/c53 0 2023-12-05T09:57:25.419 INFO:tasks.workunit.client.1.smithi150.stdout:8/222: mkdir d0/d8/d45 0 2023-12-05T09:57:25.422 INFO:tasks.workunit.client.0.smithi100.stdout:1/284: creat db/d31/d4f/f57 x:0 0 0 2023-12-05T09:57:25.422 INFO:tasks.workunit.client.0.smithi100.stdout:2/397: unlink d7/da/d18/l48 0 2023-12-05T09:57:25.422 INFO:tasks.workunit.client.1.smithi150.stdout:7/245: mkdir d2/db/d30/d47 0 2023-12-05T09:57:25.423 INFO:tasks.workunit.client.0.smithi100.stdout:2/398: write d7/da/d18/d21/f7e [369515,20051] 0 2023-12-05T09:57:25.423 INFO:tasks.workunit.client.0.smithi100.stdout:0/285: symlink da/d2a/d45/l57 0 2023-12-05T09:57:25.423 INFO:tasks.workunit.client.0.smithi100.stdout:0/286: write da/f2d [1316591,28204] 0 2023-12-05T09:57:25.431 INFO:tasks.workunit.client.0.smithi100.stdout:1/285: dread db/d12/f14 [0,4194304] 0 2023-12-05T09:57:25.432 INFO:tasks.workunit.client.1.smithi150.stdout:2/243: dread d0/d3/d5/d10/f20 [0,4194304] 0 2023-12-05T09:57:25.432 INFO:tasks.workunit.client.1.smithi150.stdout:2/244: fdatasync d0/d3/d5/d10/f1b 0 2023-12-05T09:57:25.434 INFO:tasks.workunit.client.1.smithi150.stdout:9/223: rename d3/d9/lb to d3/d1b/l45 0 2023-12-05T09:57:25.434 INFO:tasks.workunit.client.1.smithi150.stdout:5/251: mkdir d1/d3/d1e/d31/d5b 0 2023-12-05T09:57:25.434 INFO:tasks.workunit.client.1.smithi150.stdout:5/252: creat d1/d3/d38/f5c x:0 0 0 2023-12-05T09:57:25.434 INFO:tasks.workunit.client.1.smithi150.stdout:9/224: write d3/d9/d26/f3f [88715,64332] 0 2023-12-05T09:57:25.435 INFO:tasks.workunit.client.0.smithi100.stdout:2/399: dread d7/da/d18/d21/d4d/f58 [0,4194304] 0 2023-12-05T09:57:25.435 INFO:tasks.workunit.client.0.smithi100.stdout:2/400: stat d7/da/d18/d1b/d2c/d3f/d46 0 2023-12-05T09:57:25.435 INFO:tasks.workunit.client.0.smithi100.stdout:2/401: truncate d7/f34 4349913 0 2023-12-05T09:57:25.435 INFO:tasks.workunit.client.0.smithi100.stdout:6/617: dwrite d7/d2d/fbd [0,4194304] 0 2023-12-05T09:57:25.436 INFO:tasks.workunit.client.0.smithi100.stdout:4/234: truncate de/d16/d23/f34 2770666 0 2023-12-05T09:57:25.436 INFO:tasks.workunit.client.0.smithi100.stdout:4/235: creat de/f4a x:0 0 0 2023-12-05T09:57:25.437 INFO:tasks.workunit.client.1.smithi150.stdout:6/212: getdents d2/d23/d2e/d39 0 2023-12-05T09:57:25.442 INFO:tasks.workunit.client.0.smithi100.stdout:3/327: getdents d0/d3d 0 2023-12-05T09:57:25.442 INFO:tasks.workunit.client.0.smithi100.stdout:8/236: dwrite d0/d12/d13/d16/d22/f26 [0,4194304] 0 2023-12-05T09:57:25.442 INFO:tasks.workunit.client.0.smithi100.stdout:9/324: mkdir d7/d20/d69 0 2023-12-05T09:57:25.442 INFO:tasks.workunit.client.0.smithi100.stdout:9/325: stat d7/d20/c4c 0 2023-12-05T09:57:25.442 INFO:tasks.workunit.client.0.smithi100.stdout:4/236: write de/f13 [895473,107067] 0 2023-12-05T09:57:25.445 INFO:tasks.workunit.client.1.smithi150.stdout:8/223: mknod d0/d8/d14/c46 0 2023-12-05T09:57:25.455 INFO:tasks.workunit.client.0.smithi100.stdout:2/402: getdents d7/da/d13/d4e 0 2023-12-05T09:57:25.462 INFO:tasks.workunit.client.0.smithi100.stdout:6/618: creat d7/d27/d35/d5a/db0/fcb x:0 0 0 2023-12-05T09:57:25.462 INFO:tasks.workunit.client.0.smithi100.stdout:6/619: fdatasync d7/d27/d35/fab 0 2023-12-05T09:57:25.469 INFO:tasks.workunit.client.1.smithi150.stdout:4/200: rmdir d0 39 2023-12-05T09:57:25.469 INFO:tasks.workunit.client.1.smithi150.stdout:4/201: fsync d0/d11/f2a 0 2023-12-05T09:57:25.469 INFO:tasks.workunit.client.1.smithi150.stdout:4/202: stat d0/d11/l1d 0 2023-12-05T09:57:25.469 INFO:tasks.workunit.client.1.smithi150.stdout:4/203: fdatasync d0/f20 0 2023-12-05T09:57:25.469 INFO:tasks.workunit.client.1.smithi150.stdout:4/204: fsync d0/d11/f32 0 2023-12-05T09:57:25.470 INFO:tasks.workunit.client.0.smithi100.stdout:3/328: dread d0/d2/de/d11/f21 [4194304,4194304] 0 2023-12-05T09:57:25.479 INFO:tasks.workunit.client.1.smithi150.stdout:0/262: rename d5/d11/d16/f17 to d5/d11/d16/d3f/d3b/f55 0 2023-12-05T09:57:25.481 INFO:tasks.workunit.client.1.smithi150.stdout:1/288: sync 2023-12-05T09:57:25.483 INFO:tasks.workunit.client.0.smithi100.stdout:8/237: stat d0/d12/l15 0 2023-12-05T09:57:25.489 INFO:tasks.workunit.client.0.smithi100.stdout:8/238: fsync d0/d12/f36 0 2023-12-05T09:57:25.489 INFO:tasks.workunit.client.0.smithi100.stdout:6/620: mkdir d7/dcc 0 2023-12-05T09:57:25.490 INFO:tasks.workunit.client.0.smithi100.stdout:9/326: dread d7/f8 [0,4194304] 0 2023-12-05T09:57:25.490 INFO:tasks.workunit.client.0.smithi100.stdout:9/327: rename d7/d1b to d7/d1b/d22/d51/d6a 22 2023-12-05T09:57:25.492 INFO:tasks.workunit.client.1.smithi150.stdout:9/225: mkdir d3/d1b/d46 0 2023-12-05T09:57:25.492 INFO:tasks.workunit.client.1.smithi150.stdout:8/224: mknod d0/d8/d14/d1b/d24/d2e/c47 0 2023-12-05T09:57:25.492 INFO:tasks.workunit.client.1.smithi150.stdout:6/213: unlink d2/da/fe 0 2023-12-05T09:57:25.493 INFO:tasks.workunit.client.1.smithi150.stdout:0/263: creat d5/d11/d32/d37/f56 x:0 0 0 2023-12-05T09:57:25.493 INFO:tasks.workunit.client.0.smithi100.stdout:3/329: mknod d0/d4/c6d 0 2023-12-05T09:57:25.494 INFO:tasks.workunit.client.1.smithi150.stdout:5/253: dwrite d1/d3/d1e/d21/f57 [0,4194304] 0 2023-12-05T09:57:25.495 INFO:tasks.workunit.client.1.smithi150.stdout:2/245: dwrite d0/d3/d11/d1d/f29 [0,4194304] 0 2023-12-05T09:57:25.496 INFO:tasks.workunit.client.1.smithi150.stdout:2/246: write d0/d3/d11/f18 [3637491,73886] 0 2023-12-05T09:57:25.496 INFO:tasks.workunit.client.1.smithi150.stdout:2/247: fdatasync d0/d3/d21/f2c 0 2023-12-05T09:57:25.497 INFO:tasks.workunit.client.1.smithi150.stdout:3/247: rename d6/d19/d30/d36 to d6/d19/d53 0 2023-12-05T09:57:25.497 INFO:tasks.workunit.client.0.smithi100.stdout:0/287: dwrite da/f2c [4194304,4194304] 0 2023-12-05T09:57:25.500 INFO:tasks.workunit.client.0.smithi100.stdout:6/621: symlink d7/d2d/lcd 0 2023-12-05T09:57:25.504 INFO:tasks.workunit.client.0.smithi100.stdout:6/622: truncate d7/d27/d72/f87 3845351 0 2023-12-05T09:57:25.505 INFO:tasks.workunit.client.0.smithi100.stdout:6/623: write d7/fbe [331052,115455] 0 2023-12-05T09:57:25.513 INFO:tasks.workunit.client.0.smithi100.stdout:3/330: link d0/f36 d0/d2/f6e 0 2023-12-05T09:57:25.513 INFO:tasks.workunit.client.1.smithi150.stdout:1/289: link d6/d8/c26 d6/d47/d4c/c68 0 2023-12-05T09:57:25.514 INFO:tasks.workunit.client.1.smithi150.stdout:5/254: mknod d1/d3/d6/d1b/c5d 0 2023-12-05T09:57:25.514 INFO:tasks.workunit.client.1.smithi150.stdout:0/264: truncate d5/fc 462551 0 2023-12-05T09:57:25.516 INFO:tasks.workunit.client.0.smithi100.stdout:0/288: write da/d1b/f3c [2990774,68669] 0 2023-12-05T09:57:25.517 INFO:tasks.workunit.client.1.smithi150.stdout:3/248: symlink d6/d22/l54 0 2023-12-05T09:57:25.519 INFO:tasks.workunit.client.0.smithi100.stdout:4/237: dwrite de/f14 [0,4194304] 0 2023-12-05T09:57:25.519 INFO:tasks.workunit.client.0.smithi100.stdout:4/238: stat de/d16/d23/d36/f3e 0 2023-12-05T09:57:25.520 INFO:tasks.workunit.client.1.smithi150.stdout:6/214: rename d2/d23/f3a to d2/d23/d2e/d39/f4d 0 2023-12-05T09:57:25.522 INFO:tasks.workunit.client.1.smithi150.stdout:0/265: rmdir d5/d11/d16/d3f 39 2023-12-05T09:57:25.523 INFO:tasks.workunit.client.1.smithi150.stdout:0/266: chown d5/d11/d16/d1f/c2b 64354 1 2023-12-05T09:57:25.529 INFO:tasks.workunit.client.0.smithi100.stdout:6/624: mknod d7/d11/d82/cce 0 2023-12-05T09:57:25.530 INFO:tasks.workunit.client.0.smithi100.stdout:2/403: write d7/da/dc/f12 [578849,90437] 0 2023-12-05T09:57:25.530 INFO:tasks.workunit.client.0.smithi100.stdout:2/404: stat d7/da/d18/d1b/d2c/d3f/f67 0 2023-12-05T09:57:25.533 INFO:tasks.workunit.client.0.smithi100.stdout:3/331: write d0/d4/f17 [2944956,28172] 0 2023-12-05T09:57:25.534 INFO:tasks.workunit.client.1.smithi150.stdout:3/249: write d6/d22/d37/f4a [323858,101306] 0 2023-12-05T09:57:25.535 INFO:tasks.workunit.client.1.smithi150.stdout:2/248: rename d0/d3/d11/d1d/d38 to d0/d3/d5/d13/d15/d30/d54 0 2023-12-05T09:57:25.538 INFO:tasks.workunit.client.1.smithi150.stdout:4/205: dwrite d0/f20 [4194304,4194304] 0 2023-12-05T09:57:25.539 INFO:tasks.workunit.client.1.smithi150.stdout:1/290: dread d6/d8/db/f5b [0,4194304] 0 2023-12-05T09:57:25.539 INFO:tasks.workunit.client.1.smithi150.stdout:1/291: creat d6/d47/d4c/d60/f69 x:0 0 0 2023-12-05T09:57:25.542 INFO:tasks.workunit.client.0.smithi100.stdout:0/289: mknod da/d22/d33/d35/c58 0 2023-12-05T09:57:25.551 INFO:tasks.workunit.client.1.smithi150.stdout:6/215: rename d2/d23/c24 to d2/c4e 0 2023-12-05T09:57:25.551 INFO:tasks.workunit.client.1.smithi150.stdout:6/216: dread - d2/da/f31 zero size 2023-12-05T09:57:25.552 INFO:tasks.workunit.client.1.smithi150.stdout:2/249: symlink d0/d3/d5/d13/d15/l55 0 2023-12-05T09:57:25.552 INFO:tasks.workunit.client.1.smithi150.stdout:0/267: mkdir d5/d11/d32/d57 0 2023-12-05T09:57:25.553 INFO:tasks.workunit.client.1.smithi150.stdout:4/206: creat d0/d11/f39 x:0 0 0 2023-12-05T09:57:25.555 INFO:tasks.workunit.client.0.smithi100.stdout:4/239: mknod de/d16/c4b 0 2023-12-05T09:57:25.555 INFO:tasks.workunit.client.0.smithi100.stdout:4/240: fsync de/f12 0 2023-12-05T09:57:25.555 INFO:tasks.workunit.client.0.smithi100.stdout:4/241: chown de/d16/d23/l35 16 1 2023-12-05T09:57:25.558 INFO:tasks.workunit.client.0.smithi100.stdout:6/625: rmdir d7/d27/da0 39 2023-12-05T09:57:25.559 INFO:tasks.workunit.client.1.smithi150.stdout:1/292: rename d6/d8/c26 to d6/d8/db/d1b/c6a 0 2023-12-05T09:57:25.563 INFO:tasks.workunit.client.0.smithi100.stdout:3/332: rmdir d0/d2/de/d12 39 2023-12-05T09:57:25.563 INFO:tasks.workunit.client.0.smithi100.stdout:1/286: dwrite db/d12/d1e/f34 [0,4194304] 0 2023-12-05T09:57:25.564 INFO:tasks.workunit.client.0.smithi100.stdout:1/287: chown db/d12/d1e/d26/f43 65 1 2023-12-05T09:57:25.564 INFO:tasks.workunit.client.0.smithi100.stdout:1/288: truncate db/f20 317714 0 2023-12-05T09:57:25.564 INFO:tasks.workunit.client.1.smithi150.stdout:7/246: sync 2023-12-05T09:57:25.566 INFO:tasks.workunit.client.0.smithi100.stdout:0/290: mkdir da/d2a/d59 0 2023-12-05T09:57:25.566 INFO:tasks.workunit.client.0.smithi100.stdout:0/291: chown da/l1a 3808241 1 2023-12-05T09:57:25.566 INFO:tasks.workunit.client.0.smithi100.stdout:0/292: write da/d1b/f52 [368884,73413] 0 2023-12-05T09:57:25.567 INFO:tasks.workunit.client.0.smithi100.stdout:8/239: dwrite d0/fd [0,4194304] 0 2023-12-05T09:57:25.567 INFO:tasks.workunit.client.0.smithi100.stdout:8/240: readlink d0/d12/d13/d16/l1f 0 2023-12-05T09:57:25.567 INFO:tasks.workunit.client.1.smithi150.stdout:8/225: dwrite d0/ff [0,4194304] 0 2023-12-05T09:57:25.567 INFO:tasks.workunit.client.1.smithi150.stdout:8/226: read - d0/d8/d14/d1b/d24/f3b zero size 2023-12-05T09:57:25.567 INFO:tasks.workunit.client.1.smithi150.stdout:8/227: write d0/d8/d14/d1b/f31 [4772450,20487] 0 2023-12-05T09:57:25.569 INFO:tasks.workunit.client.0.smithi100.stdout:4/242: symlink de/d16/d23/d36/l4c 0 2023-12-05T09:57:25.569 INFO:tasks.workunit.client.0.smithi100.stdout:4/243: readlink de/d16/d23/l35 0 2023-12-05T09:57:25.574 INFO:tasks.workunit.client.1.smithi150.stdout:0/268: rename l1 to d5/d11/d32/l58 0 2023-12-05T09:57:25.578 INFO:tasks.workunit.client.1.smithi150.stdout:9/226: dwrite d3/f15 [0,4194304] 0 2023-12-05T09:57:25.580 INFO:tasks.workunit.client.1.smithi150.stdout:3/250: dread d6/d25/d28/f2d [0,4194304] 0 2023-12-05T09:57:25.580 INFO:tasks.workunit.client.1.smithi150.stdout:3/251: fdatasync d6/d9/f1b 0 2023-12-05T09:57:25.581 INFO:tasks.workunit.client.0.smithi100.stdout:8/241: creat d0/d35/f39 x:0 0 0 2023-12-05T09:57:25.581 INFO:tasks.workunit.client.0.smithi100.stdout:8/242: creat d0/d12/d13/d16/f3a x:0 0 0 2023-12-05T09:57:25.584 INFO:tasks.workunit.client.0.smithi100.stdout:9/328: dwrite d7/d1b/d22/d2a/d56/d2e/f53 [0,4194304] 0 2023-12-05T09:57:25.587 INFO:tasks.workunit.client.0.smithi100.stdout:9/329: creat d7/d1b/d22/d2a/f6b x:0 0 0 2023-12-05T09:57:25.587 INFO:tasks.workunit.client.1.smithi150.stdout:5/255: dwrite d1/d3/d6/d1b/d22/f32 [0,4194304] 0 2023-12-05T09:57:25.592 INFO:tasks.workunit.client.1.smithi150.stdout:7/247: link d2/db/d30/d18/d1a/d1e/d2b/c32 d2/d4/c48 0 2023-12-05T09:57:25.592 INFO:tasks.workunit.client.1.smithi150.stdout:0/269: creat d5/d11/f59 x:0 0 0 2023-12-05T09:57:25.596 INFO:tasks.workunit.client.1.smithi150.stdout:6/217: getdents d2/d23/d2e/d39 0 2023-12-05T09:57:25.603 INFO:tasks.workunit.client.1.smithi150.stdout:8/228: dread d0/d8/d14/d1b/d24/d38/f3d [0,4194304] 0 2023-12-05T09:57:25.603 INFO:tasks.workunit.client.1.smithi150.stdout:7/248: write d2/d4/ff [3328326,53517] 0 2023-12-05T09:57:25.605 INFO:tasks.workunit.client.0.smithi100.stdout:9/330: truncate d7/fb 60256 0 2023-12-05T09:57:25.607 INFO:tasks.workunit.client.1.smithi150.stdout:3/252: write d6/d42/f44 [234501,59672] 0 2023-12-05T09:57:25.607 INFO:tasks.workunit.client.1.smithi150.stdout:3/253: stat d6/d22/d37/f3c 0 2023-12-05T09:57:25.607 INFO:tasks.workunit.client.1.smithi150.stdout:3/254: dread - d6/d22/d37/f3c zero size 2023-12-05T09:57:25.608 INFO:tasks.workunit.client.0.smithi100.stdout:0/293: dread da/f2d [0,4194304] 0 2023-12-05T09:57:25.609 INFO:tasks.workunit.client.0.smithi100.stdout:2/405: dwrite d7/da/d18/d21/f40 [0,4194304] 0 2023-12-05T09:57:25.609 INFO:tasks.workunit.client.0.smithi100.stdout:0/294: creat da/f5a x:0 0 0 2023-12-05T09:57:25.618 INFO:tasks.workunit.client.1.smithi150.stdout:8/229: mknod d0/d8/d14/d1b/d24/c48 0 2023-12-05T09:57:25.619 INFO:tasks.workunit.client.1.smithi150.stdout:4/207: rmdir d0/d11 39 2023-12-05T09:57:25.619 INFO:tasks.workunit.client.1.smithi150.stdout:8/230: write d0/d8/d14/d1b/d24/d38/f3a [720896,84480] 0 2023-12-05T09:57:25.619 INFO:tasks.workunit.client.1.smithi150.stdout:8/231: chown d0/d8/c18 3541 1 2023-12-05T09:57:25.622 INFO:tasks.workunit.client.0.smithi100.stdout:4/244: dread de/d16/d23/f34 [0,4194304] 0 2023-12-05T09:57:25.622 INFO:tasks.workunit.client.1.smithi150.stdout:6/218: write d2/da/f1a [611569,1588] 0 2023-12-05T09:57:25.623 INFO:tasks.workunit.client.1.smithi150.stdout:2/250: dwrite d0/d3/d11/d1d/f2f [4194304,4194304] 0 2023-12-05T09:57:25.623 INFO:tasks.workunit.client.1.smithi150.stdout:2/251: write d0/d3/d21/f44 [830500,69710] 0 2023-12-05T09:57:25.623 INFO:tasks.workunit.client.1.smithi150.stdout:2/252: fsync d0/f16 0 2023-12-05T09:57:25.624 INFO:tasks.workunit.client.0.smithi100.stdout:3/333: dwrite d0/d10/f43 [0,4194304] 0 2023-12-05T09:57:25.624 INFO:tasks.workunit.client.0.smithi100.stdout:3/334: write d0/d3d/f6c [533804,14521] 0 2023-12-05T09:57:25.625 INFO:tasks.workunit.client.1.smithi150.stdout:3/255: mknod d6/d9/d43/d47/c55 0 2023-12-05T09:57:25.634 INFO:tasks.workunit.client.0.smithi100.stdout:6/626: write d7/f56 [25994,109122] 0 2023-12-05T09:57:25.634 INFO:tasks.workunit.client.0.smithi100.stdout:8/243: rmdir d0/d35 39 2023-12-05T09:57:25.634 INFO:tasks.workunit.client.0.smithi100.stdout:8/244: chown d0/d12/d13/c14 6 1 2023-12-05T09:57:25.635 INFO:tasks.workunit.client.1.smithi150.stdout:4/208: creat d0/f3a x:0 0 0 2023-12-05T09:57:25.635 INFO:tasks.workunit.client.1.smithi150.stdout:1/293: dwrite d6/d8/db/de/f22 [0,4194304] 0 2023-12-05T09:57:25.636 INFO:tasks.workunit.client.1.smithi150.stdout:9/227: dwrite d3/f29 [0,4194304] 0 2023-12-05T09:57:25.636 INFO:tasks.workunit.client.1.smithi150.stdout:7/249: write d2/d4/fc [3511069,86837] 0 2023-12-05T09:57:25.636 INFO:tasks.workunit.client.0.smithi100.stdout:1/289: dwrite db/f20 [0,4194304] 0 2023-12-05T09:57:25.637 INFO:tasks.workunit.client.1.smithi150.stdout:8/232: unlink d0/f16 0 2023-12-05T09:57:25.638 INFO:tasks.workunit.client.0.smithi100.stdout:9/331: symlink d7/d1b/d22/d2a/d56/d2e/d50/d5b/l6c 0 2023-12-05T09:57:25.639 INFO:tasks.workunit.client.1.smithi150.stdout:2/253: dread d0/d3/d5/d10/f1b [0,4194304] 0 2023-12-05T09:57:25.648 INFO:tasks.workunit.client.0.smithi100.stdout:9/332: dread d7/f9 [0,4194304] 0 2023-12-05T09:57:25.648 INFO:tasks.workunit.client.0.smithi100.stdout:9/333: fsync d7/f45 0 2023-12-05T09:57:25.648 INFO:tasks.workunit.client.0.smithi100.stdout:9/334: dread - d7/d35/f65 zero size 2023-12-05T09:57:25.652 INFO:tasks.workunit.client.1.smithi150.stdout:4/209: dread d0/d11/f32 [0,4194304] 0 2023-12-05T09:57:25.652 INFO:tasks.workunit.client.1.smithi150.stdout:4/210: creat d0/f3b x:0 0 0 2023-12-05T09:57:25.652 INFO:tasks.workunit.client.1.smithi150.stdout:1/294: mknod d6/d47/d4c/c6b 0 2023-12-05T09:57:25.652 INFO:tasks.workunit.client.1.smithi150.stdout:1/295: chown d6/d38/l5c 1289 1 2023-12-05T09:57:25.655 INFO:tasks.workunit.client.0.smithi100.stdout:0/295: mknod da/d22/d33/d35/d3a/c5b 0 2023-12-05T09:57:25.655 INFO:tasks.workunit.client.1.smithi150.stdout:6/219: dread d2/da/f10 [0,4194304] 0 2023-12-05T09:57:25.658 INFO:tasks.workunit.client.0.smithi100.stdout:5/330: sync 2023-12-05T09:57:25.658 INFO:tasks.workunit.client.0.smithi100.stdout:5/331: fsync d0/d16/d2b/f3a 0 2023-12-05T09:57:25.658 INFO:tasks.workunit.client.0.smithi100.stdout:7/233: sync 2023-12-05T09:57:25.658 INFO:tasks.workunit.client.0.smithi100.stdout:7/234: chown d3/dc/d11/d13/de 103077 1 2023-12-05T09:57:25.664 INFO:tasks.workunit.client.0.smithi100.stdout:4/245: rename de/d16/d23/d33/d3d/f49 to de/d16/d23/d33/d3d/d44/f4d 0 2023-12-05T09:57:25.670 INFO:tasks.workunit.client.0.smithi100.stdout:1/290: mknod db/d12/d1e/c58 0 2023-12-05T09:57:25.670 INFO:tasks.workunit.client.0.smithi100.stdout:1/291: readlink db/l1b 0 2023-12-05T09:57:25.672 INFO:tasks.workunit.client.1.smithi150.stdout:9/228: symlink d3/d9/dc/d1f/d24/l47 0 2023-12-05T09:57:25.672 INFO:tasks.workunit.client.1.smithi150.stdout:2/254: mkdir d0/d3/d5/d22/d52/d56 0 2023-12-05T09:57:25.674 INFO:tasks.workunit.client.0.smithi100.stdout:2/406: getdents d7/da/d1a 0 2023-12-05T09:57:25.675 INFO:tasks.workunit.client.0.smithi100.stdout:3/335: dread d0/d2/d33/f40 [0,4194304] 0 2023-12-05T09:57:25.677 INFO:tasks.workunit.client.0.smithi100.stdout:5/332: symlink d0/d4/d14/l76 0 2023-12-05T09:57:25.677 INFO:tasks.workunit.client.1.smithi150.stdout:0/270: dwrite d5/ff [4194304,4194304] 0 2023-12-05T09:57:25.679 INFO:tasks.workunit.client.0.smithi100.stdout:7/235: creat d3/dc/d11/d33/f53 x:0 0 0 2023-12-05T09:57:25.683 INFO:tasks.workunit.client.0.smithi100.stdout:1/292: link la db/l59 0 2023-12-05T09:57:25.683 INFO:tasks.workunit.client.0.smithi100.stdout:1/293: chown db/d12/c48 347662980 1 2023-12-05T09:57:25.683 INFO:tasks.workunit.client.0.smithi100.stdout:1/294: readlink db/l1b 0 2023-12-05T09:57:25.685 INFO:tasks.workunit.client.0.smithi100.stdout:9/335: mknod d7/c6d 0 2023-12-05T09:57:25.685 INFO:tasks.workunit.client.0.smithi100.stdout:9/336: creat d7/d1b/d22/d2a/d56/f6e x:0 0 0 2023-12-05T09:57:25.685 INFO:tasks.workunit.client.0.smithi100.stdout:6/627: dwrite f5 [4194304,4194304] 0 2023-12-05T09:57:25.687 INFO:tasks.workunit.client.0.smithi100.stdout:6/628: write d7/d11/d82/fc6 [250275,67002] 0 2023-12-05T09:57:25.687 INFO:tasks.workunit.client.0.smithi100.stdout:6/629: truncate d7/d2d/f4a 4304868 0 2023-12-05T09:57:25.688 INFO:tasks.workunit.client.0.smithi100.stdout:2/407: mkdir d7/da/d13/d4e/d87 0 2023-12-05T09:57:25.704 INFO:tasks.workunit.client.0.smithi100.stdout:7/236: mknod d3/dc/d11/d13/de/d18/c54 0 2023-12-05T09:57:25.704 INFO:tasks.workunit.client.0.smithi100.stdout:8/245: dwrite d0/d12/f2a [0,4194304] 0 2023-12-05T09:57:25.705 INFO:tasks.workunit.client.0.smithi100.stdout:3/336: dread d0/d2/de/d12/f18 [0,4194304] 0 2023-12-05T09:57:25.708 INFO:tasks.workunit.client.1.smithi150.stdout:4/211: link d0/d11/f32 d0/f3c 0 2023-12-05T09:57:25.708 INFO:tasks.workunit.client.0.smithi100.stdout:5/333: dread d0/d16/d2b/d48/f13 [0,4194304] 0 2023-12-05T09:57:25.711 INFO:tasks.workunit.client.1.smithi150.stdout:6/220: dwrite d2/d23/f45 [0,4194304] 0 2023-12-05T09:57:25.711 INFO:tasks.workunit.client.1.smithi150.stdout:6/221: write d2/d23/d2e/d39/f40 [484454,64327] 0 2023-12-05T09:57:25.712 INFO:tasks.workunit.client.0.smithi100.stdout:6/630: read d7/d2d/d6a/f7b [194404,119863] 0 2023-12-05T09:57:25.718 INFO:tasks.workunit.client.1.smithi150.stdout:9/229: symlink d3/l48 0 2023-12-05T09:57:25.718 INFO:tasks.workunit.client.1.smithi150.stdout:9/230: chown d3/d1b/c3b 2 1 2023-12-05T09:57:25.718 INFO:tasks.workunit.client.1.smithi150.stdout:9/231: chown d3/d9/dc/d1f 9030504 1 2023-12-05T09:57:25.720 INFO:tasks.workunit.client.1.smithi150.stdout:0/271: mknod d5/d11/d16/c5a 0 2023-12-05T09:57:25.720 INFO:tasks.workunit.client.1.smithi150.stdout:0/272: chown d5/d11/d16/d3f/f3c 11699256 1 2023-12-05T09:57:25.720 INFO:tasks.workunit.client.1.smithi150.stdout:0/273: creat d5/f5b x:0 0 0 2023-12-05T09:57:25.721 INFO:tasks.workunit.client.1.smithi150.stdout:3/256: rename d6/d19 to d6/d9/d3d/d56 0 2023-12-05T09:57:25.721 INFO:tasks.workunit.client.1.smithi150.stdout:3/257: creat d6/d9/f57 x:0 0 0 2023-12-05T09:57:25.721 INFO:tasks.workunit.client.1.smithi150.stdout:3/258: fsync d6/f20 0 2023-12-05T09:57:25.723 INFO:tasks.workunit.client.0.smithi100.stdout:9/337: link d7/d35/f55 d7/d20/d68/f6f 0 2023-12-05T09:57:25.723 INFO:tasks.workunit.client.0.smithi100.stdout:9/338: truncate d7/d20/f3a 846251 0 2023-12-05T09:57:25.725 INFO:tasks.workunit.client.0.smithi100.stdout:2/408: rmdir d7/da/d18/d21/d4d/d81 39 2023-12-05T09:57:25.726 INFO:tasks.workunit.client.1.smithi150.stdout:4/212: unlink d0/f28 0 2023-12-05T09:57:25.733 INFO:tasks.workunit.client.0.smithi100.stdout:3/337: chown d0/d2/f23 10157371 1 2023-12-05T09:57:25.733 INFO:tasks.workunit.client.0.smithi100.stdout:3/338: readlink d0/d3d/l3e 0 2023-12-05T09:57:25.735 INFO:tasks.workunit.client.1.smithi150.stdout:1/296: getdents d6/d8/db 0 2023-12-05T09:57:25.736 INFO:tasks.workunit.client.0.smithi100.stdout:5/334: dread d0/d1f/f2e [0,4194304] 0 2023-12-05T09:57:25.739 INFO:tasks.workunit.client.1.smithi150.stdout:9/232: write d3/d9/dc/d1f/f2b [172886,109126] 0 2023-12-05T09:57:25.739 INFO:tasks.workunit.client.1.smithi150.stdout:9/233: chown l1 569 1 2023-12-05T09:57:25.740 INFO:tasks.workunit.client.0.smithi100.stdout:1/295: rename db/f20 to db/d12/d1e/d26/d30/d52/f5a 0 2023-12-05T09:57:25.740 INFO:tasks.workunit.client.0.smithi100.stdout:1/296: chown db/l59 23 1 2023-12-05T09:57:25.741 INFO:tasks.workunit.client.1.smithi150.stdout:2/255: dwrite d0/d3/d11/f23 [0,4194304] 0 2023-12-05T09:57:25.743 INFO:tasks.workunit.client.0.smithi100.stdout:2/409: mkdir d7/da/dc/d88 0 2023-12-05T09:57:25.744 INFO:tasks.workunit.client.1.smithi150.stdout:0/274: mknod d5/d11/d16/d3f/d3b/c5c 0 2023-12-05T09:57:25.745 INFO:tasks.workunit.client.1.smithi150.stdout:0/275: creat d5/f5d x:0 0 0 2023-12-05T09:57:25.745 INFO:tasks.workunit.client.1.smithi150.stdout:0/276: chown d5/d11/l12 4924 1 2023-12-05T09:57:25.745 INFO:tasks.workunit.client.1.smithi150.stdout:0/277: readlink d5/d11/d16/d1f/l20 0 2023-12-05T09:57:25.745 INFO:tasks.workunit.client.1.smithi150.stdout:0/278: truncate d5/d11/d16/d1f/f2e 4713407 0 2023-12-05T09:57:25.745 INFO:tasks.workunit.client.1.smithi150.stdout:0/279: chown d5/d11/d32/c54 11159485 1 2023-12-05T09:57:25.745 INFO:tasks.workunit.client.1.smithi150.stdout:0/280: dread - d5/d11/d32/d37/f56 zero size 2023-12-05T09:57:25.745 INFO:tasks.workunit.client.1.smithi150.stdout:0/281: stat d5/d11/d16/d3f 0 2023-12-05T09:57:25.745 INFO:tasks.workunit.client.1.smithi150.stdout:0/282: truncate d5/d11/d16/d3f/d3b/f55 1304431 0 2023-12-05T09:57:25.745 INFO:tasks.workunit.client.0.smithi100.stdout:3/339: mkdir d0/d3d/d5c/d6f 0 2023-12-05T09:57:25.746 INFO:tasks.workunit.client.0.smithi100.stdout:3/340: chown d0/d2/de/c42 0 1 2023-12-05T09:57:25.746 INFO:tasks.workunit.client.0.smithi100.stdout:8/246: read d0/d12/f2a [113178,100042] 0 2023-12-05T09:57:25.746 INFO:tasks.workunit.client.0.smithi100.stdout:8/247: readlink d0/d12/d13/d16/d22/l34 0 2023-12-05T09:57:25.746 INFO:tasks.workunit.client.0.smithi100.stdout:8/248: write d0/f2 [8985417,10638] 0 2023-12-05T09:57:25.747 INFO:tasks.workunit.client.0.smithi100.stdout:5/335: getdents d0/d16/d37 0 2023-12-05T09:57:25.747 INFO:tasks.workunit.client.0.smithi100.stdout:4/246: dwrite f1 [0,4194304] 0 2023-12-05T09:57:25.747 INFO:tasks.workunit.client.0.smithi100.stdout:9/339: write d7/ff [522477,121760] 0 2023-12-05T09:57:25.754 INFO:tasks.workunit.client.0.smithi100.stdout:2/410: mknod d7/da/d13/d4e/c89 0 2023-12-05T09:57:25.759 INFO:tasks.workunit.client.1.smithi150.stdout:1/297: mknod d6/d47/d4c/c6c 0 2023-12-05T09:57:25.762 INFO:tasks.workunit.client.1.smithi150.stdout:2/256: getdents d0/d3/d5/d13/d15/d30/d54 0 2023-12-05T09:57:25.766 INFO:tasks.workunit.client.0.smithi100.stdout:8/249: unlink d0/fb 0 2023-12-05T09:57:25.767 INFO:tasks.workunit.client.0.smithi100.stdout:0/296: dwrite da/d2a/d45/f49 [0,4194304] 0 2023-12-05T09:57:25.772 INFO:tasks.workunit.client.0.smithi100.stdout:5/336: rename d0/d16/c17 to d0/d16/c77 0 2023-12-05T09:57:25.773 INFO:tasks.workunit.client.0.smithi100.stdout:9/340: dread d7/d1b/f30 [0,4194304] 0 2023-12-05T09:57:25.773 INFO:tasks.workunit.client.0.smithi100.stdout:9/341: stat d7/d35/f63 0 2023-12-05T09:57:25.773 INFO:tasks.workunit.client.0.smithi100.stdout:9/342: getdents d7/d20/d69 0 2023-12-05T09:57:25.775 INFO:tasks.workunit.client.1.smithi150.stdout:1/298: mknod d6/d8/db/de/c6d 0 2023-12-05T09:57:25.776 INFO:tasks.workunit.client.0.smithi100.stdout:4/247: mkdir de/d16/d23/d33/d3d/d44/d4e 0 2023-12-05T09:57:25.776 INFO:tasks.workunit.client.0.smithi100.stdout:4/248: chown de/d16/d23 0 1 2023-12-05T09:57:25.776 INFO:tasks.workunit.client.1.smithi150.stdout:2/257: mkdir d0/d3/d5/d13/d15/d30/d54/d57 0 2023-12-05T09:57:25.778 INFO:tasks.workunit.client.1.smithi150.stdout:7/250: rename d2/d29 to d2/db/d30/d18/d1a/d1e/d2b/d49 0 2023-12-05T09:57:25.780 INFO:tasks.workunit.client.0.smithi100.stdout:2/411: rename d7/da/d18/d1b/d2c/f82 to d7/da/f8a 0 2023-12-05T09:57:25.782 INFO:tasks.workunit.client.1.smithi150.stdout:1/299: creat d6/d8/db/f6e x:0 0 0 2023-12-05T09:57:25.782 INFO:tasks.workunit.client.1.smithi150.stdout:1/300: dread - d6/d8/db/d1b/f37 zero size 2023-12-05T09:57:25.782 INFO:tasks.workunit.client.1.smithi150.stdout:1/301: write d6/d38/d4a/f57 [72080,92342] 0 2023-12-05T09:57:25.784 INFO:tasks.workunit.client.0.smithi100.stdout:3/341: truncate d0/d2/de/d12/f29 4559918 0 2023-12-05T09:57:25.784 INFO:tasks.workunit.client.1.smithi150.stdout:2/258: mknod d0/d3/d27/d51/c58 0 2023-12-05T09:57:25.791 INFO:tasks.workunit.client.0.smithi100.stdout:1/297: dread db/d12/d1e/d26/d30/d52/f5a [0,4194304] 0 2023-12-05T09:57:25.792 INFO:tasks.workunit.client.1.smithi150.stdout:4/213: dwrite d0/d11/f37 [0,4194304] 0 2023-12-05T09:57:25.792 INFO:tasks.workunit.client.0.smithi100.stdout:7/237: dwrite d3/dc/d11/d13/fb [0,4194304] 0 2023-12-05T09:57:25.793 INFO:tasks.workunit.client.1.smithi150.stdout:2/259: symlink d0/d3/d5/d13/d15/d30/d54/d57/l59 0 2023-12-05T09:57:25.793 INFO:tasks.workunit.client.1.smithi150.stdout:2/260: truncate d0/d3/d5/d10/f19 1883911 0 2023-12-05T09:57:25.794 INFO:tasks.workunit.client.1.smithi150.stdout:3/259: dwrite d6/d22/d37/f3c [0,4194304] 0 2023-12-05T09:57:25.797 INFO:tasks.workunit.client.0.smithi100.stdout:0/297: link da/d2a/l2e da/d22/l5c 0 2023-12-05T09:57:25.797 INFO:tasks.workunit.client.0.smithi100.stdout:0/298: write da/d1b/f3c [503838,108389] 0 2023-12-05T09:57:25.797 INFO:tasks.workunit.client.0.smithi100.stdout:0/299: getdents da/d1b/d4a 0 2023-12-05T09:57:25.798 INFO:tasks.workunit.client.0.smithi100.stdout:5/337: creat d0/d16/d2b/d75/f78 x:0 0 0 2023-12-05T09:57:25.798 INFO:tasks.workunit.client.0.smithi100.stdout:5/338: truncate d0/d1f/f2e 2025261 0 2023-12-05T09:57:25.798 INFO:tasks.workunit.client.0.smithi100.stdout:5/339: stat d0/d1f/l24 0 2023-12-05T09:57:25.798 INFO:tasks.workunit.client.0.smithi100.stdout:4/249: dread de/d38/f42 [0,4194304] 0 2023-12-05T09:57:25.798 INFO:tasks.workunit.client.0.smithi100.stdout:9/343: mknod d7/d20/c70 0 2023-12-05T09:57:25.800 INFO:tasks.workunit.client.1.smithi150.stdout:8/233: rename d0/d8/d14 to d0/d41/d49 0 2023-12-05T09:57:25.800 INFO:tasks.workunit.client.1.smithi150.stdout:4/214: read d0/d11/f18 [615798,80951] 0 2023-12-05T09:57:25.802 INFO:tasks.workunit.client.0.smithi100.stdout:2/412: mknod d7/da/dc/d88/c8b 0 2023-12-05T09:57:25.802 INFO:tasks.workunit.client.0.smithi100.stdout:3/342: truncate d0/d2/f37 753112 0 2023-12-05T09:57:25.807 INFO:tasks.workunit.client.1.smithi150.stdout:2/261: truncate d0/d3/d11/d1d/f2f 8166186 0 2023-12-05T09:57:25.816 INFO:tasks.workunit.client.0.smithi100.stdout:5/340: read d0/d16/f68 [1673853,87292] 0 2023-12-05T09:57:25.816 INFO:tasks.workunit.client.0.smithi100.stdout:5/341: chown d0/f36 8054 1 2023-12-05T09:57:25.829 INFO:tasks.workunit.client.0.smithi100.stdout:7/238: symlink d3/dc/d11/d13/de/d18/d3b/d40/l55 0 2023-12-05T09:57:25.837 INFO:tasks.workunit.client.0.smithi100.stdout:4/250: rmdir de/d16/d23/d33 39 2023-12-05T09:57:25.841 INFO:tasks.workunit.client.1.smithi150.stdout:8/234: write d0/d41/d49/d1b/f1c [3992957,116750] 0 2023-12-05T09:57:25.841 INFO:tasks.workunit.client.1.smithi150.stdout:0/283: rename d5/d11/d16/d3f/d46/l4a to d5/d11/d32/d57/l5e 0 2023-12-05T09:57:25.843 INFO:tasks.workunit.client.0.smithi100.stdout:9/344: mkdir d7/d35/d71 0 2023-12-05T09:57:25.850 INFO:tasks.workunit.client.1.smithi150.stdout:8/235: write d0/d41/d49/d1b/d24/d38/f3a [695066,26202] 0 2023-12-05T09:57:25.850 INFO:tasks.workunit.client.1.smithi150.stdout:4/215: dread d0/f3c [0,4194304] 0 2023-12-05T09:57:25.850 INFO:tasks.workunit.client.1.smithi150.stdout:2/262: mkdir d0/d3/d5/d22/d52/d5a 0 2023-12-05T09:57:25.851 INFO:tasks.workunit.client.1.smithi150.stdout:6/222: dwrite d2/f26 [0,4194304] 0 2023-12-05T09:57:25.851 INFO:tasks.workunit.client.0.smithi100.stdout:5/342: unlink d0/d16/d2b/d48/df/c5f 0 2023-12-05T09:57:25.852 INFO:tasks.workunit.client.0.smithi100.stdout:5/343: fsync d0/d27/f29 0 2023-12-05T09:57:25.852 INFO:tasks.workunit.client.0.smithi100.stdout:5/344: chown d0/d16/d2b/d48 537147 1 2023-12-05T09:57:25.858 INFO:tasks.workunit.client.1.smithi150.stdout:5/256: sync 2023-12-05T09:57:25.858 INFO:tasks.workunit.client.1.smithi150.stdout:5/257: fsync d1/d3/d6/d1b/d22/d24/f41 0 2023-12-05T09:57:25.858 INFO:tasks.workunit.client.1.smithi150.stdout:0/284: mkdir d5/d11/d32/d37/d5f 0 2023-12-05T09:57:25.860 INFO:tasks.workunit.client.0.smithi100.stdout:4/251: symlink de/d16/d23/d33/d3d/l4f 0 2023-12-05T09:57:25.863 INFO:tasks.workunit.client.0.smithi100.stdout:9/345: creat d7/d20/d69/f72 x:0 0 0 2023-12-05T09:57:25.868 INFO:tasks.workunit.client.1.smithi150.stdout:8/236: write d0/ff [1460329,45293] 0 2023-12-05T09:57:25.871 INFO:tasks.workunit.client.1.smithi150.stdout:3/260: dwrite d6/d9/f50 [0,4194304] 0 2023-12-05T09:57:25.871 INFO:tasks.workunit.client.1.smithi150.stdout:2/263: rename d0/lc to d0/d3/d27/l5b 0 2023-12-05T09:57:25.871 INFO:tasks.workunit.client.0.smithi100.stdout:2/413: dwrite d7/da/d18/d1b/d2c/d3f/d46/f76 [0,4194304] 0 2023-12-05T09:57:25.873 INFO:tasks.workunit.client.0.smithi100.stdout:0/300: dwrite da/d22/f2b [0,4194304] 0 2023-12-05T09:57:25.873 INFO:tasks.workunit.client.0.smithi100.stdout:0/301: truncate da/f5a 548341 0 2023-12-05T09:57:25.874 INFO:tasks.workunit.client.0.smithi100.stdout:0/302: chown da/d1b/l2f 3680 1 2023-12-05T09:57:25.874 INFO:tasks.workunit.client.0.smithi100.stdout:0/303: chown da/d22/d33/d35/d3a/c42 4420941 1 2023-12-05T09:57:25.874 INFO:tasks.workunit.client.0.smithi100.stdout:7/239: dwrite d3/dc/d11/f25 [0,4194304] 0 2023-12-05T09:57:25.874 INFO:tasks.workunit.client.0.smithi100.stdout:7/240: stat d3/dc/d11/d13/d1b/f45 0 2023-12-05T09:57:25.874 INFO:tasks.workunit.client.1.smithi150.stdout:0/285: symlink d5/d11/d32/l60 0 2023-12-05T09:57:25.874 INFO:tasks.workunit.client.0.smithi100.stdout:7/241: write d3/dc/d11/d13/de/d2d/f44 [5120979,65583] 0 2023-12-05T09:57:25.874 INFO:tasks.workunit.client.0.smithi100.stdout:7/242: dread - d3/dc/d11/d13/de/d2d/f4f zero size 2023-12-05T09:57:25.875 INFO:tasks.workunit.client.0.smithi100.stdout:7/243: rename d3/dc/d11/d13 to d3/dc/d11/d13/de/d56 22 2023-12-05T09:57:25.876 INFO:tasks.workunit.client.1.smithi150.stdout:4/216: rmdir d0 39 2023-12-05T09:57:25.877 INFO:tasks.workunit.client.1.smithi150.stdout:4/217: truncate d0/d11/f23 1542154 0 2023-12-05T09:57:25.877 INFO:tasks.workunit.client.1.smithi150.stdout:9/234: dwrite d3/f15 [0,4194304] 0 2023-12-05T09:57:25.879 INFO:tasks.workunit.client.1.smithi150.stdout:2/264: dread d0/d3/d5/d10/f1b [0,4194304] 0 2023-12-05T09:57:25.880 INFO:tasks.workunit.client.1.smithi150.stdout:2/265: write d0/d3/d5/d10/f45 [215809,85811] 0 2023-12-05T09:57:25.881 INFO:tasks.workunit.client.1.smithi150.stdout:8/237: symlink d0/d8/l4a 0 2023-12-05T09:57:25.888 INFO:tasks.workunit.client.0.smithi100.stdout:3/343: creat d0/d2/d62/f70 x:0 0 0 2023-12-05T09:57:25.888 INFO:tasks.workunit.client.0.smithi100.stdout:3/344: fsync d0/d10/d39/f55 0 2023-12-05T09:57:25.890 INFO:tasks.workunit.client.0.smithi100.stdout:2/414: write d7/da/d1a/f45 [3328418,89991] 0 2023-12-05T09:57:25.891 INFO:tasks.workunit.client.0.smithi100.stdout:2/415: write d7/da/d18/d1b/d2c/d3f/f85 [547320,105701] 0 2023-12-05T09:57:25.891 INFO:tasks.workunit.client.0.smithi100.stdout:5/345: symlink d0/d1f/d53/l79 0 2023-12-05T09:57:25.891 INFO:tasks.workunit.client.0.smithi100.stdout:5/346: fsync d0/d4/d14/f55 0 2023-12-05T09:57:25.892 INFO:tasks.workunit.client.1.smithi150.stdout:6/223: dwrite d2/f1c [0,4194304] 0 2023-12-05T09:57:25.893 INFO:tasks.workunit.client.1.smithi150.stdout:3/261: symlink d6/d9/d3d/d52/l58 0 2023-12-05T09:57:25.893 INFO:tasks.workunit.client.1.smithi150.stdout:3/262: fdatasync d6/d9/f50 0 2023-12-05T09:57:25.893 INFO:tasks.workunit.client.1.smithi150.stdout:2/266: read d0/d3/d21/f2c [3204984,49109] 0 2023-12-05T09:57:25.896 INFO:tasks.workunit.client.0.smithi100.stdout:4/252: creat de/d16/d23/d33/d3d/d44/d4e/f50 x:0 0 0 2023-12-05T09:57:25.896 INFO:tasks.workunit.client.0.smithi100.stdout:4/253: dread - de/f48 zero size 2023-12-05T09:57:25.896 INFO:tasks.workunit.client.0.smithi100.stdout:4/254: stat de/d16/d1e 0 2023-12-05T09:57:25.898 INFO:tasks.workunit.client.1.smithi150.stdout:5/258: rename d1/d3/d6/d1b/l42 to d1/d3/d6/d1b/d22/d24/l5e 0 2023-12-05T09:57:25.898 INFO:tasks.workunit.client.1.smithi150.stdout:5/259: chown d1/d3/c54 5206 1 2023-12-05T09:57:25.902 INFO:tasks.workunit.client.1.smithi150.stdout:0/286: mkdir d5/d11/d16/d3f/d3b/d61 0 2023-12-05T09:57:25.902 INFO:tasks.workunit.client.1.smithi150.stdout:0/287: chown d5/c1a 1 1 2023-12-05T09:57:25.908 INFO:tasks.workunit.client.0.smithi100.stdout:8/250: truncate d0/f2 6262794 0 2023-12-05T09:57:25.908 INFO:tasks.workunit.client.0.smithi100.stdout:8/251: write d0/d12/d13/d16/f3a [456300,88888] 0 2023-12-05T09:57:25.909 INFO:tasks.workunit.client.0.smithi100.stdout:8/252: fsync d0/f31 0 2023-12-05T09:57:25.909 INFO:tasks.workunit.client.0.smithi100.stdout:8/253: write d0/d12/d13/d16/f3a [746239,118654] 0 2023-12-05T09:57:25.912 INFO:tasks.workunit.client.0.smithi100.stdout:5/347: dread d0/d1f/f4c [0,4194304] 0 2023-12-05T09:57:25.912 INFO:tasks.workunit.client.0.smithi100.stdout:5/348: creat d0/d16/d2b/d75/f7a x:0 0 0 2023-12-05T09:57:25.919 INFO:tasks.workunit.client.0.smithi100.stdout:0/304: link da/l32 da/l5d 0 2023-12-05T09:57:25.920 INFO:tasks.workunit.client.0.smithi100.stdout:0/305: chown da/d2a/l2e 96635924 1 2023-12-05T09:57:25.920 INFO:tasks.workunit.client.0.smithi100.stdout:0/306: write da/f2d [1934850,77818] 0 2023-12-05T09:57:25.920 INFO:tasks.workunit.client.0.smithi100.stdout:0/307: chown da/d2a/d4d/c55 324431 1 2023-12-05T09:57:25.920 INFO:tasks.workunit.client.0.smithi100.stdout:0/308: write da/d1b/d36/f48 [4502621,85933] 0 2023-12-05T09:57:25.920 INFO:tasks.workunit.client.0.smithi100.stdout:0/309: readlink da/d22/l50 0 2023-12-05T09:57:25.925 INFO:tasks.workunit.client.0.smithi100.stdout:7/244: mknod d3/dc/d11/d33/c57 0 2023-12-05T09:57:25.925 INFO:tasks.workunit.client.0.smithi100.stdout:7/245: truncate d3/dc/d11/d13/f43 1028440 0 2023-12-05T09:57:25.925 INFO:tasks.workunit.client.0.smithi100.stdout:7/246: dread - d3/dc/d11/d13/de/d18/d3b/d40/f41 zero size 2023-12-05T09:57:25.927 INFO:tasks.workunit.client.0.smithi100.stdout:3/345: creat d0/d10/f71 x:0 0 0 2023-12-05T09:57:25.933 INFO:tasks.workunit.client.1.smithi150.stdout:4/218: rmdir d0/d11 39 2023-12-05T09:57:25.933 INFO:tasks.workunit.client.1.smithi150.stdout:4/219: chown d0/d11/f18 7112 1 2023-12-05T09:57:25.933 INFO:tasks.workunit.client.1.smithi150.stdout:4/220: fsync d0/d11/f23 0 2023-12-05T09:57:25.934 INFO:tasks.workunit.client.0.smithi100.stdout:5/349: read d0/d16/d2b/d48/f5d [1607650,97789] 0 2023-12-05T09:57:25.936 INFO:tasks.workunit.client.0.smithi100.stdout:2/416: link d7/da/d1a/f38 d7/da/d13/d69/d6e/d71/f8c 0 2023-12-05T09:57:25.936 INFO:tasks.workunit.client.0.smithi100.stdout:2/417: write d7/da/dc/f12 [2213057,32446] 0 2023-12-05T09:57:25.938 INFO:tasks.workunit.client.0.smithi100.stdout:4/255: getdents de/d16/d23/d33/d3d/d44 0 2023-12-05T09:57:25.939 INFO:tasks.workunit.client.1.smithi150.stdout:5/260: dread d1/d3/d6/d26/f3e [0,4194304] 0 2023-12-05T09:57:25.939 INFO:tasks.workunit.client.1.smithi150.stdout:8/238: dwrite d0/d41/d49/d1b/d24/d38/f3a [0,4194304] 0 2023-12-05T09:57:25.939 INFO:tasks.workunit.client.1.smithi150.stdout:8/239: truncate d0/d8/f11 1888284 0 2023-12-05T09:57:25.941 INFO:tasks.workunit.client.1.smithi150.stdout:3/263: unlink d6/f20 0 2023-12-05T09:57:25.942 INFO:tasks.workunit.client.1.smithi150.stdout:0/288: dwrite d5/f5d [0,4194304] 0 2023-12-05T09:57:25.958 INFO:tasks.workunit.client.0.smithi100.stdout:9/346: rmdir d7/d1b/d22/d2a 39 2023-12-05T09:57:25.959 INFO:tasks.workunit.client.1.smithi150.stdout:5/261: symlink d1/d3/d1e/d21/l5f 0 2023-12-05T09:57:25.970 INFO:tasks.workunit.client.1.smithi150.stdout:0/289: dread d5/d11/d32/f39 [0,4194304] 0 2023-12-05T09:57:25.971 INFO:tasks.workunit.client.1.smithi150.stdout:0/290: readlink d5/d11/l35 0 2023-12-05T09:57:25.971 INFO:tasks.workunit.client.1.smithi150.stdout:0/291: dread - d5/d11/d16/f51 zero size 2023-12-05T09:57:25.972 INFO:tasks.workunit.client.0.smithi100.stdout:0/310: rename da/l12 to da/d2a/l5e 0 2023-12-05T09:57:25.974 INFO:tasks.workunit.client.0.smithi100.stdout:7/247: creat d3/dc/d11/f58 x:0 0 0 2023-12-05T09:57:25.976 INFO:tasks.workunit.client.1.smithi150.stdout:0/292: getdents d5/d11/d16/d1f 0 2023-12-05T09:57:25.976 INFO:tasks.workunit.client.1.smithi150.stdout:0/293: chown d5/d11/d16/c36 21229 1 2023-12-05T09:57:25.976 INFO:tasks.workunit.client.1.smithi150.stdout:0/294: chown d5/f41 11335 1 2023-12-05T09:57:25.976 INFO:tasks.workunit.client.1.smithi150.stdout:0/295: write d5/d11/d32/d37/f56 [531726,53118] 0 2023-12-05T09:57:25.979 INFO:tasks.workunit.client.1.smithi150.stdout:0/296: stat d5/d11/d16/c4e 0 2023-12-05T09:57:25.980 INFO:tasks.workunit.client.0.smithi100.stdout:3/346: symlink d0/d2/de/d11/d58/l72 0 2023-12-05T09:57:25.984 INFO:tasks.workunit.client.0.smithi100.stdout:2/418: truncate d7/f43 408667 0 2023-12-05T09:57:25.984 INFO:tasks.workunit.client.0.smithi100.stdout:2/419: write d7/da/d18/d21/d4d/f58 [534884,47080] 0 2023-12-05T09:57:25.986 INFO:tasks.workunit.client.1.smithi150.stdout:0/297: symlink d5/d11/l62 0 2023-12-05T09:57:25.986 INFO:tasks.workunit.client.1.smithi150.stdout:0/298: read d5/fa [791892,30877] 0 2023-12-05T09:57:25.986 INFO:tasks.workunit.client.0.smithi100.stdout:2/420: write d7/da/d18/d1b/f6c [208401,45286] 0 2023-12-05T09:57:25.987 INFO:tasks.workunit.client.0.smithi100.stdout:2/421: stat d7/da/d18/d21/d4d 0 2023-12-05T09:57:25.987 INFO:tasks.workunit.client.0.smithi100.stdout:2/422: fsync d7/f66 0 2023-12-05T09:57:25.987 INFO:tasks.workunit.client.0.smithi100.stdout:2/423: write d7/da/d18/d1b/f6c [190667,51410] 0 2023-12-05T09:57:25.988 INFO:tasks.workunit.client.0.smithi100.stdout:2/424: write d7/da/d18/d21/f44 [188262,14403] 0 2023-12-05T09:57:25.988 INFO:tasks.workunit.client.0.smithi100.stdout:4/256: unlink de/f25 0 2023-12-05T09:57:25.988 INFO:tasks.workunit.client.0.smithi100.stdout:4/257: fsync de/d16/d23/f2c 0 2023-12-05T09:57:25.988 INFO:tasks.workunit.client.1.smithi150.stdout:3/264: dwrite d6/d22/d37/f3c [0,4194304] 0 2023-12-05T09:57:25.989 INFO:tasks.workunit.client.1.smithi150.stdout:3/265: stat d6/d25/d28 0 2023-12-05T09:57:25.991 INFO:tasks.workunit.client.0.smithi100.stdout:0/311: link da/c13 da/d1b/d36/c5f 0 2023-12-05T09:57:25.991 INFO:tasks.workunit.client.0.smithi100.stdout:0/312: fdatasync da/d2a/f3f 0 2023-12-05T09:57:25.993 INFO:tasks.workunit.client.0.smithi100.stdout:0/313: write da/d1b/d36/f4f [4571278,123863] 0 2023-12-05T09:57:25.996 INFO:tasks.workunit.client.1.smithi150.stdout:4/221: dwrite d0/f3b [0,4194304] 0 2023-12-05T09:57:25.997 INFO:tasks.workunit.client.0.smithi100.stdout:2/425: mknod d7/da/dc/c8d 0 2023-12-05T09:57:25.997 INFO:tasks.workunit.client.0.smithi100.stdout:2/426: write d7/da/d18/d1b/f6c [1132641,2495] 0 2023-12-05T09:57:25.998 INFO:tasks.workunit.client.1.smithi150.stdout:3/266: mknod d6/d25/d28/c59 0 2023-12-05T09:57:26.003 INFO:tasks.workunit.client.0.smithi100.stdout:4/258: unlink de/lf 0 2023-12-05T09:57:26.003 INFO:tasks.workunit.client.0.smithi100.stdout:5/350: dwrite d0/f59 [0,4194304] 0 2023-12-05T09:57:26.007 INFO:tasks.workunit.client.1.smithi150.stdout:1/302: sync 2023-12-05T09:57:26.007 INFO:tasks.workunit.client.1.smithi150.stdout:7/251: sync 2023-12-05T09:57:26.007 INFO:tasks.workunit.client.1.smithi150.stdout:7/252: chown d2/db/d17/d3a 38954 1 2023-12-05T09:57:26.008 INFO:tasks.workunit.client.1.smithi150.stdout:8/240: dwrite d0/d8/f2c [0,4194304] 0 2023-12-05T09:57:26.009 INFO:tasks.workunit.client.1.smithi150.stdout:8/241: write d0/ff [2733907,114149] 0 2023-12-05T09:57:26.010 INFO:tasks.workunit.client.0.smithi100.stdout:9/347: mknod d7/c73 0 2023-12-05T09:57:26.010 INFO:tasks.workunit.client.0.smithi100.stdout:2/427: symlink d7/da/l8e 0 2023-12-05T09:57:26.011 INFO:tasks.workunit.client.1.smithi150.stdout:1/303: symlink d6/d8/d59/l6f 0 2023-12-05T09:57:26.011 INFO:tasks.workunit.client.1.smithi150.stdout:1/304: truncate d6/d8/db/f16 1211004 0 2023-12-05T09:57:26.013 INFO:tasks.workunit.client.0.smithi100.stdout:0/314: dread da/d22/f23 [0,4194304] 0 2023-12-05T09:57:26.019 INFO:tasks.workunit.client.1.smithi150.stdout:4/222: dread d0/f30 [0,4194304] 0 2023-12-05T09:57:26.022 INFO:tasks.workunit.client.1.smithi150.stdout:7/253: write d2/db/d30/d13/f14 [3568771,18847] 0 2023-12-05T09:57:26.038 INFO:tasks.workunit.client.1.smithi150.stdout:7/254: dread d2/db/d30/d13/f37 [0,4194304] 0 2023-12-05T09:57:26.042 INFO:tasks.workunit.client.0.smithi100.stdout:4/259: write f2 [10828086,82381] 0 2023-12-05T09:57:26.043 INFO:tasks.workunit.client.0.smithi100.stdout:0/315: mkdir da/d60 0 2023-12-05T09:57:26.044 INFO:tasks.workunit.client.1.smithi150.stdout:0/299: dwrite d5/d11/d32/f39 [0,4194304] 0 2023-12-05T09:57:26.047 INFO:tasks.workunit.client.1.smithi150.stdout:8/242: mknod d0/d41/d49/d1b/d24/d2e/d30/c4b 0 2023-12-05T09:57:26.049 INFO:tasks.workunit.client.0.smithi100.stdout:9/348: write d7/d1b/d22/d51/f11 [4138206,91085] 0 2023-12-05T09:57:26.050 INFO:tasks.workunit.client.0.smithi100.stdout:9/349: readlink d7/d1b/d22/l36 0 2023-12-05T09:57:26.050 INFO:tasks.workunit.client.1.smithi150.stdout:1/305: symlink d6/d8/d59/l70 0 2023-12-05T09:57:26.054 INFO:tasks.workunit.client.1.smithi150.stdout:4/223: rmdir d0/d11 39 2023-12-05T09:57:26.058 INFO:tasks.workunit.client.0.smithi100.stdout:2/428: dwrite d7/da/d18/f62 [0,4194304] 0 2023-12-05T09:57:26.062 INFO:tasks.workunit.client.0.smithi100.stdout:4/260: truncate de/d16/d23/f29 899804 0 2023-12-05T09:57:26.062 INFO:tasks.workunit.client.0.smithi100.stdout:0/316: mknod da/d22/d33/c61 0 2023-12-05T09:57:26.064 INFO:tasks.workunit.client.1.smithi150.stdout:8/243: write d0/d41/d49/d1b/f2f [7289021,85283] 0 2023-12-05T09:57:26.064 INFO:tasks.workunit.client.1.smithi150.stdout:8/244: dread - d0/d8/f23 zero size 2023-12-05T09:57:26.070 INFO:tasks.workunit.client.0.smithi100.stdout:0/317: creat da/d2a/f62 x:0 0 0 2023-12-05T09:57:26.072 INFO:tasks.workunit.client.1.smithi150.stdout:8/245: mknod d0/d41/d49/d1b/c4c 0 2023-12-05T09:57:26.074 INFO:tasks.workunit.client.1.smithi150.stdout:8/246: mkdir d0/d41/d49/d1b/d24/d2e/d4d 0 2023-12-05T09:57:26.074 INFO:tasks.workunit.client.1.smithi150.stdout:8/247: fdatasync d0/d41/d49/d1b/f2b 0 2023-12-05T09:57:26.074 INFO:tasks.workunit.client.1.smithi150.stdout:9/235: sync 2023-12-05T09:57:26.077 INFO:tasks.workunit.client.0.smithi100.stdout:3/347: dwrite d0/d2/d33/f35 [0,4194304] 0 2023-12-05T09:57:26.077 INFO:tasks.workunit.client.0.smithi100.stdout:3/348: write d0/d4/d3a/f64 [845202,3140] 0 2023-12-05T09:57:26.077 INFO:tasks.workunit.client.0.smithi100.stdout:3/349: write d0/d4/f17 [4980933,11310] 0 2023-12-05T09:57:26.077 INFO:tasks.workunit.client.0.smithi100.stdout:3/350: fdatasync d0/d2/de/f38 0 2023-12-05T09:57:26.081 INFO:tasks.workunit.client.0.smithi100.stdout:3/351: mkdir d0/d3d/d5c/d5f/d73 0 2023-12-05T09:57:26.081 INFO:tasks.workunit.client.1.smithi150.stdout:2/267: sync 2023-12-05T09:57:26.081 INFO:tasks.workunit.client.1.smithi150.stdout:6/224: sync 2023-12-05T09:57:26.082 INFO:tasks.workunit.client.0.smithi100.stdout:3/352: symlink d0/d3d/d5c/d5f/l74 0 2023-12-05T09:57:26.084 INFO:tasks.workunit.client.0.smithi100.stdout:2/429: dread d7/da/dc/f12 [0,4194304] 0 2023-12-05T09:57:26.084 INFO:tasks.workunit.client.0.smithi100.stdout:2/430: chown d7/f34 343 1 2023-12-05T09:57:26.084 INFO:tasks.workunit.client.1.smithi150.stdout:2/268: mknod d0/d3/d5/d13/d15/c5c 0 2023-12-05T09:57:26.085 INFO:tasks.workunit.client.0.smithi100.stdout:3/353: unlink d0/d4/d3a/c5d 0 2023-12-05T09:57:26.087 INFO:tasks.workunit.client.0.smithi100.stdout:2/431: creat d7/da/d18/d21/d4d/d81/f8f x:0 0 0 2023-12-05T09:57:26.088 INFO:tasks.workunit.client.1.smithi150.stdout:9/236: dread d3/d9/dc/d1f/f2b [0,4194304] 0 2023-12-05T09:57:26.090 INFO:tasks.workunit.client.0.smithi100.stdout:2/432: symlink d7/da/d18/l90 0 2023-12-05T09:57:26.091 INFO:tasks.workunit.client.1.smithi150.stdout:9/237: truncate d3/f2e 1549411 0 2023-12-05T09:57:26.095 INFO:tasks.workunit.client.0.smithi100.stdout:2/433: creat d7/da/dc/d88/f91 x:0 0 0 2023-12-05T09:57:26.095 INFO:tasks.workunit.client.0.smithi100.stdout:2/434: fsync d7/da/d18/d1b/f28 0 2023-12-05T09:57:26.096 INFO:tasks.workunit.client.0.smithi100.stdout:2/435: write d7/da/d1a/f38 [3123632,109093] 0 2023-12-05T09:57:26.096 INFO:tasks.workunit.client.0.smithi100.stdout:2/436: fdatasync d7/da/d65/f77 0 2023-12-05T09:57:26.096 INFO:tasks.workunit.client.1.smithi150.stdout:9/238: rmdir d3/d9/dc 39 2023-12-05T09:57:26.097 INFO:tasks.workunit.client.1.smithi150.stdout:9/239: link d3/d9/f14 d3/d9/f49 0 2023-12-05T09:57:26.103 INFO:tasks.workunit.client.1.smithi150.stdout:4/224: dwrite d0/d11/f2a [0,4194304] 0 2023-12-05T09:57:26.118 INFO:tasks.workunit.client.1.smithi150.stdout:9/240: write d3/d9/dc/f1d [2781260,117799] 0 2023-12-05T09:57:26.120 INFO:tasks.workunit.client.1.smithi150.stdout:9/241: symlink d3/d9/d26/l4a 0 2023-12-05T09:57:26.126 INFO:tasks.workunit.client.1.smithi150.stdout:6/225: dwrite d2/da/f31 [0,4194304] 0 2023-12-05T09:57:26.126 INFO:tasks.workunit.client.1.smithi150.stdout:6/226: creat d2/d23/d2e/f4f x:0 0 0 2023-12-05T09:57:26.144 INFO:tasks.workunit.client.1.smithi150.stdout:8/248: dread d0/ff [0,4194304] 0 2023-12-05T09:57:26.144 INFO:tasks.workunit.client.1.smithi150.stdout:8/249: readlink d0/d41/d49/d1b/l37 0 2023-12-05T09:57:26.144 INFO:tasks.workunit.client.1.smithi150.stdout:8/250: chown d0/d41/d49/d1b/d24/d38/f3a 7 1 2023-12-05T09:57:26.144 INFO:tasks.workunit.client.1.smithi150.stdout:9/242: write d3/d9/d26/f21 [1349908,75357] 0 2023-12-05T09:57:26.146 INFO:tasks.workunit.client.1.smithi150.stdout:8/251: rename d0/l20 to d0/d41/l4e 0 2023-12-05T09:57:26.147 INFO:tasks.workunit.client.1.smithi150.stdout:8/252: truncate d0/d41/d49/f1a 3055299 0 2023-12-05T09:57:26.147 INFO:tasks.workunit.client.1.smithi150.stdout:2/269: dread d0/f16 [0,4194304] 0 2023-12-05T09:57:26.151 INFO:tasks.workunit.client.1.smithi150.stdout:8/253: mknod d0/c4f 0 2023-12-05T09:57:26.152 INFO:tasks.workunit.client.1.smithi150.stdout:8/254: creat d0/d41/f50 x:0 0 0 2023-12-05T09:57:26.155 INFO:tasks.workunit.client.1.smithi150.stdout:8/255: creat d0/d8/f51 x:0 0 0 2023-12-05T09:57:26.155 INFO:tasks.workunit.client.1.smithi150.stdout:8/256: write d0/ff [3072180,82509] 0 2023-12-05T09:57:26.155 INFO:tasks.workunit.client.0.smithi100.stdout:4/261: dwrite de/f12 [0,4194304] 0 2023-12-05T09:57:26.156 INFO:tasks.workunit.client.0.smithi100.stdout:4/262: fsync de/d16/d1e/f30 0 2023-12-05T09:57:26.156 INFO:tasks.workunit.client.0.smithi100.stdout:3/354: dwrite d0/d2/d62/f70 [0,4194304] 0 2023-12-05T09:57:26.158 INFO:tasks.workunit.client.1.smithi150.stdout:4/225: dwrite d0/d11/f39 [0,4194304] 0 2023-12-05T09:57:26.158 INFO:tasks.workunit.client.1.smithi150.stdout:4/226: chown d0/d11/f2f 116254809 1 2023-12-05T09:57:26.159 INFO:tasks.workunit.client.0.smithi100.stdout:9/350: dwrite d7/d1b/d22/d51/f5f [0,4194304] 0 2023-12-05T09:57:26.159 INFO:tasks.workunit.client.0.smithi100.stdout:2/437: dwrite d7/da/d13/f5d [0,4194304] 0 2023-12-05T09:57:26.161 INFO:tasks.workunit.client.1.smithi150.stdout:8/257: creat d0/d41/d49/f52 x:0 0 0 2023-12-05T09:57:26.162 INFO:tasks.workunit.client.1.smithi150.stdout:8/258: dread - d0/d41/f50 zero size 2023-12-05T09:57:26.167 INFO:tasks.workunit.client.1.smithi150.stdout:2/270: dread d0/d3/d5/d22/f35 [0,4194304] 0 2023-12-05T09:57:26.168 INFO:tasks.workunit.client.1.smithi150.stdout:8/259: dread d0/d8/f11 [0,4194304] 0 2023-12-05T09:57:26.168 INFO:tasks.workunit.client.1.smithi150.stdout:5/262: sync 2023-12-05T09:57:26.168 INFO:tasks.workunit.client.1.smithi150.stdout:8/260: fsync d0/d8/f23 0 2023-12-05T09:57:26.168 INFO:tasks.workunit.client.1.smithi150.stdout:8/261: chown d0/d8/f1f 41116 1 2023-12-05T09:57:26.169 INFO:tasks.workunit.client.1.smithi150.stdout:5/263: write d1/d2e/f52 [955706,13429] 0 2023-12-05T09:57:26.173 INFO:tasks.workunit.client.0.smithi100.stdout:4/263: mkdir de/d16/d23/d33/d51 0 2023-12-05T09:57:26.174 INFO:tasks.workunit.client.1.smithi150.stdout:4/227: dread d0/d11/f18 [0,4194304] 0 2023-12-05T09:57:26.174 INFO:tasks.workunit.client.1.smithi150.stdout:4/228: fdatasync d0/d11/f2f 0 2023-12-05T09:57:26.177 INFO:tasks.workunit.client.0.smithi100.stdout:3/355: unlink d0/d4/fc 0 2023-12-05T09:57:26.179 INFO:tasks.workunit.client.1.smithi150.stdout:8/262: creat d0/d41/d49/d1b/d24/d2e/f53 x:0 0 0 2023-12-05T09:57:26.182 INFO:tasks.workunit.client.1.smithi150.stdout:4/229: symlink d0/d11/l3d 0 2023-12-05T09:57:26.184 INFO:tasks.workunit.client.1.smithi150.stdout:8/263: creat d0/d41/d49/d1b/d24/d43/f54 x:0 0 0 2023-12-05T09:57:26.191 INFO:tasks.workunit.client.0.smithi100.stdout:9/351: mkdir d7/d1b/d22/d2a/d74 0 2023-12-05T09:57:26.192 INFO:tasks.workunit.client.0.smithi100.stdout:9/352: fdatasync d7/d1b/d22/d2a/d56/d2e/d50/f61 0 2023-12-05T09:57:26.192 INFO:tasks.workunit.client.0.smithi100.stdout:9/353: write d7/d35/f55 [905822,77712] 0 2023-12-05T09:57:26.192 INFO:tasks.workunit.client.0.smithi100.stdout:9/354: creat d7/d35/f75 x:0 0 0 2023-12-05T09:57:26.193 INFO:tasks.workunit.client.0.smithi100.stdout:2/438: mkdir d7/da/d18/d21/d86/d92 0 2023-12-05T09:57:26.194 INFO:tasks.workunit.client.1.smithi150.stdout:7/255: sync 2023-12-05T09:57:26.194 INFO:tasks.workunit.client.1.smithi150.stdout:3/267: sync 2023-12-05T09:57:26.194 INFO:tasks.workunit.client.1.smithi150.stdout:3/268: truncate d6/d9/f57 800587 0 2023-12-05T09:57:26.194 INFO:tasks.workunit.client.1.smithi150.stdout:3/269: chown d6/d9/d43 19 1 2023-12-05T09:57:26.201 INFO:tasks.workunit.client.0.smithi100.stdout:3/356: unlink d0/l4b 0 2023-12-05T09:57:26.207 INFO:tasks.workunit.client.0.smithi100.stdout:9/355: rename d7/d1b/d22/d51/f37 to d7/d20/f76 0 2023-12-05T09:57:26.210 INFO:tasks.workunit.client.1.smithi150.stdout:4/230: write d0/d11/f2e [679365,88940] 0 2023-12-05T09:57:26.210 INFO:tasks.workunit.client.0.smithi100.stdout:4/264: rmdir de/d16/d1e 39 2023-12-05T09:57:26.213 INFO:tasks.workunit.client.1.smithi150.stdout:6/227: dwrite d2/da/f27 [0,4194304] 0 2023-12-05T09:57:26.214 INFO:tasks.workunit.client.0.smithi100.stdout:3/357: creat d0/d2/f75 x:0 0 0 2023-12-05T09:57:26.214 INFO:tasks.workunit.client.0.smithi100.stdout:3/358: stat d0/d10 0 2023-12-05T09:57:26.214 INFO:tasks.workunit.client.0.smithi100.stdout:3/359: read d0/f36 [178397,5832] 0 2023-12-05T09:57:26.216 INFO:tasks.workunit.client.0.smithi100.stdout:4/265: link de/d16/d23/d36/f31 de/d16/f52 0 2023-12-05T09:57:26.216 INFO:tasks.workunit.client.0.smithi100.stdout:4/266: write de/d16/d23/f2c [960430,126043] 0 2023-12-05T09:57:26.220 INFO:tasks.workunit.client.0.smithi100.stdout:1/298: sync 2023-12-05T09:57:26.220 INFO:tasks.workunit.client.0.smithi100.stdout:6/631: sync 2023-12-05T09:57:26.220 INFO:tasks.workunit.client.0.smithi100.stdout:6/632: dread - d7/d11/d7e/fa1 zero size 2023-12-05T09:57:26.221 INFO:tasks.workunit.client.1.smithi150.stdout:6/228: dread d2/da/f22 [0,4194304] 0 2023-12-05T09:57:26.222 INFO:tasks.workunit.client.1.smithi150.stdout:6/229: chown c1 470083 1 2023-12-05T09:57:26.222 INFO:tasks.workunit.client.0.smithi100.stdout:3/360: symlink d0/d10/l76 0 2023-12-05T09:57:26.222 INFO:tasks.workunit.client.0.smithi100.stdout:3/361: creat d0/d10/f77 x:0 0 0 2023-12-05T09:57:26.223 INFO:tasks.workunit.client.0.smithi100.stdout:8/254: sync 2023-12-05T09:57:26.224 INFO:tasks.workunit.client.0.smithi100.stdout:1/299: read db/d12/f45 [135271,20306] 0 2023-12-05T09:57:26.225 INFO:tasks.workunit.client.0.smithi100.stdout:1/300: creat db/d31/d3a/f5b x:0 0 0 2023-12-05T09:57:26.225 INFO:tasks.workunit.client.0.smithi100.stdout:1/301: fdatasync f9 0 2023-12-05T09:57:26.228 INFO:tasks.workunit.client.0.smithi100.stdout:4/267: rename de/d16/d23/d36/f31 to de/d16/d23/f53 0 2023-12-05T09:57:26.232 INFO:tasks.workunit.client.1.smithi150.stdout:5/264: dwrite d1/f55 [0,4194304] 0 2023-12-05T09:57:26.237 INFO:tasks.workunit.client.1.smithi150.stdout:4/231: dread d0/fd [0,4194304] 0 2023-12-05T09:57:26.238 INFO:tasks.workunit.client.0.smithi100.stdout:8/255: truncate d0/f1d 2411659 0 2023-12-05T09:57:26.238 INFO:tasks.workunit.client.0.smithi100.stdout:8/256: chown d0/d12/d13/d16/d22/d24/l2c 0 1 2023-12-05T09:57:26.238 INFO:tasks.workunit.client.0.smithi100.stdout:8/257: write d0/d12/f36 [817945,53401] 0 2023-12-05T09:57:26.239 INFO:tasks.workunit.client.0.smithi100.stdout:3/362: creat d0/d2/d33/f78 x:0 0 0 2023-12-05T09:57:26.240 INFO:tasks.workunit.client.1.smithi150.stdout:4/232: mkdir d0/d3e 0 2023-12-05T09:57:26.240 INFO:tasks.workunit.client.1.smithi150.stdout:4/233: readlink d0/d11/l3d 0 2023-12-05T09:57:26.241 INFO:tasks.workunit.client.0.smithi100.stdout:4/268: mknod de/d16/d23/d33/d51/c54 0 2023-12-05T09:57:26.242 INFO:tasks.workunit.client.0.smithi100.stdout:4/269: creat de/f55 x:0 0 0 2023-12-05T09:57:26.251 INFO:tasks.workunit.client.0.smithi100.stdout:1/302: dread db/d31/d3a/f4c [0,4194304] 0 2023-12-05T09:57:26.251 INFO:tasks.workunit.client.0.smithi100.stdout:1/303: write db/d31/f51 [455275,14973] 0 2023-12-05T09:57:26.254 INFO:tasks.workunit.client.1.smithi150.stdout:4/234: rename d0/ff to d0/d11/f3f 0 2023-12-05T09:57:26.255 INFO:tasks.workunit.client.0.smithi100.stdout:3/363: unlink d0/d4/d3a/d45/f50 0 2023-12-05T09:57:26.260 INFO:tasks.workunit.client.1.smithi150.stdout:4/235: rename d0/c1e to d0/d3e/c40 0 2023-12-05T09:57:26.261 INFO:tasks.workunit.client.0.smithi100.stdout:3/364: write d0/d10/f2a [4683860,59489] 0 2023-12-05T09:57:26.261 INFO:tasks.workunit.client.0.smithi100.stdout:3/365: write d0/d10/f49 [8421683,103007] 0 2023-12-05T09:57:26.268 INFO:tasks.workunit.client.1.smithi150.stdout:2/271: dwrite d0/d3/d11/f23 [0,4194304] 0 2023-12-05T09:57:26.271 INFO:tasks.workunit.client.0.smithi100.stdout:8/258: rmdir d0/d12/d13/d16 39 2023-12-05T09:57:26.275 INFO:tasks.workunit.client.0.smithi100.stdout:1/304: rename db/d12/d1e/d26/d30/d52/c53 to db/d31/d3a/c5c 0 2023-12-05T09:57:26.279 INFO:tasks.workunit.client.1.smithi150.stdout:4/236: link d0/d11/f2e d0/f41 0 2023-12-05T09:57:26.282 INFO:tasks.workunit.client.0.smithi100.stdout:3/366: dread d0/d2/de/d12/f63 [0,4194304] 0 2023-12-05T09:57:26.285 INFO:tasks.workunit.client.1.smithi150.stdout:6/230: dwrite d2/f13 [4194304,4194304] 0 2023-12-05T09:57:26.285 INFO:tasks.workunit.client.1.smithi150.stdout:6/231: chown d2/da/f31 4 1 2023-12-05T09:57:26.286 INFO:tasks.workunit.client.0.smithi100.stdout:2/439: dwrite d7/da/d18/f62 [4194304,4194304] 0 2023-12-05T09:57:26.288 INFO:tasks.workunit.client.1.smithi150.stdout:2/272: creat d0/d3/d5/d22/d52/d5a/f5d x:0 0 0 2023-12-05T09:57:26.289 INFO:tasks.workunit.client.0.smithi100.stdout:1/305: dread db/d12/d1e/f2e [0,4194304] 0 2023-12-05T09:57:26.289 INFO:tasks.workunit.client.0.smithi100.stdout:1/306: truncate db/d12/d1e/f2e 576255 0 2023-12-05T09:57:26.290 INFO:tasks.workunit.client.1.smithi150.stdout:1/306: sync 2023-12-05T09:57:26.290 INFO:tasks.workunit.client.1.smithi150.stdout:1/307: readlink d6/d38/d4a/l4f 0 2023-12-05T09:57:26.290 INFO:tasks.workunit.client.0.smithi100.stdout:3/367: mknod d0/c79 0 2023-12-05T09:57:26.291 INFO:tasks.workunit.client.1.smithi150.stdout:5/265: dwrite d1/d2e/f52 [0,4194304] 0 2023-12-05T09:57:26.292 INFO:tasks.workunit.client.1.smithi150.stdout:8/264: dwrite d0/d8/f11 [0,4194304] 0 2023-12-05T09:57:26.292 INFO:tasks.workunit.client.1.smithi150.stdout:8/265: creat d0/d41/f55 x:0 0 0 2023-12-05T09:57:26.292 INFO:tasks.workunit.client.0.smithi100.stdout:8/259: read d0/d12/d13/d16/f2e [2199117,7844] 0 2023-12-05T09:57:26.292 INFO:tasks.workunit.client.1.smithi150.stdout:7/256: dwrite d2/db/f45 [0,4194304] 0 2023-12-05T09:57:26.293 INFO:tasks.workunit.client.0.smithi100.stdout:6/633: dwrite d7/d76/fc1 [4194304,4194304] 0 2023-12-05T09:57:26.294 INFO:tasks.workunit.client.1.smithi150.stdout:0/300: sync 2023-12-05T09:57:26.295 INFO:tasks.workunit.client.1.smithi150.stdout:4/237: mkdir d0/d42 0 2023-12-05T09:57:26.296 INFO:tasks.workunit.client.0.smithi100.stdout:6/634: write d7/d2d/d6a/d7c/fb8 [82884,88022] 0 2023-12-05T09:57:26.296 INFO:tasks.workunit.client.0.smithi100.stdout:2/440: rename d7/da/f5b to d7/da/d13/d69/d6e/d71/f93 0 2023-12-05T09:57:26.299 INFO:tasks.workunit.client.1.smithi150.stdout:6/232: creat d2/d23/d2e/d44/f50 x:0 0 0 2023-12-05T09:57:26.299 INFO:tasks.workunit.client.1.smithi150.stdout:6/233: write d2/d23/d2e/d39/f40 [1311867,102768] 0 2023-12-05T09:57:26.300 INFO:tasks.workunit.client.0.smithi100.stdout:3/368: read d0/d4/f17 [4453510,37] 0 2023-12-05T09:57:26.306 INFO:tasks.workunit.client.1.smithi150.stdout:1/308: link d6/d8/db/de/c6d d6/d8/db/de/c71 0 2023-12-05T09:57:26.319 INFO:tasks.workunit.client.1.smithi150.stdout:5/266: dread d1/d3/f7 [0,4194304] 0 2023-12-05T09:57:26.319 INFO:tasks.workunit.client.1.smithi150.stdout:5/267: chown d1/d3/d1e/d21/d3b 15903620 1 2023-12-05T09:57:26.319 INFO:tasks.workunit.client.1.smithi150.stdout:5/268: write d1/d3/d1e/d31/f49 [146213,77306] 0 2023-12-05T09:57:26.321 INFO:tasks.workunit.client.1.smithi150.stdout:8/266: dread d0/d41/d49/d1b/f2b [0,4194304] 0 2023-12-05T09:57:26.321 INFO:tasks.workunit.client.1.smithi150.stdout:8/267: write d0/d41/d49/d1b/f1c [2311708,113419] 0 2023-12-05T09:57:26.321 INFO:tasks.workunit.client.1.smithi150.stdout:8/268: chown d0/d41/d49/l3c 377065 1 2023-12-05T09:57:26.321 INFO:tasks.workunit.client.1.smithi150.stdout:8/269: fsync d0/d41/d49/d1b/d24/f3b 0 2023-12-05T09:57:26.322 INFO:tasks.workunit.client.1.smithi150.stdout:9/243: sync 2023-12-05T09:57:26.324 INFO:tasks.workunit.client.0.smithi100.stdout:1/307: dwrite db/d12/f16 [0,4194304] 0 2023-12-05T09:57:26.325 INFO:tasks.workunit.client.0.smithi100.stdout:1/308: write db/d31/d3a/f5b [917619,77654] 0 2023-12-05T09:57:26.333 INFO:tasks.workunit.client.0.smithi100.stdout:2/441: truncate d7/da/d18/d1b/d2c/d3f/d46/f76 4011266 0 2023-12-05T09:57:26.333 INFO:tasks.workunit.client.0.smithi100.stdout:2/442: readlink d7/da/d18/d21/l54 0 2023-12-05T09:57:26.333 INFO:tasks.workunit.client.0.smithi100.stdout:2/443: chown d7/da/d18/d1b/d2c/d3f/f67 268354967 1 2023-12-05T09:57:26.333 INFO:tasks.workunit.client.0.smithi100.stdout:2/444: chown d7/da/dc/d88/c8b 5290148 1 2023-12-05T09:57:26.334 INFO:tasks.workunit.client.0.smithi100.stdout:3/369: mknod d0/d2/de/d11/d58/c7a 0 2023-12-05T09:57:26.335 INFO:tasks.workunit.client.1.smithi150.stdout:2/273: dwrite d0/d3/d5/f40 [0,4194304] 0 2023-12-05T09:57:26.335 INFO:tasks.workunit.client.1.smithi150.stdout:2/274: chown d0/d3/d11/d1d/l4e 6 1 2023-12-05T09:57:26.338 INFO:tasks.workunit.client.0.smithi100.stdout:3/370: write d0/d2/f4f [213697,102201] 0 2023-12-05T09:57:26.339 INFO:tasks.workunit.client.1.smithi150.stdout:7/257: mknod d2/db/d30/d13/c4a 0 2023-12-05T09:57:26.341 INFO:tasks.workunit.client.0.smithi100.stdout:1/309: rmdir db/d31/d4f 39 2023-12-05T09:57:26.343 INFO:tasks.workunit.client.0.smithi100.stdout:6/635: dwrite d7/d2d/d6a/d7c/d8d/fb3 [0,4194304] 0 2023-12-05T09:57:26.344 INFO:tasks.workunit.client.1.smithi150.stdout:0/301: link d5/d11/d16/d3f/d3b/f52 d5/d11/d16/f63 0 2023-12-05T09:57:26.347 INFO:tasks.workunit.client.0.smithi100.stdout:3/371: symlink d0/l7b 0 2023-12-05T09:57:26.347 INFO:tasks.workunit.client.0.smithi100.stdout:7/248: sync 2023-12-05T09:57:26.347 INFO:tasks.workunit.client.0.smithi100.stdout:5/351: sync 2023-12-05T09:57:26.347 INFO:tasks.workunit.client.0.smithi100.stdout:2/445: write d7/da/f17 [2525376,124207] 0 2023-12-05T09:57:26.348 INFO:tasks.workunit.client.1.smithi150.stdout:4/238: symlink d0/d3e/l43 0 2023-12-05T09:57:26.351 INFO:tasks.workunit.client.0.smithi100.stdout:1/310: unlink db/d12/d1e/d26/d30/d52/f5a 0 2023-12-05T09:57:26.355 INFO:tasks.workunit.client.1.smithi150.stdout:3/270: sync 2023-12-05T09:57:26.355 INFO:tasks.workunit.client.1.smithi150.stdout:3/271: chown d6/d25/d28/f3a 1664 1 2023-12-05T09:57:26.357 INFO:tasks.workunit.client.1.smithi150.stdout:7/258: dread d2/db/f26 [0,4194304] 0 2023-12-05T09:57:26.359 INFO:tasks.workunit.client.0.smithi100.stdout:6/636: mknod d7/d2d/ccf 0 2023-12-05T09:57:26.359 INFO:tasks.workunit.client.0.smithi100.stdout:6/637: fsync d7/d11/f2c 0 2023-12-05T09:57:26.361 INFO:tasks.workunit.client.0.smithi100.stdout:7/249: link d3/dc/d11/d13/d1b/f45 d3/dc/d11/f59 0 2023-12-05T09:57:26.362 INFO:tasks.workunit.client.1.smithi150.stdout:9/244: truncate d3/d9/d26/f21 472165 0 2023-12-05T09:57:26.363 INFO:tasks.workunit.client.0.smithi100.stdout:5/352: mkdir d0/d16/d2b/d48/df/d51/d7b 0 2023-12-05T09:57:26.363 INFO:tasks.workunit.client.0.smithi100.stdout:5/353: truncate d0/d16/f68 5156961 0 2023-12-05T09:57:26.363 INFO:tasks.workunit.client.0.smithi100.stdout:5/354: creat d0/d1f/d53/f7c x:0 0 0 2023-12-05T09:57:26.366 INFO:tasks.workunit.client.0.smithi100.stdout:2/446: link d7/da/d18/d1b/d2c/d3f/l64 d7/da/l94 0 2023-12-05T09:57:26.366 INFO:tasks.workunit.client.0.smithi100.stdout:3/372: read d0/d2/d33/f40 [3768288,2221] 0 2023-12-05T09:57:26.367 INFO:tasks.workunit.client.0.smithi100.stdout:6/638: mkdir d7/d11/d1a/d78/dd0 0 2023-12-05T09:57:26.369 INFO:tasks.workunit.client.1.smithi150.stdout:2/275: mknod d0/d3/d5/d22/d52/d56/c5e 0 2023-12-05T09:57:26.370 INFO:tasks.workunit.client.0.smithi100.stdout:1/311: dread db/d12/d1e/f41 [4194304,4194304] 0 2023-12-05T09:57:26.373 INFO:tasks.workunit.client.1.smithi150.stdout:0/302: mknod d5/d11/d32/d57/c64 0 2023-12-05T09:57:26.373 INFO:tasks.workunit.client.1.smithi150.stdout:0/303: dread - d5/f41 zero size 2023-12-05T09:57:26.374 INFO:tasks.workunit.client.0.smithi100.stdout:5/355: truncate d0/d1f/d25/f67 1034124 0 2023-12-05T09:57:26.376 INFO:tasks.workunit.client.1.smithi150.stdout:4/239: mkdir d0/d42/d44 0 2023-12-05T09:57:26.376 INFO:tasks.workunit.client.1.smithi150.stdout:4/240: dread - d0/f26 zero size 2023-12-05T09:57:26.376 INFO:tasks.workunit.client.1.smithi150.stdout:7/259: write d2/f12 [3767627,45648] 0 2023-12-05T09:57:26.376 INFO:tasks.workunit.client.1.smithi150.stdout:7/260: truncate d2/db/d30/d18/d1a/f3c 414885 0 2023-12-05T09:57:26.377 INFO:tasks.workunit.client.1.smithi150.stdout:5/269: dwrite d1/d3/d6/f1c [0,4194304] 0 2023-12-05T09:57:26.378 INFO:tasks.workunit.client.1.smithi150.stdout:1/309: rmdir d6/d47/d4c/d60 39 2023-12-05T09:57:26.382 INFO:tasks.workunit.client.1.smithi150.stdout:3/272: truncate d6/d42/f44 320105 0 2023-12-05T09:57:26.387 INFO:tasks.workunit.client.0.smithi100.stdout:7/250: write d3/dc/d11/f31 [487670,59940] 0 2023-12-05T09:57:26.387 INFO:tasks.workunit.client.0.smithi100.stdout:7/251: fdatasync d3/dc/d11/d13/de/d2d/f4f 0 2023-12-05T09:57:26.390 INFO:tasks.workunit.client.1.smithi150.stdout:2/276: write d0/f16 [2046187,42603] 0 2023-12-05T09:57:26.391 INFO:tasks.workunit.client.0.smithi100.stdout:2/447: dread d7/da/d18/d21/f40 [0,4194304] 0 2023-12-05T09:57:26.391 INFO:tasks.workunit.client.0.smithi100.stdout:5/356: creat d0/d1b/d4d/d6c/f7d x:0 0 0 2023-12-05T09:57:26.391 INFO:tasks.workunit.client.0.smithi100.stdout:3/373: dread d0/d10/d39/f55 [0,4194304] 0 2023-12-05T09:57:26.391 INFO:tasks.workunit.client.0.smithi100.stdout:3/374: write d0/d4/f4a [1115434,86456] 0 2023-12-05T09:57:26.395 INFO:tasks.workunit.client.1.smithi150.stdout:4/241: creat d0/f45 x:0 0 0 2023-12-05T09:57:26.397 INFO:tasks.workunit.client.0.smithi100.stdout:6/639: mkdir d7/d11/dd1 0 2023-12-05T09:57:26.403 INFO:tasks.workunit.client.1.smithi150.stdout:8/270: rename d0/d41/d49/d1b/d24/d43 to d0/d41/d49/d1b/d24/d34/d56 0 2023-12-05T09:57:26.403 INFO:tasks.workunit.client.1.smithi150.stdout:8/271: chown d0/d8/f2c 2577 1 2023-12-05T09:57:26.407 INFO:tasks.workunit.client.1.smithi150.stdout:2/277: mknod d0/d3/d11/c5f 0 2023-12-05T09:57:26.409 INFO:tasks.workunit.client.1.smithi150.stdout:7/261: rmdir d2/d1b 39 2023-12-05T09:57:26.409 INFO:tasks.workunit.client.1.smithi150.stdout:7/262: dread - d2/db/d30/d13/f1d zero size 2023-12-05T09:57:26.409 INFO:tasks.workunit.client.1.smithi150.stdout:7/263: readlink d2/le 0 2023-12-05T09:57:26.414 INFO:tasks.workunit.client.0.smithi100.stdout:2/448: creat d7/d61/f95 x:0 0 0 2023-12-05T09:57:26.415 INFO:tasks.workunit.client.1.smithi150.stdout:5/270: dread d1/d3/d6/f1c [0,4194304] 0 2023-12-05T09:57:26.415 INFO:tasks.workunit.client.1.smithi150.stdout:5/271: stat d1/d3/d6/d26/f28 0 2023-12-05T09:57:26.415 INFO:tasks.workunit.client.1.smithi150.stdout:5/272: fdatasync d1/d3/d1e/d21/f35 0 2023-12-05T09:57:26.416 INFO:tasks.workunit.client.0.smithi100.stdout:6/640: link d7/d27/d72/f87 d7/dcc/fd2 0 2023-12-05T09:57:26.421 INFO:tasks.workunit.client.1.smithi150.stdout:5/273: symlink d1/d3/d1e/d21/l60 0 2023-12-05T09:57:26.422 INFO:tasks.workunit.client.1.smithi150.stdout:5/274: chown d1/d3/d38/f4f 1110911 1 2023-12-05T09:57:26.422 INFO:tasks.workunit.client.1.smithi150.stdout:4/242: dread d0/d11/f37 [0,4194304] 0 2023-12-05T09:57:26.422 INFO:tasks.workunit.client.1.smithi150.stdout:4/243: truncate d0/d11/f39 4665283 0 2023-12-05T09:57:26.423 INFO:tasks.workunit.client.0.smithi100.stdout:6/641: symlink d7/d76/ld3 0 2023-12-05T09:57:26.425 INFO:tasks.workunit.client.1.smithi150.stdout:5/275: mknod d1/d3/d1e/d21/c61 0 2023-12-05T09:57:26.425 INFO:tasks.workunit.client.0.smithi100.stdout:6/642: rename d7/d11/d82/f29 to d7/d11/d82/fd4 0 2023-12-05T09:57:26.428 INFO:tasks.workunit.client.1.smithi150.stdout:0/304: dwrite d5/f5d [4194304,4194304] 0 2023-12-05T09:57:26.429 INFO:tasks.workunit.client.0.smithi100.stdout:3/375: dread d0/d10/d39/f41 [0,4194304] 0 2023-12-05T09:57:26.431 INFO:tasks.workunit.client.0.smithi100.stdout:3/376: mkdir d0/d2/de/d11/d7c 0 2023-12-05T09:57:26.431 INFO:tasks.workunit.client.0.smithi100.stdout:3/377: getdents d0/d3d 0 2023-12-05T09:57:26.433 INFO:tasks.workunit.client.1.smithi150.stdout:1/310: dread d6/d8/f11 [0,4194304] 0 2023-12-05T09:57:26.436 INFO:tasks.workunit.client.0.smithi100.stdout:3/378: rename d0/d4/l4c to d0/d2/d33/l7d 0 2023-12-05T09:57:26.436 INFO:tasks.workunit.client.0.smithi100.stdout:3/379: stat d0/d10 0 2023-12-05T09:57:26.436 INFO:tasks.workunit.client.0.smithi100.stdout:3/380: dread - d0/d2/d33/f78 zero size 2023-12-05T09:57:26.438 INFO:tasks.workunit.client.1.smithi150.stdout:4/244: dread d0/fd [0,4194304] 0 2023-12-05T09:57:26.441 INFO:tasks.workunit.client.1.smithi150.stdout:8/272: dread d0/f13 [0,4194304] 0 2023-12-05T09:57:26.441 INFO:tasks.workunit.client.0.smithi100.stdout:3/381: symlink d0/d2/de/d11/d58/l7e 0 2023-12-05T09:57:26.445 INFO:tasks.workunit.client.1.smithi150.stdout:8/273: truncate d0/d41/d49/d1b/f2b 736070 0 2023-12-05T09:57:26.445 INFO:tasks.workunit.client.0.smithi100.stdout:3/382: mkdir d0/d3d/d5c/d6f/d7f 0 2023-12-05T09:57:26.446 INFO:tasks.workunit.client.1.smithi150.stdout:8/274: getdents d0/d41/d49/d1b/d24/d2e/d30 0 2023-12-05T09:57:26.446 INFO:tasks.workunit.client.1.smithi150.stdout:8/275: chown d0/d41/l4e 2790233 1 2023-12-05T09:57:26.450 INFO:tasks.workunit.client.0.smithi100.stdout:3/383: creat d0/d10/d39/f80 x:0 0 0 2023-12-05T09:57:26.450 INFO:tasks.workunit.client.1.smithi150.stdout:8/276: write d0/d41/d49/d1b/f1d [345988,83072] 0 2023-12-05T09:57:26.451 INFO:tasks.workunit.client.0.smithi100.stdout:3/384: link d0/d2/de/d11/l2b d0/d2/de/l81 0 2023-12-05T09:57:26.451 INFO:tasks.workunit.client.0.smithi100.stdout:3/385: fsync d0/d10/f2a 0 2023-12-05T09:57:26.453 INFO:tasks.workunit.client.0.smithi100.stdout:3/386: unlink d0/d2/d62/f70 0 2023-12-05T09:57:26.454 INFO:tasks.workunit.client.1.smithi150.stdout:0/305: dread d5/fa [0,4194304] 0 2023-12-05T09:57:26.454 INFO:tasks.workunit.client.0.smithi100.stdout:3/387: mknod d0/d3d/d5c/d6f/d7f/c82 0 2023-12-05T09:57:26.454 INFO:tasks.workunit.client.0.smithi100.stdout:3/388: rename d0/d3d to d0/d3d/d5c/d6f/d7f/d83 22 2023-12-05T09:57:26.456 INFO:tasks.workunit.client.0.smithi100.stdout:6/643: dread d7/d11/f6e [0,4194304] 0 2023-12-05T09:57:26.457 INFO:tasks.workunit.client.0.smithi100.stdout:6/644: read d7/d11/f20 [1395121,125748] 0 2023-12-05T09:57:26.457 INFO:tasks.workunit.client.1.smithi150.stdout:0/306: mkdir d5/d11/d65 0 2023-12-05T09:57:26.457 INFO:tasks.workunit.client.1.smithi150.stdout:0/307: readlink d5/d11/d32/d37/l29 0 2023-12-05T09:57:26.457 INFO:tasks.workunit.client.1.smithi150.stdout:0/308: creat d5/d11/f66 x:0 0 0 2023-12-05T09:57:26.457 INFO:tasks.workunit.client.1.smithi150.stdout:0/309: mkdir d5/d11/d16/d1f/d67 0 2023-12-05T09:57:26.458 INFO:tasks.workunit.client.1.smithi150.stdout:0/310: symlink d5/d11/d16/l68 0 2023-12-05T09:57:26.459 INFO:tasks.workunit.client.1.smithi150.stdout:0/311: symlink d5/d11/d16/d3f/d46/l69 0 2023-12-05T09:57:26.462 INFO:tasks.workunit.client.0.smithi100.stdout:6/645: creat d7/d11/d1a/d78/dd0/fd5 x:0 0 0 2023-12-05T09:57:26.464 INFO:tasks.workunit.client.0.smithi100.stdout:6/646: creat d7/d11/d1a/db1/fd6 x:0 0 0 2023-12-05T09:57:26.464 INFO:tasks.workunit.client.0.smithi100.stdout:6/647: write d7/d11/d1a/f2b [2019820,106523] 0 2023-12-05T09:57:26.464 INFO:tasks.workunit.client.0.smithi100.stdout:6/648: write d7/d11/d1a/db1/fc4 [259865,105838] 0 2023-12-05T09:57:26.467 INFO:tasks.workunit.client.0.smithi100.stdout:7/252: dwrite d3/dc/d11/d13/de/d2d/f4e [0,4194304] 0 2023-12-05T09:57:26.471 INFO:tasks.workunit.client.0.smithi100.stdout:6/649: rename d7/d11/d1a/lc3 to d7/d27/d35/d5a/db0/ld7 0 2023-12-05T09:57:26.471 INFO:tasks.workunit.client.0.smithi100.stdout:6/650: read d7/d2d/d6a/f7b [2645398,28922] 0 2023-12-05T09:57:26.471 INFO:tasks.workunit.client.0.smithi100.stdout:6/651: readlink d7/d2d/l5f 0 2023-12-05T09:57:26.471 INFO:tasks.workunit.client.0.smithi100.stdout:6/652: truncate d7/d11/d82/db9/fca 152299 0 2023-12-05T09:57:26.471 INFO:tasks.workunit.client.0.smithi100.stdout:6/653: truncate d7/d11/d82/f74 1004365 0 2023-12-05T09:57:26.471 INFO:tasks.workunit.client.1.smithi150.stdout:9/245: dwrite d3/d9/d26/f41 [0,4194304] 0 2023-12-05T09:57:26.472 INFO:tasks.workunit.client.0.smithi100.stdout:7/253: rmdir d3/dc/d11/d13/de 39 2023-12-05T09:57:26.472 INFO:tasks.workunit.client.0.smithi100.stdout:7/254: fsync d3/dc/d11/d13/f30 0 2023-12-05T09:57:26.472 INFO:tasks.workunit.client.0.smithi100.stdout:7/255: dread - d3/dc/d11/f1e zero size 2023-12-05T09:57:26.477 INFO:tasks.workunit.client.1.smithi150.stdout:0/312: dread d5/d11/d16/d3f/d3b/f55 [0,4194304] 0 2023-12-05T09:57:26.479 INFO:tasks.workunit.client.0.smithi100.stdout:3/389: dread d0/d4/f17 [0,4194304] 0 2023-12-05T09:57:26.480 INFO:tasks.workunit.client.1.smithi150.stdout:0/313: mkdir d5/d11/d32/d37/d5f/d6a 0 2023-12-05T09:57:26.483 INFO:tasks.workunit.client.1.smithi150.stdout:0/314: symlink d5/d11/d32/l6b 0 2023-12-05T09:57:26.483 INFO:tasks.workunit.client.1.smithi150.stdout:0/315: chown d5/d11/d16/d3f/f3c 114830503 1 2023-12-05T09:57:26.483 INFO:tasks.workunit.client.1.smithi150.stdout:0/316: creat d5/d11/d16/d3f/d3b/f6c x:0 0 0 2023-12-05T09:57:26.483 INFO:tasks.workunit.client.1.smithi150.stdout:0/317: read d5/fc [57596,11800] 0 2023-12-05T09:57:26.487 INFO:tasks.workunit.client.0.smithi100.stdout:3/390: creat d0/d3d/d5c/d6f/f84 x:0 0 0 2023-12-05T09:57:26.488 INFO:tasks.workunit.client.0.smithi100.stdout:7/256: dread d3/dc/d11/d13/de/f2b [0,4194304] 0 2023-12-05T09:57:26.492 INFO:tasks.workunit.client.0.smithi100.stdout:6/654: write d7/d2d/f42 [576334,91642] 0 2023-12-05T09:57:26.493 INFO:tasks.workunit.client.1.smithi150.stdout:8/277: dread d0/f13 [0,4194304] 0 2023-12-05T09:57:26.493 INFO:tasks.workunit.client.1.smithi150.stdout:2/278: dwrite d0/d3/d5/d10/f19 [0,4194304] 0 2023-12-05T09:57:26.493 INFO:tasks.workunit.client.1.smithi150.stdout:8/278: write d0/d41/d49/d1b/d24/d2e/f44 [311880,10049] 0 2023-12-05T09:57:26.493 INFO:tasks.workunit.client.1.smithi150.stdout:8/279: write d0/d41/d49/d1b/d24/d38/f3d [459264,27968] 0 2023-12-05T09:57:26.494 INFO:tasks.workunit.client.1.smithi150.stdout:0/318: mknod d5/d11/d32/d37/d5f/d6a/c6d 0 2023-12-05T09:57:26.494 INFO:tasks.workunit.client.1.smithi150.stdout:0/319: stat d5/d11/d32 0 2023-12-05T09:57:26.495 INFO:tasks.workunit.client.0.smithi100.stdout:7/257: creat d3/dc/d11/d13/de/f5a x:0 0 0 2023-12-05T09:57:26.497 INFO:tasks.workunit.client.0.smithi100.stdout:6/655: symlink d7/d11/d82/db9/ld8 0 2023-12-05T09:57:26.497 INFO:tasks.workunit.client.1.smithi150.stdout:2/279: write d0/d3/d21/f44 [271837,77605] 0 2023-12-05T09:57:26.497 INFO:tasks.workunit.client.1.smithi150.stdout:2/280: write d0/d3/d21/f2c [4222009,24989] 0 2023-12-05T09:57:26.497 INFO:tasks.workunit.client.1.smithi150.stdout:8/280: symlink d0/d8/d45/l57 0 2023-12-05T09:57:26.500 INFO:tasks.workunit.client.0.smithi100.stdout:7/258: symlink d3/dc/d11/d13/d37/l5b 0 2023-12-05T09:57:26.501 INFO:tasks.workunit.client.0.smithi100.stdout:5/357: dwrite d0/f2 [0,4194304] 0 2023-12-05T09:57:26.501 INFO:tasks.workunit.client.0.smithi100.stdout:5/358: chown d0/d16/l3d 1827327615 1 2023-12-05T09:57:26.502 INFO:tasks.workunit.client.0.smithi100.stdout:6/656: rename d7/d27/d35/d5a/db0/fcb to d7/d27/da0/fd9 0 2023-12-05T09:57:26.506 INFO:tasks.workunit.client.1.smithi150.stdout:3/273: dwrite d6/d9/f1c [4194304,4194304] 0 2023-12-05T09:57:26.507 INFO:tasks.workunit.client.1.smithi150.stdout:3/274: chown d6/d25 0 1 2023-12-05T09:57:26.507 INFO:tasks.workunit.client.1.smithi150.stdout:3/275: stat d6/d9/d3d/d52/l58 0 2023-12-05T09:57:26.507 INFO:tasks.workunit.client.0.smithi100.stdout:5/359: link d0/d1f/d53/l79 d0/d1b/d4d/d60/l7e 0 2023-12-05T09:57:26.507 INFO:tasks.workunit.client.0.smithi100.stdout:5/360: write d0/d1f/d53/f7c [363499,97045] 0 2023-12-05T09:57:26.508 INFO:tasks.workunit.client.0.smithi100.stdout:6/657: mkdir d7/dcc/dda 0 2023-12-05T09:57:26.509 INFO:tasks.workunit.client.0.smithi100.stdout:6/658: chown d7/d11/d7e/fa1 1000555 1 2023-12-05T09:57:26.509 INFO:tasks.workunit.client.0.smithi100.stdout:6/659: fsync d7/d11/f20 0 2023-12-05T09:57:26.509 INFO:tasks.workunit.client.0.smithi100.stdout:5/361: truncate d0/f3 3078193 0 2023-12-05T09:57:26.510 INFO:tasks.workunit.client.0.smithi100.stdout:6/660: getdents d7/d2d/d6a/d7c/d8d 0 2023-12-05T09:57:26.511 INFO:tasks.workunit.client.0.smithi100.stdout:5/362: truncate d0/f59 248565 0 2023-12-05T09:57:26.511 INFO:tasks.workunit.client.0.smithi100.stdout:5/363: chown d0/d1f/f21 14128 1 2023-12-05T09:57:26.512 INFO:tasks.workunit.client.0.smithi100.stdout:6/661: link d7/f59 d7/d76/fdb 0 2023-12-05T09:57:26.512 INFO:tasks.workunit.client.0.smithi100.stdout:6/662: fsync d7/d27/f5b 0 2023-12-05T09:57:26.514 INFO:tasks.workunit.client.0.smithi100.stdout:6/663: symlink d7/dcc/ldc 0 2023-12-05T09:57:26.515 INFO:tasks.workunit.client.1.smithi150.stdout:8/281: mknod d0/d41/d49/d1b/d24/d34/c58 0 2023-12-05T09:57:26.516 INFO:tasks.workunit.client.1.smithi150.stdout:7/264: dwrite d2/f12 [0,4194304] 0 2023-12-05T09:57:26.517 INFO:tasks.workunit.client.1.smithi150.stdout:1/311: dwrite d6/d8/fc [0,4194304] 0 2023-12-05T09:57:26.517 INFO:tasks.workunit.client.0.smithi100.stdout:6/664: link d7/d27/d35/l4e d7/d11/d1a/d78/dd0/ldd 0 2023-12-05T09:57:26.521 INFO:tasks.workunit.client.1.smithi150.stdout:7/265: mknod d2/db/d30/d18/d1a/d1e/c4b 0 2023-12-05T09:57:26.521 INFO:tasks.workunit.client.1.smithi150.stdout:7/266: chown d2/db/d30/d18/d1a/f3c 226313831 1 2023-12-05T09:57:26.524 INFO:tasks.workunit.client.1.smithi150.stdout:1/312: rename d6/l46 to d6/d38/d4a/l72 0 2023-12-05T09:57:26.525 INFO:tasks.workunit.client.0.smithi100.stdout:6/665: rmdir d7/d2d/d6a 39 2023-12-05T09:57:26.526 INFO:tasks.workunit.client.1.smithi150.stdout:9/246: dwrite d3/d9/f1c [0,4194304] 0 2023-12-05T09:57:26.526 INFO:tasks.workunit.client.1.smithi150.stdout:9/247: chown d3/f29 117 1 2023-12-05T09:57:26.527 INFO:tasks.workunit.client.0.smithi100.stdout:7/259: dread d3/dc/d11/f32 [0,4194304] 0 2023-12-05T09:57:26.527 INFO:tasks.workunit.client.1.smithi150.stdout:7/267: mknod d2/db/d17/d20/c4c 0 2023-12-05T09:57:26.527 INFO:tasks.workunit.client.1.smithi150.stdout:7/268: chown d2/db/d17/d38 633343306 1 2023-12-05T09:57:26.529 INFO:tasks.workunit.client.1.smithi150.stdout:1/313: chown d6/c2c 3493635 1 2023-12-05T09:57:26.529 INFO:tasks.workunit.client.1.smithi150.stdout:1/314: fsync d6/d47/d4c/f5d 0 2023-12-05T09:57:26.529 INFO:tasks.workunit.client.1.smithi150.stdout:1/315: creat d6/d8/db/f73 x:0 0 0 2023-12-05T09:57:26.532 INFO:tasks.workunit.client.1.smithi150.stdout:2/281: dwrite d0/f7 [0,4194304] 0 2023-12-05T09:57:26.534 INFO:tasks.workunit.client.1.smithi150.stdout:3/276: write d6/d9/d43/d47/f1a [2748343,78397] 0 2023-12-05T09:57:26.537 INFO:tasks.workunit.client.1.smithi150.stdout:9/248: creat d3/d9/dc/f4b x:0 0 0 2023-12-05T09:57:26.537 INFO:tasks.workunit.client.0.smithi100.stdout:6/666: dread d7/d27/d35/d5a/f65 [0,4194304] 0 2023-12-05T09:57:26.537 INFO:tasks.workunit.client.0.smithi100.stdout:6/667: chown d7/d2d/ca6 3 1 2023-12-05T09:57:26.541 INFO:tasks.workunit.client.0.smithi100.stdout:6/668: rmdir d7/d11/d1a/d78 39 2023-12-05T09:57:26.541 INFO:tasks.workunit.client.0.smithi100.stdout:6/669: stat d7 0 2023-12-05T09:57:26.544 INFO:tasks.workunit.client.1.smithi150.stdout:3/277: symlink d6/d9/d3d/d56/l5a 0 2023-12-05T09:57:26.546 INFO:tasks.workunit.client.1.smithi150.stdout:7/269: dread d2/d4/fc [8388608,4194304] 0 2023-12-05T09:57:26.546 INFO:tasks.workunit.client.1.smithi150.stdout:7/270: stat d2/d4/l7 0 2023-12-05T09:57:26.547 INFO:tasks.workunit.client.1.smithi150.stdout:0/320: dwrite d5/f31 [4194304,4194304] 0 2023-12-05T09:57:26.551 INFO:tasks.workunit.client.1.smithi150.stdout:9/249: write d3/f2e [524088,77098] 0 2023-12-05T09:57:26.554 INFO:tasks.workunit.client.1.smithi150.stdout:0/321: rmdir d5/d11/d32/d37/d5f/d6a 39 2023-12-05T09:57:26.555 INFO:tasks.workunit.client.1.smithi150.stdout:9/250: chown d3/d9/dc/d1f/f25 7 1 2023-12-05T09:57:26.555 INFO:tasks.workunit.client.1.smithi150.stdout:9/251: rename d3/d9/dc to d3/d9/dc/d1f/d24/d4c 22 2023-12-05T09:57:26.556 INFO:tasks.workunit.client.1.smithi150.stdout:6/234: sync 2023-12-05T09:57:26.559 INFO:tasks.workunit.client.1.smithi150.stdout:6/235: symlink d2/d23/d3b/l51 0 2023-12-05T09:57:26.560 INFO:tasks.workunit.client.0.smithi100.stdout:6/670: dread d7/f17 [0,4194304] 0 2023-12-05T09:57:26.563 INFO:tasks.workunit.client.0.smithi100.stdout:6/671: link d7/f17 d7/d2d/d6a/fde 0 2023-12-05T09:57:26.563 INFO:tasks.workunit.client.0.smithi100.stdout:6/672: write d7/d11/d1a/db1/fd6 [29056,50535] 0 2023-12-05T09:57:26.567 INFO:tasks.workunit.client.0.smithi100.stdout:6/673: creat d7/d11/d1a/fdf x:0 0 0 2023-12-05T09:57:26.568 INFO:tasks.workunit.client.0.smithi100.stdout:9/356: sync 2023-12-05T09:57:26.568 INFO:tasks.workunit.client.0.smithi100.stdout:0/318: sync 2023-12-05T09:57:26.570 INFO:tasks.workunit.client.0.smithi100.stdout:6/674: rename d7/d76/f90 to d7/d11/d1a/d78/fe0 0 2023-12-05T09:57:26.570 INFO:tasks.workunit.client.1.smithi150.stdout:7/271: write d2/db/d30/d18/d1a/f1f [1865226,65931] 0 2023-12-05T09:57:26.570 INFO:tasks.workunit.client.1.smithi150.stdout:7/272: write d2/d4/fc [729535,36078] 0 2023-12-05T09:57:26.573 INFO:tasks.workunit.client.0.smithi100.stdout:0/319: mknod da/c63 0 2023-12-05T09:57:26.573 INFO:tasks.workunit.client.0.smithi100.stdout:5/364: rmdir d0/d1f/d53 39 2023-12-05T09:57:26.573 INFO:tasks.workunit.client.0.smithi100.stdout:5/365: truncate d0/d4/fd 8597366 0 2023-12-05T09:57:26.575 INFO:tasks.workunit.client.1.smithi150.stdout:7/273: symlink d2/db/d30/d13/d3d/l4d 0 2023-12-05T09:57:26.575 INFO:tasks.workunit.client.1.smithi150.stdout:7/274: stat d2/d1b/d31 0 2023-12-05T09:57:26.579 INFO:tasks.workunit.client.0.smithi100.stdout:6/675: unlink d7/d76/f8c 0 2023-12-05T09:57:26.580 INFO:tasks.workunit.client.1.smithi150.stdout:6/236: write d2/d23/f45 [3218082,30353] 0 2023-12-05T09:57:26.580 INFO:tasks.workunit.client.1.smithi150.stdout:9/252: dread d3/d9/f17 [0,4194304] 0 2023-12-05T09:57:26.580 INFO:tasks.workunit.client.1.smithi150.stdout:9/253: dread - d3/d9/f2f zero size 2023-12-05T09:57:26.581 INFO:tasks.workunit.client.1.smithi150.stdout:9/254: read d3/d1b/f36 [950956,36871] 0 2023-12-05T09:57:26.582 INFO:tasks.workunit.client.1.smithi150.stdout:3/278: dwrite d6/d38/f4d [0,4194304] 0 2023-12-05T09:57:26.582 INFO:tasks.workunit.client.1.smithi150.stdout:3/279: fsync d6/d9/d3d/d56/f3f 0 2023-12-05T09:57:26.582 INFO:tasks.workunit.client.1.smithi150.stdout:3/280: write d6/d9/d3d/d56/f3b [351752,125048] 0 2023-12-05T09:57:26.583 INFO:tasks.workunit.client.0.smithi100.stdout:7/260: dwrite d3/f1f [0,4194304] 0 2023-12-05T09:57:26.588 INFO:tasks.workunit.client.1.smithi150.stdout:9/255: link l1 d3/d9/d26/d34/d3a/l4d 0 2023-12-05T09:57:26.589 INFO:tasks.workunit.client.1.smithi150.stdout:9/256: write d3/d9/f49 [79638,52255] 0 2023-12-05T09:57:26.589 INFO:tasks.workunit.client.0.smithi100.stdout:5/366: rename d0/d1f/f4c to d0/d16/d2b/f7f 0 2023-12-05T09:57:26.600 INFO:tasks.workunit.client.1.smithi150.stdout:1/316: getdents d6/d38/d4a 0 2023-12-05T09:57:26.603 INFO:tasks.workunit.client.1.smithi150.stdout:1/317: fsync d6/d8/db/f73 0 2023-12-05T09:57:26.603 INFO:tasks.workunit.client.1.smithi150.stdout:6/237: write d2/d23/f45 [8029656,22590] 0 2023-12-05T09:57:26.610 INFO:tasks.workunit.client.1.smithi150.stdout:1/318: symlink d6/d8/d54/l74 0 2023-12-05T09:57:26.613 INFO:tasks.workunit.client.0.smithi100.stdout:5/367: rename d0/d4/d14/d35/f42 to d0/d16/d2b/d48/f80 0 2023-12-05T09:57:26.613 INFO:tasks.workunit.client.0.smithi100.stdout:5/368: rename d0 to d0/d16/d37/d81 22 2023-12-05T09:57:26.613 INFO:tasks.workunit.client.1.smithi150.stdout:6/238: chown d2/da/cc 3982 1 2023-12-05T09:57:26.615 INFO:tasks.workunit.client.1.smithi150.stdout:4/245: sync 2023-12-05T09:57:26.615 INFO:tasks.workunit.client.1.smithi150.stdout:5/276: sync 2023-12-05T09:57:26.616 INFO:tasks.workunit.client.1.smithi150.stdout:4/246: fsync d0/f41 0 2023-12-05T09:57:26.618 INFO:tasks.workunit.client.1.smithi150.stdout:1/319: unlink d6/d38/f3d 0 2023-12-05T09:57:26.621 INFO:tasks.workunit.client.1.smithi150.stdout:6/239: unlink d2/d23/d2e/d39/l41 0 2023-12-05T09:57:26.625 INFO:tasks.workunit.client.1.smithi150.stdout:5/277: link d1/d3/d1e/d21/f57 d1/d3/d1e/d21/d3b/f62 0 2023-12-05T09:57:26.628 INFO:tasks.workunit.client.1.smithi150.stdout:9/257: dread d3/d9/f1c [0,4194304] 0 2023-12-05T09:57:26.629 INFO:tasks.workunit.client.1.smithi150.stdout:4/247: creat d0/d42/d44/f46 x:0 0 0 2023-12-05T09:57:26.631 INFO:tasks.workunit.client.1.smithi150.stdout:1/320: mkdir d6/d8/db/de/d75 0 2023-12-05T09:57:26.633 INFO:tasks.workunit.client.1.smithi150.stdout:5/278: rename d1/d3/d6/f8 to d1/d3/d1e/d21/f63 0 2023-12-05T09:57:26.634 INFO:tasks.workunit.client.1.smithi150.stdout:3/281: dread d6/d22/d37/f3c [0,4194304] 0 2023-12-05T09:57:26.635 INFO:tasks.workunit.client.0.smithi100.stdout:9/357: dwrite d7/f9 [0,4194304] 0 2023-12-05T09:57:26.636 INFO:tasks.workunit.client.0.smithi100.stdout:9/358: creat d7/d1b/d22/f77 x:0 0 0 2023-12-05T09:57:26.637 INFO:tasks.workunit.client.1.smithi150.stdout:9/258: creat d3/d42/f4e x:0 0 0 2023-12-05T09:57:26.637 INFO:tasks.workunit.client.1.smithi150.stdout:9/259: chown d3/d9/dc/c11 1 1 2023-12-05T09:57:26.638 INFO:tasks.workunit.client.1.smithi150.stdout:4/248: mkdir d0/d47 0 2023-12-05T09:57:26.654 INFO:tasks.workunit.client.1.smithi150.stdout:9/260: symlink d3/d9/dc/d1f/d24/l4f 0 2023-12-05T09:57:26.654 INFO:tasks.workunit.client.1.smithi150.stdout:4/249: mkdir d0/d3e/d48 0 2023-12-05T09:57:26.654 INFO:tasks.workunit.client.1.smithi150.stdout:9/261: chown d3/d1b/l2d 15750 1 2023-12-05T09:57:26.655 INFO:tasks.workunit.client.1.smithi150.stdout:9/262: truncate d3/d9/dc/f4b 1007893 0 2023-12-05T09:57:26.655 INFO:tasks.workunit.client.1.smithi150.stdout:6/240: dread d2/f26 [0,4194304] 0 2023-12-05T09:57:26.656 INFO:tasks.workunit.client.0.smithi100.stdout:9/359: rename d7/d35/f62 to d7/d35/d71/f78 0 2023-12-05T09:57:26.656 INFO:tasks.workunit.client.0.smithi100.stdout:9/360: write d7/d1b/d22/d2a/d56/d2e/d50/f61 [484913,97321] 0 2023-12-05T09:57:26.658 INFO:tasks.workunit.client.0.smithi100.stdout:9/361: creat d7/d1b/d22/d2a/f79 x:0 0 0 2023-12-05T09:57:26.662 INFO:tasks.workunit.client.0.smithi100.stdout:9/362: creat d7/d35/d71/f7a x:0 0 0 2023-12-05T09:57:26.662 INFO:tasks.workunit.client.0.smithi100.stdout:9/363: dread - d7/d35/f65 zero size 2023-12-05T09:57:26.662 INFO:tasks.workunit.client.1.smithi150.stdout:4/250: mknod d0/d3e/d48/c49 0 2023-12-05T09:57:26.664 INFO:tasks.workunit.client.1.smithi150.stdout:6/241: creat d2/f52 x:0 0 0 2023-12-05T09:57:26.665 INFO:tasks.workunit.client.0.smithi100.stdout:9/364: rmdir d7/d1b/d22/d2a/d56 39 2023-12-05T09:57:26.666 INFO:tasks.workunit.client.0.smithi100.stdout:0/320: dwrite da/d1b/d36/f48 [4194304,4194304] 0 2023-12-05T09:57:26.666 INFO:tasks.workunit.client.0.smithi100.stdout:0/321: truncate da/f2d 6011072 0 2023-12-05T09:57:26.666 INFO:tasks.workunit.client.0.smithi100.stdout:0/322: chown da/d2a/f56 6 1 2023-12-05T09:57:26.666 INFO:tasks.workunit.client.1.smithi150.stdout:4/251: rmdir d0/d47 0 2023-12-05T09:57:26.667 INFO:tasks.workunit.client.1.smithi150.stdout:7/275: dwrite d2/db/d30/d13/f44 [0,4194304] 0 2023-12-05T09:57:26.668 INFO:tasks.workunit.client.0.smithi100.stdout:7/261: dwrite d3/dc/f4a [0,4194304] 0 2023-12-05T09:57:26.669 INFO:tasks.workunit.client.1.smithi150.stdout:6/242: creat d2/da/f53 x:0 0 0 2023-12-05T09:57:26.669 INFO:tasks.workunit.client.1.smithi150.stdout:0/322: dwrite d5/d11/d32/d37/f30 [0,4194304] 0 2023-12-05T09:57:26.670 INFO:tasks.workunit.client.1.smithi150.stdout:4/252: unlink d0/d11/f32 0 2023-12-05T09:57:26.670 INFO:tasks.workunit.client.1.smithi150.stdout:9/263: dread d3/d9/dc/d1f/f2b [0,4194304] 0 2023-12-05T09:57:26.673 INFO:tasks.workunit.client.1.smithi150.stdout:7/276: rmdir d2/db/d30/d18/d40 0 2023-12-05T09:57:26.673 INFO:tasks.workunit.client.0.smithi100.stdout:6/676: dwrite d7/faa [0,4194304] 0 2023-12-05T09:57:26.682 INFO:tasks.workunit.client.1.smithi150.stdout:5/279: rename d1/d3/d1e to d1/d64 0 2023-12-05T09:57:26.686 INFO:tasks.workunit.client.0.smithi100.stdout:5/369: dwrite d0/d16/d2b/f64 [0,4194304] 0 2023-12-05T09:57:26.686 INFO:tasks.workunit.client.0.smithi100.stdout:5/370: creat d0/d16/d2b/f82 x:0 0 0 2023-12-05T09:57:26.686 INFO:tasks.workunit.client.0.smithi100.stdout:5/371: truncate d0/d1b/d4d/d60/f6d 499898 0 2023-12-05T09:57:26.687 INFO:tasks.workunit.client.1.smithi150.stdout:6/243: write d2/da/f10 [717179,73677] 0 2023-12-05T09:57:26.687 INFO:tasks.workunit.client.0.smithi100.stdout:6/677: mknod d7/d11/d7e/ce1 0 2023-12-05T09:57:26.688 INFO:tasks.workunit.client.1.smithi150.stdout:3/282: dwrite d6/d25/d28/f2e [0,4194304] 0 2023-12-05T09:57:26.690 INFO:tasks.workunit.client.1.smithi150.stdout:0/323: unlink d5/fd 0 2023-12-05T09:57:26.690 INFO:tasks.workunit.client.0.smithi100.stdout:9/365: dread d7/d1b/f33 [0,4194304] 0 2023-12-05T09:57:26.690 INFO:tasks.workunit.client.0.smithi100.stdout:9/366: readlink d7/d1b/d22/d51/l12 0 2023-12-05T09:57:26.691 INFO:tasks.workunit.client.0.smithi100.stdout:9/367: chown d7/d60 23555649 1 2023-12-05T09:57:26.699 INFO:tasks.workunit.client.1.smithi150.stdout:7/277: mknod d2/db/d17/d3a/c4e 0 2023-12-05T09:57:26.699 INFO:tasks.workunit.client.1.smithi150.stdout:7/278: fdatasync d2/db/d30/d18/d1a/d1e/d2b/d49/f43 0 2023-12-05T09:57:26.699 INFO:tasks.workunit.client.1.smithi150.stdout:6/244: dread d2/da/f31 [0,4194304] 0 2023-12-05T09:57:26.699 INFO:tasks.workunit.client.1.smithi150.stdout:6/245: chown d2/d23/d2e/f43 3 1 2023-12-05T09:57:26.699 INFO:tasks.workunit.client.1.smithi150.stdout:6/246: truncate d2/d23/d2e/d44/f50 40023 0 2023-12-05T09:57:26.699 INFO:tasks.workunit.client.1.smithi150.stdout:6/247: creat d2/d23/d2e/d44/f54 x:0 0 0 2023-12-05T09:57:26.700 INFO:tasks.workunit.client.1.smithi150.stdout:4/253: rename d0/c36 to d0/d11/c4a 0 2023-12-05T09:57:26.702 INFO:tasks.workunit.client.0.smithi100.stdout:5/372: rmdir d0/d1f/d25/d31 39 2023-12-05T09:57:26.703 INFO:tasks.workunit.client.0.smithi100.stdout:5/373: chown d0/d1f/d25 13215289 1 2023-12-05T09:57:26.703 INFO:tasks.workunit.client.0.smithi100.stdout:5/374: write d0/d1b/d4d/d60/f6d [1378834,4755] 0 2023-12-05T09:57:26.704 INFO:tasks.workunit.client.1.smithi150.stdout:0/324: symlink d5/d11/l6e 0 2023-12-05T09:57:26.708 INFO:tasks.workunit.client.0.smithi100.stdout:6/678: mkdir d7/d2d/d6a/de2 0 2023-12-05T09:57:26.708 INFO:tasks.workunit.client.0.smithi100.stdout:6/679: fdatasync d7/f17 0 2023-12-05T09:57:26.708 INFO:tasks.workunit.client.0.smithi100.stdout:6/680: fdatasync d7/d11/d1a/f54 0 2023-12-05T09:57:26.708 INFO:tasks.workunit.client.0.smithi100.stdout:6/681: write d7/d11/f99 [193192,118456] 0 2023-12-05T09:57:26.709 INFO:tasks.workunit.client.1.smithi150.stdout:9/264: rmdir d3/d9/dc 39 2023-12-05T09:57:26.712 INFO:tasks.workunit.client.0.smithi100.stdout:9/368: rename d7/d20/c4c to d7/d1b/d22/d2a/d56/d2e/d50/d5b/c7b 0 2023-12-05T09:57:26.714 INFO:tasks.workunit.client.1.smithi150.stdout:7/279: getdents d2/db/d30/d18/d1a/d1e/d2b/d49 0 2023-12-05T09:57:26.714 INFO:tasks.workunit.client.1.smithi150.stdout:7/280: readlink d2/le 0 2023-12-05T09:57:26.718 INFO:tasks.workunit.client.0.smithi100.stdout:5/375: write d0/f2 [469946,127301] 0 2023-12-05T09:57:26.718 INFO:tasks.workunit.client.0.smithi100.stdout:5/376: write d0/d1f/f6a [4283210,35615] 0 2023-12-05T09:57:26.720 INFO:tasks.workunit.client.0.smithi100.stdout:6/682: link d7/d11/d1a/f6b d7/d2d/fe3 0 2023-12-05T09:57:26.722 INFO:tasks.workunit.client.1.smithi150.stdout:5/280: dwrite d1/f51 [0,4194304] 0 2023-12-05T09:57:26.722 INFO:tasks.workunit.client.1.smithi150.stdout:5/281: chown d1/d3/d6/d26/c2d 10639 1 2023-12-05T09:57:26.722 INFO:tasks.workunit.client.1.smithi150.stdout:5/282: chown d1/d3/d6/d1b/d22/d24/f41 155 1 2023-12-05T09:57:26.728 INFO:tasks.workunit.client.0.smithi100.stdout:7/262: truncate d3/dc/f4a 3079133 0 2023-12-05T09:57:26.728 INFO:tasks.workunit.client.0.smithi100.stdout:7/263: write d3/dc/d11/d13/de/f5a [1002421,6091] 0 2023-12-05T09:57:26.730 INFO:tasks.workunit.client.1.smithi150.stdout:3/283: rename d6/d42 to d6/d9/d3d/d52/d5b 0 2023-12-05T09:57:26.730 INFO:tasks.workunit.client.0.smithi100.stdout:9/369: dread d7/d1b/d22/d2a/d56/d2e/f53 [0,4194304] 0 2023-12-05T09:57:26.731 INFO:tasks.workunit.client.0.smithi100.stdout:5/377: symlink d0/d4/d14/l83 0 2023-12-05T09:57:26.738 INFO:tasks.workunit.client.0.smithi100.stdout:7/264: dread d3/dc/f3a [0,4194304] 0 2023-12-05T09:57:26.738 INFO:tasks.workunit.client.1.smithi150.stdout:0/325: link d5/d11/f26 d5/d11/d32/d37/d5f/f6f 0 2023-12-05T09:57:26.739 INFO:tasks.workunit.client.1.smithi150.stdout:0/326: read - d5/d11/d32/f50 zero size 2023-12-05T09:57:26.739 INFO:tasks.workunit.client.0.smithi100.stdout:6/683: getdents d7/dcc 0 2023-12-05T09:57:26.741 INFO:tasks.workunit.client.1.smithi150.stdout:7/281: mkdir d2/db/d30/d13/d4f 0 2023-12-05T09:57:26.743 INFO:tasks.workunit.client.1.smithi150.stdout:2/282: sync 2023-12-05T09:57:26.743 INFO:tasks.workunit.client.1.smithi150.stdout:8/282: sync 2023-12-05T09:57:26.745 INFO:tasks.workunit.client.1.smithi150.stdout:6/248: rename d2/da/c2f to d2/da/c55 0 2023-12-05T09:57:26.746 INFO:tasks.workunit.client.1.smithi150.stdout:9/265: dwrite d3/f2e [0,4194304] 0 2023-12-05T09:57:26.746 INFO:tasks.workunit.client.0.smithi100.stdout:5/378: mknod d0/d4/c84 0 2023-12-05T09:57:26.746 INFO:tasks.workunit.client.0.smithi100.stdout:5/379: stat d0/d16/d37/l73 0 2023-12-05T09:57:26.746 INFO:tasks.workunit.client.0.smithi100.stdout:5/380: write d0/d16/f68 [2638615,61899] 0 2023-12-05T09:57:26.750 INFO:tasks.workunit.client.0.smithi100.stdout:7/265: link d3/dc/d11/d13/f30 d3/dc/d11/d13/de/d18/d3b/d40/d46/f5c 0 2023-12-05T09:57:26.759 INFO:tasks.workunit.client.1.smithi150.stdout:4/254: rmdir d0/d3e 39 2023-12-05T09:57:26.764 INFO:tasks.workunit.client.1.smithi150.stdout:5/283: rename d1/d64/d21 to d1/d3/d38/d65 0 2023-12-05T09:57:26.772 INFO:tasks.workunit.client.0.smithi100.stdout:4/270: sync 2023-12-05T09:57:26.778 INFO:tasks.workunit.client.0.smithi100.stdout:4/271: creat de/d16/d23/d36/f56 x:0 0 0 2023-12-05T09:57:26.779 INFO:tasks.workunit.client.1.smithi150.stdout:3/284: getdents d6/d9/d3d 0 2023-12-05T09:57:26.779 INFO:tasks.workunit.client.1.smithi150.stdout:2/283: symlink d0/d3/d11/d1d/l60 0 2023-12-05T09:57:26.779 INFO:tasks.workunit.client.1.smithi150.stdout:0/327: creat d5/d11/d32/d37/d5f/f70 x:0 0 0 2023-12-05T09:57:26.779 INFO:tasks.workunit.client.1.smithi150.stdout:3/285: read d6/d25/d28/f2d [536165,108238] 0 2023-12-05T09:57:26.779 INFO:tasks.workunit.client.1.smithi150.stdout:6/249: rmdir d2/d23/d3b 39 2023-12-05T09:57:26.780 INFO:tasks.workunit.client.1.smithi150.stdout:8/283: truncate d0/d41/d49/d1b/d24/d38/f3d 2422114 0 2023-12-05T09:57:26.780 INFO:tasks.workunit.client.1.smithi150.stdout:9/266: creat d3/d1b/d46/f50 x:0 0 0 2023-12-05T09:57:26.780 INFO:tasks.workunit.client.1.smithi150.stdout:8/284: creat d0/d41/d49/f59 x:0 0 0 2023-12-05T09:57:26.780 INFO:tasks.workunit.client.1.smithi150.stdout:8/285: readlink d0/d41/d49/d1b/d24/d2e/l3f 0 2023-12-05T09:57:26.782 INFO:tasks.workunit.client.1.smithi150.stdout:7/282: dwrite d2/db/d30/d13/f44 [0,4194304] 0 2023-12-05T09:57:26.782 INFO:tasks.workunit.client.1.smithi150.stdout:7/283: readlink d2/db/d30/d13/d3d/l4d 0 2023-12-05T09:57:26.782 INFO:tasks.workunit.client.1.smithi150.stdout:7/284: getdents d2/db/d30/d47 0 2023-12-05T09:57:26.785 INFO:tasks.workunit.client.1.smithi150.stdout:3/286: link d6/d22/d37/c4f d6/d9/c5c 0 2023-12-05T09:57:26.786 INFO:tasks.workunit.client.0.smithi100.stdout:9/370: write d7/d20/f3a [303934,93425] 0 2023-12-05T09:57:26.787 INFO:tasks.workunit.client.1.smithi150.stdout:2/284: mknod d0/d3/d5/d36/c61 0 2023-12-05T09:57:26.787 INFO:tasks.workunit.client.1.smithi150.stdout:2/285: write d0/d3/d5/d10/f1b [1081691,42032] 0 2023-12-05T09:57:26.787 INFO:tasks.workunit.client.1.smithi150.stdout:2/286: chown d0/d3/d21/c24 574 1 2023-12-05T09:57:26.788 INFO:tasks.workunit.client.1.smithi150.stdout:3/287: read d6/d9/f57 [284661,52160] 0 2023-12-05T09:57:26.790 INFO:tasks.workunit.client.1.smithi150.stdout:6/250: rmdir d2/d23/d2e/d44/d48 0 2023-12-05T09:57:26.790 INFO:tasks.workunit.client.1.smithi150.stdout:6/251: chown d2/da/f22 3695 1 2023-12-05T09:57:26.790 INFO:tasks.workunit.client.1.smithi150.stdout:6/252: dread - d2/f52 zero size 2023-12-05T09:57:26.791 INFO:tasks.workunit.client.0.smithi100.stdout:9/371: creat d7/d1b/d22/d2a/d56/d2e/d50/f7c x:0 0 0 2023-12-05T09:57:26.793 INFO:tasks.workunit.client.0.smithi100.stdout:6/684: dwrite d7/d11/f20 [4194304,4194304] 0 2023-12-05T09:57:26.793 INFO:tasks.workunit.client.0.smithi100.stdout:6/685: readlink d7/d76/ld3 0 2023-12-05T09:57:26.795 INFO:tasks.workunit.client.1.smithi150.stdout:6/253: read d2/d23/d2e/f3e [640763,90082] 0 2023-12-05T09:57:26.795 INFO:tasks.workunit.client.1.smithi150.stdout:6/254: fdatasync d2/d23/f3f 0 2023-12-05T09:57:26.795 INFO:tasks.workunit.client.1.smithi150.stdout:6/255: write d2/da/f1a [4995878,29385] 0 2023-12-05T09:57:26.795 INFO:tasks.workunit.client.0.smithi100.stdout:9/372: symlink d7/d1b/d22/d2a/d56/d2e/l7d 0 2023-12-05T09:57:26.796 INFO:tasks.workunit.client.1.smithi150.stdout:9/267: mknod d3/d9/dc/d1f/d24/c51 0 2023-12-05T09:57:26.796 INFO:tasks.workunit.client.1.smithi150.stdout:9/268: creat d3/d9/f52 x:0 0 0 2023-12-05T09:57:26.797 INFO:tasks.workunit.client.1.smithi150.stdout:9/269: truncate d3/d9/f52 128187 0 2023-12-05T09:57:26.803 INFO:tasks.workunit.client.0.smithi100.stdout:6/686: unlink d7/d11/d1a/db1/fc4 0 2023-12-05T09:57:26.803 INFO:tasks.workunit.client.1.smithi150.stdout:1/321: sync 2023-12-05T09:57:26.804 INFO:tasks.workunit.client.1.smithi150.stdout:8/286: getdents d0/d41/d49/d1b/d24/d34 0 2023-12-05T09:57:26.804 INFO:tasks.workunit.client.1.smithi150.stdout:2/287: dread d0/d3/d21/f2c [0,4194304] 0 2023-12-05T09:57:26.804 INFO:tasks.workunit.client.1.smithi150.stdout:2/288: fsync d0/d3/d11/f18 0 2023-12-05T09:57:26.806 INFO:tasks.workunit.client.0.smithi100.stdout:4/272: dread de/d16/d23/f24 [0,4194304] 0 2023-12-05T09:57:26.807 INFO:tasks.workunit.client.1.smithi150.stdout:7/285: dread d2/d4/ff [0,4194304] 0 2023-12-05T09:57:26.808 INFO:tasks.workunit.client.0.smithi100.stdout:6/687: mkdir d7/d11/d1a/d78/de4 0 2023-12-05T09:57:26.808 INFO:tasks.workunit.client.0.smithi100.stdout:6/688: chown d7/la8 495 1 2023-12-05T09:57:26.808 INFO:tasks.workunit.client.0.smithi100.stdout:6/689: truncate d7/d11/d82/f9f 749559 0 2023-12-05T09:57:26.808 INFO:tasks.workunit.client.0.smithi100.stdout:7/266: write d3/f1f [3003464,127647] 0 2023-12-05T09:57:26.808 INFO:tasks.workunit.client.0.smithi100.stdout:5/381: dwrite d0/d1b/f66 [0,4194304] 0 2023-12-05T09:57:26.811 INFO:tasks.workunit.client.0.smithi100.stdout:4/273: rmdir de/d16/d23/d33/d51 39 2023-12-05T09:57:26.811 INFO:tasks.workunit.client.0.smithi100.stdout:4/274: readlink l4 0 2023-12-05T09:57:26.811 INFO:tasks.workunit.client.1.smithi150.stdout:1/322: dread d6/d38/f43 [0,4194304] 0 2023-12-05T09:57:26.811 INFO:tasks.workunit.client.1.smithi150.stdout:1/323: stat d6/d3c/l58 0 2023-12-05T09:57:26.814 INFO:tasks.workunit.client.1.smithi150.stdout:3/288: unlink d6/f1f 0 2023-12-05T09:57:26.816 INFO:tasks.workunit.client.1.smithi150.stdout:6/256: mknod d2/d23/d2e/c56 0 2023-12-05T09:57:26.817 INFO:tasks.workunit.client.0.smithi100.stdout:7/267: creat d3/dc/d11/d13/de/d18/d3b/f5d x:0 0 0 2023-12-05T09:57:26.818 INFO:tasks.workunit.client.0.smithi100.stdout:7/268: readlink d3/l2c 0 2023-12-05T09:57:26.820 INFO:tasks.workunit.client.0.smithi100.stdout:9/373: dread d7/d1b/d22/d51/f23 [0,4194304] 0 2023-12-05T09:57:26.820 INFO:tasks.workunit.client.0.smithi100.stdout:9/374: stat d7/ff 0 2023-12-05T09:57:26.821 INFO:tasks.workunit.client.0.smithi100.stdout:6/690: rename d7/d11/d82/fc6 to d7/d11/d1a/d78/d80/fe5 0 2023-12-05T09:57:26.824 INFO:tasks.workunit.client.1.smithi150.stdout:9/270: link d3/d9/l3c d3/d9/d26/d34/d3a/l53 0 2023-12-05T09:57:26.824 INFO:tasks.workunit.client.1.smithi150.stdout:9/271: creat d3/d9/f54 x:0 0 0 2023-12-05T09:57:26.824 INFO:tasks.workunit.client.1.smithi150.stdout:8/287: dread d0/d41/d49/d1b/f2f [4194304,4194304] 0 2023-12-05T09:57:26.824 INFO:tasks.workunit.client.1.smithi150.stdout:8/288: fsync d0/d41/f55 0 2023-12-05T09:57:26.824 INFO:tasks.workunit.client.1.smithi150.stdout:8/289: write d0/d41/d49/f59 [839432,48054] 0 2023-12-05T09:57:26.825 INFO:tasks.workunit.client.1.smithi150.stdout:0/328: rename d5/d11/d32/d37 to d5/d11/d71 0 2023-12-05T09:57:26.826 INFO:tasks.workunit.client.1.smithi150.stdout:0/329: dread - d5/f5b zero size 2023-12-05T09:57:26.827 INFO:tasks.workunit.client.0.smithi100.stdout:4/275: dread de/d16/d23/f24 [0,4194304] 0 2023-12-05T09:57:26.828 INFO:tasks.workunit.client.0.smithi100.stdout:4/276: truncate de/d16/f52 705258 0 2023-12-05T09:57:26.829 INFO:tasks.workunit.client.1.smithi150.stdout:7/286: mknod d2/db/d30/d13/d3d/c50 0 2023-12-05T09:57:26.830 INFO:tasks.workunit.client.1.smithi150.stdout:7/287: fsync d2/d1b/d31/f36 0 2023-12-05T09:57:26.830 INFO:tasks.workunit.client.1.smithi150.stdout:4/255: dwrite d0/f24 [0,4194304] 0 2023-12-05T09:57:26.832 INFO:tasks.workunit.client.0.smithi100.stdout:5/382: link d0/d1f/f6a d0/d16/d2b/d75/f85 0 2023-12-05T09:57:26.832 INFO:tasks.workunit.client.0.smithi100.stdout:4/277: write de/d16/d23/f47 [974066,52538] 0 2023-12-05T09:57:26.832 INFO:tasks.workunit.client.0.smithi100.stdout:5/383: write d0/f59 [773915,15737] 0 2023-12-05T09:57:26.832 INFO:tasks.workunit.client.0.smithi100.stdout:5/384: fsync d0/d1b/f33 0 2023-12-05T09:57:26.832 INFO:tasks.workunit.client.0.smithi100.stdout:5/385: creat d0/d1f/f86 x:0 0 0 2023-12-05T09:57:26.832 INFO:tasks.workunit.client.0.smithi100.stdout:5/386: chown d0/d1b/f33 6376 1 2023-12-05T09:57:26.834 INFO:tasks.workunit.client.1.smithi150.stdout:3/289: unlink d6/d9/d43/c49 0 2023-12-05T09:57:26.834 INFO:tasks.workunit.client.1.smithi150.stdout:3/290: chown d6/d22/d37/f3c 132 1 2023-12-05T09:57:26.834 INFO:tasks.workunit.client.1.smithi150.stdout:3/291: readlink d6/d9/d43/d47/l45 0 2023-12-05T09:57:26.836 INFO:tasks.workunit.client.0.smithi100.stdout:9/375: rename d7/d35/f75 to d7/d20/d68/f7e 0 2023-12-05T09:57:26.836 INFO:tasks.workunit.client.0.smithi100.stdout:9/376: chown l5 21227 1 2023-12-05T09:57:26.836 INFO:tasks.workunit.client.0.smithi100.stdout:9/377: stat d7/fd 0 2023-12-05T09:57:26.836 INFO:tasks.workunit.client.0.smithi100.stdout:9/378: readlink d7/d35/l3b 0 2023-12-05T09:57:26.838 INFO:tasks.workunit.client.1.smithi150.stdout:6/257: mknod d2/d23/c57 0 2023-12-05T09:57:26.838 INFO:tasks.workunit.client.1.smithi150.stdout:6/258: fsync d2/da/f22 0 2023-12-05T09:57:26.840 INFO:tasks.workunit.client.0.smithi100.stdout:6/691: creat d7/d27/d35/d5a/fe6 x:0 0 0 2023-12-05T09:57:26.840 INFO:tasks.workunit.client.0.smithi100.stdout:6/692: read - d7/d27/d97/fc5 zero size 2023-12-05T09:57:26.848 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:26 smithi150 ceph-mon[116142]: pgmap v29: 65 pgs: 65 active+clean; 1.2 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 115 MiB/s rd, 145 MiB/s wr, 738 op/s 2023-12-05T09:57:26.848 INFO:tasks.workunit.client.1.smithi150.stdout:9/272: mkdir d3/d1b/d46/d55 0 2023-12-05T09:57:26.850 INFO:tasks.workunit.client.1.smithi150.stdout:5/284: dwrite d1/d3/d38/f5c [0,4194304] 0 2023-12-05T09:57:26.852 INFO:tasks.workunit.client.0.smithi100.stdout:5/387: getdents d0/d4 0 2023-12-05T09:57:26.853 INFO:tasks.workunit.client.0.smithi100.stdout:5/388: creat d0/d1b/d4d/f87 x:0 0 0 2023-12-05T09:57:26.853 INFO:tasks.workunit.client.1.smithi150.stdout:8/290: symlink d0/d41/d49/d1b/d24/d2e/l5a 0 2023-12-05T09:57:26.859 INFO:tasks.workunit.client.1.smithi150.stdout:2/289: rename d0/d3/d5/d22/d52/d56/c5e to d0/d3/d11/d1d/c62 0 2023-12-05T09:57:26.860 INFO:tasks.workunit.client.0.smithi100.stdout:9/379: unlink l4 0 2023-12-05T09:57:26.861 INFO:tasks.workunit.client.0.smithi100.stdout:6/693: mkdir d7/d27/d97/de7 0 2023-12-05T09:57:26.861 INFO:tasks.workunit.client.0.smithi100.stdout:6/694: chown d7/d27/d97/fbb 819833 1 2023-12-05T09:57:26.861 INFO:tasks.workunit.client.0.smithi100.stdout:6/695: read d7/d11/d1a/db1/fd6 [69601,22299] 0 2023-12-05T09:57:26.861 INFO:tasks.workunit.client.0.smithi100.stdout:6/696: fsync d7/d27/d97/fc2 0 2023-12-05T09:57:26.870 INFO:tasks.workunit.client.1.smithi150.stdout:7/288: truncate d2/d4/f27 4151821 0 2023-12-05T09:57:26.871 INFO:tasks.workunit.client.1.smithi150.stdout:3/292: unlink d6/d9/d43/d47/c55 0 2023-12-05T09:57:26.877 INFO:tasks.workunit.client.1.smithi150.stdout:8/291: mkdir d0/d41/d49/d1b/d24/d5b 0 2023-12-05T09:57:26.879 INFO:tasks.workunit.client.1.smithi150.stdout:0/330: dwrite d5/d11/f24 [0,4194304] 0 2023-12-05T09:57:26.879 INFO:tasks.workunit.client.1.smithi150.stdout:9/273: rename d3/f15 to d3/d42/f56 0 2023-12-05T09:57:26.880 INFO:tasks.workunit.client.1.smithi150.stdout:2/290: symlink d0/d3/d27/l63 0 2023-12-05T09:57:26.882 INFO:tasks.workunit.client.1.smithi150.stdout:7/289: mknod d2/db/d30/d18/d1a/d1e/c51 0 2023-12-05T09:57:26.883 INFO:tasks.workunit.client.1.smithi150.stdout:4/256: mkdir d0/d11/d4b 0 2023-12-05T09:57:26.886 INFO:tasks.workunit.client.1.smithi150.stdout:8/292: symlink d0/d41/d49/d1b/d24/d2e/d4d/l5c 0 2023-12-05T09:57:26.886 INFO:tasks.workunit.client.1.smithi150.stdout:3/293: creat d6/f5d x:0 0 0 2023-12-05T09:57:26.886 INFO:tasks.workunit.client.1.smithi150.stdout:8/293: truncate d0/d41/d49/f52 453270 0 2023-12-05T09:57:26.887 INFO:tasks.workunit.client.0.smithi100.stdout:7/269: dwrite d3/dc/f4a [0,4194304] 0 2023-12-05T09:57:26.887 INFO:tasks.workunit.client.0.smithi100.stdout:7/270: chown d3/dc/d11/f31 1 1 2023-12-05T09:57:26.888 INFO:tasks.workunit.client.1.smithi150.stdout:0/331: unlink d5/d11/d16/d3f/d46/l69 0 2023-12-05T09:57:26.890 INFO:tasks.workunit.client.1.smithi150.stdout:9/274: rmdir d3/d9/dc/d1f 39 2023-12-05T09:57:26.890 INFO:tasks.workunit.client.0.smithi100.stdout:9/380: dread d7/ff [0,4194304] 0 2023-12-05T09:57:26.890 INFO:tasks.workunit.client.0.smithi100.stdout:9/381: chown d7/d1b/d22/d2a/d56 189730510 1 2023-12-05T09:57:26.892 INFO:tasks.workunit.client.0.smithi100.stdout:4/278: dwrite de/f1b [0,4194304] 0 2023-12-05T09:57:26.894 INFO:tasks.workunit.client.1.smithi150.stdout:2/291: truncate d0/d3/d11/d1d/f29 2206314 0 2023-12-05T09:57:26.894 INFO:tasks.workunit.client.1.smithi150.stdout:2/292: chown d0/d3/d5 178 1 2023-12-05T09:57:26.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:26 smithi100 ceph-mon[107145]: pgmap v29: 65 pgs: 65 active+clean; 1.2 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 115 MiB/s rd, 145 MiB/s wr, 738 op/s 2023-12-05T09:57:26.896 INFO:tasks.workunit.client.1.smithi150.stdout:7/290: truncate d2/db/d30/f9 414580 0 2023-12-05T09:57:26.896 INFO:tasks.workunit.client.1.smithi150.stdout:7/291: read - d2/d1b/d31/f36 zero size 2023-12-05T09:57:26.897 INFO:tasks.workunit.client.0.smithi100.stdout:9/382: truncate d7/d1b/d22/f4a 3783205 0 2023-12-05T09:57:26.897 INFO:tasks.workunit.client.0.smithi100.stdout:9/383: write d7/d1b/d22/d2a/d56/f6e [673275,54931] 0 2023-12-05T09:57:26.898 INFO:tasks.workunit.client.0.smithi100.stdout:9/384: write d7/d1b/d22/f31 [774421,5039] 0 2023-12-05T09:57:26.898 INFO:tasks.workunit.client.0.smithi100.stdout:9/385: fsync d7/d35/d71/f78 0 2023-12-05T09:57:26.898 INFO:tasks.workunit.client.1.smithi150.stdout:1/324: dwrite d6/d8/db/f73 [0,4194304] 0 2023-12-05T09:57:26.899 INFO:tasks.workunit.client.1.smithi150.stdout:6/259: dwrite d2/d23/d2e/d39/f4d [0,4194304] 0 2023-12-05T09:57:26.907 INFO:tasks.workunit.client.1.smithi150.stdout:8/294: stat d0/d41/d49/d1b/l32 0 2023-12-05T09:57:26.907 INFO:tasks.workunit.client.1.smithi150.stdout:8/295: chown d0/d41 796208483 1 2023-12-05T09:57:26.907 INFO:tasks.workunit.client.1.smithi150.stdout:8/296: write d0/d41/d49/d1b/f1c [3850383,88192] 0 2023-12-05T09:57:26.907 INFO:tasks.workunit.client.1.smithi150.stdout:8/297: readlink d0/d41/d49/d1b/l32 0 2023-12-05T09:57:26.914 INFO:tasks.workunit.client.1.smithi150.stdout:3/294: creat d6/d9/d3d/d56/d30/f5e x:0 0 0 2023-12-05T09:57:26.915 INFO:tasks.workunit.client.0.smithi100.stdout:4/279: mknod de/c57 0 2023-12-05T09:57:26.915 INFO:tasks.workunit.client.0.smithi100.stdout:4/280: creat de/d16/d23/f58 x:0 0 0 2023-12-05T09:57:26.917 INFO:tasks.workunit.client.0.smithi100.stdout:4/281: read de/d16/d23/f37 [217808,78189] 0 2023-12-05T09:57:26.917 INFO:tasks.workunit.client.0.smithi100.stdout:4/282: fsync de/f55 0 2023-12-05T09:57:26.917 INFO:tasks.workunit.client.0.smithi100.stdout:4/283: read - de/d16/d23/d33/d3d/f3f zero size 2023-12-05T09:57:26.918 INFO:tasks.workunit.client.1.smithi150.stdout:0/332: rename d5/d11/d16/d3f/d3b/f52 to d5/f72 0 2023-12-05T09:57:26.919 INFO:tasks.workunit.client.1.smithi150.stdout:0/333: write d5/fa [3114901,76004] 0 2023-12-05T09:57:26.921 INFO:tasks.workunit.client.1.smithi150.stdout:8/298: write d0/d41/d49/f59 [301331,31136] 0 2023-12-05T09:57:26.921 INFO:tasks.workunit.client.1.smithi150.stdout:8/299: chown d0/d41/d49/d1b/d24/l2d 189117926 1 2023-12-05T09:57:26.924 INFO:tasks.workunit.client.1.smithi150.stdout:9/275: truncate d3/f29 2600196 0 2023-12-05T09:57:26.924 INFO:tasks.workunit.client.1.smithi150.stdout:9/276: fdatasync d3/d1b/f36 0 2023-12-05T09:57:26.926 INFO:tasks.workunit.client.1.smithi150.stdout:2/293: creat d0/d3/d5/d3b/d4c/f64 x:0 0 0 2023-12-05T09:57:26.926 INFO:tasks.workunit.client.0.smithi100.stdout:9/386: rmdir d7/d1b 39 2023-12-05T09:57:26.928 INFO:tasks.workunit.client.1.smithi150.stdout:5/285: dwrite d1/d3/d6/d11/f2f [0,4194304] 0 2023-12-05T09:57:26.928 INFO:tasks.workunit.client.1.smithi150.stdout:5/286: chown d1/d3/d38/d65/d3b 481578846 1 2023-12-05T09:57:26.928 INFO:tasks.workunit.client.1.smithi150.stdout:5/287: chown d1/d64/d31/f49 0 1 2023-12-05T09:57:26.935 INFO:tasks.workunit.client.1.smithi150.stdout:7/292: rmdir d2/db/d30/d18/d1a/d1e 39 2023-12-05T09:57:26.937 INFO:tasks.workunit.client.0.smithi100.stdout:4/284: creat de/d16/d1e/f59 x:0 0 0 2023-12-05T09:57:26.937 INFO:tasks.workunit.client.0.smithi100.stdout:4/285: fsync de/d16/d23/f2c 0 2023-12-05T09:57:26.940 INFO:tasks.workunit.client.1.smithi150.stdout:6/260: symlink d2/d23/d2e/d44/l58 0 2023-12-05T09:57:26.940 INFO:tasks.workunit.client.1.smithi150.stdout:6/261: fdatasync d2/d23/f45 0 2023-12-05T09:57:26.940 INFO:tasks.workunit.client.1.smithi150.stdout:6/262: chown d2/f1c 207306 1 2023-12-05T09:57:26.941 INFO:tasks.workunit.client.1.smithi150.stdout:1/325: dwrite d6/d47/d4c/d60/f69 [0,4194304] 0 2023-12-05T09:57:26.941 INFO:tasks.workunit.client.1.smithi150.stdout:1/326: fsync d6/d8/db/f16 0 2023-12-05T09:57:26.942 INFO:tasks.workunit.client.1.smithi150.stdout:1/327: chown d6/d3c/f40 0 1 2023-12-05T09:57:26.942 INFO:tasks.workunit.client.1.smithi150.stdout:9/277: dread d3/d9/f49 [0,4194304] 0 2023-12-05T09:57:26.943 INFO:tasks.workunit.client.1.smithi150.stdout:4/257: getdents d0/d11 0 2023-12-05T09:57:26.945 INFO:tasks.workunit.client.1.smithi150.stdout:0/334: creat d5/d11/d16/d1f/d67/f73 x:0 0 0 2023-12-05T09:57:26.948 INFO:tasks.workunit.client.0.smithi100.stdout:7/271: dwrite d3/dc/f12 [0,4194304] 0 2023-12-05T09:57:26.952 INFO:tasks.workunit.client.1.smithi150.stdout:8/300: symlink d0/d41/d49/d1b/d24/d2e/d30/l5d 0 2023-12-05T09:57:26.952 INFO:tasks.workunit.client.1.smithi150.stdout:8/301: creat d0/d41/d49/d1b/d24/d2e/f5e x:0 0 0 2023-12-05T09:57:26.954 INFO:tasks.workunit.client.1.smithi150.stdout:2/294: creat d0/d3/d5/d22/f65 x:0 0 0 2023-12-05T09:57:26.956 INFO:tasks.workunit.client.1.smithi150.stdout:5/288: mknod d1/d2e/c66 0 2023-12-05T09:57:26.959 INFO:tasks.workunit.client.1.smithi150.stdout:7/293: symlink d2/db/d17/d3a/l52 0 2023-12-05T09:57:26.967 INFO:tasks.workunit.client.1.smithi150.stdout:7/294: write d2/d1b/f35 [1929342,28706] 0 2023-12-05T09:57:26.969 INFO:tasks.workunit.client.0.smithi100.stdout:9/387: creat d7/d1b/d22/d51/f7f x:0 0 0 2023-12-05T09:57:26.981 INFO:tasks.workunit.client.1.smithi150.stdout:4/258: chown d0/c10 0 1 2023-12-05T09:57:26.981 INFO:tasks.workunit.client.1.smithi150.stdout:3/295: rmdir d6/d9/d43/d47 39 2023-12-05T09:57:26.981 INFO:tasks.workunit.client.1.smithi150.stdout:1/328: creat d6/d8/d59/f76 x:0 0 0 2023-12-05T09:57:26.981 INFO:tasks.workunit.client.1.smithi150.stdout:3/296: chown d6/d38/f4d 1 1 2023-12-05T09:57:26.981 INFO:tasks.workunit.client.1.smithi150.stdout:3/297: creat d6/d9/d3d/d56/d30/f5f x:0 0 0 2023-12-05T09:57:26.983 INFO:tasks.workunit.client.1.smithi150.stdout:0/335: mkdir d5/d11/d71/d74 0 2023-12-05T09:57:26.984 INFO:tasks.workunit.client.1.smithi150.stdout:8/302: symlink d0/d41/d49/d1b/d24/d5b/l5f 0 2023-12-05T09:57:26.986 INFO:tasks.workunit.client.1.smithi150.stdout:2/295: symlink d0/d3/d5/d22/l66 0 2023-12-05T09:57:26.986 INFO:tasks.workunit.client.1.smithi150.stdout:2/296: chown d0/d3/f14 3252765 1 2023-12-05T09:57:26.990 INFO:tasks.workunit.client.1.smithi150.stdout:5/289: symlink d1/d3/d38/l67 0 2023-12-05T09:57:26.992 INFO:tasks.workunit.client.1.smithi150.stdout:7/295: mkdir d2/db/d30/d53 0 2023-12-05T09:57:26.992 INFO:tasks.workunit.client.1.smithi150.stdout:7/296: fsync d2/db/d30/d18/d1a/d1e/d2b/d49/f43 0 2023-12-05T09:57:26.993 INFO:tasks.workunit.client.1.smithi150.stdout:0/336: dread d5/d11/f26 [0,4194304] 0 2023-12-05T09:57:26.994 INFO:tasks.workunit.client.1.smithi150.stdout:9/278: link d3/d9/dc/d1f/l39 d3/d9/l57 0 2023-12-05T09:57:26.994 INFO:tasks.workunit.client.1.smithi150.stdout:9/279: truncate d3/d9/f31 576033 0 2023-12-05T09:57:26.997 INFO:tasks.workunit.client.1.smithi150.stdout:3/298: link d6/d9/d3d/d56/f46 d6/d9/d43/f60 0 2023-12-05T09:57:26.998 INFO:tasks.workunit.client.1.smithi150.stdout:8/303: creat d0/d41/d49/d1b/d24/d34/d56/f60 x:0 0 0 2023-12-05T09:57:27.001 INFO:tasks.workunit.client.1.smithi150.stdout:6/263: rename d2/d23/d2e/d39 to d2/d23/d2e/d59 0 2023-12-05T09:57:27.001 INFO:tasks.workunit.client.1.smithi150.stdout:6/264: dread - d2/d23/d2e/f3c zero size 2023-12-05T09:57:27.001 INFO:tasks.workunit.client.1.smithi150.stdout:6/265: fdatasync d2/da/f27 0 2023-12-05T09:57:27.001 INFO:tasks.workunit.client.1.smithi150.stdout:6/266: creat d2/f5a x:0 0 0 2023-12-05T09:57:27.003 INFO:tasks.workunit.client.1.smithi150.stdout:5/290: truncate d1/d3/fb 453146 0 2023-12-05T09:57:27.003 INFO:tasks.workunit.client.1.smithi150.stdout:5/291: chown d1/d3/d6/f1c 25895538 1 2023-12-05T09:57:27.004 INFO:tasks.workunit.client.1.smithi150.stdout:7/297: rename d2/db/d17/d3a/l52 to d2/db/d30/d18/d1a/d1e/d2b/l54 0 2023-12-05T09:57:27.010 INFO:tasks.workunit.client.1.smithi150.stdout:2/297: symlink d0/d3/d5/d13/d15/d30/d54/l67 0 2023-12-05T09:57:27.011 INFO:tasks.workunit.client.0.smithi100.stdout:8/260: sync 2023-12-05T09:57:27.012 INFO:tasks.workunit.client.0.smithi100.stdout:2/449: sync 2023-12-05T09:57:27.012 INFO:tasks.workunit.client.0.smithi100.stdout:1/312: sync 2023-12-05T09:57:27.012 INFO:tasks.workunit.client.0.smithi100.stdout:3/391: sync 2023-12-05T09:57:27.013 INFO:tasks.workunit.client.0.smithi100.stdout:7/272: dwrite d3/dc/d11/d13/de/d2d/f4e [0,4194304] 0 2023-12-05T09:57:27.014 INFO:tasks.workunit.client.1.smithi150.stdout:0/337: mknod d5/d11/d32/d57/c75 0 2023-12-05T09:57:27.014 INFO:tasks.workunit.client.1.smithi150.stdout:8/304: rename d0/d8/d45/l57 to d0/d41/l61 0 2023-12-05T09:57:27.015 INFO:tasks.workunit.client.0.smithi100.stdout:8/261: creat d0/d35/f3b x:0 0 0 2023-12-05T09:57:27.015 INFO:tasks.workunit.client.1.smithi150.stdout:2/298: mknod d0/d3/d5/d10/d3d/d41/c68 0 2023-12-05T09:57:27.017 INFO:tasks.workunit.client.0.smithi100.stdout:3/392: rename d0/l7b to d0/d3d/d5c/d5f/l85 0 2023-12-05T09:57:27.017 INFO:tasks.workunit.client.0.smithi100.stdout:3/393: fdatasync d0/d10/f71 0 2023-12-05T09:57:27.018 INFO:tasks.workunit.client.1.smithi150.stdout:5/292: mknod d1/d3/d38/d65/d3b/c68 0 2023-12-05T09:57:27.018 INFO:tasks.workunit.client.1.smithi150.stdout:7/298: symlink d2/db/d30/d13/l55 0 2023-12-05T09:57:27.018 INFO:tasks.workunit.client.1.smithi150.stdout:7/299: readlink d2/db/d30/d18/d1a/d1e/d2b/l54 0 2023-12-05T09:57:27.019 INFO:tasks.workunit.client.1.smithi150.stdout:4/259: write d0/fc [3676581,57933] 0 2023-12-05T09:57:27.024 INFO:tasks.workunit.client.1.smithi150.stdout:6/267: rmdir d2/da 39 2023-12-05T09:57:27.025 INFO:tasks.workunit.client.0.smithi100.stdout:7/273: link d3/dc/d11/d13/f30 d3/dc/d11/d13/d1b/f5e 0 2023-12-05T09:57:27.025 INFO:tasks.workunit.client.0.smithi100.stdout:7/274: fdatasync d3/dc/f4a 0 2023-12-05T09:57:27.027 INFO:tasks.workunit.client.1.smithi150.stdout:3/299: dread d6/d9/d3d/d52/d5b/f44 [0,4194304] 0 2023-12-05T09:57:27.030 INFO:tasks.workunit.client.1.smithi150.stdout:2/299: creat d0/d3/d5/d13/f69 x:0 0 0 2023-12-05T09:57:27.032 INFO:tasks.workunit.client.0.smithi100.stdout:3/394: mknod d0/d2/de/d11/c86 0 2023-12-05T09:57:27.036 INFO:tasks.workunit.client.0.smithi100.stdout:4/286: dwrite de/d16/d23/f37 [0,4194304] 0 2023-12-05T09:57:27.036 INFO:tasks.workunit.client.0.smithi100.stdout:4/287: chown de/d16/d23/f47 724126 1 2023-12-05T09:57:27.037 INFO:tasks.workunit.client.0.smithi100.stdout:4/288: creat de/d16/d23/d33/d3d/f5a x:0 0 0 2023-12-05T09:57:27.037 INFO:tasks.workunit.client.1.smithi150.stdout:5/293: creat d1/d3/d38/d65/d3b/d37/f69 x:0 0 0 2023-12-05T09:57:27.037 INFO:tasks.workunit.client.1.smithi150.stdout:5/294: chown d1 25 1 2023-12-05T09:57:27.045 INFO:tasks.workunit.client.1.smithi150.stdout:3/300: mknod d6/d25/c61 0 2023-12-05T09:57:27.049 INFO:tasks.workunit.client.1.smithi150.stdout:2/300: mknod d0/d3/d5/d13/d15/d30/d54/d57/c6a 0 2023-12-05T09:57:27.060 INFO:tasks.workunit.client.0.smithi100.stdout:9/388: dwrite d7/fc [0,4194304] 0 2023-12-05T09:57:27.060 INFO:tasks.workunit.client.0.smithi100.stdout:9/389: write d7/d35/f59 [670141,70892] 0 2023-12-05T09:57:27.060 INFO:tasks.workunit.client.0.smithi100.stdout:9/390: readlink d7/d1b/d22/d2a/l2b 0 2023-12-05T09:57:27.060 INFO:tasks.workunit.client.1.smithi150.stdout:5/295: dread d1/d3/d6/f10 [0,4194304] 0 2023-12-05T09:57:27.063 INFO:tasks.workunit.client.1.smithi150.stdout:7/300: rmdir d2/db/d30/d18/d1a/d1e/d2b 39 2023-12-05T09:57:27.064 INFO:tasks.workunit.client.1.smithi150.stdout:4/260: rmdir d0/d3e 39 2023-12-05T09:57:27.069 INFO:tasks.workunit.client.1.smithi150.stdout:3/301: rename d6/d9/d3d/d56/f46 to d6/d25/f62 0 2023-12-05T09:57:27.074 INFO:tasks.workunit.client.1.smithi150.stdout:9/280: dwrite d3/d9/f52 [0,4194304] 0 2023-12-05T09:57:27.078 INFO:tasks.workunit.client.0.smithi100.stdout:4/289: link c5 de/d16/d23/d33/d3d/d44/c5b 0 2023-12-05T09:57:27.081 INFO:tasks.workunit.client.0.smithi100.stdout:7/275: rmdir d3/dc/d11 39 2023-12-05T09:57:27.082 INFO:tasks.workunit.client.0.smithi100.stdout:1/313: dwrite db/d12/d1e/f2e [0,4194304] 0 2023-12-05T09:57:27.082 INFO:tasks.workunit.client.0.smithi100.stdout:1/314: fsync db/d31/d3a/d3b/f4b 0 2023-12-05T09:57:27.083 INFO:tasks.workunit.client.0.smithi100.stdout:1/315: creat db/d12/d1e/f5d x:0 0 0 2023-12-05T09:57:27.083 INFO:tasks.workunit.client.0.smithi100.stdout:1/316: truncate db/f55 640170 0 2023-12-05T09:57:27.083 INFO:tasks.workunit.client.0.smithi100.stdout:9/391: write d7/d1b/d22/d51/f2d [5212121,7492] 0 2023-12-05T09:57:27.083 INFO:tasks.workunit.client.1.smithi150.stdout:5/296: write d1/d3/d38/d65/d3b/f62 [413905,10348] 0 2023-12-05T09:57:27.083 INFO:tasks.workunit.client.1.smithi150.stdout:1/329: dwrite d6/d8/f27 [0,4194304] 0 2023-12-05T09:57:27.084 INFO:tasks.workunit.client.1.smithi150.stdout:2/301: rename d0/d3/d11/c28 to d0/d3/d27/d51/c6b 0 2023-12-05T09:57:27.085 INFO:tasks.workunit.client.0.smithi100.stdout:2/450: dwrite d7/da/d13/f5d [4194304,4194304] 0 2023-12-05T09:57:27.086 INFO:tasks.workunit.client.0.smithi100.stdout:4/290: symlink de/d16/l5c 0 2023-12-05T09:57:27.086 INFO:tasks.workunit.client.0.smithi100.stdout:4/291: dread - de/f11 zero size 2023-12-05T09:57:27.089 INFO:tasks.workunit.client.1.smithi150.stdout:9/281: mkdir d3/d9/d58 0 2023-12-05T09:57:27.093 INFO:tasks.workunit.client.0.smithi100.stdout:1/317: rename db/d12/d1e/f2e to db/d12/d1e/d26/f5e 0 2023-12-05T09:57:27.093 INFO:tasks.workunit.client.1.smithi150.stdout:2/302: dread d0/d3/d21/f44 [0,4194304] 0 2023-12-05T09:57:27.093 INFO:tasks.workunit.client.1.smithi150.stdout:2/303: fsync d0/d3/d5/d22/f35 0 2023-12-05T09:57:27.094 INFO:tasks.workunit.client.1.smithi150.stdout:5/297: truncate d1/d3/d6/f1c 3915375 0 2023-12-05T09:57:27.099 INFO:tasks.workunit.client.1.smithi150.stdout:7/301: rename d2/db/d30/d13/l55 to d2/db/l56 0 2023-12-05T09:57:27.099 INFO:tasks.workunit.client.1.smithi150.stdout:1/330: getdents d6/d8/d59 0 2023-12-05T09:57:27.103 INFO:tasks.workunit.client.1.smithi150.stdout:1/331: rmdir d6/d8/db/d1b 39 2023-12-05T09:57:27.103 INFO:tasks.workunit.client.1.smithi150.stdout:1/332: chown d6/d8/db/d1b 508 1 2023-12-05T09:57:27.104 INFO:tasks.workunit.client.1.smithi150.stdout:7/302: creat d2/db/d30/d18/f57 x:0 0 0 2023-12-05T09:57:27.105 INFO:tasks.workunit.client.1.smithi150.stdout:6/268: dwrite d2/da/f27 [4194304,4194304] 0 2023-12-05T09:57:27.106 INFO:tasks.workunit.client.0.smithi100.stdout:9/392: dread d7/fc [0,4194304] 0 2023-12-05T09:57:27.107 INFO:tasks.workunit.client.1.smithi150.stdout:7/303: unlink d2/db/d30/ld 0 2023-12-05T09:57:27.111 INFO:tasks.workunit.client.1.smithi150.stdout:3/302: rename d6/d38 to d6/d22/d37/d63 0 2023-12-05T09:57:27.112 INFO:tasks.workunit.client.1.smithi150.stdout:3/303: fdatasync d6/d9/f57 0 2023-12-05T09:57:27.112 INFO:tasks.workunit.client.1.smithi150.stdout:3/304: chown d6/d9/la 2079178 1 2023-12-05T09:57:27.113 INFO:tasks.workunit.client.0.smithi100.stdout:8/262: dwrite d0/f9 [0,4194304] 0 2023-12-05T09:57:27.113 INFO:tasks.workunit.client.1.smithi150.stdout:6/269: rmdir d2/d23 39 2023-12-05T09:57:27.115 INFO:tasks.workunit.client.1.smithi150.stdout:0/338: dwrite d5/f5d [0,4194304] 0 2023-12-05T09:57:27.116 INFO:tasks.workunit.client.0.smithi100.stdout:3/395: dwrite d0/f36 [0,4194304] 0 2023-12-05T09:57:27.121 INFO:tasks.workunit.client.0.smithi100.stdout:1/318: write db/d12/d1e/d26/d30/f56 [1050396,18416] 0 2023-12-05T09:57:27.126 INFO:tasks.workunit.client.1.smithi150.stdout:3/305: rename d6/c29 to d6/d9/d43/c64 0 2023-12-05T09:57:27.126 INFO:tasks.workunit.client.1.smithi150.stdout:5/298: dread d1/d3/d38/d65/f63 [4194304,4194304] 0 2023-12-05T09:57:27.126 INFO:tasks.workunit.client.1.smithi150.stdout:0/339: getdents d5/d11/d16/d1f 0 2023-12-05T09:57:27.132 INFO:tasks.workunit.client.1.smithi150.stdout:7/304: dread d2/db/d30/d18/d1a/f3c [0,4194304] 0 2023-12-05T09:57:27.136 INFO:tasks.workunit.client.0.smithi100.stdout:3/396: fsync d0/d2/f56 0 2023-12-05T09:57:27.136 INFO:tasks.workunit.client.0.smithi100.stdout:3/397: chown d0/d2/d33/f35 37 1 2023-12-05T09:57:27.144 INFO:tasks.workunit.client.0.smithi100.stdout:7/276: dwrite d3/dc/d11/f58 [0,4194304] 0 2023-12-05T09:57:27.147 INFO:tasks.workunit.client.1.smithi150.stdout:5/299: creat d1/d3/d6/d1b/f6a x:0 0 0 2023-12-05T09:57:27.147 INFO:tasks.workunit.client.1.smithi150.stdout:5/300: dread - d1/d3/d38/f4f zero size 2023-12-05T09:57:27.148 INFO:tasks.workunit.client.1.smithi150.stdout:0/340: creat d5/d11/d65/f76 x:0 0 0 2023-12-05T09:57:27.150 INFO:tasks.workunit.client.1.smithi150.stdout:0/341: write d5/fa [1638906,66123] 0 2023-12-05T09:57:27.152 INFO:tasks.workunit.client.0.smithi100.stdout:2/451: dwrite d7/da/d18/d1b/f28 [0,4194304] 0 2023-12-05T09:57:27.152 INFO:tasks.workunit.client.0.smithi100.stdout:2/452: fsync d7/da/d18/f62 0 2023-12-05T09:57:27.155 INFO:tasks.workunit.client.0.smithi100.stdout:3/398: mkdir d0/d3d/d5c/d6f/d7f/d87 0 2023-12-05T09:57:27.155 INFO:tasks.workunit.client.0.smithi100.stdout:3/399: write d0/d10/f71 [241835,58140] 0 2023-12-05T09:57:27.162 INFO:tasks.workunit.client.0.smithi100.stdout:1/319: getdents db/d31/d3a 0 2023-12-05T09:57:27.165 INFO:tasks.workunit.client.0.smithi100.stdout:2/453: symlink d7/da/d18/d21/l96 0 2023-12-05T09:57:27.166 INFO:tasks.workunit.client.1.smithi150.stdout:1/333: dwrite f4 [0,4194304] 0 2023-12-05T09:57:27.166 INFO:tasks.workunit.client.1.smithi150.stdout:1/334: dread - d6/d8/db/f6e zero size 2023-12-05T09:57:27.167 INFO:tasks.workunit.client.1.smithi150.stdout:9/282: dwrite d3/d1b/f36 [0,4194304] 0 2023-12-05T09:57:27.167 INFO:tasks.workunit.client.1.smithi150.stdout:9/283: truncate d3/d9/f31 1255796 0 2023-12-05T09:57:27.169 INFO:tasks.workunit.client.0.smithi100.stdout:3/400: creat d0/f88 x:0 0 0 2023-12-05T09:57:27.172 INFO:tasks.workunit.client.0.smithi100.stdout:1/320: creat db/d12/d1e/d26/d30/d52/f5f x:0 0 0 2023-12-05T09:57:27.175 INFO:tasks.workunit.client.0.smithi100.stdout:4/292: dwrite de/f11 [0,4194304] 0 2023-12-05T09:57:27.175 INFO:tasks.workunit.client.0.smithi100.stdout:4/293: fdatasync de/d16/f45 0 2023-12-05T09:57:27.177 INFO:tasks.workunit.client.0.smithi100.stdout:2/454: truncate d7/da/d65/f77 4129124 0 2023-12-05T09:57:27.177 INFO:tasks.workunit.client.1.smithi150.stdout:6/270: dwrite d2/f1c [0,4194304] 0 2023-12-05T09:57:27.178 INFO:tasks.workunit.client.1.smithi150.stdout:6/271: fdatasync d2/f26 0 2023-12-05T09:57:27.178 INFO:tasks.workunit.client.1.smithi150.stdout:7/305: mknod d2/db/d30/d53/c58 0 2023-12-05T09:57:27.183 INFO:tasks.workunit.client.1.smithi150.stdout:3/306: rmdir d6/d9/d43 39 2023-12-05T09:57:27.186 INFO:tasks.workunit.client.0.smithi100.stdout:1/321: rename db/f55 to db/d31/f60 0 2023-12-05T09:57:27.186 INFO:tasks.workunit.client.0.smithi100.stdout:1/322: chown db/d31/f60 1723798 1 2023-12-05T09:57:27.187 INFO:tasks.workunit.client.1.smithi150.stdout:9/284: dread d3/d9/dc/f33 [0,4194304] 0 2023-12-05T09:57:27.187 INFO:tasks.workunit.client.1.smithi150.stdout:5/301: mkdir d1/d3/d38/d65/d3b/d6b 0 2023-12-05T09:57:27.187 INFO:tasks.workunit.client.1.smithi150.stdout:5/302: read d1/d3/d38/d65/f63 [1695772,112897] 0 2023-12-05T09:57:27.189 INFO:tasks.workunit.client.1.smithi150.stdout:1/335: write d6/d47/d4c/d60/f69 [2448651,53375] 0 2023-12-05T09:57:27.190 INFO:tasks.workunit.client.1.smithi150.stdout:0/342: rename d5/d11/d16/d3f/d3b/d61 to d5/d11/d71/d5f/d77 0 2023-12-05T09:57:27.191 INFO:tasks.workunit.client.1.smithi150.stdout:9/285: dread d3/d9/f31 [0,4194304] 0 2023-12-05T09:57:27.198 INFO:tasks.workunit.client.0.smithi100.stdout:7/277: dwrite d3/dc/d11/d13/de/f22 [0,4194304] 0 2023-12-05T09:57:27.198 INFO:tasks.workunit.client.0.smithi100.stdout:7/278: truncate d3/dc/d11/d13/de/d18/d3b/d40/f41 191532 0 2023-12-05T09:57:27.206 INFO:tasks.workunit.client.0.smithi100.stdout:3/401: rmdir d0/d10 39 2023-12-05T09:57:27.206 INFO:tasks.workunit.client.0.smithi100.stdout:3/402: fdatasync d0/f36 0 2023-12-05T09:57:27.206 INFO:tasks.workunit.client.0.smithi100.stdout:2/455: truncate d7/da/d18/d21/f7e 535381 0 2023-12-05T09:57:27.209 INFO:tasks.workunit.client.0.smithi100.stdout:1/323: mkdir db/d12/d61 0 2023-12-05T09:57:27.209 INFO:tasks.workunit.client.0.smithi100.stdout:1/324: chown db/l21 246102792 1 2023-12-05T09:57:27.211 INFO:tasks.workunit.client.1.smithi150.stdout:7/306: creat d2/db/d30/d13/d4f/f59 x:0 0 0 2023-12-05T09:57:27.213 INFO:tasks.workunit.client.1.smithi150.stdout:3/307: creat d6/d9/d3d/d52/f65 x:0 0 0 2023-12-05T09:57:27.214 INFO:tasks.workunit.client.0.smithi100.stdout:7/279: creat d3/dc/d11/d13/de/d18/d3b/d40/d46/f5f x:0 0 0 2023-12-05T09:57:27.215 INFO:tasks.workunit.client.1.smithi150.stdout:5/303: mknod d1/d3/d6/d1b/c6c 0 2023-12-05T09:57:27.216 INFO:tasks.workunit.client.0.smithi100.stdout:2/456: symlink d7/da/l97 0 2023-12-05T09:57:27.217 INFO:tasks.workunit.client.0.smithi100.stdout:7/280: mkdir d3/dc/d11/d13/d1b/d60 0 2023-12-05T09:57:27.218 INFO:tasks.workunit.client.0.smithi100.stdout:7/281: fdatasync d3/dc/d11/d13/de/d18/d3b/d40/d46/f5c 0 2023-12-05T09:57:27.222 INFO:tasks.workunit.client.1.smithi150.stdout:1/336: creat d6/d8/db/de/f77 x:0 0 0 2023-12-05T09:57:27.223 INFO:tasks.workunit.client.1.smithi150.stdout:7/307: dread d2/db/d30/d13/f14 [0,4194304] 0 2023-12-05T09:57:27.224 INFO:tasks.workunit.client.0.smithi100.stdout:2/457: mkdir d7/da/d18/d1b/d2c/d3f/d98 0 2023-12-05T09:57:27.225 INFO:tasks.workunit.client.0.smithi100.stdout:2/458: chown d7/da/d18/d21/d4d/l7d 111798007 1 2023-12-05T09:57:27.226 INFO:tasks.workunit.client.0.smithi100.stdout:3/403: dread d0/d4/f14 [0,4194304] 0 2023-12-05T09:57:27.227 INFO:tasks.workunit.client.1.smithi150.stdout:6/272: rename d2/l38 to d2/d23/d2e/l5b 0 2023-12-05T09:57:27.227 INFO:tasks.workunit.client.1.smithi150.stdout:6/273: chown d2/da/c55 7513 1 2023-12-05T09:57:27.228 INFO:tasks.workunit.client.0.smithi100.stdout:7/282: dread d3/dc/d11/d13/de/f5a [0,4194304] 0 2023-12-05T09:57:27.228 INFO:tasks.workunit.client.1.smithi150.stdout:0/343: mknod d5/d11/d16/d3f/d3b/c78 0 2023-12-05T09:57:27.229 INFO:tasks.workunit.client.1.smithi150.stdout:0/344: truncate d5/f41 210238 0 2023-12-05T09:57:27.230 INFO:tasks.workunit.client.0.smithi100.stdout:2/459: mknod d7/da/d18/d21/c99 0 2023-12-05T09:57:27.230 INFO:tasks.workunit.client.0.smithi100.stdout:0/323: sync 2023-12-05T09:57:27.231 INFO:tasks.workunit.client.0.smithi100.stdout:0/324: write da/f37 [1094972,65385] 0 2023-12-05T09:57:27.231 INFO:tasks.workunit.client.0.smithi100.stdout:0/325: fsync da/d2a/f3f 0 2023-12-05T09:57:27.231 INFO:tasks.workunit.client.0.smithi100.stdout:0/326: read da/fd [295720,9514] 0 2023-12-05T09:57:27.231 INFO:tasks.workunit.client.0.smithi100.stdout:0/327: fdatasync da/f2c 0 2023-12-05T09:57:27.235 INFO:tasks.workunit.client.1.smithi150.stdout:4/261: sync 2023-12-05T09:57:27.235 INFO:tasks.workunit.client.1.smithi150.stdout:2/304: sync 2023-12-05T09:57:27.235 INFO:tasks.workunit.client.1.smithi150.stdout:8/305: sync 2023-12-05T09:57:27.235 INFO:tasks.workunit.client.0.smithi100.stdout:3/404: creat d0/d4/d3a/d45/f89 x:0 0 0 2023-12-05T09:57:27.235 INFO:tasks.workunit.client.0.smithi100.stdout:3/405: readlink d0/d2/de/d11/l2b 0 2023-12-05T09:57:27.236 INFO:tasks.workunit.client.0.smithi100.stdout:2/460: creat d7/da/d13/d69/d6e/d71/f9a x:0 0 0 2023-12-05T09:57:27.236 INFO:tasks.workunit.client.1.smithi150.stdout:5/304: mknod d1/c6d 0 2023-12-05T09:57:27.236 INFO:tasks.workunit.client.1.smithi150.stdout:5/305: write d1/d3/d6/f10 [577267,105873] 0 2023-12-05T09:57:27.240 INFO:tasks.workunit.client.1.smithi150.stdout:1/337: link d6/d8/db/f5b d6/d8/d59/f78 0 2023-12-05T09:57:27.242 INFO:tasks.workunit.client.1.smithi150.stdout:7/308: mkdir d2/db/d30/d13/d4f/d5a 0 2023-12-05T09:57:27.242 INFO:tasks.workunit.client.1.smithi150.stdout:7/309: chown d2/db/d30/d18/d1a/d1e/f21 248 1 2023-12-05T09:57:27.243 INFO:tasks.workunit.client.1.smithi150.stdout:7/310: write d2/d4/ff [4554623,91085] 0 2023-12-05T09:57:27.243 INFO:tasks.workunit.client.1.smithi150.stdout:7/311: chown d2/db/d30/d18/d1a/f3c 839935 1 2023-12-05T09:57:27.243 INFO:tasks.workunit.client.1.smithi150.stdout:7/312: write d2/d4/fc [7035763,35976] 0 2023-12-05T09:57:27.245 INFO:tasks.workunit.client.0.smithi100.stdout:2/461: mknod d7/da/d18/d21/d86/c9b 0 2023-12-05T09:57:27.246 INFO:tasks.workunit.client.1.smithi150.stdout:6/274: symlink d2/d23/d3b/d46/l5c 0 2023-12-05T09:57:27.247 INFO:tasks.workunit.client.1.smithi150.stdout:0/345: mknod d5/d11/d32/d57/c79 0 2023-12-05T09:57:27.249 INFO:tasks.workunit.client.0.smithi100.stdout:2/462: unlink d7/da/l8e 0 2023-12-05T09:57:27.249 INFO:tasks.workunit.client.0.smithi100.stdout:2/463: creat d7/da/f9c x:0 0 0 2023-12-05T09:57:27.249 INFO:tasks.workunit.client.0.smithi100.stdout:2/464: write d7/da/d18/d1b/f59 [1440766,20636] 0 2023-12-05T09:57:27.253 INFO:tasks.workunit.client.1.smithi150.stdout:3/308: symlink d6/l66 0 2023-12-05T09:57:27.253 INFO:tasks.workunit.client.1.smithi150.stdout:2/305: symlink d0/d3/d5/d10/d3d/d41/l6c 0 2023-12-05T09:57:27.253 INFO:tasks.workunit.client.1.smithi150.stdout:3/309: fdatasync d6/d25/d28/f2d 0 2023-12-05T09:57:27.255 INFO:tasks.workunit.client.1.smithi150.stdout:5/306: symlink d1/l6e 0 2023-12-05T09:57:27.255 INFO:tasks.workunit.client.1.smithi150.stdout:5/307: chown d1/d3/d6/f10 49060 1 2023-12-05T09:57:27.255 INFO:tasks.workunit.client.1.smithi150.stdout:5/308: dread - d1/d3/d6/d1b/f6a zero size 2023-12-05T09:57:27.260 INFO:tasks.workunit.client.0.smithi100.stdout:7/283: write d3/dc/f4a [2350591,106932] 0 2023-12-05T09:57:27.261 INFO:tasks.workunit.client.1.smithi150.stdout:1/338: truncate d6/d8/f11 674675 0 2023-12-05T09:57:27.261 INFO:tasks.workunit.client.1.smithi150.stdout:1/339: truncate d6/d8/db/f73 5238383 0 2023-12-05T09:57:27.261 INFO:tasks.workunit.client.1.smithi150.stdout:4/262: write d0/f20 [3408929,44205] 0 2023-12-05T09:57:27.263 INFO:tasks.workunit.client.0.smithi100.stdout:1/325: dwrite db/d31/d3a/f5b [0,4194304] 0 2023-12-05T09:57:27.265 INFO:tasks.workunit.client.1.smithi150.stdout:7/313: rename d2/db/d30/d13/d3d to d2/d1b/d5b 0 2023-12-05T09:57:27.265 INFO:tasks.workunit.client.1.smithi150.stdout:7/314: truncate d2/db/d30/d18/d1a/d1e/d2b/d49/f43 421391 0 2023-12-05T09:57:27.272 INFO:tasks.workunit.client.0.smithi100.stdout:1/326: link db/d12/d1e/d26/f5e db/d12/d1e/d26/f62 0 2023-12-05T09:57:27.272 INFO:tasks.workunit.client.0.smithi100.stdout:1/327: stat db/d31/d3a/d3b/c3d 0 2023-12-05T09:57:27.272 INFO:tasks.workunit.client.0.smithi100.stdout:1/328: write db/d31/d3a/d3b/f4b [196972,9402] 0 2023-12-05T09:57:27.272 INFO:tasks.workunit.client.1.smithi150.stdout:6/275: mkdir d2/d23/d2e/d59/d5d 0 2023-12-05T09:57:27.273 INFO:tasks.workunit.client.0.smithi100.stdout:1/329: link db/d12/d1e/d26/c3f db/d12/d1e/d26/c63 0 2023-12-05T09:57:27.276 INFO:tasks.workunit.client.1.smithi150.stdout:3/310: dread d6/d9/f50 [0,4194304] 0 2023-12-05T09:57:27.276 INFO:tasks.workunit.client.1.smithi150.stdout:3/311: chown d6/d9/d43/c64 4 1 2023-12-05T09:57:27.277 INFO:tasks.workunit.client.1.smithi150.stdout:3/312: dread - d6/d25/f62 zero size 2023-12-05T09:57:27.277 INFO:tasks.workunit.client.1.smithi150.stdout:3/313: chown d6/d25 238242 1 2023-12-05T09:57:27.278 INFO:tasks.workunit.client.1.smithi150.stdout:8/306: dwrite d0/d41/f55 [0,4194304] 0 2023-12-05T09:57:27.278 INFO:tasks.workunit.client.0.smithi100.stdout:1/330: truncate db/f35 2970017 0 2023-12-05T09:57:27.281 INFO:tasks.workunit.client.1.smithi150.stdout:0/346: symlink d5/d11/d32/l7a 0 2023-12-05T09:57:27.281 INFO:tasks.workunit.client.1.smithi150.stdout:2/306: mknod d0/d3/d5/c6d 0 2023-12-05T09:57:27.281 INFO:tasks.workunit.client.1.smithi150.stdout:6/276: unlink d2/f2c 0 2023-12-05T09:57:27.282 INFO:tasks.workunit.client.1.smithi150.stdout:6/277: fdatasync d2/f1c 0 2023-12-05T09:57:27.282 INFO:tasks.workunit.client.1.smithi150.stdout:6/278: chown d2/da/c1b 711 1 2023-12-05T09:57:27.282 INFO:tasks.workunit.client.1.smithi150.stdout:5/309: rename d1/c3d to d1/d3/d38/d65/d3b/d37/c6f 0 2023-12-05T09:57:27.286 INFO:tasks.workunit.client.0.smithi100.stdout:1/331: link db/d31/d3a/d3b/f4b db/d12/d61/f64 0 2023-12-05T09:57:27.287 INFO:tasks.workunit.client.1.smithi150.stdout:3/314: mkdir d6/d25/d28/d67 0 2023-12-05T09:57:27.287 INFO:tasks.workunit.client.1.smithi150.stdout:3/315: chown d6/d9/d3d/d56/d30 213361 1 2023-12-05T09:57:27.287 INFO:tasks.workunit.client.1.smithi150.stdout:3/316: write d6/d9/f57 [449330,82593] 0 2023-12-05T09:57:27.295 INFO:tasks.workunit.client.1.smithi150.stdout:2/307: symlink d0/d3/d11/d1d/l6e 0 2023-12-05T09:57:27.296 INFO:tasks.workunit.client.1.smithi150.stdout:0/347: link d5/d11/d32/d57/c64 d5/d11/d71/d5f/d6a/c7b 0 2023-12-05T09:57:27.297 INFO:tasks.workunit.client.1.smithi150.stdout:0/348: truncate d5/d11/d71/f56 1274898 0 2023-12-05T09:57:27.297 INFO:tasks.workunit.client.1.smithi150.stdout:0/349: write d5/d11/d16/f51 [331016,46139] 0 2023-12-05T09:57:27.297 INFO:tasks.workunit.client.1.smithi150.stdout:0/350: stat d5/d11/d16/f51 0 2023-12-05T09:57:27.297 INFO:tasks.workunit.client.1.smithi150.stdout:8/307: read d0/d41/d49/d1b/d24/d2e/d30/f36 [1724083,16862] 0 2023-12-05T09:57:27.298 INFO:tasks.workunit.client.1.smithi150.stdout:6/279: creat d2/d23/d2e/d59/f5e x:0 0 0 2023-12-05T09:57:27.301 INFO:tasks.workunit.client.1.smithi150.stdout:7/315: rename d2/db/d30/d18/d1a/d1e/d2b/d49 to d2/db/d30/d13/d4f/d5a/d5c 0 2023-12-05T09:57:27.302 INFO:tasks.workunit.client.1.smithi150.stdout:7/316: dread - d2/d1b/d31/f36 zero size 2023-12-05T09:57:27.302 INFO:tasks.workunit.client.1.smithi150.stdout:7/317: chown d2/db/d17/d20/l33 72811 1 2023-12-05T09:57:27.302 INFO:tasks.workunit.client.1.smithi150.stdout:4/263: creat d0/d42/f4c x:0 0 0 2023-12-05T09:57:27.302 INFO:tasks.workunit.client.0.smithi100.stdout:0/328: dwrite da/d2a/f3f [0,4194304] 0 2023-12-05T09:57:27.302 INFO:tasks.workunit.client.0.smithi100.stdout:0/329: write da/f5a [725721,83348] 0 2023-12-05T09:57:27.305 INFO:tasks.workunit.client.1.smithi150.stdout:0/351: creat d5/d11/d71/f7c x:0 0 0 2023-12-05T09:57:27.305 INFO:tasks.workunit.client.1.smithi150.stdout:8/308: mkdir d0/d41/d49/d1b/d24/d38/d62 0 2023-12-05T09:57:27.306 INFO:tasks.workunit.client.1.smithi150.stdout:6/280: getdents d2/d23 0 2023-12-05T09:57:27.307 INFO:tasks.workunit.client.1.smithi150.stdout:5/310: read d1/d2e/f52 [3963857,93983] 0 2023-12-05T09:57:27.311 INFO:tasks.workunit.client.0.smithi100.stdout:2/465: dwrite d7/da/d13/d69/d6e/d71/f9a [0,4194304] 0 2023-12-05T09:57:27.314 INFO:tasks.workunit.client.1.smithi150.stdout:4/264: rmdir d0 39 2023-12-05T09:57:27.314 INFO:tasks.workunit.client.1.smithi150.stdout:4/265: stat d0/d11/f39 0 2023-12-05T09:57:27.318 INFO:tasks.workunit.client.1.smithi150.stdout:0/352: mknod d5/d11/d16/d1f/c7d 0 2023-12-05T09:57:27.318 INFO:tasks.workunit.client.0.smithi100.stdout:1/332: write db/d12/d1e/d26/f5e [667669,50943] 0 2023-12-05T09:57:27.319 INFO:tasks.workunit.client.0.smithi100.stdout:0/330: mknod da/d1b/d36/c64 0 2023-12-05T09:57:27.319 INFO:tasks.workunit.client.1.smithi150.stdout:8/309: creat d0/d41/d49/d1b/d24/f63 x:0 0 0 2023-12-05T09:57:27.322 INFO:tasks.workunit.client.1.smithi150.stdout:1/340: dwrite d6/d8/db/de/f13 [4194304,4194304] 0 2023-12-05T09:57:27.322 INFO:tasks.workunit.client.1.smithi150.stdout:1/341: fdatasync d6/d8/d59/f78 0 2023-12-05T09:57:27.327 INFO:tasks.workunit.client.1.smithi150.stdout:6/281: mkdir d2/d23/d2e/d5f 0 2023-12-05T09:57:27.327 INFO:tasks.workunit.client.1.smithi150.stdout:6/282: chown d2/da/f22 1285 1 2023-12-05T09:57:27.332 INFO:tasks.workunit.client.0.smithi100.stdout:3/406: dwrite d0/d10/d39/f51 [0,4194304] 0 2023-12-05T09:57:27.337 INFO:tasks.workunit.client.1.smithi150.stdout:4/266: mkdir d0/d3e/d48/d4d 0 2023-12-05T09:57:27.338 INFO:tasks.workunit.client.1.smithi150.stdout:3/317: rename d6/d9/d43/d47/f13 to d6/d9/d3d/d52/d5b/f68 0 2023-12-05T09:57:27.338 INFO:tasks.workunit.client.1.smithi150.stdout:3/318: chown d6/d9/d43/d47/f1a 62153 1 2023-12-05T09:57:27.338 INFO:tasks.workunit.client.1.smithi150.stdout:0/353: mknod d5/d11/d71/d5f/d77/c7e 0 2023-12-05T09:57:27.338 INFO:tasks.workunit.client.1.smithi150.stdout:0/354: chown d5/d11/d16/d3f/d3b 12453629 1 2023-12-05T09:57:27.339 INFO:tasks.workunit.client.1.smithi150.stdout:0/355: write d5/d11/d16/d3f/f3c [10082532,50430] 0 2023-12-05T09:57:27.339 INFO:tasks.workunit.client.1.smithi150.stdout:0/356: chown d5/d11/d71/d5f 1581736224 1 2023-12-05T09:57:27.339 INFO:tasks.workunit.client.1.smithi150.stdout:0/357: chown d5/d11/d71/d5f/d77 87213569 1 2023-12-05T09:57:27.339 INFO:tasks.workunit.client.0.smithi100.stdout:1/333: rename db/d12/d1e/d26/c2b to db/d31/d3a/c65 0 2023-12-05T09:57:27.340 INFO:tasks.workunit.client.1.smithi150.stdout:8/310: rmdir d0/d41/d49/d1b/d24/d2e/d30 39 2023-12-05T09:57:27.340 INFO:tasks.workunit.client.0.smithi100.stdout:7/284: dwrite d3/dc/d11/d13/de/f2b [0,4194304] 0 2023-12-05T09:57:27.343 INFO:tasks.workunit.client.1.smithi150.stdout:1/342: dread d6/d3c/f49 [0,4194304] 0 2023-12-05T09:57:27.343 INFO:tasks.workunit.client.1.smithi150.stdout:1/343: readlink d6/d47/l61 0 2023-12-05T09:57:27.343 INFO:tasks.workunit.client.1.smithi150.stdout:1/344: truncate d6/d8/db/f19 692532 0 2023-12-05T09:57:27.349 INFO:tasks.workunit.client.1.smithi150.stdout:4/267: dread d0/f20 [0,4194304] 0 2023-12-05T09:57:27.352 INFO:tasks.workunit.client.1.smithi150.stdout:7/318: dread d2/d4/fc [4194304,4194304] 0 2023-12-05T09:57:27.362 INFO:tasks.workunit.client.0.smithi100.stdout:0/331: dwrite da/d1b/f52 [0,4194304] 0 2023-12-05T09:57:27.362 INFO:tasks.workunit.client.0.smithi100.stdout:0/332: fdatasync da/d2a/f56 0 2023-12-05T09:57:27.382 INFO:tasks.workunit.client.1.smithi150.stdout:3/319: creat d6/d9/d3d/d56/d53/f69 x:0 0 0 2023-12-05T09:57:27.383 INFO:tasks.workunit.client.1.smithi150.stdout:3/320: fsync d6/d9/f1c 0 2023-12-05T09:57:27.383 INFO:tasks.workunit.client.1.smithi150.stdout:3/321: chown d6/d9/d3d/d56/f3b 479559295 1 2023-12-05T09:57:27.383 INFO:tasks.workunit.client.1.smithi150.stdout:3/322: write d6/d9/d3d/d56/f3f [1003716,91711] 0 2023-12-05T09:57:27.383 INFO:tasks.workunit.client.1.smithi150.stdout:2/308: dwrite d0/d3/d21/f39 [0,4194304] 0 2023-12-05T09:57:27.385 INFO:tasks.workunit.client.0.smithi100.stdout:2/466: dwrite d7/f66 [0,4194304] 0 2023-12-05T09:57:27.386 INFO:tasks.workunit.client.0.smithi100.stdout:1/334: mkdir db/d12/d61/d66 0 2023-12-05T09:57:27.387 INFO:tasks.workunit.client.1.smithi150.stdout:9/286: sync 2023-12-05T09:57:27.387 INFO:tasks.workunit.client.1.smithi150.stdout:9/287: dread - d3/d9/f54 zero size 2023-12-05T09:57:27.395 INFO:tasks.workunit.client.1.smithi150.stdout:3/323: dread d6/d25/d28/f2e [4194304,4194304] 0 2023-12-05T09:57:27.395 INFO:tasks.workunit.client.1.smithi150.stdout:0/358: mkdir d5/d11/d16/d1f/d7f 0 2023-12-05T09:57:27.395 INFO:tasks.workunit.client.1.smithi150.stdout:3/324: fdatasync d6/d22/f31 0 2023-12-05T09:57:27.396 INFO:tasks.workunit.client.0.smithi100.stdout:7/285: rmdir d3/dc/d11/d13/de/d2d/d47 39 2023-12-05T09:57:27.398 INFO:tasks.workunit.client.1.smithi150.stdout:8/311: mkdir d0/d8/d45/d64 0 2023-12-05T09:57:27.400 INFO:tasks.workunit.client.1.smithi150.stdout:0/359: dread d5/d11/d71/d5f/f6f [0,4194304] 0 2023-12-05T09:57:27.400 INFO:tasks.workunit.client.1.smithi150.stdout:0/360: truncate d5/d11/d71/f7c 462203 0 2023-12-05T09:57:27.403 INFO:tasks.workunit.client.1.smithi150.stdout:1/345: mkdir d6/d8/db/d1b/d79 0 2023-12-05T09:57:27.405 INFO:tasks.workunit.client.1.smithi150.stdout:4/268: rmdir d0/d3e/d48 39 2023-12-05T09:57:27.406 INFO:tasks.workunit.client.0.smithi100.stdout:0/333: mknod da/d2a/d4d/c65 0 2023-12-05T09:57:27.406 INFO:tasks.workunit.client.0.smithi100.stdout:0/334: fdatasync da/d2a/f62 0 2023-12-05T09:57:27.407 INFO:tasks.workunit.client.1.smithi150.stdout:3/325: write d6/d9/d3d/d52/d5b/f68 [3683027,73462] 0 2023-12-05T09:57:27.408 INFO:tasks.workunit.client.1.smithi150.stdout:8/312: dread d0/d41/d49/d1b/d24/d2e/d30/f36 [0,4194304] 0 2023-12-05T09:57:27.409 INFO:tasks.workunit.client.1.smithi150.stdout:7/319: mknod d2/db/d30/d53/c5d 0 2023-12-05T09:57:27.411 INFO:tasks.workunit.client.0.smithi100.stdout:3/407: link d0/d10/d39/c66 d0/d3d/d5c/c8a 0 2023-12-05T09:57:27.424 INFO:tasks.workunit.client.0.smithi100.stdout:2/467: mkdir d7/da/d18/d1b/d2c/d3f/d72/d9d 0 2023-12-05T09:57:27.425 INFO:tasks.workunit.client.0.smithi100.stdout:5/389: sync 2023-12-05T09:57:27.426 INFO:tasks.workunit.client.0.smithi100.stdout:6/697: sync 2023-12-05T09:57:27.434 INFO:tasks.workunit.client.0.smithi100.stdout:0/335: rmdir da/d22 39 2023-12-05T09:57:27.438 INFO:tasks.workunit.client.1.smithi150.stdout:3/326: dread d6/d9/d3d/d52/d5b/f68 [4194304,4194304] 0 2023-12-05T09:57:27.439 INFO:tasks.workunit.client.0.smithi100.stdout:2/468: symlink d7/da/d18/d1b/d2c/d3f/d72/l9e 0 2023-12-05T09:57:27.439 INFO:tasks.workunit.client.0.smithi100.stdout:2/469: truncate d7/da/dc/d88/f91 922024 0 2023-12-05T09:57:27.442 INFO:tasks.workunit.client.0.smithi100.stdout:6/698: dread d7/d11/d82/fd4 [0,4194304] 0 2023-12-05T09:57:27.444 INFO:tasks.workunit.client.0.smithi100.stdout:5/390: mknod d0/d1f/c88 0 2023-12-05T09:57:27.445 INFO:tasks.workunit.client.0.smithi100.stdout:1/335: dwrite db/d31/d4f/f57 [0,4194304] 0 2023-12-05T09:57:27.446 INFO:tasks.workunit.client.0.smithi100.stdout:1/336: readlink db/d12/d1e/l2f 0 2023-12-05T09:57:27.446 INFO:tasks.workunit.client.0.smithi100.stdout:1/337: chown c7 63550 1 2023-12-05T09:57:27.449 INFO:tasks.workunit.client.1.smithi150.stdout:0/361: mkdir d5/d11/d16/d3f/d46/d80 0 2023-12-05T09:57:27.456 INFO:tasks.workunit.client.0.smithi100.stdout:2/470: dread d7/da/dc/f56 [0,4194304] 0 2023-12-05T09:57:27.456 INFO:tasks.workunit.client.0.smithi100.stdout:5/391: unlink d0/f59 0 2023-12-05T09:57:27.458 INFO:tasks.workunit.client.1.smithi150.stdout:8/313: truncate d0/d8/f2c 2793735 0 2023-12-05T09:57:27.460 INFO:tasks.workunit.client.1.smithi150.stdout:3/327: dread d6/d9/f50 [0,4194304] 0 2023-12-05T09:57:27.460 INFO:tasks.workunit.client.1.smithi150.stdout:1/346: dwrite d6/d8/db/de/f39 [0,4194304] 0 2023-12-05T09:57:27.470 INFO:tasks.workunit.client.1.smithi150.stdout:7/320: getdents d2/db/d30/d18/d1a/d1e 0 2023-12-05T09:57:27.472 INFO:tasks.workunit.client.0.smithi100.stdout:0/336: write da/d2a/d45/f49 [3503351,55821] 0 2023-12-05T09:57:27.472 INFO:tasks.workunit.client.0.smithi100.stdout:0/337: creat da/d1b/f66 x:0 0 0 2023-12-05T09:57:27.472 INFO:tasks.workunit.client.0.smithi100.stdout:1/338: mkdir db/d12/d61/d66/d67 0 2023-12-05T09:57:27.472 INFO:tasks.workunit.client.0.smithi100.stdout:0/338: fsync da/d2a/d45/f49 0 2023-12-05T09:57:27.473 INFO:tasks.workunit.client.1.smithi150.stdout:6/283: rename d2/d23/d2e/d59 to d2/d23/d60 0 2023-12-05T09:57:27.473 INFO:tasks.workunit.client.1.smithi150.stdout:6/284: chown d2/da/f4b 7 1 2023-12-05T09:57:27.474 INFO:tasks.workunit.client.0.smithi100.stdout:6/699: mkdir d7/d11/de8 0 2023-12-05T09:57:27.474 INFO:tasks.workunit.client.0.smithi100.stdout:6/700: dread - d7/d27/d97/fc2 zero size 2023-12-05T09:57:27.474 INFO:tasks.workunit.client.0.smithi100.stdout:7/286: dwrite d3/dc/d11/d13/f30 [0,4194304] 0 2023-12-05T09:57:27.478 INFO:tasks.workunit.client.1.smithi150.stdout:9/288: rmdir d3/d42 39 2023-12-05T09:57:27.478 INFO:tasks.workunit.client.1.smithi150.stdout:9/289: creat d3/d1b/f59 x:0 0 0 2023-12-05T09:57:27.479 INFO:tasks.workunit.client.0.smithi100.stdout:2/471: link d7/da/d13/d4e/c5a d7/da/d18/d21/c9f 0 2023-12-05T09:57:27.479 INFO:tasks.workunit.client.0.smithi100.stdout:2/472: chown d7/da/d18/d1b/d2c/d3f 10587 1 2023-12-05T09:57:27.479 INFO:tasks.workunit.client.0.smithi100.stdout:2/473: read d7/da/d18/d1b/f6c [131525,50362] 0 2023-12-05T09:57:27.481 INFO:tasks.workunit.client.0.smithi100.stdout:1/339: dread db/d31/f36 [0,4194304] 0 2023-12-05T09:57:27.482 INFO:tasks.workunit.client.0.smithi100.stdout:1/340: write db/d12/d1e/d26/f43 [679230,108829] 0 2023-12-05T09:57:27.482 INFO:tasks.workunit.client.0.smithi100.stdout:1/341: fsync db/d12/d1e/f38 0 2023-12-05T09:57:27.482 INFO:tasks.workunit.client.1.smithi150.stdout:4/269: link d0/f26 d0/d3e/d48/f4e 0 2023-12-05T09:57:27.484 INFO:tasks.workunit.client.0.smithi100.stdout:5/392: link d0/d1f/f21 d0/d4/d14/d35/f89 0 2023-12-05T09:57:27.484 INFO:tasks.workunit.client.0.smithi100.stdout:5/393: chown d0/d1b/f66 0 1 2023-12-05T09:57:27.497 INFO:tasks.workunit.client.0.smithi100.stdout:0/339: dread da/d1b/f52 [0,4194304] 0 2023-12-05T09:57:27.500 INFO:tasks.workunit.client.1.smithi150.stdout:3/328: mknod d6/d25/d28/c6a 0 2023-12-05T09:57:27.505 INFO:tasks.workunit.client.1.smithi150.stdout:0/362: dwrite d5/f41 [0,4194304] 0 2023-12-05T09:57:27.505 INFO:tasks.workunit.client.1.smithi150.stdout:0/363: truncate d5/fc 510463 0 2023-12-05T09:57:27.505 INFO:tasks.workunit.client.1.smithi150.stdout:0/364: write d5/d11/d16/d3f/d3b/f6c [61551,49416] 0 2023-12-05T09:57:27.506 INFO:tasks.workunit.client.1.smithi150.stdout:0/365: chown d5/d11/d16/l4d 0 1 2023-12-05T09:57:27.506 INFO:tasks.workunit.client.1.smithi150.stdout:7/321: link d2/d1b/d31/l3b d2/db/d17/l5e 0 2023-12-05T09:57:27.506 INFO:tasks.workunit.client.1.smithi150.stdout:7/322: creat d2/db/d30/d18/f5f x:0 0 0 2023-12-05T09:57:27.509 INFO:tasks.workunit.client.0.smithi100.stdout:7/287: symlink d3/l61 0 2023-12-05T09:57:27.510 INFO:tasks.workunit.client.0.smithi100.stdout:2/474: creat d7/da/d18/d21/d4d/fa0 x:0 0 0 2023-12-05T09:57:27.511 INFO:tasks.workunit.client.1.smithi150.stdout:6/285: mknod d2/d23/d60/c61 0 2023-12-05T09:57:27.513 INFO:tasks.workunit.client.1.smithi150.stdout:5/311: sync 2023-12-05T09:57:27.513 INFO:tasks.workunit.client.1.smithi150.stdout:5/312: creat d1/d3/d38/d65/d3b/d37/f70 x:0 0 0 2023-12-05T09:57:27.513 INFO:tasks.workunit.client.1.smithi150.stdout:5/313: fsync d1/d3/d38/f4f 0 2023-12-05T09:57:27.514 INFO:tasks.workunit.client.0.smithi100.stdout:1/342: getdents db/d12/d61/d66 0 2023-12-05T09:57:27.514 INFO:tasks.workunit.client.0.smithi100.stdout:1/343: fdatasync db/d12/d1e/f38 0 2023-12-05T09:57:27.519 INFO:tasks.workunit.client.0.smithi100.stdout:0/340: link da/d1b/d36/f4f da/d22/d33/d35/d3a/f67 0 2023-12-05T09:57:27.526 INFO:tasks.workunit.client.1.smithi150.stdout:9/290: mknod d3/d9/d26/d34/d3a/c5a 0 2023-12-05T09:57:27.527 INFO:tasks.workunit.client.1.smithi150.stdout:9/291: read d3/d9/f17 [1844713,97297] 0 2023-12-05T09:57:27.527 INFO:tasks.workunit.client.1.smithi150.stdout:9/292: write d3/d9/f20 [128954,28333] 0 2023-12-05T09:57:27.528 INFO:tasks.workunit.client.1.smithi150.stdout:4/270: dwrite d0/d11/f39 [0,4194304] 0 2023-12-05T09:57:27.533 INFO:tasks.workunit.client.1.smithi150.stdout:8/314: getdents d0/d41 0 2023-12-05T09:57:27.534 INFO:tasks.workunit.client.1.smithi150.stdout:8/315: chown d0/d41/d49/f1a 12 1 2023-12-05T09:57:27.535 INFO:tasks.workunit.client.0.smithi100.stdout:7/288: rename d3/dc/d11/d13/f15 to d3/dc/d11/d33/f62 0 2023-12-05T09:57:27.537 INFO:tasks.workunit.client.0.smithi100.stdout:2/475: mknod d7/da/d13/d69/ca1 0 2023-12-05T09:57:27.537 INFO:tasks.workunit.client.0.smithi100.stdout:2/476: fdatasync d7/da/d18/d1b/f28 0 2023-12-05T09:57:27.538 INFO:tasks.workunit.client.1.smithi150.stdout:1/347: getdents d6/d8/db 0 2023-12-05T09:57:27.538 INFO:tasks.workunit.client.1.smithi150.stdout:1/348: read - d6/d38/f41 zero size 2023-12-05T09:57:27.538 INFO:tasks.workunit.client.1.smithi150.stdout:1/349: stat d6/d8/db/f30 0 2023-12-05T09:57:27.540 INFO:tasks.workunit.client.1.smithi150.stdout:0/366: mknod d5/d11/d71/d5f/d6a/c81 0 2023-12-05T09:57:27.548 INFO:tasks.workunit.client.1.smithi150.stdout:2/309: rename d0/d3/d27/d51/c58 to d0/d3/d5/d13/d15/d30/d54/c6f 0 2023-12-05T09:57:27.548 INFO:tasks.workunit.client.1.smithi150.stdout:2/310: read - d0/d3/d5/d3b/d4c/f64 zero size 2023-12-05T09:57:27.548 INFO:tasks.workunit.client.1.smithi150.stdout:6/286: mknod d2/d23/d2e/d44/c62 0 2023-12-05T09:57:27.548 INFO:tasks.workunit.client.1.smithi150.stdout:2/311: creat d0/d3/f70 x:0 0 0 2023-12-05T09:57:27.552 INFO:tasks.workunit.client.0.smithi100.stdout:6/701: dwrite d7/d27/d35/d5a/f65 [0,4194304] 0 2023-12-05T09:57:27.554 INFO:tasks.workunit.client.0.smithi100.stdout:5/394: dwrite d0/d1b/d4d/d6c/f7d [0,4194304] 0 2023-12-05T09:57:27.558 INFO:tasks.workunit.client.1.smithi150.stdout:5/314: mknod d1/d3/d38/d65/d3b/d6b/c71 0 2023-12-05T09:57:27.558 INFO:tasks.workunit.client.1.smithi150.stdout:9/293: creat d3/d9/d26/d34/f5b x:0 0 0 2023-12-05T09:57:27.564 INFO:tasks.workunit.client.1.smithi150.stdout:4/271: link d0/d3e/c40 d0/d11/d4b/c4f 0 2023-12-05T09:57:27.566 INFO:tasks.workunit.client.1.smithi150.stdout:9/294: dread d3/d9/d26/f3f [0,4194304] 0 2023-12-05T09:57:27.568 INFO:tasks.workunit.client.1.smithi150.stdout:8/316: creat d0/d41/d49/d1b/d24/d38/d62/f65 x:0 0 0 2023-12-05T09:57:27.568 INFO:tasks.workunit.client.1.smithi150.stdout:8/317: fdatasync d0/d8/f11 0 2023-12-05T09:57:27.576 INFO:tasks.workunit.client.0.smithi100.stdout:5/395: creat d0/d1f/d53/f8a x:0 0 0 2023-12-05T09:57:27.576 INFO:tasks.workunit.client.0.smithi100.stdout:5/396: readlink d0/d1f/d25/d31/l52 0 2023-12-05T09:57:27.577 INFO:tasks.workunit.client.0.smithi100.stdout:7/289: dread d3/dc/d11/f59 [0,4194304] 0 2023-12-05T09:57:27.577 INFO:tasks.workunit.client.0.smithi100.stdout:7/290: stat d3/dc/d11/d13/d1b/l36 0 2023-12-05T09:57:27.578 INFO:tasks.workunit.client.1.smithi150.stdout:1/350: creat d6/d8/db/d1b/d79/f7a x:0 0 0 2023-12-05T09:57:27.579 INFO:tasks.workunit.client.1.smithi150.stdout:0/367: mkdir d5/d11/d65/d82 0 2023-12-05T09:57:27.579 INFO:tasks.workunit.client.1.smithi150.stdout:2/312: write d0/f7 [3264735,45839] 0 2023-12-05T09:57:27.581 INFO:tasks.workunit.client.1.smithi150.stdout:7/323: rename d2/db/d30/d13/f44 to d2/d39/f60 0 2023-12-05T09:57:27.586 INFO:tasks.workunit.client.1.smithi150.stdout:6/287: rmdir d2/d23/d2e/d44 39 2023-12-05T09:57:27.587 INFO:tasks.workunit.client.1.smithi150.stdout:3/329: dwrite d6/d22/d37/d63/f4d [0,4194304] 0 2023-12-05T09:57:27.587 INFO:tasks.workunit.client.1.smithi150.stdout:3/330: fsync d6/d25/d28/f2e 0 2023-12-05T09:57:27.588 INFO:tasks.workunit.client.0.smithi100.stdout:7/291: getdents d3/dc/d11/d13/de/d2d 0 2023-12-05T09:57:27.588 INFO:tasks.workunit.client.0.smithi100.stdout:7/292: write d3/dc/f1d [2256256,70945] 0 2023-12-05T09:57:27.589 INFO:tasks.workunit.client.0.smithi100.stdout:7/293: fdatasync d3/dc/d11/d13/de/f22 0 2023-12-05T09:57:27.590 INFO:tasks.workunit.client.1.smithi150.stdout:4/272: creat d0/d11/d4b/f50 x:0 0 0 2023-12-05T09:57:27.591 INFO:tasks.workunit.client.0.smithi100.stdout:7/294: rmdir d3/dc/d11/d13/de/d2d/d47 39 2023-12-05T09:57:27.592 INFO:tasks.workunit.client.1.smithi150.stdout:0/368: mknod d5/d11/d32/c83 0 2023-12-05T09:57:27.593 INFO:tasks.workunit.client.0.smithi100.stdout:7/295: mknod d3/dc/d11/d13/de/d18/d3b/d40/d4c/c63 0 2023-12-05T09:57:27.593 INFO:tasks.workunit.client.0.smithi100.stdout:7/296: chown d3/dc/d11/d13/de/d18/c2f 64344 1 2023-12-05T09:57:27.599 INFO:tasks.workunit.client.1.smithi150.stdout:7/324: symlink d2/db/d30/d13/d4f/d5a/d5c/l61 0 2023-12-05T09:57:27.601 INFO:tasks.workunit.client.0.smithi100.stdout:7/297: mknod d3/dc/d11/d13/d1b/d60/c64 0 2023-12-05T09:57:27.601 INFO:tasks.workunit.client.0.smithi100.stdout:7/298: truncate d3/dc/d11/d13/de/d18/d3b/d40/d46/f5c 4457254 0 2023-12-05T09:57:27.602 INFO:tasks.workunit.client.1.smithi150.stdout:3/331: creat d6/d9/d3d/d56/d53/d51/f6b x:0 0 0 2023-12-05T09:57:27.602 INFO:tasks.workunit.client.1.smithi150.stdout:3/332: chown d6/d25/d28/f2d 29939547 1 2023-12-05T09:57:27.603 INFO:tasks.workunit.client.1.smithi150.stdout:0/369: mknod d5/d11/d71/d74/c84 0 2023-12-05T09:57:27.603 INFO:tasks.workunit.client.1.smithi150.stdout:0/370: fdatasync d5/fa 0 2023-12-05T09:57:27.603 INFO:tasks.workunit.client.1.smithi150.stdout:4/273: truncate d0/d11/f2e 3472183 0 2023-12-05T09:57:27.606 INFO:tasks.workunit.client.1.smithi150.stdout:7/325: mkdir d2/db/d62 0 2023-12-05T09:57:27.613 INFO:tasks.workunit.client.0.smithi100.stdout:1/344: dwrite db/d31/d4f/f57 [0,4194304] 0 2023-12-05T09:57:27.614 INFO:tasks.workunit.client.1.smithi150.stdout:3/333: creat d6/f6c x:0 0 0 2023-12-05T09:57:27.614 INFO:tasks.workunit.client.1.smithi150.stdout:3/334: fsync d6/d25/d28/f2d 0 2023-12-05T09:57:27.619 INFO:tasks.workunit.client.0.smithi100.stdout:0/341: dwrite da/fd [0,4194304] 0 2023-12-05T09:57:27.621 INFO:tasks.workunit.client.1.smithi150.stdout:7/326: mkdir d2/db/d30/d18/d63 0 2023-12-05T09:57:27.626 INFO:tasks.workunit.client.1.smithi150.stdout:0/371: dread d5/fa [0,4194304] 0 2023-12-05T09:57:27.627 INFO:tasks.workunit.client.1.smithi150.stdout:0/372: chown d5/d11/d65 12257963 1 2023-12-05T09:57:27.630 INFO:tasks.workunit.client.1.smithi150.stdout:1/351: dwrite d6/d8/db/de/f32 [0,4194304] 0 2023-12-05T09:57:27.631 INFO:tasks.workunit.client.0.smithi100.stdout:7/299: dread d3/dc/f12 [0,4194304] 0 2023-12-05T09:57:27.635 INFO:tasks.workunit.client.0.smithi100.stdout:5/397: truncate d0/d1b/d4d/d6c/f7d 3223274 0 2023-12-05T09:57:27.637 INFO:tasks.workunit.client.0.smithi100.stdout:2/477: dwrite d7/da/d18/d21/f44 [0,4194304] 0 2023-12-05T09:57:27.638 INFO:tasks.workunit.client.1.smithi150.stdout:3/335: dread d6/d9/f1c [0,4194304] 0 2023-12-05T09:57:27.638 INFO:tasks.workunit.client.1.smithi150.stdout:3/336: fsync d6/d9/d3d/d56/d30/f5f 0 2023-12-05T09:57:27.638 INFO:tasks.workunit.client.1.smithi150.stdout:4/274: getdents d0/d42/d44 0 2023-12-05T09:57:27.639 INFO:tasks.workunit.client.1.smithi150.stdout:2/313: dwrite d0/d3/d5/f40 [0,4194304] 0 2023-12-05T09:57:27.640 INFO:tasks.workunit.client.0.smithi100.stdout:1/345: truncate db/d12/f1d 7022207 0 2023-12-05T09:57:27.640 INFO:tasks.workunit.client.0.smithi100.stdout:1/346: fsync db/f35 0 2023-12-05T09:57:27.641 INFO:tasks.workunit.client.1.smithi150.stdout:7/327: creat d2/d39/f64 x:0 0 0 2023-12-05T09:57:27.641 INFO:tasks.workunit.client.1.smithi150.stdout:7/328: chown d2/db/d30/d18/d1a 760106 1 2023-12-05T09:57:27.642 INFO:tasks.workunit.client.1.smithi150.stdout:7/329: write d2/d4/f27 [22048,114211] 0 2023-12-05T09:57:27.642 INFO:tasks.workunit.client.1.smithi150.stdout:7/330: write d2/db/d30/d13/d4f/d5a/d5c/f43 [611892,120959] 0 2023-12-05T09:57:27.642 INFO:tasks.workunit.client.0.smithi100.stdout:0/342: symlink da/d2a/d45/l68 0 2023-12-05T09:57:27.642 INFO:tasks.workunit.client.0.smithi100.stdout:0/343: chown da/d22/l31 58 1 2023-12-05T09:57:27.648 INFO:tasks.workunit.client.1.smithi150.stdout:1/352: symlink d6/d8/d59/l7b 0 2023-12-05T09:57:27.648 INFO:tasks.workunit.client.1.smithi150.stdout:5/315: dwrite d1/f55 [0,4194304] 0 2023-12-05T09:57:27.650 INFO:tasks.workunit.client.0.smithi100.stdout:7/300: dread d3/dc/d11/d33/f62 [0,4194304] 0 2023-12-05T09:57:27.650 INFO:tasks.workunit.client.1.smithi150.stdout:8/318: dwrite d0/ff [0,4194304] 0 2023-12-05T09:57:27.652 INFO:tasks.workunit.client.1.smithi150.stdout:3/337: symlink d6/d9/d43/l6d 0 2023-12-05T09:57:27.652 INFO:tasks.workunit.client.1.smithi150.stdout:3/338: fdatasync d6/d25/d28/f3a 0 2023-12-05T09:57:27.652 INFO:tasks.workunit.client.1.smithi150.stdout:3/339: readlink d6/d9/d43/d47/l45 0 2023-12-05T09:57:27.657 INFO:tasks.workunit.client.0.smithi100.stdout:1/347: rmdir db/d12/d1e/d26/d30 39 2023-12-05T09:57:27.663 INFO:tasks.workunit.client.0.smithi100.stdout:7/301: mknod d3/dc/d11/d13/de/d18/d3b/d40/d4c/c65 0 2023-12-05T09:57:27.663 INFO:tasks.workunit.client.0.smithi100.stdout:1/348: creat db/d12/d1e/d26/f68 x:0 0 0 2023-12-05T09:57:27.663 INFO:tasks.workunit.client.0.smithi100.stdout:1/349: stat db/d12/f16 0 2023-12-05T09:57:27.664 INFO:tasks.workunit.client.1.smithi150.stdout:8/319: dread d0/d41/d49/d1b/f2f [4194304,4194304] 0 2023-12-05T09:57:27.664 INFO:tasks.workunit.client.1.smithi150.stdout:4/275: read - d0/f3a zero size 2023-12-05T09:57:27.664 INFO:tasks.workunit.client.1.smithi150.stdout:2/314: mkdir d0/d3/d5/d3b/d4c/d71 0 2023-12-05T09:57:27.664 INFO:tasks.workunit.client.1.smithi150.stdout:7/331: symlink d2/d39/l65 0 2023-12-05T09:57:27.665 INFO:tasks.workunit.client.0.smithi100.stdout:0/344: dread da/d1b/d36/f4f [0,4194304] 0 2023-12-05T09:57:27.665 INFO:tasks.workunit.client.0.smithi100.stdout:0/345: chown da/f5a 44383 1 2023-12-05T09:57:27.665 INFO:tasks.workunit.client.0.smithi100.stdout:7/302: mknod d3/dc/d11/d13/de/c66 0 2023-12-05T09:57:27.667 INFO:tasks.workunit.client.0.smithi100.stdout:7/303: creat d3/f67 x:0 0 0 2023-12-05T09:57:27.667 INFO:tasks.workunit.client.0.smithi100.stdout:4/294: sync 2023-12-05T09:57:27.667 INFO:tasks.workunit.client.0.smithi100.stdout:9/393: sync 2023-12-05T09:57:27.667 INFO:tasks.workunit.client.0.smithi100.stdout:8/263: sync 2023-12-05T09:57:27.667 INFO:tasks.workunit.client.0.smithi100.stdout:9/394: write d7/f4d [913504,79720] 0 2023-12-05T09:57:27.667 INFO:tasks.workunit.client.0.smithi100.stdout:8/264: write d0/f37 [814274,52080] 0 2023-12-05T09:57:27.667 INFO:tasks.workunit.client.0.smithi100.stdout:8/265: creat d0/f3c x:0 0 0 2023-12-05T09:57:27.667 INFO:tasks.workunit.client.0.smithi100.stdout:3/408: sync 2023-12-05T09:57:27.668 INFO:tasks.workunit.client.1.smithi150.stdout:5/316: mkdir d1/d3/d6/d72 0 2023-12-05T09:57:27.669 INFO:tasks.workunit.client.1.smithi150.stdout:5/317: fsync d1/d3/d6/d1b/d22/f32 0 2023-12-05T09:57:27.669 INFO:tasks.workunit.client.1.smithi150.stdout:3/340: getdents d6/d9/d3d/d56 0 2023-12-05T09:57:27.671 INFO:tasks.workunit.client.0.smithi100.stdout:1/350: symlink db/d12/d61/l69 0 2023-12-05T09:57:27.671 INFO:tasks.workunit.client.1.smithi150.stdout:8/320: write d0/d41/d49/f1a [2137584,66154] 0 2023-12-05T09:57:27.672 INFO:tasks.workunit.client.0.smithi100.stdout:0/346: rename da/d1b/d36/l51 to da/d22/l69 0 2023-12-05T09:57:27.673 INFO:tasks.workunit.client.1.smithi150.stdout:5/318: mknod d1/d3/d6/d1b/d22/d24/c73 0 2023-12-05T09:57:27.675 INFO:tasks.workunit.client.1.smithi150.stdout:3/341: mknod d6/d25/d28/d67/c6e 0 2023-12-05T09:57:27.675 INFO:tasks.workunit.client.1.smithi150.stdout:3/342: creat d6/d9/d3d/d52/f6f x:0 0 0 2023-12-05T09:57:27.675 INFO:tasks.workunit.client.1.smithi150.stdout:3/343: chown d6/d9/d3d/d56/d53 23 1 2023-12-05T09:57:27.675 INFO:tasks.workunit.client.0.smithi100.stdout:4/295: truncate de/f1b 3907871 0 2023-12-05T09:57:27.676 INFO:tasks.workunit.client.0.smithi100.stdout:4/296: stat de/d16/d23/d33/d3d/f3f 0 2023-12-05T09:57:27.678 INFO:tasks.workunit.client.1.smithi150.stdout:8/321: truncate d0/d41/d49/d1b/d24/d2e/d30/f36 4108234 0 2023-12-05T09:57:27.681 INFO:tasks.workunit.client.0.smithi100.stdout:9/395: mknod d7/d35/c80 0 2023-12-05T09:57:27.684 INFO:tasks.workunit.client.1.smithi150.stdout:5/319: rename d1/d3/d38/d65/f35 to d1/f74 0 2023-12-05T09:57:27.688 INFO:tasks.workunit.client.0.smithi100.stdout:5/398: dread d0/d1b/d4d/d6c/f7d [0,4194304] 0 2023-12-05T09:57:27.688 INFO:tasks.workunit.client.0.smithi100.stdout:5/399: chown d0/d1f/d25/d31/l52 143 1 2023-12-05T09:57:27.688 INFO:tasks.workunit.client.0.smithi100.stdout:8/266: truncate d0/d12/d13/d16/f2e 3392976 0 2023-12-05T09:57:27.688 INFO:tasks.workunit.client.0.smithi100.stdout:8/267: write d0/d12/d13/d16/f3a [1398254,129834] 0 2023-12-05T09:57:27.689 INFO:tasks.workunit.client.0.smithi100.stdout:8/268: fdatasync d0/f9 0 2023-12-05T09:57:27.689 INFO:tasks.workunit.client.0.smithi100.stdout:8/269: fdatasync d0/d12/d13/f2f 0 2023-12-05T09:57:27.691 INFO:tasks.workunit.client.1.smithi150.stdout:3/344: truncate d6/d9/f1c 761216 0 2023-12-05T09:57:27.693 INFO:tasks.workunit.client.0.smithi100.stdout:1/351: link c7 db/d12/d61/d66/c6a 0 2023-12-05T09:57:27.696 INFO:tasks.workunit.client.0.smithi100.stdout:0/347: creat da/d22/d33/f6a x:0 0 0 2023-12-05T09:57:27.696 INFO:tasks.workunit.client.1.smithi150.stdout:7/332: write d2/db/f45 [713600,28996] 0 2023-12-05T09:57:27.696 INFO:tasks.workunit.client.0.smithi100.stdout:4/297: mkdir de/d38/d5d 0 2023-12-05T09:57:27.697 INFO:tasks.workunit.client.0.smithi100.stdout:9/396: symlink d7/d1b/d22/d2a/d74/l81 0 2023-12-05T09:57:27.705 INFO:tasks.workunit.client.1.smithi150.stdout:8/322: dread d0/f13 [0,4194304] 0 2023-12-05T09:57:27.710 INFO:tasks.workunit.client.1.smithi150.stdout:7/333: dread d2/db/d30/d18/d1a/f3c [0,4194304] 0 2023-12-05T09:57:27.717 INFO:tasks.workunit.client.0.smithi100.stdout:1/352: creat db/d12/d61/d66/d67/f6b x:0 0 0 2023-12-05T09:57:27.720 INFO:tasks.workunit.client.0.smithi100.stdout:7/304: write d3/dc/d11/f32 [2887515,118823] 0 2023-12-05T09:57:27.720 INFO:tasks.workunit.client.0.smithi100.stdout:7/305: stat d3/dc/cf 0 2023-12-05T09:57:27.720 INFO:tasks.workunit.client.0.smithi100.stdout:7/306: fsync d3/dc/d11/d13/de/f2b 0 2023-12-05T09:57:27.720 INFO:tasks.workunit.client.0.smithi100.stdout:7/307: chown d3/dc/d11/d13/de/d18/d3b/d40/l55 1786902 1 2023-12-05T09:57:27.724 INFO:tasks.workunit.client.1.smithi150.stdout:3/345: write d6/d25/d28/f2e [7900002,82638] 0 2023-12-05T09:57:27.724 INFO:tasks.workunit.client.1.smithi150.stdout:3/346: chown d6/d9/d43/c64 4 1 2023-12-05T09:57:27.727 INFO:tasks.workunit.client.0.smithi100.stdout:3/409: dread d0/d3d/d5c/d5f/d67/f69 [0,4194304] 0 2023-12-05T09:57:27.727 INFO:tasks.workunit.client.0.smithi100.stdout:3/410: chown d0/d2/f23 0 1 2023-12-05T09:57:27.727 INFO:tasks.workunit.client.0.smithi100.stdout:3/411: write d0/d2/d33/f78 [430105,10099] 0 2023-12-05T09:57:27.728 INFO:tasks.workunit.client.1.smithi150.stdout:1/353: dwrite d6/d3c/f40 [0,4194304] 0 2023-12-05T09:57:27.728 INFO:tasks.workunit.client.1.smithi150.stdout:1/354: truncate d6/d8/db/f6e 651064 0 2023-12-05T09:57:27.739 INFO:tasks.workunit.client.1.smithi150.stdout:8/323: link d0/d41/d49/d1b/d24/d34/c58 d0/d41/d49/d1b/d24/d2e/d30/c66 0 2023-12-05T09:57:27.742 INFO:tasks.workunit.client.0.smithi100.stdout:5/400: getdents d0/d4/d14 0 2023-12-05T09:57:27.746 INFO:tasks.workunit.client.1.smithi150.stdout:7/334: unlink d2/db/d17/d20/l2f 0 2023-12-05T09:57:27.751 INFO:tasks.workunit.client.1.smithi150.stdout:4/276: dwrite d0/d11/f34 [0,4194304] 0 2023-12-05T09:57:27.752 INFO:tasks.workunit.client.0.smithi100.stdout:4/298: write de/d16/d23/f26 [531147,69843] 0 2023-12-05T09:57:27.754 INFO:tasks.workunit.client.1.smithi150.stdout:2/315: dwrite d0/d3/d21/f2c [0,4194304] 0 2023-12-05T09:57:27.754 INFO:tasks.workunit.client.1.smithi150.stdout:3/347: creat d6/d25/f70 x:0 0 0 2023-12-05T09:57:27.756 INFO:tasks.workunit.client.0.smithi100.stdout:2/478: dwrite d7/da/d18/d21/d4d/d81/f8f [0,4194304] 0 2023-12-05T09:57:27.757 INFO:tasks.workunit.client.0.smithi100.stdout:8/270: dread d0/d12/d13/d16/f3a [0,4194304] 0 2023-12-05T09:57:27.762 INFO:tasks.workunit.client.0.smithi100.stdout:7/308: rename d3/dc/d11/d13/de/f22 to d3/dc/d11/d13/de/d18/d3b/d40/d46/f68 0 2023-12-05T09:57:27.762 INFO:tasks.workunit.client.1.smithi150.stdout:5/320: dwrite d1/d3/d6/d1b/f6a [0,4194304] 0 2023-12-05T09:57:27.762 INFO:tasks.workunit.client.1.smithi150.stdout:5/321: readlink d1/d3/l17 0 2023-12-05T09:57:27.763 INFO:tasks.workunit.client.0.smithi100.stdout:8/271: write d0/f2b [380325,84551] 0 2023-12-05T09:57:27.763 INFO:tasks.workunit.client.0.smithi100.stdout:8/272: dread - d0/d12/d13/d16/f27 zero size 2023-12-05T09:57:27.772 INFO:tasks.workunit.client.0.smithi100.stdout:3/412: unlink d0/d3d/d5c/d6f/d7f/c82 0 2023-12-05T09:57:27.773 INFO:tasks.workunit.client.0.smithi100.stdout:1/353: rmdir db/d12/d1e 39 2023-12-05T09:57:27.776 INFO:tasks.workunit.client.1.smithi150.stdout:1/355: mkdir d6/d47/d4c/d7c 0 2023-12-05T09:57:27.778 INFO:tasks.workunit.client.0.smithi100.stdout:4/299: creat de/d38/d5d/f5e x:0 0 0 2023-12-05T09:57:27.780 INFO:tasks.workunit.client.1.smithi150.stdout:8/324: rename d0/d8/d45 to d0/d41/d49/d1b/d24/d34/d56/d67 0 2023-12-05T09:57:27.780 INFO:tasks.workunit.client.1.smithi150.stdout:8/325: truncate d0/d41/d49/f59 1288717 0 2023-12-05T09:57:27.782 INFO:tasks.workunit.client.1.smithi150.stdout:8/326: dread - d0/d41/d49/d1b/d24/d2e/f53 zero size 2023-12-05T09:57:27.782 INFO:tasks.workunit.client.1.smithi150.stdout:8/327: truncate d0/d41/d49/f59 2055156 0 2023-12-05T09:57:27.782 INFO:tasks.workunit.client.1.smithi150.stdout:8/328: readlink d0/d41/d49/d1b/d24/d2e/d30/l3e 0 2023-12-05T09:57:27.782 INFO:tasks.workunit.client.1.smithi150.stdout:8/329: creat d0/d41/d49/d1b/d24/d38/d62/f68 x:0 0 0 2023-12-05T09:57:27.783 INFO:tasks.workunit.client.1.smithi150.stdout:1/356: dread d6/d38/d4a/f57 [0,4194304] 0 2023-12-05T09:57:27.784 INFO:tasks.workunit.client.0.smithi100.stdout:9/397: dwrite d7/fc [0,4194304] 0 2023-12-05T09:57:27.785 INFO:tasks.workunit.client.1.smithi150.stdout:7/335: link d2/db/d30/d18/d1a/d1e/d2b/f34 d2/db/d30/d13/f66 0 2023-12-05T09:57:27.785 INFO:tasks.workunit.client.1.smithi150.stdout:7/336: chown d2/db/d30/d18/d1a/f3c 14336682 1 2023-12-05T09:57:27.785 INFO:tasks.workunit.client.1.smithi150.stdout:7/337: readlink d2/db/d17/d20/l33 0 2023-12-05T09:57:27.785 INFO:tasks.workunit.client.1.smithi150.stdout:7/338: creat d2/d39/f67 x:0 0 0 2023-12-05T09:57:27.785 INFO:tasks.workunit.client.1.smithi150.stdout:7/339: write d2/d39/f60 [4318565,102689] 0 2023-12-05T09:57:27.787 INFO:tasks.workunit.client.0.smithi100.stdout:2/479: mkdir d7/da/d18/d21/d4d/d81/da2 0 2023-12-05T09:57:27.788 INFO:tasks.workunit.client.0.smithi100.stdout:7/309: mknod d3/dc/d11/d13/d1b/c69 0 2023-12-05T09:57:27.788 INFO:tasks.workunit.client.0.smithi100.stdout:8/273: rmdir d0/d12/d13/d16 39 2023-12-05T09:57:27.792 INFO:tasks.workunit.client.0.smithi100.stdout:1/354: unlink la 0 2023-12-05T09:57:27.793 INFO:tasks.workunit.client.0.smithi100.stdout:4/300: symlink de/d16/d23/d33/l5f 0 2023-12-05T09:57:27.797 INFO:tasks.workunit.client.1.smithi150.stdout:4/277: creat d0/f51 x:0 0 0 2023-12-05T09:57:27.798 INFO:tasks.workunit.client.0.smithi100.stdout:0/348: dwrite da/d22/d33/d35/d3a/f67 [0,4194304] 0 2023-12-05T09:57:27.798 INFO:tasks.workunit.client.0.smithi100.stdout:2/480: mkdir d7/da/d18/d21/da3 0 2023-12-05T09:57:27.798 INFO:tasks.workunit.client.0.smithi100.stdout:9/398: symlink d7/d1b/d22/l82 0 2023-12-05T09:57:27.803 INFO:tasks.workunit.client.0.smithi100.stdout:7/310: getdents d3/dc/d11 0 2023-12-05T09:57:27.804 INFO:tasks.workunit.client.1.smithi150.stdout:3/348: mkdir d6/d9/d3d/d56/d71 0 2023-12-05T09:57:27.804 INFO:tasks.workunit.client.1.smithi150.stdout:7/340: read d2/d39/f60 [103678,9149] 0 2023-12-05T09:57:27.804 INFO:tasks.workunit.client.1.smithi150.stdout:7/341: dread - d2/db/d30/d13/d4f/f59 zero size 2023-12-05T09:57:27.804 INFO:tasks.workunit.client.1.smithi150.stdout:7/342: creat d2/db/d30/d18/d1a/f68 x:0 0 0 2023-12-05T09:57:27.805 INFO:tasks.workunit.client.1.smithi150.stdout:7/343: write d2/db/d30/d18/f5f [313262,57405] 0 2023-12-05T09:57:27.805 INFO:tasks.workunit.client.1.smithi150.stdout:7/344: read d2/db/d30/d13/f14 [3437619,99022] 0 2023-12-05T09:57:27.805 INFO:tasks.workunit.client.1.smithi150.stdout:7/345: stat d2/db/d30 0 2023-12-05T09:57:27.806 INFO:tasks.workunit.client.0.smithi100.stdout:1/355: symlink db/d12/l6c 0 2023-12-05T09:57:27.810 INFO:tasks.workunit.client.1.smithi150.stdout:8/330: dread d0/d8/f1f [0,4194304] 0 2023-12-05T09:57:27.810 INFO:tasks.workunit.client.1.smithi150.stdout:8/331: fdatasync d0/d41/d49/f52 0 2023-12-05T09:57:27.813 INFO:tasks.workunit.client.1.smithi150.stdout:5/322: mknod d1/d3/d38/d65/d3b/d6b/c75 0 2023-12-05T09:57:27.814 INFO:tasks.workunit.client.0.smithi100.stdout:5/401: dwrite d0/d1f/f86 [0,4194304] 0 2023-12-05T09:57:27.814 INFO:tasks.workunit.client.0.smithi100.stdout:5/402: write d0/d1f/d53/f5a [106582,55912] 0 2023-12-05T09:57:27.820 INFO:tasks.workunit.client.0.smithi100.stdout:1/356: dread db/d31/f60 [0,4194304] 0 2023-12-05T09:57:27.822 INFO:tasks.workunit.client.1.smithi150.stdout:2/316: rename d0/d3/d11/d1d/l6e to d0/d3/d5/d22/d52/d56/l72 0 2023-12-05T09:57:27.829 INFO:tasks.workunit.client.1.smithi150.stdout:2/317: read d0/d3/d5/d22/f35 [4443530,10603] 0 2023-12-05T09:57:27.835 INFO:tasks.workunit.client.1.smithi150.stdout:9/295: sync 2023-12-05T09:57:27.837 INFO:tasks.workunit.client.1.smithi150.stdout:3/349: creat d6/d9/d43/f72 x:0 0 0 2023-12-05T09:57:27.839 INFO:tasks.workunit.client.0.smithi100.stdout:1/357: dread db/d12/d1e/d26/f62 [0,4194304] 0 2023-12-05T09:57:27.840 INFO:tasks.workunit.client.0.smithi100.stdout:1/358: creat db/d12/d61/d66/d67/f6d x:0 0 0 2023-12-05T09:57:27.842 INFO:tasks.workunit.client.1.smithi150.stdout:7/346: creat d2/d1b/d31/f69 x:0 0 0 2023-12-05T09:57:27.847 INFO:tasks.workunit.client.1.smithi150.stdout:9/296: dread d3/d9/d26/f3f [0,4194304] 0 2023-12-05T09:57:27.847 INFO:tasks.workunit.client.1.smithi150.stdout:8/332: symlink d0/d41/d49/d1b/d24/l69 0 2023-12-05T09:57:27.847 INFO:tasks.workunit.client.1.smithi150.stdout:6/288: sync 2023-12-05T09:57:27.848 INFO:tasks.workunit.client.1.smithi150.stdout:0/373: sync 2023-12-05T09:57:27.848 INFO:tasks.workunit.client.1.smithi150.stdout:5/323: symlink d1/d3/d6/d72/l76 0 2023-12-05T09:57:27.849 INFO:tasks.workunit.client.1.smithi150.stdout:1/357: rename d6/f3f to d6/d8/d59/f7d 0 2023-12-05T09:57:27.853 INFO:tasks.workunit.client.0.smithi100.stdout:4/301: mkdir de/d16/d23/d60 0 2023-12-05T09:57:27.855 INFO:tasks.workunit.client.0.smithi100.stdout:7/311: rmdir d3/dc 39 2023-12-05T09:57:27.855 INFO:tasks.workunit.client.0.smithi100.stdout:0/349: dread da/d22/f3b [4194304,4194304] 0 2023-12-05T09:57:27.858 INFO:tasks.workunit.client.1.smithi150.stdout:2/318: dread d0/d3/d11/d1d/f2f [0,4194304] 0 2023-12-05T09:57:27.862 INFO:tasks.workunit.client.0.smithi100.stdout:5/403: dread d0/d1f/d25/d31/f3e [0,4194304] 0 2023-12-05T09:57:27.863 INFO:tasks.workunit.client.0.smithi100.stdout:3/413: dwrite d0/d4/f4a [0,4194304] 0 2023-12-05T09:57:27.863 INFO:tasks.workunit.client.0.smithi100.stdout:3/414: read d0/d2/de/d12/f1a [5168402,85853] 0 2023-12-05T09:57:27.864 INFO:tasks.workunit.client.1.smithi150.stdout:3/350: unlink d6/d9/d43/d47/l48 0 2023-12-05T09:57:27.864 INFO:tasks.workunit.client.1.smithi150.stdout:3/351: truncate d6/d9/d3d/d52/d5b/f44 565846 0 2023-12-05T09:57:27.864 INFO:tasks.workunit.client.1.smithi150.stdout:7/347: mkdir d2/d1b/d5b/d6a 0 2023-12-05T09:57:27.864 INFO:tasks.workunit.client.1.smithi150.stdout:9/297: creat d3/d9/d26/d34/d3a/f5c x:0 0 0 2023-12-05T09:57:27.867 INFO:tasks.workunit.client.1.smithi150.stdout:8/333: rename d0/d41/d49/d1b/d24/d38/f3a to d0/d41/d49/d1b/d24/d38/f6a 0 2023-12-05T09:57:27.870 INFO:tasks.workunit.client.1.smithi150.stdout:0/374: link d5/d11/d16/d1f/l20 d5/d11/d71/d74/l85 0 2023-12-05T09:57:27.872 INFO:tasks.workunit.client.1.smithi150.stdout:1/358: creat d6/d3c/f7e x:0 0 0 2023-12-05T09:57:27.872 INFO:tasks.workunit.client.1.smithi150.stdout:4/278: dwrite d0/f24 [0,4194304] 0 2023-12-05T09:57:27.874 INFO:tasks.workunit.client.1.smithi150.stdout:2/319: creat d0/d3/d5/d22/d52/d56/f73 x:0 0 0 2023-12-05T09:57:27.880 INFO:tasks.workunit.client.0.smithi100.stdout:3/415: creat d0/d10/d39/f8b x:0 0 0 2023-12-05T09:57:27.880 INFO:tasks.workunit.client.0.smithi100.stdout:4/302: write f1 [2170413,47028] 0 2023-12-05T09:57:27.880 INFO:tasks.workunit.client.0.smithi100.stdout:4/303: chown de/f55 3664218 1 2023-12-05T09:57:27.880 INFO:tasks.workunit.client.0.smithi100.stdout:4/304: chown de/d16/l39 3836 1 2023-12-05T09:57:27.880 INFO:tasks.workunit.client.0.smithi100.stdout:4/305: chown de/d16/d23/d33/d3d 2360 1 2023-12-05T09:57:27.880 INFO:tasks.workunit.client.0.smithi100.stdout:2/481: dwrite d7/da/d13/f5d [4194304,4194304] 0 2023-12-05T09:57:27.882 INFO:tasks.workunit.client.1.smithi150.stdout:3/352: unlink d6/d22/c24 0 2023-12-05T09:57:27.882 INFO:tasks.workunit.client.1.smithi150.stdout:3/353: chown d6/d9 947346 1 2023-12-05T09:57:27.882 INFO:tasks.workunit.client.1.smithi150.stdout:3/354: stat d6/d9/f1d 0 2023-12-05T09:57:27.883 INFO:tasks.workunit.client.1.smithi150.stdout:3/355: stat d6/d9/d43/f72 0 2023-12-05T09:57:27.883 INFO:tasks.workunit.client.1.smithi150.stdout:3/356: write d6/d25/d28/f3a [285288,50171] 0 2023-12-05T09:57:27.883 INFO:tasks.workunit.client.1.smithi150.stdout:7/348: mknod d2/db/d30/d13/d4f/c6b 0 2023-12-05T09:57:27.885 INFO:tasks.workunit.client.1.smithi150.stdout:3/357: write d6/d9/d3d/d56/f3b [657739,48636] 0 2023-12-05T09:57:27.886 INFO:tasks.workunit.client.1.smithi150.stdout:7/349: read d2/db/d30/d18/d1a/f3c [66749,38104] 0 2023-12-05T09:57:27.886 INFO:tasks.workunit.client.0.smithi100.stdout:8/274: dwrite d0/d12/d13/f25 [0,4194304] 0 2023-12-05T09:57:27.887 INFO:tasks.workunit.client.0.smithi100.stdout:8/275: write d0/d12/f2a [2485194,61924] 0 2023-12-05T09:57:27.887 INFO:tasks.workunit.client.0.smithi100.stdout:1/359: write db/d12/d1e/f50 [752830,108758] 0 2023-12-05T09:57:27.887 INFO:tasks.workunit.client.0.smithi100.stdout:8/276: dread - d0/d35/f3b zero size 2023-12-05T09:57:27.887 INFO:tasks.workunit.client.0.smithi100.stdout:5/404: link d0/d1f/l24 d0/d1b/d4d/d6c/l8b 0 2023-12-05T09:57:27.887 INFO:tasks.workunit.client.0.smithi100.stdout:5/405: getdents d0/d4/d14/d35/d62 0 2023-12-05T09:57:27.887 INFO:tasks.workunit.client.0.smithi100.stdout:5/406: fdatasync d0/d16/f68 0 2023-12-05T09:57:27.889 INFO:tasks.workunit.client.0.smithi100.stdout:7/312: mknod d3/dc/d11/d13/de/d2d/d42/c6a 0 2023-12-05T09:57:27.889 INFO:tasks.workunit.client.0.smithi100.stdout:7/313: write d3/dc/d11/d33/f62 [4772357,77032] 0 2023-12-05T09:57:27.889 INFO:tasks.workunit.client.0.smithi100.stdout:7/314: write d3/dc/d11/d13/de/d18/d3b/d40/f41 [1191621,113142] 0 2023-12-05T09:57:27.890 INFO:tasks.workunit.client.1.smithi150.stdout:9/298: truncate d3/d9/f49 3054320 0 2023-12-05T09:57:27.891 INFO:tasks.workunit.client.0.smithi100.stdout:4/306: mknod de/d16/d23/d33/d3d/d44/d4e/c61 0 2023-12-05T09:57:27.891 INFO:tasks.workunit.client.0.smithi100.stdout:4/307: write de/d38/f42 [4901070,23661] 0 2023-12-05T09:57:27.891 INFO:tasks.workunit.client.1.smithi150.stdout:8/334: unlink d0/d41/d49/d1b/d24/d34/c42 0 2023-12-05T09:57:27.902 INFO:tasks.workunit.client.0.smithi100.stdout:2/482: read d7/da/d18/d21/d4d/d81/f80 [1564398,43400] 0 2023-12-05T09:57:27.903 INFO:tasks.workunit.client.0.smithi100.stdout:2/483: truncate d7/da/d1a/f73 580258 0 2023-12-05T09:57:27.903 INFO:tasks.workunit.client.1.smithi150.stdout:6/289: mkdir d2/da/d63 0 2023-12-05T09:57:27.903 INFO:tasks.workunit.client.0.smithi100.stdout:8/277: dread d0/f37 [0,4194304] 0 2023-12-05T09:57:27.908 INFO:tasks.workunit.client.1.smithi150.stdout:0/375: link d5/d11/d71/f30 d5/d11/d16/d3f/d46/d80/f86 0 2023-12-05T09:57:27.909 INFO:tasks.workunit.client.1.smithi150.stdout:4/279: creat d0/d3e/d48/f52 x:0 0 0 2023-12-05T09:57:27.910 INFO:tasks.workunit.client.1.smithi150.stdout:4/280: creat d0/d3e/d48/f53 x:0 0 0 2023-12-05T09:57:27.914 INFO:tasks.workunit.client.1.smithi150.stdout:2/320: link d0/d3/d27/l5b d0/d3/d5/l74 0 2023-12-05T09:57:27.915 INFO:tasks.workunit.client.0.smithi100.stdout:6/702: sync 2023-12-05T09:57:27.916 INFO:tasks.workunit.client.1.smithi150.stdout:2/321: read d0/d3/d5/d10/f45 [13187,112634] 0 2023-12-05T09:57:27.916 INFO:tasks.workunit.client.1.smithi150.stdout:3/358: creat d6/d9/d3d/d56/d71/f73 x:0 0 0 2023-12-05T09:57:27.918 INFO:tasks.workunit.client.1.smithi150.stdout:9/299: link d3/d9/dc/d1f/d24/l47 d3/d9/d58/l5d 0 2023-12-05T09:57:27.918 INFO:tasks.workunit.client.1.smithi150.stdout:9/300: chown d3/d9/dc/f4b 3304853 1 2023-12-05T09:57:27.918 INFO:tasks.workunit.client.1.smithi150.stdout:9/301: readlink d3/d9/dc/d1f/d24/l2a 0 2023-12-05T09:57:27.918 INFO:tasks.workunit.client.1.smithi150.stdout:9/302: readlink d3/d9/d58/l5d 0 2023-12-05T09:57:27.920 INFO:tasks.workunit.client.1.smithi150.stdout:8/335: getdents d0/d41/d49/d1b 0 2023-12-05T09:57:27.923 INFO:tasks.workunit.client.0.smithi100.stdout:5/407: truncate d0/d4/fa 5598257 0 2023-12-05T09:57:27.923 INFO:tasks.workunit.client.0.smithi100.stdout:5/408: chown d0/d16/d2b/f82 340 1 2023-12-05T09:57:27.923 INFO:tasks.workunit.client.0.smithi100.stdout:0/350: dwrite da/d2a/d45/f49 [0,4194304] 0 2023-12-05T09:57:27.929 INFO:tasks.workunit.client.0.smithi100.stdout:7/315: symlink d3/l6b 0 2023-12-05T09:57:27.933 INFO:tasks.workunit.client.1.smithi150.stdout:1/359: symlink d6/l7f 0 2023-12-05T09:57:27.935 INFO:tasks.workunit.client.1.smithi150.stdout:7/350: dwrite d2/db/d30/d18/d1a/f68 [0,4194304] 0 2023-12-05T09:57:27.935 INFO:tasks.workunit.client.1.smithi150.stdout:7/351: creat d2/db/d30/d18/f6c x:0 0 0 2023-12-05T09:57:27.935 INFO:tasks.workunit.client.1.smithi150.stdout:7/352: stat d2/d1b/d5b/c50 0 2023-12-05T09:57:27.935 INFO:tasks.workunit.client.0.smithi100.stdout:4/308: rename de/d16/d1e/f59 to de/d16/d1e/f62 0 2023-12-05T09:57:27.937 INFO:tasks.workunit.client.1.smithi150.stdout:0/376: mkdir d5/d11/d71/d5f/d77/d87 0 2023-12-05T09:57:27.942 INFO:tasks.workunit.client.0.smithi100.stdout:2/484: rmdir d7/da/d18/d21/d4d/d81/da2 0 2023-12-05T09:57:27.943 INFO:tasks.workunit.client.0.smithi100.stdout:2/485: creat d7/da/d18/d21/fa4 x:0 0 0 2023-12-05T09:57:27.943 INFO:tasks.workunit.client.0.smithi100.stdout:2/486: truncate d7/da/d1a/f73 824662 0 2023-12-05T09:57:27.943 INFO:tasks.workunit.client.0.smithi100.stdout:2/487: stat d7/da/dc/c8d 0 2023-12-05T09:57:27.944 INFO:tasks.workunit.client.1.smithi150.stdout:5/324: dwrite d1/d3/d38/d65/d3b/d37/f48 [0,4194304] 0 2023-12-05T09:57:27.948 INFO:tasks.workunit.client.0.smithi100.stdout:5/409: dread d0/d4/d14/f5b [0,4194304] 0 2023-12-05T09:57:27.951 INFO:tasks.workunit.client.0.smithi100.stdout:3/416: dwrite d0/d2/d33/f40 [0,4194304] 0 2023-12-05T09:57:27.952 INFO:tasks.workunit.client.0.smithi100.stdout:3/417: chown d0/d2/d33/l7d 119 1 2023-12-05T09:57:27.952 INFO:tasks.workunit.client.1.smithi150.stdout:1/360: dread f1 [0,4194304] 0 2023-12-05T09:57:27.955 INFO:tasks.workunit.client.0.smithi100.stdout:6/703: read d7/d11/d82/f74 [371906,68924] 0 2023-12-05T09:57:27.955 INFO:tasks.workunit.client.0.smithi100.stdout:6/704: chown d7/fc7 27 1 2023-12-05T09:57:27.956 INFO:tasks.workunit.client.0.smithi100.stdout:6/705: fdatasync d7/d27/d97/fbb 0 2023-12-05T09:57:27.958 INFO:tasks.workunit.client.1.smithi150.stdout:2/322: rmdir d0 39 2023-12-05T09:57:27.962 INFO:tasks.workunit.client.1.smithi150.stdout:3/359: mknod d6/d25/c74 0 2023-12-05T09:57:27.962 INFO:tasks.workunit.client.1.smithi150.stdout:3/360: chown d6/d25/d28/c59 48318 1 2023-12-05T09:57:27.966 INFO:tasks.workunit.client.0.smithi100.stdout:0/351: mkdir da/d1b/d6b 0 2023-12-05T09:57:27.967 INFO:tasks.workunit.client.0.smithi100.stdout:0/352: write da/d1b/f54 [493146,28677] 0 2023-12-05T09:57:27.967 INFO:tasks.workunit.client.0.smithi100.stdout:0/353: fdatasync da/f5a 0 2023-12-05T09:57:27.967 INFO:tasks.workunit.client.0.smithi100.stdout:0/354: chown da/d22/f23 153447978 1 2023-12-05T09:57:27.967 INFO:tasks.workunit.client.1.smithi150.stdout:1/361: dread d6/d8/db/de/f13 [4194304,4194304] 0 2023-12-05T09:57:27.969 INFO:tasks.workunit.client.0.smithi100.stdout:8/278: dwrite d0/d12/f2a [0,4194304] 0 2023-12-05T09:57:27.970 INFO:tasks.workunit.client.0.smithi100.stdout:8/279: write d0/d12/d13/d16/f3a [2058221,29901] 0 2023-12-05T09:57:27.973 INFO:tasks.workunit.client.0.smithi100.stdout:7/316: link d3/dc/d11/d13/de/f28 d3/dc/d11/d13/d1b/f6c 0 2023-12-05T09:57:27.974 INFO:tasks.workunit.client.1.smithi150.stdout:6/290: dwrite d2/f1c [4194304,4194304] 0 2023-12-05T09:57:27.980 INFO:tasks.workunit.client.0.smithi100.stdout:4/309: symlink de/d38/l63 0 2023-12-05T09:57:27.980 INFO:tasks.workunit.client.0.smithi100.stdout:4/310: write de/d16/d23/f58 [398116,11312] 0 2023-12-05T09:57:27.981 INFO:tasks.workunit.client.0.smithi100.stdout:4/311: fsync de/d16/f52 0 2023-12-05T09:57:27.981 INFO:tasks.workunit.client.0.smithi100.stdout:4/312: truncate de/d16/d23/d33/d3d/d44/d4e/f50 147832 0 2023-12-05T09:57:27.981 INFO:tasks.workunit.client.1.smithi150.stdout:2/323: dread d0/d3/d21/f39 [0,4194304] 0 2023-12-05T09:57:27.982 INFO:tasks.workunit.client.1.smithi150.stdout:3/361: write d6/d22/d37/d63/f4d [1503321,62480] 0 2023-12-05T09:57:27.986 INFO:tasks.workunit.client.0.smithi100.stdout:0/355: dread da/d1b/d36/f4f [0,4194304] 0 2023-12-05T09:57:27.987 INFO:tasks.workunit.client.1.smithi150.stdout:0/377: creat d5/d11/d65/d82/f88 x:0 0 0 2023-12-05T09:57:27.987 INFO:tasks.workunit.client.0.smithi100.stdout:5/410: symlink d0/l8c 0 2023-12-05T09:57:27.991 INFO:tasks.workunit.client.0.smithi100.stdout:0/356: write da/f5a [518778,80837] 0 2023-12-05T09:57:27.991 INFO:tasks.workunit.client.1.smithi150.stdout:8/336: dwrite d0/d8/f11 [0,4194304] 0 2023-12-05T09:57:27.991 INFO:tasks.workunit.client.1.smithi150.stdout:8/337: readlink d0/d41/l61 0 2023-12-05T09:57:27.991 INFO:tasks.workunit.client.1.smithi150.stdout:8/338: chown d0/d41/d49/d1b/l32 1 1 2023-12-05T09:57:27.992 INFO:tasks.workunit.client.1.smithi150.stdout:8/339: stat d0/d41/d49/d1b/d24/d5b 0 2023-12-05T09:57:27.992 INFO:tasks.workunit.client.1.smithi150.stdout:8/340: creat d0/d41/d49/d1b/d24/d38/d62/f6b x:0 0 0 2023-12-05T09:57:28.001 INFO:tasks.workunit.client.0.smithi100.stdout:1/360: rename db/d31/d4f to db/d12/d1e/d26/d30/d6e 0 2023-12-05T09:57:28.001 INFO:tasks.workunit.client.0.smithi100.stdout:1/361: fsync db/d12/d1e/d26/f62 0 2023-12-05T09:57:28.003 INFO:tasks.workunit.client.1.smithi150.stdout:5/325: symlink d1/d3/d6/d1b/l77 0 2023-12-05T09:57:28.006 INFO:tasks.workunit.client.1.smithi150.stdout:4/281: getdents d0/d3e/d48 0 2023-12-05T09:57:28.007 INFO:tasks.workunit.client.1.smithi150.stdout:9/303: symlink d3/d9/dc/d1f/l5e 0 2023-12-05T09:57:28.010 INFO:tasks.workunit.client.0.smithi100.stdout:4/313: truncate f2 7914338 0 2023-12-05T09:57:28.016 INFO:tasks.workunit.client.0.smithi100.stdout:2/488: rmdir d7/da/dc/d88 39 2023-12-05T09:57:28.019 INFO:tasks.workunit.client.1.smithi150.stdout:2/324: creat d0/d3/d5/d13/d15/d30/d54/d57/f75 x:0 0 0 2023-12-05T09:57:28.019 INFO:tasks.workunit.client.1.smithi150.stdout:2/325: fdatasync d0/d3/d21/f39 0 2023-12-05T09:57:28.019 INFO:tasks.workunit.client.1.smithi150.stdout:2/326: truncate d0/d3/d21/f44 1030376 0 2023-12-05T09:57:28.029 INFO:tasks.workunit.client.0.smithi100.stdout:6/706: dread d7/d27/f2e [0,4194304] 0 2023-12-05T09:57:28.029 INFO:tasks.workunit.client.0.smithi100.stdout:5/411: dread d0/d16/d2b/f3a [0,4194304] 0 2023-12-05T09:57:28.030 INFO:tasks.workunit.client.0.smithi100.stdout:7/317: dread d3/dc/d11/f58 [0,4194304] 0 2023-12-05T09:57:28.031 INFO:tasks.workunit.client.1.smithi150.stdout:7/353: rename d2/db/d30/d18/d1a/f1f to d2/d4/f6d 0 2023-12-05T09:57:28.031 INFO:tasks.workunit.client.1.smithi150.stdout:7/354: chown d2/d1b 229835277 1 2023-12-05T09:57:28.031 INFO:tasks.workunit.client.1.smithi150.stdout:1/362: rename d6/d8/db to d6/d8/db/d1b/d79/d80 22 2023-12-05T09:57:28.031 INFO:tasks.workunit.client.1.smithi150.stdout:1/363: dread - d6/d8/d54/f67 zero size 2023-12-05T09:57:28.035 INFO:tasks.workunit.client.0.smithi100.stdout:8/280: write d0/f2 [5987614,69387] 0 2023-12-05T09:57:28.039 INFO:tasks.workunit.client.1.smithi150.stdout:0/378: creat d5/d11/d16/d3f/d46/f89 x:0 0 0 2023-12-05T09:57:28.039 INFO:tasks.workunit.client.1.smithi150.stdout:0/379: fdatasync d5/d11/d71/f56 0 2023-12-05T09:57:28.039 INFO:tasks.workunit.client.0.smithi100.stdout:6/707: write d7/d11/f51 [5736635,40352] 0 2023-12-05T09:57:28.039 INFO:tasks.workunit.client.0.smithi100.stdout:4/314: symlink de/d16/d23/d60/l64 0 2023-12-05T09:57:28.039 INFO:tasks.workunit.client.0.smithi100.stdout:2/489: mknod d7/da/d13/d69/d6e/ca5 0 2023-12-05T09:57:28.042 INFO:tasks.workunit.client.1.smithi150.stdout:7/355: dread d2/db/d30/d13/f14 [0,4194304] 0 2023-12-05T09:57:28.042 INFO:tasks.workunit.client.1.smithi150.stdout:6/291: dwrite d2/d23/d60/f5e [0,4194304] 0 2023-12-05T09:57:28.049 INFO:tasks.workunit.client.0.smithi100.stdout:3/418: dwrite d0/d2/de/d11/f21 [0,4194304] 0 2023-12-05T09:57:28.050 INFO:tasks.workunit.client.1.smithi150.stdout:3/362: dwrite d6/d9/d3d/d56/f3f [0,4194304] 0 2023-12-05T09:57:28.051 INFO:tasks.workunit.client.1.smithi150.stdout:8/341: getdents d0/d41/d49/d1b/d24/d38 0 2023-12-05T09:57:28.054 INFO:tasks.workunit.client.1.smithi150.stdout:5/326: mknod d1/d3/d38/d65/d3b/d6b/c78 0 2023-12-05T09:57:28.054 INFO:tasks.workunit.client.1.smithi150.stdout:5/327: creat d1/d3/d38/f79 x:0 0 0 2023-12-05T09:57:28.054 INFO:tasks.workunit.client.0.smithi100.stdout:1/362: dread db/ff [0,4194304] 0 2023-12-05T09:57:28.054 INFO:tasks.workunit.client.0.smithi100.stdout:1/363: dread - db/d31/f46 zero size 2023-12-05T09:57:28.059 INFO:tasks.workunit.client.1.smithi150.stdout:1/364: write d6/d8/db/f30 [986860,89753] 0 2023-12-05T09:57:28.060 INFO:tasks.workunit.client.1.smithi150.stdout:4/282: mknod d0/d3e/d48/c54 0 2023-12-05T09:57:28.062 INFO:tasks.workunit.client.0.smithi100.stdout:5/412: symlink d0/d4/d14/l8d 0 2023-12-05T09:57:28.065 INFO:tasks.workunit.client.1.smithi150.stdout:9/304: creat d3/d9/dc/d1f/f5f x:0 0 0 2023-12-05T09:57:28.065 INFO:tasks.workunit.client.0.smithi100.stdout:7/318: creat d3/dc/d11/d13/de/d2d/f6d x:0 0 0 2023-12-05T09:57:28.068 INFO:tasks.workunit.client.1.smithi150.stdout:6/292: dread d2/d23/d60/f40 [0,4194304] 0 2023-12-05T09:57:28.069 INFO:tasks.workunit.client.1.smithi150.stdout:2/327: link d0/d3/d21/l32 d0/d3/d5/d13/d15/d30/d54/d57/l76 0 2023-12-05T09:57:28.069 INFO:tasks.workunit.client.1.smithi150.stdout:0/380: rename d5/c2f to d5/d11/d71/d5f/d77/c8a 0 2023-12-05T09:57:28.069 INFO:tasks.workunit.client.1.smithi150.stdout:2/328: write d0/d3/d5/d22/f65 [7433,102712] 0 2023-12-05T09:57:28.070 INFO:tasks.workunit.client.1.smithi150.stdout:4/283: dread d0/d11/f39 [4194304,4194304] 0 2023-12-05T09:57:28.070 INFO:tasks.workunit.client.1.smithi150.stdout:4/284: write d0/d3e/d48/f52 [8946,9914] 0 2023-12-05T09:57:28.071 INFO:tasks.workunit.client.0.smithi100.stdout:8/281: rename d0/fd to d0/d12/d13/d16/d22/d24/f3d 0 2023-12-05T09:57:28.071 INFO:tasks.workunit.client.0.smithi100.stdout:8/282: truncate d0/d12/d13/f2f 923307 0 2023-12-05T09:57:28.072 INFO:tasks.workunit.client.1.smithi150.stdout:8/342: write d0/ff [1722012,108641] 0 2023-12-05T09:57:28.072 INFO:tasks.workunit.client.1.smithi150.stdout:8/343: truncate d0/d41/f50 171286 0 2023-12-05T09:57:28.073 INFO:tasks.workunit.client.1.smithi150.stdout:8/344: readlink d0/d41/d49/d1b/d24/d2e/d30/l3e 0 2023-12-05T09:57:28.073 INFO:tasks.workunit.client.1.smithi150.stdout:8/345: dread - d0/d41/d49/d1b/d24/f3b zero size 2023-12-05T09:57:28.073 INFO:tasks.workunit.client.1.smithi150.stdout:8/346: truncate d0/d41/d49/d1b/d24/d34/d56/f60 670296 0 2023-12-05T09:57:28.073 INFO:tasks.workunit.client.1.smithi150.stdout:8/347: read - d0/d41/d49/d1b/d24/d38/d62/f6b zero size 2023-12-05T09:57:28.073 INFO:tasks.workunit.client.0.smithi100.stdout:2/490: mknod d7/da/d18/ca6 0 2023-12-05T09:57:28.073 INFO:tasks.workunit.client.0.smithi100.stdout:2/491: read - d7/da/d18/d21/fa4 zero size 2023-12-05T09:57:28.076 INFO:tasks.workunit.client.1.smithi150.stdout:7/356: mknod d2/db/d30/d13/c6e 0 2023-12-05T09:57:28.078 INFO:tasks.workunit.client.1.smithi150.stdout:3/363: unlink d6/d25/d28/c59 0 2023-12-05T09:57:28.079 INFO:tasks.workunit.client.1.smithi150.stdout:3/364: write d6/d25/d28/f2e [6682550,53270] 0 2023-12-05T09:57:28.082 INFO:tasks.workunit.client.1.smithi150.stdout:9/305: symlink d3/d9/dc/d1f/d24/l60 0 2023-12-05T09:57:28.082 INFO:tasks.workunit.client.1.smithi150.stdout:9/306: truncate d3/d9/d26/f3f 638938 0 2023-12-05T09:57:28.083 INFO:tasks.workunit.client.1.smithi150.stdout:1/365: dread d6/d8/db/de/ff [0,4194304] 0 2023-12-05T09:57:28.084 INFO:tasks.workunit.client.1.smithi150.stdout:1/366: chown d6/d8/db/f19 0 1 2023-12-05T09:57:28.084 INFO:tasks.workunit.client.1.smithi150.stdout:6/293: mkdir d2/d23/d3b/d64 0 2023-12-05T09:57:28.084 INFO:tasks.workunit.client.1.smithi150.stdout:6/294: chown d2/d23/d3b 117 1 2023-12-05T09:57:28.085 INFO:tasks.workunit.client.1.smithi150.stdout:6/295: read d2/da/f27 [8401204,35755] 0 2023-12-05T09:57:28.087 INFO:tasks.workunit.client.1.smithi150.stdout:5/328: rename d1/d3/d6/d26/f30 to d1/d3/d6/d1b/d22/d24/f7a 0 2023-12-05T09:57:28.089 INFO:tasks.workunit.client.1.smithi150.stdout:0/381: symlink d5/d11/d65/d82/l8b 0 2023-12-05T09:57:28.090 INFO:tasks.workunit.client.1.smithi150.stdout:0/382: write d5/d11/f24 [4246931,49131] 0 2023-12-05T09:57:28.090 INFO:tasks.workunit.client.1.smithi150.stdout:1/367: dread d6/d8/db/f6e [0,4194304] 0 2023-12-05T09:57:28.093 INFO:tasks.workunit.client.0.smithi100.stdout:7/319: write d3/f24 [3655316,85125] 0 2023-12-05T09:57:28.093 INFO:tasks.workunit.client.0.smithi100.stdout:7/320: dread - d3/dc/d11/d13/de/d18/d3b/f5d zero size 2023-12-05T09:57:28.101 INFO:tasks.workunit.client.1.smithi150.stdout:2/329: mkdir d0/d3/d21/d77 0 2023-12-05T09:57:28.101 INFO:tasks.workunit.client.1.smithi150.stdout:8/348: creat d0/d41/d49/d1b/d24/d34/d56/d67/f6c x:0 0 0 2023-12-05T09:57:28.106 INFO:tasks.workunit.client.0.smithi100.stdout:4/315: dwrite de/d16/f52 [0,4194304] 0 2023-12-05T09:57:28.107 INFO:tasks.workunit.client.1.smithi150.stdout:7/357: unlink d2/d1b/d31/f36 0 2023-12-05T09:57:28.107 INFO:tasks.workunit.client.1.smithi150.stdout:7/358: write d2/d1b/d31/f69 [957779,17553] 0 2023-12-05T09:57:28.108 INFO:tasks.workunit.client.0.smithi100.stdout:4/316: write de/f14 [4282861,8221] 0 2023-12-05T09:57:28.113 INFO:tasks.workunit.client.0.smithi100.stdout:5/413: write d0/d1f/f6a [3648553,16221] 0 2023-12-05T09:57:28.114 INFO:tasks.workunit.client.1.smithi150.stdout:9/307: write d3/f2e [3008457,50050] 0 2023-12-05T09:57:28.114 INFO:tasks.workunit.client.1.smithi150.stdout:9/308: dread - d3/d9/dc/d1f/f5f zero size 2023-12-05T09:57:28.114 INFO:tasks.workunit.client.1.smithi150.stdout:9/309: stat d3/d1b/f36 0 2023-12-05T09:57:28.118 INFO:tasks.workunit.client.0.smithi100.stdout:1/364: symlink db/d12/d1e/d26/d30/d6e/l6f 0 2023-12-05T09:57:28.118 INFO:tasks.workunit.client.0.smithi100.stdout:1/365: chown db/d31/d3a/d3b/c3d 0 1 2023-12-05T09:57:28.118 INFO:tasks.workunit.client.0.smithi100.stdout:1/366: creat db/d31/d3a/d3b/f70 x:0 0 0 2023-12-05T09:57:28.125 INFO:tasks.workunit.client.1.smithi150.stdout:3/365: mkdir d6/d9/d43/d75 0 2023-12-05T09:57:28.125 INFO:tasks.workunit.client.1.smithi150.stdout:3/366: dread - d6/f6c zero size 2023-12-05T09:57:28.131 INFO:tasks.workunit.client.0.smithi100.stdout:4/317: dread de/d16/d1e/f2e [0,4194304] 0 2023-12-05T09:57:28.131 INFO:tasks.workunit.client.0.smithi100.stdout:6/708: dwrite d7/fc7 [0,4194304] 0 2023-12-05T09:57:28.131 INFO:tasks.workunit.client.0.smithi100.stdout:4/318: write de/f48 [214169,117503] 0 2023-12-05T09:57:28.138 INFO:tasks.workunit.client.0.smithi100.stdout:8/283: rename d0/f17 to d0/d12/d13/f3e 0 2023-12-05T09:57:28.138 INFO:tasks.workunit.client.0.smithi100.stdout:8/284: chown d0/d12/d13/d16/f27 0 1 2023-12-05T09:57:28.142 INFO:tasks.workunit.client.1.smithi150.stdout:4/285: dwrite d0/f24 [0,4194304] 0 2023-12-05T09:57:28.142 INFO:tasks.workunit.client.1.smithi150.stdout:6/296: mknod d2/d23/d60/c65 0 2023-12-05T09:57:28.144 INFO:tasks.workunit.client.0.smithi100.stdout:2/492: mkdir d7/da/da7 0 2023-12-05T09:57:28.155 INFO:tasks.workunit.client.1.smithi150.stdout:8/349: dwrite d0/d8/f23 [0,4194304] 0 2023-12-05T09:57:28.159 INFO:tasks.workunit.client.1.smithi150.stdout:5/329: rename d1/l2b to d1/d3/d6/d26/l7b 0 2023-12-05T09:57:28.159 INFO:tasks.workunit.client.1.smithi150.stdout:7/359: rename d2/db/d30/d13/d4f/d5a to d2/db/d30/d13/d4f/d5a/d5c/d6f 22 2023-12-05T09:57:28.160 INFO:tasks.workunit.client.1.smithi150.stdout:7/360: chown d2/d1b/d5b/c50 528272 1 2023-12-05T09:57:28.166 INFO:tasks.workunit.client.0.smithi100.stdout:3/419: getdents d0/d10/d39 0 2023-12-05T09:57:28.166 INFO:tasks.workunit.client.0.smithi100.stdout:3/420: creat d0/d3d/d5c/d6f/f8c x:0 0 0 2023-12-05T09:57:28.174 INFO:tasks.workunit.client.1.smithi150.stdout:5/330: dread d1/d64/d31/f49 [0,4194304] 0 2023-12-05T09:57:28.176 INFO:tasks.workunit.client.1.smithi150.stdout:2/330: dwrite d0/f49 [0,4194304] 0 2023-12-05T09:57:28.178 INFO:tasks.workunit.client.1.smithi150.stdout:3/367: dwrite d6/f5d [0,4194304] 0 2023-12-05T09:57:28.179 INFO:tasks.workunit.client.1.smithi150.stdout:9/310: symlink d3/d9/dc/l61 0 2023-12-05T09:57:28.179 INFO:tasks.workunit.client.1.smithi150.stdout:9/311: truncate d3/d9/dc/f4b 1060151 0 2023-12-05T09:57:28.179 INFO:tasks.workunit.client.1.smithi150.stdout:9/312: fsync d3/d9/dc/d1f/f5f 0 2023-12-05T09:57:28.179 INFO:tasks.workunit.client.1.smithi150.stdout:9/313: chown d3/d9/d26/d34 80 1 2023-12-05T09:57:28.179 INFO:tasks.workunit.client.1.smithi150.stdout:9/314: chown d3/d1b/f36 18245 1 2023-12-05T09:57:28.186 INFO:tasks.workunit.client.0.smithi100.stdout:8/285: creat d0/d12/d13/d16/d22/d24/f3f x:0 0 0 2023-12-05T09:57:28.186 INFO:tasks.workunit.client.0.smithi100.stdout:8/286: chown d0/d12/d13/d16/d22 201393 1 2023-12-05T09:57:28.189 INFO:tasks.workunit.client.0.smithi100.stdout:9/399: sync 2023-12-05T09:57:28.189 INFO:tasks.workunit.client.0.smithi100.stdout:2/493: mknod d7/da/d18/d1b/d2c/d3f/d46/ca8 0 2023-12-05T09:57:28.190 INFO:tasks.workunit.client.0.smithi100.stdout:7/321: symlink d3/dc/d11/d13/de/d2d/d47/l6e 0 2023-12-05T09:57:28.194 INFO:tasks.workunit.client.1.smithi150.stdout:6/297: dwrite d2/f26 [0,4194304] 0 2023-12-05T09:57:28.194 INFO:tasks.workunit.client.1.smithi150.stdout:6/298: chown d2/d23/d2e/d44/c62 12 1 2023-12-05T09:57:28.195 INFO:tasks.workunit.client.0.smithi100.stdout:5/414: dwrite d0/d1f/f2e [0,4194304] 0 2023-12-05T09:57:28.195 INFO:tasks.workunit.client.0.smithi100.stdout:5/415: read d0/d1f/f21 [2263085,99057] 0 2023-12-05T09:57:28.196 INFO:tasks.workunit.client.1.smithi150.stdout:5/331: dread d1/d3/d6/f10 [0,4194304] 0 2023-12-05T09:57:28.197 INFO:tasks.workunit.client.0.smithi100.stdout:5/416: write d0/d16/d2b/d48/f5d [3473013,16220] 0 2023-12-05T09:57:28.197 INFO:tasks.workunit.client.0.smithi100.stdout:3/421: mkdir d0/d2/de/d8d 0 2023-12-05T09:57:28.201 INFO:tasks.workunit.client.0.smithi100.stdout:1/367: rename db/c24 to db/d12/d1e/c71 0 2023-12-05T09:57:28.203 INFO:tasks.workunit.client.0.smithi100.stdout:9/400: getdents d7/d1b 0 2023-12-05T09:57:28.206 INFO:tasks.workunit.client.0.smithi100.stdout:5/417: mkdir d0/d1b/d4d/d8e 0 2023-12-05T09:57:28.211 INFO:tasks.workunit.client.0.smithi100.stdout:8/287: write d0/d12/d13/f25 [762039,31136] 0 2023-12-05T09:57:28.211 INFO:tasks.workunit.client.0.smithi100.stdout:8/288: truncate d0/f3c 164030 0 2023-12-05T09:57:28.211 INFO:tasks.workunit.client.0.smithi100.stdout:6/709: write d7/d11/d1a/f1b [992221,45156] 0 2023-12-05T09:57:28.211 INFO:tasks.workunit.client.0.smithi100.stdout:6/710: truncate d7/d27/d35/d5a/f7f 2335083 0 2023-12-05T09:57:28.211 INFO:tasks.workunit.client.0.smithi100.stdout:6/711: fsync d7/d27/d35/d5a/f96 0 2023-12-05T09:57:28.211 INFO:tasks.workunit.client.0.smithi100.stdout:6/712: chown d7/d11/d1a/f2b 12304 1 2023-12-05T09:57:28.212 INFO:tasks.workunit.client.1.smithi150.stdout:5/332: write d1/d3/d38/d65/d3b/d37/f48 [2002089,110171] 0 2023-12-05T09:57:28.215 INFO:tasks.workunit.client.0.smithi100.stdout:1/368: mkdir db/d12/d1e/d72 0 2023-12-05T09:57:28.215 INFO:tasks.workunit.client.0.smithi100.stdout:4/319: rename de/d16/d23/d36/l4c to de/d38/l65 0 2023-12-05T09:57:28.215 INFO:tasks.workunit.client.0.smithi100.stdout:9/401: unlink d7/d1b/d22/d2a/d56/d2e/f53 0 2023-12-05T09:57:28.215 INFO:tasks.workunit.client.0.smithi100.stdout:9/402: write d7/d35/d71/f78 [231617,19167] 0 2023-12-05T09:57:28.215 INFO:tasks.workunit.client.0.smithi100.stdout:8/289: mknod d0/d35/c40 0 2023-12-05T09:57:28.215 INFO:tasks.workunit.client.0.smithi100.stdout:8/290: truncate d0/d12/f32 308152 0 2023-12-05T09:57:28.216 INFO:tasks.workunit.client.0.smithi100.stdout:6/713: creat d7/d11/de8/fe9 x:0 0 0 2023-12-05T09:57:28.217 INFO:tasks.workunit.client.0.smithi100.stdout:3/422: symlink d0/d2/de/d12/l8e 0 2023-12-05T09:57:28.217 INFO:tasks.workunit.client.0.smithi100.stdout:6/714: write d7/d2d/fe3 [306852,52405] 0 2023-12-05T09:57:28.220 INFO:tasks.workunit.client.0.smithi100.stdout:2/494: rename d7/da/c42 to d7/da/d13/d4e/d87/ca9 0 2023-12-05T09:57:28.220 INFO:tasks.workunit.client.0.smithi100.stdout:2/495: chown d7/da/d18/d1b/c60 1369924245 1 2023-12-05T09:57:28.222 INFO:tasks.workunit.client.1.smithi150.stdout:8/350: symlink d0/d41/d49/d1b/d24/d2e/l6d 0 2023-12-05T09:57:28.222 INFO:tasks.workunit.client.1.smithi150.stdout:8/351: dread - d0/d41/d49/d1b/d24/d38/d62/f68 zero size 2023-12-05T09:57:28.231 INFO:tasks.workunit.client.0.smithi100.stdout:1/369: mkdir db/d31/d73 0 2023-12-05T09:57:28.232 INFO:tasks.workunit.client.1.smithi150.stdout:7/361: unlink d2/d1b/f35 0 2023-12-05T09:57:28.232 INFO:tasks.workunit.client.1.smithi150.stdout:7/362: read d2/db/d30/d13/f14 [3364024,129482] 0 2023-12-05T09:57:28.234 INFO:tasks.workunit.client.0.smithi100.stdout:9/403: link d7/d1b/d22/d2a/d56/f5c d7/d20/d68/f83 0 2023-12-05T09:57:28.238 INFO:tasks.workunit.client.1.smithi150.stdout:1/368: rmdir d6/d8/db/de 39 2023-12-05T09:57:28.242 INFO:tasks.workunit.client.0.smithi100.stdout:8/291: creat d0/d12/d13/d16/f41 x:0 0 0 2023-12-05T09:57:28.242 INFO:tasks.workunit.client.0.smithi100.stdout:8/292: chown d0/d12/d13/d16/d22/l34 257422 1 2023-12-05T09:57:28.242 INFO:tasks.workunit.client.0.smithi100.stdout:8/293: dread - d0/d12/d13/d16/d22/d24/f3f zero size 2023-12-05T09:57:28.242 INFO:tasks.workunit.client.0.smithi100.stdout:8/294: write d0/f1d [3183732,65353] 0 2023-12-05T09:57:28.246 INFO:tasks.workunit.client.0.smithi100.stdout:3/423: symlink d0/d2/de/d8d/l8f 0 2023-12-05T09:57:28.248 INFO:tasks.workunit.client.1.smithi150.stdout:2/331: symlink d0/d3/d5/d36/l78 0 2023-12-05T09:57:28.250 INFO:tasks.workunit.client.1.smithi150.stdout:8/352: write d0/d41/f55 [57468,53859] 0 2023-12-05T09:57:28.251 INFO:tasks.workunit.client.1.smithi150.stdout:8/353: write d0/d41/d49/d1b/d24/d34/d56/d67/f6c [924170,32476] 0 2023-12-05T09:57:28.251 INFO:tasks.workunit.client.1.smithi150.stdout:8/354: dread - d0/d8/f51 zero size 2023-12-05T09:57:28.251 INFO:tasks.workunit.client.1.smithi150.stdout:8/355: creat d0/d41/d49/d1b/d24/d2e/f6e x:0 0 0 2023-12-05T09:57:28.251 INFO:tasks.workunit.client.1.smithi150.stdout:8/356: fsync d0/d41/d49/d1b/d24/d38/f6a 0 2023-12-05T09:57:28.252 INFO:tasks.workunit.client.0.smithi100.stdout:6/715: rename d7/d2d/f48 to d7/d27/d97/fea 0 2023-12-05T09:57:28.258 INFO:tasks.workunit.client.1.smithi150.stdout:5/333: dwrite d1/f55 [4194304,4194304] 0 2023-12-05T09:57:28.261 INFO:tasks.workunit.client.1.smithi150.stdout:3/368: rename d6/d22/d37/f3c to d6/d9/d3d/d52/f76 0 2023-12-05T09:57:28.262 INFO:tasks.workunit.client.0.smithi100.stdout:1/370: mknod db/d12/d1e/d26/d30/d6e/c74 0 2023-12-05T09:57:28.270 INFO:tasks.workunit.client.0.smithi100.stdout:2/496: dread d7/da/d13/d69/d6e/d71/f8c [0,4194304] 0 2023-12-05T09:57:28.270 INFO:tasks.workunit.client.0.smithi100.stdout:9/404: rmdir d7/d1b/d22/d2a/d56 39 2023-12-05T09:57:28.270 INFO:tasks.workunit.client.0.smithi100.stdout:2/497: creat d7/da/d18/d1b/d2c/d3f/faa x:0 0 0 2023-12-05T09:57:28.271 INFO:tasks.workunit.client.1.smithi150.stdout:5/334: read d1/d3/d6/d1b/d22/f32 [844699,78666] 0 2023-12-05T09:57:28.271 INFO:tasks.workunit.client.1.smithi150.stdout:5/335: write d1/d3/d38/d65/d3b/f62 [5121279,90768] 0 2023-12-05T09:57:28.271 INFO:tasks.workunit.client.0.smithi100.stdout:2/498: creat d7/da/d18/fab x:0 0 0 2023-12-05T09:57:28.271 INFO:tasks.workunit.client.0.smithi100.stdout:7/322: dwrite d3/dc/d11/d13/de/f28 [0,4194304] 0 2023-12-05T09:57:28.271 INFO:tasks.workunit.client.0.smithi100.stdout:2/499: write d7/da/d18/d21/f7e [204831,109429] 0 2023-12-05T09:57:28.271 INFO:tasks.workunit.client.0.smithi100.stdout:4/320: dread de/d16/d23/f37 [0,4194304] 0 2023-12-05T09:57:28.271 INFO:tasks.workunit.client.0.smithi100.stdout:4/321: read - de/d16/d23/d33/d3d/d44/f4d zero size 2023-12-05T09:57:28.276 INFO:tasks.workunit.client.0.smithi100.stdout:3/424: mkdir d0/d3d/d90 0 2023-12-05T09:57:28.276 INFO:tasks.workunit.client.0.smithi100.stdout:3/425: chown d0/f36 1 1 2023-12-05T09:57:28.281 INFO:tasks.workunit.client.0.smithi100.stdout:8/295: dread d0/d12/d13/d16/f20 [0,4194304] 0 2023-12-05T09:57:28.281 INFO:tasks.workunit.client.0.smithi100.stdout:8/296: stat d0/ca 0 2023-12-05T09:57:28.282 INFO:tasks.workunit.client.0.smithi100.stdout:6/716: rename d7/d11/d7e/fa1 to d7/d27/d35/d5a/feb 0 2023-12-05T09:57:28.282 INFO:tasks.workunit.client.0.smithi100.stdout:6/717: fdatasync f5 0 2023-12-05T09:57:28.283 INFO:tasks.workunit.client.0.smithi100.stdout:6/718: truncate d7/d2d/f43 4343749 0 2023-12-05T09:57:28.283 INFO:tasks.workunit.client.0.smithi100.stdout:6/719: chown d7/d2d/d6a/d7c/f88 5735043 1 2023-12-05T09:57:28.284 INFO:tasks.workunit.client.0.smithi100.stdout:1/371: dread db/d12/d1e/f34 [0,4194304] 0 2023-12-05T09:57:28.288 INFO:tasks.workunit.client.1.smithi150.stdout:6/299: symlink d2/l66 0 2023-12-05T09:57:28.288 INFO:tasks.workunit.client.1.smithi150.stdout:6/300: write d2/d23/d2e/d44/f50 [162113,48863] 0 2023-12-05T09:57:28.290 INFO:tasks.workunit.client.1.smithi150.stdout:7/363: dwrite d2/db/d30/d18/f6c [0,4194304] 0 2023-12-05T09:57:28.290 INFO:tasks.workunit.client.1.smithi150.stdout:7/364: write d2/d1b/d31/f69 [1866968,103633] 0 2023-12-05T09:57:28.295 INFO:tasks.workunit.client.0.smithi100.stdout:5/418: dwrite d0/d1f/d53/f5a [0,4194304] 0 2023-12-05T09:57:28.295 INFO:tasks.workunit.client.0.smithi100.stdout:8/297: dread d0/d12/d13/d16/f2e [0,4194304] 0 2023-12-05T09:57:28.295 INFO:tasks.workunit.client.0.smithi100.stdout:8/298: chown d0/d12/d13/d16/f3a 41047306 1 2023-12-05T09:57:28.296 INFO:tasks.workunit.client.1.smithi150.stdout:4/286: getdents d0 0 2023-12-05T09:57:28.310 INFO:tasks.workunit.client.0.smithi100.stdout:9/405: dwrite d7/fb [0,4194304] 0 2023-12-05T09:57:28.312 INFO:tasks.workunit.client.1.smithi150.stdout:8/357: mknod d0/d41/d49/d1b/d24/d2e/d4d/c6f 0 2023-12-05T09:57:28.316 INFO:tasks.workunit.client.0.smithi100.stdout:2/500: link d7/da/d1a/f38 d7/da/fac 0 2023-12-05T09:57:28.317 INFO:tasks.workunit.client.1.smithi150.stdout:3/369: mknod d6/d9/d3d/c77 0 2023-12-05T09:57:28.321 INFO:tasks.workunit.client.1.smithi150.stdout:0/383: sync 2023-12-05T09:57:28.324 INFO:tasks.workunit.client.1.smithi150.stdout:5/336: symlink d1/d3/d6/d11/l7c 0 2023-12-05T09:57:28.331 INFO:tasks.workunit.client.1.smithi150.stdout:5/337: dread d1/d3/fb [0,4194304] 0 2023-12-05T09:57:28.334 INFO:tasks.workunit.client.1.smithi150.stdout:7/365: mknod d2/db/d2e/c70 0 2023-12-05T09:57:28.334 INFO:tasks.workunit.client.1.smithi150.stdout:4/287: link d0/d11/c4a d0/d3e/d48/c55 0 2023-12-05T09:57:28.334 INFO:tasks.workunit.client.1.smithi150.stdout:2/332: rmdir d0/d3/d5/d22/d52/d5a 39 2023-12-05T09:57:28.335 INFO:tasks.workunit.client.1.smithi150.stdout:2/333: dread - d0/d3/f70 zero size 2023-12-05T09:57:28.335 INFO:tasks.workunit.client.1.smithi150.stdout:2/334: fdatasync d0/d3/f70 0 2023-12-05T09:57:28.335 INFO:tasks.workunit.client.1.smithi150.stdout:6/301: dwrite d2/d23/d2e/f3c [0,4194304] 0 2023-12-05T09:57:28.336 INFO:tasks.workunit.client.1.smithi150.stdout:8/358: link d0/d41/d49/d1b/c22 d0/d41/c70 0 2023-12-05T09:57:28.337 INFO:tasks.workunit.client.0.smithi100.stdout:7/323: mknod d3/dc/d11/d13/de/d18/d3b/d40/d46/c6f 0 2023-12-05T09:57:28.343 INFO:tasks.workunit.client.1.smithi150.stdout:0/384: mknod d5/d11/d71/d5f/c8c 0 2023-12-05T09:57:28.343 INFO:tasks.workunit.client.1.smithi150.stdout:0/385: write d5/d11/d16/f1e [3822542,63131] 0 2023-12-05T09:57:28.343 INFO:tasks.workunit.client.0.smithi100.stdout:4/322: mkdir de/d66 0 2023-12-05T09:57:28.343 INFO:tasks.workunit.client.0.smithi100.stdout:4/323: write f1 [2476925,35839] 0 2023-12-05T09:57:28.343 INFO:tasks.workunit.client.0.smithi100.stdout:3/426: readlink d0/d2/de/d12/l27 0 2023-12-05T09:57:28.346 INFO:tasks.workunit.client.1.smithi150.stdout:5/338: unlink d1/d3/d6/d11/f2f 0 2023-12-05T09:57:28.347 INFO:tasks.workunit.client.1.smithi150.stdout:5/339: dread - d1/d3/d38/f79 zero size 2023-12-05T09:57:28.347 INFO:tasks.workunit.client.0.smithi100.stdout:6/720: symlink d7/dcc/lec 0 2023-12-05T09:57:28.348 INFO:tasks.workunit.client.1.smithi150.stdout:7/366: mkdir d2/db/d2e/d71 0 2023-12-05T09:57:28.348 INFO:tasks.workunit.client.1.smithi150.stdout:7/367: chown d2/d1b/d31 5007342 1 2023-12-05T09:57:28.348 INFO:tasks.workunit.client.1.smithi150.stdout:7/368: write d2/db/d30/d13/f66 [5201646,64658] 0 2023-12-05T09:57:28.351 INFO:tasks.workunit.client.0.smithi100.stdout:1/372: rename db/d12/d1e/d26/d30/f33 to db/d12/f75 0 2023-12-05T09:57:28.352 INFO:tasks.workunit.client.0.smithi100.stdout:1/373: fsync db/d12/d1e/d26/f5e 0 2023-12-05T09:57:28.352 INFO:tasks.workunit.client.0.smithi100.stdout:6/721: read d7/f89 [232635,79659] 0 2023-12-05T09:57:28.352 INFO:tasks.workunit.client.1.smithi150.stdout:4/288: mknod d0/d11/c56 0 2023-12-05T09:57:28.356 INFO:tasks.workunit.client.1.smithi150.stdout:2/335: mknod d0/d3/d11/d1d/c79 0 2023-12-05T09:57:28.356 INFO:tasks.workunit.client.1.smithi150.stdout:2/336: fsync d0/d3/d5/d22/f35 0 2023-12-05T09:57:28.363 INFO:tasks.workunit.client.0.smithi100.stdout:4/324: read de/f1b [1908911,110342] 0 2023-12-05T09:57:28.363 INFO:tasks.workunit.client.0.smithi100.stdout:5/419: unlink d0/d4/c45 0 2023-12-05T09:57:28.363 INFO:tasks.workunit.client.0.smithi100.stdout:4/325: creat de/d16/f67 x:0 0 0 2023-12-05T09:57:28.370 INFO:tasks.workunit.client.0.smithi100.stdout:8/299: mkdir d0/d12/d13/d16/d42 0 2023-12-05T09:57:28.370 INFO:tasks.workunit.client.0.smithi100.stdout:0/357: sync 2023-12-05T09:57:28.375 INFO:tasks.workunit.client.0.smithi100.stdout:9/406: mknod d7/d35/d71/c84 0 2023-12-05T09:57:28.376 INFO:tasks.workunit.client.0.smithi100.stdout:9/407: dread - d7/d20/d69/f72 zero size 2023-12-05T09:57:28.376 INFO:tasks.workunit.client.0.smithi100.stdout:2/501: mknod d7/da/d18/d1b/d2c/d3f/d72/d9d/cad 0 2023-12-05T09:57:28.376 INFO:tasks.workunit.client.0.smithi100.stdout:2/502: dread - d7/da/d18/d1b/d2c/d3f/f67 zero size 2023-12-05T09:57:28.377 INFO:tasks.workunit.client.1.smithi150.stdout:6/302: truncate d2/da/f31 4165484 0 2023-12-05T09:57:28.377 INFO:tasks.workunit.client.0.smithi100.stdout:2/503: write d7/da/d13/d69/d6e/d71/f9a [4556951,44158] 0 2023-12-05T09:57:28.379 INFO:tasks.workunit.client.0.smithi100.stdout:7/324: mknod d3/dc/d11/d13/de/c70 0 2023-12-05T09:57:28.380 INFO:tasks.workunit.client.1.smithi150.stdout:8/359: link d0/d41/d49/d1b/d24/f3b d0/d41/f71 0 2023-12-05T09:57:28.380 INFO:tasks.workunit.client.1.smithi150.stdout:8/360: creat d0/d41/d49/d1b/d24/f72 x:0 0 0 2023-12-05T09:57:28.381 INFO:tasks.workunit.client.0.smithi100.stdout:3/427: mknod d0/d3d/d5c/d5f/d67/c91 0 2023-12-05T09:57:28.384 INFO:tasks.workunit.client.1.smithi150.stdout:9/315: rename d3/d9/d26/d34/d3a to d3/d42/d62 0 2023-12-05T09:57:28.384 INFO:tasks.workunit.client.1.smithi150.stdout:9/316: stat d3/d9/dc/c11 0 2023-12-05T09:57:28.386 INFO:tasks.workunit.client.0.smithi100.stdout:8/300: dread d0/f2b [0,4194304] 0 2023-12-05T09:57:28.386 INFO:tasks.workunit.client.0.smithi100.stdout:8/301: chown d0/d12/f32 18562 1 2023-12-05T09:57:28.387 INFO:tasks.workunit.client.0.smithi100.stdout:4/326: mknod de/d16/d23/d33/d3d/c68 0 2023-12-05T09:57:28.387 INFO:tasks.workunit.client.0.smithi100.stdout:4/327: fdatasync de/f12 0 2023-12-05T09:57:28.390 INFO:tasks.workunit.client.0.smithi100.stdout:0/358: link da/d1b/f3c da/d1b/d6b/f6c 0 2023-12-05T09:57:28.390 INFO:tasks.workunit.client.0.smithi100.stdout:0/359: write da/fd [4981435,91611] 0 2023-12-05T09:57:28.396 INFO:tasks.workunit.client.1.smithi150.stdout:3/370: rmdir d6/d22 39 2023-12-05T09:57:28.397 INFO:tasks.workunit.client.1.smithi150.stdout:5/340: unlink d1/d3/d38/d65/d3b/f62 0 2023-12-05T09:57:28.397 INFO:tasks.workunit.client.1.smithi150.stdout:2/337: creat d0/d3/d5/d22/d52/d5a/f7a x:0 0 0 2023-12-05T09:57:28.397 INFO:tasks.workunit.client.1.smithi150.stdout:5/341: fsync d1/f51 0 2023-12-05T09:57:28.397 INFO:tasks.workunit.client.1.smithi150.stdout:5/342: write d1/d3/d38/d65/d3b/d37/f70 [538073,79932] 0 2023-12-05T09:57:28.398 INFO:tasks.workunit.client.0.smithi100.stdout:2/504: rmdir d7/da/dc/d88 39 2023-12-05T09:57:28.399 INFO:tasks.workunit.client.0.smithi100.stdout:8/302: mkdir d0/d12/d13/d16/d42/d43 0 2023-12-05T09:57:28.401 INFO:tasks.workunit.client.1.smithi150.stdout:4/289: rename d0/f17 to d0/d3e/d48/d4d/f57 0 2023-12-05T09:57:28.401 INFO:tasks.workunit.client.1.smithi150.stdout:4/290: truncate d0/f26 338708 0 2023-12-05T09:57:28.401 INFO:tasks.workunit.client.1.smithi150.stdout:4/291: creat d0/d11/d4b/f58 x:0 0 0 2023-12-05T09:57:28.405 INFO:tasks.workunit.client.0.smithi100.stdout:4/328: link de/d16/c4b de/d16/d23/d33/d51/c69 0 2023-12-05T09:57:28.409 INFO:tasks.workunit.client.1.smithi150.stdout:9/317: creat d3/d9/dc/d1f/d24/f63 x:0 0 0 2023-12-05T09:57:28.409 INFO:tasks.workunit.client.1.smithi150.stdout:9/318: write d3/d42/d62/f5c [1005320,82108] 0 2023-12-05T09:57:28.412 INFO:tasks.workunit.client.1.smithi150.stdout:5/343: creat d1/d3/f7d x:0 0 0 2023-12-05T09:57:28.413 INFO:tasks.workunit.client.1.smithi150.stdout:0/386: dwrite d5/d11/d16/d3f/d46/f89 [0,4194304] 0 2023-12-05T09:57:28.414 INFO:tasks.workunit.client.1.smithi150.stdout:0/387: write d5/f23 [2636884,23851] 0 2023-12-05T09:57:28.414 INFO:tasks.workunit.client.1.smithi150.stdout:0/388: read - d5/d11/d71/d5f/f70 zero size 2023-12-05T09:57:28.415 INFO:tasks.workunit.client.0.smithi100.stdout:7/325: dread d3/dc/d11/d33/f62 [0,4194304] 0 2023-12-05T09:57:28.425 INFO:tasks.workunit.client.0.smithi100.stdout:8/303: mknod d0/d12/d13/d16/d22/c44 0 2023-12-05T09:57:28.425 INFO:tasks.workunit.client.0.smithi100.stdout:5/420: dwrite d0/d16/d2b/d48/f13 [0,4194304] 0 2023-12-05T09:57:28.426 INFO:tasks.workunit.client.0.smithi100.stdout:4/329: truncate de/d16/d1e/f41 2743442 0 2023-12-05T09:57:28.426 INFO:tasks.workunit.client.0.smithi100.stdout:4/330: write de/d16/d23/d36/f21 [4306824,39567] 0 2023-12-05T09:57:28.427 INFO:tasks.workunit.client.0.smithi100.stdout:9/408: dread d7/d1b/d22/d51/f23 [0,4194304] 0 2023-12-05T09:57:28.430 INFO:tasks.workunit.client.1.smithi150.stdout:6/303: rename d2/f52 to d2/d23/f67 0 2023-12-05T09:57:28.430 INFO:tasks.workunit.client.1.smithi150.stdout:2/338: dread d0/f16 [0,4194304] 0 2023-12-05T09:57:28.432 INFO:tasks.workunit.client.1.smithi150.stdout:7/369: dwrite d2/db/d30/d18/f57 [0,4194304] 0 2023-12-05T09:57:28.441 INFO:tasks.workunit.client.1.smithi150.stdout:0/389: symlink d5/d11/d71/d5f/d77/d87/l8d 0 2023-12-05T09:57:28.442 INFO:tasks.workunit.client.0.smithi100.stdout:7/326: rename d3/dc/d11/d13/de/d18/d3b/d40/d46/f68 to d3/dc/d11/d13/de/d18/d3b/d40/d46/f71 0 2023-12-05T09:57:28.442 INFO:tasks.workunit.client.0.smithi100.stdout:7/327: chown d3/dc/d11/d13/d1b/f45 7 1 2023-12-05T09:57:28.444 INFO:tasks.workunit.client.1.smithi150.stdout:1/369: sync 2023-12-05T09:57:28.449 INFO:tasks.workunit.client.1.smithi150.stdout:8/361: rename d0/d41/d49/d1b/d24/l2d to d0/d41/l73 0 2023-12-05T09:57:28.451 INFO:tasks.workunit.client.1.smithi150.stdout:5/344: dread d1/d3/f1d [0,4194304] 0 2023-12-05T09:57:28.451 INFO:tasks.workunit.client.1.smithi150.stdout:5/345: readlink d1/d3/d38/d65/d3b/l44 0 2023-12-05T09:57:28.451 INFO:tasks.workunit.client.1.smithi150.stdout:5/346: stat d1/d3/d38/d65/d3b/c1a 0 2023-12-05T09:57:28.451 INFO:tasks.workunit.client.1.smithi150.stdout:5/347: creat d1/d3/f7e x:0 0 0 2023-12-05T09:57:28.451 INFO:tasks.workunit.client.1.smithi150.stdout:5/348: chown d1/d3/c54 43432 1 2023-12-05T09:57:28.453 INFO:tasks.workunit.client.1.smithi150.stdout:6/304: dread d2/d23/d60/f40 [0,4194304] 0 2023-12-05T09:57:28.453 INFO:tasks.workunit.client.1.smithi150.stdout:6/305: chown d2/da 22392679 1 2023-12-05T09:57:28.458 INFO:tasks.workunit.client.1.smithi150.stdout:2/339: creat d0/d3/d5/d10/d3d/d41/f7b x:0 0 0 2023-12-05T09:57:28.458 INFO:tasks.workunit.client.1.smithi150.stdout:2/340: chown d0/d3/d5/d22/d52 440941 1 2023-12-05T09:57:28.468 INFO:tasks.workunit.client.0.smithi100.stdout:8/304: mkdir d0/d12/d13/d45 0 2023-12-05T09:57:28.472 INFO:tasks.workunit.client.0.smithi100.stdout:5/421: truncate d0/d1b/d4d/d60/f6d 655211 0 2023-12-05T09:57:28.473 INFO:tasks.workunit.client.0.smithi100.stdout:5/422: fsync d0/d4/d14/f55 0 2023-12-05T09:57:28.474 INFO:tasks.workunit.client.1.smithi150.stdout:7/370: mkdir d2/d72 0 2023-12-05T09:57:28.475 INFO:tasks.workunit.client.1.smithi150.stdout:3/371: dwrite d6/d9/d3d/d56/d53/f69 [0,4194304] 0 2023-12-05T09:57:28.476 INFO:tasks.workunit.client.1.smithi150.stdout:3/372: write d6/d9/d3d/d56/d71/f73 [905359,40420] 0 2023-12-05T09:57:28.477 INFO:tasks.workunit.client.1.smithi150.stdout:3/373: dread - d6/d9/d3d/d52/f6f zero size 2023-12-05T09:57:28.481 INFO:tasks.workunit.client.0.smithi100.stdout:9/409: chown d7/d1b/d22/d51/d32/c58 0 1 2023-12-05T09:57:28.481 INFO:tasks.workunit.client.0.smithi100.stdout:9/410: write d7/d1b/d22/d2a/f6b [658731,17149] 0 2023-12-05T09:57:28.483 INFO:tasks.workunit.client.1.smithi150.stdout:1/370: link d6/d8/db/f19 d6/d38/f81 0 2023-12-05T09:57:28.483 INFO:tasks.workunit.client.1.smithi150.stdout:1/371: creat d6/d8/d54/f82 x:0 0 0 2023-12-05T09:57:28.483 INFO:tasks.workunit.client.1.smithi150.stdout:1/372: stat d6/d8/d59/l7b 0 2023-12-05T09:57:28.484 INFO:tasks.workunit.client.0.smithi100.stdout:0/360: truncate da/d2a/f56 4036897 0 2023-12-05T09:57:28.487 INFO:tasks.workunit.client.1.smithi150.stdout:4/292: dwrite d0/d42/f4c [0,4194304] 0 2023-12-05T09:57:28.489 INFO:tasks.workunit.client.0.smithi100.stdout:7/328: creat d3/dc/d11/d13/de/d2d/d47/f72 x:0 0 0 2023-12-05T09:57:28.493 INFO:tasks.workunit.client.0.smithi100.stdout:5/423: creat d0/d4/d14/f8f x:0 0 0 2023-12-05T09:57:28.494 INFO:tasks.workunit.client.1.smithi150.stdout:0/390: rename d5/d11/d65/d82/l8b to d5/d11/d71/l8e 0 2023-12-05T09:57:28.497 INFO:tasks.workunit.client.1.smithi150.stdout:0/391: creat d5/d11/f8f x:0 0 0 2023-12-05T09:57:28.497 INFO:tasks.workunit.client.1.smithi150.stdout:8/362: mknod d0/d41/d49/d1b/d24/d34/d56/c74 0 2023-12-05T09:57:28.502 INFO:tasks.workunit.client.0.smithi100.stdout:9/411: truncate d7/d1b/d22/d51/f28 4312170 0 2023-12-05T09:57:28.502 INFO:tasks.workunit.client.0.smithi100.stdout:9/412: chown d7/f9 88294 1 2023-12-05T09:57:28.502 INFO:tasks.workunit.client.0.smithi100.stdout:4/331: dwrite de/d16/d23/f47 [0,4194304] 0 2023-12-05T09:57:28.502 INFO:tasks.workunit.client.0.smithi100.stdout:9/413: creat d7/d35/f85 x:0 0 0 2023-12-05T09:57:28.503 INFO:tasks.workunit.client.0.smithi100.stdout:0/361: rmdir da/d22 39 2023-12-05T09:57:28.506 INFO:tasks.workunit.client.1.smithi150.stdout:6/306: creat d2/d23/d3b/d46/f68 x:0 0 0 2023-12-05T09:57:28.506 INFO:tasks.workunit.client.1.smithi150.stdout:6/307: chown d2/da/f10 20054 1 2023-12-05T09:57:28.508 INFO:tasks.workunit.client.0.smithi100.stdout:3/428: dwrite d0/d2/de/d11/f21 [0,4194304] 0 2023-12-05T09:57:28.508 INFO:tasks.workunit.client.1.smithi150.stdout:9/319: dwrite d3/d9/dc/f33 [4194304,4194304] 0 2023-12-05T09:57:28.511 INFO:tasks.workunit.client.1.smithi150.stdout:7/371: symlink d2/d1b/d5b/d6a/l73 0 2023-12-05T09:57:28.513 INFO:tasks.workunit.client.0.smithi100.stdout:7/329: read - d3/dc/d11/d13/de/d2d/f4f zero size 2023-12-05T09:57:28.513 INFO:tasks.workunit.client.0.smithi100.stdout:7/330: read d3/dc/f4a [2686559,33377] 0 2023-12-05T09:57:28.515 INFO:tasks.workunit.client.0.smithi100.stdout:5/424: link d0/d16/d2b/c72 d0/d16/d37/c90 0 2023-12-05T09:57:28.517 INFO:tasks.workunit.client.1.smithi150.stdout:3/374: getdents d6/d22/d37/d63 0 2023-12-05T09:57:28.519 INFO:tasks.workunit.client.0.smithi100.stdout:2/505: dwrite d7/da/d13/d69/d6e/d71/f9a [0,4194304] 0 2023-12-05T09:57:28.519 INFO:tasks.workunit.client.0.smithi100.stdout:2/506: chown d7/f43 3637 1 2023-12-05T09:57:28.519 INFO:tasks.workunit.client.0.smithi100.stdout:2/507: stat d7/da/d18/d21/c99 0 2023-12-05T09:57:28.522 INFO:tasks.workunit.client.1.smithi150.stdout:9/320: dread d3/d9/dc/d1f/f2b [0,4194304] 0 2023-12-05T09:57:28.524 INFO:tasks.workunit.client.0.smithi100.stdout:4/332: dread de/f11 [0,4194304] 0 2023-12-05T09:57:28.524 INFO:tasks.workunit.client.0.smithi100.stdout:9/414: rename d7/d20/d68/f83 to d7/d35/f86 0 2023-12-05T09:57:28.524 INFO:tasks.workunit.client.0.smithi100.stdout:9/415: dread - d7/d35/f65 zero size 2023-12-05T09:57:28.524 INFO:tasks.workunit.client.0.smithi100.stdout:9/416: chown d7/d1b/d22/d2a/f48 16404175 1 2023-12-05T09:57:28.525 INFO:tasks.workunit.client.1.smithi150.stdout:3/375: dread d6/d9/d3d/d52/d5b/f44 [0,4194304] 0 2023-12-05T09:57:28.525 INFO:tasks.workunit.client.1.smithi150.stdout:3/376: creat d6/d9/d3d/d56/d53/f78 x:0 0 0 2023-12-05T09:57:28.525 INFO:tasks.workunit.client.1.smithi150.stdout:2/341: dwrite d0/d3/f70 [0,4194304] 0 2023-12-05T09:57:28.526 INFO:tasks.workunit.client.0.smithi100.stdout:8/305: dwrite d0/f19 [0,4194304] 0 2023-12-05T09:57:28.527 INFO:tasks.workunit.client.1.smithi150.stdout:2/342: creat d0/d3/d5/d3b/d4c/f7c x:0 0 0 2023-12-05T09:57:28.527 INFO:tasks.workunit.client.1.smithi150.stdout:2/343: readlink d0/d3/d27/l5b 0 2023-12-05T09:57:28.527 INFO:tasks.workunit.client.1.smithi150.stdout:2/344: fsync d0/d3/d11/d1d/f29 0 2023-12-05T09:57:28.527 INFO:tasks.workunit.client.1.smithi150.stdout:4/293: creat d0/d42/d44/f59 x:0 0 0 2023-12-05T09:57:28.527 INFO:tasks.workunit.client.1.smithi150.stdout:4/294: chown d0/d42/d44/f59 4680669 1 2023-12-05T09:57:28.527 INFO:tasks.workunit.client.1.smithi150.stdout:4/295: read - d0/d42/d44/f59 zero size 2023-12-05T09:57:28.527 INFO:tasks.workunit.client.1.smithi150.stdout:4/296: write d0/d11/f12 [646345,70262] 0 2023-12-05T09:57:28.527 INFO:tasks.workunit.client.0.smithi100.stdout:3/429: rename d0/d2/de/d11/c68 to d0/d2/de/d11/c92 0 2023-12-05T09:57:28.535 INFO:tasks.workunit.client.0.smithi100.stdout:7/331: getdents d3/dc/d11/d13/de/d18/d3b/d40 0 2023-12-05T09:57:28.535 INFO:tasks.workunit.client.1.smithi150.stdout:6/308: dread d2/da/f27 [0,4194304] 0 2023-12-05T09:57:28.540 INFO:tasks.workunit.client.0.smithi100.stdout:5/425: unlink d0/f3 0 2023-12-05T09:57:28.544 INFO:tasks.workunit.client.1.smithi150.stdout:0/392: symlink d5/d11/l90 0 2023-12-05T09:57:28.544 INFO:tasks.workunit.client.1.smithi150.stdout:0/393: creat d5/d11/d32/f91 x:0 0 0 2023-12-05T09:57:28.544 INFO:tasks.workunit.client.1.smithi150.stdout:0/394: chown d5/d11/f66 3 1 2023-12-05T09:57:28.544 INFO:tasks.workunit.client.1.smithi150.stdout:0/395: write d5/d11/d65/f76 [97419,91195] 0 2023-12-05T09:57:28.545 INFO:tasks.workunit.client.0.smithi100.stdout:0/362: write da/d2a/f56 [580939,29161] 0 2023-12-05T09:57:28.545 INFO:tasks.workunit.client.1.smithi150.stdout:4/297: write d0/d11/f23 [665760,88014] 0 2023-12-05T09:57:28.547 INFO:tasks.workunit.client.0.smithi100.stdout:2/508: rmdir d7/da/d1a 39 2023-12-05T09:57:28.550 INFO:tasks.workunit.client.0.smithi100.stdout:9/417: creat d7/d1b/d22/d51/f87 x:0 0 0 2023-12-05T09:57:28.560 INFO:tasks.workunit.client.0.smithi100.stdout:4/333: rename de/d16/d23/f34 to de/d16/d23/d36/f6a 0 2023-12-05T09:57:28.569 INFO:tasks.workunit.client.0.smithi100.stdout:0/363: mknod da/d1b/c6d 0 2023-12-05T09:57:28.569 INFO:tasks.workunit.client.0.smithi100.stdout:3/430: chown d0/d2/l2d 10386 1 2023-12-05T09:57:28.569 INFO:tasks.workunit.client.0.smithi100.stdout:3/431: chown d0/d10/d39 3207900 1 2023-12-05T09:57:28.569 INFO:tasks.workunit.client.1.smithi150.stdout:7/372: mknod d2/db/d30/d47/c74 0 2023-12-05T09:57:28.570 INFO:tasks.workunit.client.1.smithi150.stdout:4/298: dread d0/f24 [0,4194304] 0 2023-12-05T09:57:28.570 INFO:tasks.workunit.client.1.smithi150.stdout:4/299: read d0/f41 [1851831,113003] 0 2023-12-05T09:57:28.570 INFO:tasks.workunit.client.1.smithi150.stdout:4/300: fsync d0/d11/f39 0 2023-12-05T09:57:28.573 INFO:tasks.workunit.client.0.smithi100.stdout:2/509: mkdir d7/da/d18/d21/dae 0 2023-12-05T09:57:28.574 INFO:tasks.workunit.client.0.smithi100.stdout:4/334: link de/d16/d23/d36/f3a de/d16/d23/d33/f6b 0 2023-12-05T09:57:28.576 INFO:tasks.workunit.client.0.smithi100.stdout:7/332: rename d3/dc/d11/d13/de/d2d/f4f to d3/dc/d11/d13/de/f73 0 2023-12-05T09:57:28.576 INFO:tasks.workunit.client.0.smithi100.stdout:7/333: readlink d3/dc/d11/d13/de/d18/d3b/d40/l55 0 2023-12-05T09:57:28.577 INFO:tasks.workunit.client.0.smithi100.stdout:0/364: getdents da/d2a/d4d 0 2023-12-05T09:57:28.577 INFO:tasks.workunit.client.0.smithi100.stdout:4/335: creat de/d66/f6c x:0 0 0 2023-12-05T09:57:28.577 INFO:tasks.workunit.client.0.smithi100.stdout:4/336: write de/f48 [740313,86191] 0 2023-12-05T09:57:28.579 INFO:tasks.workunit.client.0.smithi100.stdout:3/432: rename d0/d2/de/d12/l27 to d0/d10/l93 0 2023-12-05T09:57:28.583 INFO:tasks.workunit.client.1.smithi150.stdout:2/345: creat d0/d3/d5/d13/d15/d30/d54/f7d x:0 0 0 2023-12-05T09:57:28.583 INFO:tasks.workunit.client.1.smithi150.stdout:2/346: write d0/d3/d5/d3b/d4c/f7c [163697,102102] 0 2023-12-05T09:57:28.584 INFO:tasks.workunit.client.1.smithi150.stdout:2/347: truncate d0/d3/d5/d13/d15/d30/d54/d57/f75 887944 0 2023-12-05T09:57:28.584 INFO:tasks.workunit.client.1.smithi150.stdout:2/348: fdatasync d0/f7 0 2023-12-05T09:57:28.584 INFO:tasks.workunit.client.1.smithi150.stdout:2/349: fdatasync d0/d3/d5/d22/d52/d56/f73 0 2023-12-05T09:57:28.585 INFO:tasks.workunit.client.1.smithi150.stdout:2/350: dread - d0/d3/d5/d10/d3d/d41/f7b zero size 2023-12-05T09:57:28.585 INFO:tasks.workunit.client.0.smithi100.stdout:0/365: symlink da/d22/d33/d35/l6e 0 2023-12-05T09:57:28.585 INFO:tasks.workunit.client.0.smithi100.stdout:0/366: chown da/d22/c24 27 1 2023-12-05T09:57:28.589 INFO:tasks.workunit.client.1.smithi150.stdout:9/321: dwrite d3/d9/f49 [0,4194304] 0 2023-12-05T09:57:28.589 INFO:tasks.workunit.client.1.smithi150.stdout:3/377: dwrite d6/d9/d43/f72 [0,4194304] 0 2023-12-05T09:57:28.589 INFO:tasks.workunit.client.1.smithi150.stdout:9/322: read d3/d9/dc/f4b [908326,66604] 0 2023-12-05T09:57:28.589 INFO:tasks.workunit.client.0.smithi100.stdout:3/433: symlink d0/d2/de/d11/d58/l94 0 2023-12-05T09:57:28.590 INFO:tasks.workunit.client.1.smithi150.stdout:6/309: truncate d2/d23/f45 5177709 0 2023-12-05T09:57:28.594 INFO:tasks.workunit.client.0.smithi100.stdout:8/306: dwrite d0/f37 [0,4194304] 0 2023-12-05T09:57:28.594 INFO:tasks.workunit.client.0.smithi100.stdout:3/434: truncate d0/d10/f43 3785874 0 2023-12-05T09:57:28.594 INFO:tasks.workunit.client.0.smithi100.stdout:3/435: readlink d0/l6 0 2023-12-05T09:57:28.594 INFO:tasks.workunit.client.0.smithi100.stdout:3/436: truncate d0/d10/d39/f80 686068 0 2023-12-05T09:57:28.594 INFO:tasks.workunit.client.0.smithi100.stdout:3/437: creat d0/d2/d62/f95 x:0 0 0 2023-12-05T09:57:28.595 INFO:tasks.workunit.client.0.smithi100.stdout:3/438: dread - d0/d10/d39/f57 zero size 2023-12-05T09:57:28.608 INFO:tasks.workunit.client.0.smithi100.stdout:8/307: link d0/d12/d13/f30 d0/d12/d13/d16/f46 0 2023-12-05T09:57:28.609 INFO:tasks.workunit.client.1.smithi150.stdout:6/310: dread d2/d23/d2e/f3c [0,4194304] 0 2023-12-05T09:57:28.611 INFO:tasks.workunit.client.1.smithi150.stdout:2/351: dread d0/f49 [0,4194304] 0 2023-12-05T09:57:28.613 INFO:tasks.workunit.client.0.smithi100.stdout:0/367: read da/d2a/d45/f49 [1921982,91956] 0 2023-12-05T09:57:28.616 INFO:tasks.workunit.client.0.smithi100.stdout:9/418: dread d7/d1b/d22/d51/f28 [0,4194304] 0 2023-12-05T09:57:28.619 INFO:tasks.workunit.client.0.smithi100.stdout:3/439: truncate d0/d2/de/d12/f1a 6297734 0 2023-12-05T09:57:28.619 INFO:tasks.workunit.client.0.smithi100.stdout:3/440: stat d0/d4/l4e 0 2023-12-05T09:57:28.625 INFO:tasks.workunit.client.1.smithi150.stdout:8/363: rmdir d0/d41/d49 39 2023-12-05T09:57:28.625 INFO:tasks.workunit.client.1.smithi150.stdout:8/364: read - d0/d41/d49/d1b/d24/d2e/f5e zero size 2023-12-05T09:57:28.628 INFO:tasks.workunit.client.0.smithi100.stdout:5/426: dwrite d0/d1f/d25/f50 [0,4194304] 0 2023-12-05T09:57:28.632 INFO:tasks.workunit.client.0.smithi100.stdout:0/368: dread da/d1b/d6b/f6c [0,4194304] 0 2023-12-05T09:57:28.634 INFO:tasks.workunit.client.1.smithi150.stdout:0/396: mknod d5/d11/d16/d1f/d67/c92 0 2023-12-05T09:57:28.634 INFO:tasks.workunit.client.1.smithi150.stdout:0/397: chown d5/d11/d16/c4e 7767 1 2023-12-05T09:57:28.638 INFO:tasks.workunit.client.1.smithi150.stdout:0/398: write d5/d11/d16/d1f/f44 [324214,96703] 0 2023-12-05T09:57:28.638 INFO:tasks.workunit.client.1.smithi150.stdout:4/301: truncate d0/d11/f37 1755517 0 2023-12-05T09:57:28.641 INFO:tasks.workunit.client.0.smithi100.stdout:8/308: mknod d0/d12/d13/c47 0 2023-12-05T09:57:28.643 INFO:tasks.workunit.client.0.smithi100.stdout:9/419: truncate d7/d1b/d22/d2a/d56/d2e/d50/f61 360784 0 2023-12-05T09:57:28.645 INFO:tasks.workunit.client.1.smithi150.stdout:9/323: dwrite d3/d42/f56 [0,4194304] 0 2023-12-05T09:57:28.646 INFO:tasks.workunit.client.0.smithi100.stdout:1/374: sync 2023-12-05T09:57:28.647 INFO:tasks.workunit.client.0.smithi100.stdout:3/441: link d0/d2/l2d d0/d10/l96 0 2023-12-05T09:57:28.649 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:28 smithi100 ceph-mon[107145]: pgmap v30: 65 pgs: 65 active+clean; 1.2 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 106 MiB/s rd, 128 MiB/s wr, 202 op/s 2023-12-05T09:57:28.649 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:28 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:57:28.649 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:28 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:57:28.649 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:28 smithi100 ceph-mon[107145]: Reconfiguring prometheus.smithi100 (dependencies changed)... 2023-12-05T09:57:28.649 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:28 smithi100 ceph-mon[107145]: Reconfiguring daemon prometheus.smithi100 on smithi100 2023-12-05T09:57:28.650 INFO:tasks.workunit.client.0.smithi100.stdout:6/722: sync 2023-12-05T09:57:28.650 INFO:tasks.workunit.client.1.smithi150.stdout:8/365: dread d0/d41/d49/d1b/f2f [0,4194304] 0 2023-12-05T09:57:28.652 INFO:tasks.workunit.client.0.smithi100.stdout:8/309: dread d0/d12/f36 [0,4194304] 0 2023-12-05T09:57:28.653 INFO:tasks.workunit.client.0.smithi100.stdout:8/310: creat d0/d12/f48 x:0 0 0 2023-12-05T09:57:28.660 INFO:tasks.workunit.client.0.smithi100.stdout:3/442: dread d0/d2/de/d12/f1a [4194304,4194304] 0 2023-12-05T09:57:28.660 INFO:tasks.workunit.client.0.smithi100.stdout:3/443: chown d0/f3b 3 1 2023-12-05T09:57:28.663 INFO:tasks.workunit.client.0.smithi100.stdout:0/369: rename c5 to da/d60/c6f 0 2023-12-05T09:57:28.663 INFO:tasks.workunit.client.0.smithi100.stdout:8/311: rename d0/d12/d13 to d0/d12/d13/d16/d42/d43/d49 22 2023-12-05T09:57:28.664 INFO:tasks.workunit.client.0.smithi100.stdout:9/420: mknod d7/d1b/d22/d51/d32/c88 0 2023-12-05T09:57:28.668 INFO:tasks.workunit.client.0.smithi100.stdout:1/375: creat db/d12/d61/d66/f76 x:0 0 0 2023-12-05T09:57:28.668 INFO:tasks.workunit.client.0.smithi100.stdout:1/376: truncate db/d12/d1e/d26/d30/d52/f5f 252996 0 2023-12-05T09:57:28.668 INFO:tasks.workunit.client.1.smithi150.stdout:5/349: rename d1/d3/d38 to d1/d7f 0 2023-12-05T09:57:28.671 INFO:tasks.workunit.client.1.smithi150.stdout:3/378: mkdir d6/d9/d3d/d56/d79 0 2023-12-05T09:57:28.671 INFO:tasks.workunit.client.1.smithi150.stdout:3/379: truncate d6/d25/f62 266815 0 2023-12-05T09:57:28.674 INFO:tasks.workunit.client.1.smithi150.stdout:6/311: unlink d2/d23/d3b/c42 0 2023-12-05T09:57:28.674 INFO:tasks.workunit.client.1.smithi150.stdout:6/312: truncate d2/d23/f67 395673 0 2023-12-05T09:57:28.675 INFO:tasks.workunit.client.0.smithi100.stdout:5/427: truncate d0/d4/fa 5592456 0 2023-12-05T09:57:28.675 INFO:tasks.workunit.client.0.smithi100.stdout:5/428: write d0/d1f/f6a [4797656,16957] 0 2023-12-05T09:57:28.680 INFO:tasks.workunit.client.1.smithi150.stdout:0/399: mknod d5/d11/d71/d74/c93 0 2023-12-05T09:57:28.685 INFO:tasks.workunit.client.0.smithi100.stdout:3/444: mkdir d0/d3d/d90/d97 0 2023-12-05T09:57:28.686 INFO:tasks.workunit.client.1.smithi150.stdout:4/302: symlink d0/d42/d44/l5a 0 2023-12-05T09:57:28.686 INFO:tasks.workunit.client.1.smithi150.stdout:4/303: chown d0/d3e/d48/f53 225855 1 2023-12-05T09:57:28.686 INFO:tasks.workunit.client.1.smithi150.stdout:5/350: read d1/d3/d6/d1b/d22/d24/f41 [2230765,27646] 0 2023-12-05T09:57:28.686 INFO:tasks.workunit.client.1.smithi150.stdout:5/351: readlink d1/d3/d6/d1b/l77 0 2023-12-05T09:57:28.686 INFO:tasks.workunit.client.1.smithi150.stdout:5/352: creat d1/d2e/f80 x:0 0 0 2023-12-05T09:57:28.689 INFO:tasks.workunit.client.0.smithi100.stdout:8/312: truncate d0/fc 45292 0 2023-12-05T09:57:28.689 INFO:tasks.workunit.client.0.smithi100.stdout:8/313: creat d0/d12/d13/d16/f4a x:0 0 0 2023-12-05T09:57:28.690 INFO:tasks.workunit.client.1.smithi150.stdout:1/373: sync 2023-12-05T09:57:28.690 INFO:tasks.workunit.client.0.smithi100.stdout:9/421: read d7/d1b/d22/f4a [1147751,31110] 0 2023-12-05T09:57:28.694 INFO:tasks.workunit.client.0.smithi100.stdout:6/723: rename d7/d11/f6d to d7/d11/fed 0 2023-12-05T09:57:28.694 INFO:tasks.workunit.client.0.smithi100.stdout:5/429: dread d0/d16/d2b/d48/f65 [0,4194304] 0 2023-12-05T09:57:28.697 INFO:tasks.workunit.client.1.smithi150.stdout:9/324: truncate d3/d9/dc/f33 740085 0 2023-12-05T09:57:28.697 INFO:tasks.workunit.client.1.smithi150.stdout:9/325: readlink d3/d9/d26/l4a 0 2023-12-05T09:57:28.697 INFO:tasks.workunit.client.1.smithi150.stdout:8/366: rmdir d0/d41/d49 39 2023-12-05T09:57:28.697 INFO:tasks.workunit.client.1.smithi150.stdout:8/367: chown d0/d41/d49/d1b 534208 1 2023-12-05T09:57:28.697 INFO:tasks.workunit.client.1.smithi150.stdout:8/368: stat d0/d41/f71 0 2023-12-05T09:57:28.697 INFO:tasks.workunit.client.1.smithi150.stdout:8/369: read - d0/d41/d49/d1b/d24/d2e/f53 zero size 2023-12-05T09:57:28.697 INFO:tasks.workunit.client.1.smithi150.stdout:8/370: chown d0/d41/d49/d1b/d24/d34/d56 255275 1 2023-12-05T09:57:28.702 INFO:tasks.workunit.client.1.smithi150.stdout:7/373: rename d2/db/f26 to d2/db/d17/d20/f75 0 2023-12-05T09:57:28.702 INFO:tasks.workunit.client.0.smithi100.stdout:3/445: dread d0/d2/d33/f78 [0,4194304] 0 2023-12-05T09:57:28.703 INFO:tasks.workunit.client.1.smithi150.stdout:3/380: creat d6/d25/d28/d67/f7a x:0 0 0 2023-12-05T09:57:28.706 INFO:tasks.workunit.client.0.smithi100.stdout:9/422: mkdir d7/d1b/d89 0 2023-12-05T09:57:28.713 INFO:tasks.workunit.client.0.smithi100.stdout:6/724: rename d7/d11/fed to d7/fee 0 2023-12-05T09:57:28.713 INFO:tasks.workunit.client.0.smithi100.stdout:6/725: write d7/d76/f93 [362326,13297] 0 2023-12-05T09:57:28.713 INFO:tasks.workunit.client.0.smithi100.stdout:9/423: creat d7/d20/d68/f8a x:0 0 0 2023-12-05T09:57:28.714 INFO:tasks.workunit.client.0.smithi100.stdout:9/424: chown d7/d1b/d22/d51 152270 1 2023-12-05T09:57:28.715 INFO:tasks.workunit.client.1.smithi150.stdout:6/313: mkdir d2/d23/d60/d69 0 2023-12-05T09:57:28.715 INFO:tasks.workunit.client.1.smithi150.stdout:4/304: rmdir d0/d11 39 2023-12-05T09:57:28.718 INFO:tasks.workunit.client.0.smithi100.stdout:5/430: rename d0/d16/d2b/d48/f13 to d0/d16/d2b/f91 0 2023-12-05T09:57:28.718 INFO:tasks.workunit.client.0.smithi100.stdout:5/431: chown d0/d27 31 1 2023-12-05T09:57:28.718 INFO:tasks.workunit.client.1.smithi150.stdout:3/381: dread d6/d9/d3d/d52/d5b/f44 [0,4194304] 0 2023-12-05T09:57:28.719 INFO:tasks.workunit.client.1.smithi150.stdout:3/382: write d6/d9/d3d/d52/f65 [133785,117270] 0 2023-12-05T09:57:28.722 INFO:tasks.workunit.client.0.smithi100.stdout:9/425: mknod d7/d1b/d22/d2a/d74/c8b 0 2023-12-05T09:57:28.725 INFO:tasks.workunit.client.0.smithi100.stdout:6/726: link d7/d11/f8f d7/d11/d1a/db7/fef 0 2023-12-05T09:57:28.725 INFO:tasks.workunit.client.1.smithi150.stdout:1/374: mknod d6/d8/d59/c83 0 2023-12-05T09:57:28.725 INFO:tasks.workunit.client.1.smithi150.stdout:9/326: mkdir d3/d1b/d46/d55/d64 0 2023-12-05T09:57:28.725 INFO:tasks.workunit.client.1.smithi150.stdout:9/327: chown d3/d9/f54 24 1 2023-12-05T09:57:28.727 INFO:tasks.workunit.client.1.smithi150.stdout:8/371: write d0/d41/d49/d1b/d24/d38/f6a [3898312,46099] 0 2023-12-05T09:57:28.730 INFO:tasks.workunit.client.1.smithi150.stdout:0/400: getdents d5 0 2023-12-05T09:57:28.734 INFO:tasks.workunit.client.0.smithi100.stdout:3/446: rename d0/d2/de/d12/f1a to d0/d10/d39/f98 0 2023-12-05T09:57:28.739 INFO:tasks.workunit.client.1.smithi150.stdout:6/314: rename d2/da/c1d to d2/d23/d60/d69/c6a 0 2023-12-05T09:57:28.739 INFO:tasks.workunit.client.1.smithi150.stdout:6/315: truncate d2/f5a 799241 0 2023-12-05T09:57:28.745 INFO:tasks.workunit.client.0.smithi100.stdout:5/432: unlink d0/d16/d2b/d48/df/f20 0 2023-12-05T09:57:28.746 INFO:tasks.workunit.client.1.smithi150.stdout:0/401: write d5/d11/d71/f56 [521180,3086] 0 2023-12-05T09:57:28.746 INFO:tasks.workunit.client.1.smithi150.stdout:0/402: write d5/d11/d32/f91 [85096,60131] 0 2023-12-05T09:57:28.746 INFO:tasks.workunit.client.1.smithi150.stdout:0/403: write d5/d11/d71/d5f/f70 [756077,100844] 0 2023-12-05T09:57:28.749 INFO:tasks.workunit.client.0.smithi100.stdout:9/426: creat d7/d1b/d22/d51/d32/f8c x:0 0 0 2023-12-05T09:57:28.749 INFO:tasks.workunit.client.0.smithi100.stdout:9/427: fdatasync d7/d1b/d22/d51/d32/f42 0 2023-12-05T09:57:28.749 INFO:tasks.workunit.client.1.smithi150.stdout:2/352: sync 2023-12-05T09:57:28.754 INFO:tasks.workunit.client.0.smithi100.stdout:6/727: mkdir d7/dcc/df0 0 2023-12-05T09:57:28.754 INFO:tasks.workunit.client.0.smithi100.stdout:6/728: truncate d7/d27/f9a 665105 0 2023-12-05T09:57:28.755 INFO:tasks.workunit.client.1.smithi150.stdout:8/372: rename d0/d41/d49/d1b/d24/d34/d56/f54 to d0/d41/d49/d1b/d24/d38/d62/f75 0 2023-12-05T09:57:28.755 INFO:tasks.workunit.client.0.smithi100.stdout:0/370: dwrite da/d2a/f3f [0,4194304] 0 2023-12-05T09:57:28.756 INFO:tasks.workunit.client.0.smithi100.stdout:3/447: creat d0/d4/d3a/f99 x:0 0 0 2023-12-05T09:57:28.758 INFO:tasks.workunit.client.1.smithi150.stdout:3/383: symlink d6/d9/d3d/d52/d5b/l7b 0 2023-12-05T09:57:28.759 INFO:tasks.workunit.client.1.smithi150.stdout:0/404: truncate d5/d11/d16/d1f/f44 401959 0 2023-12-05T09:57:28.760 INFO:tasks.workunit.client.0.smithi100.stdout:3/448: creat d0/d3d/d5c/d6f/d7f/d87/f9a x:0 0 0 2023-12-05T09:57:28.760 INFO:tasks.workunit.client.0.smithi100.stdout:3/449: fdatasync d0/d3d/f6c 0 2023-12-05T09:57:28.760 INFO:tasks.workunit.client.1.smithi150.stdout:2/353: symlink d0/d3/d11/d1d/l7e 0 2023-12-05T09:57:28.760 INFO:tasks.workunit.client.1.smithi150.stdout:2/354: fsync d0/d3/d5/d22/d52/d5a/f7a 0 2023-12-05T09:57:28.760 INFO:tasks.workunit.client.1.smithi150.stdout:2/355: chown d0/d3/l4 3 1 2023-12-05T09:57:28.762 INFO:tasks.workunit.client.1.smithi150.stdout:8/373: creat d0/d41/d49/d1b/d24/d34/d56/f76 x:0 0 0 2023-12-05T09:57:28.762 INFO:tasks.workunit.client.1.smithi150.stdout:3/384: mknod d6/d25/d28/d67/c7c 0 2023-12-05T09:57:28.762 INFO:tasks.workunit.client.1.smithi150.stdout:3/385: getdents d6/d9/d43/d75 0 2023-12-05T09:57:28.762 INFO:tasks.workunit.client.1.smithi150.stdout:3/386: chown d6/d25/c61 990217146 1 2023-12-05T09:57:28.763 INFO:tasks.workunit.client.1.smithi150.stdout:0/405: truncate d5/d11/d16/d3f/f3d 2516506 0 2023-12-05T09:57:28.765 INFO:tasks.workunit.client.1.smithi150.stdout:2/356: unlink d0/d3/d21/c24 0 2023-12-05T09:57:28.765 INFO:tasks.workunit.client.1.smithi150.stdout:2/357: chown d0/d3/d11/d1d/f29 14892050 1 2023-12-05T09:57:28.765 INFO:tasks.workunit.client.1.smithi150.stdout:2/358: creat d0/d3/d5/d22/f7f x:0 0 0 2023-12-05T09:57:28.765 INFO:tasks.workunit.client.1.smithi150.stdout:2/359: chown d0/d3/d11/c5f 1547 1 2023-12-05T09:57:28.766 INFO:tasks.workunit.client.0.smithi100.stdout:5/433: dread d0/d27/f4b [0,4194304] 0 2023-12-05T09:57:28.766 INFO:tasks.workunit.client.0.smithi100.stdout:3/450: mkdir d0/d2/de/d12/d9b 0 2023-12-05T09:57:28.767 INFO:tasks.workunit.client.0.smithi100.stdout:3/451: dread - d0/d3d/d5c/d6f/f8c zero size 2023-12-05T09:57:28.767 INFO:tasks.workunit.client.0.smithi100.stdout:5/434: creat d0/d1f/d53/f92 x:0 0 0 2023-12-05T09:57:28.772 INFO:tasks.workunit.client.1.smithi150.stdout:0/406: unlink d5/d11/d71/d5f/f6f 0 2023-12-05T09:57:28.772 INFO:tasks.workunit.client.1.smithi150.stdout:0/407: write d5/d11/d65/d82/f88 [715336,40224] 0 2023-12-05T09:57:28.773 INFO:tasks.workunit.client.1.smithi150.stdout:0/408: chown d5/d11/d16/d3f/l4b 853979 1 2023-12-05T09:57:28.773 INFO:tasks.workunit.client.1.smithi150.stdout:0/409: write d5/d11/d16/d3f/d3b/f6c [1032988,5485] 0 2023-12-05T09:57:28.774 INFO:tasks.workunit.client.0.smithi100.stdout:1/377: dwrite db/d31/f46 [0,4194304] 0 2023-12-05T09:57:28.774 INFO:tasks.workunit.client.1.smithi150.stdout:1/375: getdents d6/d8/d59 0 2023-12-05T09:57:28.775 INFO:tasks.workunit.client.1.smithi150.stdout:9/328: write d3/d9/f14 [882370,40487] 0 2023-12-05T09:57:28.775 INFO:tasks.workunit.client.1.smithi150.stdout:9/329: readlink d3/d9/dc/d1f/d24/l47 0 2023-12-05T09:57:28.775 INFO:tasks.workunit.client.1.smithi150.stdout:5/353: dwrite d1/d7f/d65/d3b/d37/f69 [0,4194304] 0 2023-12-05T09:57:28.775 INFO:tasks.workunit.client.1.smithi150.stdout:4/305: dwrite d0/d3e/d48/d4d/f57 [0,4194304] 0 2023-12-05T09:57:28.777 INFO:tasks.workunit.client.1.smithi150.stdout:3/387: dread d6/d25/d28/f3a [0,4194304] 0 2023-12-05T09:57:28.778 INFO:tasks.workunit.client.1.smithi150.stdout:7/374: dwrite d2/db/d17/d20/f3f [0,4194304] 0 2023-12-05T09:57:28.778 INFO:tasks.workunit.client.0.smithi100.stdout:8/314: dwrite d0/d12/f36 [0,4194304] 0 2023-12-05T09:57:28.778 INFO:tasks.workunit.client.0.smithi100.stdout:9/428: dread d7/d20/f2c [0,4194304] 0 2023-12-05T09:57:28.779 INFO:tasks.workunit.client.1.smithi150.stdout:2/360: symlink d0/d3/d5/d10/d3d/l80 0 2023-12-05T09:57:28.779 INFO:tasks.workunit.client.1.smithi150.stdout:2/361: write d0/d3/d5/d22/f65 [769238,45796] 0 2023-12-05T09:57:28.780 INFO:tasks.workunit.client.0.smithi100.stdout:6/729: dread d7/d27/fb5 [0,4194304] 0 2023-12-05T09:57:28.782 INFO:tasks.workunit.client.1.smithi150.stdout:0/410: rename d5/d11/d32/c54 to d5/d11/d16/d3f/d3b/c94 0 2023-12-05T09:57:28.786 INFO:tasks.workunit.client.0.smithi100.stdout:5/435: rename d0/d4/d14/l41 to d0/d1b/d4d/d8e/l93 0 2023-12-05T09:57:28.786 INFO:tasks.workunit.client.0.smithi100.stdout:5/436: chown d0/d1f/d53 575547428 1 2023-12-05T09:57:28.786 INFO:tasks.workunit.client.0.smithi100.stdout:5/437: truncate d0/d1b/f39 4817466 0 2023-12-05T09:57:28.786 INFO:tasks.workunit.client.0.smithi100.stdout:5/438: truncate d0/d1f/d53/f7c 794353 0 2023-12-05T09:57:28.787 INFO:tasks.workunit.client.0.smithi100.stdout:3/452: dread d0/d2/f37 [0,4194304] 0 2023-12-05T09:57:28.787 INFO:tasks.workunit.client.0.smithi100.stdout:0/371: read da/d1b/d36/f4f [167912,125436] 0 2023-12-05T09:57:28.787 INFO:tasks.workunit.client.0.smithi100.stdout:8/315: read d0/d12/d13/d16/f3a [739437,39419] 0 2023-12-05T09:57:28.789 INFO:tasks.workunit.client.1.smithi150.stdout:6/316: dwrite d2/f13 [0,4194304] 0 2023-12-05T09:57:28.797 INFO:tasks.workunit.client.1.smithi150.stdout:4/306: dread d0/d3e/d48/d4d/f57 [0,4194304] 0 2023-12-05T09:57:28.806 INFO:tasks.workunit.client.1.smithi150.stdout:1/376: mkdir d6/d8/db/d1b/d84 0 2023-12-05T09:57:28.812 INFO:tasks.workunit.client.1.smithi150.stdout:3/388: creat d6/d9/d3d/d56/f7d x:0 0 0 2023-12-05T09:57:28.823 INFO:tasks.workunit.client.1.smithi150.stdout:8/374: dwrite d0/d41/d49/d1b/d24/d34/d56/f76 [0,4194304] 0 2023-12-05T09:57:28.826 INFO:tasks.workunit.client.1.smithi150.stdout:2/362: mkdir d0/d3/d5/d10/d3d/d41/d81 0 2023-12-05T09:57:28.826 INFO:tasks.workunit.client.1.smithi150.stdout:2/363: creat d0/d3/d5/d22/f82 x:0 0 0 2023-12-05T09:57:28.830 INFO:tasks.workunit.client.1.smithi150.stdout:9/330: rename d3/d1b/c3b to d3/d1b/d46/d55/d64/c65 0 2023-12-05T09:57:28.833 INFO:tasks.workunit.client.1.smithi150.stdout:0/411: creat d5/d11/d71/d5f/d77/f95 x:0 0 0 2023-12-05T09:57:28.844 INFO:tasks.workunit.client.0.smithi100.stdout:1/378: link db/d12/d61/d66/d67/f6b db/d12/d1e/d26/d30/d52/f77 0 2023-12-05T09:57:28.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:28 smithi150 ceph-mon[116142]: pgmap v30: 65 pgs: 65 active+clean; 1.2 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 106 MiB/s rd, 128 MiB/s wr, 202 op/s 2023-12-05T09:57:28.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:28 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:57:28.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:28 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:57:28.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:28 smithi150 ceph-mon[116142]: Reconfiguring prometheus.smithi100 (dependencies changed)... 2023-12-05T09:57:28.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:28 smithi150 ceph-mon[116142]: Reconfiguring daemon prometheus.smithi100 on smithi100 2023-12-05T09:57:28.847 INFO:tasks.workunit.client.0.smithi100.stdout:8/316: dwrite d0/d12/d13/d16/f2e [0,4194304] 0 2023-12-05T09:57:28.849 INFO:tasks.workunit.client.1.smithi150.stdout:5/354: dwrite d1/d3/d6/d26/f28 [0,4194304] 0 2023-12-05T09:57:28.850 INFO:tasks.workunit.client.0.smithi100.stdout:6/730: unlink d7/d11/d1a/db1/fb6 0 2023-12-05T09:57:28.850 INFO:tasks.workunit.client.1.smithi150.stdout:6/317: dwrite d2/da/f27 [8388608,4194304] 0 2023-12-05T09:57:28.852 INFO:tasks.workunit.client.1.smithi150.stdout:4/307: dwrite d0/f41 [0,4194304] 0 2023-12-05T09:57:28.852 INFO:tasks.workunit.client.1.smithi150.stdout:4/308: fsync d0/d3e/d48/f53 0 2023-12-05T09:57:28.858 INFO:tasks.workunit.client.1.smithi150.stdout:8/375: creat d0/d41/d49/d1b/d24/d38/f77 x:0 0 0 2023-12-05T09:57:28.859 INFO:tasks.workunit.client.1.smithi150.stdout:8/376: write d0/d8/f2c [3632203,82566] 0 2023-12-05T09:57:28.859 INFO:tasks.workunit.client.1.smithi150.stdout:8/377: readlink d0/d41/d49/l3c 0 2023-12-05T09:57:28.863 INFO:tasks.workunit.client.0.smithi100.stdout:5/439: creat d0/d16/d2b/d48/df/d51/f94 x:0 0 0 2023-12-05T09:57:28.866 INFO:tasks.workunit.client.1.smithi150.stdout:2/364: creat d0/d3/d27/f83 x:0 0 0 2023-12-05T09:57:28.866 INFO:tasks.workunit.client.1.smithi150.stdout:2/365: chown d0/d3/d5/d3b/d4c/c50 0 1 2023-12-05T09:57:28.866 INFO:tasks.workunit.client.0.smithi100.stdout:3/453: creat d0/d10/d39/f9c x:0 0 0 2023-12-05T09:57:28.869 INFO:tasks.workunit.client.0.smithi100.stdout:0/372: rmdir da/d2a/d59 0 2023-12-05T09:57:28.871 INFO:tasks.workunit.client.1.smithi150.stdout:5/355: dread d1/d3/d6/d1b/d22/d24/f41 [0,4194304] 0 2023-12-05T09:57:28.878 INFO:tasks.workunit.client.0.smithi100.stdout:9/429: mknod d7/d1b/d22/d51/c8d 0 2023-12-05T09:57:28.878 INFO:tasks.workunit.client.0.smithi100.stdout:9/430: dread - d7/d1b/d22/d2a/f79 zero size 2023-12-05T09:57:28.878 INFO:tasks.workunit.client.0.smithi100.stdout:9/431: chown d7/d1b/d22/d2a/d74 0 1 2023-12-05T09:57:28.879 INFO:tasks.workunit.client.0.smithi100.stdout:8/317: truncate d0/f31 4014044 0 2023-12-05T09:57:28.879 INFO:tasks.workunit.client.0.smithi100.stdout:8/318: dread - d0/d12/d13/d16/f27 zero size 2023-12-05T09:57:28.880 INFO:tasks.workunit.client.0.smithi100.stdout:6/731: truncate d7/d2d/fbd 3590147 0 2023-12-05T09:57:28.882 INFO:tasks.workunit.client.1.smithi150.stdout:9/331: rename d3 to d3/d9/dc/d1f/d66 22 2023-12-05T09:57:28.883 INFO:tasks.workunit.client.1.smithi150.stdout:9/332: chown d3/d1b/f59 930757218 1 2023-12-05T09:57:28.883 INFO:tasks.workunit.client.1.smithi150.stdout:9/333: chown d3/d9/l30 0 1 2023-12-05T09:57:28.883 INFO:tasks.workunit.client.1.smithi150.stdout:0/412: mkdir d5/d11/d16/d3f/d96 0 2023-12-05T09:57:28.883 INFO:tasks.workunit.client.0.smithi100.stdout:5/440: chown d0/d1f/l6f 3014 1 2023-12-05T09:57:28.886 INFO:tasks.workunit.client.0.smithi100.stdout:6/732: dread d7/f23 [0,4194304] 0 2023-12-05T09:57:28.890 INFO:tasks.workunit.client.0.smithi100.stdout:3/454: rmdir d0/d3d/d90/d97 0 2023-12-05T09:57:28.890 INFO:tasks.workunit.client.0.smithi100.stdout:0/373: link da/d1b/c20 da/d2a/d4d/c70 0 2023-12-05T09:57:28.891 INFO:tasks.workunit.client.0.smithi100.stdout:7/334: sync 2023-12-05T09:57:28.891 INFO:tasks.workunit.client.0.smithi100.stdout:7/335: chown d3/dc/d11/d13/de/d2d/f6d 439 1 2023-12-05T09:57:28.898 INFO:tasks.workunit.client.1.smithi150.stdout:9/334: read d3/d1b/f36 [959194,37898] 0 2023-12-05T09:57:28.899 INFO:tasks.workunit.client.1.smithi150.stdout:9/335: fdatasync d3/d9/dc/f1d 0 2023-12-05T09:57:28.903 INFO:tasks.workunit.client.0.smithi100.stdout:2/510: sync 2023-12-05T09:57:28.903 INFO:tasks.workunit.client.0.smithi100.stdout:4/337: sync 2023-12-05T09:57:28.903 INFO:tasks.workunit.client.0.smithi100.stdout:9/432: dread d7/d1b/f30 [0,4194304] 0 2023-12-05T09:57:28.903 INFO:tasks.workunit.client.0.smithi100.stdout:1/379: symlink db/l78 0 2023-12-05T09:57:28.903 INFO:tasks.workunit.client.0.smithi100.stdout:1/380: chown db/d12/d1e/d26 1245187569 1 2023-12-05T09:57:28.904 INFO:tasks.workunit.client.1.smithi150.stdout:3/389: rmdir d6/d9/d3d/d52 39 2023-12-05T09:57:28.904 INFO:tasks.workunit.client.1.smithi150.stdout:3/390: truncate d6/d22/d37/f4a 769290 0 2023-12-05T09:57:28.912 INFO:tasks.workunit.client.1.smithi150.stdout:3/391: write d6/d9/d3d/d56/d71/f73 [1423230,30242] 0 2023-12-05T09:57:28.914 INFO:tasks.workunit.client.0.smithi100.stdout:2/511: symlink d7/da/d18/d21/d86/d92/laf 0 2023-12-05T09:57:28.914 INFO:tasks.workunit.client.0.smithi100.stdout:2/512: chown d7/da/d18/d1b/d2c/d3f/d72 2 1 2023-12-05T09:57:28.914 INFO:tasks.workunit.client.0.smithi100.stdout:2/513: fdatasync d7/da/dc/d88/f91 0 2023-12-05T09:57:28.914 INFO:tasks.workunit.client.0.smithi100.stdout:2/514: fdatasync d7/da/dc/d88/f91 0 2023-12-05T09:57:28.914 INFO:tasks.workunit.client.0.smithi100.stdout:2/515: chown d7/da/d13/d4e/c74 45900 1 2023-12-05T09:57:28.914 INFO:tasks.workunit.client.0.smithi100.stdout:2/516: dread - d7/d61/f95 zero size 2023-12-05T09:57:28.915 INFO:tasks.workunit.client.0.smithi100.stdout:8/319: dread d0/f19 [0,4194304] 0 2023-12-05T09:57:28.915 INFO:tasks.workunit.client.1.smithi150.stdout:4/309: mkdir d0/d3e/d5b 0 2023-12-05T09:57:28.915 INFO:tasks.workunit.client.0.smithi100.stdout:5/441: rmdir d0/d1f/d25/d31 39 2023-12-05T09:57:28.916 INFO:tasks.workunit.client.0.smithi100.stdout:6/733: unlink d7/d11/l15 0 2023-12-05T09:57:28.918 INFO:tasks.workunit.client.0.smithi100.stdout:4/338: write de/f12 [3146153,34957] 0 2023-12-05T09:57:28.928 INFO:tasks.workunit.client.0.smithi100.stdout:9/433: creat d7/d1b/d22/d2a/d74/f8e x:0 0 0 2023-12-05T09:57:28.929 INFO:tasks.workunit.client.0.smithi100.stdout:2/517: mknod d7/da/d18/d1b/d2c/d3f/d72/cb0 0 2023-12-05T09:57:28.929 INFO:tasks.workunit.client.0.smithi100.stdout:9/434: readlink d7/d1b/d22/l24 0 2023-12-05T09:57:28.931 INFO:tasks.workunit.client.1.smithi150.stdout:2/366: creat d0/d3/d21/d4d/f84 x:0 0 0 2023-12-05T09:57:28.932 INFO:tasks.workunit.client.0.smithi100.stdout:5/442: fdatasync d0/d1f/f86 0 2023-12-05T09:57:28.937 INFO:tasks.workunit.client.1.smithi150.stdout:7/375: rename d2/db/d30/d18/f5f to d2/db/d2e/f76 0 2023-12-05T09:57:28.937 INFO:tasks.workunit.client.1.smithi150.stdout:5/356: dwrite d1/d7f/f4f [0,4194304] 0 2023-12-05T09:57:28.937 INFO:tasks.workunit.client.1.smithi150.stdout:5/357: fdatasync d1/f55 0 2023-12-05T09:57:28.937 INFO:tasks.workunit.client.1.smithi150.stdout:5/358: creat d1/d3/d6/f81 x:0 0 0 2023-12-05T09:57:28.938 INFO:tasks.workunit.client.1.smithi150.stdout:5/359: fsync d1/d3/d6/d26/f3e 0 2023-12-05T09:57:28.938 INFO:tasks.workunit.client.1.smithi150.stdout:5/360: chown d1/d7f/d65/d3b 4568 1 2023-12-05T09:57:28.938 INFO:tasks.workunit.client.0.smithi100.stdout:6/734: mknod d7/d11/d82/db9/cf1 0 2023-12-05T09:57:28.938 INFO:tasks.workunit.client.0.smithi100.stdout:6/735: fdatasync d7/d2d/f42 0 2023-12-05T09:57:28.938 INFO:tasks.workunit.client.1.smithi150.stdout:0/413: mknod d5/d11/d16/d3f/c97 0 2023-12-05T09:57:28.940 INFO:tasks.workunit.client.1.smithi150.stdout:4/310: write d0/f3c [5185966,84929] 0 2023-12-05T09:57:28.940 INFO:tasks.workunit.client.1.smithi150.stdout:4/311: write d0/d11/f12 [93207,38260] 0 2023-12-05T09:57:28.940 INFO:tasks.workunit.client.0.smithi100.stdout:4/339: mknod de/d16/d23/d33/c6d 0 2023-12-05T09:57:28.941 INFO:tasks.workunit.client.0.smithi100.stdout:4/340: stat de/d16/d23/d36 0 2023-12-05T09:57:28.941 INFO:tasks.workunit.client.0.smithi100.stdout:4/341: fdatasync de/d16/d23/d33/d3d/f5a 0 2023-12-05T09:57:28.944 INFO:tasks.workunit.client.0.smithi100.stdout:2/518: symlink d7/da/d18/d1b/d2c/d3f/d98/lb1 0 2023-12-05T09:57:28.946 INFO:tasks.workunit.client.1.smithi150.stdout:7/376: mknod d2/c77 0 2023-12-05T09:57:28.947 INFO:tasks.workunit.client.0.smithi100.stdout:9/435: rename c3 to d7/d1b/d22/d2a/d56/d2e/d50/c8f 0 2023-12-05T09:57:28.947 INFO:tasks.workunit.client.1.smithi150.stdout:2/367: dread d0/d3/d5/d10/f45 [0,4194304] 0 2023-12-05T09:57:28.954 INFO:tasks.workunit.client.0.smithi100.stdout:8/320: getdents d0 0 2023-12-05T09:57:28.957 INFO:tasks.workunit.client.0.smithi100.stdout:5/443: fdatasync d0/d1f/f6a 0 2023-12-05T09:57:28.958 INFO:tasks.workunit.client.0.smithi100.stdout:5/444: creat d0/d16/d2b/d48/f95 x:0 0 0 2023-12-05T09:57:28.959 INFO:tasks.workunit.client.1.smithi150.stdout:5/361: mknod d1/d7f/d65/c82 0 2023-12-05T09:57:28.965 INFO:tasks.workunit.client.0.smithi100.stdout:6/736: truncate d7/d27/f2e 133565 0 2023-12-05T09:57:28.966 INFO:tasks.workunit.client.0.smithi100.stdout:9/436: dread d7/d35/f59 [0,4194304] 0 2023-12-05T09:57:28.969 INFO:tasks.workunit.client.1.smithi150.stdout:6/318: rename d2/da to d2/d23/d60/d5d/d6b 0 2023-12-05T09:57:28.970 INFO:tasks.workunit.client.0.smithi100.stdout:2/519: mknod d7/da/d13/d69/d6e/d71/cb2 0 2023-12-05T09:57:28.970 INFO:tasks.workunit.client.0.smithi100.stdout:2/520: dread - d7/da/d18/d1b/d2c/f70 zero size 2023-12-05T09:57:28.971 INFO:tasks.workunit.client.0.smithi100.stdout:3/455: dwrite d0/d4/d3a/f99 [0,4194304] 0 2023-12-05T09:57:28.973 INFO:tasks.workunit.client.1.smithi150.stdout:3/392: dwrite d6/d25/d28/f3a [0,4194304] 0 2023-12-05T09:57:28.975 INFO:tasks.workunit.client.0.smithi100.stdout:7/336: dwrite d3/dc/d11/d13/de/d2d/f6d [0,4194304] 0 2023-12-05T09:57:28.976 INFO:tasks.workunit.client.1.smithi150.stdout:0/414: symlink d5/d11/d16/d1f/d7f/l98 0 2023-12-05T09:57:28.977 INFO:tasks.workunit.client.1.smithi150.stdout:9/336: dwrite d3/d9/dc/d1f/f25 [0,4194304] 0 2023-12-05T09:57:28.979 INFO:tasks.workunit.client.0.smithi100.stdout:8/321: symlink d0/d12/d13/d45/l4b 0 2023-12-05T09:57:28.986 INFO:tasks.workunit.client.0.smithi100.stdout:5/445: mkdir d0/d1b/d4d/d8e/d96 0 2023-12-05T09:57:28.986 INFO:tasks.workunit.client.0.smithi100.stdout:5/446: truncate d0/d1b/d4d/f87 1015095 0 2023-12-05T09:57:28.986 INFO:tasks.workunit.client.0.smithi100.stdout:5/447: write d0/d27/f5e [462850,18608] 0 2023-12-05T09:57:28.988 INFO:tasks.workunit.client.0.smithi100.stdout:9/437: rename d7/d1b/d22/d51/f87 to d7/d1b/d89/f90 0 2023-12-05T09:57:28.991 INFO:tasks.workunit.client.1.smithi150.stdout:4/312: symlink d0/d42/d44/l5c 0 2023-12-05T09:57:28.991 INFO:tasks.workunit.client.1.smithi150.stdout:4/313: dread - d0/f51 zero size 2023-12-05T09:57:28.991 INFO:tasks.workunit.client.1.smithi150.stdout:1/377: sync 2023-12-05T09:57:28.995 INFO:tasks.workunit.client.1.smithi150.stdout:5/362: rename d1/d3/d6/d1b/d22/l39 to d1/d7f/d65/d3b/d6b/l83 0 2023-12-05T09:57:28.995 INFO:tasks.workunit.client.1.smithi150.stdout:5/363: fsync d1/d2e/f80 0 2023-12-05T09:57:28.997 INFO:tasks.workunit.client.1.smithi150.stdout:6/319: mknod d2/d23/d60/d5d/d6b/d63/c6c 0 2023-12-05T09:57:29.004 INFO:tasks.workunit.client.0.smithi100.stdout:2/521: link d7/da/d18/d1b/d2c/d3f/d98/lb1 d7/da/d65/lb3 0 2023-12-05T09:57:29.004 INFO:tasks.workunit.client.0.smithi100.stdout:3/456: creat d0/d3d/d5c/d5f/d73/f9d x:0 0 0 2023-12-05T09:57:29.004 INFO:tasks.workunit.client.0.smithi100.stdout:3/457: chown d0/d3d/d5c/d6f/f8c 560 1 2023-12-05T09:57:29.004 INFO:tasks.workunit.client.0.smithi100.stdout:3/458: fsync d0/d2/d33/f35 0 2023-12-05T09:57:29.009 INFO:tasks.workunit.client.0.smithi100.stdout:4/342: dwrite de/d16/d23/f37 [4194304,4194304] 0 2023-12-05T09:57:29.010 INFO:tasks.workunit.client.0.smithi100.stdout:8/322: truncate d0/d12/d13/d16/f20 225876 0 2023-12-05T09:57:29.012 INFO:tasks.workunit.client.1.smithi150.stdout:6/320: creat d2/d23/d2e/d5f/f6d x:0 0 0 2023-12-05T09:57:29.012 INFO:tasks.workunit.client.1.smithi150.stdout:6/321: write d2/d23/d60/f40 [1755618,1745] 0 2023-12-05T09:57:29.012 INFO:tasks.workunit.client.1.smithi150.stdout:6/322: chown d2/l66 14 1 2023-12-05T09:57:29.018 INFO:tasks.workunit.client.1.smithi150.stdout:6/323: symlink d2/d23/d2e/d44/l6e 0 2023-12-05T09:57:29.020 INFO:tasks.workunit.client.0.smithi100.stdout:7/337: rename d3/dc/f3a to d3/dc/d11/d13/de/f74 0 2023-12-05T09:57:29.020 INFO:tasks.workunit.client.0.smithi100.stdout:9/438: truncate d7/d1b/d22/f38 2081959 0 2023-12-05T09:57:29.020 INFO:tasks.workunit.client.0.smithi100.stdout:9/439: read d7/d1b/f33 [1707296,104517] 0 2023-12-05T09:57:29.021 INFO:tasks.workunit.client.1.smithi150.stdout:7/377: dwrite d2/db/d30/d18/f57 [0,4194304] 0 2023-12-05T09:57:29.021 INFO:tasks.workunit.client.1.smithi150.stdout:7/378: creat d2/db/d17/f78 x:0 0 0 2023-12-05T09:57:29.021 INFO:tasks.workunit.client.0.smithi100.stdout:2/522: write d7/da/d18/d1b/d2c/d3f/d46/f76 [3542255,130788] 0 2023-12-05T09:57:29.021 INFO:tasks.workunit.client.0.smithi100.stdout:2/523: fdatasync d7/da/d18/d1b/d2c/f49 0 2023-12-05T09:57:29.021 INFO:tasks.workunit.client.0.smithi100.stdout:2/524: stat d7/da/f9c 0 2023-12-05T09:57:29.022 INFO:tasks.workunit.client.0.smithi100.stdout:8/323: symlink d0/d12/l4c 0 2023-12-05T09:57:29.023 INFO:tasks.workunit.client.0.smithi100.stdout:5/448: link d0/d4/fd d0/d1f/f97 0 2023-12-05T09:57:29.024 INFO:tasks.workunit.client.1.smithi150.stdout:6/324: truncate d2/d23/f29 2821331 0 2023-12-05T09:57:29.026 INFO:tasks.workunit.client.0.smithi100.stdout:7/338: unlink d3/dc/d11/d33/f3f 0 2023-12-05T09:57:29.029 INFO:tasks.workunit.client.1.smithi150.stdout:7/379: read - d2/d4/f42 zero size 2023-12-05T09:57:29.029 INFO:tasks.workunit.client.1.smithi150.stdout:7/380: getdents d2/db/d30/d18/d1a/d1e 0 2023-12-05T09:57:29.029 INFO:tasks.workunit.client.1.smithi150.stdout:7/381: fdatasync d2/d39/f64 0 2023-12-05T09:57:29.029 INFO:tasks.workunit.client.1.smithi150.stdout:2/368: dwrite d0/d3/d5/d10/f45 [0,4194304] 0 2023-12-05T09:57:29.032 INFO:tasks.workunit.client.0.smithi100.stdout:6/737: dwrite d7/d11/d82/f28 [0,4194304] 0 2023-12-05T09:57:29.033 INFO:tasks.workunit.client.0.smithi100.stdout:8/324: rename d0/d12/d13/d16/f27 to d0/d12/d13/f4d 0 2023-12-05T09:57:29.034 INFO:tasks.workunit.client.0.smithi100.stdout:7/339: link d3/dc/d11/d13/de/f28 d3/dc/d11/d13/d1b/d60/f75 0 2023-12-05T09:57:29.047 INFO:tasks.workunit.client.1.smithi150.stdout:3/393: dwrite d6/d9/d43/f60 [0,4194304] 0 2023-12-05T09:57:29.052 INFO:tasks.workunit.client.1.smithi150.stdout:0/415: dwrite d5/d11/d65/d82/f88 [0,4194304] 0 2023-12-05T09:57:29.053 INFO:tasks.workunit.client.1.smithi150.stdout:0/416: write d5/d11/d16/f1e [4740186,124474] 0 2023-12-05T09:57:29.059 INFO:tasks.workunit.client.0.smithi100.stdout:5/449: write d0/d1b/f33 [3187676,32396] 0 2023-12-05T09:57:29.072 INFO:tasks.workunit.client.1.smithi150.stdout:4/314: dread d0/f41 [0,4194304] 0 2023-12-05T09:57:29.096 INFO:tasks.workunit.client.1.smithi150.stdout:7/382: unlink d2/d1b/d5b/c50 0 2023-12-05T09:57:29.100 INFO:tasks.workunit.client.1.smithi150.stdout:2/369: unlink d0/d3/d5/d22/l25 0 2023-12-05T09:57:29.100 INFO:tasks.workunit.client.1.smithi150.stdout:2/370: stat d0/d3/cd 0 2023-12-05T09:57:29.100 INFO:tasks.workunit.client.1.smithi150.stdout:2/371: chown d0/d3/d5/f40 494 1 2023-12-05T09:57:29.106 INFO:tasks.workunit.client.1.smithi150.stdout:9/337: dwrite d3/d9/dc/d1f/f25 [0,4194304] 0 2023-12-05T09:57:29.107 INFO:tasks.workunit.client.1.smithi150.stdout:9/338: chown d3/d42/d62/l53 14 1 2023-12-05T09:57:29.113 INFO:tasks.workunit.client.0.smithi100.stdout:6/738: mknod d7/d2d/d6a/d7c/d8d/cf2 0 2023-12-05T09:57:29.114 INFO:tasks.workunit.client.0.smithi100.stdout:6/739: write d7/d27/f5b [465282,8319] 0 2023-12-05T09:57:29.114 INFO:tasks.workunit.client.0.smithi100.stdout:6/740: truncate d7/d11/d82/fd4 1636333 0 2023-12-05T09:57:29.115 INFO:tasks.workunit.client.1.smithi150.stdout:2/372: write d0/d3/d5/f40 [2701461,68791] 0 2023-12-05T09:57:29.115 INFO:tasks.workunit.client.1.smithi150.stdout:0/417: mkdir d5/d11/d71/d99 0 2023-12-05T09:57:29.115 INFO:tasks.workunit.client.1.smithi150.stdout:0/418: readlink l3 0 2023-12-05T09:57:29.115 INFO:tasks.workunit.client.0.smithi100.stdout:8/325: symlink d0/d12/d13/l4e 0 2023-12-05T09:57:29.115 INFO:tasks.workunit.client.0.smithi100.stdout:8/326: fdatasync d0/d12/f2a 0 2023-12-05T09:57:29.120 INFO:tasks.workunit.client.0.smithi100.stdout:5/450: symlink d0/d1b/d4d/d60/l98 0 2023-12-05T09:57:29.120 INFO:tasks.workunit.client.0.smithi100.stdout:5/451: creat d0/d16/f99 x:0 0 0 2023-12-05T09:57:29.121 INFO:tasks.workunit.client.0.smithi100.stdout:5/452: creat d0/d4/d14/f9a x:0 0 0 2023-12-05T09:57:29.121 INFO:tasks.workunit.client.0.smithi100.stdout:3/459: dwrite d0/d4/d3a/f99 [0,4194304] 0 2023-12-05T09:57:29.122 INFO:tasks.workunit.client.1.smithi150.stdout:4/315: truncate d0/fd 3325896 0 2023-12-05T09:57:29.122 INFO:tasks.workunit.client.1.smithi150.stdout:4/316: chown d0/d3e/d48/d4d 3218 1 2023-12-05T09:57:29.122 INFO:tasks.workunit.client.1.smithi150.stdout:7/383: symlink d2/d72/l79 0 2023-12-05T09:57:29.122 INFO:tasks.workunit.client.1.smithi150.stdout:7/384: creat d2/db/d17/f7a x:0 0 0 2023-12-05T09:57:29.122 INFO:tasks.workunit.client.1.smithi150.stdout:9/339: dread d3/d9/f52 [0,4194304] 0 2023-12-05T09:57:29.123 INFO:tasks.workunit.client.1.smithi150.stdout:1/378: dwrite d6/d8/db/f73 [0,4194304] 0 2023-12-05T09:57:29.124 INFO:tasks.workunit.client.0.smithi100.stdout:2/525: dwrite d7/da/f6f [0,4194304] 0 2023-12-05T09:57:29.124 INFO:tasks.workunit.client.0.smithi100.stdout:6/741: link d7/d11/d1a/laf d7/d27/d72/lf3 0 2023-12-05T09:57:29.124 INFO:tasks.workunit.client.1.smithi150.stdout:6/325: dwrite d2/d23/d60/d5d/d6b/f31 [4194304,4194304] 0 2023-12-05T09:57:29.124 INFO:tasks.workunit.client.1.smithi150.stdout:5/364: dwrite d1/d3/f1d [0,4194304] 0 2023-12-05T09:57:29.125 INFO:tasks.workunit.client.1.smithi150.stdout:5/365: fdatasync d1/d64/d31/f49 0 2023-12-05T09:57:29.125 INFO:tasks.workunit.client.1.smithi150.stdout:5/366: fdatasync d1/d3/d6/d1b/f6a 0 2023-12-05T09:57:29.125 INFO:tasks.workunit.client.1.smithi150.stdout:6/326: read d2/d23/d2e/f43 [557588,118094] 0 2023-12-05T09:57:29.126 INFO:tasks.workunit.client.0.smithi100.stdout:8/327: creat d0/d12/d13/d45/f4f x:0 0 0 2023-12-05T09:57:29.130 INFO:tasks.workunit.client.1.smithi150.stdout:2/373: mknod d0/d3/d27/d51/c85 0 2023-12-05T09:57:29.133 INFO:tasks.workunit.client.0.smithi100.stdout:8/328: dread d0/f2b [0,4194304] 0 2023-12-05T09:57:29.134 INFO:tasks.workunit.client.1.smithi150.stdout:0/419: creat d5/d11/d16/d1f/d7f/f9a x:0 0 0 2023-12-05T09:57:29.134 INFO:tasks.workunit.client.0.smithi100.stdout:5/453: mknod d0/d16/d2b/c9b 0 2023-12-05T09:57:29.135 INFO:tasks.workunit.client.0.smithi100.stdout:5/454: write d0/d1f/d25/f63 [943737,117244] 0 2023-12-05T09:57:29.136 INFO:tasks.workunit.client.1.smithi150.stdout:9/340: dread d3/d9/f49 [0,4194304] 0 2023-12-05T09:57:29.139 INFO:tasks.workunit.client.0.smithi100.stdout:3/460: symlink d0/d3d/d5c/d6f/d7f/l9e 0 2023-12-05T09:57:29.141 INFO:tasks.workunit.client.1.smithi150.stdout:4/317: mkdir d0/d3e/d48/d5d 0 2023-12-05T09:57:29.147 INFO:tasks.workunit.client.1.smithi150.stdout:7/385: link d2/d4/ff d2/db/d30/d18/d63/f7b 0 2023-12-05T09:57:29.147 INFO:tasks.workunit.client.1.smithi150.stdout:7/386: readlink d2/d1b/d5b/d6a/l73 0 2023-12-05T09:57:29.147 INFO:tasks.workunit.client.0.smithi100.stdout:6/742: creat d7/d11/d82/ff4 x:0 0 0 2023-12-05T09:57:29.147 INFO:tasks.workunit.client.0.smithi100.stdout:6/743: chown d7/fbe 118281 1 2023-12-05T09:57:29.154 INFO:tasks.workunit.client.1.smithi150.stdout:9/341: dread d3/d9/f52 [0,4194304] 0 2023-12-05T09:57:29.155 INFO:tasks.workunit.client.0.smithi100.stdout:6/744: truncate d7/d11/d1a/f2b 2689698 0 2023-12-05T09:57:29.156 INFO:tasks.workunit.client.0.smithi100.stdout:6/745: truncate d7/d11/d1a/db7/fc0 1595363 0 2023-12-05T09:57:29.156 INFO:tasks.workunit.client.0.smithi100.stdout:6/746: chown d7/d2d/l85 30 1 2023-12-05T09:57:29.156 INFO:tasks.workunit.client.0.smithi100.stdout:6/747: creat d7/d11/de8/ff5 x:0 0 0 2023-12-05T09:57:29.156 INFO:tasks.workunit.client.0.smithi100.stdout:3/461: getdents d0/d3d/d5c/d6f 0 2023-12-05T09:57:29.159 INFO:tasks.workunit.client.0.smithi100.stdout:2/526: dread d7/da/d1a/f73 [0,4194304] 0 2023-12-05T09:57:29.161 INFO:tasks.workunit.client.1.smithi150.stdout:1/379: mkdir d6/d8/d85 0 2023-12-05T09:57:29.167 INFO:tasks.workunit.client.1.smithi150.stdout:5/367: link d1/d64/f58 d1/d7f/d65/d3b/f84 0 2023-12-05T09:57:29.167 INFO:tasks.workunit.client.1.smithi150.stdout:5/368: fdatasync d1/d3/d6/f1c 0 2023-12-05T09:57:29.167 INFO:tasks.workunit.client.1.smithi150.stdout:5/369: creat d1/d3/f85 x:0 0 0 2023-12-05T09:57:29.168 INFO:tasks.workunit.client.0.smithi100.stdout:2/527: mkdir d7/db4 0 2023-12-05T09:57:29.169 INFO:tasks.workunit.client.1.smithi150.stdout:7/387: dread d2/db/d30/d13/f37 [0,4194304] 0 2023-12-05T09:57:29.169 INFO:tasks.workunit.client.1.smithi150.stdout:7/388: write d2/db/d17/d20/f75 [4723052,88168] 0 2023-12-05T09:57:29.170 INFO:tasks.workunit.client.1.smithi150.stdout:0/420: mknod d5/d11/d16/d1f/d7f/c9b 0 2023-12-05T09:57:29.170 INFO:tasks.workunit.client.1.smithi150.stdout:0/421: fsync d5/d11/f59 0 2023-12-05T09:57:29.171 INFO:tasks.workunit.client.0.smithi100.stdout:6/748: getdents d7/d11/d1a 0 2023-12-05T09:57:29.174 INFO:tasks.workunit.client.1.smithi150.stdout:2/374: dwrite d0/d3/d5/d22/d52/d56/f73 [0,4194304] 0 2023-12-05T09:57:29.174 INFO:tasks.workunit.client.1.smithi150.stdout:4/318: truncate d0/d11/f39 932568 0 2023-12-05T09:57:29.175 INFO:tasks.workunit.client.0.smithi100.stdout:6/749: mkdir d7/d27/d97/de7/df6 0 2023-12-05T09:57:29.175 INFO:tasks.workunit.client.1.smithi150.stdout:4/319: write d0/d42/d44/f59 [429721,99389] 0 2023-12-05T09:57:29.179 INFO:tasks.workunit.client.1.smithi150.stdout:1/380: rename d6/d8/db/d1b/f37 to d6/d8/db/d1b/d79/f86 0 2023-12-05T09:57:29.180 INFO:tasks.workunit.client.1.smithi150.stdout:1/381: creat d6/d8/d54/f87 x:0 0 0 2023-12-05T09:57:29.183 INFO:tasks.workunit.client.1.smithi150.stdout:7/389: creat d2/db/d30/d13/d4f/d5a/d5c/f7c x:0 0 0 2023-12-05T09:57:29.184 INFO:tasks.workunit.client.0.smithi100.stdout:5/455: dwrite d0/d16/f99 [0,4194304] 0 2023-12-05T09:57:29.188 INFO:tasks.workunit.client.1.smithi150.stdout:5/370: write d1/d3/d6/f1c [1970485,14057] 0 2023-12-05T09:57:29.193 INFO:tasks.workunit.client.1.smithi150.stdout:1/382: creat d6/d38/d4a/f88 x:0 0 0 2023-12-05T09:57:29.193 INFO:tasks.workunit.client.1.smithi150.stdout:4/320: write d0/f3b [3878741,128489] 0 2023-12-05T09:57:29.194 INFO:tasks.workunit.client.1.smithi150.stdout:4/321: chown d0/d3e/d48/d5d 11103410 1 2023-12-05T09:57:29.194 INFO:tasks.workunit.client.1.smithi150.stdout:4/322: chown d0/l33 180438765 1 2023-12-05T09:57:29.194 INFO:tasks.workunit.client.1.smithi150.stdout:1/383: read d6/d38/d4a/f57 [64938,131072] 0 2023-12-05T09:57:29.203 INFO:tasks.workunit.client.0.smithi100.stdout:3/462: dread d0/d2/de/d12/f29 [0,4194304] 0 2023-12-05T09:57:29.204 INFO:tasks.workunit.client.0.smithi100.stdout:5/456: write d0/d16/d2b/d48/f65 [709973,115831] 0 2023-12-05T09:57:29.219 INFO:tasks.workunit.client.0.smithi100.stdout:8/329: dwrite d0/d12/d13/d16/f23 [0,4194304] 0 2023-12-05T09:57:29.230 INFO:tasks.workunit.client.1.smithi150.stdout:9/342: dwrite d3/d9/dc/f4b [0,4194304] 0 2023-12-05T09:57:29.230 INFO:tasks.workunit.client.1.smithi150.stdout:9/343: chown d3/l48 1199395 1 2023-12-05T09:57:29.230 INFO:tasks.workunit.client.1.smithi150.stdout:2/375: dwrite d0/d3/d21/f2c [4194304,4194304] 0 2023-12-05T09:57:29.231 INFO:tasks.workunit.client.1.smithi150.stdout:2/376: write d0/f16 [3376180,64409] 0 2023-12-05T09:57:29.231 INFO:tasks.workunit.client.0.smithi100.stdout:6/750: dwrite d7/d76/f93 [0,4194304] 0 2023-12-05T09:57:29.252 INFO:tasks.workunit.client.1.smithi150.stdout:8/378: sync 2023-12-05T09:57:29.252 INFO:tasks.workunit.client.1.smithi150.stdout:8/379: creat d0/d41/d49/d1b/d24/d38/f78 x:0 0 0 2023-12-05T09:57:29.256 INFO:tasks.workunit.client.1.smithi150.stdout:1/384: rmdir d6/d8/db/d1b/d84 0 2023-12-05T09:57:29.257 INFO:tasks.workunit.client.0.smithi100.stdout:3/463: symlink d0/d3d/d5c/d6f/d7f/d87/l9f 0 2023-12-05T09:57:29.257 INFO:tasks.workunit.client.0.smithi100.stdout:3/464: chown d0/d4/c1c 68829 1 2023-12-05T09:57:29.276 INFO:tasks.workunit.client.0.smithi100.stdout:8/330: truncate d0/d12/d13/d16/f3a 1980889 0 2023-12-05T09:57:29.277 INFO:tasks.workunit.client.1.smithi150.stdout:3/394: sync 2023-12-05T09:57:29.277 INFO:tasks.workunit.client.1.smithi150.stdout:3/395: readlink l3 0 2023-12-05T09:57:29.278 INFO:tasks.workunit.client.1.smithi150.stdout:3/396: write d6/d22/d37/f4a [136402,96117] 0 2023-12-05T09:57:29.337 INFO:tasks.workunit.client.1.smithi150.stdout:2/377: mkdir d0/d3/d5/d36/d86 0 2023-12-05T09:57:29.338 INFO:tasks.workunit.client.1.smithi150.stdout:2/378: readlink d0/d3/d5/l74 0 2023-12-05T09:57:29.353 INFO:tasks.workunit.client.1.smithi150.stdout:7/390: link d2/c77 d2/db/d30/d18/d1a/d1e/c7d 0 2023-12-05T09:57:29.354 INFO:tasks.workunit.client.1.smithi150.stdout:7/391: readlink d2/d1b/d5b/l4d 0 2023-12-05T09:57:29.364 INFO:tasks.workunit.client.1.smithi150.stdout:7/392: dread d2/db/d30/d18/d1a/d1e/d2b/f34 [0,4194304] 0 2023-12-05T09:57:29.379 INFO:tasks.workunit.client.1.smithi150.stdout:4/323: getdents d0/d11/d4b 0 2023-12-05T09:57:29.381 INFO:tasks.workunit.client.1.smithi150.stdout:1/385: mkdir d6/d47/d4c/d7c/d89 0 2023-12-05T09:57:29.384 INFO:tasks.workunit.client.1.smithi150.stdout:3/397: rename d6/d22/c26 to d6/d22/c7e 0 2023-12-05T09:57:29.388 INFO:tasks.workunit.client.1.smithi150.stdout:2/379: symlink d0/d3/d21/d4d/l87 0 2023-12-05T09:57:29.388 INFO:tasks.workunit.client.1.smithi150.stdout:4/324: dread d0/d3e/d48/f4e [0,4194304] 0 2023-12-05T09:57:29.407 INFO:tasks.workunit.client.1.smithi150.stdout:3/398: dread d6/d9/d3d/d56/d53/f69 [0,4194304] 0 2023-12-05T09:57:29.410 INFO:tasks.workunit.client.0.smithi100.stdout:3/465: truncate d0/d4/f4a 1614311 0 2023-12-05T09:57:29.410 INFO:tasks.workunit.client.0.smithi100.stdout:3/466: truncate d0/d4/d3a/d45/f89 351804 0 2023-12-05T09:57:29.412 INFO:tasks.workunit.client.0.smithi100.stdout:8/331: symlink d0/d12/d13/d16/d22/l50 0 2023-12-05T09:57:29.412 INFO:tasks.workunit.client.0.smithi100.stdout:8/332: stat d0/d12/f32 0 2023-12-05T09:57:29.412 INFO:tasks.workunit.client.0.smithi100.stdout:8/333: write d0/d12/d13/d45/f4f [253209,70518] 0 2023-12-05T09:57:29.412 INFO:tasks.workunit.client.0.smithi100.stdout:8/334: write d0/d12/f32 [498480,112759] 0 2023-12-05T09:57:29.413 INFO:tasks.workunit.client.0.smithi100.stdout:6/751: rmdir d7/d27/d97 39 2023-12-05T09:57:29.414 INFO:tasks.workunit.client.0.smithi100.stdout:6/752: write d7/d11/d1a/db1/fb4 [891086,70118] 0 2023-12-05T09:57:29.421 INFO:tasks.workunit.client.0.smithi100.stdout:3/467: link d0/d10/d39/c66 d0/d10/d39/ca0 0 2023-12-05T09:57:29.421 INFO:tasks.workunit.client.0.smithi100.stdout:3/468: chown d0/d4/l4e 28561352 1 2023-12-05T09:57:29.421 INFO:tasks.workunit.client.0.smithi100.stdout:3/469: fsync d0/d2/f6e 0 2023-12-05T09:57:29.421 INFO:tasks.workunit.client.0.smithi100.stdout:8/335: getdents d0/d12/d13/d16/d42 0 2023-12-05T09:57:29.441 INFO:tasks.workunit.client.1.smithi150.stdout:7/393: dread d2/d4/f23 [0,4194304] 0 2023-12-05T09:57:29.441 INFO:tasks.workunit.client.1.smithi150.stdout:2/380: dwrite d0/d3/d27/f83 [0,4194304] 0 2023-12-05T09:57:29.446 INFO:tasks.workunit.client.1.smithi150.stdout:4/325: dwrite d0/f26 [0,4194304] 0 2023-12-05T09:57:29.446 INFO:tasks.workunit.client.1.smithi150.stdout:4/326: chown d0/d3e/d48/c49 5830 1 2023-12-05T09:57:29.449 INFO:tasks.workunit.client.1.smithi150.stdout:7/394: read d2/db/d30/f9 [277177,26040] 0 2023-12-05T09:57:29.450 INFO:tasks.workunit.client.1.smithi150.stdout:3/399: dwrite d6/d9/d3d/d56/d53/d51/f6b [0,4194304] 0 2023-12-05T09:57:29.453 INFO:tasks.workunit.client.1.smithi150.stdout:4/327: mknod d0/d3e/c5e 0 2023-12-05T09:57:29.457 INFO:tasks.workunit.client.1.smithi150.stdout:7/395: mkdir d2/db/d30/d13/d4f/d7e 0 2023-12-05T09:57:29.461 INFO:tasks.workunit.client.0.smithi100.stdout:6/753: write d7/d11/d82/f28 [2173578,21709] 0 2023-12-05T09:57:29.466 INFO:tasks.workunit.client.0.smithi100.stdout:3/470: dread d0/d2/de/f47 [0,4194304] 0 2023-12-05T09:57:29.472 INFO:tasks.workunit.client.0.smithi100.stdout:6/754: getdents d7/d2d/d6a/d7c 0 2023-12-05T09:57:29.473 INFO:tasks.workunit.client.1.smithi150.stdout:8/380: rename d0/d41/d49/f1a to d0/d41/d49/f79 0 2023-12-05T09:57:29.475 INFO:tasks.workunit.client.0.smithi100.stdout:3/471: mknod d0/d3d/d5c/d5f/ca1 0 2023-12-05T09:57:29.475 INFO:tasks.workunit.client.0.smithi100.stdout:3/472: stat d0/d3d/d5c/d6f/f84 0 2023-12-05T09:57:29.481 INFO:tasks.workunit.client.0.smithi100.stdout:8/336: dwrite d0/d12/d13/d16/f23 [4194304,4194304] 0 2023-12-05T09:57:29.481 INFO:tasks.workunit.client.1.smithi150.stdout:8/381: mknod d0/d8/c7a 0 2023-12-05T09:57:29.490 INFO:tasks.workunit.client.1.smithi150.stdout:8/382: mknod d0/d41/d49/d1b/d24/d34/c7b 0 2023-12-05T09:57:29.492 INFO:tasks.workunit.client.1.smithi150.stdout:2/381: write d0/f49 [1802185,5853] 0 2023-12-05T09:57:29.492 INFO:tasks.workunit.client.1.smithi150.stdout:2/382: stat d0/d3/d21/d4d/l87 0 2023-12-05T09:57:29.495 INFO:tasks.workunit.client.1.smithi150.stdout:5/371: mkdir d1/d3/d6/d1b/d22/d86 0 2023-12-05T09:57:29.495 INFO:tasks.workunit.client.1.smithi150.stdout:7/396: dwrite d2/db/d30/d18/f6c [0,4194304] 0 2023-12-05T09:57:29.495 INFO:tasks.workunit.client.1.smithi150.stdout:7/397: write d2/db/d30/d13/d4f/f59 [802402,91312] 0 2023-12-05T09:57:29.495 INFO:tasks.workunit.client.1.smithi150.stdout:7/398: fdatasync d2/d4/f42 0 2023-12-05T09:57:29.496 INFO:tasks.workunit.client.1.smithi150.stdout:0/422: rename d5/d11/d16/d3f to d5/d11/d71/d99/d9c 0 2023-12-05T09:57:29.501 INFO:tasks.workunit.client.1.smithi150.stdout:7/399: rmdir d2/d1b 39 2023-12-05T09:57:29.501 INFO:tasks.workunit.client.1.smithi150.stdout:7/400: write d2/d4/f42 [676893,94821] 0 2023-12-05T09:57:29.502 INFO:tasks.workunit.client.1.smithi150.stdout:7/401: chown d2/db/d30/d18 86813466 1 2023-12-05T09:57:29.511 INFO:tasks.workunit.client.1.smithi150.stdout:7/402: creat d2/db/d30/d18/d63/f7f x:0 0 0 2023-12-05T09:57:29.512 INFO:tasks.workunit.client.1.smithi150.stdout:1/386: symlink d6/d38/l8a 0 2023-12-05T09:57:29.512 INFO:tasks.workunit.client.1.smithi150.stdout:1/387: dread - d6/f53 zero size 2023-12-05T09:57:29.514 INFO:tasks.workunit.client.0.smithi100.stdout:6/755: dwrite d7/d27/d35/f39 [0,4194304] 0 2023-12-05T09:57:29.515 INFO:tasks.workunit.client.1.smithi150.stdout:7/403: creat d2/db/d30/d53/f80 x:0 0 0 2023-12-05T09:57:29.516 INFO:tasks.workunit.client.1.smithi150.stdout:8/383: dread d0/f13 [0,4194304] 0 2023-12-05T09:57:29.521 INFO:tasks.workunit.client.1.smithi150.stdout:1/388: symlink d6/d3c/l8b 0 2023-12-05T09:57:29.521 INFO:tasks.workunit.client.1.smithi150.stdout:1/389: truncate d6/d8/d54/f67 194618 0 2023-12-05T09:57:29.524 INFO:tasks.workunit.client.0.smithi100.stdout:6/756: dread d7/d11/d1a/db1/fd6 [0,4194304] 0 2023-12-05T09:57:29.527 INFO:tasks.workunit.client.0.smithi100.stdout:6/757: mkdir d7/d11/d1a/db7/df7 0 2023-12-05T09:57:29.530 INFO:tasks.workunit.client.1.smithi150.stdout:7/404: dread d2/d4/f23 [0,4194304] 0 2023-12-05T09:57:29.536 INFO:tasks.workunit.client.0.smithi100.stdout:5/457: symlink d0/d4/d14/l9c 0 2023-12-05T09:57:29.536 INFO:tasks.workunit.client.0.smithi100.stdout:5/458: chown d0/d1f/d25/c71 977206 1 2023-12-05T09:57:29.539 INFO:tasks.workunit.client.1.smithi150.stdout:1/390: write d6/d8/db/f5b [340639,15005] 0 2023-12-05T09:57:29.540 INFO:tasks.workunit.client.0.smithi100.stdout:3/473: dwrite d0/f88 [0,4194304] 0 2023-12-05T09:57:29.541 INFO:tasks.workunit.client.1.smithi150.stdout:4/328: rename d0/d3e/d48/d5d to d0/d5f 0 2023-12-05T09:57:29.546 INFO:tasks.workunit.client.1.smithi150.stdout:1/391: mkdir d6/d8c 0 2023-12-05T09:57:29.546 INFO:tasks.workunit.client.1.smithi150.stdout:1/392: readlink d6/d47/l61 0 2023-12-05T09:57:29.552 INFO:tasks.workunit.client.0.smithi100.stdout:3/474: mknod d0/d48/ca2 0 2023-12-05T09:57:29.552 INFO:tasks.workunit.client.1.smithi150.stdout:5/372: dwrite d1/d3/d6/d1b/d22/d24/f7a [0,4194304] 0 2023-12-05T09:57:29.552 INFO:tasks.workunit.client.1.smithi150.stdout:4/329: getdents d0/d3e/d48/d4d 0 2023-12-05T09:57:29.553 INFO:tasks.workunit.client.1.smithi150.stdout:8/384: rename d0/d8/f23 to d0/d41/d49/d1b/d24/d2e/d4d/f7c 0 2023-12-05T09:57:29.553 INFO:tasks.workunit.client.1.smithi150.stdout:8/385: stat d0/d41/d49/d1b/d24/d34/d56/f60 0 2023-12-05T09:57:29.555 INFO:tasks.workunit.client.1.smithi150.stdout:2/383: dwrite d0/d3/d11/d1d/f2f [8388608,4194304] 0 2023-12-05T09:57:29.556 INFO:tasks.workunit.client.0.smithi100.stdout:3/475: rename d0/d10/c5b to d0/d3d/d5c/d6f/ca3 0 2023-12-05T09:57:29.556 INFO:tasks.workunit.client.1.smithi150.stdout:0/423: dwrite d5/d11/f24 [0,4194304] 0 2023-12-05T09:57:29.556 INFO:tasks.workunit.client.1.smithi150.stdout:0/424: write d5/f5b [587086,97471] 0 2023-12-05T09:57:29.562 INFO:tasks.workunit.client.1.smithi150.stdout:1/393: creat d6/f8d x:0 0 0 2023-12-05T09:57:29.562 INFO:tasks.workunit.client.1.smithi150.stdout:1/394: creat d6/d38/d4a/f8e x:0 0 0 2023-12-05T09:57:29.563 INFO:tasks.workunit.client.1.smithi150.stdout:4/330: link d0/d42/d44/f46 d0/d42/d44/f60 0 2023-12-05T09:57:29.566 INFO:tasks.workunit.client.1.smithi150.stdout:8/386: mknod d0/d41/d49/d1b/d24/d38/c7d 0 2023-12-05T09:57:29.566 INFO:tasks.workunit.client.1.smithi150.stdout:8/387: stat d0/d8/cd 0 2023-12-05T09:57:29.567 INFO:tasks.workunit.client.1.smithi150.stdout:0/425: link d5/d11/f24 d5/d11/d32/d57/f9d 0 2023-12-05T09:57:29.575 INFO:tasks.workunit.client.1.smithi150.stdout:9/344: mkdir d3/d9/d67 0 2023-12-05T09:57:29.583 INFO:tasks.workunit.client.1.smithi150.stdout:8/388: getdents d0/d41/d49/d1b/d24/d34 0 2023-12-05T09:57:29.584 INFO:tasks.workunit.client.1.smithi150.stdout:8/389: write d0/d41/f55 [1459177,106423] 0 2023-12-05T09:57:29.586 INFO:tasks.workunit.client.1.smithi150.stdout:5/373: getdents d1/d3/d6/d1b/d22 0 2023-12-05T09:57:29.586 INFO:tasks.workunit.client.1.smithi150.stdout:5/374: chown d1/d7f/f4f 121 1 2023-12-05T09:57:29.589 INFO:tasks.workunit.client.1.smithi150.stdout:4/331: dread d0/f30 [0,4194304] 0 2023-12-05T09:57:29.593 INFO:tasks.workunit.client.1.smithi150.stdout:6/327: sync 2023-12-05T09:57:29.593 INFO:tasks.workunit.client.1.smithi150.stdout:6/328: dread - d2/d23/d60/d5d/d6b/f4b zero size 2023-12-05T09:57:29.593 INFO:tasks.workunit.client.1.smithi150.stdout:4/332: link d0/d11/d4b/f50 d0/f61 0 2023-12-05T09:57:29.594 INFO:tasks.workunit.client.0.smithi100.stdout:3/476: dread d0/d2/f59 [0,4194304] 0 2023-12-05T09:57:29.594 INFO:tasks.workunit.client.1.smithi150.stdout:7/405: dwrite d2/d39/f60 [4194304,4194304] 0 2023-12-05T09:57:29.596 INFO:tasks.workunit.client.0.smithi100.stdout:6/758: dwrite d7/d11/d1a/f54 [0,4194304] 0 2023-12-05T09:57:29.596 INFO:tasks.workunit.client.0.smithi100.stdout:3/477: rmdir d0/d4 39 2023-12-05T09:57:29.596 INFO:tasks.workunit.client.0.smithi100.stdout:3/478: readlink d0/d10/l76 0 2023-12-05T09:57:29.598 INFO:tasks.workunit.client.0.smithi100.stdout:5/459: dwrite d0/d16/d2b/d48/f5d [0,4194304] 0 2023-12-05T09:57:29.600 INFO:tasks.workunit.client.1.smithi150.stdout:0/426: dread d5/d11/f24 [0,4194304] 0 2023-12-05T09:57:29.601 INFO:tasks.workunit.client.0.smithi100.stdout:6/759: link d7/d11/d1a/f6b d7/dcc/df0/ff8 0 2023-12-05T09:57:29.605 INFO:tasks.workunit.client.1.smithi150.stdout:6/329: getdents d2/d23/d60 0 2023-12-05T09:57:29.605 INFO:tasks.workunit.client.1.smithi150.stdout:4/333: rename d0/l35 to d0/d3e/d48/l62 0 2023-12-05T09:57:29.605 INFO:tasks.workunit.client.1.smithi150.stdout:6/330: fsync d2/d23/d2e/f4f 0 2023-12-05T09:57:29.605 INFO:tasks.workunit.client.1.smithi150.stdout:6/331: write d2/d23/f45 [5230309,110517] 0 2023-12-05T09:57:29.606 INFO:tasks.workunit.client.1.smithi150.stdout:5/375: write d1/d7f/f4f [998503,16447] 0 2023-12-05T09:57:29.610 INFO:tasks.workunit.client.0.smithi100.stdout:5/460: creat d0/d1f/d53/f9d x:0 0 0 2023-12-05T09:57:29.611 INFO:tasks.workunit.client.1.smithi150.stdout:2/384: dwrite d0/d3/d21/f39 [4194304,4194304] 0 2023-12-05T09:57:29.612 INFO:tasks.workunit.client.0.smithi100.stdout:5/461: rename d0/d16/d2b/d48/df/d51 to d0/d16/d2b/d48/df/d51/d9e 22 2023-12-05T09:57:29.612 INFO:tasks.workunit.client.0.smithi100.stdout:3/479: dread d0/d10/d39/f55 [0,4194304] 0 2023-12-05T09:57:29.614 INFO:tasks.workunit.client.0.smithi100.stdout:1/381: sync 2023-12-05T09:57:29.614 INFO:tasks.workunit.client.0.smithi100.stdout:0/374: sync 2023-12-05T09:57:29.614 INFO:tasks.workunit.client.0.smithi100.stdout:9/440: sync 2023-12-05T09:57:29.614 INFO:tasks.workunit.client.0.smithi100.stdout:4/343: sync 2023-12-05T09:57:29.614 INFO:tasks.workunit.client.0.smithi100.stdout:7/340: sync 2023-12-05T09:57:29.614 INFO:tasks.workunit.client.0.smithi100.stdout:7/341: chown d3/dc/d11/d13/de/d18/d3b/d40/d46/f5f 364 1 2023-12-05T09:57:29.615 INFO:tasks.workunit.client.1.smithi150.stdout:7/406: mknod d2/db/d30/d18/d1a/d1e/c81 0 2023-12-05T09:57:29.620 INFO:tasks.workunit.client.0.smithi100.stdout:2/528: sync 2023-12-05T09:57:29.620 INFO:tasks.workunit.client.0.smithi100.stdout:2/529: stat d7/da/f8a 0 2023-12-05T09:57:29.620 INFO:tasks.workunit.client.0.smithi100.stdout:2/530: readlink d7/da/d65/lb3 0 2023-12-05T09:57:29.620 INFO:tasks.workunit.client.0.smithi100.stdout:8/337: unlink d0/d12/d13/d16/l1f 0 2023-12-05T09:57:29.621 INFO:tasks.workunit.client.0.smithi100.stdout:8/338: dread - d0/d12/d13/f4d zero size 2023-12-05T09:57:29.621 INFO:tasks.workunit.client.0.smithi100.stdout:8/339: readlink d0/d12/d13/d16/d22/l50 0 2023-12-05T09:57:29.629 INFO:tasks.workunit.client.0.smithi100.stdout:5/462: truncate d0/d16/f68 1487156 0 2023-12-05T09:57:29.630 INFO:tasks.workunit.client.1.smithi150.stdout:6/332: truncate d2/d23/f29 48256 0 2023-12-05T09:57:29.631 INFO:tasks.workunit.client.0.smithi100.stdout:3/480: mkdir d0/d3d/d5c/d5f/d67/da4 0 2023-12-05T09:57:29.633 INFO:tasks.workunit.client.0.smithi100.stdout:0/375: mkdir da/d2a/d71 0 2023-12-05T09:57:29.633 INFO:tasks.workunit.client.1.smithi150.stdout:5/376: mknod d1/d7f/d65/d3b/d37/c87 0 2023-12-05T09:57:29.637 INFO:tasks.workunit.client.1.smithi150.stdout:0/427: getdents d5/d11/d16/d1f/d7f 0 2023-12-05T09:57:29.637 INFO:tasks.workunit.client.1.smithi150.stdout:0/428: chown d5/d11/d71 29 1 2023-12-05T09:57:29.637 INFO:tasks.workunit.client.1.smithi150.stdout:0/429: fsync d5/f72 0 2023-12-05T09:57:29.637 INFO:tasks.workunit.client.1.smithi150.stdout:0/430: truncate d5/d11/d16/d1f/d67/f73 942280 0 2023-12-05T09:57:29.638 INFO:tasks.workunit.client.1.smithi150.stdout:7/407: mkdir d2/d72/d82 0 2023-12-05T09:57:29.639 INFO:tasks.workunit.client.1.smithi150.stdout:4/334: rmdir d0/d42/d44 39 2023-12-05T09:57:29.639 INFO:tasks.workunit.client.1.smithi150.stdout:4/335: fdatasync d0/f20 0 2023-12-05T09:57:29.640 INFO:tasks.workunit.client.1.smithi150.stdout:5/377: unlink d1/d7f/d65/d3b/d37/f69 0 2023-12-05T09:57:29.640 INFO:tasks.workunit.client.1.smithi150.stdout:5/378: fsync d1/d7f/d65/d3b/d37/f70 0 2023-12-05T09:57:29.640 INFO:tasks.workunit.client.1.smithi150.stdout:2/385: dread d0/d3/d11/f18 [0,4194304] 0 2023-12-05T09:57:29.642 INFO:tasks.workunit.client.1.smithi150.stdout:0/431: link d5/d11/d16/d1f/l20 d5/d11/d65/d82/l9e 0 2023-12-05T09:57:29.642 INFO:tasks.workunit.client.1.smithi150.stdout:0/432: readlink d5/d11/d16/d1f/l2a 0 2023-12-05T09:57:29.642 INFO:tasks.workunit.client.1.smithi150.stdout:7/408: mknod d2/db/d30/d13/d4f/d5a/c83 0 2023-12-05T09:57:29.643 INFO:tasks.workunit.client.1.smithi150.stdout:4/336: rename d0/d11/d4b/f58 to d0/d42/f63 0 2023-12-05T09:57:29.644 INFO:tasks.workunit.client.1.smithi150.stdout:5/379: creat d1/d3/d6/d1b/d22/d86/f88 x:0 0 0 2023-12-05T09:57:29.644 INFO:tasks.workunit.client.1.smithi150.stdout:5/380: readlink d1/d7f/d65/l60 0 2023-12-05T09:57:29.644 INFO:tasks.workunit.client.1.smithi150.stdout:0/433: getdents d5/d11/d71/d5f/d77/d87 0 2023-12-05T09:57:29.646 INFO:tasks.workunit.client.1.smithi150.stdout:8/390: dread d0/d8/f1f [0,4194304] 0 2023-12-05T09:57:29.646 INFO:tasks.workunit.client.0.smithi100.stdout:8/340: dread d0/f19 [0,4194304] 0 2023-12-05T09:57:29.648 INFO:tasks.workunit.client.1.smithi150.stdout:5/381: mkdir d1/d3/d6/d89 0 2023-12-05T09:57:29.648 INFO:tasks.workunit.client.1.smithi150.stdout:4/337: creat d0/d3e/d48/d4d/f64 x:0 0 0 2023-12-05T09:57:29.652 INFO:tasks.workunit.client.0.smithi100.stdout:9/441: symlink d7/d35/l91 0 2023-12-05T09:57:29.652 INFO:tasks.workunit.client.0.smithi100.stdout:9/442: chown d7/d35/l3b 713952 1 2023-12-05T09:57:29.652 INFO:tasks.workunit.client.0.smithi100.stdout:3/481: read d0/d2/d33/f78 [280002,65389] 0 2023-12-05T09:57:29.654 INFO:tasks.workunit.client.0.smithi100.stdout:9/443: symlink d7/d20/l92 0 2023-12-05T09:57:29.655 INFO:tasks.workunit.client.1.smithi150.stdout:0/434: creat d5/d11/d71/d99/d9c/d3b/f9f x:0 0 0 2023-12-05T09:57:29.656 INFO:tasks.workunit.client.0.smithi100.stdout:3/482: symlink d0/d3d/d90/la5 0 2023-12-05T09:57:29.656 INFO:tasks.workunit.client.1.smithi150.stdout:8/391: creat d0/d41/d49/d1b/d24/d34/d56/d67/d64/f7e x:0 0 0 2023-12-05T09:57:29.657 INFO:tasks.workunit.client.1.smithi150.stdout:8/392: dread - d0/d41/d49/d1b/d24/d38/f77 zero size 2023-12-05T09:57:29.657 INFO:tasks.workunit.client.1.smithi150.stdout:8/393: stat d0/d8/f1f 0 2023-12-05T09:57:29.658 INFO:tasks.workunit.client.1.smithi150.stdout:1/395: dwrite d6/d38/d4a/f8e [0,4194304] 0 2023-12-05T09:57:29.658 INFO:tasks.workunit.client.1.smithi150.stdout:1/396: write d6/f53 [243118,65099] 0 2023-12-05T09:57:29.658 INFO:tasks.workunit.client.1.smithi150.stdout:1/397: chown d6/d8/d59 7126 1 2023-12-05T09:57:29.658 INFO:tasks.workunit.client.1.smithi150.stdout:1/398: chown d6/d8/d85 24 1 2023-12-05T09:57:29.659 INFO:tasks.workunit.client.0.smithi100.stdout:9/444: mkdir d7/d1b/d22/d93 0 2023-12-05T09:57:29.659 INFO:tasks.workunit.client.0.smithi100.stdout:9/445: chown d7/d1b/d22/d2a/c46 7 1 2023-12-05T09:57:29.659 INFO:tasks.workunit.client.0.smithi100.stdout:9/446: fdatasync d7/d1b/d22/d2a/f40 0 2023-12-05T09:57:29.666 INFO:tasks.workunit.client.1.smithi150.stdout:6/333: write d2/f1c [3450447,29076] 0 2023-12-05T09:57:29.673 INFO:tasks.workunit.client.1.smithi150.stdout:9/345: dwrite d3/d9/f1c [0,4194304] 0 2023-12-05T09:57:29.692 INFO:tasks.workunit.client.1.smithi150.stdout:8/394: mknod d0/d41/d49/d1b/d24/d34/d56/d67/d64/c7f 0 2023-12-05T09:57:29.693 INFO:tasks.workunit.client.1.smithi150.stdout:1/399: symlink d6/d47/d4c/d7c/d89/l8f 0 2023-12-05T09:57:29.693 INFO:tasks.workunit.client.1.smithi150.stdout:8/395: write d0/d41/d49/f79 [2072931,37480] 0 2023-12-05T09:57:29.693 INFO:tasks.workunit.client.1.smithi150.stdout:6/334: mknod d2/d23/d60/d5d/c6f 0 2023-12-05T09:57:29.693 INFO:tasks.workunit.client.1.smithi150.stdout:6/335: chown d2/d23/f67 3 1 2023-12-05T09:57:29.694 INFO:tasks.workunit.client.1.smithi150.stdout:0/435: dread d5/d11/d71/d99/d9c/d46/d80/f86 [0,4194304] 0 2023-12-05T09:57:29.695 INFO:tasks.workunit.client.1.smithi150.stdout:1/400: creat d6/d8/d59/f90 x:0 0 0 2023-12-05T09:57:29.695 INFO:tasks.workunit.client.1.smithi150.stdout:1/401: chown d6/c2c 97 1 2023-12-05T09:57:29.697 INFO:tasks.workunit.client.1.smithi150.stdout:8/396: symlink d0/d41/d49/d1b/d24/d34/d56/d67/l80 0 2023-12-05T09:57:29.700 INFO:tasks.workunit.client.0.smithi100.stdout:3/483: dread d0/d10/f49 [0,4194304] 0 2023-12-05T09:57:29.700 INFO:tasks.workunit.client.0.smithi100.stdout:3/484: creat d0/d4/d3a/d45/fa6 x:0 0 0 2023-12-05T09:57:29.704 INFO:tasks.workunit.client.0.smithi100.stdout:3/485: link d0/d2/de/f47 d0/fa7 0 2023-12-05T09:57:29.705 INFO:tasks.workunit.client.0.smithi100.stdout:3/486: creat d0/d10/d39/fa8 x:0 0 0 2023-12-05T09:57:29.712 INFO:tasks.workunit.client.0.smithi100.stdout:3/487: rename d0/d2/d33/f40 to d0/d3d/d5c/fa9 0 2023-12-05T09:57:29.712 INFO:tasks.workunit.client.0.smithi100.stdout:3/488: stat d0/d2/de/d12/d9b 0 2023-12-05T09:57:29.723 INFO:tasks.workunit.client.0.smithi100.stdout:2/531: dwrite d7/da/dc/f12 [0,4194304] 0 2023-12-05T09:57:29.723 INFO:tasks.workunit.client.0.smithi100.stdout:2/532: readlink d7/da/d18/d21/l54 0 2023-12-05T09:57:29.724 INFO:tasks.workunit.client.1.smithi150.stdout:0/436: dread d5/d11/d71/d99/d9c/f3c [4194304,4194304] 0 2023-12-05T09:57:29.725 INFO:tasks.workunit.client.0.smithi100.stdout:6/760: dwrite d7/dcc/df0/ff8 [0,4194304] 0 2023-12-05T09:57:29.725 INFO:tasks.workunit.client.0.smithi100.stdout:6/761: creat d7/d27/d35/d5a/db0/ff9 x:0 0 0 2023-12-05T09:57:29.725 INFO:tasks.workunit.client.0.smithi100.stdout:6/762: readlink d7/d11/d82/lbc 0 2023-12-05T09:57:29.725 INFO:tasks.workunit.client.0.smithi100.stdout:2/533: mknod d7/da/d18/d21/da3/cb5 0 2023-12-05T09:57:29.726 INFO:tasks.workunit.client.0.smithi100.stdout:2/534: creat d7/da/d18/d1b/d2c/d3f/d46/fb6 x:0 0 0 2023-12-05T09:57:29.726 INFO:tasks.workunit.client.0.smithi100.stdout:7/342: dwrite d3/dc/d11/d13/de/f74 [0,4194304] 0 2023-12-05T09:57:29.726 INFO:tasks.workunit.client.0.smithi100.stdout:7/343: readlink d3/l61 0 2023-12-05T09:57:29.728 INFO:tasks.workunit.client.0.smithi100.stdout:6/763: creat d7/d11/d7e/ffa x:0 0 0 2023-12-05T09:57:29.728 INFO:tasks.workunit.client.0.smithi100.stdout:6/764: creat d7/d11/d82/ffb x:0 0 0 2023-12-05T09:57:29.731 INFO:tasks.workunit.client.1.smithi150.stdout:2/386: dwrite d0/d3/f14 [0,4194304] 0 2023-12-05T09:57:29.734 INFO:tasks.workunit.client.0.smithi100.stdout:2/535: creat d7/da/d1a/fb7 x:0 0 0 2023-12-05T09:57:29.735 INFO:tasks.workunit.client.0.smithi100.stdout:2/536: read d7/da/d13/d69/d6e/d71/f8c [3091059,73983] 0 2023-12-05T09:57:29.735 INFO:tasks.workunit.client.0.smithi100.stdout:2/537: chown d7/da/dc/f12 9 1 2023-12-05T09:57:29.735 INFO:tasks.workunit.client.0.smithi100.stdout:2/538: write d7/da/d18/d1b/d2c/d3f/f67 [727263,123616] 0 2023-12-05T09:57:29.742 INFO:tasks.workunit.client.1.smithi150.stdout:2/387: link d0/f7 d0/d3/d5/d13/d15/d30/d54/d57/f88 0 2023-12-05T09:57:29.743 INFO:tasks.workunit.client.0.smithi100.stdout:6/765: truncate d7/d11/d1a/f22 373319 0 2023-12-05T09:57:29.744 INFO:tasks.workunit.client.0.smithi100.stdout:6/766: creat d7/d11/d7e/ffc x:0 0 0 2023-12-05T09:57:29.744 INFO:tasks.workunit.client.0.smithi100.stdout:1/382: dwrite db/d31/d3a/f3e [0,4194304] 0 2023-12-05T09:57:29.746 INFO:tasks.workunit.client.0.smithi100.stdout:2/539: rename d7/da/d18/d1b/d2c/d3f/f85 to d7/da/dc/d88/fb8 0 2023-12-05T09:57:29.746 INFO:tasks.workunit.client.0.smithi100.stdout:8/341: dread d0/d12/f36 [0,4194304] 0 2023-12-05T09:57:29.747 INFO:tasks.workunit.client.1.smithi150.stdout:5/382: dwrite d1/d3/fb [0,4194304] 0 2023-12-05T09:57:29.747 INFO:tasks.workunit.client.1.smithi150.stdout:7/409: dwrite d2/db/d30/d13/f37 [4194304,4194304] 0 2023-12-05T09:57:29.749 INFO:tasks.workunit.client.1.smithi150.stdout:0/437: write d5/d11/d71/f7c [71245,25236] 0 2023-12-05T09:57:29.750 INFO:tasks.workunit.client.1.smithi150.stdout:0/438: dread - d5/d11/d71/d5f/d77/f95 zero size 2023-12-05T09:57:29.750 INFO:tasks.workunit.client.0.smithi100.stdout:3/489: dread d0/d2/de/d11/f21 [4194304,4194304] 0 2023-12-05T09:57:29.751 INFO:tasks.workunit.client.1.smithi150.stdout:8/397: dwrite d0/d41/d49/d1b/d24/d2e/f6e [0,4194304] 0 2023-12-05T09:57:29.751 INFO:tasks.workunit.client.1.smithi150.stdout:8/398: chown d0/d41/d49/d1b/d24/d5b/l5f 249529 1 2023-12-05T09:57:29.752 INFO:tasks.workunit.client.1.smithi150.stdout:8/399: write d0/d41/f71 [217297,9907] 0 2023-12-05T09:57:29.753 INFO:tasks.workunit.client.0.smithi100.stdout:4/344: dwrite de/d16/d23/d33/d3d/f5a [0,4194304] 0 2023-12-05T09:57:29.753 INFO:tasks.workunit.client.0.smithi100.stdout:4/345: write f2 [460961,71707] 0 2023-12-05T09:57:29.753 INFO:tasks.workunit.client.0.smithi100.stdout:4/346: fdatasync de/f1b 0 2023-12-05T09:57:29.754 INFO:tasks.workunit.client.1.smithi150.stdout:0/439: creat d5/d11/d16/d1f/fa0 x:0 0 0 2023-12-05T09:57:29.754 INFO:tasks.workunit.client.0.smithi100.stdout:6/767: mkdir d7/d11/d82/db9/dfd 0 2023-12-05T09:57:29.756 INFO:tasks.workunit.client.0.smithi100.stdout:0/376: dwrite da/d1b/f52 [0,4194304] 0 2023-12-05T09:57:29.761 INFO:tasks.workunit.client.1.smithi150.stdout:6/336: dread d2/d23/f45 [0,4194304] 0 2023-12-05T09:57:29.762 INFO:tasks.workunit.client.1.smithi150.stdout:4/338: dwrite d0/d3e/d48/d4d/f57 [4194304,4194304] 0 2023-12-05T09:57:29.762 INFO:tasks.workunit.client.0.smithi100.stdout:2/540: mknod d7/da/dc/cb9 0 2023-12-05T09:57:29.762 INFO:tasks.workunit.client.0.smithi100.stdout:2/541: chown d7/da/d18/d1b/d2c/d3f/c4c 1285 1 2023-12-05T09:57:29.763 INFO:tasks.workunit.client.0.smithi100.stdout:8/342: mknod d0/d35/c51 0 2023-12-05T09:57:29.763 INFO:tasks.workunit.client.0.smithi100.stdout:8/343: chown d0/d35/f39 4177 1 2023-12-05T09:57:29.763 INFO:tasks.workunit.client.1.smithi150.stdout:1/402: dwrite d6/d8/db/de/f14 [0,4194304] 0 2023-12-05T09:57:29.772 INFO:tasks.workunit.client.1.smithi150.stdout:8/400: creat d0/d41/d49/f81 x:0 0 0 2023-12-05T09:57:29.775 INFO:tasks.workunit.client.0.smithi100.stdout:4/347: rmdir de/d16/d23/d33/d51 39 2023-12-05T09:57:29.776 INFO:tasks.workunit.client.0.smithi100.stdout:4/348: chown de/d16/d23/d33/d3d/d44 1 1 2023-12-05T09:57:29.780 INFO:tasks.workunit.client.0.smithi100.stdout:6/768: link d7/d27/d72/f55 d7/d11/d1a/d78/de4/ffe 0 2023-12-05T09:57:29.780 INFO:tasks.workunit.client.0.smithi100.stdout:6/769: fdatasync d7/d27/d35/d5a/fe6 0 2023-12-05T09:57:29.785 INFO:tasks.workunit.client.0.smithi100.stdout:0/377: write da/f11 [10363950,26993] 0 2023-12-05T09:57:29.788 INFO:tasks.workunit.client.0.smithi100.stdout:3/490: dwrite d0/d3d/f6c [0,4194304] 0 2023-12-05T09:57:29.793 INFO:tasks.workunit.client.1.smithi150.stdout:4/339: write d0/d3e/d48/f4e [2094855,38841] 0 2023-12-05T09:57:29.793 INFO:tasks.workunit.client.1.smithi150.stdout:4/340: write d0/f3a [741260,7722] 0 2023-12-05T09:57:29.793 INFO:tasks.workunit.client.1.smithi150.stdout:4/341: dread - d0/f51 zero size 2023-12-05T09:57:29.795 INFO:tasks.workunit.client.1.smithi150.stdout:1/403: write d6/d8/d59/f65 [999985,16724] 0 2023-12-05T09:57:29.796 INFO:tasks.workunit.client.1.smithi150.stdout:1/404: creat d6/d8/d59/f91 x:0 0 0 2023-12-05T09:57:29.797 INFO:tasks.workunit.client.0.smithi100.stdout:8/344: mkdir d0/d12/d52 0 2023-12-05T09:57:29.804 INFO:tasks.workunit.client.0.smithi100.stdout:1/383: rename db/l1b to db/d12/d61/d66/d67/l79 0 2023-12-05T09:57:29.812 INFO:tasks.workunit.client.0.smithi100.stdout:0/378: creat da/f72 x:0 0 0 2023-12-05T09:57:29.813 INFO:tasks.workunit.client.1.smithi150.stdout:3/400: sync 2023-12-05T09:57:29.814 INFO:tasks.workunit.client.1.smithi150.stdout:4/342: creat d0/d11/d4b/f65 x:0 0 0 2023-12-05T09:57:29.820 INFO:tasks.workunit.client.1.smithi150.stdout:6/337: link d2/c1e d2/d23/d60/d5d/d6b/c70 0 2023-12-05T09:57:29.820 INFO:tasks.workunit.client.1.smithi150.stdout:6/338: fsync d2/d23/d2e/d5f/f6d 0 2023-12-05T09:57:29.821 INFO:tasks.workunit.client.1.smithi150.stdout:8/401: write d0/d41/d49/d1b/d24/d2e/d30/f36 [2485086,5347] 0 2023-12-05T09:57:29.822 INFO:tasks.workunit.client.0.smithi100.stdout:3/491: mknod d0/d4/d3a/caa 0 2023-12-05T09:57:29.823 INFO:tasks.workunit.client.1.smithi150.stdout:3/401: creat d6/d9/d3d/d56/d79/f7f x:0 0 0 2023-12-05T09:57:29.823 INFO:tasks.workunit.client.1.smithi150.stdout:3/402: chown d6/d9/d43/d47 207 1 2023-12-05T09:57:29.826 INFO:tasks.workunit.client.0.smithi100.stdout:8/345: mknod d0/d12/d13/d16/d22/d24/c53 0 2023-12-05T09:57:29.826 INFO:tasks.workunit.client.0.smithi100.stdout:8/346: fdatasync d0/f2b 0 2023-12-05T09:57:29.828 INFO:tasks.workunit.client.1.smithi150.stdout:4/343: link d0/d3e/l43 d0/d42/l66 0 2023-12-05T09:57:29.829 INFO:tasks.workunit.client.1.smithi150.stdout:7/410: dwrite d2/db/d30/d18/d1a/d1e/d2b/f34 [0,4194304] 0 2023-12-05T09:57:29.829 INFO:tasks.workunit.client.1.smithi150.stdout:7/411: fsync d2/d4/f42 0 2023-12-05T09:57:29.829 INFO:tasks.workunit.client.1.smithi150.stdout:4/344: creat d0/d3e/d48/d4d/f67 x:0 0 0 2023-12-05T09:57:29.829 INFO:tasks.workunit.client.1.smithi150.stdout:4/345: write d0/f51 [384030,16664] 0 2023-12-05T09:57:29.829 INFO:tasks.workunit.client.1.smithi150.stdout:6/339: read d2/f13 [1197990,1732] 0 2023-12-05T09:57:29.830 INFO:tasks.workunit.client.1.smithi150.stdout:0/440: dwrite d5/d11/d16/d1f/d7f/f9a [0,4194304] 0 2023-12-05T09:57:29.830 INFO:tasks.workunit.client.1.smithi150.stdout:0/441: write d5/f5b [1014859,16513] 0 2023-12-05T09:57:29.831 INFO:tasks.workunit.client.0.smithi100.stdout:0/379: unlink da/d1b/d36/c64 0 2023-12-05T09:57:29.834 INFO:tasks.workunit.client.0.smithi100.stdout:2/542: dwrite d7/da/dc/f7a [0,4194304] 0 2023-12-05T09:57:29.837 INFO:tasks.workunit.client.1.smithi150.stdout:8/402: creat d0/d8/f82 x:0 0 0 2023-12-05T09:57:29.837 INFO:tasks.workunit.client.1.smithi150.stdout:7/412: dread d2/d4/f6d [4194304,4194304] 0 2023-12-05T09:57:29.838 INFO:tasks.workunit.client.0.smithi100.stdout:3/492: mkdir d0/d10/d39/dab 0 2023-12-05T09:57:29.839 INFO:tasks.workunit.client.0.smithi100.stdout:3/493: chown d0/d4/f4a 133140 1 2023-12-05T09:57:29.839 INFO:tasks.workunit.client.0.smithi100.stdout:3/494: chown d0/d10 0 1 2023-12-05T09:57:29.839 INFO:tasks.workunit.client.0.smithi100.stdout:0/380: mkdir da/d1b/d73 0 2023-12-05T09:57:29.839 INFO:tasks.workunit.client.0.smithi100.stdout:0/381: write da/d2a/f56 [371263,27289] 0 2023-12-05T09:57:29.840 INFO:tasks.workunit.client.1.smithi150.stdout:2/388: dwrite d0/d3/d5/d22/d52/d5a/f7a [0,4194304] 0 2023-12-05T09:57:29.842 INFO:tasks.workunit.client.1.smithi150.stdout:1/405: dwrite d6/f8d [0,4194304] 0 2023-12-05T09:57:29.843 INFO:tasks.workunit.client.1.smithi150.stdout:5/383: dwrite d1/f51 [0,4194304] 0 2023-12-05T09:57:29.844 INFO:tasks.workunit.client.0.smithi100.stdout:4/349: dwrite de/f55 [0,4194304] 0 2023-12-05T09:57:29.844 INFO:tasks.workunit.client.0.smithi100.stdout:4/350: creat de/d38/d5d/f6e x:0 0 0 2023-12-05T09:57:29.844 INFO:tasks.workunit.client.0.smithi100.stdout:6/770: dwrite d7/d27/d72/f77 [0,4194304] 0 2023-12-05T09:57:29.844 INFO:tasks.workunit.client.0.smithi100.stdout:6/771: fdatasync d7/d2d/fbd 0 2023-12-05T09:57:29.845 INFO:tasks.workunit.client.0.smithi100.stdout:8/347: dread d0/d12/f36 [0,4194304] 0 2023-12-05T09:57:29.852 INFO:tasks.workunit.client.1.smithi150.stdout:6/340: rename d2/d23/d60/d5d/d6b/f31 to d2/d23/d60/d5d/d6b/d63/f71 0 2023-12-05T09:57:29.855 INFO:tasks.workunit.client.0.smithi100.stdout:0/382: mkdir da/d22/d33/d74 0 2023-12-05T09:57:29.855 INFO:tasks.workunit.client.0.smithi100.stdout:0/383: read da/f5a [79034,107944] 0 2023-12-05T09:57:29.864 INFO:tasks.workunit.client.1.smithi150.stdout:0/442: creat d5/d11/d32/d57/fa1 x:0 0 0 2023-12-05T09:57:29.869 INFO:tasks.workunit.client.1.smithi150.stdout:8/403: unlink d0/d41/d49/d1b/d24/f72 0 2023-12-05T09:57:29.869 INFO:tasks.workunit.client.1.smithi150.stdout:8/404: chown d0/d8/f51 61019180 1 2023-12-05T09:57:29.869 INFO:tasks.workunit.client.1.smithi150.stdout:8/405: read - d0/d41/d49/d1b/d24/d38/d62/f6b zero size 2023-12-05T09:57:29.873 INFO:tasks.workunit.client.1.smithi150.stdout:7/413: unlink d2/db/d17/d20/f75 0 2023-12-05T09:57:29.888 INFO:tasks.workunit.client.1.smithi150.stdout:1/406: symlink d6/d8/db/de/d75/l92 0 2023-12-05T09:57:29.888 INFO:tasks.workunit.client.1.smithi150.stdout:1/407: truncate d6/d8/d54/f67 1147013 0 2023-12-05T09:57:29.888 INFO:tasks.workunit.client.1.smithi150.stdout:5/384: dread d1/f55 [0,4194304] 0 2023-12-05T09:57:29.907 INFO:tasks.workunit.client.0.smithi100.stdout:6/772: dread d7/d2d/fe3 [0,4194304] 0 2023-12-05T09:57:29.913 INFO:tasks.workunit.client.1.smithi150.stdout:8/406: mkdir d0/d41/d49/d1b/d24/d2e/d4d/d83 0 2023-12-05T09:57:29.913 INFO:tasks.workunit.client.1.smithi150.stdout:7/414: rmdir d2/db 39 2023-12-05T09:57:29.914 INFO:tasks.workunit.client.0.smithi100.stdout:8/348: dread d0/d12/d13/d16/f2e [0,4194304] 0 2023-12-05T09:57:29.914 INFO:tasks.workunit.client.0.smithi100.stdout:0/384: dread da/f37 [0,4194304] 0 2023-12-05T09:57:29.915 INFO:tasks.workunit.client.0.smithi100.stdout:2/543: dwrite d7/da/d18/d21/f7e [0,4194304] 0 2023-12-05T09:57:29.916 INFO:tasks.workunit.client.0.smithi100.stdout:6/773: truncate d7/f23 417865 0 2023-12-05T09:57:29.916 INFO:tasks.workunit.client.0.smithi100.stdout:6/774: read - d7/d27/d97/fbb zero size 2023-12-05T09:57:29.916 INFO:tasks.workunit.client.1.smithi150.stdout:2/389: rename d0/d3/d5/d13/d15/d30/d54/f7d to d0/d3/d5/d13/d15/d30/f89 0 2023-12-05T09:57:29.916 INFO:tasks.workunit.client.1.smithi150.stdout:8/407: truncate d0/d41/d49/f81 770626 0 2023-12-05T09:57:29.916 INFO:tasks.workunit.client.1.smithi150.stdout:2/390: write d0/d3/d5/d13/f69 [547504,127972] 0 2023-12-05T09:57:29.916 INFO:tasks.workunit.client.1.smithi150.stdout:1/408: creat d6/d8/db/de/f93 x:0 0 0 2023-12-05T09:57:29.916 INFO:tasks.workunit.client.1.smithi150.stdout:5/385: dread d1/d64/f58 [0,4194304] 0 2023-12-05T09:57:29.922 INFO:tasks.workunit.client.0.smithi100.stdout:8/349: mkdir d0/d12/d13/d16/d22/d54 0 2023-12-05T09:57:29.930 INFO:tasks.workunit.client.0.smithi100.stdout:0/385: rmdir da/d2a/d4d 39 2023-12-05T09:57:29.933 INFO:tasks.workunit.client.1.smithi150.stdout:4/346: dwrite d0/d11/f2f [0,4194304] 0 2023-12-05T09:57:29.934 INFO:tasks.workunit.client.1.smithi150.stdout:7/415: truncate d2/d4/ff 802143 0 2023-12-05T09:57:29.934 INFO:tasks.workunit.client.1.smithi150.stdout:7/416: readlink d2/db/d30/d13/d4f/d5a/d5c/l61 0 2023-12-05T09:57:29.934 INFO:tasks.workunit.client.1.smithi150.stdout:6/341: dwrite d2/d23/d60/f5e [0,4194304] 0 2023-12-05T09:57:29.935 INFO:tasks.workunit.client.0.smithi100.stdout:4/351: dwrite de/d16/d23/d36/f3a [0,4194304] 0 2023-12-05T09:57:29.938 INFO:tasks.workunit.client.1.smithi150.stdout:0/443: dwrite d5/d11/d65/f76 [0,4194304] 0 2023-12-05T09:57:29.942 INFO:tasks.workunit.client.0.smithi100.stdout:6/775: read d7/d27/d72/f55 [152029,86965] 0 2023-12-05T09:57:29.944 INFO:tasks.workunit.client.1.smithi150.stdout:2/391: link d0/d3/d5/d13/d15/d30/d54/d57/f75 d0/d3/d5/d13/d15/d30/d54/f8a 0 2023-12-05T09:57:29.945 INFO:tasks.workunit.client.1.smithi150.stdout:2/392: fsync d0/d3/d5/d22/d52/d56/f73 0 2023-12-05T09:57:29.945 INFO:tasks.workunit.client.1.smithi150.stdout:2/393: chown d0/cb 4038316 1 2023-12-05T09:57:29.945 INFO:tasks.workunit.client.1.smithi150.stdout:5/386: dread d1/d3/d6/d1b/d22/d24/f7a [0,4194304] 0 2023-12-05T09:57:29.945 INFO:tasks.workunit.client.1.smithi150.stdout:5/387: read - d1/d3/d6/d1b/d22/d86/f88 zero size 2023-12-05T09:57:29.949 INFO:tasks.workunit.client.1.smithi150.stdout:4/347: creat d0/d5f/f68 x:0 0 0 2023-12-05T09:57:29.949 INFO:tasks.workunit.client.1.smithi150.stdout:4/348: readlink d0/d11/l1d 0 2023-12-05T09:57:29.952 INFO:tasks.workunit.client.0.smithi100.stdout:3/495: dwrite d0/d2/de/d12/f63 [0,4194304] 0 2023-12-05T09:57:29.952 INFO:tasks.workunit.client.0.smithi100.stdout:3/496: truncate d0/d2/de/f38 1694208 0 2023-12-05T09:57:29.952 INFO:tasks.workunit.client.0.smithi100.stdout:3/497: fsync d0/d2/de/d12/f63 0 2023-12-05T09:57:29.954 INFO:tasks.workunit.client.1.smithi150.stdout:7/417: rmdir d2/db/d30/d18 39 2023-12-05T09:57:29.957 INFO:tasks.workunit.client.1.smithi150.stdout:6/342: truncate d2/d23/d60/d5d/d6b/f10 1802325 0 2023-12-05T09:57:29.957 INFO:tasks.workunit.client.1.smithi150.stdout:3/403: getdents d6/d9/d3d/d56/d79 0 2023-12-05T09:57:29.957 INFO:tasks.workunit.client.1.smithi150.stdout:3/404: getdents d6/d9/d43/d75 0 2023-12-05T09:57:29.963 INFO:tasks.workunit.client.0.smithi100.stdout:3/498: dread d0/d2/f4f [0,4194304] 0 2023-12-05T09:57:29.966 INFO:tasks.workunit.client.0.smithi100.stdout:8/350: dread d0/f9 [0,4194304] 0 2023-12-05T09:57:29.967 INFO:tasks.workunit.client.0.smithi100.stdout:8/351: write d0/d12/d13/f25 [1227665,120086] 0 2023-12-05T09:57:29.967 INFO:tasks.workunit.client.0.smithi100.stdout:3/499: link d0/d10/d39/f55 d0/d3d/d5c/d6f/d7f/fac 0 2023-12-05T09:57:29.967 INFO:tasks.workunit.client.0.smithi100.stdout:3/500: chown d0/d2/de/d11/l2b 8 1 2023-12-05T09:57:29.967 INFO:tasks.workunit.client.0.smithi100.stdout:3/501: stat d0/d3d/d5c/d5f/d73/f9d 0 2023-12-05T09:57:29.968 INFO:tasks.workunit.client.1.smithi150.stdout:2/394: symlink d0/d3/d5/d22/l8b 0 2023-12-05T09:57:29.969 INFO:tasks.workunit.client.0.smithi100.stdout:0/386: dread da/fd [0,4194304] 0 2023-12-05T09:57:29.970 INFO:tasks.workunit.client.0.smithi100.stdout:4/352: write de/d16/d23/f47 [645239,32821] 0 2023-12-05T09:57:29.970 INFO:tasks.workunit.client.0.smithi100.stdout:4/353: write de/f12 [5079718,20602] 0 2023-12-05T09:57:29.971 INFO:tasks.workunit.client.1.smithi150.stdout:5/388: symlink d1/d7f/d65/l8a 0 2023-12-05T09:57:29.971 INFO:tasks.workunit.client.1.smithi150.stdout:5/389: chown d1/d7f/d65/d3b/d37/c6f 82 1 2023-12-05T09:57:29.973 INFO:tasks.workunit.client.1.smithi150.stdout:1/409: dwrite d6/f1a [4194304,4194304] 0 2023-12-05T09:57:29.973 INFO:tasks.workunit.client.0.smithi100.stdout:3/502: creat d0/d2/de/d11/fad x:0 0 0 2023-12-05T09:57:29.976 INFO:tasks.workunit.client.0.smithi100.stdout:0/387: truncate da/d2a/f3f 1581465 0 2023-12-05T09:57:29.978 INFO:tasks.workunit.client.1.smithi150.stdout:7/418: creat d2/db/d30/d18/d1a/d1e/d2b/f84 x:0 0 0 2023-12-05T09:57:29.979 INFO:tasks.workunit.client.0.smithi100.stdout:4/354: dread de/f48 [0,4194304] 0 2023-12-05T09:57:29.979 INFO:tasks.workunit.client.0.smithi100.stdout:3/503: creat d0/d2/d33/fae x:0 0 0 2023-12-05T09:57:29.979 INFO:tasks.workunit.client.0.smithi100.stdout:4/355: creat de/d16/d23/d33/d3d/f6f x:0 0 0 2023-12-05T09:57:29.979 INFO:tasks.workunit.client.0.smithi100.stdout:4/356: dread - de/f4a zero size 2023-12-05T09:57:29.979 INFO:tasks.workunit.client.1.smithi150.stdout:6/343: mkdir d2/d23/d2e/d72 0 2023-12-05T09:57:29.980 INFO:tasks.workunit.client.0.smithi100.stdout:0/388: link da/d22/f2b da/d22/d33/f75 0 2023-12-05T09:57:29.980 INFO:tasks.workunit.client.0.smithi100.stdout:0/389: fsync da/d1b/d36/f48 0 2023-12-05T09:57:29.980 INFO:tasks.workunit.client.0.smithi100.stdout:0/390: rename da to da/d1b/d73/d76 22 2023-12-05T09:57:29.981 INFO:tasks.workunit.client.1.smithi150.stdout:0/444: write d5/d11/d32/f39 [4250262,20621] 0 2023-12-05T09:57:29.981 INFO:tasks.workunit.client.1.smithi150.stdout:1/410: dread d6/d8/db/f73 [4194304,4194304] 0 2023-12-05T09:57:29.981 INFO:tasks.workunit.client.1.smithi150.stdout:8/408: dwrite d0/d41/d49/d1b/d24/d2e/f44 [0,4194304] 0 2023-12-05T09:57:29.982 INFO:tasks.workunit.client.1.smithi150.stdout:3/405: truncate d6/d9/f1b 884022 0 2023-12-05T09:57:29.982 INFO:tasks.workunit.client.1.smithi150.stdout:3/406: write d6/d25/f70 [755767,21151] 0 2023-12-05T09:57:29.983 INFO:tasks.workunit.client.0.smithi100.stdout:3/504: link d0/d2/f75 d0/d10/d39/dab/faf 0 2023-12-05T09:57:29.984 INFO:tasks.workunit.client.1.smithi150.stdout:2/395: mknod d0/d42/c8c 0 2023-12-05T09:57:29.985 INFO:tasks.workunit.client.1.smithi150.stdout:6/344: dread d2/f34 [0,4194304] 0 2023-12-05T09:57:29.987 INFO:tasks.workunit.client.1.smithi150.stdout:5/390: creat d1/d7f/d65/d3b/d6b/f8b x:0 0 0 2023-12-05T09:57:29.987 INFO:tasks.workunit.client.0.smithi100.stdout:2/544: dwrite d7/da/d18/d1b/f59 [0,4194304] 0 2023-12-05T09:57:29.990 INFO:tasks.workunit.client.0.smithi100.stdout:8/352: dread d0/f9 [0,4194304] 0 2023-12-05T09:57:29.993 INFO:tasks.workunit.client.0.smithi100.stdout:0/391: unlink da/d2a/d4d/c55 0 2023-12-05T09:57:30.000 INFO:tasks.workunit.client.0.smithi100.stdout:3/505: mkdir d0/d2/de/d11/d58/db0 0 2023-12-05T09:57:30.004 INFO:tasks.workunit.client.1.smithi150.stdout:0/445: write d5/d11/d71/f30 [363934,8544] 0 2023-12-05T09:57:30.005 INFO:tasks.workunit.client.1.smithi150.stdout:8/409: unlink d0/d41/d49/d1b/d24/d38/f77 0 2023-12-05T09:57:30.013 INFO:tasks.workunit.client.1.smithi150.stdout:3/407: truncate d6/d9/d43/f60 3995832 0 2023-12-05T09:57:30.013 INFO:tasks.workunit.client.1.smithi150.stdout:3/408: chown d6/d9/d3d/d56/d53/f69 10 1 2023-12-05T09:57:30.016 INFO:tasks.workunit.client.0.smithi100.stdout:2/545: creat d7/da/d13/d69/fba x:0 0 0 2023-12-05T09:57:30.016 INFO:tasks.workunit.client.0.smithi100.stdout:2/546: chown d7/da/d18/d1b/f6c 23731 1 2023-12-05T09:57:30.016 INFO:tasks.workunit.client.0.smithi100.stdout:2/547: write d7/da/f8a [68276,887] 0 2023-12-05T09:57:30.017 INFO:tasks.workunit.client.1.smithi150.stdout:5/391: dread d1/d3/d6/d1b/d22/d24/f41 [0,4194304] 0 2023-12-05T09:57:30.017 INFO:tasks.workunit.client.1.smithi150.stdout:5/392: write d1/d7f/f79 [213854,90634] 0 2023-12-05T09:57:30.018 INFO:tasks.workunit.client.1.smithi150.stdout:2/396: link d0/d3/d5/d10/f20 d0/d3/d5/d13/d15/f8d 0 2023-12-05T09:57:30.019 INFO:tasks.workunit.client.1.smithi150.stdout:2/397: chown d0/d3/cd 6603 1 2023-12-05T09:57:30.019 INFO:tasks.workunit.client.1.smithi150.stdout:2/398: stat d0/d3/d21/c46 0 2023-12-05T09:57:30.020 INFO:tasks.workunit.client.0.smithi100.stdout:4/357: getdents de/d16/d23 0 2023-12-05T09:57:30.023 INFO:tasks.workunit.client.0.smithi100.stdout:3/506: write d0/d10/d39/f98 [3011282,108162] 0 2023-12-05T09:57:30.025 INFO:tasks.workunit.client.0.smithi100.stdout:0/392: rename da/d1b/d4a to da/d22/d33/d74/d77 0 2023-12-05T09:57:30.026 INFO:tasks.workunit.client.1.smithi150.stdout:4/349: getdents d0/d11 0 2023-12-05T09:57:30.026 INFO:tasks.workunit.client.0.smithi100.stdout:0/393: write da/d22/d33/d35/d3a/f67 [2911846,43155] 0 2023-12-05T09:57:30.030 INFO:tasks.workunit.client.1.smithi150.stdout:1/411: dwrite d6/d8/db/f20 [0,4194304] 0 2023-12-05T09:57:30.033 INFO:tasks.workunit.client.1.smithi150.stdout:8/410: mkdir d0/d41/d49/d1b/d24/d38/d84 0 2023-12-05T09:57:30.034 INFO:tasks.workunit.client.1.smithi150.stdout:9/346: sync 2023-12-05T09:57:30.034 INFO:tasks.workunit.client.0.smithi100.stdout:3/507: dread d0/d4/d3a/f64 [0,4194304] 0 2023-12-05T09:57:30.034 INFO:tasks.workunit.client.1.smithi150.stdout:3/409: rmdir d6/d25 39 2023-12-05T09:57:30.035 INFO:tasks.workunit.client.1.smithi150.stdout:3/410: chown d6/d9/d43 690901 1 2023-12-05T09:57:30.036 INFO:tasks.workunit.client.1.smithi150.stdout:7/419: dwrite d2/db/d30/d18/d1a/d1e/f21 [8388608,4194304] 0 2023-12-05T09:57:30.039 INFO:tasks.workunit.client.0.smithi100.stdout:2/548: mknod d7/da/d18/d21/d4d/cbb 0 2023-12-05T09:57:30.039 INFO:tasks.workunit.client.0.smithi100.stdout:2/549: chown d7/da/l6d 5 1 2023-12-05T09:57:30.041 INFO:tasks.workunit.client.1.smithi150.stdout:5/393: creat d1/f8c x:0 0 0 2023-12-05T09:57:30.047 INFO:tasks.workunit.client.1.smithi150.stdout:2/399: creat d0/f8e x:0 0 0 2023-12-05T09:57:30.051 INFO:tasks.workunit.client.0.smithi100.stdout:4/358: rename de/d16/d23/l32 to de/d16/d23/d33/d3d/d44/l70 0 2023-12-05T09:57:30.054 INFO:tasks.workunit.client.0.smithi100.stdout:3/508: dread d0/d2/f6e [0,4194304] 0 2023-12-05T09:57:30.054 INFO:tasks.workunit.client.0.smithi100.stdout:3/509: write d0/d4/d3a/d45/f89 [794083,62648] 0 2023-12-05T09:57:30.054 INFO:tasks.workunit.client.0.smithi100.stdout:3/510: read d0/d10/d39/f98 [4348170,101806] 0 2023-12-05T09:57:30.057 INFO:tasks.workunit.client.1.smithi150.stdout:4/350: truncate d0/d42/f4c 3550766 0 2023-12-05T09:57:30.057 INFO:tasks.workunit.client.1.smithi150.stdout:4/351: chown d0/d3e 11776 1 2023-12-05T09:57:30.059 INFO:tasks.workunit.client.0.smithi100.stdout:6/776: write d7/d27/f9a [1688648,53067] 0 2023-12-05T09:57:30.061 INFO:tasks.workunit.client.0.smithi100.stdout:2/550: rename d7/da/d18/d1b/d2c/l3d to d7/db4/lbc 0 2023-12-05T09:57:30.069 INFO:tasks.workunit.client.0.smithi100.stdout:3/511: truncate d0/f36 3358032 0 2023-12-05T09:57:30.070 INFO:tasks.workunit.client.0.smithi100.stdout:3/512: write d0/d2/f23 [140130,50605] 0 2023-12-05T09:57:30.074 INFO:tasks.workunit.client.0.smithi100.stdout:6/777: creat d7/d11/d1a/d78/de4/fff x:0 0 0 2023-12-05T09:57:30.076 INFO:tasks.workunit.client.1.smithi150.stdout:6/345: rename d2/d23/d60 to d2/d23/d2e/d44/d73 0 2023-12-05T09:57:30.076 INFO:tasks.workunit.client.1.smithi150.stdout:8/411: symlink d0/d41/d49/d1b/d24/d34/d56/l85 0 2023-12-05T09:57:30.076 INFO:tasks.workunit.client.1.smithi150.stdout:8/412: fdatasync d0/d41/d49/d1b/d24/d38/d62/f65 0 2023-12-05T09:57:30.076 INFO:tasks.workunit.client.1.smithi150.stdout:8/413: chown d0/d41/d49/d1b/d24/d2e/f6e 1426 1 2023-12-05T09:57:30.078 INFO:tasks.workunit.client.1.smithi150.stdout:3/411: creat d6/f80 x:0 0 0 2023-12-05T09:57:30.078 INFO:tasks.workunit.client.1.smithi150.stdout:3/412: chown d6/d9/d3d/d52/f6f 2125993 1 2023-12-05T09:57:30.078 INFO:tasks.workunit.client.1.smithi150.stdout:3/413: chown d6/d9/d3d/d56/l2b 3 1 2023-12-05T09:57:30.080 INFO:tasks.workunit.client.0.smithi100.stdout:3/513: rename d0/d2/de/d11/c92 to d0/d4/cb1 0 2023-12-05T09:57:30.085 INFO:tasks.workunit.client.0.smithi100.stdout:6/778: truncate d7/d11/f98 568415 0 2023-12-05T09:57:30.085 INFO:tasks.workunit.client.0.smithi100.stdout:6/779: fdatasync d7/d2d/f46 0 2023-12-05T09:57:30.086 INFO:tasks.workunit.client.0.smithi100.stdout:6/780: write d7/d11/d82/f28 [1250947,112380] 0 2023-12-05T09:57:30.092 INFO:tasks.workunit.client.0.smithi100.stdout:3/514: creat d0/d3d/fb2 x:0 0 0 2023-12-05T09:57:30.095 INFO:tasks.workunit.client.1.smithi150.stdout:7/420: mkdir d2/db/d17/d38/d85 0 2023-12-05T09:57:30.097 INFO:tasks.workunit.client.1.smithi150.stdout:5/394: mkdir d1/d7f/d65/d3b/d8d 0 2023-12-05T09:57:30.099 INFO:tasks.workunit.client.0.smithi100.stdout:3/515: mknod d0/d3d/d5c/cb3 0 2023-12-05T09:57:30.099 INFO:tasks.workunit.client.0.smithi100.stdout:3/516: chown d0/d2/de/f38 27159969 1 2023-12-05T09:57:30.100 INFO:tasks.workunit.client.1.smithi150.stdout:1/412: dwrite d6/d8/db/d1b/d79/f86 [0,4194304] 0 2023-12-05T09:57:30.100 INFO:tasks.workunit.client.1.smithi150.stdout:1/413: readlink d6/d8/d59/l7b 0 2023-12-05T09:57:30.100 INFO:tasks.workunit.client.1.smithi150.stdout:1/414: chown d6/d8/db/f19 711361 1 2023-12-05T09:57:30.101 INFO:tasks.workunit.client.0.smithi100.stdout:6/781: write d7/dcc/fd2 [1319385,10797] 0 2023-12-05T09:57:30.103 INFO:tasks.workunit.client.1.smithi150.stdout:6/346: creat d2/d23/d3b/f74 x:0 0 0 2023-12-05T09:57:30.104 INFO:tasks.workunit.client.1.smithi150.stdout:8/414: link d0/d41/d49/d1b/d24/d2e/d4d/f7c d0/d41/d49/f86 0 2023-12-05T09:57:30.105 INFO:tasks.workunit.client.1.smithi150.stdout:8/415: chown d0/d41/d49/d1b/d24/d2e/d4d/c6f 4810042 1 2023-12-05T09:57:30.105 INFO:tasks.workunit.client.0.smithi100.stdout:2/551: dwrite d7/f34 [0,4194304] 0 2023-12-05T09:57:30.107 INFO:tasks.workunit.client.1.smithi150.stdout:7/421: mknod d2/db/d30/d13/c86 0 2023-12-05T09:57:30.121 INFO:tasks.workunit.client.1.smithi150.stdout:6/347: creat d2/d23/d2e/d72/f75 x:0 0 0 2023-12-05T09:57:30.121 INFO:tasks.workunit.client.1.smithi150.stdout:6/348: write d2/f5a [1308307,111788] 0 2023-12-05T09:57:30.121 INFO:tasks.workunit.client.1.smithi150.stdout:8/416: mkdir d0/d41/d49/d1b/d24/d5b/d87 0 2023-12-05T09:57:30.122 INFO:tasks.workunit.client.0.smithi100.stdout:2/552: mknod d7/da/d13/d4e/d87/cbd 0 2023-12-05T09:57:30.122 INFO:tasks.workunit.client.0.smithi100.stdout:2/553: chown d7/da/dc/d88/c8b 503615417 1 2023-12-05T09:57:30.123 INFO:tasks.workunit.client.0.smithi100.stdout:2/554: chown d7/da/dc/d88/c8b 1 1 2023-12-05T09:57:30.123 INFO:tasks.workunit.client.0.smithi100.stdout:2/555: dread - d7/da/d18/d21/fa4 zero size 2023-12-05T09:57:30.123 INFO:tasks.workunit.client.0.smithi100.stdout:2/556: write d7/da/d18/d1b/d2c/d3f/d46/f47 [1078834,107509] 0 2023-12-05T09:57:30.125 INFO:tasks.workunit.client.1.smithi150.stdout:5/395: dread d1/f51 [0,4194304] 0 2023-12-05T09:57:30.125 INFO:tasks.workunit.client.1.smithi150.stdout:1/415: getdents d6/d8/db/d1b/d79 0 2023-12-05T09:57:30.126 INFO:tasks.workunit.client.1.smithi150.stdout:4/352: dwrite d0/d3e/d48/f52 [0,4194304] 0 2023-12-05T09:57:30.126 INFO:tasks.workunit.client.1.smithi150.stdout:4/353: getdents d0/d11 0 2023-12-05T09:57:30.126 INFO:tasks.workunit.client.1.smithi150.stdout:4/354: creat d0/d11/d4b/f69 x:0 0 0 2023-12-05T09:57:30.126 INFO:tasks.workunit.client.1.smithi150.stdout:2/400: dwrite d0/d3/d5/d10/f19 [4194304,4194304] 0 2023-12-05T09:57:30.127 INFO:tasks.workunit.client.0.smithi100.stdout:2/557: unlink d7/da/d13/d4e/c5a 0 2023-12-05T09:57:30.133 INFO:tasks.workunit.client.0.smithi100.stdout:2/558: link d7/da/d18/d1b/d2c/d3f/d46/f76 d7/da/d18/d21/d86/d92/fbe 0 2023-12-05T09:57:30.138 INFO:tasks.workunit.client.0.smithi100.stdout:2/559: link d7/da/d18/d21/c9f d7/db4/cbf 0 2023-12-05T09:57:30.140 INFO:tasks.workunit.client.1.smithi150.stdout:1/416: unlink d6/d8/c5e 0 2023-12-05T09:57:30.140 INFO:tasks.workunit.client.1.smithi150.stdout:4/355: symlink d0/d42/d44/l6a 0 2023-12-05T09:57:30.143 INFO:tasks.workunit.client.0.smithi100.stdout:2/560: truncate d7/da/d13/f4a 2122637 0 2023-12-05T09:57:30.145 INFO:tasks.workunit.client.1.smithi150.stdout:2/401: rmdir d0/d3/d5/d10 39 2023-12-05T09:57:30.148 INFO:tasks.workunit.client.1.smithi150.stdout:1/417: mkdir d6/d8/d54/d94 0 2023-12-05T09:57:30.150 INFO:tasks.workunit.client.1.smithi150.stdout:4/356: creat d0/d3e/f6b x:0 0 0 2023-12-05T09:57:30.153 INFO:tasks.workunit.client.1.smithi150.stdout:1/418: creat d6/f95 x:0 0 0 2023-12-05T09:57:30.155 INFO:tasks.workunit.client.1.smithi150.stdout:7/422: dwrite d2/db/d17/f78 [0,4194304] 0 2023-12-05T09:57:30.158 INFO:tasks.workunit.client.0.smithi100.stdout:6/782: rename d7/d11/d1a/d78/de4 to d7/dcc/df0/d100 0 2023-12-05T09:57:30.159 INFO:tasks.workunit.client.1.smithi150.stdout:6/349: read d2/d23/d2e/d44/d73/f5e [517557,114827] 0 2023-12-05T09:57:30.161 INFO:tasks.workunit.client.1.smithi150.stdout:3/414: dwrite d6/d9/f1b [0,4194304] 0 2023-12-05T09:57:30.161 INFO:tasks.workunit.client.0.smithi100.stdout:2/561: write d7/da/d13/f5d [6566744,63684] 0 2023-12-05T09:57:30.164 INFO:tasks.workunit.client.0.smithi100.stdout:3/517: dwrite d0/d2/de/d12/f63 [4194304,4194304] 0 2023-12-05T09:57:30.165 INFO:tasks.workunit.client.0.smithi100.stdout:2/562: link d7/f66 d7/da/d18/d1b/d2c/d3f/fc0 0 2023-12-05T09:57:30.166 INFO:tasks.workunit.client.1.smithi150.stdout:7/423: mknod d2/db/d30/d18/d63/c87 0 2023-12-05T09:57:30.170 INFO:tasks.workunit.client.1.smithi150.stdout:2/402: dread d0/d3/d11/f23 [0,4194304] 0 2023-12-05T09:57:30.170 INFO:tasks.workunit.client.1.smithi150.stdout:2/403: fdatasync d0/d3/d5/d22/f82 0 2023-12-05T09:57:30.178 INFO:tasks.workunit.client.1.smithi150.stdout:6/350: symlink d2/d23/d2e/d44/d73/d5d/d6b/l76 0 2023-12-05T09:57:30.178 INFO:tasks.workunit.client.1.smithi150.stdout:7/424: mkdir d2/db/d17/d88 0 2023-12-05T09:57:30.179 INFO:tasks.workunit.client.0.smithi100.stdout:6/783: write d7/d27/d97/fb2 [1899494,11191] 0 2023-12-05T09:57:30.183 INFO:tasks.workunit.client.1.smithi150.stdout:2/404: symlink d0/d3/d5/d22/l8f 0 2023-12-05T09:57:30.184 INFO:tasks.workunit.client.1.smithi150.stdout:2/405: write d0/f49 [3646661,87146] 0 2023-12-05T09:57:30.184 INFO:tasks.workunit.client.1.smithi150.stdout:2/406: readlink d0/d3/d5/l74 0 2023-12-05T09:57:30.187 INFO:tasks.workunit.client.1.smithi150.stdout:8/417: dwrite d0/d8/f51 [0,4194304] 0 2023-12-05T09:57:30.187 INFO:tasks.workunit.client.1.smithi150.stdout:8/418: read - d0/d41/d49/d1b/d24/d2e/f5e zero size 2023-12-05T09:57:30.187 INFO:tasks.workunit.client.1.smithi150.stdout:2/407: rmdir d0/d3/d5/d13/d15/d30 39 2023-12-05T09:57:30.187 INFO:tasks.workunit.client.1.smithi150.stdout:2/408: write d0/f8e [556971,5258] 0 2023-12-05T09:57:30.188 INFO:tasks.workunit.client.1.smithi150.stdout:3/415: dread d6/d9/d3d/d52/d5b/f68 [0,4194304] 0 2023-12-05T09:57:30.188 INFO:tasks.workunit.client.1.smithi150.stdout:5/396: dwrite d1/d7f/d65/d3b/f84 [0,4194304] 0 2023-12-05T09:57:30.188 INFO:tasks.workunit.client.0.smithi100.stdout:2/563: dread d7/d61/f6b [0,4194304] 0 2023-12-05T09:57:30.188 INFO:tasks.workunit.client.0.smithi100.stdout:2/564: read d7/da/d18/d21/d4d/d81/f80 [3680185,97087] 0 2023-12-05T09:57:30.188 INFO:tasks.workunit.client.0.smithi100.stdout:2/565: readlink d7/da/l97 0 2023-12-05T09:57:30.188 INFO:tasks.workunit.client.0.smithi100.stdout:2/566: chown d7/da/d18/d1b/c29 137147 1 2023-12-05T09:57:30.190 INFO:tasks.workunit.client.0.smithi100.stdout:6/784: dread d7/d11/d1a/db1/fb4 [0,4194304] 0 2023-12-05T09:57:30.191 INFO:tasks.workunit.client.0.smithi100.stdout:3/518: rename d0/d3d/d5c/d6f/d7f/fac to d0/d2/de/d12/fb4 0 2023-12-05T09:57:30.193 INFO:tasks.workunit.client.0.smithi100.stdout:6/785: creat d7/d11/d82/db9/dfd/f101 x:0 0 0 2023-12-05T09:57:30.195 INFO:tasks.workunit.client.1.smithi150.stdout:8/419: symlink d0/d41/l88 0 2023-12-05T09:57:30.195 INFO:tasks.workunit.client.1.smithi150.stdout:8/420: write d0/d41/d49/f52 [880355,97284] 0 2023-12-05T09:57:30.195 INFO:tasks.workunit.client.1.smithi150.stdout:8/421: chown d0/d41/d49/d1b/d24/d2e/d4d/l5c 140315268 1 2023-12-05T09:57:30.195 INFO:tasks.workunit.client.1.smithi150.stdout:8/422: truncate d0/d41/d49/d1b/d24/f3b 1056063 0 2023-12-05T09:57:30.197 INFO:tasks.workunit.client.0.smithi100.stdout:3/519: mkdir d0/d2/de/d11/db5 0 2023-12-05T09:57:30.197 INFO:tasks.workunit.client.0.smithi100.stdout:3/520: fdatasync d0/d2/de/d12/f29 0 2023-12-05T09:57:30.197 INFO:tasks.workunit.client.0.smithi100.stdout:3/521: write d0/d10/d39/fa8 [481525,5843] 0 2023-12-05T09:57:30.197 INFO:tasks.workunit.client.0.smithi100.stdout:3/522: dread - d0/d3d/d5c/d6f/d7f/d87/f9a zero size 2023-12-05T09:57:30.199 INFO:tasks.workunit.client.1.smithi150.stdout:2/409: unlink d0/d3/d5/d10/d3d/d41/c68 0 2023-12-05T09:57:30.202 INFO:tasks.workunit.client.0.smithi100.stdout:6/786: mkdir d7/d27/d97/d102 0 2023-12-05T09:57:30.203 INFO:tasks.workunit.client.0.smithi100.stdout:2/567: write d7/da/d18/d21/d4d/d81/f8f [190504,41862] 0 2023-12-05T09:57:30.203 INFO:tasks.workunit.client.1.smithi150.stdout:5/397: symlink d1/d3/d6/d1b/d22/d24/l8e 0 2023-12-05T09:57:30.207 INFO:tasks.workunit.client.1.smithi150.stdout:4/357: dwrite d0/f61 [0,4194304] 0 2023-12-05T09:57:30.211 INFO:tasks.workunit.client.1.smithi150.stdout:8/423: mknod d0/d41/d49/d1b/d24/d34/d56/d67/c89 0 2023-12-05T09:57:30.211 INFO:tasks.workunit.client.1.smithi150.stdout:2/410: unlink d0/d3/d21/c46 0 2023-12-05T09:57:30.212 INFO:tasks.workunit.client.1.smithi150.stdout:3/416: symlink d6/d9/d3d/d52/d5b/l81 0 2023-12-05T09:57:30.214 INFO:tasks.workunit.client.0.smithi100.stdout:2/568: dread d7/da/d18/d21/d4d/f58 [0,4194304] 0 2023-12-05T09:57:30.214 INFO:tasks.workunit.client.1.smithi150.stdout:0/446: sync 2023-12-05T09:57:30.214 INFO:tasks.workunit.client.1.smithi150.stdout:0/447: chown d5/d11/d32/d57/fa1 419203 1 2023-12-05T09:57:30.214 INFO:tasks.workunit.client.1.smithi150.stdout:0/448: chown d5/d11/d16/d1f/f2e 227989967 1 2023-12-05T09:57:30.217 INFO:tasks.workunit.client.1.smithi150.stdout:5/398: creat d1/d3/d6/d72/f8f x:0 0 0 2023-12-05T09:57:30.220 INFO:tasks.workunit.client.0.smithi100.stdout:6/787: rename d7/d11/l69 to d7/d27/d35/d5a/db0/l103 0 2023-12-05T09:57:30.220 INFO:tasks.workunit.client.0.smithi100.stdout:3/523: write d0/d4/d3a/f99 [1870136,14201] 0 2023-12-05T09:57:30.221 INFO:tasks.workunit.client.0.smithi100.stdout:3/524: dread - d0/d3d/d5c/d5f/d73/f9d zero size 2023-12-05T09:57:30.230 INFO:tasks.workunit.client.1.smithi150.stdout:6/351: dwrite d2/d23/d2e/f43 [0,4194304] 0 2023-12-05T09:57:30.233 INFO:tasks.workunit.client.1.smithi150.stdout:9/347: sync 2023-12-05T09:57:30.233 INFO:tasks.workunit.client.1.smithi150.stdout:9/348: write d3/d9/dc/d1f/f2b [941872,117328] 0 2023-12-05T09:57:30.233 INFO:tasks.workunit.client.1.smithi150.stdout:9/349: stat d3/d1b/d46/d55 0 2023-12-05T09:57:30.238 INFO:tasks.workunit.client.0.smithi100.stdout:2/569: getdents d7/da/d18/d1b/d2c 0 2023-12-05T09:57:30.239 INFO:tasks.workunit.client.1.smithi150.stdout:0/449: rmdir d5/d11/d71 39 2023-12-05T09:57:30.239 INFO:tasks.workunit.client.1.smithi150.stdout:0/450: write d5/d11/d16/d1f/d7f/f9a [4456906,20087] 0 2023-12-05T09:57:30.240 INFO:tasks.workunit.client.0.smithi100.stdout:6/788: creat d7/d11/d1a/d78/d80/f104 x:0 0 0 2023-12-05T09:57:30.246 INFO:tasks.workunit.client.1.smithi150.stdout:6/352: link d2/d23/d2e/d44/l6e d2/d23/d3b/d64/l77 0 2023-12-05T09:57:30.247 INFO:tasks.workunit.client.1.smithi150.stdout:0/451: dread d5/d11/d16/f51 [0,4194304] 0 2023-12-05T09:57:30.247 INFO:tasks.workunit.client.1.smithi150.stdout:0/452: creat d5/d11/d32/d57/fa2 x:0 0 0 2023-12-05T09:57:30.248 INFO:tasks.workunit.client.0.smithi100.stdout:6/789: mknod d7/d11/dd1/c105 0 2023-12-05T09:57:30.250 INFO:tasks.workunit.client.1.smithi150.stdout:9/350: symlink d3/d42/d62/l68 0 2023-12-05T09:57:30.257 INFO:tasks.workunit.client.1.smithi150.stdout:6/353: truncate d2/d23/f45 3465425 0 2023-12-05T09:57:30.257 INFO:tasks.workunit.client.0.smithi100.stdout:6/790: truncate d7/fee 867203 0 2023-12-05T09:57:30.259 INFO:tasks.workunit.client.1.smithi150.stdout:9/351: mknod d3/d9/d58/c69 0 2023-12-05T09:57:30.259 INFO:tasks.workunit.client.1.smithi150.stdout:9/352: read - d3/f40 zero size 2023-12-05T09:57:30.261 INFO:tasks.workunit.client.1.smithi150.stdout:6/354: link d2/l66 d2/d23/d2e/d44/l78 0 2023-12-05T09:57:30.262 INFO:tasks.workunit.client.0.smithi100.stdout:6/791: mknod d7/d27/d35/c106 0 2023-12-05T09:57:30.262 INFO:tasks.workunit.client.0.smithi100.stdout:6/792: dread - d7/d27/d35/d5a/f9d zero size 2023-12-05T09:57:30.267 INFO:tasks.workunit.client.1.smithi150.stdout:6/355: symlink d2/d23/d2e/d44/d73/d5d/d6b/d63/l79 0 2023-12-05T09:57:30.267 INFO:tasks.workunit.client.1.smithi150.stdout:7/425: dwrite d2/db/d30/d18/d63/f7f [0,4194304] 0 2023-12-05T09:57:30.267 INFO:tasks.workunit.client.1.smithi150.stdout:0/453: dread d5/d11/d71/d99/d9c/f3c [8388608,4194304] 0 2023-12-05T09:57:30.267 INFO:tasks.workunit.client.1.smithi150.stdout:7/426: truncate d2/db/d17/f7a 1034670 0 2023-12-05T09:57:30.269 INFO:tasks.workunit.client.0.smithi100.stdout:1/384: sync 2023-12-05T09:57:30.269 INFO:tasks.workunit.client.0.smithi100.stdout:0/394: sync 2023-12-05T09:57:30.269 INFO:tasks.workunit.client.0.smithi100.stdout:8/353: sync 2023-12-05T09:57:30.269 INFO:tasks.workunit.client.0.smithi100.stdout:9/447: sync 2023-12-05T09:57:30.270 INFO:tasks.workunit.client.0.smithi100.stdout:8/354: chown d0/f9 1190 1 2023-12-05T09:57:30.270 INFO:tasks.workunit.client.0.smithi100.stdout:5/463: sync 2023-12-05T09:57:30.271 INFO:tasks.workunit.client.1.smithi150.stdout:4/358: write d0/d11/f2a [1694117,74668] 0 2023-12-05T09:57:30.271 INFO:tasks.workunit.client.1.smithi150.stdout:4/359: stat d0/d3e/f6b 0 2023-12-05T09:57:30.271 INFO:tasks.workunit.client.1.smithi150.stdout:9/353: rename d3/d9/dc/d1f/l39 to d3/d9/dc/d1f/l6a 0 2023-12-05T09:57:30.274 INFO:tasks.workunit.client.0.smithi100.stdout:6/793: rmdir d7/d11/d82/db9 39 2023-12-05T09:57:30.277 INFO:tasks.workunit.client.0.smithi100.stdout:6/794: write d7/d11/d1a/db1/fb4 [631842,68791] 0 2023-12-05T09:57:30.279 INFO:tasks.workunit.client.0.smithi100.stdout:0/395: unlink da/d1b/f52 0 2023-12-05T09:57:30.280 INFO:tasks.workunit.client.0.smithi100.stdout:0/396: fdatasync da/f2d 0 2023-12-05T09:57:30.280 INFO:tasks.workunit.client.1.smithi150.stdout:5/399: dread d1/d3/d6/d26/f3e [0,4194304] 0 2023-12-05T09:57:30.280 INFO:tasks.workunit.client.1.smithi150.stdout:5/400: creat d1/d2e/f90 x:0 0 0 2023-12-05T09:57:30.280 INFO:tasks.workunit.client.1.smithi150.stdout:5/401: creat d1/d7f/d65/d3b/d6b/f91 x:0 0 0 2023-12-05T09:57:30.280 INFO:tasks.workunit.client.1.smithi150.stdout:5/402: readlink d1/l6e 0 2023-12-05T09:57:30.283 INFO:tasks.workunit.client.0.smithi100.stdout:9/448: rmdir d7/d1b/d22/d2a/d56/d2e/d50/d5b 39 2023-12-05T09:57:30.287 INFO:tasks.workunit.client.0.smithi100.stdout:9/449: write d7/d1b/d22/d2a/d56/d2e/d50/f61 [1098732,81735] 0 2023-12-05T09:57:30.287 INFO:tasks.workunit.client.0.smithi100.stdout:9/450: dread - d7/d35/f86 zero size 2023-12-05T09:57:30.295 INFO:tasks.workunit.client.1.smithi150.stdout:8/424: dwrite d0/d8/f82 [0,4194304] 0 2023-12-05T09:57:30.295 INFO:tasks.workunit.client.1.smithi150.stdout:3/417: dwrite d6/d9/d3d/d56/d30/f5e [0,4194304] 0 2023-12-05T09:57:30.296 INFO:tasks.workunit.client.0.smithi100.stdout:8/355: creat d0/d12/d13/d16/d22/f55 x:0 0 0 2023-12-05T09:57:30.298 INFO:tasks.workunit.client.1.smithi150.stdout:4/360: read d0/d3e/d48/d4d/f57 [4210650,123602] 0 2023-12-05T09:57:30.299 INFO:tasks.workunit.client.0.smithi100.stdout:3/525: dwrite d0/f36 [0,4194304] 0 2023-12-05T09:57:30.299 INFO:tasks.workunit.client.0.smithi100.stdout:2/570: dwrite d7/da/f6f [0,4194304] 0 2023-12-05T09:57:30.299 INFO:tasks.workunit.client.0.smithi100.stdout:2/571: chown d7/da/dc/f7a 2097531989 1 2023-12-05T09:57:30.300 INFO:tasks.workunit.client.0.smithi100.stdout:4/359: sync 2023-12-05T09:57:30.300 INFO:tasks.workunit.client.0.smithi100.stdout:7/344: sync 2023-12-05T09:57:30.300 INFO:tasks.workunit.client.0.smithi100.stdout:4/360: chown de/d16/d23/d36/f56 7 1 2023-12-05T09:57:30.300 INFO:tasks.workunit.client.0.smithi100.stdout:4/361: creat de/d38/d5d/f71 x:0 0 0 2023-12-05T09:57:30.301 INFO:tasks.workunit.client.0.smithi100.stdout:5/464: unlink d0/d16/d2b/d75/f7a 0 2023-12-05T09:57:30.302 INFO:tasks.workunit.client.1.smithi150.stdout:2/411: dwrite d0/f16 [0,4194304] 0 2023-12-05T09:57:30.302 INFO:tasks.workunit.client.1.smithi150.stdout:2/412: creat d0/d3/d21/d4d/f90 x:0 0 0 2023-12-05T09:57:30.306 INFO:tasks.workunit.client.0.smithi100.stdout:0/397: mkdir da/d1b/d6b/d78 0 2023-12-05T09:57:30.315 INFO:tasks.workunit.client.0.smithi100.stdout:8/356: link d0/c7 d0/d12/d13/d16/d42/c56 0 2023-12-05T09:57:30.315 INFO:tasks.workunit.client.0.smithi100.stdout:8/357: truncate d0/d12/d13/d16/d22/d24/f3f 377363 0 2023-12-05T09:57:30.321 INFO:tasks.workunit.client.1.smithi150.stdout:9/354: truncate d3/d9/dc/f4b 1257637 0 2023-12-05T09:57:30.324 INFO:tasks.workunit.client.1.smithi150.stdout:6/356: rename d2/d23/d2e/d44/d73 to d2/d23/d3b/d64/d7a 0 2023-12-05T09:57:30.325 INFO:tasks.workunit.client.0.smithi100.stdout:1/385: mknod db/c7a 0 2023-12-05T09:57:30.327 INFO:tasks.workunit.client.0.smithi100.stdout:8/358: dread d0/d12/f32 [0,4194304] 0 2023-12-05T09:57:30.327 INFO:tasks.workunit.client.0.smithi100.stdout:6/795: dwrite d7/d11/f4c [0,4194304] 0 2023-12-05T09:57:30.327 INFO:tasks.workunit.client.1.smithi150.stdout:7/427: dwrite d2/db/d2e/f76 [0,4194304] 0 2023-12-05T09:57:30.327 INFO:tasks.workunit.client.1.smithi150.stdout:7/428: chown d2/db/d30/d13/d4f/d5a/d5c/l61 27433698 1 2023-12-05T09:57:30.330 INFO:tasks.workunit.client.0.smithi100.stdout:3/526: rename d0/d2/de/f38 to d0/d2/de/d11/d7c/fb6 0 2023-12-05T09:57:30.331 INFO:tasks.workunit.client.1.smithi150.stdout:5/403: mkdir d1/d3/d92 0 2023-12-05T09:57:30.335 INFO:tasks.workunit.client.0.smithi100.stdout:2/572: symlink d7/da/d18/lc1 0 2023-12-05T09:57:30.337 INFO:tasks.workunit.client.0.smithi100.stdout:2/573: creat d7/da/d18/d1b/d2c/d3f/d46/fc2 x:0 0 0 2023-12-05T09:57:30.339 INFO:tasks.workunit.client.0.smithi100.stdout:4/362: symlink de/d16/d23/d33/l72 0 2023-12-05T09:57:30.345 INFO:tasks.workunit.client.1.smithi150.stdout:3/418: unlink d6/c7 0 2023-12-05T09:57:30.346 INFO:tasks.workunit.client.0.smithi100.stdout:7/345: dwrite d3/dc/d11/d13/de/d18/d3b/d40/d46/f50 [0,4194304] 0 2023-12-05T09:57:30.348 INFO:tasks.workunit.client.1.smithi150.stdout:0/454: dwrite d5/d11/d71/d99/d9c/d46/f89 [0,4194304] 0 2023-12-05T09:57:30.352 INFO:tasks.workunit.client.1.smithi150.stdout:4/361: symlink d0/d3e/d48/l6c 0 2023-12-05T09:57:30.352 INFO:tasks.workunit.client.1.smithi150.stdout:4/362: truncate d0/d11/f3f 9051243 0 2023-12-05T09:57:30.352 INFO:tasks.workunit.client.1.smithi150.stdout:4/363: fsync d0/d11/d4b/f65 0 2023-12-05T09:57:30.354 INFO:tasks.workunit.client.1.smithi150.stdout:8/425: mknod d0/d41/d49/d1b/d24/d2e/d4d/d83/c8a 0 2023-12-05T09:57:30.355 INFO:tasks.workunit.client.0.smithi100.stdout:4/363: dread de/d16/d23/f2c [0,4194304] 0 2023-12-05T09:57:30.355 INFO:tasks.workunit.client.0.smithi100.stdout:4/364: stat de/d16/d23/f53 0 2023-12-05T09:57:30.355 INFO:tasks.workunit.client.0.smithi100.stdout:4/365: dread - de/d66/f6c zero size 2023-12-05T09:57:30.356 INFO:tasks.workunit.client.0.smithi100.stdout:4/366: read - de/d16/d23/d33/d3d/f3f zero size 2023-12-05T09:57:30.357 INFO:tasks.workunit.client.0.smithi100.stdout:1/386: creat db/d12/d1e/d26/d39/f7b x:0 0 0 2023-12-05T09:57:30.361 INFO:tasks.workunit.client.1.smithi150.stdout:1/419: sync 2023-12-05T09:57:30.365 INFO:tasks.workunit.client.1.smithi150.stdout:6/357: unlink d2/d23/d3b/d64/d7a/d5d/d6b/cd 0 2023-12-05T09:57:30.366 INFO:tasks.workunit.client.0.smithi100.stdout:6/796: link d7/d76/fc1 d7/d11/d82/db9/dfd/f107 0 2023-12-05T09:57:30.371 INFO:tasks.workunit.client.1.smithi150.stdout:5/404: rename d1/d3/fb to d1/d3/d6/d1b/d22/d24/f93 0 2023-12-05T09:57:30.371 INFO:tasks.workunit.client.1.smithi150.stdout:5/405: readlink d1/d3/d6/d1b/d22/d24/l8e 0 2023-12-05T09:57:30.372 INFO:tasks.workunit.client.1.smithi150.stdout:8/426: write d0/d41/d49/f86 [3364211,25339] 0 2023-12-05T09:57:30.373 INFO:tasks.workunit.client.0.smithi100.stdout:5/465: mkdir d0/d1f/d9f 0 2023-12-05T09:57:30.376 INFO:tasks.workunit.client.1.smithi150.stdout:4/364: unlink d0/d3e/c5e 0 2023-12-05T09:57:30.376 INFO:tasks.workunit.client.1.smithi150.stdout:4/365: truncate d0/f51 1179262 0 2023-12-05T09:57:30.377 INFO:tasks.workunit.client.0.smithi100.stdout:7/346: fsync d3/dc/d11/d13/de/d2d/f44 0 2023-12-05T09:57:30.377 INFO:tasks.workunit.client.0.smithi100.stdout:7/347: write d3/f1f [4441200,23562] 0 2023-12-05T09:57:30.377 INFO:tasks.workunit.client.0.smithi100.stdout:7/348: dread - d3/f67 zero size 2023-12-05T09:57:30.378 INFO:tasks.workunit.client.1.smithi150.stdout:6/358: symlink d2/d23/d3b/l7b 0 2023-12-05T09:57:30.378 INFO:tasks.workunit.client.1.smithi150.stdout:5/406: creat d1/d7f/f94 x:0 0 0 2023-12-05T09:57:30.380 INFO:tasks.workunit.client.0.smithi100.stdout:4/367: creat de/f73 x:0 0 0 2023-12-05T09:57:30.380 INFO:tasks.workunit.client.1.smithi150.stdout:0/455: dread d5/f5d [0,4194304] 0 2023-12-05T09:57:30.381 INFO:tasks.workunit.client.1.smithi150.stdout:0/456: fdatasync d5/d11/d16/f63 0 2023-12-05T09:57:30.381 INFO:tasks.workunit.client.1.smithi150.stdout:0/457: chown d5/d11/d71/l8e 135229 1 2023-12-05T09:57:30.381 INFO:tasks.workunit.client.1.smithi150.stdout:0/458: write d5/d11/f59 [13791,63924] 0 2023-12-05T09:57:30.382 INFO:tasks.workunit.client.0.smithi100.stdout:1/387: mknod db/d12/d1e/d72/c7c 0 2023-12-05T09:57:30.383 INFO:tasks.workunit.client.1.smithi150.stdout:3/419: mknod d6/d9/d3d/d52/d5b/c82 0 2023-12-05T09:57:30.384 INFO:tasks.workunit.client.1.smithi150.stdout:3/420: chown d6/d22/d37/d63/f4d 192276831 1 2023-12-05T09:57:30.384 INFO:tasks.workunit.client.1.smithi150.stdout:2/413: dwrite d0/d3/f14 [0,4194304] 0 2023-12-05T09:57:30.384 INFO:tasks.workunit.client.0.smithi100.stdout:6/797: symlink d7/dcc/l108 0 2023-12-05T09:57:30.386 INFO:tasks.workunit.client.0.smithi100.stdout:6/798: creat d7/d11/d1a/db1/f109 x:0 0 0 2023-12-05T09:57:30.386 INFO:tasks.workunit.client.0.smithi100.stdout:6/799: read d7/fbe [331379,7413] 0 2023-12-05T09:57:30.386 INFO:tasks.workunit.client.0.smithi100.stdout:6/800: dread - d7/d11/d1a/fdf zero size 2023-12-05T09:57:30.386 INFO:tasks.workunit.client.0.smithi100.stdout:8/359: dwrite d0/f19 [0,4194304] 0 2023-12-05T09:57:30.387 INFO:tasks.workunit.client.0.smithi100.stdout:8/360: fdatasync d0/f2 0 2023-12-05T09:57:30.388 INFO:tasks.workunit.client.0.smithi100.stdout:2/574: symlink d7/db4/lc3 0 2023-12-05T09:57:30.388 INFO:tasks.workunit.client.1.smithi150.stdout:4/366: getdents d0/d5f 0 2023-12-05T09:57:30.388 INFO:tasks.workunit.client.1.smithi150.stdout:9/355: dwrite d3/d9/f1c [4194304,4194304] 0 2023-12-05T09:57:30.388 INFO:tasks.workunit.client.1.smithi150.stdout:9/356: chown d3/d9/dc/c10 16 1 2023-12-05T09:57:30.388 INFO:tasks.workunit.client.1.smithi150.stdout:9/357: creat d3/d9/dc/d1f/d24/f6b x:0 0 0 2023-12-05T09:57:30.388 INFO:tasks.workunit.client.1.smithi150.stdout:9/358: readlink d3/d9/d26/l4a 0 2023-12-05T09:57:30.389 INFO:tasks.workunit.client.1.smithi150.stdout:5/407: mknod d1/d2e/c95 0 2023-12-05T09:57:30.390 INFO:tasks.workunit.client.1.smithi150.stdout:5/408: fsync d1/f8c 0 2023-12-05T09:57:30.390 INFO:tasks.workunit.client.1.smithi150.stdout:5/409: chown d1/d3/f7e 4 1 2023-12-05T09:57:30.390 INFO:tasks.workunit.client.1.smithi150.stdout:5/410: creat d1/f96 x:0 0 0 2023-12-05T09:57:30.391 INFO:tasks.workunit.client.0.smithi100.stdout:5/466: mkdir d0/d16/d2b/d48/df/d51/d7b/da0 0 2023-12-05T09:57:30.396 INFO:tasks.workunit.client.0.smithi100.stdout:7/349: mknod d3/dc/d11/d13/de/d2d/d47/c76 0 2023-12-05T09:57:30.399 INFO:tasks.workunit.client.0.smithi100.stdout:4/368: symlink de/d16/d23/d33/d51/l74 0 2023-12-05T09:57:30.404 INFO:tasks.workunit.client.0.smithi100.stdout:1/388: creat db/d31/d3a/d4a/f7d x:0 0 0 2023-12-05T09:57:30.404 INFO:tasks.workunit.client.0.smithi100.stdout:1/389: fsync db/d31/d3a/f4c 0 2023-12-05T09:57:30.404 INFO:tasks.workunit.client.0.smithi100.stdout:1/390: chown db/d12/d1e/d26/d30/d6e/c74 13686562 1 2023-12-05T09:57:30.407 INFO:tasks.workunit.client.1.smithi150.stdout:0/459: creat d5/d11/d16/fa3 x:0 0 0 2023-12-05T09:57:30.407 INFO:tasks.workunit.client.1.smithi150.stdout:0/460: chown d5/d11/d65/f76 19 1 2023-12-05T09:57:30.407 INFO:tasks.workunit.client.1.smithi150.stdout:3/421: truncate d6/f5d 3653361 0 2023-12-05T09:57:30.408 INFO:tasks.workunit.client.1.smithi150.stdout:2/414: link d0/d3/d5/d10/d3d/d41/f7b d0/d3/d5/d13/d15/d30/d54/d57/f91 0 2023-12-05T09:57:30.408 INFO:tasks.workunit.client.1.smithi150.stdout:3/422: truncate d6/d9/f32 1197931 0 2023-12-05T09:57:30.408 INFO:tasks.workunit.client.1.smithi150.stdout:7/429: dwrite d2/db/d30/d13/f66 [4194304,4194304] 0 2023-12-05T09:57:30.408 INFO:tasks.workunit.client.1.smithi150.stdout:7/430: write d2/db/d30/d13/d4f/d5a/d5c/f7c [1015145,35518] 0 2023-12-05T09:57:30.408 INFO:tasks.workunit.client.1.smithi150.stdout:7/431: creat d2/db/d30/d13/d4f/d5a/d5c/f89 x:0 0 0 2023-12-05T09:57:30.409 INFO:tasks.workunit.client.1.smithi150.stdout:9/359: truncate d3/d9/f52 2953470 0 2023-12-05T09:57:30.411 INFO:tasks.workunit.client.0.smithi100.stdout:8/361: link d0/d12/d13/d16/d22/c44 d0/d12/d13/d16/d22/c57 0 2023-12-05T09:57:30.411 INFO:tasks.workunit.client.0.smithi100.stdout:8/362: fdatasync d0/d12/d13/f3e 0 2023-12-05T09:57:30.414 INFO:tasks.workunit.client.0.smithi100.stdout:2/575: chown d7/da/d18/d21/d4d/f58 1460755 1 2023-12-05T09:57:30.415 INFO:tasks.workunit.client.1.smithi150.stdout:5/411: dread d1/d3/d6/f3f [0,4194304] 0 2023-12-05T09:57:30.419 INFO:tasks.workunit.client.1.smithi150.stdout:5/412: write d1/d2e/f80 [248024,95155] 0 2023-12-05T09:57:30.420 INFO:tasks.workunit.client.1.smithi150.stdout:0/461: mknod d5/d11/d71/d5f/d77/ca4 0 2023-12-05T09:57:30.420 INFO:tasks.workunit.client.1.smithi150.stdout:3/423: mknod d6/d9/d3d/d56/d30/c83 0 2023-12-05T09:57:30.421 INFO:tasks.workunit.client.0.smithi100.stdout:7/350: mknod d3/dc/d11/d13/d37/c77 0 2023-12-05T09:57:30.424 INFO:tasks.workunit.client.0.smithi100.stdout:1/391: link db/d12/l2d db/d31/d3a/l7e 0 2023-12-05T09:57:30.425 INFO:tasks.workunit.client.1.smithi150.stdout:4/367: dread d0/d3e/d48/f4e [0,4194304] 0 2023-12-05T09:57:30.425 INFO:tasks.workunit.client.1.smithi150.stdout:4/368: fsync d0/d11/f23 0 2023-12-05T09:57:30.426 INFO:tasks.workunit.client.0.smithi100.stdout:1/392: read db/d31/f36 [44038,35186] 0 2023-12-05T09:57:30.427 INFO:tasks.workunit.client.0.smithi100.stdout:8/363: rename d0/d12/d13/d16/d22/d24/f3d to d0/d12/d13/d45/f58 0 2023-12-05T09:57:30.430 INFO:tasks.workunit.client.1.smithi150.stdout:7/432: symlink d2/db/d17/d38/d85/l8a 0 2023-12-05T09:57:30.433 INFO:tasks.workunit.client.0.smithi100.stdout:2/576: truncate d7/da/d1a/f38 1555049 0 2023-12-05T09:57:30.433 INFO:tasks.workunit.client.1.smithi150.stdout:9/360: creat d3/d9/dc/d1f/f6c x:0 0 0 2023-12-05T09:57:30.434 INFO:tasks.workunit.client.1.smithi150.stdout:9/361: creat d3/d9/d26/d34/f6d x:0 0 0 2023-12-05T09:57:30.434 INFO:tasks.workunit.client.1.smithi150.stdout:9/362: write d3/d9/f20 [315308,9409] 0 2023-12-05T09:57:30.435 INFO:tasks.workunit.client.0.smithi100.stdout:5/467: mkdir d0/d1f/da1 0 2023-12-05T09:57:30.435 INFO:tasks.workunit.client.0.smithi100.stdout:5/468: fdatasync d0/d1b/f33 0 2023-12-05T09:57:30.438 INFO:tasks.workunit.client.0.smithi100.stdout:1/393: mknod db/d12/d61/c7f 0 2023-12-05T09:57:30.441 INFO:tasks.workunit.client.0.smithi100.stdout:8/364: symlink d0/d12/d13/d16/d22/d24/l59 0 2023-12-05T09:57:30.441 INFO:tasks.workunit.client.0.smithi100.stdout:8/365: stat d0 0 2023-12-05T09:57:30.447 INFO:tasks.workunit.client.1.smithi150.stdout:1/420: dwrite d6/d8/d59/f76 [0,4194304] 0 2023-12-05T09:57:30.448 INFO:tasks.workunit.client.0.smithi100.stdout:1/394: creat db/d12/d61/f80 x:0 0 0 2023-12-05T09:57:30.451 INFO:tasks.workunit.client.0.smithi100.stdout:4/369: dread de/f11 [0,4194304] 0 2023-12-05T09:57:30.452 INFO:tasks.workunit.client.1.smithi150.stdout:6/359: dwrite d2/d23/d3b/d64/d7a/f5e [0,4194304] 0 2023-12-05T09:57:30.452 INFO:tasks.workunit.client.1.smithi150.stdout:2/415: dread d0/d3/d11/d1d/f2f [4194304,4194304] 0 2023-12-05T09:57:30.452 INFO:tasks.workunit.client.1.smithi150.stdout:2/416: fdatasync d0/d3/d5/d13/d15/d30/d54/f8a 0 2023-12-05T09:57:30.453 INFO:tasks.workunit.client.0.smithi100.stdout:5/469: dread d0/f2 [0,4194304] 0 2023-12-05T09:57:30.454 INFO:tasks.workunit.client.0.smithi100.stdout:6/801: dwrite d7/d27/d35/d5a/fe6 [0,4194304] 0 2023-12-05T09:57:30.458 INFO:tasks.workunit.client.0.smithi100.stdout:8/366: creat d0/f5a x:0 0 0 2023-12-05T09:57:30.458 INFO:tasks.workunit.client.0.smithi100.stdout:2/577: rename d7/da/l94 to d7/da/d18/d21/d86/d92/lc4 0 2023-12-05T09:57:30.462 INFO:tasks.workunit.client.0.smithi100.stdout:1/395: link db/d12/f45 db/d31/f81 0 2023-12-05T09:57:30.462 INFO:tasks.workunit.client.0.smithi100.stdout:1/396: write db/d31/d3a/f42 [332917,92886] 0 2023-12-05T09:57:30.463 INFO:tasks.workunit.client.0.smithi100.stdout:1/397: chown db/d31/d3a/d4a 11791619 1 2023-12-05T09:57:30.463 INFO:tasks.workunit.client.0.smithi100.stdout:4/370: stat de/d38/l65 0 2023-12-05T09:57:30.470 INFO:tasks.workunit.client.0.smithi100.stdout:8/367: dread d0/f2 [4194304,4194304] 0 2023-12-05T09:57:30.471 INFO:tasks.workunit.client.0.smithi100.stdout:8/368: stat d0/d12/l21 0 2023-12-05T09:57:30.472 INFO:tasks.workunit.client.0.smithi100.stdout:5/470: symlink d0/d16/d2b/d48/df/d51/la2 0 2023-12-05T09:57:30.474 INFO:tasks.workunit.client.0.smithi100.stdout:5/471: write d0/d27/f29 [1424343,40684] 0 2023-12-05T09:57:30.474 INFO:tasks.workunit.client.1.smithi150.stdout:3/424: symlink d6/d9/d3d/d56/l84 0 2023-12-05T09:57:30.474 INFO:tasks.workunit.client.1.smithi150.stdout:4/369: rmdir d0/d5f 39 2023-12-05T09:57:30.474 INFO:tasks.workunit.client.1.smithi150.stdout:4/370: truncate d0/d11/f37 1796290 0 2023-12-05T09:57:30.475 INFO:tasks.workunit.client.1.smithi150.stdout:3/425: write d6/d9/d3d/d56/f3b [1602377,96561] 0 2023-12-05T09:57:30.475 INFO:tasks.workunit.client.0.smithi100.stdout:6/802: rename d7/d11/d1a/d78/d80/f104 to d7/dcc/df0/d100/f10a 0 2023-12-05T09:57:30.475 INFO:tasks.workunit.client.0.smithi100.stdout:6/803: stat d7/d11/d1a/db7/fc0 0 2023-12-05T09:57:30.477 INFO:tasks.workunit.client.1.smithi150.stdout:0/462: dwrite d5/d11/d16/f51 [0,4194304] 0 2023-12-05T09:57:30.477 INFO:tasks.workunit.client.1.smithi150.stdout:7/433: creat d2/db/d17/d38/d85/f8b x:0 0 0 2023-12-05T09:57:30.477 INFO:tasks.workunit.client.1.smithi150.stdout:7/434: write d2/db/d30/d13/d4f/f59 [1783013,120834] 0 2023-12-05T09:57:30.477 INFO:tasks.workunit.client.1.smithi150.stdout:7/435: chown d2/d39/f67 76 1 2023-12-05T09:57:30.478 INFO:tasks.workunit.client.0.smithi100.stdout:2/578: mkdir d7/da/d18/d1b/d2c/d3f/dc5 0 2023-12-05T09:57:30.478 INFO:tasks.workunit.client.0.smithi100.stdout:2/579: chown d7/da/d18/d21 517804939 1 2023-12-05T09:57:30.482 INFO:tasks.workunit.client.0.smithi100.stdout:4/371: unlink de/f48 0 2023-12-05T09:57:30.482 INFO:tasks.workunit.client.0.smithi100.stdout:4/372: creat de/d66/f75 x:0 0 0 2023-12-05T09:57:30.483 INFO:tasks.workunit.client.1.smithi150.stdout:5/413: dwrite d1/d3/d6/f3f [0,4194304] 0 2023-12-05T09:57:30.485 INFO:tasks.workunit.client.1.smithi150.stdout:1/421: creat d6/d8/d54/d94/f96 x:0 0 0 2023-12-05T09:57:30.488 INFO:tasks.workunit.client.1.smithi150.stdout:6/360: mknod d2/d23/d3b/d64/c7c 0 2023-12-05T09:57:30.489 INFO:tasks.workunit.client.1.smithi150.stdout:6/361: chown d2/d23/d3b/d64/d7a/d5d/d6b/f1a 7 1 2023-12-05T09:57:30.489 INFO:tasks.workunit.client.0.smithi100.stdout:4/373: mknod de/c76 0 2023-12-05T09:57:30.489 INFO:tasks.workunit.client.0.smithi100.stdout:4/374: readlink l4 0 2023-12-05T09:57:30.491 INFO:tasks.workunit.client.1.smithi150.stdout:2/417: symlink d0/d3/d5/d13/l92 0 2023-12-05T09:57:30.491 INFO:tasks.workunit.client.0.smithi100.stdout:6/804: truncate d7/d27/d97/fea 961165 0 2023-12-05T09:57:30.493 INFO:tasks.workunit.client.0.smithi100.stdout:7/351: dwrite d3/f1f [4194304,4194304] 0 2023-12-05T09:57:30.495 INFO:tasks.workunit.client.0.smithi100.stdout:4/375: truncate f2 2432000 0 2023-12-05T09:57:30.499 INFO:tasks.workunit.client.0.smithi100.stdout:7/352: mknod d3/dc/d11/d13/de/d18/d3b/d40/d46/c78 0 2023-12-05T09:57:30.505 INFO:tasks.workunit.client.1.smithi150.stdout:0/463: creat d5/d11/d71/d99/d9c/fa5 x:0 0 0 2023-12-05T09:57:30.505 INFO:tasks.workunit.client.1.smithi150.stdout:7/436: symlink d2/db/d30/d13/d4f/l8c 0 2023-12-05T09:57:30.505 INFO:tasks.workunit.client.1.smithi150.stdout:0/464: dread - d5/d11/d16/f63 zero size 2023-12-05T09:57:30.505 INFO:tasks.workunit.client.1.smithi150.stdout:7/437: read d2/db/d30/d18/d1a/f3c [42365,73473] 0 2023-12-05T09:57:30.506 INFO:tasks.workunit.client.1.smithi150.stdout:5/414: unlink d1/d7f/d65/d3b/d37/c6f 0 2023-12-05T09:57:30.506 INFO:tasks.workunit.client.1.smithi150.stdout:5/415: chown d1/d7f/d65/d3b/l20 2607156 1 2023-12-05T09:57:30.507 INFO:tasks.workunit.client.1.smithi150.stdout:1/422: creat d6/d8/d85/f97 x:0 0 0 2023-12-05T09:57:30.511 INFO:tasks.workunit.client.1.smithi150.stdout:2/418: mknod d0/d3/d5/d10/d3d/d41/d81/c93 0 2023-12-05T09:57:30.512 INFO:tasks.workunit.client.1.smithi150.stdout:4/371: rename d0/d11 to d0/d3e/d6d 0 2023-12-05T09:57:30.516 INFO:tasks.workunit.client.1.smithi150.stdout:0/465: getdents d5/d11/d71/d5f/d6a 0 2023-12-05T09:57:30.516 INFO:tasks.workunit.client.1.smithi150.stdout:0/466: write d5/d11/d71/f30 [4718559,52406] 0 2023-12-05T09:57:30.516 INFO:tasks.workunit.client.1.smithi150.stdout:0/467: truncate d5/d11/d71/d5f/f70 1209680 0 2023-12-05T09:57:30.516 INFO:tasks.workunit.client.0.smithi100.stdout:4/376: read de/d16/d23/d36/f21 [2725802,5209] 0 2023-12-05T09:57:30.517 INFO:tasks.workunit.client.1.smithi150.stdout:7/438: rename d2/d1b/d31/f69 to d2/d1b/d31/f8d 0 2023-12-05T09:57:30.517 INFO:tasks.workunit.client.1.smithi150.stdout:7/439: stat d2/d72/d82 0 2023-12-05T09:57:30.517 INFO:tasks.workunit.client.1.smithi150.stdout:1/423: symlink d6/d47/l98 0 2023-12-05T09:57:30.523 INFO:tasks.workunit.client.0.smithi100.stdout:6/805: write d7/d11/f6e [2195864,128624] 0 2023-12-05T09:57:30.523 INFO:tasks.workunit.client.0.smithi100.stdout:6/806: fsync d7/d2d/d6a/fad 0 2023-12-05T09:57:30.525 INFO:tasks.workunit.client.0.smithi100.stdout:5/472: dread d0/d27/f29 [0,4194304] 0 2023-12-05T09:57:30.526 INFO:tasks.workunit.client.0.smithi100.stdout:8/369: dwrite d0/d35/f39 [0,4194304] 0 2023-12-05T09:57:30.532 INFO:tasks.workunit.client.0.smithi100.stdout:1/398: dwrite db/d31/f46 [4194304,4194304] 0 2023-12-05T09:57:30.532 INFO:tasks.workunit.client.1.smithi150.stdout:3/426: dwrite d6/d9/d3d/d56/d30/f5e [0,4194304] 0 2023-12-05T09:57:30.532 INFO:tasks.workunit.client.1.smithi150.stdout:3/427: chown d6/d22/d37 28618774 1 2023-12-05T09:57:30.532 INFO:tasks.workunit.client.1.smithi150.stdout:3/428: chown d6/d25/d28 55828728 1 2023-12-05T09:57:30.532 INFO:tasks.workunit.client.1.smithi150.stdout:3/429: stat d6/d25/d28/d67 0 2023-12-05T09:57:30.537 INFO:tasks.workunit.client.0.smithi100.stdout:6/807: dread d7/f17 [0,4194304] 0 2023-12-05T09:57:30.537 INFO:tasks.workunit.client.0.smithi100.stdout:6/808: chown d7/d2d/d6a/fad 33223076 1 2023-12-05T09:57:30.544 INFO:tasks.workunit.client.0.smithi100.stdout:8/370: dread d0/d12/f36 [0,4194304] 0 2023-12-05T09:57:30.545 INFO:tasks.workunit.client.0.smithi100.stdout:8/371: creat d0/f5b x:0 0 0 2023-12-05T09:57:30.545 INFO:tasks.workunit.client.0.smithi100.stdout:8/372: fdatasync d0/d12/d13/f3e 0 2023-12-05T09:57:30.566 INFO:tasks.workunit.client.1.smithi150.stdout:0/468: dwrite d5/d11/d32/f50 [0,4194304] 0 2023-12-05T09:57:30.602 INFO:tasks.workunit.client.1.smithi150.stdout:2/419: link d0/d3/d5/d13/l92 d0/d3/d5/d3b/l94 0 2023-12-05T09:57:30.605 INFO:tasks.workunit.client.1.smithi150.stdout:6/362: rename d2/d23/d3b/d64/d7a/d69 to d2/d23/d2e/d44/d7d 0 2023-12-05T09:57:30.607 INFO:tasks.workunit.client.1.smithi150.stdout:4/372: mkdir d0/d3e/d5b/d6e 0 2023-12-05T09:57:30.610 INFO:tasks.workunit.client.1.smithi150.stdout:7/440: mkdir d2/d1b/d31/d8e 0 2023-12-05T09:57:30.610 INFO:tasks.workunit.client.1.smithi150.stdout:7/441: fdatasync d2/db/d17/d38/d85/f8b 0 2023-12-05T09:57:30.610 INFO:tasks.workunit.client.0.smithi100.stdout:6/809: write d7/d27/f38 [2697921,92046] 0 2023-12-05T09:57:30.610 INFO:tasks.workunit.client.0.smithi100.stdout:6/810: chown d7/d11/d82/l57 41158 1 2023-12-05T09:57:30.613 INFO:tasks.workunit.client.0.smithi100.stdout:4/377: dwrite f9 [0,4194304] 0 2023-12-05T09:57:30.613 INFO:tasks.workunit.client.0.smithi100.stdout:4/378: fsync de/d16/f2f 0 2023-12-05T09:57:30.613 INFO:tasks.workunit.client.0.smithi100.stdout:4/379: creat de/d66/f77 x:0 0 0 2023-12-05T09:57:30.613 INFO:tasks.workunit.client.0.smithi100.stdout:7/353: dwrite d3/dc/d11/d13/d1b/f45 [0,4194304] 0 2023-12-05T09:57:30.632 INFO:tasks.workunit.client.1.smithi150.stdout:1/424: unlink d6/d8/d54/f56 0 2023-12-05T09:57:30.636 INFO:tasks.workunit.client.0.smithi100.stdout:5/473: mknod d0/d16/d2b/d48/df/d51/d7b/da0/ca3 0 2023-12-05T09:57:30.639 INFO:tasks.workunit.client.0.smithi100.stdout:1/399: mkdir db/d12/d61/d82 0 2023-12-05T09:57:30.646 INFO:tasks.workunit.client.0.smithi100.stdout:6/811: symlink d7/d76/l10b 0 2023-12-05T09:57:30.647 INFO:tasks.workunit.client.1.smithi150.stdout:0/469: link d5/d11/d71/l29 d5/d11/d16/d1f/la6 0 2023-12-05T09:57:30.651 INFO:tasks.workunit.client.1.smithi150.stdout:2/420: mkdir d0/d3/d27/d95 0 2023-12-05T09:57:30.654 INFO:tasks.workunit.client.1.smithi150.stdout:5/416: rename d1/d3/d6/d11/l7c to d1/d3/d6/d72/l97 0 2023-12-05T09:57:30.654 INFO:tasks.workunit.client.1.smithi150.stdout:5/417: chown d1/d3/d6/d1b/d22/d24/f41 10551397 1 2023-12-05T09:57:30.656 INFO:tasks.workunit.client.0.smithi100.stdout:4/380: rename de/d16/d1e/c2a to de/d16/d1e/c78 0 2023-12-05T09:57:30.658 INFO:tasks.workunit.client.1.smithi150.stdout:6/363: creat d2/d23/f7e x:0 0 0 2023-12-05T09:57:30.661 INFO:tasks.workunit.client.1.smithi150.stdout:4/373: creat d0/d42/d44/f6f x:0 0 0 2023-12-05T09:57:30.661 INFO:tasks.workunit.client.1.smithi150.stdout:4/374: readlink d0/d3e/d6d/l3d 0 2023-12-05T09:57:30.661 INFO:tasks.workunit.client.1.smithi150.stdout:4/375: chown d0/d3e/d5b 11548 1 2023-12-05T09:57:30.661 INFO:tasks.workunit.client.1.smithi150.stdout:4/376: write d0/fc [1844215,52273] 0 2023-12-05T09:57:30.661 INFO:tasks.workunit.client.1.smithi150.stdout:4/377: stat d0/d3e/d6d/l1d 0 2023-12-05T09:57:30.661 INFO:tasks.workunit.client.1.smithi150.stdout:0/470: dread d5/f31 [4194304,4194304] 0 2023-12-05T09:57:30.667 INFO:tasks.workunit.client.0.smithi100.stdout:7/354: dwrite d3/dc/d11/f32 [0,4194304] 0 2023-12-05T09:57:30.667 INFO:tasks.workunit.client.0.smithi100.stdout:7/355: chown d3/dc/d11/d13/de/d18/c2f 51 1 2023-12-05T09:57:30.669 INFO:tasks.workunit.client.1.smithi150.stdout:7/442: creat d2/db/d2e/d71/f8f x:0 0 0 2023-12-05T09:57:30.669 INFO:tasks.workunit.client.1.smithi150.stdout:1/425: mknod d6/d8/d59/c99 0 2023-12-05T09:57:30.669 INFO:tasks.workunit.client.1.smithi150.stdout:3/430: rename d6/d9/d3d/c77 to d6/d25/d28/c85 0 2023-12-05T09:57:30.669 INFO:tasks.workunit.client.1.smithi150.stdout:7/443: read - d2/db/d2e/d71/f8f zero size 2023-12-05T09:57:30.670 INFO:tasks.workunit.client.1.smithi150.stdout:7/444: dread - d2/db/d30/d53/f80 zero size 2023-12-05T09:57:30.670 INFO:tasks.workunit.client.1.smithi150.stdout:7/445: stat d2/db/d30/d18/d1a/d1e/f21 0 2023-12-05T09:57:30.670 INFO:tasks.workunit.client.1.smithi150.stdout:3/431: creat d6/d25/d28/d67/f86 x:0 0 0 2023-12-05T09:57:30.671 INFO:tasks.workunit.client.0.smithi100.stdout:1/400: creat db/d12/d1e/d26/d30/f83 x:0 0 0 2023-12-05T09:57:30.671 INFO:tasks.workunit.client.0.smithi100.stdout:1/401: chown db/d12/l2d 413287 1 2023-12-05T09:57:30.671 INFO:tasks.workunit.client.0.smithi100.stdout:1/402: fsync f9 0 2023-12-05T09:57:30.671 INFO:tasks.workunit.client.0.smithi100.stdout:1/403: fdatasync db/d12/f16 0 2023-12-05T09:57:30.671 INFO:tasks.workunit.client.0.smithi100.stdout:6/812: mknod d7/d11/d1a/c10c 0 2023-12-05T09:57:30.671 INFO:tasks.workunit.client.0.smithi100.stdout:6/813: chown d7/d27/d35/d5a/db0 6 1 2023-12-05T09:57:30.671 INFO:tasks.workunit.client.0.smithi100.stdout:6/814: fsync d7/d27/d97/fc2 0 2023-12-05T09:57:30.673 INFO:tasks.workunit.client.0.smithi100.stdout:4/381: creat de/d16/d23/d33/d51/f79 x:0 0 0 2023-12-05T09:57:30.673 INFO:tasks.workunit.client.0.smithi100.stdout:4/382: creat de/d16/d23/d36/f7a x:0 0 0 2023-12-05T09:57:30.676 INFO:tasks.workunit.client.1.smithi150.stdout:2/421: rename d0/d3/d5/d13/d15/d30/d54/d57/l76 to d0/d3/d5/d10/d3d/d41/l96 0 2023-12-05T09:57:30.676 INFO:tasks.workunit.client.1.smithi150.stdout:1/426: mknod d6/d8/db/d1b/d79/c9a 0 2023-12-05T09:57:30.676 INFO:tasks.workunit.client.1.smithi150.stdout:4/378: write d0/d42/f4c [1545801,129894] 0 2023-12-05T09:57:30.678 INFO:tasks.workunit.client.1.smithi150.stdout:7/446: mkdir d2/db/d30/d53/d90 0 2023-12-05T09:57:30.678 INFO:tasks.workunit.client.1.smithi150.stdout:8/427: sync 2023-12-05T09:57:30.680 INFO:tasks.workunit.client.1.smithi150.stdout:6/364: dread d2/d23/d3b/d64/d7a/d5d/d6b/f22 [0,4194304] 0 2023-12-05T09:57:30.680 INFO:tasks.workunit.client.1.smithi150.stdout:6/365: write d2/d23/d2e/d44/f54 [603211,98499] 0 2023-12-05T09:57:30.685 INFO:tasks.workunit.client.1.smithi150.stdout:0/471: rename d5/fc to d5/d11/d32/d57/fa7 0 2023-12-05T09:57:30.686 INFO:tasks.workunit.client.0.smithi100.stdout:7/356: creat d3/dc/d11/d33/f79 x:0 0 0 2023-12-05T09:57:30.687 INFO:tasks.workunit.client.1.smithi150.stdout:2/422: getdents d0/d42 0 2023-12-05T09:57:30.688 INFO:tasks.workunit.client.0.smithi100.stdout:1/404: mkdir db/d12/d1e/d26/d30/d52/d84 0 2023-12-05T09:57:30.688 INFO:tasks.workunit.client.0.smithi100.stdout:1/405: creat db/d12/d61/f85 x:0 0 0 2023-12-05T09:57:30.689 INFO:tasks.workunit.client.0.smithi100.stdout:1/406: readlink db/d12/d1e/l2f 0 2023-12-05T09:57:30.690 INFO:tasks.workunit.client.1.smithi150.stdout:3/432: dread d6/d9/f32 [0,4194304] 0 2023-12-05T09:57:30.691 INFO:tasks.workunit.client.0.smithi100.stdout:6/815: creat d7/dcc/df0/f10d x:0 0 0 2023-12-05T09:57:30.694 INFO:tasks.workunit.client.1.smithi150.stdout:6/366: rename d2/d23/d3b/l51 to d2/d23/d3b/d64/l7f 0 2023-12-05T09:57:30.695 INFO:tasks.workunit.client.1.smithi150.stdout:6/367: readlink d2/d23/d3b/d64/d7a/d5d/d6b/d63/l79 0 2023-12-05T09:57:30.695 INFO:tasks.workunit.client.1.smithi150.stdout:6/368: chown d2/d23/c57 180 1 2023-12-05T09:57:30.695 INFO:tasks.workunit.client.0.smithi100.stdout:4/383: truncate de/d16/d1e/f2e 3879103 0 2023-12-05T09:57:30.698 INFO:tasks.workunit.client.1.smithi150.stdout:3/433: mkdir d6/d9/d3d/d87 0 2023-12-05T09:57:30.698 INFO:tasks.workunit.client.1.smithi150.stdout:3/434: stat d6/d9/d3d/d52/d5b/f44 0 2023-12-05T09:57:30.699 INFO:tasks.workunit.client.1.smithi150.stdout:5/418: dwrite d1/d7f/d65/d3b/d6b/f91 [0,4194304] 0 2023-12-05T09:57:30.700 INFO:tasks.workunit.client.1.smithi150.stdout:5/419: fsync d1/d3/f1d 0 2023-12-05T09:57:30.700 INFO:tasks.workunit.client.1.smithi150.stdout:5/420: creat d1/d7f/d65/d3b/d6b/f98 x:0 0 0 2023-12-05T09:57:30.701 INFO:tasks.workunit.client.0.smithi100.stdout:7/357: mknod d3/dc/d11/d33/c7a 0 2023-12-05T09:57:30.703 INFO:tasks.workunit.client.1.smithi150.stdout:7/447: write d2/db/d30/d18/d1a/f68 [3208839,186] 0 2023-12-05T09:57:30.704 INFO:tasks.workunit.client.0.smithi100.stdout:5/474: rmdir d0/d16/d2b/d48 39 2023-12-05T09:57:30.705 INFO:tasks.workunit.client.1.smithi150.stdout:2/423: dread d0/f49 [0,4194304] 0 2023-12-05T09:57:30.707 INFO:tasks.workunit.client.0.smithi100.stdout:1/407: getdents db/d31 0 2023-12-05T09:57:30.708 INFO:tasks.workunit.client.0.smithi100.stdout:1/408: fdatasync db/d12/f75 0 2023-12-05T09:57:30.711 INFO:tasks.workunit.client.1.smithi150.stdout:9/363: sync 2023-12-05T09:57:30.712 INFO:tasks.workunit.client.0.smithi100.stdout:6/816: creat d7/d11/d82/db9/f10e x:0 0 0 2023-12-05T09:57:30.719 INFO:tasks.workunit.client.0.smithi100.stdout:4/384: dread f9 [0,4194304] 0 2023-12-05T09:57:30.726 INFO:tasks.workunit.client.1.smithi150.stdout:5/421: unlink d1/d7f/d65/l60 0 2023-12-05T09:57:30.727 INFO:tasks.workunit.client.1.smithi150.stdout:7/448: mkdir d2/d1b/d91 0 2023-12-05T09:57:30.729 INFO:tasks.workunit.client.1.smithi150.stdout:9/364: dread d3/d9/f14 [0,4194304] 0 2023-12-05T09:57:30.729 INFO:tasks.workunit.client.1.smithi150.stdout:9/365: fsync d3/d9/dc/d1f/f2b 0 2023-12-05T09:57:30.729 INFO:tasks.workunit.client.1.smithi150.stdout:2/424: mknod d0/d3/d5/d13/d15/d30/c97 0 2023-12-05T09:57:30.730 INFO:tasks.workunit.client.0.smithi100.stdout:1/409: mknod db/d31/d3a/c86 0 2023-12-05T09:57:30.730 INFO:tasks.workunit.client.0.smithi100.stdout:1/410: truncate db/d12/d61/d66/d67/f6d 12148 0 2023-12-05T09:57:30.731 INFO:tasks.workunit.client.1.smithi150.stdout:5/422: symlink d1/d3/d6/d1b/d22/d24/d59/l99 0 2023-12-05T09:57:30.732 INFO:tasks.workunit.client.1.smithi150.stdout:6/369: dread d2/d23/d3b/d64/d7a/f40 [0,4194304] 0 2023-12-05T09:57:30.735 INFO:tasks.workunit.client.0.smithi100.stdout:6/817: unlink d7/dcc/ldc 0 2023-12-05T09:57:30.735 INFO:tasks.workunit.client.0.smithi100.stdout:6/818: chown d7/d2d/f43 0 1 2023-12-05T09:57:30.737 INFO:tasks.workunit.client.1.smithi150.stdout:9/366: mkdir d3/d9/d6e 0 2023-12-05T09:57:30.740 INFO:tasks.workunit.client.0.smithi100.stdout:4/385: unlink de/d16/l5c 0 2023-12-05T09:57:30.740 INFO:tasks.workunit.client.0.smithi100.stdout:4/386: fsync de/d16/d1e/f62 0 2023-12-05T09:57:30.740 INFO:tasks.workunit.client.0.smithi100.stdout:4/387: dread - de/d16/d1e/f30 zero size 2023-12-05T09:57:30.740 INFO:tasks.workunit.client.0.smithi100.stdout:4/388: write de/d38/f42 [4934081,39676] 0 2023-12-05T09:57:30.741 INFO:tasks.workunit.client.1.smithi150.stdout:2/425: symlink d0/d3/d5/d10/d3d/l98 0 2023-12-05T09:57:30.741 INFO:tasks.workunit.client.1.smithi150.stdout:2/426: write d0/d3/d5/d22/f82 [644423,61535] 0 2023-12-05T09:57:30.741 INFO:tasks.workunit.client.1.smithi150.stdout:2/427: truncate d0/d3/d5/d22/d52/d5a/f5d 560842 0 2023-12-05T09:57:30.743 INFO:tasks.workunit.client.0.smithi100.stdout:1/411: unlink db/d12/d1e/d26/f43 0 2023-12-05T09:57:30.743 INFO:tasks.workunit.client.0.smithi100.stdout:1/412: write db/d31/f36 [1272794,10874] 0 2023-12-05T09:57:30.743 INFO:tasks.workunit.client.0.smithi100.stdout:1/413: dread - db/d31/d3a/d3b/f70 zero size 2023-12-05T09:57:30.744 INFO:tasks.workunit.client.0.smithi100.stdout:1/414: chown db/d12/d61 30264833 1 2023-12-05T09:57:30.745 INFO:tasks.workunit.client.1.smithi150.stdout:6/370: mknod d2/d23/d3b/d64/d7a/c80 0 2023-12-05T09:57:30.745 INFO:tasks.workunit.client.1.smithi150.stdout:6/371: read d2/f1c [251903,93217] 0 2023-12-05T09:57:30.745 INFO:tasks.workunit.client.1.smithi150.stdout:6/372: truncate d2/d23/d2e/d44/f54 837684 0 2023-12-05T09:57:30.746 INFO:tasks.workunit.client.1.smithi150.stdout:6/373: write d2/d23/d3b/d64/d7a/d5d/d6b/f10 [1786866,90931] 0 2023-12-05T09:57:30.746 INFO:tasks.workunit.client.1.smithi150.stdout:8/428: dwrite d0/ff [0,4194304] 0 2023-12-05T09:57:30.749 INFO:tasks.workunit.client.0.smithi100.stdout:6/819: truncate d7/d27/d97/fb2 3010374 0 2023-12-05T09:57:30.749 INFO:tasks.workunit.client.1.smithi150.stdout:3/435: dwrite d6/f6c [0,4194304] 0 2023-12-05T09:57:30.752 INFO:tasks.workunit.client.0.smithi100.stdout:6/820: mknod d7/d27/d97/d102/c10f 0 2023-12-05T09:57:30.752 INFO:tasks.workunit.client.1.smithi150.stdout:9/367: creat d3/d9/f6f x:0 0 0 2023-12-05T09:57:30.754 INFO:tasks.workunit.client.1.smithi150.stdout:2/428: creat d0/d3/f99 x:0 0 0 2023-12-05T09:57:30.754 INFO:tasks.workunit.client.1.smithi150.stdout:2/429: readlink d0/d3/d5/d13/d15/l17 0 2023-12-05T09:57:30.755 INFO:tasks.workunit.client.1.smithi150.stdout:3/436: dread d6/d9/f32 [0,4194304] 0 2023-12-05T09:57:30.756 INFO:tasks.workunit.client.1.smithi150.stdout:3/437: write d6/d9/d3d/d52/f65 [165716,57989] 0 2023-12-05T09:57:30.756 INFO:tasks.workunit.client.1.smithi150.stdout:3/438: write d6/d25/d28/f2d [2368010,68927] 0 2023-12-05T09:57:30.757 INFO:tasks.workunit.client.0.smithi100.stdout:1/415: rmdir db/d31/d3a/d3b 39 2023-12-05T09:57:30.757 INFO:tasks.workunit.client.0.smithi100.stdout:1/416: chown db/d31/d3a/l7e 112899800 1 2023-12-05T09:57:30.762 INFO:tasks.workunit.client.0.smithi100.stdout:5/475: write d0/d1f/f2e [2141983,120057] 0 2023-12-05T09:57:30.762 INFO:tasks.workunit.client.0.smithi100.stdout:7/358: dwrite d3/dc/d11/d13/de/d18/d3b/f5d [0,4194304] 0 2023-12-05T09:57:30.766 INFO:tasks.workunit.client.0.smithi100.stdout:6/821: getdents d7/d11/d1a/d78/d80 0 2023-12-05T09:57:30.775 INFO:tasks.workunit.client.1.smithi150.stdout:9/368: symlink d3/d9/d58/l70 0 2023-12-05T09:57:30.776 INFO:tasks.workunit.client.0.smithi100.stdout:5/476: creat d0/d16/d2b/fa4 x:0 0 0 2023-12-05T09:57:30.778 INFO:tasks.workunit.client.0.smithi100.stdout:7/359: rename d3/dc/f4a to d3/dc/d11/d33/f7b 0 2023-12-05T09:57:30.782 INFO:tasks.workunit.client.0.smithi100.stdout:5/477: unlink d0/d1f/l6f 0 2023-12-05T09:57:30.782 INFO:tasks.workunit.client.0.smithi100.stdout:5/478: truncate d0/d16/d2b/f91 4288381 0 2023-12-05T09:57:30.784 INFO:tasks.workunit.client.0.smithi100.stdout:5/479: creat d0/d1b/fa5 x:0 0 0 2023-12-05T09:57:30.787 INFO:tasks.workunit.client.0.smithi100.stdout:5/480: creat d0/d16/d2b/d48/df/d51/d7b/da0/fa6 x:0 0 0 2023-12-05T09:57:30.788 INFO:tasks.workunit.client.1.smithi150.stdout:2/430: creat d0/d3/d5/d36/f9a x:0 0 0 2023-12-05T09:57:30.788 INFO:tasks.workunit.client.1.smithi150.stdout:3/439: symlink d6/d9/d3d/d56/l88 0 2023-12-05T09:57:30.789 INFO:tasks.workunit.client.1.smithi150.stdout:2/431: symlink d0/d3/d5/d13/l9b 0 2023-12-05T09:57:30.790 INFO:tasks.workunit.client.1.smithi150.stdout:3/440: creat d6/d9/d3d/d87/f89 x:0 0 0 2023-12-05T09:57:30.791 INFO:tasks.workunit.client.0.smithi100.stdout:5/481: link d0/d16/d2b/d48/df/c6e d0/d4/ca7 0 2023-12-05T09:57:30.792 INFO:tasks.workunit.client.1.smithi150.stdout:3/441: rmdir d6/d25 39 2023-12-05T09:57:30.796 INFO:tasks.workunit.client.1.smithi150.stdout:3/442: mkdir d6/d9/d3d/d8a 0 2023-12-05T09:57:30.797 INFO:tasks.workunit.client.1.smithi150.stdout:3/443: rmdir d6/d22/d37 39 2023-12-05T09:57:30.803 INFO:tasks.workunit.client.1.smithi150.stdout:6/374: dwrite d2/d23/f67 [0,4194304] 0 2023-12-05T09:57:30.804 INFO:tasks.workunit.client.1.smithi150.stdout:3/444: rename d6/d9/d3d/d56/d30/f5f to d6/d9/d3d/d56/d53/d51/f8b 0 2023-12-05T09:57:30.804 INFO:tasks.workunit.client.0.smithi100.stdout:7/360: write d3/dc/d11/d13/f43 [990283,103133] 0 2023-12-05T09:57:30.804 INFO:tasks.workunit.client.0.smithi100.stdout:7/361: truncate d3/dc/d11/d33/f53 579414 0 2023-12-05T09:57:30.805 INFO:tasks.workunit.client.0.smithi100.stdout:5/482: write d0/d1b/f32 [615597,29451] 0 2023-12-05T09:57:30.805 INFO:tasks.workunit.client.0.smithi100.stdout:5/483: fsync d0/d16/d2b/f91 0 2023-12-05T09:57:30.807 INFO:tasks.workunit.client.0.smithi100.stdout:7/362: symlink d3/dc/d11/d13/de/d2d/l7c 0 2023-12-05T09:57:30.807 INFO:tasks.workunit.client.0.smithi100.stdout:7/363: stat d3/dc/d11/d13/de/d18/d3b/d40/f41 0 2023-12-05T09:57:30.810 INFO:tasks.workunit.client.0.smithi100.stdout:5/484: mkdir d0/d16/d2b/d48/df/d51/da8 0 2023-12-05T09:57:30.811 INFO:tasks.workunit.client.0.smithi100.stdout:7/364: unlink d3/f2e 0 2023-12-05T09:57:30.812 INFO:tasks.workunit.client.0.smithi100.stdout:5/485: rmdir d0/d16/d37 39 2023-12-05T09:57:30.815 INFO:tasks.workunit.client.1.smithi150.stdout:2/432: write d0/d3/d5/d10/f19 [5807492,28679] 0 2023-12-05T09:57:30.816 INFO:tasks.workunit.client.0.smithi100.stdout:1/417: dwrite db/d31/d3a/f3e [0,4194304] 0 2023-12-05T09:57:30.819 INFO:tasks.workunit.client.0.smithi100.stdout:1/418: unlink db/d31/f46 0 2023-12-05T09:57:30.825 INFO:tasks.workunit.client.0.smithi100.stdout:7/365: getdents d3/dc 0 2023-12-05T09:57:30.828 INFO:tasks.workunit.client.0.smithi100.stdout:6/822: dwrite d7/d11/d82/f74 [0,4194304] 0 2023-12-05T09:57:30.832 INFO:tasks.workunit.client.0.smithi100.stdout:7/366: link d3/c34 d3/dc/d11/d13/de/d18/d3b/c7d 0 2023-12-05T09:57:30.832 INFO:tasks.workunit.client.0.smithi100.stdout:7/367: chown d3/dc/d11/d13/d1b/d60/f75 27617 1 2023-12-05T09:57:30.832 INFO:tasks.workunit.client.0.smithi100.stdout:7/368: getdents d3/dc/d11 0 2023-12-05T09:57:30.834 INFO:tasks.workunit.client.1.smithi150.stdout:8/429: dwrite d0/d41/d49/d1b/d24/f63 [0,4194304] 0 2023-12-05T09:57:30.834 INFO:tasks.workunit.client.1.smithi150.stdout:8/430: getdents d0/d41/d49/d1b/d24/d34 0 2023-12-05T09:57:30.835 INFO:tasks.workunit.client.1.smithi150.stdout:8/431: fdatasync d0/d41/d49/d1b/d24/d34/d56/d67/f6c 0 2023-12-05T09:57:30.839 INFO:tasks.workunit.client.0.smithi100.stdout:1/419: dread db/d12/f18 [0,4194304] 0 2023-12-05T09:57:30.840 INFO:tasks.workunit.client.0.smithi100.stdout:6/823: mknod d7/dcc/c110 0 2023-12-05T09:57:30.845 INFO:tasks.workunit.client.0.smithi100.stdout:7/369: rename d3/dc/d11/d13/de/d18/d3b/d40/d46/f71 to d3/dc/d11/d13/d1b/f7e 0 2023-12-05T09:57:30.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:30 smithi150 ceph-mon[116142]: pgmap v31: 65 pgs: 65 active+clean; 1.2 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 106 MiB/s rd, 128 MiB/s wr, 202 op/s 2023-12-05T09:57:30.847 INFO:tasks.workunit.client.0.smithi100.stdout:1/420: creat db/d12/d1e/d26/d30/d52/d84/f87 x:0 0 0 2023-12-05T09:57:30.848 INFO:tasks.workunit.client.0.smithi100.stdout:6/824: creat d7/d2d/f111 x:0 0 0 2023-12-05T09:57:30.849 INFO:tasks.workunit.client.0.smithi100.stdout:7/370: rmdir d3/dc/d11/d13/de 39 2023-12-05T09:57:30.851 INFO:tasks.workunit.client.1.smithi150.stdout:8/432: write d0/d41/d49/d1b/d24/f63 [197143,50534] 0 2023-12-05T09:57:30.851 INFO:tasks.workunit.client.0.smithi100.stdout:6/825: getdents d7/d27 0 2023-12-05T09:57:30.852 INFO:tasks.workunit.client.1.smithi150.stdout:9/369: dwrite d3/d9/dc/d1f/d24/f6b [0,4194304] 0 2023-12-05T09:57:30.853 INFO:tasks.workunit.client.1.smithi150.stdout:9/370: chown d3/d9/dc/f1d 2376 1 2023-12-05T09:57:30.853 INFO:tasks.workunit.client.1.smithi150.stdout:9/371: truncate d3/d9/d26/f3f 986766 0 2023-12-05T09:57:30.853 INFO:tasks.workunit.client.0.smithi100.stdout:7/371: mkdir d3/dc/d11/d13/de/d18/d3b/d40/d4c/d7f 0 2023-12-05T09:57:30.854 INFO:tasks.workunit.client.0.smithi100.stdout:6/826: creat d7/d27/da0/f112 x:0 0 0 2023-12-05T09:57:30.859 INFO:tasks.workunit.client.0.smithi100.stdout:6/827: unlink d7/d27/d35/d5a/db0/ld7 0 2023-12-05T09:57:30.860 INFO:tasks.workunit.client.0.smithi100.stdout:5/486: dwrite d0/d16/d2b/d75/f78 [0,4194304] 0 2023-12-05T09:57:30.860 INFO:tasks.workunit.client.0.smithi100.stdout:5/487: getdents d0/d1f/da1 0 2023-12-05T09:57:30.869 INFO:tasks.workunit.client.1.smithi150.stdout:9/372: rmdir d3/d9/dc/d1f/d24 39 2023-12-05T09:57:30.870 INFO:tasks.workunit.client.1.smithi150.stdout:9/373: rmdir d3/d42 39 2023-12-05T09:57:30.872 INFO:tasks.workunit.client.0.smithi100.stdout:5/488: rmdir d0/d1f 39 2023-12-05T09:57:30.872 INFO:tasks.workunit.client.0.smithi100.stdout:5/489: write d0/d16/d2b/d48/df/d51/f94 [847742,119116] 0 2023-12-05T09:57:30.875 INFO:tasks.workunit.client.1.smithi150.stdout:9/374: rename d3/d9/d26/f21 to d3/f71 0 2023-12-05T09:57:30.875 INFO:tasks.workunit.client.1.smithi150.stdout:9/375: readlink d3/d9/dc/d1f/d24/l4f 0 2023-12-05T09:57:30.875 INFO:tasks.workunit.client.1.smithi150.stdout:9/376: creat d3/d9/d26/d34/f72 x:0 0 0 2023-12-05T09:57:30.876 INFO:tasks.workunit.client.0.smithi100.stdout:7/372: write d3/dc/d11/d13/d1b/f45 [3761988,58885] 0 2023-12-05T09:57:30.876 INFO:tasks.workunit.client.0.smithi100.stdout:5/490: creat d0/d1f/d25/fa9 x:0 0 0 2023-12-05T09:57:30.883 INFO:tasks.workunit.client.1.smithi150.stdout:2/433: read d0/d3/d5/d13/f69 [19104,39374] 0 2023-12-05T09:57:30.883 INFO:tasks.workunit.client.1.smithi150.stdout:2/434: write d0/d3/d5/d3b/d4c/f64 [531544,30010] 0 2023-12-05T09:57:30.883 INFO:tasks.workunit.client.1.smithi150.stdout:6/375: dwrite d2/d23/d2e/d44/f54 [0,4194304] 0 2023-12-05T09:57:30.883 INFO:tasks.workunit.client.1.smithi150.stdout:6/376: fdatasync d2/d23/f3f 0 2023-12-05T09:57:30.884 INFO:tasks.workunit.client.1.smithi150.stdout:6/377: write d2/f26 [4513248,127584] 0 2023-12-05T09:57:30.885 INFO:tasks.workunit.client.1.smithi150.stdout:9/377: mkdir d3/d9/d58/d73 0 2023-12-05T09:57:30.885 INFO:tasks.workunit.client.1.smithi150.stdout:9/378: readlink d3/d1b/l2d 0 2023-12-05T09:57:30.886 INFO:tasks.workunit.client.0.smithi100.stdout:7/373: mknod d3/dc/d11/d13/de/d18/d3b/d40/d4c/c80 0 2023-12-05T09:57:30.887 INFO:tasks.workunit.client.0.smithi100.stdout:7/374: mknod d3/dc/d11/d13/d1b/d60/c81 0 2023-12-05T09:57:30.891 INFO:tasks.workunit.client.1.smithi150.stdout:7/449: sync 2023-12-05T09:57:30.891 INFO:tasks.workunit.client.1.smithi150.stdout:0/472: sync 2023-12-05T09:57:30.891 INFO:tasks.workunit.client.1.smithi150.stdout:4/379: sync 2023-12-05T09:57:30.891 INFO:tasks.workunit.client.1.smithi150.stdout:1/427: sync 2023-12-05T09:57:30.892 INFO:tasks.workunit.client.1.smithi150.stdout:2/435: symlink d0/d3/d5/d13/l9c 0 2023-12-05T09:57:30.892 INFO:tasks.workunit.client.1.smithi150.stdout:1/428: creat d6/d8/d85/f9b x:0 0 0 2023-12-05T09:57:30.899 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:30 smithi100 ceph-mon[107145]: pgmap v31: 65 pgs: 65 active+clean; 1.2 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 106 MiB/s rd, 128 MiB/s wr, 202 op/s 2023-12-05T09:57:30.899 INFO:tasks.workunit.client.0.smithi100.stdout:6/828: dread d7/f89 [0,4194304] 0 2023-12-05T09:57:30.900 INFO:tasks.workunit.client.1.smithi150.stdout:4/380: truncate d0/f3a 117736 0 2023-12-05T09:57:30.900 INFO:tasks.workunit.client.1.smithi150.stdout:7/450: creat d2/db/d62/f92 x:0 0 0 2023-12-05T09:57:30.900 INFO:tasks.workunit.client.1.smithi150.stdout:9/379: link l1 d3/d9/d26/l74 0 2023-12-05T09:57:30.900 INFO:tasks.workunit.client.1.smithi150.stdout:4/381: readlink d0/d3e/d6d/l1d 0 2023-12-05T09:57:30.900 INFO:tasks.workunit.client.1.smithi150.stdout:7/451: read d2/db/f45 [684422,97601] 0 2023-12-05T09:57:30.900 INFO:tasks.workunit.client.1.smithi150.stdout:9/380: truncate d3/d9/dc/d1f/f5f 948221 0 2023-12-05T09:57:30.900 INFO:tasks.workunit.client.1.smithi150.stdout:9/381: truncate d3/d9/f54 677121 0 2023-12-05T09:57:30.901 INFO:tasks.workunit.client.1.smithi150.stdout:1/429: mknod d6/d8/db/de/c9c 0 2023-12-05T09:57:30.901 INFO:tasks.workunit.client.1.smithi150.stdout:2/436: mknod d0/d3/d27/d95/c9d 0 2023-12-05T09:57:30.908 INFO:tasks.workunit.client.1.smithi150.stdout:7/452: mknod d2/d1b/d5b/c93 0 2023-12-05T09:57:30.908 INFO:tasks.workunit.client.1.smithi150.stdout:8/433: dwrite d0/d41/d49/d1b/d24/d38/f6a [0,4194304] 0 2023-12-05T09:57:30.908 INFO:tasks.workunit.client.0.smithi100.stdout:1/421: dwrite db/d12/d1e/f34 [4194304,4194304] 0 2023-12-05T09:57:30.911 INFO:tasks.workunit.client.1.smithi150.stdout:9/382: mkdir d3/d9/dc/d1f/d24/d75 0 2023-12-05T09:57:30.913 INFO:tasks.workunit.client.1.smithi150.stdout:2/437: symlink d0/d3/d21/l9e 0 2023-12-05T09:57:30.916 INFO:tasks.workunit.client.1.smithi150.stdout:0/473: dread d5/d11/d65/d82/f88 [0,4194304] 0 2023-12-05T09:57:30.916 INFO:tasks.workunit.client.1.smithi150.stdout:8/434: rename d0/d41/d49/f79 to d0/d41/d49/d1b/d24/d2e/f8b 0 2023-12-05T09:57:30.916 INFO:tasks.workunit.client.1.smithi150.stdout:8/435: chown d0/d41/d49/d1b/d24/f3b 47 1 2023-12-05T09:57:30.916 INFO:tasks.workunit.client.1.smithi150.stdout:8/436: write d0/d41/d49/f86 [4180243,23789] 0 2023-12-05T09:57:30.919 INFO:tasks.workunit.client.0.smithi100.stdout:7/375: dread d3/dc/d11/d13/d1b/f26 [0,4194304] 0 2023-12-05T09:57:30.919 INFO:tasks.workunit.client.0.smithi100.stdout:7/376: stat d3/dc/d11/d13/l51 0 2023-12-05T09:57:30.920 INFO:tasks.workunit.client.1.smithi150.stdout:3/445: dwrite d6/d9/d3d/d56/d30/f5e [0,4194304] 0 2023-12-05T09:57:30.920 INFO:tasks.workunit.client.1.smithi150.stdout:3/446: chown d6/d9/d3d/d56/d71 15705 1 2023-12-05T09:57:30.921 INFO:tasks.workunit.client.1.smithi150.stdout:2/438: mknod d0/d3/d5/d10/c9f 0 2023-12-05T09:57:30.922 INFO:tasks.workunit.client.1.smithi150.stdout:9/383: mkdir d3/d9/d6e/d76 0 2023-12-05T09:57:30.922 INFO:tasks.workunit.client.1.smithi150.stdout:0/474: mkdir d5/d11/d16/d1f/d67/da8 0 2023-12-05T09:57:30.922 INFO:tasks.workunit.client.1.smithi150.stdout:0/475: chown d5/d11/d16/d1f/l2a 377446 1 2023-12-05T09:57:30.922 INFO:tasks.workunit.client.1.smithi150.stdout:5/423: sync 2023-12-05T09:57:30.923 INFO:tasks.workunit.client.0.smithi100.stdout:7/377: rename d3/dc/d11/d13/de/d2d/d42/c6a to d3/dc/d11/c82 0 2023-12-05T09:57:30.927 INFO:tasks.workunit.client.1.smithi150.stdout:1/430: dread d6/d8/db/f35 [0,4194304] 0 2023-12-05T09:57:30.927 INFO:tasks.workunit.client.1.smithi150.stdout:8/437: creat d0/d41/d49/d1b/d24/d38/d62/f8c x:0 0 0 2023-12-05T09:57:30.927 INFO:tasks.workunit.client.1.smithi150.stdout:8/438: dread - d0/d41/d49/d1b/d24/d38/d62/f65 zero size 2023-12-05T09:57:30.929 INFO:tasks.workunit.client.1.smithi150.stdout:9/384: write d3/d9/dc/f4b [937108,61169] 0 2023-12-05T09:57:30.932 INFO:tasks.workunit.client.1.smithi150.stdout:3/447: getdents d6/d22 0 2023-12-05T09:57:30.932 INFO:tasks.workunit.client.1.smithi150.stdout:3/448: getdents d6/d9/d3d/d56/d79 0 2023-12-05T09:57:30.932 INFO:tasks.workunit.client.1.smithi150.stdout:3/449: write d6/f17 [4737161,50306] 0 2023-12-05T09:57:30.937 INFO:tasks.workunit.client.0.smithi100.stdout:7/378: stat d3/c34 0 2023-12-05T09:57:30.938 INFO:tasks.workunit.client.1.smithi150.stdout:2/439: creat d0/d3/d5/d36/d86/fa0 x:0 0 0 2023-12-05T09:57:30.938 INFO:tasks.workunit.client.1.smithi150.stdout:2/440: readlink d0/d3/d5/d13/l9c 0 2023-12-05T09:57:30.938 INFO:tasks.workunit.client.1.smithi150.stdout:2/441: write d0/d3/d5/d13/d15/d30/f89 [476975,43678] 0 2023-12-05T09:57:30.938 INFO:tasks.workunit.client.1.smithi150.stdout:4/382: dread d0/d42/f4c [0,4194304] 0 2023-12-05T09:57:30.938 INFO:tasks.workunit.client.1.smithi150.stdout:4/383: getdents d0/d3e/d6d 0 2023-12-05T09:57:30.938 INFO:tasks.workunit.client.1.smithi150.stdout:4/384: creat d0/d3e/d48/d4d/f70 x:0 0 0 2023-12-05T09:57:30.939 INFO:tasks.workunit.client.1.smithi150.stdout:6/378: dwrite d2/d23/d2e/d72/f75 [0,4194304] 0 2023-12-05T09:57:30.943 INFO:tasks.workunit.client.0.smithi100.stdout:7/379: rename d3/dc/d11/d13/d1b/f26 to d3/dc/d11/d13/de/d2d/d42/f83 0 2023-12-05T09:57:30.948 INFO:tasks.workunit.client.1.smithi150.stdout:5/424: mkdir d1/d3/d6/d26/d9a 0 2023-12-05T09:57:30.948 INFO:tasks.workunit.client.1.smithi150.stdout:0/476: creat d5/d11/d16/d1f/d67/da8/fa9 x:0 0 0 2023-12-05T09:57:30.948 INFO:tasks.workunit.client.1.smithi150.stdout:1/431: creat d6/d47/d4c/d60/f9d x:0 0 0 2023-12-05T09:57:30.948 INFO:tasks.workunit.client.1.smithi150.stdout:1/432: write d6/f95 [52043,119997] 0 2023-12-05T09:57:30.949 INFO:tasks.workunit.client.1.smithi150.stdout:9/385: link d3/l48 d3/d9/d58/d73/l77 0 2023-12-05T09:57:30.951 INFO:tasks.workunit.client.1.smithi150.stdout:3/450: mkdir d6/d9/d43/d47/d8c 0 2023-12-05T09:57:30.958 INFO:tasks.workunit.client.0.smithi100.stdout:1/422: dwrite db/d12/d1e/d26/d30/d6e/f57 [0,4194304] 0 2023-12-05T09:57:30.959 INFO:tasks.workunit.client.0.smithi100.stdout:6/829: dwrite d7/d27/d97/fbb [0,4194304] 0 2023-12-05T09:57:30.959 INFO:tasks.workunit.client.1.smithi150.stdout:4/385: write d0/d3e/d48/f52 [3898263,18175] 0 2023-12-05T09:57:30.959 INFO:tasks.workunit.client.1.smithi150.stdout:2/442: mkdir d0/d3/d5/d10/d3d/da1 0 2023-12-05T09:57:30.959 INFO:tasks.workunit.client.1.smithi150.stdout:2/443: write d0/d3/d21/d4d/f90 [641055,116158] 0 2023-12-05T09:57:30.959 INFO:tasks.workunit.client.1.smithi150.stdout:2/444: stat d0/d3/d5/d13/d15/d30/d54/l67 0 2023-12-05T09:57:30.964 INFO:tasks.workunit.client.1.smithi150.stdout:2/445: write d0/d3/d5/d13/d15/d30/d54/d57/f75 [1323542,55112] 0 2023-12-05T09:57:30.964 INFO:tasks.workunit.client.1.smithi150.stdout:0/477: mknod d5/d11/d16/d1f/d67/da8/caa 0 2023-12-05T09:57:30.965 INFO:tasks.workunit.client.1.smithi150.stdout:9/386: creat d3/d9/dc/d1f/d24/f78 x:0 0 0 2023-12-05T09:57:30.965 INFO:tasks.workunit.client.1.smithi150.stdout:0/478: chown d5/d11/l6e 19692 1 2023-12-05T09:57:30.965 INFO:tasks.workunit.client.1.smithi150.stdout:7/453: dwrite d2/db/d17/d20/f3f [0,4194304] 0 2023-12-05T09:57:30.965 INFO:tasks.workunit.client.1.smithi150.stdout:2/446: write d0/d3/d5/d13/d15/d30/d54/d57/f75 [775024,40928] 0 2023-12-05T09:57:30.965 INFO:tasks.workunit.client.1.smithi150.stdout:3/451: rename d6/d9/d3d/d52/d5b to d6/d9/d8d 0 2023-12-05T09:57:30.967 INFO:tasks.workunit.client.0.smithi100.stdout:1/423: unlink db/d31/c47 0 2023-12-05T09:57:30.967 INFO:tasks.workunit.client.0.smithi100.stdout:1/424: stat db/d31/d3a/f4c 0 2023-12-05T09:57:30.968 INFO:tasks.workunit.client.0.smithi100.stdout:1/425: symlink db/d12/l88 0 2023-12-05T09:57:30.969 INFO:tasks.workunit.client.0.smithi100.stdout:1/426: creat db/d12/d61/d66/f89 x:0 0 0 2023-12-05T09:57:30.970 INFO:tasks.workunit.client.0.smithi100.stdout:1/427: rmdir db 39 2023-12-05T09:57:30.972 INFO:tasks.workunit.client.1.smithi150.stdout:0/479: rmdir d5/d11/d71/d5f/d6a 39 2023-12-05T09:57:30.972 INFO:tasks.workunit.client.1.smithi150.stdout:0/480: fsync d5/f23 0 2023-12-05T09:57:30.972 INFO:tasks.workunit.client.1.smithi150.stdout:0/481: write d5/f72 [474897,110656] 0 2023-12-05T09:57:30.972 INFO:tasks.workunit.client.1.smithi150.stdout:0/482: creat d5/d11/d65/d82/fab x:0 0 0 2023-12-05T09:57:30.972 INFO:tasks.workunit.client.0.smithi100.stdout:1/428: rename db/d12/l28 to db/d31/d73/l8a 0 2023-12-05T09:57:30.972 INFO:tasks.workunit.client.0.smithi100.stdout:1/429: read - db/d12/d61/d66/f89 zero size 2023-12-05T09:57:30.974 INFO:tasks.workunit.client.1.smithi150.stdout:0/483: creat d5/d11/d16/d1f/d7f/fac x:0 0 0 2023-12-05T09:57:30.980 INFO:tasks.workunit.client.0.smithi100.stdout:0/398: sync 2023-12-05T09:57:30.980 INFO:tasks.workunit.client.0.smithi100.stdout:9/451: sync 2023-12-05T09:57:30.982 INFO:tasks.workunit.client.0.smithi100.stdout:6/830: dread d7/faa [0,4194304] 0 2023-12-05T09:57:30.983 INFO:tasks.workunit.client.0.smithi100.stdout:9/452: rename d7/d1b/d22/d51/c8d to d7/d35/c94 0 2023-12-05T09:57:30.986 INFO:tasks.workunit.client.0.smithi100.stdout:6/831: rename d7/d11/d1a/db1/f109 to d7/d27/d72/f113 0 2023-12-05T09:57:30.987 INFO:tasks.workunit.client.1.smithi150.stdout:5/425: write d1/d7f/d65/d3b/f84 [2347496,34171] 0 2023-12-05T09:57:30.987 INFO:tasks.workunit.client.0.smithi100.stdout:6/832: rename d7/d11/d82/db9/ld8 to d7/d11/d1a/l114 0 2023-12-05T09:57:30.990 INFO:tasks.workunit.client.0.smithi100.stdout:9/453: getdents d7/d20/d68 0 2023-12-05T09:57:30.990 INFO:tasks.workunit.client.0.smithi100.stdout:9/454: write d7/d20/d69/f72 [226134,119114] 0 2023-12-05T09:57:30.992 INFO:tasks.workunit.client.1.smithi150.stdout:5/426: symlink d1/d3/d6/l9b 0 2023-12-05T09:57:30.993 INFO:tasks.workunit.client.1.smithi150.stdout:5/427: fsync d1/d7f/f5c 0 2023-12-05T09:57:30.994 INFO:tasks.workunit.client.0.smithi100.stdout:9/455: symlink d7/d60/l95 0 2023-12-05T09:57:30.999 INFO:tasks.workunit.client.1.smithi150.stdout:5/428: symlink d1/d7f/d65/d3b/d37/l9c 0 2023-12-05T09:57:31.003 INFO:tasks.workunit.client.0.smithi100.stdout:7/380: dwrite d3/dc/d11/d13/de/d2d/f6d [0,4194304] 0 2023-12-05T09:57:31.003 INFO:tasks.workunit.client.0.smithi100.stdout:9/456: mkdir d7/d1b/d22/d51/d32/d96 0 2023-12-05T09:57:31.003 INFO:tasks.workunit.client.0.smithi100.stdout:9/457: fdatasync d7/d35/d71/f78 0 2023-12-05T09:57:31.006 INFO:tasks.workunit.client.0.smithi100.stdout:9/458: mkdir d7/d35/d97 0 2023-12-05T09:57:31.006 INFO:tasks.workunit.client.0.smithi100.stdout:9/459: chown d7/d1b/d22/d51/d32/c88 23 1 2023-12-05T09:57:31.008 INFO:tasks.workunit.client.1.smithi150.stdout:5/429: creat d1/d7f/d65/f9d x:0 0 0 2023-12-05T09:57:31.008 INFO:tasks.workunit.client.1.smithi150.stdout:8/439: dwrite d0/d41/d49/d1b/f1d [0,4194304] 0 2023-12-05T09:57:31.016 INFO:tasks.workunit.client.1.smithi150.stdout:0/484: dread d5/d11/f24 [0,4194304] 0 2023-12-05T09:57:31.016 INFO:tasks.workunit.client.1.smithi150.stdout:8/440: mknod d0/d41/d49/d1b/d24/d5b/d87/c8d 0 2023-12-05T09:57:31.018 INFO:tasks.workunit.client.0.smithi100.stdout:7/381: rmdir d3 39 2023-12-05T09:57:31.019 INFO:tasks.workunit.client.0.smithi100.stdout:7/382: truncate d3/dc/d11/f1e 201459 0 2023-12-05T09:57:31.022 INFO:tasks.workunit.client.1.smithi150.stdout:0/485: mkdir d5/d11/d71/d99/d9c/d3b/dad 0 2023-12-05T09:57:31.025 INFO:tasks.workunit.client.1.smithi150.stdout:8/441: mknod d0/d41/d49/d1b/d24/d38/d84/c8e 0 2023-12-05T09:57:31.027 INFO:tasks.workunit.client.1.smithi150.stdout:8/442: creat d0/d41/d49/d1b/d24/d34/d56/f8f x:0 0 0 2023-12-05T09:57:31.032 INFO:tasks.workunit.client.0.smithi100.stdout:7/383: rename d3/dc/d11/d13/de/f5a to d3/dc/d11/d13/f84 0 2023-12-05T09:57:31.034 INFO:tasks.workunit.client.1.smithi150.stdout:8/443: dread d0/d41/f50 [0,4194304] 0 2023-12-05T09:57:31.039 INFO:tasks.workunit.client.1.smithi150.stdout:8/444: mknod d0/d41/d49/d1b/d24/d2e/d30/c90 0 2023-12-05T09:57:31.051 INFO:tasks.workunit.client.0.smithi100.stdout:9/460: rmdir d7/d35 39 2023-12-05T09:57:31.055 INFO:tasks.workunit.client.0.smithi100.stdout:6/833: dread d7/d11/d1a/f9b [0,4194304] 0 2023-12-05T09:57:31.058 INFO:tasks.workunit.client.0.smithi100.stdout:7/384: dread d3/dc/d11/d13/de/f2b [0,4194304] 0 2023-12-05T09:57:31.058 INFO:tasks.workunit.client.0.smithi100.stdout:7/385: write d3/dc/d11/d13/d37/f4b [948533,16352] 0 2023-12-05T09:57:31.058 INFO:tasks.workunit.client.1.smithi150.stdout:2/447: dwrite d0/d3/f14 [0,4194304] 0 2023-12-05T09:57:31.058 INFO:tasks.workunit.client.0.smithi100.stdout:9/461: mknod d7/d20/c98 0 2023-12-05T09:57:31.059 INFO:tasks.workunit.client.0.smithi100.stdout:7/386: write d3/dc/d11/d13/de/d18/d3b/d40/f41 [1445859,110310] 0 2023-12-05T09:57:31.059 INFO:tasks.workunit.client.1.smithi150.stdout:7/454: dwrite d2/db/d17/d20/f3f [0,4194304] 0 2023-12-05T09:57:31.059 INFO:tasks.workunit.client.0.smithi100.stdout:6/834: mkdir d7/d2d/d115 0 2023-12-05T09:57:31.061 INFO:tasks.workunit.client.0.smithi100.stdout:9/462: creat d7/d1b/d22/d2a/f99 x:0 0 0 2023-12-05T09:57:31.062 INFO:tasks.workunit.client.1.smithi150.stdout:6/379: dwrite d2/d23/d3b/d46/f68 [0,4194304] 0 2023-12-05T09:57:31.062 INFO:tasks.workunit.client.1.smithi150.stdout:6/380: write d2/d23/d3b/d64/d7a/d5d/d6b/f53 [55734,121991] 0 2023-12-05T09:57:31.062 INFO:tasks.workunit.client.1.smithi150.stdout:6/381: read - d2/d23/d3b/d64/d7a/d5d/d6b/f4b zero size 2023-12-05T09:57:31.064 INFO:tasks.workunit.client.1.smithi150.stdout:8/445: dread d0/d41/d49/d1b/d24/d34/d56/f76 [0,4194304] 0 2023-12-05T09:57:31.065 INFO:tasks.workunit.client.0.smithi100.stdout:6/835: mknod d7/c116 0 2023-12-05T09:57:31.065 INFO:tasks.workunit.client.0.smithi100.stdout:9/463: mkdir d7/d35/d71/d9a 0 2023-12-05T09:57:31.065 INFO:tasks.workunit.client.0.smithi100.stdout:9/464: creat d7/d20/f9b x:0 0 0 2023-12-05T09:57:31.065 INFO:tasks.workunit.client.1.smithi150.stdout:2/448: link d0/d3/d5/d22/d52/d56/l72 d0/d3/d5/d3b/la2 0 2023-12-05T09:57:31.068 INFO:tasks.workunit.client.0.smithi100.stdout:9/465: mkdir d7/d1b/d22/d2a/d56/d9c 0 2023-12-05T09:57:31.068 INFO:tasks.workunit.client.1.smithi150.stdout:7/455: creat d2/db/d30/f94 x:0 0 0 2023-12-05T09:57:31.070 INFO:tasks.workunit.client.0.smithi100.stdout:9/466: rename d7/d1b/d22/d2a/d74/f8e to d7/d35/d97/f9d 0 2023-12-05T09:57:31.072 INFO:tasks.workunit.client.1.smithi150.stdout:6/382: mknod d2/d23/d3b/d64/d7a/d5d/d6b/c81 0 2023-12-05T09:57:31.074 INFO:tasks.workunit.client.1.smithi150.stdout:8/446: getdents d0/d41/d49/d1b/d24/d34/d56/d67/d64 0 2023-12-05T09:57:31.074 INFO:tasks.workunit.client.1.smithi150.stdout:4/386: dwrite d0/d42/f4c [0,4194304] 0 2023-12-05T09:57:31.076 INFO:tasks.workunit.client.1.smithi150.stdout:9/387: dwrite d3/d9/d26/d34/f72 [0,4194304] 0 2023-12-05T09:57:31.077 INFO:tasks.workunit.client.1.smithi150.stdout:2/449: dread d0/d3/d5/d22/f65 [0,4194304] 0 2023-12-05T09:57:31.079 INFO:tasks.workunit.client.1.smithi150.stdout:3/452: dwrite d6/f6c [0,4194304] 0 2023-12-05T09:57:31.079 INFO:tasks.workunit.client.1.smithi150.stdout:4/387: rename d0/d3e/d6d/d4b/f69 to d0/d3e/f71 0 2023-12-05T09:57:31.080 INFO:tasks.workunit.client.1.smithi150.stdout:4/388: readlink d0/d3e/d6d/l1b 0 2023-12-05T09:57:31.080 INFO:tasks.workunit.client.1.smithi150.stdout:4/389: read - d0/d3e/f6b zero size 2023-12-05T09:57:31.080 INFO:tasks.workunit.client.0.smithi100.stdout:0/399: dwrite da/d22/d33/f6a [0,4194304] 0 2023-12-05T09:57:31.080 INFO:tasks.workunit.client.0.smithi100.stdout:0/400: chown da/d22/d33/f75 3 1 2023-12-05T09:57:31.081 INFO:tasks.workunit.client.0.smithi100.stdout:7/387: write d3/dc/d11/d13/de/d2d/f6d [1559826,77004] 0 2023-12-05T09:57:31.083 INFO:tasks.workunit.client.1.smithi150.stdout:9/388: stat d3/d9/d26/l74 0 2023-12-05T09:57:31.085 INFO:tasks.workunit.client.1.smithi150.stdout:7/456: write d2/d4/fc [8916310,36380] 0 2023-12-05T09:57:31.086 INFO:tasks.workunit.client.1.smithi150.stdout:2/450: mkdir d0/da3 0 2023-12-05T09:57:31.087 INFO:tasks.workunit.client.0.smithi100.stdout:6/836: dread d7/d11/f4c [0,4194304] 0 2023-12-05T09:57:31.087 INFO:tasks.workunit.client.0.smithi100.stdout:9/467: dread d7/d1b/f33 [0,4194304] 0 2023-12-05T09:57:31.089 INFO:tasks.workunit.client.0.smithi100.stdout:0/401: creat da/d22/d33/d74/f79 x:0 0 0 2023-12-05T09:57:31.089 INFO:tasks.workunit.client.0.smithi100.stdout:0/402: chown da/d22/f23 594522383 1 2023-12-05T09:57:31.089 INFO:tasks.workunit.client.0.smithi100.stdout:0/403: write da/d22/d33/d74/f79 [786221,88333] 0 2023-12-05T09:57:31.089 INFO:tasks.workunit.client.1.smithi150.stdout:5/430: dwrite d1/d3/f85 [0,4194304] 0 2023-12-05T09:57:31.090 INFO:tasks.workunit.client.1.smithi150.stdout:5/431: chown d1/d7f/d65/c61 96890566 1 2023-12-05T09:57:31.090 INFO:tasks.workunit.client.1.smithi150.stdout:1/433: dwrite d6/d8/d54/d94/f96 [0,4194304] 0 2023-12-05T09:57:31.091 INFO:tasks.workunit.client.0.smithi100.stdout:7/388: creat d3/dc/d11/d13/de/d18/d3b/d40/d46/f85 x:0 0 0 2023-12-05T09:57:31.091 INFO:tasks.workunit.client.0.smithi100.stdout:7/389: fdatasync d3/dc/d11/d13/de/f74 0 2023-12-05T09:57:31.091 INFO:tasks.workunit.client.1.smithi150.stdout:8/447: dread d0/d41/d49/d1b/f31 [0,4194304] 0 2023-12-05T09:57:31.093 INFO:tasks.workunit.client.0.smithi100.stdout:9/468: mknod d7/d1b/d22/d93/c9e 0 2023-12-05T09:57:31.095 INFO:tasks.workunit.client.0.smithi100.stdout:0/404: symlink da/d60/l7a 0 2023-12-05T09:57:31.095 INFO:tasks.workunit.client.1.smithi150.stdout:9/389: dread d3/d9/dc/f4b [0,4194304] 0 2023-12-05T09:57:31.096 INFO:tasks.workunit.client.1.smithi150.stdout:9/390: fdatasync d3/d9/f6f 0 2023-12-05T09:57:31.096 INFO:tasks.workunit.client.1.smithi150.stdout:9/391: dread - d3/d1b/d46/f50 zero size 2023-12-05T09:57:31.096 INFO:tasks.workunit.client.1.smithi150.stdout:9/392: write d3/d9/f20 [1115478,30338] 0 2023-12-05T09:57:31.096 INFO:tasks.workunit.client.1.smithi150.stdout:9/393: write d3/f2e [1782892,19942] 0 2023-12-05T09:57:31.099 INFO:tasks.workunit.client.0.smithi100.stdout:7/390: creat d3/dc/d11/d13/de/f86 x:0 0 0 2023-12-05T09:57:31.099 INFO:tasks.workunit.client.0.smithi100.stdout:7/391: creat d3/dc/d11/d13/de/f87 x:0 0 0 2023-12-05T09:57:31.102 INFO:tasks.workunit.client.1.smithi150.stdout:3/453: link d6/c16 d6/d22/d37/d63/c8e 0 2023-12-05T09:57:31.113 INFO:tasks.workunit.client.1.smithi150.stdout:4/390: mknod d0/d3e/d6d/d4b/c72 0 2023-12-05T09:57:31.114 INFO:tasks.workunit.client.0.smithi100.stdout:7/392: creat d3/dc/d11/d13/de/d18/d3b/d40/d4c/d7f/f88 x:0 0 0 2023-12-05T09:57:31.121 INFO:tasks.workunit.client.0.smithi100.stdout:7/393: symlink d3/dc/d11/d13/de/l89 0 2023-12-05T09:57:31.122 INFO:tasks.workunit.client.1.smithi150.stdout:7/457: symlink d2/db/d62/l95 0 2023-12-05T09:57:31.123 INFO:tasks.workunit.client.1.smithi150.stdout:9/394: read d3/d42/f56 [3195868,34884] 0 2023-12-05T09:57:31.123 INFO:tasks.workunit.client.1.smithi150.stdout:9/395: chown d3/d42/d62/l53 255 1 2023-12-05T09:57:31.123 INFO:tasks.workunit.client.1.smithi150.stdout:9/396: fdatasync d3/f40 0 2023-12-05T09:57:31.123 INFO:tasks.workunit.client.1.smithi150.stdout:2/451: mknod d0/d3/d11/d1d/ca4 0 2023-12-05T09:57:31.124 INFO:tasks.workunit.client.1.smithi150.stdout:6/383: dwrite d2/d23/f29 [0,4194304] 0 2023-12-05T09:57:31.125 INFO:tasks.workunit.client.0.smithi100.stdout:7/394: symlink d3/dc/d11/d13/d1b/l8a 0 2023-12-05T09:57:31.125 INFO:tasks.workunit.client.0.smithi100.stdout:7/395: stat d3/dc/d11/d33/c57 0 2023-12-05T09:57:31.128 INFO:tasks.workunit.client.1.smithi150.stdout:2/452: dread d0/d3/d5/d22/d52/d5a/f5d [0,4194304] 0 2023-12-05T09:57:31.128 INFO:tasks.workunit.client.1.smithi150.stdout:5/432: dwrite d1/d7f/d65/f9d [0,4194304] 0 2023-12-05T09:57:31.129 INFO:tasks.workunit.client.0.smithi100.stdout:7/396: rename d3/dc/d11/d13/d1b/d60/c64 to d3/dc/d11/d13/de/d18/c8b 0 2023-12-05T09:57:31.129 INFO:tasks.workunit.client.0.smithi100.stdout:7/397: readlink d3/l2c 0 2023-12-05T09:57:31.137 INFO:tasks.workunit.client.0.smithi100.stdout:9/469: dread d7/d1b/d22/d51/f28 [0,4194304] 0 2023-12-05T09:57:31.137 INFO:tasks.workunit.client.0.smithi100.stdout:9/470: read d7/d1b/d22/f4a [1044585,118999] 0 2023-12-05T09:57:31.137 INFO:tasks.workunit.client.0.smithi100.stdout:9/471: dread - d7/d20/d68/f7e zero size 2023-12-05T09:57:31.143 INFO:tasks.workunit.client.1.smithi150.stdout:8/448: rename d0/d41/l4e to d0/d41/d49/d1b/d24/d34/d56/d67/l91 0 2023-12-05T09:57:31.143 INFO:tasks.workunit.client.0.smithi100.stdout:9/472: link d7/d1b/d22/d2a/f79 d7/d1b/d22/d93/f9f 0 2023-12-05T09:57:31.145 INFO:tasks.workunit.client.0.smithi100.stdout:9/473: rename d7/d35/f59 to d7/d20/d69/fa0 0 2023-12-05T09:57:31.147 INFO:tasks.workunit.client.1.smithi150.stdout:3/454: symlink d6/d9/d3d/d56/d30/l8f 0 2023-12-05T09:57:31.147 INFO:tasks.workunit.client.1.smithi150.stdout:4/391: mknod d0/d3e/d5b/d6e/c73 0 2023-12-05T09:57:31.147 INFO:tasks.workunit.client.1.smithi150.stdout:7/458: mknod d2/db/d30/d13/d4f/d5a/d5c/c96 0 2023-12-05T09:57:31.147 INFO:tasks.workunit.client.1.smithi150.stdout:3/455: chown d6/d25/d28/d67 660920647 1 2023-12-05T09:57:31.149 INFO:tasks.workunit.client.1.smithi150.stdout:8/449: dread d0/d41/f71 [0,4194304] 0 2023-12-05T09:57:31.151 INFO:tasks.workunit.client.0.smithi100.stdout:9/474: mknod d7/d20/d68/ca1 0 2023-12-05T09:57:31.151 INFO:tasks.workunit.client.0.smithi100.stdout:9/475: fsync d7/d1b/d22/d51/d32/f8c 0 2023-12-05T09:57:31.157 INFO:tasks.workunit.client.1.smithi150.stdout:5/433: link d1/d7f/d65/l8a d1/d7f/d65/d3b/d8d/l9e 0 2023-12-05T09:57:31.165 INFO:tasks.workunit.client.1.smithi150.stdout:1/434: getdents d6/d8/d85 0 2023-12-05T09:57:31.165 INFO:tasks.workunit.client.1.smithi150.stdout:1/435: chown d6/d8/db/f19 7668 1 2023-12-05T09:57:31.166 INFO:tasks.workunit.client.1.smithi150.stdout:9/397: rename d3/d9/d58/d73 to d3/d1b/d79 0 2023-12-05T09:57:31.166 INFO:tasks.workunit.client.1.smithi150.stdout:4/392: symlink d0/d3e/d5b/l74 0 2023-12-05T09:57:31.166 INFO:tasks.workunit.client.1.smithi150.stdout:7/459: rmdir d2/db/d17 39 2023-12-05T09:57:31.166 INFO:tasks.workunit.client.1.smithi150.stdout:7/460: write d2/d4/f27 [4137539,98539] 0 2023-12-05T09:57:31.166 INFO:tasks.workunit.client.0.smithi100.stdout:0/405: dwrite da/f2c [4194304,4194304] 0 2023-12-05T09:57:31.167 INFO:tasks.workunit.client.1.smithi150.stdout:8/450: mknod d0/d41/d49/d1b/d24/d2e/d4d/d83/c92 0 2023-12-05T09:57:31.168 INFO:tasks.workunit.client.0.smithi100.stdout:9/476: read d7/fc [754575,70372] 0 2023-12-05T09:57:31.170 INFO:tasks.workunit.client.0.smithi100.stdout:0/406: creat da/d2a/f7b x:0 0 0 2023-12-05T09:57:31.172 INFO:tasks.workunit.client.1.smithi150.stdout:5/434: link d1/d3/f7d d1/d7f/d65/f9f 0 2023-12-05T09:57:31.174 INFO:tasks.workunit.client.1.smithi150.stdout:1/436: mknod d6/d47/d4c/d7c/c9e 0 2023-12-05T09:57:31.175 INFO:tasks.workunit.client.1.smithi150.stdout:9/398: symlink d3/d1b/d46/l7a 0 2023-12-05T09:57:31.178 INFO:tasks.workunit.client.1.smithi150.stdout:4/393: mknod d0/d3e/d5b/c75 0 2023-12-05T09:57:31.180 INFO:tasks.workunit.client.0.smithi100.stdout:9/477: unlink d7/d1b/d22/d2a/d56/c26 0 2023-12-05T09:57:31.181 INFO:tasks.workunit.client.0.smithi100.stdout:9/478: write d7/d1b/f30 [1579207,116938] 0 2023-12-05T09:57:31.184 INFO:tasks.workunit.client.0.smithi100.stdout:9/479: chown d7/d1b/d22/d2a/d56/d2e/d50 0 1 2023-12-05T09:57:31.184 INFO:tasks.workunit.client.1.smithi150.stdout:7/461: mknod d2/d39/c97 0 2023-12-05T09:57:31.184 INFO:tasks.workunit.client.1.smithi150.stdout:6/384: dwrite d2/d23/d2e/f43 [0,4194304] 0 2023-12-05T09:57:31.184 INFO:tasks.workunit.client.1.smithi150.stdout:6/385: chown d2/d23 3 1 2023-12-05T09:57:31.185 INFO:tasks.workunit.client.1.smithi150.stdout:1/437: symlink d6/d8/db/d1b/d79/l9f 0 2023-12-05T09:57:31.185 INFO:tasks.workunit.client.1.smithi150.stdout:1/438: chown d6/d8/fc 3446 1 2023-12-05T09:57:31.186 INFO:tasks.workunit.client.0.smithi100.stdout:7/398: dwrite d3/dc/d11/d13/de/f86 [0,4194304] 0 2023-12-05T09:57:31.186 INFO:tasks.workunit.client.0.smithi100.stdout:7/399: readlink d3/dc/d11/d13/d1b/l36 0 2023-12-05T09:57:31.191 INFO:tasks.workunit.client.0.smithi100.stdout:0/407: symlink da/d1b/d6b/l7c 0 2023-12-05T09:57:31.191 INFO:tasks.workunit.client.0.smithi100.stdout:9/480: mkdir d7/d1b/d22/d2a/d56/d2e/d50/d5b/da2 0 2023-12-05T09:57:31.193 INFO:tasks.workunit.client.1.smithi150.stdout:9/399: unlink d3/d9/f1c 0 2023-12-05T09:57:31.193 INFO:tasks.workunit.client.1.smithi150.stdout:5/435: write d1/d3/d6/d1b/f6a [2566740,10558] 0 2023-12-05T09:57:31.195 INFO:tasks.workunit.client.0.smithi100.stdout:6/837: dwrite d7/d2d/f42 [0,4194304] 0 2023-12-05T09:57:31.196 INFO:tasks.workunit.client.1.smithi150.stdout:2/453: dwrite d0/d3/d5/d13/d15/d30/d54/d57/f91 [0,4194304] 0 2023-12-05T09:57:31.196 INFO:tasks.workunit.client.1.smithi150.stdout:2/454: chown d0/d3/d5/d3b/la2 1101239 1 2023-12-05T09:57:31.197 INFO:tasks.workunit.client.1.smithi150.stdout:6/386: creat d2/d23/d3b/d64/d7a/d5d/f82 x:0 0 0 2023-12-05T09:57:31.197 INFO:tasks.workunit.client.1.smithi150.stdout:1/439: creat d6/fa0 x:0 0 0 2023-12-05T09:57:31.197 INFO:tasks.workunit.client.1.smithi150.stdout:1/440: fdatasync d6/d8/db/de/f77 0 2023-12-05T09:57:31.197 INFO:tasks.workunit.client.0.smithi100.stdout:9/481: creat d7/d35/d71/d9a/fa3 x:0 0 0 2023-12-05T09:57:31.197 INFO:tasks.workunit.client.0.smithi100.stdout:9/482: fdatasync d7/d20/f76 0 2023-12-05T09:57:31.200 INFO:tasks.workunit.client.1.smithi150.stdout:2/455: write d0/d3/d5/d10/f1b [159,126858] 0 2023-12-05T09:57:31.200 INFO:tasks.workunit.client.1.smithi150.stdout:2/456: fsync d0/d3/f99 0 2023-12-05T09:57:31.202 INFO:tasks.workunit.client.1.smithi150.stdout:0/486: sync 2023-12-05T09:57:31.202 INFO:tasks.workunit.client.1.smithi150.stdout:0/487: fdatasync d5/ff 0 2023-12-05T09:57:31.206 INFO:tasks.workunit.client.1.smithi150.stdout:7/462: mkdir d2/d4/d98 0 2023-12-05T09:57:31.206 INFO:tasks.workunit.client.1.smithi150.stdout:3/456: dwrite d6/d9/d3d/d56/f3b [0,4194304] 0 2023-12-05T09:57:31.206 INFO:tasks.workunit.client.1.smithi150.stdout:7/463: fsync d2/d4/f6d 0 2023-12-05T09:57:31.206 INFO:tasks.workunit.client.1.smithi150.stdout:7/464: getdents d2/db/d17/d88 0 2023-12-05T09:57:31.206 INFO:tasks.workunit.client.1.smithi150.stdout:7/465: dread - d2/d39/f64 zero size 2023-12-05T09:57:31.210 INFO:tasks.workunit.client.1.smithi150.stdout:1/441: mkdir d6/d38/da1 0 2023-12-05T09:57:31.210 INFO:tasks.workunit.client.0.smithi100.stdout:7/400: dread d3/dc/d11/d13/d1b/f45 [0,4194304] 0 2023-12-05T09:57:31.210 INFO:tasks.workunit.client.0.smithi100.stdout:7/401: readlink d3/dc/d11/d13/de/l89 0 2023-12-05T09:57:31.210 INFO:tasks.workunit.client.0.smithi100.stdout:0/408: dread da/d22/d33/f6a [0,4194304] 0 2023-12-05T09:57:31.211 INFO:tasks.workunit.client.1.smithi150.stdout:9/400: dread d3/d9/dc/d1f/d24/f6b [0,4194304] 0 2023-12-05T09:57:31.212 INFO:tasks.workunit.client.0.smithi100.stdout:6/838: mknod d7/d2d/d115/c117 0 2023-12-05T09:57:31.212 INFO:tasks.workunit.client.0.smithi100.stdout:6/839: stat d7/d11/d1a/db7/fc0 0 2023-12-05T09:57:31.212 INFO:tasks.workunit.client.0.smithi100.stdout:6/840: fdatasync d7/fc7 0 2023-12-05T09:57:31.213 INFO:tasks.workunit.client.1.smithi150.stdout:9/401: read d3/d9/dc/d1f/f2b [644929,19988] 0 2023-12-05T09:57:31.213 INFO:tasks.workunit.client.1.smithi150.stdout:2/457: chown d0/d3/d5/d13/d15/d30/d54/c47 23780952 1 2023-12-05T09:57:31.213 INFO:tasks.workunit.client.1.smithi150.stdout:2/458: chown d0/d3/d11/d1d/l4e 97 1 2023-12-05T09:57:31.213 INFO:tasks.workunit.client.1.smithi150.stdout:2/459: write d0/d3/d5/f40 [279186,35329] 0 2023-12-05T09:57:31.213 INFO:tasks.workunit.client.1.smithi150.stdout:2/460: dread - d0/d3/f99 zero size 2023-12-05T09:57:31.214 INFO:tasks.workunit.client.0.smithi100.stdout:6/841: write d7/d11/f99 [176265,7259] 0 2023-12-05T09:57:31.216 INFO:tasks.workunit.client.1.smithi150.stdout:6/387: dread d2/d23/d3b/d64/d7a/f4d [0,4194304] 0 2023-12-05T09:57:31.219 INFO:tasks.workunit.client.0.smithi100.stdout:9/483: read d7/d20/f76 [2128437,40577] 0 2023-12-05T09:57:31.219 INFO:tasks.workunit.client.0.smithi100.stdout:0/409: creat da/d22/d33/f7d x:0 0 0 2023-12-05T09:57:31.219 INFO:tasks.workunit.client.0.smithi100.stdout:0/410: truncate da/d1b/f66 411652 0 2023-12-05T09:57:31.221 INFO:tasks.workunit.client.1.smithi150.stdout:0/488: dread d5/d11/d71/d99/d9c/f3d [0,4194304] 0 2023-12-05T09:57:31.221 INFO:tasks.workunit.client.1.smithi150.stdout:0/489: truncate d5/ff 8567237 0 2023-12-05T09:57:31.222 INFO:tasks.workunit.client.0.smithi100.stdout:7/402: getdents d3/dc/d11/d13/de/d18/d3b/d40/d46 0 2023-12-05T09:57:31.227 INFO:tasks.workunit.client.0.smithi100.stdout:0/411: symlink da/d2a/d45/l7e 0 2023-12-05T09:57:31.227 INFO:tasks.workunit.client.0.smithi100.stdout:0/412: getdents da/d1b/d6b/d78 0 2023-12-05T09:57:31.228 INFO:tasks.workunit.client.0.smithi100.stdout:0/413: readlink da/l19 0 2023-12-05T09:57:31.228 INFO:tasks.workunit.client.0.smithi100.stdout:0/414: write da/fd [3614082,66453] 0 2023-12-05T09:57:31.228 INFO:tasks.workunit.client.0.smithi100.stdout:0/415: write da/d2a/f62 [578451,123565] 0 2023-12-05T09:57:31.228 INFO:tasks.workunit.client.1.smithi150.stdout:3/457: dread d6/f6c [0,4194304] 0 2023-12-05T09:57:31.229 INFO:tasks.workunit.client.0.smithi100.stdout:7/403: mknod d3/dc/d11/d13/de/c8c 0 2023-12-05T09:57:31.230 INFO:tasks.workunit.client.0.smithi100.stdout:6/842: dread d7/d11/d82/f28 [0,4194304] 0 2023-12-05T09:57:31.230 INFO:tasks.workunit.client.0.smithi100.stdout:6/843: write d7/f89 [887685,45398] 0 2023-12-05T09:57:31.231 INFO:tasks.workunit.client.1.smithi150.stdout:7/466: creat d2/db/f99 x:0 0 0 2023-12-05T09:57:31.232 INFO:tasks.workunit.client.1.smithi150.stdout:7/467: stat d2/db/d30/f9 0 2023-12-05T09:57:31.233 INFO:tasks.workunit.client.1.smithi150.stdout:1/442: rename d6/d8/db/de/f14 to d6/d47/d4c/fa2 0 2023-12-05T09:57:31.233 INFO:tasks.workunit.client.1.smithi150.stdout:1/443: chown d6/d8/db/d1b/d79/l9f 943 1 2023-12-05T09:57:31.237 INFO:tasks.workunit.client.0.smithi100.stdout:9/484: mknod d7/d1b/d22/d51/ca4 0 2023-12-05T09:57:31.241 INFO:tasks.workunit.client.0.smithi100.stdout:0/416: rmdir da/d22/d33/d35/d3a 39 2023-12-05T09:57:31.245 INFO:tasks.workunit.client.0.smithi100.stdout:7/404: mknod d3/dc/d11/d13/de/d18/c8d 0 2023-12-05T09:57:31.246 INFO:tasks.workunit.client.0.smithi100.stdout:7/405: truncate d3/dc/d11/d13/de/f73 224481 0 2023-12-05T09:57:31.249 INFO:tasks.workunit.client.1.smithi150.stdout:6/388: rename d2/d23/d3b/d64/d7a/d5d/d6b/d63 to d2/d23/d3b/d83 0 2023-12-05T09:57:31.249 INFO:tasks.workunit.client.1.smithi150.stdout:1/444: creat d6/d38/fa3 x:0 0 0 2023-12-05T09:57:31.249 INFO:tasks.workunit.client.1.smithi150.stdout:2/461: dread d0/d3/d11/f23 [0,4194304] 0 2023-12-05T09:57:31.250 INFO:tasks.workunit.client.0.smithi100.stdout:6/844: mknod d7/d2d/d115/c118 0 2023-12-05T09:57:31.250 INFO:tasks.workunit.client.0.smithi100.stdout:6/845: fsync d7/d2d/d6a/d7c/d8d/f8e 0 2023-12-05T09:57:31.252 INFO:tasks.workunit.client.1.smithi150.stdout:1/445: write d6/d8/d54/f55 [513776,56861] 0 2023-12-05T09:57:31.252 INFO:tasks.workunit.client.0.smithi100.stdout:9/485: rename d7/d1b/d22/d2a/d56/d2e/d50/d5b to d7/d1b/da5 0 2023-12-05T09:57:31.252 INFO:tasks.workunit.client.0.smithi100.stdout:9/486: chown d7/d1b/d22/d51/d32/d96 1057110324 1 2023-12-05T09:57:31.253 INFO:tasks.workunit.client.1.smithi150.stdout:5/436: truncate d1/d3/d6/d1b/f6a 2262903 0 2023-12-05T09:57:31.255 INFO:tasks.workunit.client.0.smithi100.stdout:7/406: symlink d3/dc/d11/d13/de/d18/d3b/d40/d4c/d7f/l8e 0 2023-12-05T09:57:31.255 INFO:tasks.workunit.client.0.smithi100.stdout:7/407: chown d3/dc/d11/f58 1 1 2023-12-05T09:57:31.258 INFO:tasks.workunit.client.1.smithi150.stdout:6/389: creat d2/d23/d2e/d44/d7d/f84 x:0 0 0 2023-12-05T09:57:31.258 INFO:tasks.workunit.client.1.smithi150.stdout:3/458: write d6/d25/d28/f3a [2910763,101795] 0 2023-12-05T09:57:31.259 INFO:tasks.workunit.client.0.smithi100.stdout:6/846: mknod d7/d76/c119 0 2023-12-05T09:57:31.262 INFO:tasks.workunit.client.1.smithi150.stdout:5/437: mknod d1/d3/d6/d11/ca0 0 2023-12-05T09:57:31.262 INFO:tasks.workunit.client.1.smithi150.stdout:5/438: chown d1/d3 28739 1 2023-12-05T09:57:31.262 INFO:tasks.workunit.client.1.smithi150.stdout:5/439: creat d1/d2e/fa1 x:0 0 0 2023-12-05T09:57:31.262 INFO:tasks.workunit.client.1.smithi150.stdout:5/440: fdatasync d1/d7f/d65/d3b/f84 0 2023-12-05T09:57:31.263 INFO:tasks.workunit.client.0.smithi100.stdout:7/408: mknod d3/c8f 0 2023-12-05T09:57:31.268 INFO:tasks.workunit.client.0.smithi100.stdout:4/389: sync 2023-12-05T09:57:31.268 INFO:tasks.workunit.client.0.smithi100.stdout:1/430: sync 2023-12-05T09:57:31.268 INFO:tasks.workunit.client.0.smithi100.stdout:1/431: dread - db/d12/d61/f80 zero size 2023-12-05T09:57:31.268 INFO:tasks.workunit.client.0.smithi100.stdout:3/527: sync 2023-12-05T09:57:31.268 INFO:tasks.workunit.client.0.smithi100.stdout:5/491: sync 2023-12-05T09:57:31.268 INFO:tasks.workunit.client.0.smithi100.stdout:2/580: sync 2023-12-05T09:57:31.268 INFO:tasks.workunit.client.0.smithi100.stdout:8/373: sync 2023-12-05T09:57:31.269 INFO:tasks.workunit.client.0.smithi100.stdout:9/487: mknod d7/ca6 0 2023-12-05T09:57:31.269 INFO:tasks.workunit.client.0.smithi100.stdout:6/847: creat d7/d2d/d6a/de2/f11a x:0 0 0 2023-12-05T09:57:31.273 INFO:tasks.workunit.client.1.smithi150.stdout:1/446: symlink d6/la4 0 2023-12-05T09:57:31.274 INFO:tasks.workunit.client.0.smithi100.stdout:7/409: rename d3/dc/d11/d13/de/l27 to d3/dc/d11/d13/de/d18/d3b/d40/d4c/l90 0 2023-12-05T09:57:31.275 INFO:tasks.workunit.client.1.smithi150.stdout:0/490: dwrite d5/d11/d71/d99/d9c/f3d [0,4194304] 0 2023-12-05T09:57:31.278 INFO:tasks.workunit.client.0.smithi100.stdout:4/390: getdents de/d16/d23/d33 0 2023-12-05T09:57:31.283 INFO:tasks.workunit.client.1.smithi150.stdout:9/402: dwrite d3/d9/f6f [0,4194304] 0 2023-12-05T09:57:31.283 INFO:tasks.workunit.client.1.smithi150.stdout:9/403: dread - d3/d1b/f59 zero size 2023-12-05T09:57:31.287 INFO:tasks.workunit.client.1.smithi150.stdout:5/441: link d1/d3/d6/d1b/d22/f32 d1/d3/fa2 0 2023-12-05T09:57:31.288 INFO:tasks.workunit.client.0.smithi100.stdout:5/492: rmdir d0/d1f 39 2023-12-05T09:57:31.291 INFO:tasks.workunit.client.1.smithi150.stdout:3/459: getdents d6/d9/d3d/d56/d71 0 2023-12-05T09:57:31.291 INFO:tasks.workunit.client.1.smithi150.stdout:3/460: chown d6 1006 1 2023-12-05T09:57:31.294 INFO:tasks.workunit.client.0.smithi100.stdout:2/581: write d7/da/d18/d1b/d2c/d3f/fc0 [153994,16055] 0 2023-12-05T09:57:31.294 INFO:tasks.workunit.client.0.smithi100.stdout:2/582: write d7/da/d1a/f38 [2156826,22286] 0 2023-12-05T09:57:31.303 INFO:tasks.workunit.client.0.smithi100.stdout:3/528: dread d0/fa7 [0,4194304] 0 2023-12-05T09:57:31.303 INFO:tasks.workunit.client.0.smithi100.stdout:1/432: dread db/d31/d3a/f42 [0,4194304] 0 2023-12-05T09:57:31.304 INFO:tasks.workunit.client.0.smithi100.stdout:6/848: getdents d7/d27/da0 0 2023-12-05T09:57:31.306 INFO:tasks.workunit.client.1.smithi150.stdout:0/491: dread d5/f23 [0,4194304] 0 2023-12-05T09:57:31.313 INFO:tasks.workunit.client.1.smithi150.stdout:2/462: dwrite d0/d3/d5/d10/d3d/d41/f7b [0,4194304] 0 2023-12-05T09:57:31.314 INFO:tasks.workunit.client.1.smithi150.stdout:2/463: creat d0/d3/d5/d13/d15/d30/d54/d57/fa5 x:0 0 0 2023-12-05T09:57:31.324 INFO:tasks.workunit.client.1.smithi150.stdout:1/447: write d6/d47/d4c/fa2 [1338736,109188] 0 2023-12-05T09:57:31.325 INFO:tasks.workunit.client.1.smithi150.stdout:9/404: read d3/d9/f54 [418221,38667] 0 2023-12-05T09:57:31.330 INFO:tasks.workunit.client.0.smithi100.stdout:2/583: rename d7/da/d18/d1b/d2c/d3f/f67 to d7/da/d13/d69/fc6 0 2023-12-05T09:57:31.336 INFO:tasks.workunit.client.0.smithi100.stdout:3/529: creat d0/d10/fb7 x:0 0 0 2023-12-05T09:57:31.336 INFO:tasks.workunit.client.0.smithi100.stdout:3/530: fdatasync d0/d4/f20 0 2023-12-05T09:57:31.336 INFO:tasks.workunit.client.0.smithi100.stdout:0/417: dwrite da/d1b/f54 [0,4194304] 0 2023-12-05T09:57:31.336 INFO:tasks.workunit.client.0.smithi100.stdout:0/418: stat da/d22/d33/f6a 0 2023-12-05T09:57:31.342 INFO:tasks.workunit.client.0.smithi100.stdout:6/849: truncate d7/d27/f3b 1755549 0 2023-12-05T09:57:31.342 INFO:tasks.workunit.client.0.smithi100.stdout:6/850: chown d7/d11/d1a 247093 1 2023-12-05T09:57:31.342 INFO:tasks.workunit.client.0.smithi100.stdout:2/584: creat d7/da/d18/d1b/d2c/d3f/d98/fc7 x:0 0 0 2023-12-05T09:57:31.342 INFO:tasks.workunit.client.1.smithi150.stdout:5/442: getdents d1/d3/d6/d1b 0 2023-12-05T09:57:31.342 INFO:tasks.workunit.client.1.smithi150.stdout:5/443: truncate d1/d7f/d65/f9f 17688 0 2023-12-05T09:57:31.346 INFO:tasks.workunit.client.1.smithi150.stdout:0/492: getdents d5 0 2023-12-05T09:57:31.349 INFO:tasks.workunit.client.1.smithi150.stdout:6/390: dwrite d2/d23/d3b/d64/d7a/d5d/d6b/f10 [0,4194304] 0 2023-12-05T09:57:31.350 INFO:tasks.workunit.client.1.smithi150.stdout:0/493: write d5/d11/d71/f30 [2689558,130191] 0 2023-12-05T09:57:31.353 INFO:tasks.workunit.client.0.smithi100.stdout:6/851: creat d7/d76/f11b x:0 0 0 2023-12-05T09:57:31.355 INFO:tasks.workunit.client.1.smithi150.stdout:2/464: symlink d0/d3/d5/d3b/d4c/la6 0 2023-12-05T09:57:31.355 INFO:tasks.workunit.client.1.smithi150.stdout:2/465: stat d0/d42 0 2023-12-05T09:57:31.356 INFO:tasks.workunit.client.1.smithi150.stdout:2/466: write d0/d3/d5/d10/f1b [587732,94177] 0 2023-12-05T09:57:31.356 INFO:tasks.workunit.client.1.smithi150.stdout:2/467: chown d0/d3/d5/d3b/d4c 1 1 2023-12-05T09:57:31.356 INFO:tasks.workunit.client.1.smithi150.stdout:1/448: mkdir d6/d8/db/de/d75/da5 0 2023-12-05T09:57:31.357 INFO:tasks.workunit.client.1.smithi150.stdout:1/449: fsync d6/d8/d85/f9b 0 2023-12-05T09:57:31.361 INFO:tasks.workunit.client.0.smithi100.stdout:8/374: dwrite d0/d12/d13/d16/d22/d24/f3f [0,4194304] 0 2023-12-05T09:57:31.362 INFO:tasks.workunit.client.1.smithi150.stdout:5/444: creat d1/d3/d6/d1b/d22/d24/d59/fa3 x:0 0 0 2023-12-05T09:57:31.362 INFO:tasks.workunit.client.1.smithi150.stdout:3/461: rmdir d6/d9/d3d/d56/d53 39 2023-12-05T09:57:31.367 INFO:tasks.workunit.client.1.smithi150.stdout:3/462: write d6/d9/f1c [1122871,14098] 0 2023-12-05T09:57:31.367 INFO:tasks.workunit.client.1.smithi150.stdout:3/463: getdents d6/d9/d43/d75 0 2023-12-05T09:57:31.367 INFO:tasks.workunit.client.1.smithi150.stdout:3/464: truncate d6/d22/d37/f4a 1390003 0 2023-12-05T09:57:31.367 INFO:tasks.workunit.client.1.smithi150.stdout:4/394: sync 2023-12-05T09:57:31.367 INFO:tasks.workunit.client.1.smithi150.stdout:6/391: dread d2/d23/d2e/f3e [0,4194304] 0 2023-12-05T09:57:31.367 INFO:tasks.workunit.client.1.smithi150.stdout:8/451: sync 2023-12-05T09:57:31.367 INFO:tasks.workunit.client.1.smithi150.stdout:8/452: write d0/d41/d49/d1b/d24/d2e/f8b [227240,92115] 0 2023-12-05T09:57:31.368 INFO:tasks.workunit.client.0.smithi100.stdout:4/391: dwrite de/d16/d23/f26 [0,4194304] 0 2023-12-05T09:57:31.368 INFO:tasks.workunit.client.1.smithi150.stdout:4/395: write d0/d42/d44/f59 [356668,106951] 0 2023-12-05T09:57:31.370 INFO:tasks.workunit.client.0.smithi100.stdout:0/419: dread da/f2d [4194304,4194304] 0 2023-12-05T09:57:31.373 INFO:tasks.workunit.client.0.smithi100.stdout:7/410: dwrite d3/dc/d11/d33/f62 [0,4194304] 0 2023-12-05T09:57:31.373 INFO:tasks.workunit.client.0.smithi100.stdout:7/411: fdatasync d3/dc/d11/d13/de/d2d/f6d 0 2023-12-05T09:57:31.373 INFO:tasks.workunit.client.0.smithi100.stdout:7/412: fdatasync d3/dc/d11/d13/de/f28 0 2023-12-05T09:57:31.374 INFO:tasks.workunit.client.0.smithi100.stdout:1/433: dwrite db/d12/d1e/f38 [0,4194304] 0 2023-12-05T09:57:31.375 INFO:tasks.workunit.client.0.smithi100.stdout:5/493: dwrite d0/d1b/d4d/d60/f6d [0,4194304] 0 2023-12-05T09:57:31.376 INFO:tasks.workunit.client.0.smithi100.stdout:9/488: dwrite d7/fd [0,4194304] 0 2023-12-05T09:57:31.378 INFO:tasks.workunit.client.0.smithi100.stdout:4/392: rmdir de/d16/d23/d33 39 2023-12-05T09:57:31.380 INFO:tasks.workunit.client.0.smithi100.stdout:2/585: fdatasync d7/da/d1a/f38 0 2023-12-05T09:57:31.380 INFO:tasks.workunit.client.0.smithi100.stdout:2/586: fsync d7/da/d18/fab 0 2023-12-05T09:57:31.382 INFO:tasks.workunit.client.1.smithi150.stdout:0/494: mknod d5/d11/d71/d99/d9c/d46/d80/cae 0 2023-12-05T09:57:31.383 INFO:tasks.workunit.client.0.smithi100.stdout:0/420: mkdir da/d22/d33/d7f 0 2023-12-05T09:57:31.385 INFO:tasks.workunit.client.1.smithi150.stdout:0/495: chown d5/c48 43198 1 2023-12-05T09:57:31.389 INFO:tasks.workunit.client.1.smithi150.stdout:2/468: getdents d0/d3/d11 0 2023-12-05T09:57:31.390 INFO:tasks.workunit.client.1.smithi150.stdout:1/450: creat d6/d38/da1/fa6 x:0 0 0 2023-12-05T09:57:31.393 INFO:tasks.workunit.client.0.smithi100.stdout:1/434: symlink db/d31/d3a/l8b 0 2023-12-05T09:57:31.393 INFO:tasks.workunit.client.1.smithi150.stdout:5/445: mknod d1/d7f/d65/d3b/d37/ca4 0 2023-12-05T09:57:31.394 INFO:tasks.workunit.client.1.smithi150.stdout:5/446: creat d1/d7f/fa5 x:0 0 0 2023-12-05T09:57:31.398 INFO:tasks.workunit.client.1.smithi150.stdout:4/396: rename d0/d42/d44/f59 to d0/d3e/f76 0 2023-12-05T09:57:31.401 INFO:tasks.workunit.client.0.smithi100.stdout:3/531: dwrite d0/d3d/d5c/d5f/d67/f69 [0,4194304] 0 2023-12-05T09:57:31.401 INFO:tasks.workunit.client.0.smithi100.stdout:3/532: write d0/d10/d39/dab/faf [98054,87988] 0 2023-12-05T09:57:31.401 INFO:tasks.workunit.client.0.smithi100.stdout:7/413: write d3/dc/d11/d13/d1b/f5e [1357250,88375] 0 2023-12-05T09:57:31.401 INFO:tasks.workunit.client.0.smithi100.stdout:7/414: chown d3/dc/d11/d13/de/d18/c8d 153272 1 2023-12-05T09:57:31.402 INFO:tasks.workunit.client.0.smithi100.stdout:5/494: write d0/d1f/f21 [3689198,18053] 0 2023-12-05T09:57:31.404 INFO:tasks.workunit.client.1.smithi150.stdout:7/468: sync 2023-12-05T09:57:31.404 INFO:tasks.workunit.client.1.smithi150.stdout:7/469: dread - d2/db/d17/d38/d85/f8b zero size 2023-12-05T09:57:31.407 INFO:tasks.workunit.client.0.smithi100.stdout:4/393: dread de/d16/d23/f47 [0,4194304] 0 2023-12-05T09:57:31.414 INFO:tasks.workunit.client.1.smithi150.stdout:2/469: creat d0/d42/fa7 x:0 0 0 2023-12-05T09:57:31.414 INFO:tasks.workunit.client.1.smithi150.stdout:2/470: write d0/d3/d5/d13/d15/d30/d54/d57/f75 [1268928,62280] 0 2023-12-05T09:57:31.415 INFO:tasks.workunit.client.1.smithi150.stdout:8/453: dwrite d0/d8/f2c [0,4194304] 0 2023-12-05T09:57:31.415 INFO:tasks.workunit.client.0.smithi100.stdout:2/587: mkdir d7/da/d18/d1b/d2c/d3f/d46/dc8 0 2023-12-05T09:57:31.419 INFO:tasks.workunit.client.0.smithi100.stdout:7/415: dread d3/dc/d11/d13/de/f48 [0,4194304] 0 2023-12-05T09:57:31.419 INFO:tasks.workunit.client.1.smithi150.stdout:3/465: mknod d6/d9/d8d/c90 0 2023-12-05T09:57:31.420 INFO:tasks.workunit.client.0.smithi100.stdout:0/421: symlink da/d22/d33/d35/l80 0 2023-12-05T09:57:31.420 INFO:tasks.workunit.client.0.smithi100.stdout:0/422: fsync da/d22/d33/f6a 0 2023-12-05T09:57:31.423 INFO:tasks.workunit.client.0.smithi100.stdout:1/435: mkdir db/d12/d1e/d26/d30/d52/d84/d8c 0 2023-12-05T09:57:31.423 INFO:tasks.workunit.client.0.smithi100.stdout:1/436: write db/d12/d1e/d26/f62 [4817625,85479] 0 2023-12-05T09:57:31.424 INFO:tasks.workunit.client.1.smithi150.stdout:7/470: mkdir d2/db/d2e/d9a 0 2023-12-05T09:57:31.425 INFO:tasks.workunit.client.1.smithi150.stdout:2/471: symlink d0/d3/d27/la8 0 2023-12-05T09:57:31.426 INFO:tasks.workunit.client.0.smithi100.stdout:4/394: unlink de/d16/d23/d33/d3d/f3f 0 2023-12-05T09:57:31.427 INFO:tasks.workunit.client.0.smithi100.stdout:4/395: readlink de/d16/d23/d33/d3d/d44/l70 0 2023-12-05T09:57:31.428 INFO:tasks.workunit.client.1.smithi150.stdout:8/454: unlink d0/d41/d49/d1b/d24/f3b 0 2023-12-05T09:57:31.429 INFO:tasks.workunit.client.0.smithi100.stdout:2/588: dread d7/da/d13/d69/fc6 [0,4194304] 0 2023-12-05T09:57:31.430 INFO:tasks.workunit.client.1.smithi150.stdout:3/466: mknod d6/d9/d43/c91 0 2023-12-05T09:57:31.434 INFO:tasks.workunit.client.0.smithi100.stdout:7/416: creat d3/dc/d11/d13/f91 x:0 0 0 2023-12-05T09:57:31.435 INFO:tasks.workunit.client.0.smithi100.stdout:7/417: write d3/dc/d11/d33/f79 [983976,49800] 0 2023-12-05T09:57:31.435 INFO:tasks.workunit.client.0.smithi100.stdout:7/418: creat d3/dc/d11/d13/de/d18/d3b/d40/d4c/d7f/f92 x:0 0 0 2023-12-05T09:57:31.435 INFO:tasks.workunit.client.1.smithi150.stdout:4/397: write d0/f30 [7327968,85687] 0 2023-12-05T09:57:31.436 INFO:tasks.workunit.client.1.smithi150.stdout:4/398: chown d0/c31 400955 1 2023-12-05T09:57:31.436 INFO:tasks.workunit.client.1.smithi150.stdout:4/399: truncate d0/d42/d44/f6f 233080 0 2023-12-05T09:57:31.436 INFO:tasks.workunit.client.1.smithi150.stdout:5/447: rename d1/d3/d6/d1b/d22 to d1/d2e/da6 0 2023-12-05T09:57:31.438 INFO:tasks.workunit.client.1.smithi150.stdout:7/471: symlink d2/l9b 0 2023-12-05T09:57:31.439 INFO:tasks.workunit.client.0.smithi100.stdout:0/423: creat da/d22/d33/d7f/f81 x:0 0 0 2023-12-05T09:57:31.440 INFO:tasks.workunit.client.1.smithi150.stdout:8/455: creat d0/d41/d49/d1b/f93 x:0 0 0 2023-12-05T09:57:31.440 INFO:tasks.workunit.client.1.smithi150.stdout:8/456: write d0/d8/f11 [2265257,130995] 0 2023-12-05T09:57:31.443 INFO:tasks.workunit.client.1.smithi150.stdout:3/467: mknod d6/d9/d43/d47/d8c/c92 0 2023-12-05T09:57:31.444 INFO:tasks.workunit.client.0.smithi100.stdout:2/589: truncate d7/da/d18/d21/fa4 919250 0 2023-12-05T09:57:31.446 INFO:tasks.workunit.client.0.smithi100.stdout:7/419: mknod d3/dc/d11/d33/c93 0 2023-12-05T09:57:31.447 INFO:tasks.workunit.client.1.smithi150.stdout:5/448: creat d1/d3/d6/d1b/fa7 x:0 0 0 2023-12-05T09:57:31.448 INFO:tasks.workunit.client.0.smithi100.stdout:3/533: dwrite d0/d2/de/d12/f29 [4194304,4194304] 0 2023-12-05T09:57:31.450 INFO:tasks.workunit.client.1.smithi150.stdout:0/496: dwrite d5/d11/d71/d99/d9c/d46/f89 [0,4194304] 0 2023-12-05T09:57:31.450 INFO:tasks.workunit.client.1.smithi150.stdout:0/497: creat d5/d11/d32/d57/faf x:0 0 0 2023-12-05T09:57:31.450 INFO:tasks.workunit.client.1.smithi150.stdout:0/498: chown d5/d11/d16/d1f/f44 194589 1 2023-12-05T09:57:31.450 INFO:tasks.workunit.client.1.smithi150.stdout:0/499: chown d5/d11/d16/d1f/fa0 9317802 1 2023-12-05T09:57:31.450 INFO:tasks.workunit.client.1.smithi150.stdout:0/500: fdatasync d5/d11/d16/fa3 0 2023-12-05T09:57:31.450 INFO:tasks.workunit.client.1.smithi150.stdout:2/472: dread d0/d3/d5/d10/f45 [0,4194304] 0 2023-12-05T09:57:31.451 INFO:tasks.workunit.client.1.smithi150.stdout:1/451: dwrite d6/fa0 [0,4194304] 0 2023-12-05T09:57:31.451 INFO:tasks.workunit.client.1.smithi150.stdout:2/473: chown d0/d3/d5/d10/c9f 84 1 2023-12-05T09:57:31.453 INFO:tasks.workunit.client.1.smithi150.stdout:7/472: creat d2/d1b/d5b/f9c x:0 0 0 2023-12-05T09:57:31.455 INFO:tasks.workunit.client.0.smithi100.stdout:7/420: creat d3/dc/d11/d13/de/d18/d3b/d40/d46/f94 x:0 0 0 2023-12-05T09:57:31.457 INFO:tasks.workunit.client.1.smithi150.stdout:3/468: symlink d6/d9/d43/d47/d8c/l93 0 2023-12-05T09:57:31.457 INFO:tasks.workunit.client.1.smithi150.stdout:3/469: fsync d6/f80 0 2023-12-05T09:57:31.457 INFO:tasks.workunit.client.1.smithi150.stdout:3/470: write d6/d25/d28/d67/f7a [963030,14609] 0 2023-12-05T09:57:31.458 INFO:tasks.workunit.client.1.smithi150.stdout:3/471: read - d6/d9/d3d/d56/d79/f7f zero size 2023-12-05T09:57:31.460 INFO:tasks.workunit.client.1.smithi150.stdout:4/400: rmdir d0/d42/d44 39 2023-12-05T09:57:31.460 INFO:tasks.workunit.client.0.smithi100.stdout:3/534: mkdir d0/d2/de/db8 0 2023-12-05T09:57:31.461 INFO:tasks.workunit.client.0.smithi100.stdout:3/535: write d0/d2/f23 [1796271,114687] 0 2023-12-05T09:57:31.463 INFO:tasks.workunit.client.1.smithi150.stdout:8/457: dread d0/d41/f71 [0,4194304] 0 2023-12-05T09:57:31.464 INFO:tasks.workunit.client.1.smithi150.stdout:1/452: dread d6/d8/d59/f78 [0,4194304] 0 2023-12-05T09:57:31.467 INFO:tasks.workunit.client.0.smithi100.stdout:0/424: getdents da/d22/d33/d35 0 2023-12-05T09:57:31.467 INFO:tasks.workunit.client.0.smithi100.stdout:0/425: chown da/d22/l5c 23 1 2023-12-05T09:57:31.467 INFO:tasks.workunit.client.0.smithi100.stdout:2/590: mknod d7/db4/cc9 0 2023-12-05T09:57:31.467 INFO:tasks.workunit.client.0.smithi100.stdout:2/591: fdatasync d7/da/d18/d1b/d2c/f49 0 2023-12-05T09:57:31.468 INFO:tasks.workunit.client.0.smithi100.stdout:3/536: unlink d0/d10/l52 0 2023-12-05T09:57:31.470 INFO:tasks.workunit.client.1.smithi150.stdout:5/449: dread d1/d7f/d65/f63 [0,4194304] 0 2023-12-05T09:57:31.470 INFO:tasks.workunit.client.1.smithi150.stdout:5/450: chown d1/d2e/da6/f32 2108356511 1 2023-12-05T09:57:31.470 INFO:tasks.workunit.client.1.smithi150.stdout:5/451: stat d1/d2e/da6/l56 0 2023-12-05T09:57:31.473 INFO:tasks.workunit.client.0.smithi100.stdout:2/592: creat d7/da/d18/d21/d86/fca x:0 0 0 2023-12-05T09:57:31.473 INFO:tasks.workunit.client.0.smithi100.stdout:2/593: chown d7/da/d18/d1b/d2c/d3f/fc0 93601330 1 2023-12-05T09:57:31.473 INFO:tasks.workunit.client.0.smithi100.stdout:2/594: fdatasync d7/da/d18/d1b/d2c/d3f/faa 0 2023-12-05T09:57:31.478 INFO:tasks.workunit.client.1.smithi150.stdout:7/473: dread d2/d4/f6d [0,4194304] 0 2023-12-05T09:57:31.480 INFO:tasks.workunit.client.0.smithi100.stdout:3/537: mknod d0/d3d/d5c/d5f/cb9 0 2023-12-05T09:57:31.480 INFO:tasks.workunit.client.0.smithi100.stdout:4/396: dwrite f9 [0,4194304] 0 2023-12-05T09:57:31.480 INFO:tasks.workunit.client.0.smithi100.stdout:7/421: dread d3/dc/d11/d13/de/d2d/f6d [0,4194304] 0 2023-12-05T09:57:31.481 INFO:tasks.workunit.client.0.smithi100.stdout:7/422: creat d3/dc/d11/d13/de/d18/d3b/d40/d46/f95 x:0 0 0 2023-12-05T09:57:31.481 INFO:tasks.workunit.client.0.smithi100.stdout:7/423: truncate d3/dc/d11/d13/de/d18/d3b/d40/d46/f5c 5477302 0 2023-12-05T09:57:31.485 INFO:tasks.workunit.client.0.smithi100.stdout:2/595: symlink d7/da/d18/d1b/d2c/lcb 0 2023-12-05T09:57:31.485 INFO:tasks.workunit.client.0.smithi100.stdout:3/538: dread d0/d10/d39/f55 [0,4194304] 0 2023-12-05T09:57:31.485 INFO:tasks.workunit.client.0.smithi100.stdout:3/539: chown d0/d4/f14 303 1 2023-12-05T09:57:31.489 INFO:tasks.workunit.client.1.smithi150.stdout:0/501: stat d5/c4f 0 2023-12-05T09:57:31.489 INFO:tasks.workunit.client.1.smithi150.stdout:0/502: write d5/d11/d71/d99/d9c/d46/d80/f86 [5449977,61726] 0 2023-12-05T09:57:31.492 INFO:tasks.workunit.client.1.smithi150.stdout:2/474: unlink d0/d3/d5/d13/d15/d30/d54/d57/fa5 0 2023-12-05T09:57:31.492 INFO:tasks.workunit.client.0.smithi100.stdout:0/426: dread da/d1b/d36/f48 [0,4194304] 0 2023-12-05T09:57:31.492 INFO:tasks.workunit.client.0.smithi100.stdout:0/427: chown da/d22/d33/f6a 1435 1 2023-12-05T09:57:31.493 INFO:tasks.workunit.client.0.smithi100.stdout:0/428: chown da/d1b 5 1 2023-12-05T09:57:31.496 INFO:tasks.workunit.client.1.smithi150.stdout:3/472: mkdir d6/d9/d43/d47/d94 0 2023-12-05T09:57:31.497 INFO:tasks.workunit.client.0.smithi100.stdout:7/424: truncate d3/f24 543804 0 2023-12-05T09:57:31.502 INFO:tasks.workunit.client.0.smithi100.stdout:4/397: write de/f55 [2941602,22143] 0 2023-12-05T09:57:31.502 INFO:tasks.workunit.client.0.smithi100.stdout:4/398: stat de/f14 0 2023-12-05T09:57:31.502 INFO:tasks.workunit.client.0.smithi100.stdout:4/399: write de/d66/f6c [807929,122660] 0 2023-12-05T09:57:31.502 INFO:tasks.workunit.client.0.smithi100.stdout:4/400: chown de/d16/d23/d33/d3d/l4f 75768 1 2023-12-05T09:57:31.544 INFO:tasks.workunit.client.1.smithi150.stdout:1/453: mknod d6/d47/d4c/d60/ca7 0 2023-12-05T09:57:31.545 INFO:tasks.workunit.client.1.smithi150.stdout:1/454: write d6/d8/db/f19 [543223,38801] 0 2023-12-05T09:57:31.550 INFO:tasks.workunit.client.1.smithi150.stdout:5/452: creat d1/d7f/d65/d3b/d8d/fa8 x:0 0 0 2023-12-05T09:57:31.550 INFO:tasks.workunit.client.1.smithi150.stdout:7/474: write d2/db/d30/d18/f57 [3660448,14976] 0 2023-12-05T09:57:31.551 INFO:tasks.workunit.client.0.smithi100.stdout:2/596: creat d7/da/d13/d69/d6e/fcc x:0 0 0 2023-12-05T09:57:31.552 INFO:tasks.workunit.client.0.smithi100.stdout:2/597: chown d7/da/d13/d69/d6e 1155699766 1 2023-12-05T09:57:31.552 INFO:tasks.workunit.client.0.smithi100.stdout:2/598: readlink d7/db4/lc3 0 2023-12-05T09:57:31.552 INFO:tasks.workunit.client.0.smithi100.stdout:2/599: read - d7/da/d13/d69/fba zero size 2023-12-05T09:57:31.552 INFO:tasks.workunit.client.0.smithi100.stdout:1/437: dwrite db/d12/d1e/d26/f68 [0,4194304] 0 2023-12-05T09:57:31.552 INFO:tasks.workunit.client.0.smithi100.stdout:2/600: write d7/da/d1a/f1c [9067163,120764] 0 2023-12-05T09:57:31.555 INFO:tasks.workunit.client.0.smithi100.stdout:3/540: creat d0/d2/de/d11/db5/fba x:0 0 0 2023-12-05T09:57:31.560 INFO:tasks.workunit.client.1.smithi150.stdout:9/405: sync 2023-12-05T09:57:31.560 INFO:tasks.workunit.client.1.smithi150.stdout:6/392: sync 2023-12-05T09:57:31.560 INFO:tasks.workunit.client.1.smithi150.stdout:0/503: unlink d5/d11/d16/d1f/c7d 0 2023-12-05T09:57:31.563 INFO:tasks.workunit.client.1.smithi150.stdout:3/473: unlink d6/d9/d3d/d52/l58 0 2023-12-05T09:57:31.563 INFO:tasks.workunit.client.1.smithi150.stdout:4/401: dwrite d0/d42/f4c [0,4194304] 0 2023-12-05T09:57:31.564 INFO:tasks.workunit.client.1.smithi150.stdout:1/455: mkdir d6/d3c/da8 0 2023-12-05T09:57:31.565 INFO:tasks.workunit.client.1.smithi150.stdout:5/453: symlink d1/d2e/da6/la9 0 2023-12-05T09:57:31.565 INFO:tasks.workunit.client.1.smithi150.stdout:5/454: read - d1/d7f/fa5 zero size 2023-12-05T09:57:31.566 INFO:tasks.workunit.client.1.smithi150.stdout:8/458: dwrite d0/d41/d49/d1b/d24/d38/f6a [0,4194304] 0 2023-12-05T09:57:31.567 INFO:tasks.workunit.client.1.smithi150.stdout:7/475: mkdir d2/d9d 0 2023-12-05T09:57:31.568 INFO:tasks.workunit.client.1.smithi150.stdout:7/476: write d2/db/d30/d13/f14 [1173825,92396] 0 2023-12-05T09:57:31.569 INFO:tasks.workunit.client.1.smithi150.stdout:2/475: dwrite d0/d3/f99 [0,4194304] 0 2023-12-05T09:57:31.569 INFO:tasks.workunit.client.1.smithi150.stdout:2/476: chown d0/d3/d5/d10/d3d/d41/f7b 176426 1 2023-12-05T09:57:31.574 INFO:tasks.workunit.client.0.smithi100.stdout:4/401: dwrite de/f12 [4194304,4194304] 0 2023-12-05T09:57:31.574 INFO:tasks.workunit.client.0.smithi100.stdout:4/402: chown de/d16/d23/d33/d3d/d44/l70 446479 1 2023-12-05T09:57:31.574 INFO:tasks.workunit.client.0.smithi100.stdout:4/403: fsync de/d66/f75 0 2023-12-05T09:57:31.574 INFO:tasks.workunit.client.0.smithi100.stdout:4/404: fsync f2 0 2023-12-05T09:57:31.574 INFO:tasks.workunit.client.0.smithi100.stdout:4/405: chown de/d16/d23/f29 19 1 2023-12-05T09:57:31.576 INFO:tasks.workunit.client.1.smithi150.stdout:9/406: symlink d3/d9/d26/l7b 0 2023-12-05T09:57:31.580 INFO:tasks.workunit.client.0.smithi100.stdout:0/429: mkdir da/d1b/d73/d82 0 2023-12-05T09:57:31.581 INFO:tasks.workunit.client.1.smithi150.stdout:6/393: creat d2/d23/d2e/f85 x:0 0 0 2023-12-05T09:57:31.581 INFO:tasks.workunit.client.1.smithi150.stdout:6/394: creat d2/d23/d3b/d64/d7a/d5d/f86 x:0 0 0 2023-12-05T09:57:31.582 INFO:tasks.workunit.client.1.smithi150.stdout:6/395: truncate d2/d23/d2e/f4f 940831 0 2023-12-05T09:57:31.582 INFO:tasks.workunit.client.1.smithi150.stdout:6/396: readlink d2/d23/l25 0 2023-12-05T09:57:31.582 INFO:tasks.workunit.client.1.smithi150.stdout:6/397: chown d2/d23/d3b/d64/d7a/d5d/d6b/c70 3121 1 2023-12-05T09:57:31.582 INFO:tasks.workunit.client.1.smithi150.stdout:6/398: chown d2/d23/f7e 2 1 2023-12-05T09:57:31.584 INFO:tasks.workunit.client.0.smithi100.stdout:7/425: creat d3/dc/d11/d13/de/d2d/f96 x:0 0 0 2023-12-05T09:57:31.585 INFO:tasks.workunit.client.1.smithi150.stdout:0/504: mknod d5/d11/d71/d99/cb0 0 2023-12-05T09:57:31.586 INFO:tasks.workunit.client.1.smithi150.stdout:0/505: readlink d5/d11/d32/l7a 0 2023-12-05T09:57:31.587 INFO:tasks.workunit.client.1.smithi150.stdout:3/474: write d6/d9/f1d [1719532,107500] 0 2023-12-05T09:57:31.595 INFO:tasks.workunit.client.1.smithi150.stdout:1/456: link d6/d8/d59/f7d d6/d3c/fa9 0 2023-12-05T09:57:31.596 INFO:tasks.workunit.client.1.smithi150.stdout:5/455: mknod d1/d2e/caa 0 2023-12-05T09:57:31.596 INFO:tasks.workunit.client.1.smithi150.stdout:8/459: write d0/d41/d49/d1b/d24/d38/d62/f75 [161533,37100] 0 2023-12-05T09:57:31.600 INFO:tasks.workunit.client.0.smithi100.stdout:2/601: unlink d7/da/d18/d21/d86/c9b 0 2023-12-05T09:57:31.604 INFO:tasks.workunit.client.0.smithi100.stdout:3/541: mknod d0/d4/d3a/d45/cbb 0 2023-12-05T09:57:31.610 INFO:tasks.workunit.client.1.smithi150.stdout:9/407: creat d3/d1b/d46/d55/d64/f7c x:0 0 0 2023-12-05T09:57:31.612 INFO:tasks.workunit.client.0.smithi100.stdout:4/406: mknod de/d16/c7b 0 2023-12-05T09:57:31.612 INFO:tasks.workunit.client.0.smithi100.stdout:4/407: creat de/d16/d1e/f7c x:0 0 0 2023-12-05T09:57:31.615 INFO:tasks.workunit.client.0.smithi100.stdout:0/430: rename da/f72 to da/d22/d33/d35/d3a/f83 0 2023-12-05T09:57:31.615 INFO:tasks.workunit.client.0.smithi100.stdout:0/431: fsync da/f2d 0 2023-12-05T09:57:31.620 INFO:tasks.workunit.client.0.smithi100.stdout:2/602: creat d7/da/d18/d21/dae/fcd x:0 0 0 2023-12-05T09:57:31.624 INFO:tasks.workunit.client.0.smithi100.stdout:1/438: dwrite db/d12/d1e/f41 [0,4194304] 0 2023-12-05T09:57:31.625 INFO:tasks.workunit.client.1.smithi150.stdout:4/402: dwrite d0/d42/f4c [0,4194304] 0 2023-12-05T09:57:31.625 INFO:tasks.workunit.client.1.smithi150.stdout:6/399: write d2/d23/d3b/d46/f68 [3482021,21292] 0 2023-12-05T09:57:31.625 INFO:tasks.workunit.client.1.smithi150.stdout:7/477: dwrite d2/d1b/d5b/f9c [0,4194304] 0 2023-12-05T09:57:31.625 INFO:tasks.workunit.client.1.smithi150.stdout:6/400: creat d2/d23/d2e/d5f/f87 x:0 0 0 2023-12-05T09:57:31.626 INFO:tasks.workunit.client.1.smithi150.stdout:6/401: chown d2/d23/d3b/d83/l79 331063871 1 2023-12-05T09:57:31.627 INFO:tasks.workunit.client.0.smithi100.stdout:3/542: write d0/d3d/d5c/d5f/d67/f69 [6433897,111887] 0 2023-12-05T09:57:31.627 INFO:tasks.workunit.client.0.smithi100.stdout:3/543: write d0/d2/de/d12/f63 [8805435,54599] 0 2023-12-05T09:57:31.627 INFO:tasks.workunit.client.0.smithi100.stdout:3/544: truncate d0/d10/f71 376195 0 2023-12-05T09:57:31.631 INFO:tasks.workunit.client.0.smithi100.stdout:3/545: rename d0/d48/l6b to d0/d3d/lbc 0 2023-12-05T09:57:31.637 INFO:tasks.workunit.client.1.smithi150.stdout:8/460: link d0/d41/d49/c46 d0/d41/d49/d1b/d24/d34/c94 0 2023-12-05T09:57:31.637 INFO:tasks.workunit.client.1.smithi150.stdout:3/475: creat d6/d9/d3d/d8a/f95 x:0 0 0 2023-12-05T09:57:31.637 INFO:tasks.workunit.client.1.smithi150.stdout:2/477: rmdir d0/d3/d5/d36 39 2023-12-05T09:57:31.637 INFO:tasks.workunit.client.1.smithi150.stdout:9/408: link d3/d9/c13 d3/d9/dc/c7d 0 2023-12-05T09:57:31.637 INFO:tasks.workunit.client.1.smithi150.stdout:3/476: creat d6/d25/d28/f96 x:0 0 0 2023-12-05T09:57:31.637 INFO:tasks.workunit.client.1.smithi150.stdout:9/409: write d3/f2e [2565528,106235] 0 2023-12-05T09:57:31.638 INFO:tasks.workunit.client.1.smithi150.stdout:9/410: chown d3/d1b/d46/f50 31344700 1 2023-12-05T09:57:31.638 INFO:tasks.workunit.client.1.smithi150.stdout:5/456: dread d1/f55 [4194304,4194304] 0 2023-12-05T09:57:31.638 INFO:tasks.workunit.client.1.smithi150.stdout:5/457: truncate d1/d2e/f90 515697 0 2023-12-05T09:57:31.638 INFO:tasks.workunit.client.0.smithi100.stdout:3/546: rename d0/d2/de/c42 to d0/d10/d39/cbd 0 2023-12-05T09:57:31.639 INFO:tasks.workunit.client.0.smithi100.stdout:4/408: dread de/d38/f42 [0,4194304] 0 2023-12-05T09:57:31.639 INFO:tasks.workunit.client.0.smithi100.stdout:3/547: rename d0/d10/f77 to d0/d2/de/d8d/fbe 0 2023-12-05T09:57:31.639 INFO:tasks.workunit.client.0.smithi100.stdout:3/548: fsync d0/f3b 0 2023-12-05T09:57:31.639 INFO:tasks.workunit.client.0.smithi100.stdout:3/549: read - d0/d3d/d5c/d6f/d7f/d87/f9a zero size 2023-12-05T09:57:31.642 INFO:tasks.workunit.client.0.smithi100.stdout:4/409: mkdir de/d16/d23/d36/d7d 0 2023-12-05T09:57:31.642 INFO:tasks.workunit.client.0.smithi100.stdout:4/410: dread - de/f73 zero size 2023-12-05T09:57:31.642 INFO:tasks.workunit.client.0.smithi100.stdout:4/411: write de/d16/d23/d36/f3e [1815090,58712] 0 2023-12-05T09:57:31.642 INFO:tasks.workunit.client.0.smithi100.stdout:4/412: chown de/d16/d23/d36/f7a 8586739 1 2023-12-05T09:57:31.642 INFO:tasks.workunit.client.0.smithi100.stdout:4/413: write de/d16/f2f [4966567,118334] 0 2023-12-05T09:57:31.643 INFO:tasks.workunit.client.1.smithi150.stdout:4/403: unlink d0/d42/d44/l5a 0 2023-12-05T09:57:31.645 INFO:tasks.workunit.client.0.smithi100.stdout:3/550: unlink d0/d3d/d5c/d6f/d7f/d87/l9f 0 2023-12-05T09:57:31.648 INFO:tasks.workunit.client.1.smithi150.stdout:7/478: rmdir d2/d1b/d5b/d6a 39 2023-12-05T09:57:31.648 INFO:tasks.workunit.client.0.smithi100.stdout:7/426: dwrite d3/dc/d11/d13/de/d2d/f96 [0,4194304] 0 2023-12-05T09:57:31.649 INFO:tasks.workunit.client.0.smithi100.stdout:4/414: symlink de/d16/d23/l7e 0 2023-12-05T09:57:31.651 INFO:tasks.workunit.client.1.smithi150.stdout:6/402: truncate d2/f1c 1773522 0 2023-12-05T09:57:31.651 INFO:tasks.workunit.client.1.smithi150.stdout:6/403: write d2/d23/d2e/f3c [4788050,33624] 0 2023-12-05T09:57:31.656 INFO:tasks.workunit.client.1.smithi150.stdout:2/478: mknod d0/d3/ca9 0 2023-12-05T09:57:31.658 INFO:tasks.workunit.client.1.smithi150.stdout:2/479: write d0/d3/d5/d22/f82 [5696,59107] 0 2023-12-05T09:57:31.658 INFO:tasks.workunit.client.0.smithi100.stdout:7/427: mkdir d3/dc/d11/d13/d37/d97 0 2023-12-05T09:57:31.658 INFO:tasks.workunit.client.0.smithi100.stdout:7/428: creat d3/dc/d11/d13/de/d18/d3b/d40/d4c/d7f/f98 x:0 0 0 2023-12-05T09:57:31.658 INFO:tasks.workunit.client.0.smithi100.stdout:7/429: write d3/dc/d11/d33/f7b [3685458,43067] 0 2023-12-05T09:57:31.659 INFO:tasks.workunit.client.0.smithi100.stdout:7/430: creat d3/dc/d11/d13/de/f99 x:0 0 0 2023-12-05T09:57:31.659 INFO:tasks.workunit.client.0.smithi100.stdout:7/431: fdatasync d3/dc/d11/d13/de/d18/d3b/d40/d46/f95 0 2023-12-05T09:57:31.661 INFO:tasks.workunit.client.0.smithi100.stdout:4/415: unlink de/d16/d23/d33/d3d/f5a 0 2023-12-05T09:57:31.664 INFO:tasks.workunit.client.1.smithi150.stdout:5/458: mkdir d1/d7f/d65/dab 0 2023-12-05T09:57:31.664 INFO:tasks.workunit.client.1.smithi150.stdout:5/459: creat d1/d2e/fac x:0 0 0 2023-12-05T09:57:31.664 INFO:tasks.workunit.client.0.smithi100.stdout:3/551: getdents d0/d2/d33 0 2023-12-05T09:57:31.665 INFO:tasks.workunit.client.0.smithi100.stdout:3/552: truncate d0/d3d/d5c/d6f/f84 690374 0 2023-12-05T09:57:31.667 INFO:tasks.workunit.client.1.smithi150.stdout:4/404: dread d0/fc [0,4194304] 0 2023-12-05T09:57:31.671 INFO:tasks.workunit.client.1.smithi150.stdout:8/461: dread d0/d8/f11 [0,4194304] 0 2023-12-05T09:57:31.671 INFO:tasks.workunit.client.0.smithi100.stdout:2/603: dwrite d7/da/dc/f56 [0,4194304] 0 2023-12-05T09:57:31.671 INFO:tasks.workunit.client.1.smithi150.stdout:7/479: symlink d2/d1b/l9e 0 2023-12-05T09:57:31.671 INFO:tasks.workunit.client.1.smithi150.stdout:7/480: truncate d2/db/d2e/d71/f8f 154217 0 2023-12-05T09:57:31.672 INFO:tasks.workunit.client.1.smithi150.stdout:6/404: dread d2/d23/d3b/d64/d7a/d5d/d6b/f10 [0,4194304] 0 2023-12-05T09:57:31.672 INFO:tasks.workunit.client.1.smithi150.stdout:6/405: chown d2/d23/d3b/d46/f68 31972 1 2023-12-05T09:57:31.674 INFO:tasks.workunit.client.0.smithi100.stdout:3/553: fsync d0/d3d/d5c/d5f/d67/f69 0 2023-12-05T09:57:31.674 INFO:tasks.workunit.client.0.smithi100.stdout:7/432: mknod d3/dc/d11/d13/de/d2d/d42/c9a 0 2023-12-05T09:57:31.675 INFO:tasks.workunit.client.1.smithi150.stdout:2/480: mkdir d0/d3/d5/d10/d3d/da1/daa 0 2023-12-05T09:57:31.675 INFO:tasks.workunit.client.1.smithi150.stdout:2/481: creat d0/d3/d5/d13/d15/d30/d54/d57/fab x:0 0 0 2023-12-05T09:57:31.675 INFO:tasks.workunit.client.1.smithi150.stdout:2/482: fsync d0/d3/d11/f18 0 2023-12-05T09:57:31.675 INFO:tasks.workunit.client.0.smithi100.stdout:4/416: mknod de/d38/c7f 0 2023-12-05T09:57:31.676 INFO:tasks.workunit.client.1.smithi150.stdout:8/462: write d0/d41/d49/f52 [687988,113446] 0 2023-12-05T09:57:31.681 INFO:tasks.workunit.client.0.smithi100.stdout:2/604: rename d7/da/d1a/f38 to d7/da/d18/fce 0 2023-12-05T09:57:31.682 INFO:tasks.workunit.client.1.smithi150.stdout:1/457: dwrite d6/d8/db/de/f77 [0,4194304] 0 2023-12-05T09:57:31.684 INFO:tasks.workunit.client.0.smithi100.stdout:3/554: truncate d0/d4/f1e 3351620 0 2023-12-05T09:57:31.687 INFO:tasks.workunit.client.0.smithi100.stdout:7/433: creat d3/dc/d11/d13/de/d18/f9b x:0 0 0 2023-12-05T09:57:31.687 INFO:tasks.workunit.client.0.smithi100.stdout:7/434: chown d3/dc/d11/d13/de/c2a 184264370 1 2023-12-05T09:57:31.688 INFO:tasks.workunit.client.1.smithi150.stdout:9/411: link d3/d1b/d46/d55/d64/f7c d3/d9/d58/f7e 0 2023-12-05T09:57:31.688 INFO:tasks.workunit.client.0.smithi100.stdout:2/605: getdents d7/da/d13 0 2023-12-05T09:57:31.690 INFO:tasks.workunit.client.1.smithi150.stdout:4/405: symlink d0/d3e/l77 0 2023-12-05T09:57:31.690 INFO:tasks.workunit.client.1.smithi150.stdout:4/406: creat d0/d3e/f78 x:0 0 0 2023-12-05T09:57:31.690 INFO:tasks.workunit.client.1.smithi150.stdout:4/407: creat d0/d3e/f79 x:0 0 0 2023-12-05T09:57:31.696 INFO:tasks.workunit.client.1.smithi150.stdout:5/460: write d1/d3/f7 [3377765,129496] 0 2023-12-05T09:57:31.697 INFO:tasks.workunit.client.1.smithi150.stdout:5/461: write d1/d7f/d65/d3b/d37/f48 [1894708,106524] 0 2023-12-05T09:57:31.697 INFO:tasks.workunit.client.1.smithi150.stdout:5/462: fsync d1/d7f/d65/f63 0 2023-12-05T09:57:31.699 INFO:tasks.workunit.client.1.smithi150.stdout:8/463: creat d0/d41/d49/d1b/d24/d2e/f95 x:0 0 0 2023-12-05T09:57:31.699 INFO:tasks.workunit.client.1.smithi150.stdout:8/464: write d0/d41/d49/d1b/f2f [7866053,105134] 0 2023-12-05T09:57:31.699 INFO:tasks.workunit.client.1.smithi150.stdout:8/465: chown d0/d41/d49/d1b/d24/d34/d56/d67/l91 0 1 2023-12-05T09:57:31.699 INFO:tasks.workunit.client.1.smithi150.stdout:8/466: stat d0/d41/d49/d1b 0 2023-12-05T09:57:31.699 INFO:tasks.workunit.client.1.smithi150.stdout:8/467: chown d0/d41/d49/d1b 3840 1 2023-12-05T09:57:31.699 INFO:tasks.workunit.client.1.smithi150.stdout:2/483: truncate d0/f7 1415885 0 2023-12-05T09:57:31.699 INFO:tasks.workunit.client.1.smithi150.stdout:8/468: write d0/d41/d49/d1b/d24/d38/d62/f8c [284908,101741] 0 2023-12-05T09:57:31.704 INFO:tasks.workunit.client.0.smithi100.stdout:7/435: link d3/dc/d11/d13/de/d2d/d47/f72 d3/dc/d11/d13/de/d18/d3b/f9c 0 2023-12-05T09:57:31.710 INFO:tasks.workunit.client.1.smithi150.stdout:9/412: mknod d3/d1b/d46/d55/c7f 0 2023-12-05T09:57:31.711 INFO:tasks.workunit.client.1.smithi150.stdout:1/458: dread d6/d38/d4a/f8e [0,4194304] 0 2023-12-05T09:57:31.711 INFO:tasks.workunit.client.1.smithi150.stdout:1/459: stat d6/d8/d54/d94/f96 0 2023-12-05T09:57:31.711 INFO:tasks.workunit.client.1.smithi150.stdout:1/460: write d6/d8/f11 [462719,31743] 0 2023-12-05T09:57:31.711 INFO:tasks.workunit.client.1.smithi150.stdout:1/461: fdatasync f1 0 2023-12-05T09:57:31.711 INFO:tasks.workunit.client.1.smithi150.stdout:1/462: creat d6/d47/d4c/faa x:0 0 0 2023-12-05T09:57:31.718 INFO:tasks.workunit.client.1.smithi150.stdout:6/406: dwrite d2/d23/f3f [0,4194304] 0 2023-12-05T09:57:31.718 INFO:tasks.workunit.client.1.smithi150.stdout:2/484: write d0/d3/d5/d10/d3d/d41/f7b [2881141,123817] 0 2023-12-05T09:57:31.719 INFO:tasks.workunit.client.1.smithi150.stdout:4/408: symlink d0/d42/d44/l7a 0 2023-12-05T09:57:31.719 INFO:tasks.workunit.client.0.smithi100.stdout:3/555: rmdir d0/d3d/d5c/d6f/d7f/d87 39 2023-12-05T09:57:31.720 INFO:tasks.workunit.client.1.smithi150.stdout:5/463: dread d1/d3/d6/f3f [0,4194304] 0 2023-12-05T09:57:31.720 INFO:tasks.workunit.client.1.smithi150.stdout:5/464: creat d1/d3/d6/d72/fad x:0 0 0 2023-12-05T09:57:31.723 INFO:tasks.workunit.client.1.smithi150.stdout:1/463: read d6/d8/db/de/f13 [6574070,39365] 0 2023-12-05T09:57:31.724 INFO:tasks.workunit.client.1.smithi150.stdout:7/481: dwrite d2/db/d30/d18/d63/f7b [0,4194304] 0 2023-12-05T09:57:31.724 INFO:tasks.workunit.client.1.smithi150.stdout:7/482: write d2/d39/f64 [758381,29879] 0 2023-12-05T09:57:31.728 INFO:tasks.workunit.client.0.smithi100.stdout:3/556: symlink d0/d3d/d5c/d5f/d67/da4/lbf 0 2023-12-05T09:57:31.728 INFO:tasks.workunit.client.0.smithi100.stdout:3/557: creat d0/d2/de/d11/fc0 x:0 0 0 2023-12-05T09:57:31.736 INFO:tasks.workunit.client.1.smithi150.stdout:6/407: getdents d2/d23/d3b/d64 0 2023-12-05T09:57:31.743 INFO:tasks.workunit.client.1.smithi150.stdout:8/469: rmdir d0/d41/d49/d1b/d24/d34/d56 39 2023-12-05T09:57:31.744 INFO:tasks.workunit.client.1.smithi150.stdout:8/470: write d0/d41/d49/d1b/d24/d34/d56/d67/d64/f7e [1019288,47584] 0 2023-12-05T09:57:31.744 INFO:tasks.workunit.client.1.smithi150.stdout:8/471: write d0/d41/d49/d1b/f1c [3513280,66453] 0 2023-12-05T09:57:31.744 INFO:tasks.workunit.client.1.smithi150.stdout:8/472: fsync d0/d8/f11 0 2023-12-05T09:57:31.744 INFO:tasks.workunit.client.1.smithi150.stdout:8/473: dread - d0/d41/d49/d1b/d24/d2e/f53 zero size 2023-12-05T09:57:31.744 INFO:tasks.workunit.client.1.smithi150.stdout:8/474: fsync d0/d41/d49/d1b/d24/d2e/f95 0 2023-12-05T09:57:31.744 INFO:tasks.workunit.client.1.smithi150.stdout:5/465: mknod d1/d3/d6/d1b/cae 0 2023-12-05T09:57:31.750 INFO:tasks.workunit.client.0.smithi100.stdout:3/558: write d0/d2/f6e [1929746,45808] 0 2023-12-05T09:57:31.751 INFO:tasks.workunit.client.0.smithi100.stdout:7/436: dwrite d3/dc/d11/d13/de/f87 [0,4194304] 0 2023-12-05T09:57:31.751 INFO:tasks.workunit.client.1.smithi150.stdout:4/409: dwrite d0/f61 [0,4194304] 0 2023-12-05T09:57:31.761 INFO:tasks.workunit.client.0.smithi100.stdout:7/437: mknod d3/dc/d11/d13/d1b/d60/c9d 0 2023-12-05T09:57:31.762 INFO:tasks.workunit.client.0.smithi100.stdout:7/438: chown d3/dc/d11/d13/de/d18/d3b/d40/d46/f85 11818 1 2023-12-05T09:57:31.763 INFO:tasks.workunit.client.1.smithi150.stdout:9/413: rmdir d3/d1b 39 2023-12-05T09:57:31.765 INFO:tasks.workunit.client.0.smithi100.stdout:7/439: mkdir d3/dc/d11/d13/de/d18/d3b/d40/d46/d9e 0 2023-12-05T09:57:31.766 INFO:tasks.workunit.client.1.smithi150.stdout:1/464: getdents d6/d47/d4c/d7c 0 2023-12-05T09:57:31.768 INFO:tasks.workunit.client.1.smithi150.stdout:7/483: symlink d2/db/d17/d38/l9f 0 2023-12-05T09:57:31.769 INFO:tasks.workunit.client.0.smithi100.stdout:3/559: write d0/fa7 [1584220,112393] 0 2023-12-05T09:57:31.770 INFO:tasks.workunit.client.0.smithi100.stdout:7/440: mknod d3/dc/d11/d13/d37/c9f 0 2023-12-05T09:57:31.771 INFO:tasks.workunit.client.1.smithi150.stdout:6/408: rmdir d2/d23/d3b/d64 39 2023-12-05T09:57:31.774 INFO:tasks.workunit.client.1.smithi150.stdout:9/414: dread d3/d9/f20 [0,4194304] 0 2023-12-05T09:57:31.774 INFO:tasks.workunit.client.0.smithi100.stdout:3/560: getdents d0/d3d/d5c/d5f/d67 0 2023-12-05T09:57:31.774 INFO:tasks.workunit.client.0.smithi100.stdout:7/441: truncate d3/dc/d11/d13/de/f2b 2811216 0 2023-12-05T09:57:31.779 INFO:tasks.workunit.client.0.smithi100.stdout:3/561: creat d0/d2/de/d8d/fc1 x:0 0 0 2023-12-05T09:57:31.779 INFO:tasks.workunit.client.0.smithi100.stdout:3/562: write d0/d2/de/d11/fc0 [677847,130862] 0 2023-12-05T09:57:31.779 INFO:tasks.workunit.client.0.smithi100.stdout:7/442: mknod d3/dc/d11/d13/de/d18/d3b/d40/d4c/d7f/ca0 0 2023-12-05T09:57:31.781 INFO:tasks.workunit.client.0.smithi100.stdout:3/563: rename d0/d3d/d5c/d5f/cb9 to d0/d3d/d5c/d5f/d67/cc2 0 2023-12-05T09:57:31.782 INFO:tasks.workunit.client.1.smithi150.stdout:1/465: link d6/d8/db/f20 d6/d47/d4c/d7c/fab 0 2023-12-05T09:57:31.784 INFO:tasks.workunit.client.0.smithi100.stdout:7/443: link d3/dc/d11/d13/de/d18/c54 d3/dc/d11/d13/de/ca1 0 2023-12-05T09:57:31.785 INFO:tasks.workunit.client.1.smithi150.stdout:7/484: mkdir d2/d9d/da0 0 2023-12-05T09:57:31.787 INFO:tasks.workunit.client.1.smithi150.stdout:6/409: creat d2/d23/d3b/d64/f88 x:0 0 0 2023-12-05T09:57:31.788 INFO:tasks.workunit.client.1.smithi150.stdout:5/466: dwrite d1/d7f/d65/d3b/d37/f48 [0,4194304] 0 2023-12-05T09:57:31.789 INFO:tasks.workunit.client.0.smithi100.stdout:7/444: mknod d3/dc/d11/d13/de/ca2 0 2023-12-05T09:57:31.791 INFO:tasks.workunit.client.1.smithi150.stdout:9/415: mknod d3/d9/dc/d1f/d24/c80 0 2023-12-05T09:57:31.791 INFO:tasks.workunit.client.1.smithi150.stdout:9/416: dread - d3/d9/d26/d34/f5b zero size 2023-12-05T09:57:31.794 INFO:tasks.workunit.client.1.smithi150.stdout:2/485: rename d0/d3/d5/d10/d3d/d41 to d0/d3/d27/dac 0 2023-12-05T09:57:31.794 INFO:tasks.workunit.client.1.smithi150.stdout:2/486: fdatasync d0/f16 0 2023-12-05T09:57:31.794 INFO:tasks.workunit.client.1.smithi150.stdout:2/487: chown d0/d3/d5/d13/d15/d30/d54/d57/f91 242 1 2023-12-05T09:57:31.796 INFO:tasks.workunit.client.1.smithi150.stdout:8/475: truncate d0/d41/f71 782097 0 2023-12-05T09:57:31.798 INFO:tasks.workunit.client.0.smithi100.stdout:7/445: getdents d3/dc/d11/d13/d37 0 2023-12-05T09:57:31.801 INFO:tasks.workunit.client.1.smithi150.stdout:4/410: rmdir d0/d3e/d48/d4d 39 2023-12-05T09:57:31.801 INFO:tasks.workunit.client.1.smithi150.stdout:4/411: creat d0/d42/f7b x:0 0 0 2023-12-05T09:57:31.802 INFO:tasks.workunit.client.1.smithi150.stdout:1/466: truncate d6/d8/db/d1b/d79/f86 197994 0 2023-12-05T09:57:31.803 INFO:tasks.workunit.client.0.smithi100.stdout:7/446: mknod d3/dc/d11/d13/de/d18/d3b/ca3 0 2023-12-05T09:57:31.804 INFO:tasks.workunit.client.0.smithi100.stdout:7/447: read - d3/dc/d11/d13/de/d18/d3b/d40/d46/f85 zero size 2023-12-05T09:57:31.804 INFO:tasks.workunit.client.0.smithi100.stdout:7/448: stat d3/dc/d11/d13/de/d18/d3b/d40/d46 0 2023-12-05T09:57:31.806 INFO:tasks.workunit.client.1.smithi150.stdout:5/467: dread d1/d7f/d65/f9d [0,4194304] 0 2023-12-05T09:57:31.807 INFO:tasks.workunit.client.1.smithi150.stdout:5/468: chown d1/d2e/da6/l56 14343 1 2023-12-05T09:57:31.807 INFO:tasks.workunit.client.1.smithi150.stdout:6/410: unlink d2/d23/c4a 0 2023-12-05T09:57:31.807 INFO:tasks.workunit.client.1.smithi150.stdout:6/411: read - d2/d23/d2e/f85 zero size 2023-12-05T09:57:31.809 INFO:tasks.workunit.client.0.smithi100.stdout:7/449: rename d3/f67 to d3/dc/d11/d13/de/d18/d3b/d40/d4c/fa4 0 2023-12-05T09:57:31.813 INFO:tasks.workunit.client.1.smithi150.stdout:9/417: creat d3/d9/d26/f81 x:0 0 0 2023-12-05T09:57:31.813 INFO:tasks.workunit.client.1.smithi150.stdout:0/506: sync 2023-12-05T09:57:31.813 INFO:tasks.workunit.client.1.smithi150.stdout:3/477: sync 2023-12-05T09:57:31.813 INFO:tasks.workunit.client.1.smithi150.stdout:2/488: creat d0/da3/fad x:0 0 0 2023-12-05T09:57:31.815 INFO:tasks.workunit.client.0.smithi100.stdout:7/450: truncate d3/dc/d11/d13/de/f28 2262433 0 2023-12-05T09:57:31.820 INFO:tasks.workunit.client.0.smithi100.stdout:7/451: rename d3/dc/d11/d13/de/d2d/f96 to d3/dc/d11/d13/de/d18/d3b/d40/fa5 0 2023-12-05T09:57:31.820 INFO:tasks.workunit.client.0.smithi100.stdout:7/452: dread - d3/dc/d11/d13/de/d18/d3b/d40/d4c/d7f/f98 zero size 2023-12-05T09:57:31.822 INFO:tasks.workunit.client.1.smithi150.stdout:4/412: link d0/d42/f4c d0/d42/f7c 0 2023-12-05T09:57:31.822 INFO:tasks.workunit.client.1.smithi150.stdout:4/413: fsync d0/f30 0 2023-12-05T09:57:31.822 INFO:tasks.workunit.client.1.smithi150.stdout:8/476: dread d0/d41/f50 [0,4194304] 0 2023-12-05T09:57:31.823 INFO:tasks.workunit.client.1.smithi150.stdout:1/467: creat d6/d8/db/fac x:0 0 0 2023-12-05T09:57:31.825 INFO:tasks.workunit.client.0.smithi100.stdout:7/453: creat d3/dc/fa6 x:0 0 0 2023-12-05T09:57:31.825 INFO:tasks.workunit.client.1.smithi150.stdout:6/412: dread d2/d23/d2e/f43 [0,4194304] 0 2023-12-05T09:57:31.825 INFO:tasks.workunit.client.1.smithi150.stdout:6/413: chown d2/d23/d3b/d64/d7a/d5d/d6b/c1b 33453355 1 2023-12-05T09:57:31.825 INFO:tasks.workunit.client.1.smithi150.stdout:7/485: getdents d2/db/d30 0 2023-12-05T09:57:31.826 INFO:tasks.workunit.client.1.smithi150.stdout:9/418: mkdir d3/d82 0 2023-12-05T09:57:31.826 INFO:tasks.workunit.client.1.smithi150.stdout:9/419: chown d3/d1b/d46/l7a 10 1 2023-12-05T09:57:31.828 INFO:tasks.workunit.client.1.smithi150.stdout:3/478: creat d6/d25/f97 x:0 0 0 2023-12-05T09:57:31.829 INFO:tasks.workunit.client.1.smithi150.stdout:2/489: mkdir d0/da3/dae 0 2023-12-05T09:57:31.838 INFO:tasks.workunit.client.1.smithi150.stdout:4/414: truncate d0/d3e/d6d/f39 712199 0 2023-12-05T09:57:31.838 INFO:tasks.workunit.client.1.smithi150.stdout:7/486: creat d2/d1b/fa1 x:0 0 0 2023-12-05T09:57:31.838 INFO:tasks.workunit.client.1.smithi150.stdout:9/420: symlink d3/d9/dc/l83 0 2023-12-05T09:57:31.838 INFO:tasks.workunit.client.1.smithi150.stdout:4/415: write d0/d5f/f68 [548440,111019] 0 2023-12-05T09:57:31.838 INFO:tasks.workunit.client.1.smithi150.stdout:8/477: write d0/d41/f55 [452167,92654] 0 2023-12-05T09:57:31.838 INFO:tasks.workunit.client.1.smithi150.stdout:1/468: dread d6/d8/db/de/f13 [0,4194304] 0 2023-12-05T09:57:31.842 INFO:tasks.workunit.client.1.smithi150.stdout:0/507: rmdir d5/d11/d16 39 2023-12-05T09:57:31.842 INFO:tasks.workunit.client.1.smithi150.stdout:3/479: unlink d6/d25/d28/f3a 0 2023-12-05T09:57:31.842 INFO:tasks.workunit.client.1.smithi150.stdout:2/490: creat d0/d3/d5/d13/d15/d30/d54/faf x:0 0 0 2023-12-05T09:57:31.847 INFO:tasks.workunit.client.1.smithi150.stdout:9/421: mkdir d3/d9/d6e/d84 0 2023-12-05T09:57:31.847 INFO:tasks.workunit.client.1.smithi150.stdout:7/487: mknod d2/d9d/da0/ca2 0 2023-12-05T09:57:31.847 INFO:tasks.workunit.client.1.smithi150.stdout:4/416: mknod d0/d3e/d6d/d4b/c7d 0 2023-12-05T09:57:31.847 INFO:tasks.workunit.client.1.smithi150.stdout:4/417: chown d0/d3e/d5b/c75 3984773 1 2023-12-05T09:57:31.847 INFO:tasks.workunit.client.1.smithi150.stdout:4/418: fsync d0/d42/d44/f6f 0 2023-12-05T09:57:31.847 INFO:tasks.workunit.client.1.smithi150.stdout:3/480: mknod d6/d9/d3d/d8a/c98 0 2023-12-05T09:57:31.847 INFO:tasks.workunit.client.1.smithi150.stdout:2/491: link d0/d3/d5/d13/d15/c2b d0/d3/cb0 0 2023-12-05T09:57:31.847 INFO:tasks.workunit.client.1.smithi150.stdout:7/488: link d2/db/d30/d13/d4f/d5a/d5c/f7c d2/d1b/d91/fa3 0 2023-12-05T09:57:31.847 INFO:tasks.workunit.client.1.smithi150.stdout:2/492: readlink d0/d3/d5/d22/d52/d56/l72 0 2023-12-05T09:57:31.848 INFO:tasks.workunit.client.0.smithi100.stdout:6/852: sync 2023-12-05T09:57:31.848 INFO:tasks.workunit.client.0.smithi100.stdout:6/853: readlink d7/d11/d1a/d78/dd0/ldd 0 2023-12-05T09:57:31.848 INFO:tasks.workunit.client.0.smithi100.stdout:6/854: symlink d7/dcc/dda/l11c 0 2023-12-05T09:57:31.848 INFO:tasks.workunit.client.1.smithi150.stdout:4/419: symlink d0/d3e/d6d/d4b/l7e 0 2023-12-05T09:57:31.850 INFO:tasks.workunit.client.1.smithi150.stdout:1/469: mkdir d6/d47/d4c/d7c/dad 0 2023-12-05T09:57:31.850 INFO:tasks.workunit.client.0.smithi100.stdout:6/855: rename d7/d27/d35/d5a/feb to d7/f11d 0 2023-12-05T09:57:31.850 INFO:tasks.workunit.client.0.smithi100.stdout:6/856: stat d7/d11/d1a/l45 0 2023-12-05T09:57:31.851 INFO:tasks.workunit.client.1.smithi150.stdout:0/508: dread d5/d11/d71/d99/d9c/d46/d80/f86 [4194304,4194304] 0 2023-12-05T09:57:31.853 INFO:tasks.workunit.client.0.smithi100.stdout:6/857: mkdir d7/d27/d35/d5a/d11e 0 2023-12-05T09:57:31.856 INFO:tasks.workunit.client.1.smithi150.stdout:3/481: rename d6/d9/d3d/d56/l2b to d6/d9/l99 0 2023-12-05T09:57:31.856 INFO:tasks.workunit.client.1.smithi150.stdout:3/482: dread - d6/d9/d3d/d56/d53/d51/f8b zero size 2023-12-05T09:57:31.860 INFO:tasks.workunit.client.1.smithi150.stdout:4/420: creat d0/d42/d44/f7f x:0 0 0 2023-12-05T09:57:31.862 INFO:tasks.workunit.client.0.smithi100.stdout:6/858: rename d7/d76 to d7/d11/d1a/db7/d11f 0 2023-12-05T09:57:31.863 INFO:tasks.workunit.client.1.smithi150.stdout:0/509: unlink d5/d11/d16/d1f/d7f/f9a 0 2023-12-05T09:57:31.864 INFO:tasks.workunit.client.0.smithi100.stdout:6/859: mkdir d7/d27/d35/d5a/d120 0 2023-12-05T09:57:31.867 INFO:tasks.workunit.client.1.smithi150.stdout:0/510: unlink d5/d11/d32/d57/c75 0 2023-12-05T09:57:31.867 INFO:tasks.workunit.client.1.smithi150.stdout:7/489: dread d2/db/d30/d18/f57 [0,4194304] 0 2023-12-05T09:57:31.870 INFO:tasks.workunit.client.1.smithi150.stdout:0/511: mknod d5/d11/d71/d5f/d77/cb1 0 2023-12-05T09:57:31.870 INFO:tasks.workunit.client.1.smithi150.stdout:0/512: write d5/fa [3951819,23160] 0 2023-12-05T09:57:31.871 INFO:tasks.workunit.client.1.smithi150.stdout:7/490: mkdir d2/d1b/d31/da4 0 2023-12-05T09:57:31.872 INFO:tasks.workunit.client.1.smithi150.stdout:7/491: fsync d2/d1b/d91/fa3 0 2023-12-05T09:57:31.872 INFO:tasks.workunit.client.1.smithi150.stdout:7/492: fdatasync d2/db/d30/d18/d1a/d1e/f21 0 2023-12-05T09:57:31.872 INFO:tasks.workunit.client.1.smithi150.stdout:7/493: chown d2/db/d30/d18 968509 1 2023-12-05T09:57:31.872 INFO:tasks.workunit.client.1.smithi150.stdout:4/421: dread d0/d42/d44/f6f [0,4194304] 0 2023-12-05T09:57:31.874 INFO:tasks.workunit.client.1.smithi150.stdout:0/513: creat d5/d11/d71/d99/fb2 x:0 0 0 2023-12-05T09:57:31.886 INFO:tasks.workunit.client.1.smithi150.stdout:6/414: dwrite d2/d23/d3b/d64/d7a/d5d/f86 [0,4194304] 0 2023-12-05T09:57:31.886 INFO:tasks.workunit.client.1.smithi150.stdout:4/422: rename d0/d42 to d0/d3e/d5b/d80 0 2023-12-05T09:57:31.887 INFO:tasks.workunit.client.1.smithi150.stdout:4/423: write d0/d3e/d6d/f12 [1227297,74210] 0 2023-12-05T09:57:31.887 INFO:tasks.workunit.client.1.smithi150.stdout:4/424: chown d0/d3e/f71 11282155 1 2023-12-05T09:57:31.887 INFO:tasks.workunit.client.1.smithi150.stdout:4/425: chown d0/d3e/d6d/l38 30345 1 2023-12-05T09:57:31.887 INFO:tasks.workunit.client.1.smithi150.stdout:4/426: chown d0/d3e/d48/f4e 1320 1 2023-12-05T09:57:31.887 INFO:tasks.workunit.client.1.smithi150.stdout:4/427: dread - d0/d3e/f71 zero size 2023-12-05T09:57:31.887 INFO:tasks.workunit.client.1.smithi150.stdout:4/428: chown d0/d3e/d48 5 1 2023-12-05T09:57:31.890 INFO:tasks.workunit.client.1.smithi150.stdout:6/415: unlink d2/d23/d3b/d64/d7a/d5d/d6b/f27 0 2023-12-05T09:57:31.894 INFO:tasks.workunit.client.1.smithi150.stdout:9/422: dwrite d3/f29 [0,4194304] 0 2023-12-05T09:57:31.897 INFO:tasks.workunit.client.1.smithi150.stdout:4/429: symlink d0/d5f/l81 0 2023-12-05T09:57:31.900 INFO:tasks.workunit.client.1.smithi150.stdout:6/416: truncate d2/d23/d2e/f43 2733197 0 2023-12-05T09:57:31.900 INFO:tasks.workunit.client.1.smithi150.stdout:6/417: read - d2/d23/d3b/d64/f88 zero size 2023-12-05T09:57:31.900 INFO:tasks.workunit.client.1.smithi150.stdout:3/483: dread d6/d9/f1b [0,4194304] 0 2023-12-05T09:57:31.902 INFO:tasks.workunit.client.1.smithi150.stdout:9/423: unlink d3/d42/f4e 0 2023-12-05T09:57:31.902 INFO:tasks.workunit.client.1.smithi150.stdout:4/430: creat d0/d5f/f82 x:0 0 0 2023-12-05T09:57:31.902 INFO:tasks.workunit.client.1.smithi150.stdout:9/424: write d3/d9/f20 [1521225,37633] 0 2023-12-05T09:57:31.902 INFO:tasks.workunit.client.1.smithi150.stdout:4/431: write d0/d3e/d5b/d80/d44/f7f [838410,125045] 0 2023-12-05T09:57:31.905 INFO:tasks.workunit.client.1.smithi150.stdout:6/418: creat d2/d23/d3b/d64/d7a/d5d/d6b/f89 x:0 0 0 2023-12-05T09:57:31.908 INFO:tasks.workunit.client.1.smithi150.stdout:3/484: unlink d6/d25/c4e 0 2023-12-05T09:57:31.909 INFO:tasks.workunit.client.1.smithi150.stdout:9/425: link d3/d9/dc/c11 d3/d1b/c85 0 2023-12-05T09:57:31.909 INFO:tasks.workunit.client.1.smithi150.stdout:9/426: write d3/d9/dc/f4b [2243870,5576] 0 2023-12-05T09:57:31.909 INFO:tasks.workunit.client.1.smithi150.stdout:4/432: symlink d0/d3e/d5b/l83 0 2023-12-05T09:57:31.911 INFO:tasks.workunit.client.1.smithi150.stdout:9/427: rename d3/d9/dc/d1f/d24/l47 to d3/d9/d26/d34/l86 0 2023-12-05T09:57:31.911 INFO:tasks.workunit.client.1.smithi150.stdout:9/428: truncate d3/f71 1120242 0 2023-12-05T09:57:31.911 INFO:tasks.workunit.client.1.smithi150.stdout:9/429: fsync d3/d42/d62/f5c 0 2023-12-05T09:57:31.912 INFO:tasks.workunit.client.1.smithi150.stdout:9/430: truncate d3/d9/f52 3229570 0 2023-12-05T09:57:31.914 INFO:tasks.workunit.client.1.smithi150.stdout:4/433: mknod d0/d3e/c84 0 2023-12-05T09:57:31.915 INFO:tasks.workunit.client.1.smithi150.stdout:3/485: rmdir d6/d25/d28/d67 39 2023-12-05T09:57:31.917 INFO:tasks.workunit.client.1.smithi150.stdout:2/493: dwrite d0/d3/f99 [0,4194304] 0 2023-12-05T09:57:31.917 INFO:tasks.workunit.client.1.smithi150.stdout:2/494: truncate d0/d3/d21/f44 1868982 0 2023-12-05T09:57:31.920 INFO:tasks.workunit.client.1.smithi150.stdout:9/431: mknod d3/c87 0 2023-12-05T09:57:31.920 INFO:tasks.workunit.client.1.smithi150.stdout:4/434: link d0/d3e/d6d/c4a d0/d3e/d5b/c85 0 2023-12-05T09:57:31.920 INFO:tasks.workunit.client.1.smithi150.stdout:8/478: dwrite d0/d41/f55 [0,4194304] 0 2023-12-05T09:57:31.921 INFO:tasks.workunit.client.1.smithi150.stdout:3/486: mkdir d6/d25/d28/d9a 0 2023-12-05T09:57:31.922 INFO:tasks.workunit.client.1.smithi150.stdout:9/432: read d3/d9/d26/f3f [962125,51579] 0 2023-12-05T09:57:31.923 INFO:tasks.workunit.client.1.smithi150.stdout:9/433: dread - d3/d9/dc/d1f/f6c zero size 2023-12-05T09:57:31.923 INFO:tasks.workunit.client.1.smithi150.stdout:1/470: dwrite d6/d8/d85/f97 [0,4194304] 0 2023-12-05T09:57:31.923 INFO:tasks.workunit.client.1.smithi150.stdout:1/471: chown d6/d8/d59/l7b 14990 1 2023-12-05T09:57:31.923 INFO:tasks.workunit.client.1.smithi150.stdout:6/419: dread d2/f13 [0,4194304] 0 2023-12-05T09:57:31.923 INFO:tasks.workunit.client.1.smithi150.stdout:6/420: chown d2/d23/d3b/d64/d7a/d5d/d6b/f22 258424259 1 2023-12-05T09:57:31.923 INFO:tasks.workunit.client.1.smithi150.stdout:4/435: creat d0/d3e/d48/d4d/f86 x:0 0 0 2023-12-05T09:57:31.931 INFO:tasks.workunit.client.1.smithi150.stdout:3/487: dread d6/d9/f1c [0,4194304] 0 2023-12-05T09:57:31.934 INFO:tasks.workunit.client.1.smithi150.stdout:8/479: truncate d0/d41/d49/d1b/d24/f63 156425 0 2023-12-05T09:57:31.934 INFO:tasks.workunit.client.1.smithi150.stdout:8/480: readlink d0/d41/d49/d1b/d24/d2e/d30/l5d 0 2023-12-05T09:57:31.934 INFO:tasks.workunit.client.1.smithi150.stdout:8/481: fdatasync d0/d8/f11 0 2023-12-05T09:57:31.938 INFO:tasks.workunit.client.1.smithi150.stdout:0/514: dwrite d5/f23 [0,4194304] 0 2023-12-05T09:57:31.944 INFO:tasks.workunit.client.1.smithi150.stdout:9/434: getdents d3/d1b/d46/d55 0 2023-12-05T09:57:31.944 INFO:tasks.workunit.client.1.smithi150.stdout:6/421: rename d2/d23/d2e/f4f to d2/d23/d2e/d44/d7d/f8a 0 2023-12-05T09:57:31.944 INFO:tasks.workunit.client.1.smithi150.stdout:8/482: creat d0/d41/d49/d1b/d24/d5b/f96 x:0 0 0 2023-12-05T09:57:31.944 INFO:tasks.workunit.client.1.smithi150.stdout:3/488: getdents d6/d9/d3d/d87 0 2023-12-05T09:57:31.946 INFO:tasks.workunit.client.1.smithi150.stdout:9/435: unlink d3/d9/f6f 0 2023-12-05T09:57:31.949 INFO:tasks.workunit.client.1.smithi150.stdout:2/495: dwrite d0/f8e [0,4194304] 0 2023-12-05T09:57:31.949 INFO:tasks.workunit.client.1.smithi150.stdout:2/496: fsync d0/d3/d5/d13/d15/d30/d54/d57/f88 0 2023-12-05T09:57:31.949 INFO:tasks.workunit.client.1.smithi150.stdout:8/483: creat d0/d41/d49/d1b/d24/d34/f97 x:0 0 0 2023-12-05T09:57:31.949 INFO:tasks.workunit.client.1.smithi150.stdout:8/484: dread - d0/d41/d49/d1b/d24/d2e/f53 zero size 2023-12-05T09:57:31.950 INFO:tasks.workunit.client.1.smithi150.stdout:9/436: creat d3/d1b/d46/d55/d64/f88 x:0 0 0 2023-12-05T09:57:31.956 INFO:tasks.workunit.client.1.smithi150.stdout:2/497: creat d0/da3/dae/fb1 x:0 0 0 2023-12-05T09:57:31.957 INFO:tasks.workunit.client.1.smithi150.stdout:5/469: sync 2023-12-05T09:57:31.957 INFO:tasks.workunit.client.1.smithi150.stdout:5/470: fdatasync d1/f55 0 2023-12-05T09:57:31.957 INFO:tasks.workunit.client.1.smithi150.stdout:8/485: unlink d0/l2a 0 2023-12-05T09:57:31.959 INFO:tasks.workunit.client.1.smithi150.stdout:3/489: rename d6/d9/d3d/d56/d71/f73 to d6/d9/d8d/f9b 0 2023-12-05T09:57:31.959 INFO:tasks.workunit.client.1.smithi150.stdout:3/490: fdatasync d6/d9/f57 0 2023-12-05T09:57:31.963 INFO:tasks.workunit.client.1.smithi150.stdout:9/437: link d3/d9/f17 d3/d9/d26/f89 0 2023-12-05T09:57:31.963 INFO:tasks.workunit.client.1.smithi150.stdout:6/422: rmdir d2/d23/d2e 39 2023-12-05T09:57:31.963 INFO:tasks.workunit.client.1.smithi150.stdout:9/438: truncate d3/d9/d26/d34/f5b 992637 0 2023-12-05T09:57:31.963 INFO:tasks.workunit.client.1.smithi150.stdout:6/423: stat d2/d23/d3b/d64/d7a/f5e 0 2023-12-05T09:57:31.963 INFO:tasks.workunit.client.1.smithi150.stdout:9/439: chown d3/d1b/d46/d55/d64 0 1 2023-12-05T09:57:31.963 INFO:tasks.workunit.client.1.smithi150.stdout:9/440: readlink d3/d9/dc/d1f/l5e 0 2023-12-05T09:57:31.964 INFO:tasks.workunit.client.1.smithi150.stdout:9/441: fsync d3/d9/d26/d34/f6d 0 2023-12-05T09:57:31.964 INFO:tasks.workunit.client.1.smithi150.stdout:9/442: chown d3/d9/dc/d1f/l5e 109585 1 2023-12-05T09:57:31.964 INFO:tasks.workunit.client.1.smithi150.stdout:9/443: truncate d3/d9/d26/f3f 2008293 0 2023-12-05T09:57:31.964 INFO:tasks.workunit.client.1.smithi150.stdout:5/471: creat d1/d7f/d65/d3b/d37/faf x:0 0 0 2023-12-05T09:57:31.964 INFO:tasks.workunit.client.1.smithi150.stdout:5/472: creat d1/d7f/d65/d3b/d6b/fb0 x:0 0 0 2023-12-05T09:57:31.964 INFO:tasks.workunit.client.1.smithi150.stdout:5/473: chown d1/d3/ce 42186 1 2023-12-05T09:57:31.968 INFO:tasks.workunit.client.1.smithi150.stdout:2/498: rename d0/d3/d5/d13/d15/d30/d54/f8a to d0/d3/fb2 0 2023-12-05T09:57:31.968 INFO:tasks.workunit.client.1.smithi150.stdout:2/499: write d0/f7 [339699,9795] 0 2023-12-05T09:57:31.968 INFO:tasks.workunit.client.1.smithi150.stdout:2/500: truncate d0/d3/d5/d13/d15/d30/d54/d57/f88 1715349 0 2023-12-05T09:57:31.970 INFO:tasks.workunit.client.1.smithi150.stdout:3/491: symlink d6/d25/d28/d67/l9c 0 2023-12-05T09:57:31.970 INFO:tasks.workunit.client.1.smithi150.stdout:3/492: fdatasync d6/f80 0 2023-12-05T09:57:31.972 INFO:tasks.workunit.client.1.smithi150.stdout:9/444: link d3/d9/f31 d3/d9/d6e/f8a 0 2023-12-05T09:57:31.974 INFO:tasks.workunit.client.1.smithi150.stdout:8/486: read d0/d41/d49/d1b/d24/d38/f6a [1660014,61262] 0 2023-12-05T09:57:31.974 INFO:tasks.workunit.client.1.smithi150.stdout:8/487: readlink d0/d41/d49/l3c 0 2023-12-05T09:57:31.974 INFO:tasks.workunit.client.1.smithi150.stdout:8/488: fsync d0/d41/f71 0 2023-12-05T09:57:31.974 INFO:tasks.workunit.client.1.smithi150.stdout:8/489: chown d0/d41/d49/d1b/d24/d34/d56/f60 6161504 1 2023-12-05T09:57:31.975 INFO:tasks.workunit.client.1.smithi150.stdout:2/501: creat d0/d3/d11/fb3 x:0 0 0 2023-12-05T09:57:31.975 INFO:tasks.workunit.client.1.smithi150.stdout:2/502: chown d0/d3/d5/d36 364437 1 2023-12-05T09:57:31.975 INFO:tasks.workunit.client.1.smithi150.stdout:3/493: stat d6/d25/d28/c34 0 2023-12-05T09:57:31.983 INFO:tasks.workunit.client.1.smithi150.stdout:4/436: dwrite d0/fd [0,4194304] 0 2023-12-05T09:57:31.983 INFO:tasks.workunit.client.1.smithi150.stdout:4/437: write d0/d3e/d48/d4d/f67 [154563,857] 0 2023-12-05T09:57:31.983 INFO:tasks.workunit.client.1.smithi150.stdout:9/445: rename d3/d9/d58/l70 to d3/d9/d67/l8b 0 2023-12-05T09:57:31.983 INFO:tasks.workunit.client.1.smithi150.stdout:2/503: link d0/d3/d5/d22/d52/d5a/f5d d0/d3/d5/d13/d15/d30/d54/d57/fb4 0 2023-12-05T09:57:31.983 INFO:tasks.workunit.client.1.smithi150.stdout:2/504: truncate d0/d3/d5/d13/d15/d30/d54/d57/fab 528935 0 2023-12-05T09:57:31.983 INFO:tasks.workunit.client.1.smithi150.stdout:3/494: unlink d6/d9/d3d/d8a/f95 0 2023-12-05T09:57:31.983 INFO:tasks.workunit.client.1.smithi150.stdout:6/424: dread d2/d23/d3b/d64/d7a/d5d/d6b/f1a [0,4194304] 0 2023-12-05T09:57:31.990 INFO:tasks.workunit.client.1.smithi150.stdout:9/446: symlink d3/d9/d26/d34/l8c 0 2023-12-05T09:57:31.991 INFO:tasks.workunit.client.1.smithi150.stdout:8/490: write d0/ff [1440373,35183] 0 2023-12-05T09:57:31.994 INFO:tasks.workunit.client.1.smithi150.stdout:2/505: unlink d0/d3/d11/d1d/c62 0 2023-12-05T09:57:31.994 INFO:tasks.workunit.client.1.smithi150.stdout:2/506: write d0/d3/d27/dac/f7b [3068804,38380] 0 2023-12-05T09:57:31.995 INFO:tasks.workunit.client.1.smithi150.stdout:3/495: mknod d6/d9/c9d 0 2023-12-05T09:57:32.009 INFO:tasks.workunit.client.1.smithi150.stdout:4/438: rmdir d0/d3e 39 2023-12-05T09:57:32.009 INFO:tasks.workunit.client.1.smithi150.stdout:3/496: creat d6/d9/d3d/d56/d53/f9e x:0 0 0 2023-12-05T09:57:32.009 INFO:tasks.workunit.client.1.smithi150.stdout:8/491: creat d0/d41/d49/d1b/d24/d5b/d87/f98 x:0 0 0 2023-12-05T09:57:32.009 INFO:tasks.workunit.client.1.smithi150.stdout:6/425: rmdir d2/d23/d3b/d64 39 2023-12-05T09:57:32.009 INFO:tasks.workunit.client.1.smithi150.stdout:6/426: chown d2/l30 23341698 1 2023-12-05T09:57:32.012 INFO:tasks.workunit.client.1.smithi150.stdout:8/492: stat d0/d41/l88 0 2023-12-05T09:57:32.013 INFO:tasks.workunit.client.1.smithi150.stdout:3/497: creat d6/d9/d3d/f9f x:0 0 0 2023-12-05T09:57:32.014 INFO:tasks.workunit.client.1.smithi150.stdout:6/427: symlink d2/d23/d2e/d5f/l8b 0 2023-12-05T09:57:32.014 INFO:tasks.workunit.client.0.smithi100.stdout:1/439: sync 2023-12-05T09:57:32.014 INFO:tasks.workunit.client.0.smithi100.stdout:8/375: sync 2023-12-05T09:57:32.015 INFO:tasks.workunit.client.1.smithi150.stdout:8/493: creat d0/f99 x:0 0 0 2023-12-05T09:57:32.016 INFO:tasks.workunit.client.1.smithi150.stdout:6/428: mkdir d2/d23/d3b/d64/d7a/d8c 0 2023-12-05T09:57:32.017 INFO:tasks.workunit.client.1.smithi150.stdout:5/474: dwrite d1/d7f/d65/d3b/d6b/f8b [0,4194304] 0 2023-12-05T09:57:32.018 INFO:tasks.workunit.client.0.smithi100.stdout:8/376: mknod d0/d12/c5c 0 2023-12-05T09:57:32.020 INFO:tasks.workunit.client.1.smithi150.stdout:8/494: rename d0/d41/d49/d1b/l37 to d0/d41/d49/d1b/d24/l9a 0 2023-12-05T09:57:32.024 INFO:tasks.workunit.client.1.smithi150.stdout:6/429: truncate d2/f13 1483829 0 2023-12-05T09:57:32.024 INFO:tasks.workunit.client.1.smithi150.stdout:6/430: stat d2/d23/d3b/d64/d7a/d5d/d6b 0 2023-12-05T09:57:32.024 INFO:tasks.workunit.client.1.smithi150.stdout:0/515: dwrite d5/d11/f8f [0,4194304] 0 2023-12-05T09:57:32.024 INFO:tasks.workunit.client.0.smithi100.stdout:1/440: dread f9 [0,4194304] 0 2023-12-05T09:57:32.024 INFO:tasks.workunit.client.0.smithi100.stdout:8/377: getdents d0/d12/d13 0 2023-12-05T09:57:32.024 INFO:tasks.workunit.client.1.smithi150.stdout:1/472: dwrite d6/d3c/f7e [0,4194304] 0 2023-12-05T09:57:32.032 INFO:tasks.workunit.client.1.smithi150.stdout:5/475: symlink d1/d3/d6/d11/lb1 0 2023-12-05T09:57:32.032 INFO:tasks.workunit.client.1.smithi150.stdout:5/476: dread - d1/f96 zero size 2023-12-05T09:57:32.034 INFO:tasks.workunit.client.1.smithi150.stdout:9/447: dwrite d3/d9/dc/d1f/f5f [0,4194304] 0 2023-12-05T09:57:32.036 INFO:tasks.workunit.client.0.smithi100.stdout:8/378: rename d0/d12/d13/d16/f41 to d0/d12/d13/d45/f5d 0 2023-12-05T09:57:32.036 INFO:tasks.workunit.client.0.smithi100.stdout:8/379: getdents d0/d12/d52 0 2023-12-05T09:57:32.038 INFO:tasks.workunit.client.1.smithi150.stdout:8/495: read d0/d41/d49/d1b/f1d [2283969,75136] 0 2023-12-05T09:57:32.038 INFO:tasks.workunit.client.1.smithi150.stdout:8/496: write d0/d41/d49/d1b/d24/d38/f3d [2443498,105464] 0 2023-12-05T09:57:32.039 INFO:tasks.workunit.client.0.smithi100.stdout:8/380: unlink d0/d12/d13/c47 0 2023-12-05T09:57:32.044 INFO:tasks.workunit.client.0.smithi100.stdout:1/441: dread db/f35 [0,4194304] 0 2023-12-05T09:57:32.044 INFO:tasks.workunit.client.0.smithi100.stdout:8/381: unlink d0/d12/l4c 0 2023-12-05T09:57:32.044 INFO:tasks.workunit.client.0.smithi100.stdout:1/442: write db/d12/d61/d66/f89 [522120,104928] 0 2023-12-05T09:57:32.045 INFO:tasks.workunit.client.0.smithi100.stdout:1/443: fdatasync db/d31/d3a/f42 0 2023-12-05T09:57:32.047 INFO:tasks.workunit.client.0.smithi100.stdout:8/382: mknod d0/c5e 0 2023-12-05T09:57:32.047 INFO:tasks.workunit.client.0.smithi100.stdout:8/383: readlink d0/l2d 0 2023-12-05T09:57:32.047 INFO:tasks.workunit.client.0.smithi100.stdout:8/384: rename d0/d12/d13/d16/d42 to d0/d12/d13/d16/d42/d43/d5f 22 2023-12-05T09:57:32.048 INFO:tasks.workunit.client.0.smithi100.stdout:8/385: chown d0/f3c 1026696782 1 2023-12-05T09:57:32.048 INFO:tasks.workunit.client.1.smithi150.stdout:2/507: dwrite d0/da3/fad [0,4194304] 0 2023-12-05T09:57:32.049 INFO:tasks.workunit.client.0.smithi100.stdout:1/444: link db/d12/d1e/d26/c3f db/d12/d1e/d26/d30/d52/d84/c8d 0 2023-12-05T09:57:32.052 INFO:tasks.workunit.client.0.smithi100.stdout:8/386: symlink d0/d35/l60 0 2023-12-05T09:57:32.052 INFO:tasks.workunit.client.0.smithi100.stdout:8/387: truncate d0/d12/d13/d16/d22/f55 147592 0 2023-12-05T09:57:32.052 INFO:tasks.workunit.client.0.smithi100.stdout:1/445: truncate db/d12/d1e/d26/d30/d6e/f57 800034 0 2023-12-05T09:57:32.055 INFO:tasks.workunit.client.0.smithi100.stdout:8/388: symlink d0/d12/d13/d45/l61 0 2023-12-05T09:57:32.056 INFO:tasks.workunit.client.0.smithi100.stdout:1/446: getdents db/d12/d1e 0 2023-12-05T09:57:32.059 INFO:tasks.workunit.client.1.smithi150.stdout:6/431: symlink d2/d23/d3b/d64/d7a/l8d 0 2023-12-05T09:57:32.062 INFO:tasks.workunit.client.1.smithi150.stdout:1/473: rename d6/d8/d59/c99 to d6/d8/db/de/d75/da5/cae 0 2023-12-05T09:57:32.062 INFO:tasks.workunit.client.1.smithi150.stdout:5/477: symlink d1/d2e/da6/d24/d59/lb2 0 2023-12-05T09:57:32.063 INFO:tasks.workunit.client.1.smithi150.stdout:5/478: truncate d1/d3/d6/d72/f8f 201947 0 2023-12-05T09:57:32.063 INFO:tasks.workunit.client.0.smithi100.stdout:1/447: read db/d12/f75 [421404,93038] 0 2023-12-05T09:57:32.063 INFO:tasks.workunit.client.0.smithi100.stdout:1/448: creat db/d12/d1e/d26/d30/f8e x:0 0 0 2023-12-05T09:57:32.063 INFO:tasks.workunit.client.0.smithi100.stdout:1/449: write db/d12/d1e/d26/d30/d52/f5f [1153795,123634] 0 2023-12-05T09:57:32.072 INFO:tasks.workunit.client.0.smithi100.stdout:1/450: rename db/d12/d61/d66/f76 to db/d12/f8f 0 2023-12-05T09:57:32.072 INFO:tasks.workunit.client.1.smithi150.stdout:7/494: sync 2023-12-05T09:57:32.072 INFO:tasks.workunit.client.1.smithi150.stdout:7/495: creat d2/db/d30/d13/d4f/d5a/d5c/fa5 x:0 0 0 2023-12-05T09:57:32.074 INFO:tasks.workunit.client.1.smithi150.stdout:2/508: creat d0/d3/d5/d36/fb5 x:0 0 0 2023-12-05T09:57:32.075 INFO:tasks.workunit.client.1.smithi150.stdout:6/432: mknod d2/c8e 0 2023-12-05T09:57:32.078 INFO:tasks.workunit.client.1.smithi150.stdout:0/516: rmdir d5/d11/d16/d1f/d7f 39 2023-12-05T09:57:32.084 INFO:tasks.workunit.client.1.smithi150.stdout:9/448: rename d3/d9/d26/d34/l8c to d3/d9/dc/l8d 0 2023-12-05T09:57:32.085 INFO:tasks.workunit.client.1.smithi150.stdout:1/474: getdents d6/d8/db/d1b/d79 0 2023-12-05T09:57:32.085 INFO:tasks.workunit.client.1.smithi150.stdout:0/517: dread d5/d11/d71/d99/d9c/d3b/f6c [0,4194304] 0 2023-12-05T09:57:32.087 INFO:tasks.workunit.client.1.smithi150.stdout:5/479: mknod d1/d3/d92/cb3 0 2023-12-05T09:57:32.092 INFO:tasks.workunit.client.1.smithi150.stdout:6/433: symlink d2/d23/d3b/d64/d7a/d8c/l8f 0 2023-12-05T09:57:32.092 INFO:tasks.workunit.client.1.smithi150.stdout:6/434: fsync d2/d23/d3b/d64/f88 0 2023-12-05T09:57:32.093 INFO:tasks.workunit.client.1.smithi150.stdout:8/497: rename d0/d41/d49/d1b/d24/d38/f6a to d0/d41/d49/d1b/d24/d38/d62/f9b 0 2023-12-05T09:57:32.093 INFO:tasks.workunit.client.1.smithi150.stdout:8/498: fdatasync d0/d41/d49/d1b/f93 0 2023-12-05T09:57:32.093 INFO:tasks.workunit.client.1.smithi150.stdout:8/499: stat d0/d41/d49/d1b/d24/d38 0 2023-12-05T09:57:32.095 INFO:tasks.workunit.client.1.smithi150.stdout:9/449: getdents d3/d9/d58 0 2023-12-05T09:57:32.096 INFO:tasks.workunit.client.1.smithi150.stdout:1/475: mkdir d6/d8/db/de/daf 0 2023-12-05T09:57:32.097 INFO:tasks.workunit.client.1.smithi150.stdout:2/509: getdents d0/d3/d5/d3b/d4c 0 2023-12-05T09:57:32.102 INFO:tasks.workunit.client.1.smithi150.stdout:7/496: rename d2/db/d30/d53/f80 to d2/d1b/d5b/d6a/fa6 0 2023-12-05T09:57:32.102 INFO:tasks.workunit.client.1.smithi150.stdout:9/450: creat d3/d42/f8e x:0 0 0 2023-12-05T09:57:32.103 INFO:tasks.workunit.client.1.smithi150.stdout:2/510: mkdir d0/d3/d27/db6 0 2023-12-05T09:57:32.103 INFO:tasks.workunit.client.1.smithi150.stdout:1/476: symlink d6/d8/db/d1b/lb0 0 2023-12-05T09:57:32.103 INFO:tasks.workunit.client.1.smithi150.stdout:1/477: stat d6/d3c/l58 0 2023-12-05T09:57:32.106 INFO:tasks.workunit.client.1.smithi150.stdout:0/518: rename d5/d11/d71/d99/d9c/f3c to d5/fb3 0 2023-12-05T09:57:32.107 INFO:tasks.workunit.client.1.smithi150.stdout:7/497: creat d2/d1b/d91/fa7 x:0 0 0 2023-12-05T09:57:32.110 INFO:tasks.workunit.client.1.smithi150.stdout:5/480: rename d1/d3/f1d to d1/d2e/da6/d24/d59/fb4 0 2023-12-05T09:57:32.115 INFO:tasks.workunit.client.1.smithi150.stdout:5/481: fdatasync d1/d3/f7d 0 2023-12-05T09:57:32.115 INFO:tasks.workunit.client.1.smithi150.stdout:5/482: fsync d1/d2e/f90 0 2023-12-05T09:57:32.115 INFO:tasks.workunit.client.1.smithi150.stdout:5/483: creat d1/d7f/d65/d3b/d6b/fb5 x:0 0 0 2023-12-05T09:57:32.115 INFO:tasks.workunit.client.1.smithi150.stdout:5/484: chown d1/d7f/d65/d3b/l18 371852 1 2023-12-05T09:57:32.115 INFO:tasks.workunit.client.1.smithi150.stdout:5/485: fdatasync d1/d3/d6/d26/f3e 0 2023-12-05T09:57:32.115 INFO:tasks.workunit.client.1.smithi150.stdout:5/486: write d1/d7f/f4f [1140277,60160] 0 2023-12-05T09:57:32.116 INFO:tasks.workunit.client.1.smithi150.stdout:7/498: rmdir d2/d4/d98 0 2023-12-05T09:57:32.131 INFO:tasks.workunit.client.1.smithi150.stdout:4/439: sync 2023-12-05T09:57:32.131 INFO:tasks.workunit.client.1.smithi150.stdout:4/440: fsync d0/d3e/d48/f4e 0 2023-12-05T09:57:32.132 INFO:tasks.workunit.client.1.smithi150.stdout:4/441: truncate d0/d3e/f79 639120 0 2023-12-05T09:57:32.132 INFO:tasks.workunit.client.1.smithi150.stdout:3/498: sync 2023-12-05T09:57:32.132 INFO:tasks.workunit.client.1.smithi150.stdout:4/442: stat d0/d3e/d6d/d4b/c4f 0 2023-12-05T09:57:32.132 INFO:tasks.workunit.client.1.smithi150.stdout:3/499: mkdir d6/d25/d28/d9a/da0 0 2023-12-05T09:57:32.132 INFO:tasks.workunit.client.1.smithi150.stdout:3/500: read d6/d9/d43/d47/f1a [3559314,77693] 0 2023-12-05T09:57:32.132 INFO:tasks.workunit.client.1.smithi150.stdout:3/501: chown d6/d9/d8d/f68 62 1 2023-12-05T09:57:32.141 INFO:tasks.workunit.client.1.smithi150.stdout:1/478: dread d6/fa0 [0,4194304] 0 2023-12-05T09:57:32.143 INFO:tasks.workunit.client.1.smithi150.stdout:1/479: mkdir d6/d8/db/db1 0 2023-12-05T09:57:32.143 INFO:tasks.workunit.client.1.smithi150.stdout:1/480: fsync d6/d38/f43 0 2023-12-05T09:57:32.144 INFO:tasks.workunit.client.1.smithi150.stdout:1/481: rename d6/l7f to d6/d38/d4a/lb2 0 2023-12-05T09:57:32.147 INFO:tasks.workunit.client.1.smithi150.stdout:1/482: rename d6/d8/db/f20 to d6/d8/d54/fb3 0 2023-12-05T09:57:32.149 INFO:tasks.workunit.client.1.smithi150.stdout:1/483: read d6/d38/f43 [137112,114128] 0 2023-12-05T09:57:32.150 INFO:tasks.workunit.client.0.smithi100.stdout:1/451: dwrite db/d12/d61/d66/d67/f6b [0,4194304] 0 2023-12-05T09:57:32.152 INFO:tasks.workunit.client.1.smithi150.stdout:4/443: write d0/d3e/d6d/f12 [791097,48423] 0 2023-12-05T09:57:32.153 INFO:tasks.workunit.client.1.smithi150.stdout:4/444: chown d0/d3e/d6d/c1c 224 1 2023-12-05T09:57:32.154 INFO:tasks.workunit.client.1.smithi150.stdout:1/484: truncate d6/d47/d4c/fa2 1309137 0 2023-12-05T09:57:32.154 INFO:tasks.workunit.client.1.smithi150.stdout:3/502: write d6/d9/f32 [578651,67476] 0 2023-12-05T09:57:32.154 INFO:tasks.workunit.client.1.smithi150.stdout:3/503: fsync d6/d9/f57 0 2023-12-05T09:57:32.154 INFO:tasks.workunit.client.1.smithi150.stdout:3/504: fsync d6/d25/f70 0 2023-12-05T09:57:32.156 INFO:tasks.workunit.client.0.smithi100.stdout:1/452: mknod db/d12/c90 0 2023-12-05T09:57:32.156 INFO:tasks.workunit.client.1.smithi150.stdout:4/445: unlink d0/d3e/d6d/d4b/f65 0 2023-12-05T09:57:32.158 INFO:tasks.workunit.client.1.smithi150.stdout:1/485: mkdir d6/d47/db4 0 2023-12-05T09:57:32.158 INFO:tasks.workunit.client.1.smithi150.stdout:1/486: chown d6/d47/db4 0 1 2023-12-05T09:57:32.161 INFO:tasks.workunit.client.1.smithi150.stdout:1/487: write d6/d47/d4c/d60/f63 [170541,41624] 0 2023-12-05T09:57:32.161 INFO:tasks.workunit.client.1.smithi150.stdout:4/446: unlink d0/fd 0 2023-12-05T09:57:32.161 INFO:tasks.workunit.client.1.smithi150.stdout:7/499: dread d2/d4/f27 [0,4194304] 0 2023-12-05T09:57:32.161 INFO:tasks.workunit.client.1.smithi150.stdout:1/488: link d6/d8/db/de/ff d6/d47/db4/fb5 0 2023-12-05T09:57:32.161 INFO:tasks.workunit.client.1.smithi150.stdout:0/519: dread d5/fb3 [8388608,4194304] 0 2023-12-05T09:57:32.162 INFO:tasks.workunit.client.1.smithi150.stdout:4/447: read d0/d3e/f79 [390740,52864] 0 2023-12-05T09:57:32.162 INFO:tasks.workunit.client.1.smithi150.stdout:7/500: creat d2/db/d30/d18/d1a/d1e/fa8 x:0 0 0 2023-12-05T09:57:32.164 INFO:tasks.workunit.client.1.smithi150.stdout:1/489: unlink d6/d47/d4c/faa 0 2023-12-05T09:57:32.164 INFO:tasks.workunit.client.1.smithi150.stdout:0/520: mkdir d5/d11/d16/d1f/d7f/db4 0 2023-12-05T09:57:32.165 INFO:tasks.workunit.client.1.smithi150.stdout:0/521: write d5/d11/d16/d1f/d67/da8/fa9 [1036831,11975] 0 2023-12-05T09:57:32.165 INFO:tasks.workunit.client.1.smithi150.stdout:4/448: stat d0/d3e/d5b/c85 0 2023-12-05T09:57:32.165 INFO:tasks.workunit.client.1.smithi150.stdout:4/449: chown d0/d3e/d5b/d80/d44/l7a 87 1 2023-12-05T09:57:32.165 INFO:tasks.workunit.client.1.smithi150.stdout:0/522: creat d5/d11/d65/fb5 x:0 0 0 2023-12-05T09:57:32.165 INFO:tasks.workunit.client.1.smithi150.stdout:8/500: dwrite d0/d41/d49/d1b/d24/f63 [0,4194304] 0 2023-12-05T09:57:32.167 INFO:tasks.workunit.client.1.smithi150.stdout:7/501: mknod d2/d1b/d31/da4/ca9 0 2023-12-05T09:57:32.168 INFO:tasks.workunit.client.1.smithi150.stdout:1/490: rmdir d6/d8/d85 39 2023-12-05T09:57:32.168 INFO:tasks.workunit.client.1.smithi150.stdout:1/491: write d6/d8/db/f6e [1418769,111330] 0 2023-12-05T09:57:32.170 INFO:tasks.workunit.client.1.smithi150.stdout:0/523: mkdir d5/d11/db6 0 2023-12-05T09:57:32.170 INFO:tasks.workunit.client.1.smithi150.stdout:8/501: mkdir d0/d41/d49/d1b/d24/d5b/d9c 0 2023-12-05T09:57:32.170 INFO:tasks.workunit.client.1.smithi150.stdout:8/502: truncate d0/d41/d49/d1b/d24/d34/d56/f60 859921 0 2023-12-05T09:57:32.171 INFO:tasks.workunit.client.1.smithi150.stdout:0/524: mknod d5/d11/d32/d57/cb7 0 2023-12-05T09:57:32.172 INFO:tasks.workunit.client.1.smithi150.stdout:8/503: creat d0/d41/f9d x:0 0 0 2023-12-05T09:57:32.176 INFO:tasks.workunit.client.1.smithi150.stdout:1/492: mknod d6/d47/d4c/d7c/d89/cb6 0 2023-12-05T09:57:32.176 INFO:tasks.workunit.client.1.smithi150.stdout:8/504: creat d0/d41/d49/d1b/d24/d38/d84/f9e x:0 0 0 2023-12-05T09:57:32.179 INFO:tasks.workunit.client.0.smithi100.stdout:1/453: read db/d31/d3a/f5b [717904,2136] 0 2023-12-05T09:57:32.179 INFO:tasks.workunit.client.0.smithi100.stdout:1/454: creat db/d12/d1e/d26/d30/d6e/f91 x:0 0 0 2023-12-05T09:57:32.179 INFO:tasks.workunit.client.0.smithi100.stdout:1/455: read - db/d12/d1e/d26/d30/f83 zero size 2023-12-05T09:57:32.179 INFO:tasks.workunit.client.0.smithi100.stdout:8/389: dwrite d0/d12/d13/f25 [0,4194304] 0 2023-12-05T09:57:32.179 INFO:tasks.workunit.client.0.smithi100.stdout:1/456: rmdir db/d12/d61/d82 0 2023-12-05T09:57:32.179 INFO:tasks.workunit.client.0.smithi100.stdout:1/457: read f1 [3084872,114814] 0 2023-12-05T09:57:32.179 INFO:tasks.workunit.client.0.smithi100.stdout:1/458: creat db/d12/d61/f92 x:0 0 0 2023-12-05T09:57:32.182 INFO:tasks.workunit.client.0.smithi100.stdout:1/459: truncate db/d12/d1e/d26/d39/f7b 754127 0 2023-12-05T09:57:32.182 INFO:tasks.workunit.client.0.smithi100.stdout:1/460: write db/d12/d61/f92 [84702,71616] 0 2023-12-05T09:57:32.182 INFO:tasks.workunit.client.0.smithi100.stdout:1/461: write db/d12/d61/f64 [374019,97467] 0 2023-12-05T09:57:32.185 INFO:tasks.workunit.client.1.smithi150.stdout:3/505: dread d6/d25/d28/f2e [4194304,4194304] 0 2023-12-05T09:57:32.185 INFO:tasks.workunit.client.1.smithi150.stdout:5/487: dwrite d1/d2e/da6/d86/f88 [0,4194304] 0 2023-12-05T09:57:32.185 INFO:tasks.workunit.client.1.smithi150.stdout:5/488: chown d1/d3/d6/d26/d9a 11898 1 2023-12-05T09:57:32.185 INFO:tasks.workunit.client.1.smithi150.stdout:5/489: chown d1/d7f/d65/f57 15365572 1 2023-12-05T09:57:32.185 INFO:tasks.workunit.client.1.smithi150.stdout:5/490: write d1/d7f/d65/d3b/d37/f70 [1086360,53329] 0 2023-12-05T09:57:32.186 INFO:tasks.workunit.client.1.smithi150.stdout:8/505: read d0/d41/d49/d1b/d24/d34/d56/f60 [489989,57657] 0 2023-12-05T09:57:32.186 INFO:tasks.workunit.client.1.smithi150.stdout:9/451: dwrite d3/d9/f20 [0,4194304] 0 2023-12-05T09:57:32.187 INFO:tasks.workunit.client.0.smithi100.stdout:1/462: symlink db/d31/d3a/d4a/l93 0 2023-12-05T09:57:32.187 INFO:tasks.workunit.client.0.smithi100.stdout:1/463: write db/d12/d1e/d26/d30/f56 [3669424,117421] 0 2023-12-05T09:57:32.187 INFO:tasks.workunit.client.0.smithi100.stdout:1/464: dread - db/d12/d61/f85 zero size 2023-12-05T09:57:32.187 INFO:tasks.workunit.client.0.smithi100.stdout:8/390: rmdir d0/d12/d13/d16/d22/d24 39 2023-12-05T09:57:32.187 INFO:tasks.workunit.client.0.smithi100.stdout:8/391: truncate d0/d35/f3b 486744 0 2023-12-05T09:57:32.189 INFO:tasks.workunit.client.1.smithi150.stdout:5/491: rmdir d1/d2e/da6/d24 39 2023-12-05T09:57:32.194 INFO:tasks.workunit.client.0.smithi100.stdout:8/392: rmdir d0/d12/d13/d16/d22/d54 0 2023-12-05T09:57:32.195 INFO:tasks.workunit.client.1.smithi150.stdout:3/506: write d6/d9/d43/f60 [3449276,111675] 0 2023-12-05T09:57:32.195 INFO:tasks.workunit.client.1.smithi150.stdout:3/507: chown d6/d9/d3d/d56/d30/c83 467632 1 2023-12-05T09:57:32.196 INFO:tasks.workunit.client.1.smithi150.stdout:0/525: write d5/d11/d16/d1f/f2e [3967305,65455] 0 2023-12-05T09:57:32.196 INFO:tasks.workunit.client.1.smithi150.stdout:0/526: write d5/d11/d71/d99/d9c/d3b/f55 [554518,31634] 0 2023-12-05T09:57:32.203 INFO:tasks.workunit.client.1.smithi150.stdout:8/506: rmdir d0/d41/d49/d1b/d24/d2e/d4d 39 2023-12-05T09:57:32.203 INFO:tasks.workunit.client.1.smithi150.stdout:8/507: write d0/d41/d49/d1b/d24/d5b/d87/f98 [64108,7012] 0 2023-12-05T09:57:32.205 INFO:tasks.workunit.client.1.smithi150.stdout:9/452: truncate d3/d9/f52 138287 0 2023-12-05T09:57:32.208 INFO:tasks.workunit.client.1.smithi150.stdout:2/511: dwrite d0/f16 [4194304,4194304] 0 2023-12-05T09:57:32.208 INFO:tasks.workunit.client.1.smithi150.stdout:2/512: creat d0/d3/fb7 x:0 0 0 2023-12-05T09:57:32.208 INFO:tasks.workunit.client.1.smithi150.stdout:2/513: write d0/d3/d21/d4d/f84 [892796,53407] 0 2023-12-05T09:57:32.215 INFO:tasks.workunit.client.1.smithi150.stdout:3/508: stat l3 0 2023-12-05T09:57:32.221 INFO:tasks.workunit.client.1.smithi150.stdout:1/493: write d6/d8/db/de/f13 [994087,91524] 0 2023-12-05T09:57:32.222 INFO:tasks.workunit.client.1.smithi150.stdout:1/494: chown d6/d38 0 1 2023-12-05T09:57:32.222 INFO:tasks.workunit.client.1.smithi150.stdout:1/495: write d6/d8/d59/f78 [249865,129942] 0 2023-12-05T09:57:32.222 INFO:tasks.workunit.client.1.smithi150.stdout:1/496: truncate d6/d8/d59/f91 1025743 0 2023-12-05T09:57:32.222 INFO:tasks.workunit.client.1.smithi150.stdout:1/497: creat d6/d38/fb7 x:0 0 0 2023-12-05T09:57:32.222 INFO:tasks.workunit.client.1.smithi150.stdout:1/498: write d6/d8/d54/f55 [1205749,52345] 0 2023-12-05T09:57:32.222 INFO:tasks.workunit.client.1.smithi150.stdout:0/527: mknod d5/d11/d32/d57/cb8 0 2023-12-05T09:57:32.224 INFO:tasks.workunit.client.1.smithi150.stdout:8/508: creat d0/d41/d49/d1b/d24/d2e/d30/f9f x:0 0 0 2023-12-05T09:57:32.224 INFO:tasks.workunit.client.1.smithi150.stdout:8/509: read - d0/d41/d49/d1b/d24/d38/d62/f65 zero size 2023-12-05T09:57:32.224 INFO:tasks.workunit.client.1.smithi150.stdout:9/453: stat d3/d42/d62/l53 0 2023-12-05T09:57:32.227 INFO:tasks.workunit.client.0.smithi100.stdout:9/489: sync 2023-12-05T09:57:32.228 INFO:tasks.workunit.client.1.smithi150.stdout:2/514: mknod d0/d3/d5/d13/cb8 0 2023-12-05T09:57:32.229 INFO:tasks.workunit.client.1.smithi150.stdout:1/499: dread d6/d8/d59/f7d [0,4194304] 0 2023-12-05T09:57:32.229 INFO:tasks.workunit.client.1.smithi150.stdout:1/500: stat d6/d47/d4c/d7c/dad 0 2023-12-05T09:57:32.230 INFO:tasks.workunit.client.0.smithi100.stdout:9/490: creat d7/d1b/da5/fa7 x:0 0 0 2023-12-05T09:57:32.230 INFO:tasks.workunit.client.1.smithi150.stdout:5/492: write d1/d2e/da6/d24/d59/fb4 [2485569,29648] 0 2023-12-05T09:57:32.231 INFO:tasks.workunit.client.0.smithi100.stdout:9/491: read d7/d1b/d22/d2a/d56/d2e/f5e [148910,74774] 0 2023-12-05T09:57:32.232 INFO:tasks.workunit.client.1.smithi150.stdout:7/502: dwrite d2/d4/fc [0,4194304] 0 2023-12-05T09:57:32.234 INFO:tasks.workunit.client.0.smithi100.stdout:0/432: sync 2023-12-05T09:57:32.235 INFO:tasks.workunit.client.0.smithi100.stdout:5/495: sync 2023-12-05T09:57:32.235 INFO:tasks.workunit.client.0.smithi100.stdout:6/860: sync 2023-12-05T09:57:32.235 INFO:tasks.workunit.client.0.smithi100.stdout:0/433: getdents da/d1b/d6b/d78 0 2023-12-05T09:57:32.236 INFO:tasks.workunit.client.0.smithi100.stdout:6/861: write d7/d27/d35/f3a [1298755,116987] 0 2023-12-05T09:57:32.239 INFO:tasks.workunit.client.0.smithi100.stdout:0/434: chown da/d2a/f62 1289430432 1 2023-12-05T09:57:32.240 INFO:tasks.workunit.client.0.smithi100.stdout:0/435: write da/d22/d33/d35/d3a/f83 [399012,17148] 0 2023-12-05T09:57:32.240 INFO:tasks.workunit.client.0.smithi100.stdout:2/606: sync 2023-12-05T09:57:32.240 INFO:tasks.workunit.client.0.smithi100.stdout:4/417: sync 2023-12-05T09:57:32.240 INFO:tasks.workunit.client.0.smithi100.stdout:3/564: sync 2023-12-05T09:57:32.240 INFO:tasks.workunit.client.0.smithi100.stdout:7/454: sync 2023-12-05T09:57:32.246 INFO:tasks.workunit.client.0.smithi100.stdout:9/492: creat d7/d1b/da5/da2/fa8 x:0 0 0 2023-12-05T09:57:32.246 INFO:tasks.workunit.client.0.smithi100.stdout:9/493: truncate d7/d1b/d22/d51/d32/f8c 166694 0 2023-12-05T09:57:32.255 INFO:tasks.workunit.client.0.smithi100.stdout:5/496: symlink d0/d1f/da1/laa 0 2023-12-05T09:57:32.256 INFO:tasks.workunit.client.0.smithi100.stdout:5/497: read d0/d1f/f21 [90699,86159] 0 2023-12-05T09:57:32.256 INFO:tasks.workunit.client.1.smithi150.stdout:0/528: truncate d5/d11/d71/d99/d9c/d46/f89 2050823 0 2023-12-05T09:57:32.256 INFO:tasks.workunit.client.1.smithi150.stdout:0/529: chown d5/d11/d71/l42 3947452 1 2023-12-05T09:57:32.256 INFO:tasks.workunit.client.1.smithi150.stdout:0/530: stat d5/d11/d16/d1f/d7f/fac 0 2023-12-05T09:57:32.261 INFO:tasks.workunit.client.0.smithi100.stdout:1/465: dwrite db/d31/d3a/f3e [4194304,4194304] 0 2023-12-05T09:57:32.261 INFO:tasks.workunit.client.0.smithi100.stdout:1/466: truncate db/d12/d61/d66/d67/f6d 248475 0 2023-12-05T09:57:32.266 INFO:tasks.workunit.client.0.smithi100.stdout:8/393: dwrite d0/f2 [0,4194304] 0 2023-12-05T09:57:32.267 INFO:tasks.workunit.client.1.smithi150.stdout:9/454: mknod d3/d9/d26/c8f 0 2023-12-05T09:57:32.272 INFO:tasks.workunit.client.0.smithi100.stdout:4/418: truncate de/d16/d23/d36/f3a 1556616 0 2023-12-05T09:57:32.272 INFO:tasks.workunit.client.0.smithi100.stdout:4/419: write de/d16/d23/d36/f7a [308892,81394] 0 2023-12-05T09:57:32.272 INFO:tasks.workunit.client.0.smithi100.stdout:4/420: chown de/c18 1059 1 2023-12-05T09:57:32.272 INFO:tasks.workunit.client.0.smithi100.stdout:3/565: rmdir d0/d3d/d90 39 2023-12-05T09:57:32.273 INFO:tasks.workunit.client.0.smithi100.stdout:2/607: symlink d7/da/lcf 0 2023-12-05T09:57:32.273 INFO:tasks.workunit.client.1.smithi150.stdout:0/531: dread d5/d11/d65/d82/f88 [0,4194304] 0 2023-12-05T09:57:32.273 INFO:tasks.workunit.client.1.smithi150.stdout:3/509: dwrite d6/d9/d8d/f9b [0,4194304] 0 2023-12-05T09:57:32.274 INFO:tasks.workunit.client.1.smithi150.stdout:2/515: dwrite d0/d3/d11/f18 [0,4194304] 0 2023-12-05T09:57:32.276 INFO:tasks.workunit.client.1.smithi150.stdout:6/435: sync 2023-12-05T09:57:32.278 INFO:tasks.workunit.client.0.smithi100.stdout:3/566: write d0/d4/d3a/f64 [30063,78650] 0 2023-12-05T09:57:32.278 INFO:tasks.workunit.client.0.smithi100.stdout:3/567: chown d0/d2/de 527 1 2023-12-05T09:57:32.278 INFO:tasks.workunit.client.0.smithi100.stdout:3/568: write d0/d3d/d5c/d6f/d7f/d87/f9a [642282,84845] 0 2023-12-05T09:57:32.278 INFO:tasks.workunit.client.0.smithi100.stdout:3/569: dread - d0/d2/d33/fae zero size 2023-12-05T09:57:32.279 INFO:tasks.workunit.client.1.smithi150.stdout:1/501: link d6/d8/db/d1b/l3a d6/d3c/lb8 0 2023-12-05T09:57:32.281 INFO:tasks.workunit.client.0.smithi100.stdout:7/455: creat d3/dc/d11/d13/de/d18/d3b/d40/d46/d9e/fa7 x:0 0 0 2023-12-05T09:57:32.284 INFO:tasks.workunit.client.0.smithi100.stdout:5/498: mknod d0/d1f/da1/cab 0 2023-12-05T09:57:32.285 INFO:tasks.workunit.client.1.smithi150.stdout:5/493: creat d1/d64/d31/fb6 x:0 0 0 2023-12-05T09:57:32.291 INFO:tasks.workunit.client.0.smithi100.stdout:1/467: truncate db/d12/d1e/d26/f5e 4473976 0 2023-12-05T09:57:32.294 INFO:tasks.workunit.client.0.smithi100.stdout:8/394: symlink d0/d12/d13/d16/d42/d43/l62 0 2023-12-05T09:57:32.304 INFO:tasks.workunit.client.1.smithi150.stdout:7/503: creat d2/db/d30/d18/d1a/faa x:0 0 0 2023-12-05T09:57:32.305 INFO:tasks.workunit.client.1.smithi150.stdout:9/455: dwrite d3/d9/f17 [4194304,4194304] 0 2023-12-05T09:57:32.312 INFO:tasks.workunit.client.0.smithi100.stdout:3/570: creat d0/d2/fc3 x:0 0 0 2023-12-05T09:57:32.316 INFO:tasks.workunit.client.1.smithi150.stdout:8/510: rmdir d0/d41/d49/d1b/d24/d34 39 2023-12-05T09:57:32.316 INFO:tasks.workunit.client.1.smithi150.stdout:8/511: write d0/d41/d49/d1b/d24/d34/d56/d67/f6c [1560519,27990] 0 2023-12-05T09:57:32.316 INFO:tasks.workunit.client.1.smithi150.stdout:8/512: readlink d0/d41/d49/d1b/d24/l9a 0 2023-12-05T09:57:32.316 INFO:tasks.workunit.client.1.smithi150.stdout:8/513: stat d0/d8 0 2023-12-05T09:57:32.316 INFO:tasks.workunit.client.1.smithi150.stdout:8/514: write d0/d41/d49/d1b/d24/d2e/f5e [100973,5077] 0 2023-12-05T09:57:32.317 INFO:tasks.workunit.client.1.smithi150.stdout:8/515: fdatasync d0/d41/d49/d1b/f1d 0 2023-12-05T09:57:32.317 INFO:tasks.workunit.client.0.smithi100.stdout:0/436: dwrite da/d22/d33/d35/d3a/f47 [4194304,4194304] 0 2023-12-05T09:57:32.317 INFO:tasks.workunit.client.0.smithi100.stdout:0/437: write da/f5a [529861,47838] 0 2023-12-05T09:57:32.323 INFO:tasks.workunit.client.0.smithi100.stdout:3/571: dread d0/d2/de/d12/f18 [0,4194304] 0 2023-12-05T09:57:32.324 INFO:tasks.workunit.client.0.smithi100.stdout:1/468: getdents db/d31/d3a/d3b 0 2023-12-05T09:57:32.330 INFO:tasks.workunit.client.0.smithi100.stdout:7/456: mkdir d3/dc/d11/d13/da8 0 2023-12-05T09:57:32.333 INFO:tasks.workunit.client.0.smithi100.stdout:1/469: write db/f1a [5025826,69200] 0 2023-12-05T09:57:32.333 INFO:tasks.workunit.client.0.smithi100.stdout:1/470: stat f1 0 2023-12-05T09:57:32.336 INFO:tasks.workunit.client.0.smithi100.stdout:3/572: dread d0/d2/f75 [0,4194304] 0 2023-12-05T09:57:32.336 INFO:tasks.workunit.client.0.smithi100.stdout:3/573: write d0/d10/d39/f41 [1021730,5910] 0 2023-12-05T09:57:32.339 INFO:tasks.workunit.client.0.smithi100.stdout:4/421: dwrite de/d16/d23/d33/d3d/d44/f4d [0,4194304] 0 2023-12-05T09:57:32.339 INFO:tasks.workunit.client.0.smithi100.stdout:4/422: truncate de/d16/d23/d36/f7a 1438386 0 2023-12-05T09:57:32.340 INFO:tasks.workunit.client.1.smithi150.stdout:0/532: link d5/c15 d5/d11/d71/d99/d9c/d46/d80/cb9 0 2023-12-05T09:57:32.343 INFO:tasks.workunit.client.1.smithi150.stdout:3/510: mkdir d6/d22/d37/da1 0 2023-12-05T09:57:32.344 INFO:tasks.workunit.client.1.smithi150.stdout:3/511: read d6/d9/d8d/f44 [241173,97760] 0 2023-12-05T09:57:32.344 INFO:tasks.workunit.client.1.smithi150.stdout:4/450: sync 2023-12-05T09:57:32.345 INFO:tasks.workunit.client.0.smithi100.stdout:0/438: write da/d22/f2b [2613590,68561] 0 2023-12-05T09:57:32.346 INFO:tasks.workunit.client.0.smithi100.stdout:0/439: getdents da/d22/d33/d35 0 2023-12-05T09:57:32.346 INFO:tasks.workunit.client.0.smithi100.stdout:0/440: fdatasync da/d1b/d36/f48 0 2023-12-05T09:57:32.346 INFO:tasks.workunit.client.0.smithi100.stdout:0/441: chown da/f30 60315 1 2023-12-05T09:57:32.346 INFO:tasks.workunit.client.0.smithi100.stdout:0/442: creat da/d22/d33/d74/f84 x:0 0 0 2023-12-05T09:57:32.348 INFO:tasks.workunit.client.0.smithi100.stdout:9/494: dwrite d7/d1b/f33 [0,4194304] 0 2023-12-05T09:57:32.350 INFO:tasks.workunit.client.0.smithi100.stdout:3/574: rename d0/d4/d3a/d45/f89 to d0/d2/de/db8/fc4 0 2023-12-05T09:57:32.350 INFO:tasks.workunit.client.0.smithi100.stdout:3/575: fsync d0/d2/d33/fae 0 2023-12-05T09:57:32.350 INFO:tasks.workunit.client.1.smithi150.stdout:2/516: mkdir d0/d3/d5/d13/db9 0 2023-12-05T09:57:32.353 INFO:tasks.workunit.client.1.smithi150.stdout:8/516: write d0/d41/d49/d1b/d24/d2e/f6e [3914875,59455] 0 2023-12-05T09:57:32.354 INFO:tasks.workunit.client.1.smithi150.stdout:6/436: rmdir d2/d23/d2e/d72 39 2023-12-05T09:57:32.355 INFO:tasks.workunit.client.1.smithi150.stdout:4/451: dread d0/d5f/f68 [0,4194304] 0 2023-12-05T09:57:32.356 INFO:tasks.workunit.client.1.smithi150.stdout:1/502: rmdir d6/d47/d4c/d7c/dad 0 2023-12-05T09:57:32.357 INFO:tasks.workunit.client.1.smithi150.stdout:1/503: creat d6/d8/d54/d94/fb9 x:0 0 0 2023-12-05T09:57:32.357 INFO:tasks.workunit.client.1.smithi150.stdout:1/504: write d6/d8/db/f6e [1936517,62339] 0 2023-12-05T09:57:32.357 INFO:tasks.workunit.client.0.smithi100.stdout:1/471: dread db/d31/f36 [0,4194304] 0 2023-12-05T09:57:32.357 INFO:tasks.workunit.client.0.smithi100.stdout:1/472: chown db/d12/d61/d66/f89 2291 1 2023-12-05T09:57:32.358 INFO:tasks.workunit.client.0.smithi100.stdout:4/423: mkdir de/d16/d23/d33/d3d/d44/d4e/d80 0 2023-12-05T09:57:32.358 INFO:tasks.workunit.client.0.smithi100.stdout:4/424: fdatasync de/d16/d23/f24 0 2023-12-05T09:57:32.359 INFO:tasks.workunit.client.1.smithi150.stdout:5/494: creat d1/d2e/da6/d86/fb7 x:0 0 0 2023-12-05T09:57:32.359 INFO:tasks.workunit.client.0.smithi100.stdout:2/608: dwrite d7/da/d18/d21/f44 [0,4194304] 0 2023-12-05T09:57:32.360 INFO:tasks.workunit.client.0.smithi100.stdout:5/499: dwrite d0/d4/d14/f5b [0,4194304] 0 2023-12-05T09:57:32.361 INFO:tasks.workunit.client.0.smithi100.stdout:8/395: dread d0/f9 [0,4194304] 0 2023-12-05T09:57:32.363 INFO:tasks.workunit.client.1.smithi150.stdout:7/504: link d2/d4/f6d d2/db/d17/d20/fab 0 2023-12-05T09:57:32.365 INFO:tasks.workunit.client.1.smithi150.stdout:9/456: mkdir d3/d9/d58/d90 0 2023-12-05T09:57:32.366 INFO:tasks.workunit.client.0.smithi100.stdout:9/495: dread d7/fd [0,4194304] 0 2023-12-05T09:57:32.366 INFO:tasks.workunit.client.0.smithi100.stdout:0/443: symlink da/d22/l85 0 2023-12-05T09:57:32.369 INFO:tasks.workunit.client.1.smithi150.stdout:0/533: rmdir d5/d11/d71/d99/d9c/d46 39 2023-12-05T09:57:32.370 INFO:tasks.workunit.client.1.smithi150.stdout:3/512: mknod d6/d25/ca2 0 2023-12-05T09:57:32.371 INFO:tasks.workunit.client.0.smithi100.stdout:6/862: dwrite d7/f10 [0,4194304] 0 2023-12-05T09:57:32.372 INFO:tasks.workunit.client.0.smithi100.stdout:6/863: chown d7/d2d/d6a/fad 31938 1 2023-12-05T09:57:32.372 INFO:tasks.workunit.client.0.smithi100.stdout:3/576: mknod d0/d2/de/db8/cc5 0 2023-12-05T09:57:32.375 INFO:tasks.workunit.client.1.smithi150.stdout:2/517: rename d0/da3/fad to d0/d3/d27/db6/fba 0 2023-12-05T09:57:32.376 INFO:tasks.workunit.client.0.smithi100.stdout:1/473: mknod db/d12/d1e/d26/d30/d52/d84/d8c/c94 0 2023-12-05T09:57:32.379 INFO:tasks.workunit.client.1.smithi150.stdout:8/517: mknod d0/d41/d49/d1b/d24/d38/d84/ca0 0 2023-12-05T09:57:32.379 INFO:tasks.workunit.client.1.smithi150.stdout:8/518: truncate d0/d41/d49/d1b/d24/d38/d62/f75 1075346 0 2023-12-05T09:57:32.379 INFO:tasks.workunit.client.1.smithi150.stdout:8/519: chown d0/d8/cd 5121 1 2023-12-05T09:57:32.380 INFO:tasks.workunit.client.0.smithi100.stdout:4/425: unlink de/d16/d23/d33/d3d/l4f 0 2023-12-05T09:57:32.381 INFO:tasks.workunit.client.1.smithi150.stdout:4/452: rmdir d0/d3e/d48 39 2023-12-05T09:57:32.384 INFO:tasks.workunit.client.0.smithi100.stdout:2/609: rename d7/da/dc/d88/f91 to d7/da/dc/d88/fd0 0 2023-12-05T09:57:32.384 INFO:tasks.workunit.client.0.smithi100.stdout:2/610: chown d7/db4 1 1 2023-12-05T09:57:32.390 INFO:tasks.workunit.client.1.smithi150.stdout:5/495: fsync d1/d2e/da6/d86/fb7 0 2023-12-05T09:57:32.391 INFO:tasks.workunit.client.1.smithi150.stdout:5/496: fsync d1/d7f/d65/f9f 0 2023-12-05T09:57:32.391 INFO:tasks.workunit.client.1.smithi150.stdout:1/505: creat d6/d8/db/db1/fba x:0 0 0 2023-12-05T09:57:32.391 INFO:tasks.workunit.client.0.smithi100.stdout:6/864: dread d7/d27/d35/d5a/f96 [0,4194304] 0 2023-12-05T09:57:32.391 INFO:tasks.workunit.client.0.smithi100.stdout:8/396: mkdir d0/d35/d63 0 2023-12-05T09:57:32.391 INFO:tasks.workunit.client.0.smithi100.stdout:8/397: fdatasync d0/f5b 0 2023-12-05T09:57:32.392 INFO:tasks.workunit.client.0.smithi100.stdout:5/500: link d0/d4/d14/f8f d0/d1f/d53/fac 0 2023-12-05T09:57:32.392 INFO:tasks.workunit.client.0.smithi100.stdout:5/501: chown d0/d1b/d4d/d8e 3 1 2023-12-05T09:57:32.393 INFO:tasks.workunit.client.1.smithi150.stdout:7/505: symlink d2/d9d/lac 0 2023-12-05T09:57:32.393 INFO:tasks.workunit.client.0.smithi100.stdout:7/457: dwrite d3/dc/f1d [0,4194304] 0 2023-12-05T09:57:32.394 INFO:tasks.workunit.client.0.smithi100.stdout:0/444: link da/d2a/d4d/l3d da/d2a/d71/l86 0 2023-12-05T09:57:32.396 INFO:tasks.workunit.client.0.smithi100.stdout:3/577: symlink d0/d2/de/d11/lc6 0 2023-12-05T09:57:32.396 INFO:tasks.workunit.client.0.smithi100.stdout:3/578: write d0/d2/f6e [2347916,70907] 0 2023-12-05T09:57:32.396 INFO:tasks.workunit.client.1.smithi150.stdout:0/534: mknod d5/d11/d71/d99/d9c/d96/cba 0 2023-12-05T09:57:32.401 INFO:tasks.workunit.client.1.smithi150.stdout:9/457: dread d3/d9/f49 [0,4194304] 0 2023-12-05T09:57:32.402 INFO:tasks.workunit.client.0.smithi100.stdout:1/474: creat db/d12/d1e/f95 x:0 0 0 2023-12-05T09:57:32.402 INFO:tasks.workunit.client.0.smithi100.stdout:4/426: creat de/d16/d23/d33/d3d/d44/f81 x:0 0 0 2023-12-05T09:57:32.402 INFO:tasks.workunit.client.0.smithi100.stdout:2/611: creat d7/da/d18/d1b/d2c/d3f/fd1 x:0 0 0 2023-12-05T09:57:32.402 INFO:tasks.workunit.client.0.smithi100.stdout:2/612: fdatasync d7/d61/f95 0 2023-12-05T09:57:32.411 INFO:tasks.workunit.client.1.smithi150.stdout:1/506: truncate d6/d8/db/de/f39 1048710 0 2023-12-05T09:57:32.411 INFO:tasks.workunit.client.0.smithi100.stdout:9/496: dwrite d7/d1b/d22/f31 [0,4194304] 0 2023-12-05T09:57:32.411 INFO:tasks.workunit.client.0.smithi100.stdout:9/497: readlink d7/d1b/d22/d2a/l2b 0 2023-12-05T09:57:32.411 INFO:tasks.workunit.client.0.smithi100.stdout:9/498: fdatasync d7/d35/d71/d9a/fa3 0 2023-12-05T09:57:32.412 INFO:tasks.workunit.client.1.smithi150.stdout:0/535: mknod d5/cbb 0 2023-12-05T09:57:32.414 INFO:tasks.workunit.client.1.smithi150.stdout:6/437: rename d2/d23/d3b/c3d to d2/d23/d3b/d64/d7a/d5d/d6b/c90 0 2023-12-05T09:57:32.415 INFO:tasks.workunit.client.1.smithi150.stdout:5/497: dread d1/f51 [0,4194304] 0 2023-12-05T09:57:32.415 INFO:tasks.workunit.client.1.smithi150.stdout:7/506: read d2/db/d30/d18/d63/f7b [1133981,58128] 0 2023-12-05T09:57:32.415 INFO:tasks.workunit.client.1.smithi150.stdout:2/518: dread d0/d3/d21/d4d/f84 [0,4194304] 0 2023-12-05T09:57:32.415 INFO:tasks.workunit.client.1.smithi150.stdout:2/519: chown d0/d3/d27/l5b 598789 1 2023-12-05T09:57:32.418 INFO:tasks.workunit.client.0.smithi100.stdout:5/502: truncate d0/d4/d14/d35/f69 336310 0 2023-12-05T09:57:32.418 INFO:tasks.workunit.client.0.smithi100.stdout:5/503: fdatasync d0/d16/f68 0 2023-12-05T09:57:32.419 INFO:tasks.workunit.client.1.smithi150.stdout:3/513: dwrite d6/d9/d3d/d56/f3f [4194304,4194304] 0 2023-12-05T09:57:32.419 INFO:tasks.workunit.client.1.smithi150.stdout:8/520: mkdir d0/da1 0 2023-12-05T09:57:32.419 INFO:tasks.workunit.client.1.smithi150.stdout:8/521: stat d0/d41/d49/d1b/d24/d2e/d4d 0 2023-12-05T09:57:32.419 INFO:tasks.workunit.client.1.smithi150.stdout:8/522: read d0/d41/d49/d1b/f2b [1963,4076] 0 2023-12-05T09:57:32.419 INFO:tasks.workunit.client.1.smithi150.stdout:4/453: write d0/d3e/d5b/d80/f7c [3211397,86517] 0 2023-12-05T09:57:32.422 INFO:tasks.workunit.client.0.smithi100.stdout:7/458: creat d3/dc/d11/d13/d37/fa9 x:0 0 0 2023-12-05T09:57:32.425 INFO:tasks.workunit.client.1.smithi150.stdout:0/536: creat d5/d11/d71/d99/d9c/d3b/fbc x:0 0 0 2023-12-05T09:57:32.426 INFO:tasks.workunit.client.1.smithi150.stdout:0/537: write d5/d11/d32/d57/fa7 [453026,86973] 0 2023-12-05T09:57:32.427 INFO:tasks.workunit.client.0.smithi100.stdout:0/445: mkdir da/d22/d33/d7f/d87 0 2023-12-05T09:57:32.427 INFO:tasks.workunit.client.0.smithi100.stdout:0/446: chown da/d2a/d71/l86 32812631 1 2023-12-05T09:57:32.428 INFO:tasks.workunit.client.0.smithi100.stdout:0/447: readlink da/d2a/d4d/l53 0 2023-12-05T09:57:32.430 INFO:tasks.workunit.client.1.smithi150.stdout:6/438: creat d2/d23/d2e/f91 x:0 0 0 2023-12-05T09:57:32.437 INFO:tasks.workunit.client.1.smithi150.stdout:2/520: symlink d0/da3/dae/lbb 0 2023-12-05T09:57:32.437 INFO:tasks.workunit.client.1.smithi150.stdout:2/521: readlink d0/d3/d11/d1d/l4e 0 2023-12-05T09:57:32.443 INFO:tasks.workunit.client.0.smithi100.stdout:1/475: rename db/d12/d1e/d26/f5e to db/d12/f96 0 2023-12-05T09:57:32.443 INFO:tasks.workunit.client.0.smithi100.stdout:1/476: readlink db/d12/d61/d66/d67/l79 0 2023-12-05T09:57:32.444 INFO:tasks.workunit.client.1.smithi150.stdout:3/514: creat d6/d9/d3d/d56/d71/fa3 x:0 0 0 2023-12-05T09:57:32.445 INFO:tasks.workunit.client.0.smithi100.stdout:2/613: mkdir d7/da/da7/dd2 0 2023-12-05T09:57:32.449 INFO:tasks.workunit.client.1.smithi150.stdout:6/439: write d2/d23/d3b/d83/f71 [1514680,129288] 0 2023-12-05T09:57:32.450 INFO:tasks.workunit.client.1.smithi150.stdout:6/440: dread - d2/d23/d3b/d64/d7a/d5d/d6b/f89 zero size 2023-12-05T09:57:32.450 INFO:tasks.workunit.client.1.smithi150.stdout:2/522: dread d0/d3/d5/d13/d15/d30/d54/d57/fb4 [0,4194304] 0 2023-12-05T09:57:32.454 INFO:tasks.workunit.client.1.smithi150.stdout:0/538: unlink d5/d11/d65/d82/f88 0 2023-12-05T09:57:32.454 INFO:tasks.workunit.client.1.smithi150.stdout:0/539: fsync d5/d11/d65/d82/fab 0 2023-12-05T09:57:32.454 INFO:tasks.workunit.client.1.smithi150.stdout:0/540: truncate d5/f72 1488416 0 2023-12-05T09:57:32.454 INFO:tasks.workunit.client.1.smithi150.stdout:0/541: write d5/d11/d16/f1e [1257834,69537] 0 2023-12-05T09:57:32.457 INFO:tasks.workunit.client.0.smithi100.stdout:5/504: symlink d0/d1f/d25/d31/lad 0 2023-12-05T09:57:32.458 INFO:tasks.workunit.client.0.smithi100.stdout:7/459: mkdir d3/dc/daa 0 2023-12-05T09:57:32.460 INFO:tasks.workunit.client.0.smithi100.stdout:0/448: getdents da/d22 0 2023-12-05T09:57:32.461 INFO:tasks.workunit.client.1.smithi150.stdout:6/441: symlink d2/d23/d3b/d83/l92 0 2023-12-05T09:57:32.465 INFO:tasks.workunit.client.1.smithi150.stdout:0/542: mkdir d5/dbd 0 2023-12-05T09:57:32.465 INFO:tasks.workunit.client.0.smithi100.stdout:4/427: getdents de 0 2023-12-05T09:57:32.466 INFO:tasks.workunit.client.0.smithi100.stdout:4/428: creat de/d16/d23/d33/d3d/d44/f82 x:0 0 0 2023-12-05T09:57:32.466 INFO:tasks.workunit.client.0.smithi100.stdout:1/477: symlink db/d12/d61/d66/d67/l97 0 2023-12-05T09:57:32.466 INFO:tasks.workunit.client.0.smithi100.stdout:1/478: read db/d12/d61/f92 [117606,126330] 0 2023-12-05T09:57:32.466 INFO:tasks.workunit.client.0.smithi100.stdout:9/499: getdents d7/d20 0 2023-12-05T09:57:32.469 INFO:tasks.workunit.client.0.smithi100.stdout:5/505: mkdir d0/d16/d2b/d48/df/d51/d7b/dae 0 2023-12-05T09:57:32.472 INFO:tasks.workunit.client.0.smithi100.stdout:7/460: rename d3/dc/d11/d13/d1b/f6c to d3/dc/d11/d33/fab 0 2023-12-05T09:57:32.474 INFO:tasks.workunit.client.0.smithi100.stdout:8/398: dwrite d0/d12/d13/d16/f46 [0,4194304] 0 2023-12-05T09:57:32.474 INFO:tasks.workunit.client.0.smithi100.stdout:0/449: unlink da/d22/l85 0 2023-12-05T09:57:32.476 INFO:tasks.workunit.client.0.smithi100.stdout:4/429: creat de/d16/f83 x:0 0 0 2023-12-05T09:57:32.480 INFO:tasks.workunit.client.1.smithi150.stdout:6/442: mkdir d2/d23/d2e/d93 0 2023-12-05T09:57:32.480 INFO:tasks.workunit.client.1.smithi150.stdout:6/443: creat d2/d23/d2e/f94 x:0 0 0 2023-12-05T09:57:32.480 INFO:tasks.workunit.client.1.smithi150.stdout:6/444: write d2/d23/d3b/d64/d7a/d5d/d6b/f22 [1997203,108282] 0 2023-12-05T09:57:32.480 INFO:tasks.workunit.client.1.smithi150.stdout:6/445: readlink d2/l30 0 2023-12-05T09:57:32.482 INFO:tasks.workunit.client.0.smithi100.stdout:9/500: symlink d7/d60/la9 0 2023-12-05T09:57:32.482 INFO:tasks.workunit.client.0.smithi100.stdout:5/506: creat d0/d16/d2b/d48/df/d51/d7b/dae/faf x:0 0 0 2023-12-05T09:57:32.484 INFO:tasks.workunit.client.1.smithi150.stdout:0/543: symlink d5/d11/d65/d82/lbe 0 2023-12-05T09:57:32.485 INFO:tasks.workunit.client.0.smithi100.stdout:7/461: unlink d3/dc/d11/d13/de/d18/d3b/d40/fa5 0 2023-12-05T09:57:32.489 INFO:tasks.workunit.client.0.smithi100.stdout:8/399: mkdir d0/d35/d64 0 2023-12-05T09:57:32.489 INFO:tasks.workunit.client.0.smithi100.stdout:8/400: fsync d0/d35/f39 0 2023-12-05T09:57:32.489 INFO:tasks.workunit.client.0.smithi100.stdout:8/401: creat d0/d12/d13/d16/d22/f65 x:0 0 0 2023-12-05T09:57:32.490 INFO:tasks.workunit.client.0.smithi100.stdout:0/450: creat da/d1b/d6b/d78/f88 x:0 0 0 2023-12-05T09:57:32.492 INFO:tasks.workunit.client.0.smithi100.stdout:4/430: creat de/d16/d23/d36/d7d/f84 x:0 0 0 2023-12-05T09:57:32.492 INFO:tasks.workunit.client.0.smithi100.stdout:4/431: chown de/d16/d23/f29 14422 1 2023-12-05T09:57:32.492 INFO:tasks.workunit.client.0.smithi100.stdout:1/479: rmdir db/d12/d1e/d26/d39 39 2023-12-05T09:57:32.494 INFO:tasks.workunit.client.0.smithi100.stdout:5/507: truncate d0/d1b/f32 520385 0 2023-12-05T09:57:32.494 INFO:tasks.workunit.client.1.smithi150.stdout:6/446: dread d2/d23/d2e/d44/f54 [0,4194304] 0 2023-12-05T09:57:32.496 INFO:tasks.workunit.client.0.smithi100.stdout:4/432: truncate de/d16/f52 2326891 0 2023-12-05T09:57:32.500 INFO:tasks.workunit.client.0.smithi100.stdout:4/433: unlink de/d16/d23/f47 0 2023-12-05T09:57:32.501 INFO:tasks.workunit.client.1.smithi150.stdout:0/544: creat d5/d11/d32/fbf x:0 0 0 2023-12-05T09:57:32.503 INFO:tasks.workunit.client.0.smithi100.stdout:4/434: mkdir de/d16/d23/d33/d3d/d44/d4e/d85 0 2023-12-05T09:57:32.504 INFO:tasks.workunit.client.0.smithi100.stdout:4/435: chown de/d16/d23/l27 904 1 2023-12-05T09:57:32.504 INFO:tasks.workunit.client.0.smithi100.stdout:4/436: write de/d16/d23/f58 [1396213,122508] 0 2023-12-05T09:57:32.505 INFO:tasks.workunit.client.0.smithi100.stdout:4/437: mkdir de/d38/d86 0 2023-12-05T09:57:32.506 INFO:tasks.workunit.client.0.smithi100.stdout:4/438: creat de/d16/d23/d33/d3d/d44/d4e/f87 x:0 0 0 2023-12-05T09:57:32.511 INFO:tasks.workunit.client.0.smithi100.stdout:5/508: write d0/d16/d2b/f91 [3231993,18647] 0 2023-12-05T09:57:32.514 INFO:tasks.workunit.client.0.smithi100.stdout:5/509: unlink d0/d1f/d53/f5a 0 2023-12-05T09:57:32.514 INFO:tasks.workunit.client.0.smithi100.stdout:5/510: stat d0/d1f/da1/laa 0 2023-12-05T09:57:32.516 INFO:tasks.workunit.client.0.smithi100.stdout:5/511: symlink d0/d1b/d4d/d60/lb0 0 2023-12-05T09:57:32.516 INFO:tasks.workunit.client.0.smithi100.stdout:5/512: chown d0/d1b/d4d/d60/lb0 9897457 1 2023-12-05T09:57:32.527 INFO:tasks.workunit.client.0.smithi100.stdout:9/501: dread d7/d1b/d22/d2a/d56/f6e [0,4194304] 0 2023-12-05T09:57:32.533 INFO:tasks.workunit.client.1.smithi150.stdout:0/545: rename d5/f5b to d5/d11/d71/d99/d9c/fc0 0 2023-12-05T09:57:32.534 INFO:tasks.workunit.client.1.smithi150.stdout:0/546: stat d5/d11/d16/d1f/d7f/c9b 0 2023-12-05T09:57:32.534 INFO:tasks.workunit.client.1.smithi150.stdout:0/547: stat d5/d11/d65/d82 0 2023-12-05T09:57:32.536 INFO:tasks.workunit.client.0.smithi100.stdout:5/513: write d0/d16/d2b/d48/f5d [2509542,122755] 0 2023-12-05T09:57:32.538 INFO:tasks.workunit.client.0.smithi100.stdout:4/439: write de/d66/f6c [211228,54157] 0 2023-12-05T09:57:32.543 INFO:tasks.workunit.client.0.smithi100.stdout:9/502: mkdir d7/d1b/d22/d2a/d56/d9c/daa 0 2023-12-05T09:57:32.543 INFO:tasks.workunit.client.0.smithi100.stdout:9/503: truncate d7/fb 5176939 0 2023-12-05T09:57:32.545 INFO:tasks.workunit.client.0.smithi100.stdout:4/440: mkdir de/d16/d23/d60/d88 0 2023-12-05T09:57:32.547 INFO:tasks.workunit.client.0.smithi100.stdout:3/579: dwrite d0/d2/d33/fae [0,4194304] 0 2023-12-05T09:57:32.547 INFO:tasks.workunit.client.1.smithi150.stdout:0/548: mkdir d5/d11/d71/d99/d9c/d96/dc1 0 2023-12-05T09:57:32.549 INFO:tasks.workunit.client.0.smithi100.stdout:9/504: link d7/d1b/d22/d2a/d56/d2e/l7d d7/d1b/lab 0 2023-12-05T09:57:32.549 INFO:tasks.workunit.client.0.smithi100.stdout:9/505: fdatasync d7/d20/d68/f6f 0 2023-12-05T09:57:32.552 INFO:tasks.workunit.client.0.smithi100.stdout:4/441: symlink de/d16/d23/d60/d88/l89 0 2023-12-05T09:57:32.553 INFO:tasks.workunit.client.0.smithi100.stdout:4/442: readlink de/d16/d23/d33/l72 0 2023-12-05T09:57:32.554 INFO:tasks.workunit.client.1.smithi150.stdout:0/549: write d5/d11/f26 [231309,67818] 0 2023-12-05T09:57:32.554 INFO:tasks.workunit.client.1.smithi150.stdout:0/550: rename d5/d11/d32 to d5/d11/d32/dc2 22 2023-12-05T09:57:32.556 INFO:tasks.workunit.client.0.smithi100.stdout:3/580: symlink d0/d3d/d5c/d5f/d67/da4/lc7 0 2023-12-05T09:57:32.559 INFO:tasks.workunit.client.0.smithi100.stdout:3/581: write d0/d2/de/f47 [748040,61368] 0 2023-12-05T09:57:32.559 INFO:tasks.workunit.client.0.smithi100.stdout:2/614: dwrite d7/da/f9c [0,4194304] 0 2023-12-05T09:57:32.559 INFO:tasks.workunit.client.0.smithi100.stdout:7/462: dread d3/dc/d11/d13/de/d2d/f6d [0,4194304] 0 2023-12-05T09:57:32.560 INFO:tasks.workunit.client.1.smithi150.stdout:7/507: dread d2/db/d17/d20/fab [4194304,4194304] 0 2023-12-05T09:57:32.566 INFO:tasks.workunit.client.0.smithi100.stdout:9/506: creat d7/d1b/d22/fac x:0 0 0 2023-12-05T09:57:32.568 INFO:tasks.workunit.client.0.smithi100.stdout:0/451: dwrite da/d22/d33/f6a [0,4194304] 0 2023-12-05T09:57:32.570 INFO:tasks.workunit.client.1.smithi150.stdout:0/551: symlink d5/d11/d16/d1f/d67/lc3 0 2023-12-05T09:57:32.574 INFO:tasks.workunit.client.0.smithi100.stdout:4/443: creat de/d16/d23/d33/d3d/d44/d4e/d80/f8a x:0 0 0 2023-12-05T09:57:32.578 INFO:tasks.workunit.client.1.smithi150.stdout:7/508: getdents d2/db/d30/d13/d4f/d5a 0 2023-12-05T09:57:32.582 INFO:tasks.workunit.client.1.smithi150.stdout:8/523: dread d0/ff [0,4194304] 0 2023-12-05T09:57:32.583 INFO:tasks.workunit.client.1.smithi150.stdout:8/524: fsync d0/d41/d49/d1b/f1d 0 2023-12-05T09:57:32.583 INFO:tasks.workunit.client.1.smithi150.stdout:8/525: stat d0/d41/d49/d1b/d24/d34/d56/d67/d64 0 2023-12-05T09:57:32.583 INFO:tasks.workunit.client.1.smithi150.stdout:7/509: creat d2/db/d17/d3a/fad x:0 0 0 2023-12-05T09:57:32.584 INFO:tasks.workunit.client.0.smithi100.stdout:3/582: mknod d0/d3d/d5c/d6f/d7f/cc8 0 2023-12-05T09:57:32.584 INFO:tasks.workunit.client.0.smithi100.stdout:3/583: chown d0/d2/f23 437237 1 2023-12-05T09:57:32.584 INFO:tasks.workunit.client.0.smithi100.stdout:3/584: chown d0/d2/de/d8d/fc1 24 1 2023-12-05T09:57:32.586 INFO:tasks.workunit.client.1.smithi150.stdout:7/510: read d2/d4/f42 [88886,119993] 0 2023-12-05T09:57:32.596 INFO:tasks.workunit.client.0.smithi100.stdout:9/507: mknod d7/d1b/d22/d51/d32/cad 0 2023-12-05T09:57:32.598 INFO:tasks.workunit.client.1.smithi150.stdout:8/526: mkdir d0/d41/d49/d1b/d24/d34/da2 0 2023-12-05T09:57:32.599 INFO:tasks.workunit.client.0.smithi100.stdout:0/452: fdatasync da/d22/f3b 0 2023-12-05T09:57:32.600 INFO:tasks.workunit.client.1.smithi150.stdout:7/511: symlink d2/db/d30/d18/d1a/d1e/lae 0 2023-12-05T09:57:32.603 INFO:tasks.workunit.client.1.smithi150.stdout:3/515: dwrite d6/d9/f32 [0,4194304] 0 2023-12-05T09:57:32.603 INFO:tasks.workunit.client.0.smithi100.stdout:4/444: mkdir de/d38/d8b 0 2023-12-05T09:57:32.604 INFO:tasks.workunit.client.1.smithi150.stdout:2/523: dwrite d0/d3/d11/f23 [0,4194304] 0 2023-12-05T09:57:32.604 INFO:tasks.workunit.client.1.smithi150.stdout:2/524: chown d0/d3/d5/d10/d3d/da1 1 1 2023-12-05T09:57:32.605 INFO:tasks.workunit.client.1.smithi150.stdout:9/458: dwrite d3/d1b/d46/d55/d64/f88 [0,4194304] 0 2023-12-05T09:57:32.605 INFO:tasks.workunit.client.1.smithi150.stdout:2/525: creat d0/da3/fbc x:0 0 0 2023-12-05T09:57:32.605 INFO:tasks.workunit.client.1.smithi150.stdout:2/526: truncate d0/d3/d5/d36/d86/fa0 828535 0 2023-12-05T09:57:32.605 INFO:tasks.workunit.client.0.smithi100.stdout:5/514: dwrite d0/d16/d2b/fa4 [0,4194304] 0 2023-12-05T09:57:32.605 INFO:tasks.workunit.client.0.smithi100.stdout:6/865: dwrite d7/d27/d97/fea [0,4194304] 0 2023-12-05T09:57:32.606 INFO:tasks.workunit.client.0.smithi100.stdout:3/585: mkdir d0/d2/de/d8d/dc9 0 2023-12-05T09:57:32.606 INFO:tasks.workunit.client.0.smithi100.stdout:3/586: chown d0/l4d 447 1 2023-12-05T09:57:32.607 INFO:tasks.workunit.client.1.smithi150.stdout:8/527: mknod d0/d41/d49/d1b/d24/d34/d56/ca3 0 2023-12-05T09:57:32.607 INFO:tasks.workunit.client.1.smithi150.stdout:8/528: write d0/d41/d49/d1b/d24/d38/d62/f65 [1040441,55619] 0 2023-12-05T09:57:32.608 INFO:tasks.workunit.client.1.smithi150.stdout:7/512: mkdir d2/db/d30/daf 0 2023-12-05T09:57:32.610 INFO:tasks.workunit.client.0.smithi100.stdout:7/463: getdents d3/dc/d11/d13/d37 0 2023-12-05T09:57:32.610 INFO:tasks.workunit.client.0.smithi100.stdout:7/464: write d3/dc/d11/d13/de/d18/d3b/d40/d46/f5c [5571889,28742] 0 2023-12-05T09:57:32.613 INFO:tasks.workunit.client.0.smithi100.stdout:2/615: dwrite d7/da/d13/d69/fc6 [0,4194304] 0 2023-12-05T09:57:32.620 INFO:tasks.workunit.client.1.smithi150.stdout:8/529: dread d0/d41/d49/d1b/f2b [0,4194304] 0 2023-12-05T09:57:32.620 INFO:tasks.workunit.client.1.smithi150.stdout:8/530: creat d0/d41/d49/d1b/fa4 x:0 0 0 2023-12-05T09:57:32.620 INFO:tasks.workunit.client.1.smithi150.stdout:8/531: creat d0/d41/d49/d1b/d24/d2e/fa5 x:0 0 0 2023-12-05T09:57:32.621 INFO:tasks.workunit.client.1.smithi150.stdout:3/516: mkdir d6/d22/da4 0 2023-12-05T09:57:32.630 INFO:tasks.workunit.client.0.smithi100.stdout:0/453: dread da/d2a/f56 [0,4194304] 0 2023-12-05T09:57:32.631 INFO:tasks.workunit.client.0.smithi100.stdout:0/454: rename da/d22 to da/d22/d33/d35/d89 22 2023-12-05T09:57:32.631 INFO:tasks.workunit.client.0.smithi100.stdout:0/455: fsync da/f30 0 2023-12-05T09:57:32.631 INFO:tasks.workunit.client.0.smithi100.stdout:4/445: mknod de/d16/d23/d33/d3d/d44/d4e/c8c 0 2023-12-05T09:57:32.631 INFO:tasks.workunit.client.0.smithi100.stdout:9/508: creat d7/d1b/d22/d2a/d56/d9c/fae x:0 0 0 2023-12-05T09:57:32.631 INFO:tasks.workunit.client.0.smithi100.stdout:7/465: write d3/dc/d11/d13/de/f2b [1615164,69783] 0 2023-12-05T09:57:32.631 INFO:tasks.workunit.client.0.smithi100.stdout:8/402: getdents d0/d12/d13/d16/d22 0 2023-12-05T09:57:32.631 INFO:tasks.workunit.client.0.smithi100.stdout:7/466: write d3/dc/d11/d13/de/f28 [2580818,128129] 0 2023-12-05T09:57:32.636 INFO:tasks.workunit.client.0.smithi100.stdout:2/616: dread d7/da/d65/f77 [0,4194304] 0 2023-12-05T09:57:32.639 INFO:tasks.workunit.client.1.smithi150.stdout:9/459: mkdir d3/d9/dc/d91 0 2023-12-05T09:57:32.642 INFO:tasks.workunit.client.1.smithi150.stdout:2/527: truncate d0/d3/d5/d10/f45 1394009 0 2023-12-05T09:57:32.642 INFO:tasks.workunit.client.1.smithi150.stdout:2/528: readlink d0/d3/d5/d13/d15/l17 0 2023-12-05T09:57:32.645 INFO:tasks.workunit.client.0.smithi100.stdout:5/515: symlink d0/lb1 0 2023-12-05T09:57:32.645 INFO:tasks.workunit.client.0.smithi100.stdout:5/516: readlink d0/d1b/d4d/d60/lb0 0 2023-12-05T09:57:32.645 INFO:tasks.workunit.client.0.smithi100.stdout:5/517: stat d0/d16/d2b/d48/f95 0 2023-12-05T09:57:32.645 INFO:tasks.workunit.client.1.smithi150.stdout:7/513: symlink d2/db/d17/d20/lb0 0 2023-12-05T09:57:32.646 INFO:tasks.workunit.client.1.smithi150.stdout:7/514: chown d2/db/d30/d53/d90 161493 1 2023-12-05T09:57:32.647 INFO:tasks.workunit.client.0.smithi100.stdout:3/587: creat d0/d2/de/d12/d9b/fca x:0 0 0 2023-12-05T09:57:32.647 INFO:tasks.workunit.client.0.smithi100.stdout:3/588: fdatasync d0/d2/de/d11/f21 0 2023-12-05T09:57:32.648 INFO:tasks.workunit.client.0.smithi100.stdout:3/589: readlink d0/d2/de/d11/l2b 0 2023-12-05T09:57:32.648 INFO:tasks.workunit.client.0.smithi100.stdout:3/590: write d0/d3d/fb2 [365473,61739] 0 2023-12-05T09:57:32.656 INFO:tasks.workunit.client.1.smithi150.stdout:8/532: symlink d0/d41/d49/d1b/d24/d38/d62/la6 0 2023-12-05T09:57:32.659 INFO:tasks.workunit.client.1.smithi150.stdout:3/517: mknod d6/d22/d37/d63/ca5 0 2023-12-05T09:57:32.660 INFO:tasks.workunit.client.0.smithi100.stdout:4/446: creat de/f8d x:0 0 0 2023-12-05T09:57:32.671 INFO:tasks.workunit.client.0.smithi100.stdout:9/509: mkdir d7/d1b/d22/d2a/d56/daf 0 2023-12-05T09:57:32.676 INFO:tasks.workunit.client.0.smithi100.stdout:8/403: link d0/d12/f48 d0/d12/d13/d16/d42/d43/f66 0 2023-12-05T09:57:32.678 INFO:tasks.workunit.client.0.smithi100.stdout:6/866: dwrite d7/d11/f99 [0,4194304] 0 2023-12-05T09:57:32.678 INFO:tasks.workunit.client.0.smithi100.stdout:2/617: dread d7/da/d18/f62 [4194304,4194304] 0 2023-12-05T09:57:32.678 INFO:tasks.workunit.client.0.smithi100.stdout:2/618: dread - d7/da/d18/d21/dae/fcd zero size 2023-12-05T09:57:32.681 INFO:tasks.workunit.client.1.smithi150.stdout:9/460: unlink d3/d42/d62/f5c 0 2023-12-05T09:57:32.681 INFO:tasks.workunit.client.1.smithi150.stdout:9/461: write d3/d9/f2f [484707,79924] 0 2023-12-05T09:57:32.684 INFO:tasks.workunit.client.0.smithi100.stdout:7/467: mknod d3/dc/d11/d13/d37/d97/cac 0 2023-12-05T09:57:32.686 INFO:tasks.workunit.client.0.smithi100.stdout:9/510: dread d7/d35/d71/f78 [0,4194304] 0 2023-12-05T09:57:32.687 INFO:tasks.workunit.client.0.smithi100.stdout:4/447: mknod de/d16/d23/d36/c8e 0 2023-12-05T09:57:32.687 INFO:tasks.workunit.client.0.smithi100.stdout:4/448: readlink de/d16/d23/l7e 0 2023-12-05T09:57:32.687 INFO:tasks.workunit.client.1.smithi150.stdout:9/462: dread d3/d9/d26/d34/f5b [0,4194304] 0 2023-12-05T09:57:32.690 INFO:tasks.workunit.client.0.smithi100.stdout:8/404: mknod d0/d12/d13/d16/d42/c67 0 2023-12-05T09:57:32.690 INFO:tasks.workunit.client.0.smithi100.stdout:8/405: chown d0/d12/d13/d16/f46 29349447 1 2023-12-05T09:57:32.690 INFO:tasks.workunit.client.0.smithi100.stdout:8/406: chown d0/d12/d13/d45/l4b 1 1 2023-12-05T09:57:32.691 INFO:tasks.workunit.client.1.smithi150.stdout:9/463: write d3/d9/dc/f1d [69688,115365] 0 2023-12-05T09:57:32.698 INFO:tasks.workunit.client.0.smithi100.stdout:3/591: dwrite d0/d10/d39/f51 [0,4194304] 0 2023-12-05T09:57:32.702 INFO:tasks.workunit.client.1.smithi150.stdout:7/515: symlink d2/d1b/d5b/lb1 0 2023-12-05T09:57:32.702 INFO:tasks.workunit.client.1.smithi150.stdout:7/516: fdatasync d2/d39/f64 0 2023-12-05T09:57:32.706 INFO:tasks.workunit.client.0.smithi100.stdout:5/518: dwrite d0/d16/d2b/d48/f95 [0,4194304] 0 2023-12-05T09:57:32.710 INFO:tasks.workunit.client.1.smithi150.stdout:8/533: truncate d0/d41/d49/d1b/f1c 348248 0 2023-12-05T09:57:32.710 INFO:tasks.workunit.client.1.smithi150.stdout:8/534: write d0/d41/d49/d1b/f1d [724806,32232] 0 2023-12-05T09:57:32.710 INFO:tasks.workunit.client.0.smithi100.stdout:7/468: dread d3/dc/d11/d13/d1b/d60/f75 [0,4194304] 0 2023-12-05T09:57:32.710 INFO:tasks.workunit.client.0.smithi100.stdout:2/619: truncate d7/da/d1a/f45 3348462 0 2023-12-05T09:57:32.710 INFO:tasks.workunit.client.0.smithi100.stdout:7/469: write d3/dc/d11/d13/de/d18/d3b/d40/d46/f95 [143317,46968] 0 2023-12-05T09:57:32.711 INFO:tasks.workunit.client.0.smithi100.stdout:8/407: dread d0/d12/d13/d45/f58 [0,4194304] 0 2023-12-05T09:57:32.711 INFO:tasks.workunit.client.1.smithi150.stdout:3/518: symlink d6/d9/d3d/d87/la6 0 2023-12-05T09:57:32.713 INFO:tasks.workunit.client.0.smithi100.stdout:0/456: dwrite da/d22/f2b [0,4194304] 0 2023-12-05T09:57:32.716 INFO:tasks.workunit.client.0.smithi100.stdout:4/449: creat de/d16/d23/d60/d88/f8f x:0 0 0 2023-12-05T09:57:32.716 INFO:tasks.workunit.client.0.smithi100.stdout:4/450: dread - de/d16/d1e/f62 zero size 2023-12-05T09:57:32.716 INFO:tasks.workunit.client.1.smithi150.stdout:2/529: rmdir d0/d42 39 2023-12-05T09:57:32.722 INFO:tasks.workunit.client.0.smithi100.stdout:3/592: symlink d0/d2/de/d11/db5/lcb 0 2023-12-05T09:57:32.726 INFO:tasks.workunit.client.1.smithi150.stdout:7/517: dread d2/d1b/d5b/f9c [0,4194304] 0 2023-12-05T09:57:32.731 INFO:tasks.workunit.client.1.smithi150.stdout:7/518: dread d2/db/d2e/d71/f8f [0,4194304] 0 2023-12-05T09:57:32.734 INFO:tasks.workunit.client.1.smithi150.stdout:3/519: truncate d6/d25/d28/f2e 1760135 0 2023-12-05T09:57:32.737 INFO:tasks.workunit.client.0.smithi100.stdout:7/470: mknod d3/dc/d11/d13/de/d18/d3b/d40/d4c/cad 0 2023-12-05T09:57:32.740 INFO:tasks.workunit.client.1.smithi150.stdout:9/464: dwrite d3/d9/d6e/f8a [0,4194304] 0 2023-12-05T09:57:32.740 INFO:tasks.workunit.client.1.smithi150.stdout:9/465: write d3/d1b/f59 [1001092,89885] 0 2023-12-05T09:57:32.741 INFO:tasks.workunit.client.0.smithi100.stdout:0/457: creat da/d1b/d73/d82/f8a x:0 0 0 2023-12-05T09:57:32.741 INFO:tasks.workunit.client.0.smithi100.stdout:0/458: chown da/d2a/l5e 378700 1 2023-12-05T09:57:32.741 INFO:tasks.workunit.client.0.smithi100.stdout:0/459: readlink da/d2a/l2e 0 2023-12-05T09:57:32.743 INFO:tasks.workunit.client.0.smithi100.stdout:4/451: symlink de/d16/d23/d33/d3d/l90 0 2023-12-05T09:57:32.746 INFO:tasks.workunit.client.1.smithi150.stdout:3/520: creat d6/d22/d37/da1/fa7 x:0 0 0 2023-12-05T09:57:32.747 INFO:tasks.workunit.client.1.smithi150.stdout:5/498: sync 2023-12-05T09:57:32.749 INFO:tasks.workunit.client.0.smithi100.stdout:7/471: dread d3/dc/d11/d13/f84 [0,4194304] 0 2023-12-05T09:57:32.751 INFO:tasks.workunit.client.0.smithi100.stdout:0/460: mkdir da/d22/d33/d35/d3a/d8b 0 2023-12-05T09:57:32.754 INFO:tasks.workunit.client.1.smithi150.stdout:0/552: sync 2023-12-05T09:57:32.754 INFO:tasks.workunit.client.1.smithi150.stdout:1/507: sync 2023-12-05T09:57:32.755 INFO:tasks.workunit.client.1.smithi150.stdout:4/454: sync 2023-12-05T09:57:32.755 INFO:tasks.workunit.client.1.smithi150.stdout:6/447: sync 2023-12-05T09:57:32.758 INFO:tasks.workunit.client.1.smithi150.stdout:9/466: rename d3/d9/f54 to d3/d9/dc/f92 0 2023-12-05T09:57:32.758 INFO:tasks.workunit.client.1.smithi150.stdout:9/467: readlink d3/d9/dc/l8d 0 2023-12-05T09:57:32.758 INFO:tasks.workunit.client.1.smithi150.stdout:9/468: readlink d3/d9/dc/l61 0 2023-12-05T09:57:32.758 INFO:tasks.workunit.client.1.smithi150.stdout:9/469: fdatasync d3/d42/f8e 0 2023-12-05T09:57:32.760 INFO:tasks.workunit.client.1.smithi150.stdout:5/499: rmdir d1/d7f/d65/d3b 39 2023-12-05T09:57:32.762 INFO:tasks.workunit.client.0.smithi100.stdout:7/472: symlink d3/dc/d11/d13/de/d18/lae 0 2023-12-05T09:57:32.765 INFO:tasks.workunit.client.1.smithi150.stdout:1/508: creat d6/d47/d4c/d7c/fbb x:0 0 0 2023-12-05T09:57:32.765 INFO:tasks.workunit.client.1.smithi150.stdout:1/509: readlink d6/d3c/l8b 0 2023-12-05T09:57:32.766 INFO:tasks.workunit.client.1.smithi150.stdout:8/535: dwrite d0/d41/d49/d1b/d24/d38/d62/f65 [0,4194304] 0 2023-12-05T09:57:32.766 INFO:tasks.workunit.client.1.smithi150.stdout:8/536: dread - d0/d41/d49/d1b/d24/d38/f78 zero size 2023-12-05T09:57:32.766 INFO:tasks.workunit.client.1.smithi150.stdout:8/537: fsync d0/d41/d49/f59 0 2023-12-05T09:57:32.768 INFO:tasks.workunit.client.0.smithi100.stdout:0/461: rename da/d2a/d71 to da/d2a/d8c 0 2023-12-05T09:57:32.768 INFO:tasks.workunit.client.0.smithi100.stdout:0/462: write da/d22/d33/d7f/f81 [283433,101533] 0 2023-12-05T09:57:32.768 INFO:tasks.workunit.client.0.smithi100.stdout:0/463: write da/d22/d33/d74/f84 [466145,56646] 0 2023-12-05T09:57:32.768 INFO:tasks.workunit.client.0.smithi100.stdout:0/464: truncate da/f2d 6787327 0 2023-12-05T09:57:32.768 INFO:tasks.workunit.client.0.smithi100.stdout:0/465: chown da/d22/d33/d35/d3a/c42 11625069 1 2023-12-05T09:57:32.777 INFO:tasks.workunit.client.0.smithi100.stdout:0/466: rename da/l5d to da/d2a/d8c/l8d 0 2023-12-05T09:57:32.777 INFO:tasks.workunit.client.0.smithi100.stdout:0/467: write da/f30 [236655,16639] 0 2023-12-05T09:57:32.779 INFO:tasks.workunit.client.1.smithi150.stdout:6/448: rename d2/d23/d2e/d44/d7d to d2/d23/d2e/d95 0 2023-12-05T09:57:32.779 INFO:tasks.workunit.client.1.smithi150.stdout:9/470: mknod d3/d9/d58/c93 0 2023-12-05T09:57:32.781 INFO:tasks.workunit.client.1.smithi150.stdout:7/519: dwrite d2/db/d30/d18/d1a/d1e/f21 [8388608,4194304] 0 2023-12-05T09:57:32.782 INFO:tasks.workunit.client.1.smithi150.stdout:5/500: symlink d1/d64/lb8 0 2023-12-05T09:57:32.787 INFO:tasks.workunit.client.0.smithi100.stdout:4/452: getdents de/d16/d23/d60/d88 0 2023-12-05T09:57:32.787 INFO:tasks.workunit.client.0.smithi100.stdout:4/453: chown de/d16/d23/d33/d51/l74 224263 1 2023-12-05T09:57:32.791 INFO:tasks.workunit.client.1.smithi150.stdout:2/530: dwrite d0/d3/d5/d36/fb5 [0,4194304] 0 2023-12-05T09:57:32.791 INFO:tasks.workunit.client.0.smithi100.stdout:0/468: rename da/d22/l50 to da/d1b/d73/d82/l8e 0 2023-12-05T09:57:32.791 INFO:tasks.workunit.client.0.smithi100.stdout:2/620: dwrite d7/da/d18/d1b/d2c/f70 [0,4194304] 0 2023-12-05T09:57:32.799 INFO:tasks.workunit.client.1.smithi150.stdout:8/538: rmdir d0/d41/d49/d1b/d24/d34/d56/d67/d64 39 2023-12-05T09:57:32.799 INFO:tasks.workunit.client.1.smithi150.stdout:8/539: fdatasync d0/d41/d49/d1b/d24/d34/d56/f8f 0 2023-12-05T09:57:32.799 INFO:tasks.workunit.client.1.smithi150.stdout:6/449: read d2/d23/f3f [1175698,121991] 0 2023-12-05T09:57:32.799 INFO:tasks.workunit.client.0.smithi100.stdout:5/519: write d0/d4/d14/d35/f69 [282521,10914] 0 2023-12-05T09:57:32.799 INFO:tasks.workunit.client.0.smithi100.stdout:5/520: creat d0/d16/d2b/d48/df/d51/d7b/dae/fb2 x:0 0 0 2023-12-05T09:57:32.799 INFO:tasks.workunit.client.0.smithi100.stdout:5/521: fsync d0/d1b/fa5 0 2023-12-05T09:57:32.839 INFO:tasks.workunit.client.1.smithi150.stdout:2/531: write d0/d3/f99 [3320635,58681] 0 2023-12-05T09:57:32.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:32 smithi150 ceph-mon[116142]: pgmap v32: 65 pgs: 65 active+clean; 1.8 GiB data, 7.0 GiB used, 529 GiB / 536 GiB avail; 193 MiB/s rd, 226 MiB/s wr, 352 op/s 2023-12-05T09:57:32.873 INFO:tasks.workunit.client.1.smithi150.stdout:7/520: truncate d2/db/d30/d18/d1a/f68 2552680 0 2023-12-05T09:57:32.875 INFO:tasks.workunit.client.1.smithi150.stdout:4/455: dwrite d0/d5f/f68 [0,4194304] 0 2023-12-05T09:57:32.875 INFO:tasks.workunit.client.0.smithi100.stdout:8/408: dwrite d0/f9 [0,4194304] 0 2023-12-05T09:57:32.876 INFO:tasks.workunit.client.0.smithi100.stdout:8/409: creat d0/d35/f68 x:0 0 0 2023-12-05T09:57:32.876 INFO:tasks.workunit.client.0.smithi100.stdout:8/410: truncate d0/f9 9511243 0 2023-12-05T09:57:32.877 INFO:tasks.workunit.client.1.smithi150.stdout:1/510: rmdir d6/d3c 39 2023-12-05T09:57:32.882 INFO:tasks.workunit.client.0.smithi100.stdout:8/411: read d0/d12/d13/d45/f4f [137651,38965] 0 2023-12-05T09:57:32.883 INFO:tasks.workunit.client.1.smithi150.stdout:6/450: rename d2/d23/d3b/d46/l5c to d2/d23/d2e/d95/l96 0 2023-12-05T09:57:32.884 INFO:tasks.workunit.client.1.smithi150.stdout:6/451: readlink d2/d23/d2e/d44/l6e 0 2023-12-05T09:57:32.884 INFO:tasks.workunit.client.1.smithi150.stdout:6/452: chown d2/d23/d3b/d83/f71 47530235 1 2023-12-05T09:57:32.886 INFO:tasks.workunit.client.1.smithi150.stdout:5/501: dwrite d1/d64/d31/f49 [0,4194304] 0 2023-12-05T09:57:32.886 INFO:tasks.workunit.client.1.smithi150.stdout:5/502: truncate d1/d2e/f90 1501058 0 2023-12-05T09:57:32.886 INFO:tasks.workunit.client.1.smithi150.stdout:5/503: fdatasync d1/d3/f7 0 2023-12-05T09:57:32.886 INFO:tasks.workunit.client.1.smithi150.stdout:5/504: getdents d1/d3/d6/d26/d9a 0 2023-12-05T09:57:32.886 INFO:tasks.workunit.client.1.smithi150.stdout:5/505: write d1/d2e/da6/d24/f41 [1425933,96207] 0 2023-12-05T09:57:32.887 INFO:tasks.workunit.client.1.smithi150.stdout:2/532: getdents d0/d3/d27/d51 0 2023-12-05T09:57:32.887 INFO:tasks.workunit.client.1.smithi150.stdout:2/533: write d0/d3/d5/d10/f20 [206767,130077] 0 2023-12-05T09:57:32.887 INFO:tasks.workunit.client.1.smithi150.stdout:5/506: write d1/d2e/f90 [1148650,128118] 0 2023-12-05T09:57:32.888 INFO:tasks.workunit.client.0.smithi100.stdout:3/593: write d0/d2/f37 [375696,103632] 0 2023-12-05T09:57:32.891 INFO:tasks.workunit.client.1.smithi150.stdout:7/521: mkdir d2/d72/db2 0 2023-12-05T09:57:32.891 INFO:tasks.workunit.client.1.smithi150.stdout:7/522: fsync d2/db/d2e/f76 0 2023-12-05T09:57:32.893 INFO:tasks.workunit.client.0.smithi100.stdout:6/867: dwrite d7/fee [0,4194304] 0 2023-12-05T09:57:32.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:32 smithi100 ceph-mon[107145]: pgmap v32: 65 pgs: 65 active+clean; 1.8 GiB data, 7.0 GiB used, 529 GiB / 536 GiB avail; 193 MiB/s rd, 226 MiB/s wr, 352 op/s 2023-12-05T09:57:32.898 INFO:tasks.workunit.client.1.smithi150.stdout:7/523: dread d2/d1b/d91/fa3 [0,4194304] 0 2023-12-05T09:57:32.903 INFO:tasks.workunit.client.1.smithi150.stdout:4/456: dread d0/fc [0,4194304] 0 2023-12-05T09:57:32.910 INFO:tasks.workunit.client.1.smithi150.stdout:2/534: write d0/d3/d5/d22/d52/d56/f73 [3838671,69258] 0 2023-12-05T09:57:32.911 INFO:tasks.workunit.client.1.smithi150.stdout:5/507: unlink d1/d64/d31/l53 0 2023-12-05T09:57:32.912 INFO:tasks.workunit.client.0.smithi100.stdout:0/469: mkdir da/d22/d33/d35/d3a/d8b/d8f 0 2023-12-05T09:57:32.914 INFO:tasks.workunit.client.1.smithi150.stdout:1/511: getdents d6/d8/db/db1 0 2023-12-05T09:57:32.914 INFO:tasks.workunit.client.1.smithi150.stdout:1/512: readlink d6/d3c/l58 0 2023-12-05T09:57:32.914 INFO:tasks.workunit.client.1.smithi150.stdout:1/513: write d6/d3c/fa9 [488854,106882] 0 2023-12-05T09:57:32.917 INFO:tasks.workunit.client.1.smithi150.stdout:4/457: creat d0/d3e/d5b/d80/f87 x:0 0 0 2023-12-05T09:57:32.917 INFO:tasks.workunit.client.1.smithi150.stdout:4/458: fdatasync d0/d3e/f6b 0 2023-12-05T09:57:32.919 INFO:tasks.workunit.client.1.smithi150.stdout:8/540: dwrite d0/d41/d49/d1b/f1c [0,4194304] 0 2023-12-05T09:57:32.920 INFO:tasks.workunit.client.1.smithi150.stdout:8/541: write d0/d41/d49/d1b/d24/d2e/f5e [1076691,19239] 0 2023-12-05T09:57:32.920 INFO:tasks.workunit.client.0.smithi100.stdout:2/621: truncate d7/f66 3336820 0 2023-12-05T09:57:32.920 INFO:tasks.workunit.client.1.smithi150.stdout:8/542: write d0/d41/d49/d1b/d24/d38/f78 [396953,63358] 0 2023-12-05T09:57:32.920 INFO:tasks.workunit.client.1.smithi150.stdout:8/543: dread - d0/d41/d49/d1b/fa4 zero size 2023-12-05T09:57:32.921 INFO:tasks.workunit.client.0.smithi100.stdout:4/454: dwrite de/f8d [0,4194304] 0 2023-12-05T09:57:32.924 INFO:tasks.workunit.client.1.smithi150.stdout:9/471: dwrite d3/d9/dc/d1f/d24/f6b [0,4194304] 0 2023-12-05T09:57:32.924 INFO:tasks.workunit.client.1.smithi150.stdout:9/472: fdatasync d3/d9/dc/f92 0 2023-12-05T09:57:32.924 INFO:tasks.workunit.client.0.smithi100.stdout:5/522: link d0/d16/d2b/f91 d0/d4/d14/d35/fb3 0 2023-12-05T09:57:32.932 INFO:tasks.workunit.client.0.smithi100.stdout:8/412: creat d0/d35/d63/f69 x:0 0 0 2023-12-05T09:57:32.932 INFO:tasks.workunit.client.0.smithi100.stdout:8/413: fdatasync d0/d12/d13/d16/d22/f65 0 2023-12-05T09:57:32.935 INFO:tasks.workunit.client.1.smithi150.stdout:4/459: creat d0/d3e/d5b/d6e/f88 x:0 0 0 2023-12-05T09:57:32.938 INFO:tasks.workunit.client.0.smithi100.stdout:3/594: creat d0/d2/de/fcc x:0 0 0 2023-12-05T09:57:32.939 INFO:tasks.workunit.client.0.smithi100.stdout:3/595: write d0/d3d/d5c/d6f/f8c [687476,51798] 0 2023-12-05T09:57:32.939 INFO:tasks.workunit.client.0.smithi100.stdout:3/596: readlink d0/d2/de/d11/lc6 0 2023-12-05T09:57:32.946 INFO:tasks.workunit.client.0.smithi100.stdout:6/868: unlink d7/f56 0 2023-12-05T09:57:32.946 INFO:tasks.workunit.client.0.smithi100.stdout:6/869: chown d7/f11d 3245180 1 2023-12-05T09:57:32.952 INFO:tasks.workunit.client.1.smithi150.stdout:5/508: dwrite d1/d3/f7 [0,4194304] 0 2023-12-05T09:57:32.952 INFO:tasks.workunit.client.1.smithi150.stdout:5/509: read - d1/d7f/d65/d3b/d6b/fb0 zero size 2023-12-05T09:57:32.953 INFO:tasks.workunit.client.1.smithi150.stdout:8/544: symlink d0/d41/d49/d1b/d24/d2e/d4d/d83/la7 0 2023-12-05T09:57:32.953 INFO:tasks.workunit.client.1.smithi150.stdout:8/545: chown d0/ff 73 1 2023-12-05T09:57:32.959 INFO:tasks.workunit.client.0.smithi100.stdout:4/455: symlink de/d38/d8b/l91 0 2023-12-05T09:57:32.961 INFO:tasks.workunit.client.0.smithi100.stdout:2/622: write d7/da/d18/d1b/d2c/d3f/fc0 [1473612,101787] 0 2023-12-05T09:57:32.970 INFO:tasks.workunit.client.0.smithi100.stdout:6/870: write d7/d11/d1a/db7/fef [1397808,14729] 0 2023-12-05T09:57:32.970 INFO:tasks.workunit.client.0.smithi100.stdout:8/414: link d0/l2d d0/d12/d52/l6a 0 2023-12-05T09:57:32.972 INFO:tasks.workunit.client.1.smithi150.stdout:6/453: rename d2/d23/d2e/d95 to d2/d23/d2e/d93/d97 0 2023-12-05T09:57:32.975 INFO:tasks.workunit.client.1.smithi150.stdout:4/460: symlink d0/l89 0 2023-12-05T09:57:32.977 INFO:tasks.workunit.client.1.smithi150.stdout:5/510: symlink d1/d7f/d65/d3b/d6b/lb9 0 2023-12-05T09:57:32.979 INFO:tasks.workunit.client.0.smithi100.stdout:6/871: dread d7/d2d/d6a/d7c/fb8 [0,4194304] 0 2023-12-05T09:57:32.980 INFO:tasks.workunit.client.0.smithi100.stdout:8/415: symlink d0/d12/d13/d16/d42/l6b 0 2023-12-05T09:57:32.981 INFO:tasks.workunit.client.0.smithi100.stdout:6/872: readlink d7/d11/l8a 0 2023-12-05T09:57:32.981 INFO:tasks.workunit.client.0.smithi100.stdout:6/873: chown d7/d27/da0/ca7 498129 1 2023-12-05T09:57:32.985 INFO:tasks.workunit.client.1.smithi150.stdout:4/461: mkdir d0/d3e/d48/d8a 0 2023-12-05T09:57:32.985 INFO:tasks.workunit.client.0.smithi100.stdout:2/623: fdatasync d7/da/d18/d1b/d2c/d3f/fc0 0 2023-12-05T09:57:32.986 INFO:tasks.workunit.client.0.smithi100.stdout:5/523: dwrite d0/d4/d14/d35/f70 [0,4194304] 0 2023-12-05T09:57:32.986 INFO:tasks.workunit.client.1.smithi150.stdout:9/473: dwrite d3/d42/f56 [0,4194304] 0 2023-12-05T09:57:32.989 INFO:tasks.workunit.client.0.smithi100.stdout:4/456: write de/f11 [849557,112775] 0 2023-12-05T09:57:32.989 INFO:tasks.workunit.client.0.smithi100.stdout:3/597: dwrite d0/d10/d39/fa8 [0,4194304] 0 2023-12-05T09:57:32.989 INFO:tasks.workunit.client.0.smithi100.stdout:4/457: read - de/d16/d23/d33/d3d/d44/d4e/f87 zero size 2023-12-05T09:57:32.989 INFO:tasks.workunit.client.0.smithi100.stdout:3/598: creat d0/d3d/d5c/d5f/d73/fcd x:0 0 0 2023-12-05T09:57:32.989 INFO:tasks.workunit.client.0.smithi100.stdout:8/416: rename d0/d12/f2a to d0/d12/d13/f6c 0 2023-12-05T09:57:32.990 INFO:tasks.workunit.client.1.smithi150.stdout:8/546: mknod d0/ca8 0 2023-12-05T09:57:32.990 INFO:tasks.workunit.client.1.smithi150.stdout:8/547: chown d0/d8/f11 1764 1 2023-12-05T09:57:32.990 INFO:tasks.workunit.client.1.smithi150.stdout:8/548: write d0/d41/d49/d1b/d24/d34/d56/f60 [1134610,93699] 0 2023-12-05T09:57:32.991 INFO:tasks.workunit.client.1.smithi150.stdout:8/549: creat d0/d8/fa9 x:0 0 0 2023-12-05T09:57:32.991 INFO:tasks.workunit.client.1.smithi150.stdout:8/550: write d0/d41/d49/d1b/d24/d34/d56/d67/f6c [1816593,44714] 0 2023-12-05T09:57:32.993 INFO:tasks.workunit.client.0.smithi100.stdout:6/874: mknod d7/d27/c121 0 2023-12-05T09:57:32.993 INFO:tasks.workunit.client.0.smithi100.stdout:6/875: write d7/f59 [184682,30620] 0 2023-12-05T09:57:32.994 INFO:tasks.workunit.client.1.smithi150.stdout:1/514: dwrite d6/d3c/f49 [0,4194304] 0 2023-12-05T09:57:32.994 INFO:tasks.workunit.client.1.smithi150.stdout:6/454: getdents d2/d23 0 2023-12-05T09:57:32.994 INFO:tasks.workunit.client.1.smithi150.stdout:6/455: dread - d2/d23/d2e/d5f/f6d zero size 2023-12-05T09:57:32.995 INFO:tasks.workunit.client.1.smithi150.stdout:5/511: write d1/d3/d6/f3f [1730342,68522] 0 2023-12-05T09:57:32.995 INFO:tasks.workunit.client.1.smithi150.stdout:5/512: fdatasync d1/d3/d6/f81 0 2023-12-05T09:57:32.997 INFO:tasks.workunit.client.1.smithi150.stdout:4/462: mknod d0/d3e/d5b/c8b 0 2023-12-05T09:57:32.999 INFO:tasks.workunit.client.1.smithi150.stdout:9/474: mkdir d3/d1b/d46/d55/d64/d94 0 2023-12-05T09:57:33.002 INFO:tasks.workunit.client.0.smithi100.stdout:2/624: truncate d7/da/d13/d69/d6e/d71/f9a 363834 0 2023-12-05T09:57:33.004 INFO:tasks.workunit.client.0.smithi100.stdout:5/524: mknod d0/d16/d2b/d48/df/d51/da8/cb4 0 2023-12-05T09:57:33.004 INFO:tasks.workunit.client.0.smithi100.stdout:5/525: readlink d0/d27/l40 0 2023-12-05T09:57:33.004 INFO:tasks.workunit.client.0.smithi100.stdout:5/526: chown d0/d1f/d25/c44 1 1 2023-12-05T09:57:33.007 INFO:tasks.workunit.client.1.smithi150.stdout:8/551: rename d0/d41/f71 to d0/d41/d49/d1b/d24/d5b/faa 0 2023-12-05T09:57:33.011 INFO:tasks.workunit.client.1.smithi150.stdout:3/521: sync 2023-12-05T09:57:33.011 INFO:tasks.workunit.client.1.smithi150.stdout:0/553: sync 2023-12-05T09:57:33.011 INFO:tasks.workunit.client.1.smithi150.stdout:0/554: fsync d5/d11/d71/d99/d9c/f3d 0 2023-12-05T09:57:33.012 INFO:tasks.workunit.client.0.smithi100.stdout:5/527: dread d0/d16/d2b/d48/f65 [0,4194304] 0 2023-12-05T09:57:33.020 INFO:tasks.workunit.client.0.smithi100.stdout:4/458: mkdir de/d38/d92 0 2023-12-05T09:57:33.024 INFO:tasks.workunit.client.1.smithi150.stdout:6/456: write d2/d23/d2e/d72/f75 [3998465,51055] 0 2023-12-05T09:57:33.024 INFO:tasks.workunit.client.0.smithi100.stdout:3/599: unlink d0/d2/de/d12/fb4 0 2023-12-05T09:57:33.024 INFO:tasks.workunit.client.0.smithi100.stdout:3/600: write d0/d3d/f53 [4422754,86297] 0 2023-12-05T09:57:33.027 INFO:tasks.workunit.client.1.smithi150.stdout:1/515: dread d6/d8/d85/f97 [0,4194304] 0 2023-12-05T09:57:33.027 INFO:tasks.workunit.client.0.smithi100.stdout:8/417: rmdir d0/d12/d52 39 2023-12-05T09:57:33.027 INFO:tasks.workunit.client.0.smithi100.stdout:8/418: stat d0/d12/d13/d16/d42/d43/l62 0 2023-12-05T09:57:33.029 INFO:tasks.workunit.client.1.smithi150.stdout:5/513: link d1/d2e/da6/d24/d59/fb4 d1/d3/d6/d89/fba 0 2023-12-05T09:57:33.033 INFO:tasks.workunit.client.1.smithi150.stdout:8/552: symlink d0/d41/d49/d1b/d24/d34/da2/lab 0 2023-12-05T09:57:33.035 INFO:tasks.workunit.client.0.smithi100.stdout:3/601: dread d0/d2/de/d11/fc0 [0,4194304] 0 2023-12-05T09:57:33.036 INFO:tasks.workunit.client.1.smithi150.stdout:3/522: symlink d6/d9/d3d/d8a/la8 0 2023-12-05T09:57:33.037 INFO:tasks.workunit.client.1.smithi150.stdout:0/555: mknod d5/d11/d65/cc4 0 2023-12-05T09:57:33.038 INFO:tasks.workunit.client.0.smithi100.stdout:2/625: symlink d7/da/d18/d1b/d2c/d3f/d46/dc8/ld3 0 2023-12-05T09:57:33.038 INFO:tasks.workunit.client.1.smithi150.stdout:9/475: dwrite d3/d9/d58/f7e [0,4194304] 0 2023-12-05T09:57:33.039 INFO:tasks.workunit.client.1.smithi150.stdout:6/457: rmdir d2/d23/d2e/d72 39 2023-12-05T09:57:33.039 INFO:tasks.workunit.client.1.smithi150.stdout:6/458: readlink d2/l30 0 2023-12-05T09:57:33.039 INFO:tasks.workunit.client.1.smithi150.stdout:6/459: chown d2/d23/d3b/d64/d7a/d5d/d6b/f22 3 1 2023-12-05T09:57:33.039 INFO:tasks.workunit.client.1.smithi150.stdout:6/460: stat d2/d23/d2e/f43 0 2023-12-05T09:57:33.039 INFO:tasks.workunit.client.0.smithi100.stdout:1/480: sync 2023-12-05T09:57:33.040 INFO:tasks.workunit.client.0.smithi100.stdout:5/528: rename d0/d16/d37/l73 to d0/d4/lb5 0 2023-12-05T09:57:33.041 INFO:tasks.workunit.client.0.smithi100.stdout:8/419: dread d0/d12/d13/d16/f3a [0,4194304] 0 2023-12-05T09:57:33.041 INFO:tasks.workunit.client.0.smithi100.stdout:8/420: creat d0/d35/f6d x:0 0 0 2023-12-05T09:57:33.041 INFO:tasks.workunit.client.0.smithi100.stdout:8/421: write d0/d12/d13/d16/f46 [5209558,59886] 0 2023-12-05T09:57:33.042 INFO:tasks.workunit.client.1.smithi150.stdout:1/516: creat d6/d8/db/db1/fbc x:0 0 0 2023-12-05T09:57:33.046 INFO:tasks.workunit.client.1.smithi150.stdout:5/514: dread d1/d7f/d65/f57 [0,4194304] 0 2023-12-05T09:57:33.046 INFO:tasks.workunit.client.1.smithi150.stdout:5/515: write d1/d2e/f90 [738786,100058] 0 2023-12-05T09:57:33.046 INFO:tasks.workunit.client.1.smithi150.stdout:5/516: chown d1/d7f/d65/d3b/d6b 815556946 1 2023-12-05T09:57:33.046 INFO:tasks.workunit.client.1.smithi150.stdout:5/517: write d1/f96 [87515,35567] 0 2023-12-05T09:57:33.046 INFO:tasks.workunit.client.1.smithi150.stdout:2/535: sync 2023-12-05T09:57:33.046 INFO:tasks.workunit.client.1.smithi150.stdout:7/524: sync 2023-12-05T09:57:33.046 INFO:tasks.workunit.client.1.smithi150.stdout:8/553: mkdir d0/d41/d49/d1b/d24/d38/d62/dac 0 2023-12-05T09:57:33.048 INFO:tasks.workunit.client.0.smithi100.stdout:3/602: rmdir d0/d2/de/db8 39 2023-12-05T09:57:33.052 INFO:tasks.workunit.client.1.smithi150.stdout:0/556: dread d5/d11/f26 [0,4194304] 0 2023-12-05T09:57:33.055 INFO:tasks.workunit.client.0.smithi100.stdout:1/481: rename db/d12/d1e/d26/d39/l4d to db/d12/d1e/l98 0 2023-12-05T09:57:33.055 INFO:tasks.workunit.client.0.smithi100.stdout:5/529: symlink d0/d16/d2b/d48/df/d51/d7b/da0/lb6 0 2023-12-05T09:57:33.055 INFO:tasks.workunit.client.1.smithi150.stdout:9/476: mkdir d3/d9/dc/d1f/d24/d75/d95 0 2023-12-05T09:57:33.059 INFO:tasks.workunit.client.1.smithi150.stdout:6/461: creat d2/d23/d2e/d93/d97/f98 x:0 0 0 2023-12-05T09:57:33.059 INFO:tasks.workunit.client.1.smithi150.stdout:6/462: dread - d2/d23/d3b/d64/d7a/d5d/f82 zero size 2023-12-05T09:57:33.063 INFO:tasks.workunit.client.1.smithi150.stdout:2/536: rename d0/d3/d11/c31 to d0/d3/d5/d13/d15/d30/cbd 0 2023-12-05T09:57:33.063 INFO:tasks.workunit.client.1.smithi150.stdout:2/537: chown d0/d3/d5/d13/d15/d30/d54/d57 53047045 1 2023-12-05T09:57:33.067 INFO:tasks.workunit.client.1.smithi150.stdout:8/554: mkdir d0/d41/d49/d1b/d24/d38/dad 0 2023-12-05T09:57:33.070 INFO:tasks.workunit.client.0.smithi100.stdout:8/422: unlink d0/l2d 0 2023-12-05T09:57:33.073 INFO:tasks.workunit.client.0.smithi100.stdout:4/459: getdents de/d16/d1e 0 2023-12-05T09:57:33.075 INFO:tasks.workunit.client.1.smithi150.stdout:0/557: unlink d5/d11/d71/d74/l85 0 2023-12-05T09:57:33.077 INFO:tasks.workunit.client.0.smithi100.stdout:3/603: creat d0/fce x:0 0 0 2023-12-05T09:57:33.077 INFO:tasks.workunit.client.0.smithi100.stdout:3/604: creat d0/d2/de/d8d/fcf x:0 0 0 2023-12-05T09:57:33.079 INFO:tasks.workunit.client.0.smithi100.stdout:5/530: rename d0/d1f/f21 to d0/fb7 0 2023-12-05T09:57:33.085 INFO:tasks.workunit.client.0.smithi100.stdout:1/482: dread db/d31/d3a/f4c [4194304,4194304] 0 2023-12-05T09:57:33.085 INFO:tasks.workunit.client.0.smithi100.stdout:8/423: mknod d0/d12/d13/d45/c6e 0 2023-12-05T09:57:33.085 INFO:tasks.workunit.client.1.smithi150.stdout:6/463: mkdir d2/d23/d2e/d5f/d99 0 2023-12-05T09:57:33.086 INFO:tasks.workunit.client.0.smithi100.stdout:4/460: symlink de/d16/d23/d33/l93 0 2023-12-05T09:57:33.090 INFO:tasks.workunit.client.1.smithi150.stdout:9/477: rename d3/d9/f52 to d3/d9/dc/f96 0 2023-12-05T09:57:33.090 INFO:tasks.workunit.client.1.smithi150.stdout:8/555: dread d0/d8/f11 [0,4194304] 0 2023-12-05T09:57:33.096 INFO:tasks.workunit.client.0.smithi100.stdout:5/531: mknod d0/d1b/d4d/d8e/cb8 0 2023-12-05T09:57:33.099 INFO:tasks.workunit.client.0.smithi100.stdout:4/461: dread de/d16/d23/f2c [0,4194304] 0 2023-12-05T09:57:33.099 INFO:tasks.workunit.client.0.smithi100.stdout:8/424: creat d0/d12/d13/d16/d22/d24/f6f x:0 0 0 2023-12-05T09:57:33.100 INFO:tasks.workunit.client.0.smithi100.stdout:5/532: mkdir d0/d16/d2b/d48/df/d51/d7b/dae/db9 0 2023-12-05T09:57:33.100 INFO:tasks.workunit.client.1.smithi150.stdout:6/464: link d2/c4e d2/d23/d3b/d64/d7a/c9a 0 2023-12-05T09:57:33.100 INFO:tasks.workunit.client.1.smithi150.stdout:0/558: link d5/d11/d16/d1f/d67/f73 d5/d11/d71/d99/d9c/d3b/dad/fc5 0 2023-12-05T09:57:33.100 INFO:tasks.workunit.client.1.smithi150.stdout:0/559: write d5/d11/d71/d99/d9c/d3b/fbc [475831,58521] 0 2023-12-05T09:57:33.104 INFO:tasks.workunit.client.0.smithi100.stdout:4/462: rename de/d38/c46 to de/d16/d23/d36/c94 0 2023-12-05T09:57:33.104 INFO:tasks.workunit.client.1.smithi150.stdout:8/556: dread d0/d41/d49/d1b/f2b [0,4194304] 0 2023-12-05T09:57:33.105 INFO:tasks.workunit.client.1.smithi150.stdout:8/557: write d0/d8/f11 [4773449,17362] 0 2023-12-05T09:57:33.105 INFO:tasks.workunit.client.1.smithi150.stdout:8/558: chown d0/d41/d49/d1b/d24/d5b/f96 353467764 1 2023-12-05T09:57:33.105 INFO:tasks.workunit.client.1.smithi150.stdout:8/559: readlink d0/d41/d49/d1b/d24/d34/d56/l85 0 2023-12-05T09:57:33.105 INFO:tasks.workunit.client.1.smithi150.stdout:8/560: chown d0/d41/d49/d1b/d24/d2e/d30/l3e 352 1 2023-12-05T09:57:33.105 INFO:tasks.workunit.client.1.smithi150.stdout:9/478: mkdir d3/d42/d62/d97 0 2023-12-05T09:57:33.106 INFO:tasks.workunit.client.0.smithi100.stdout:8/425: rmdir d0/d12/d13/d16/d22 39 2023-12-05T09:57:33.106 INFO:tasks.workunit.client.0.smithi100.stdout:8/426: creat d0/d35/f70 x:0 0 0 2023-12-05T09:57:33.106 INFO:tasks.workunit.client.0.smithi100.stdout:8/427: chown d0/d35/c40 5 1 2023-12-05T09:57:33.109 INFO:tasks.workunit.client.1.smithi150.stdout:3/523: dwrite d6/d9/d3d/d87/f89 [0,4194304] 0 2023-12-05T09:57:33.109 INFO:tasks.workunit.client.1.smithi150.stdout:3/524: write d6/d9/d3d/d52/f6f [366655,33656] 0 2023-12-05T09:57:33.111 INFO:tasks.workunit.client.0.smithi100.stdout:5/533: symlink d0/d4/d14/d35/d62/lba 0 2023-12-05T09:57:33.111 INFO:tasks.workunit.client.0.smithi100.stdout:5/534: chown d0/d1f/da1 1548 1 2023-12-05T09:57:33.116 INFO:tasks.workunit.client.1.smithi150.stdout:6/465: creat d2/d23/d2e/d44/f9b x:0 0 0 2023-12-05T09:57:33.117 INFO:tasks.workunit.client.0.smithi100.stdout:4/463: creat de/d38/d86/f95 x:0 0 0 2023-12-05T09:57:33.119 INFO:tasks.workunit.client.1.smithi150.stdout:5/518: dwrite d1/d2e/da6/d86/fb7 [0,4194304] 0 2023-12-05T09:57:33.119 INFO:tasks.workunit.client.1.smithi150.stdout:5/519: chown d1/d3/d6/d26/c2d 61786 1 2023-12-05T09:57:33.120 INFO:tasks.workunit.client.0.smithi100.stdout:2/626: dwrite d7/da/d13/d69/d6e/fcc [0,4194304] 0 2023-12-05T09:57:33.121 INFO:tasks.workunit.client.1.smithi150.stdout:0/560: rename d5/d11/d16/d1f/d7f/l98 to d5/d11/d71/d99/d9c/d46/lc6 0 2023-12-05T09:57:33.121 INFO:tasks.workunit.client.1.smithi150.stdout:2/538: dwrite d0/d3/f14 [0,4194304] 0 2023-12-05T09:57:33.121 INFO:tasks.workunit.client.1.smithi150.stdout:0/561: write d5/d11/d71/d99/d9c/f3d [4875835,92880] 0 2023-12-05T09:57:33.121 INFO:tasks.workunit.client.1.smithi150.stdout:7/525: dwrite d2/db/d30/d13/d4f/d5a/d5c/f43 [0,4194304] 0 2023-12-05T09:57:33.123 INFO:tasks.workunit.client.1.smithi150.stdout:8/561: mknod d0/d41/d49/d1b/cae 0 2023-12-05T09:57:33.123 INFO:tasks.workunit.client.1.smithi150.stdout:8/562: write d0/d41/d49/d1b/d24/d38/d84/f9e [624538,50947] 0 2023-12-05T09:57:33.124 INFO:tasks.workunit.client.0.smithi100.stdout:6/876: dwrite d7/d27/f2e [0,4194304] 0 2023-12-05T09:57:33.125 INFO:tasks.workunit.client.1.smithi150.stdout:9/479: creat d3/d1b/d46/f98 x:0 0 0 2023-12-05T09:57:33.125 INFO:tasks.workunit.client.1.smithi150.stdout:9/480: read d3/d1b/f36 [448810,29474] 0 2023-12-05T09:57:33.125 INFO:tasks.workunit.client.1.smithi150.stdout:9/481: getdents d3/d9/dc/d91 0 2023-12-05T09:57:33.127 INFO:tasks.workunit.client.0.smithi100.stdout:5/535: link d0/d1b/f32 d0/d27/fbb 0 2023-12-05T09:57:33.127 INFO:tasks.workunit.client.0.smithi100.stdout:5/536: fsync d0/d4/d14/d35/f70 0 2023-12-05T09:57:33.127 INFO:tasks.workunit.client.0.smithi100.stdout:5/537: fdatasync d0/d1f/d53/f7c 0 2023-12-05T09:57:33.127 INFO:tasks.workunit.client.0.smithi100.stdout:5/538: chown d0/d16/d2b/d48/df/d51/d7b/da0/ca3 116014 1 2023-12-05T09:57:33.127 INFO:tasks.workunit.client.0.smithi100.stdout:5/539: fdatasync d0/d1f/d25/f50 0 2023-12-05T09:57:33.136 INFO:tasks.workunit.client.0.smithi100.stdout:3/605: dwrite d0/d2/de/db8/fc4 [0,4194304] 0 2023-12-05T09:57:33.136 INFO:tasks.workunit.client.0.smithi100.stdout:3/606: write d0/d2/de/d8d/fc1 [874762,105130] 0 2023-12-05T09:57:33.187 INFO:tasks.workunit.client.1.smithi150.stdout:3/525: creat d6/d25/d28/d9a/fa9 x:0 0 0 2023-12-05T09:57:33.187 INFO:tasks.workunit.client.1.smithi150.stdout:3/526: chown d6/d25/d28/f96 2 1 2023-12-05T09:57:33.193 INFO:tasks.workunit.client.1.smithi150.stdout:5/520: mknod d1/d3/d6/d1b/cbb 0 2023-12-05T09:57:33.193 INFO:tasks.workunit.client.1.smithi150.stdout:5/521: fdatasync d1/f55 0 2023-12-05T09:57:33.193 INFO:tasks.workunit.client.1.smithi150.stdout:5/522: readlink d1/d3/d6/d26/l7b 0 2023-12-05T09:57:33.195 INFO:tasks.workunit.client.0.smithi100.stdout:6/877: dwrite d7/fbe [0,4194304] 0 2023-12-05T09:57:33.195 INFO:tasks.workunit.client.0.smithi100.stdout:6/878: chown d7/d11/d1a/d78/d80 228 1 2023-12-05T09:57:33.195 INFO:tasks.workunit.client.0.smithi100.stdout:6/879: fsync d7/d11/d1a/db7/fc0 0 2023-12-05T09:57:33.195 INFO:tasks.workunit.client.0.smithi100.stdout:6/880: chown d7/d2d/l5f 104 1 2023-12-05T09:57:33.196 INFO:tasks.workunit.client.0.smithi100.stdout:6/881: dread - d7/d11/d1a/d78/dd0/fd5 zero size 2023-12-05T09:57:33.196 INFO:tasks.workunit.client.0.smithi100.stdout:6/882: truncate d7/d2d/d6a/d7c/fb8 1033628 0 2023-12-05T09:57:33.200 INFO:tasks.workunit.client.0.smithi100.stdout:2/627: dwrite d7/da/d18/d1b/d2c/f49 [0,4194304] 0 2023-12-05T09:57:33.201 INFO:tasks.workunit.client.1.smithi150.stdout:6/466: dwrite d2/d23/d2e/d5f/f87 [0,4194304] 0 2023-12-05T09:57:33.202 INFO:tasks.workunit.client.0.smithi100.stdout:8/428: dwrite d0/d12/d13/d16/d22/d24/f3f [0,4194304] 0 2023-12-05T09:57:33.203 INFO:tasks.workunit.client.0.smithi100.stdout:4/464: rmdir de/d16/d23/d33/d3d 39 2023-12-05T09:57:33.203 INFO:tasks.workunit.client.0.smithi100.stdout:4/465: fsync de/d16/d1e/f7c 0 2023-12-05T09:57:33.212 INFO:tasks.workunit.client.0.smithi100.stdout:5/540: creat d0/d4/fbc x:0 0 0 2023-12-05T09:57:33.213 INFO:tasks.workunit.client.0.smithi100.stdout:6/883: write d7/d2d/fe3 [2943841,9193] 0 2023-12-05T09:57:33.221 INFO:tasks.workunit.client.0.smithi100.stdout:6/884: dread d7/d11/d82/db9/fca [0,4194304] 0 2023-12-05T09:57:33.226 INFO:tasks.workunit.client.1.smithi150.stdout:3/527: dwrite d6/d9/f57 [0,4194304] 0 2023-12-05T09:57:33.229 INFO:tasks.workunit.client.0.smithi100.stdout:3/607: mkdir d0/d2/de/d11/d7c/dd0 0 2023-12-05T09:57:33.229 INFO:tasks.workunit.client.0.smithi100.stdout:3/608: fsync d0/d4/f14 0 2023-12-05T09:57:33.231 INFO:tasks.workunit.client.1.smithi150.stdout:2/539: rmdir d0/d3/d27/dac/d81 39 2023-12-05T09:57:33.236 INFO:tasks.workunit.client.1.smithi150.stdout:5/523: dwrite d1/d64/d31/fb6 [0,4194304] 0 2023-12-05T09:57:33.239 INFO:tasks.workunit.client.1.smithi150.stdout:0/562: truncate d5/d11/d71/d99/d9c/d46/f89 1389560 0 2023-12-05T09:57:33.244 INFO:tasks.workunit.client.1.smithi150.stdout:7/526: truncate d2/db/d30/d18/d1a/d1e/d2b/f34 7407421 0 2023-12-05T09:57:33.253 INFO:tasks.workunit.client.1.smithi150.stdout:9/482: mknod d3/d9/d26/c99 0 2023-12-05T09:57:33.253 INFO:tasks.workunit.client.1.smithi150.stdout:9/483: chown d3/d9/f20 507 1 2023-12-05T09:57:33.253 INFO:tasks.workunit.client.1.smithi150.stdout:9/484: chown d3/d9/dc/d1f/l6a 0 1 2023-12-05T09:57:33.254 INFO:tasks.workunit.client.0.smithi100.stdout:8/429: creat d0/d12/d13/d16/d42/d43/f71 x:0 0 0 2023-12-05T09:57:33.254 INFO:tasks.workunit.client.0.smithi100.stdout:8/430: write d0/f3c [660855,116208] 0 2023-12-05T09:57:33.255 INFO:tasks.workunit.client.0.smithi100.stdout:8/431: fsync d0/f9 0 2023-12-05T09:57:33.255 INFO:tasks.workunit.client.0.smithi100.stdout:4/466: creat de/d16/d1e/f96 x:0 0 0 2023-12-05T09:57:33.258 INFO:tasks.workunit.client.0.smithi100.stdout:5/541: symlink d0/d16/d2b/lbd 0 2023-12-05T09:57:33.260 INFO:tasks.workunit.client.1.smithi150.stdout:6/467: dwrite d2/d23/d2e/f43 [0,4194304] 0 2023-12-05T09:57:33.260 INFO:tasks.workunit.client.1.smithi150.stdout:6/468: write d2/d23/d2e/d44/f50 [1178081,57161] 0 2023-12-05T09:57:33.260 INFO:tasks.workunit.client.1.smithi150.stdout:6/469: fsync d2/f34 0 2023-12-05T09:57:33.260 INFO:tasks.workunit.client.1.smithi150.stdout:6/470: dread - d2/d23/d2e/d44/f9b zero size 2023-12-05T09:57:33.262 INFO:tasks.workunit.client.0.smithi100.stdout:2/628: dwrite d7/da/d18/d1b/f28 [4194304,4194304] 0 2023-12-05T09:57:33.263 INFO:tasks.workunit.client.0.smithi100.stdout:2/629: fsync d7/da/d13/d69/d6e/fcc 0 2023-12-05T09:57:33.263 INFO:tasks.workunit.client.0.smithi100.stdout:2/630: fdatasync d7/da/d18/d1b/d2c/d3f/faa 0 2023-12-05T09:57:33.263 INFO:tasks.workunit.client.0.smithi100.stdout:2/631: truncate d7/da/d18/d1b/d2c/d3f/fd1 938948 0 2023-12-05T09:57:33.265 INFO:tasks.workunit.client.0.smithi100.stdout:6/885: mknod d7/d11/d82/db9/c122 0 2023-12-05T09:57:33.265 INFO:tasks.workunit.client.0.smithi100.stdout:6/886: dread - d7/d27/da0/fd9 zero size 2023-12-05T09:57:33.268 INFO:tasks.workunit.client.1.smithi150.stdout:4/463: sync 2023-12-05T09:57:33.272 INFO:tasks.workunit.client.0.smithi100.stdout:3/609: unlink d0/d2/de/d12/f63 0 2023-12-05T09:57:33.278 INFO:tasks.workunit.client.0.smithi100.stdout:8/432: mkdir d0/d12/d13/d16/d22/d72 0 2023-12-05T09:57:33.278 INFO:tasks.workunit.client.0.smithi100.stdout:8/433: chown d0/d35/d63/f69 0 1 2023-12-05T09:57:33.278 INFO:tasks.workunit.client.0.smithi100.stdout:8/434: readlink d0/lf 0 2023-12-05T09:57:33.278 INFO:tasks.workunit.client.0.smithi100.stdout:8/435: truncate d0/d35/d63/f69 501455 0 2023-12-05T09:57:33.278 INFO:tasks.workunit.client.0.smithi100.stdout:8/436: dread - d0/d12/d13/d16/d42/d43/f66 zero size 2023-12-05T09:57:33.279 INFO:tasks.workunit.client.1.smithi150.stdout:1/517: sync 2023-12-05T09:57:33.283 INFO:tasks.workunit.client.1.smithi150.stdout:0/563: mknod d5/d11/d71/d99/d9c/cc7 0 2023-12-05T09:57:33.285 INFO:tasks.workunit.client.1.smithi150.stdout:5/524: dwrite d1/f51 [4194304,4194304] 0 2023-12-05T09:57:33.286 INFO:tasks.workunit.client.1.smithi150.stdout:8/563: link d0/d41/d49/d1b/l32 d0/d41/laf 0 2023-12-05T09:57:33.292 INFO:tasks.workunit.client.1.smithi150.stdout:7/527: dwrite d2/db/d2e/f76 [0,4194304] 0 2023-12-05T09:57:33.295 INFO:tasks.workunit.client.1.smithi150.stdout:4/464: unlink d0/f20 0 2023-12-05T09:57:33.295 INFO:tasks.workunit.client.1.smithi150.stdout:4/465: chown d0/d3e/d5b/d80/d44 261250 1 2023-12-05T09:57:33.296 INFO:tasks.workunit.client.1.smithi150.stdout:4/466: fdatasync d0/f26 0 2023-12-05T09:57:33.296 INFO:tasks.workunit.client.1.smithi150.stdout:3/528: getdents d6/d9/d3d/d8a 0 2023-12-05T09:57:33.297 INFO:tasks.workunit.client.1.smithi150.stdout:3/529: creat d6/d22/d37/da1/faa x:0 0 0 2023-12-05T09:57:33.299 INFO:tasks.workunit.client.0.smithi100.stdout:2/632: truncate d7/da/dc/d88/fd0 497918 0 2023-12-05T09:57:33.299 INFO:tasks.workunit.client.0.smithi100.stdout:2/633: dread - d7/da/d13/d69/fba zero size 2023-12-05T09:57:33.299 INFO:tasks.workunit.client.0.smithi100.stdout:2/634: creat d7/da/d13/d69/d6e/fd4 x:0 0 0 2023-12-05T09:57:33.300 INFO:tasks.workunit.client.1.smithi150.stdout:2/540: rmdir d0/d3/d5/d36 39 2023-12-05T09:57:33.300 INFO:tasks.workunit.client.1.smithi150.stdout:1/518: getdents d6/d8/db/d1b 0 2023-12-05T09:57:33.303 INFO:tasks.workunit.client.1.smithi150.stdout:5/525: rename d1/d7f/d65/d3b/d6b/f98 to d1/d7f/fbc 0 2023-12-05T09:57:33.304 INFO:tasks.workunit.client.0.smithi100.stdout:4/467: dwrite de/d66/f77 [0,4194304] 0 2023-12-05T09:57:33.304 INFO:tasks.workunit.client.0.smithi100.stdout:4/468: fsync de/d16/d23/f26 0 2023-12-05T09:57:33.306 INFO:tasks.workunit.client.0.smithi100.stdout:6/887: unlink d7/l14 0 2023-12-05T09:57:33.310 INFO:tasks.workunit.client.1.smithi150.stdout:8/564: read d0/d8/f2c [2516110,89120] 0 2023-12-05T09:57:33.310 INFO:tasks.workunit.client.0.smithi100.stdout:3/610: link d0/d10/l76 d0/d3d/d5c/d6f/d7f/d87/ld1 0 2023-12-05T09:57:33.310 INFO:tasks.workunit.client.0.smithi100.stdout:3/611: rename d0 to d0/d2/de/d11/d58/dd2 22 2023-12-05T09:57:33.313 INFO:tasks.workunit.client.1.smithi150.stdout:6/471: mkdir d2/d23/d3b/d64/d7a/d5d/d6b/d9c 0 2023-12-05T09:57:33.314 INFO:tasks.workunit.client.1.smithi150.stdout:0/564: write d5/f5d [6746896,113291] 0 2023-12-05T09:57:33.314 INFO:tasks.workunit.client.1.smithi150.stdout:0/565: creat d5/d11/d65/d82/fc8 x:0 0 0 2023-12-05T09:57:33.314 INFO:tasks.workunit.client.1.smithi150.stdout:0/566: write d5/d11/d16/d1f/d7f/fac [628619,122434] 0 2023-12-05T09:57:33.314 INFO:tasks.workunit.client.1.smithi150.stdout:0/567: chown d5/d11/d71/d99 1 1 2023-12-05T09:57:33.314 INFO:tasks.workunit.client.0.smithi100.stdout:8/437: mknod d0/d12/d13/d16/d42/d43/c73 0 2023-12-05T09:57:33.315 INFO:tasks.workunit.client.1.smithi150.stdout:7/528: symlink d2/db/lb3 0 2023-12-05T09:57:33.317 INFO:tasks.workunit.client.1.smithi150.stdout:2/541: dread d0/d3/d5/d13/d15/d30/d54/d57/f75 [0,4194304] 0 2023-12-05T09:57:33.317 INFO:tasks.workunit.client.1.smithi150.stdout:2/542: truncate d0/d3/fb7 212721 0 2023-12-05T09:57:33.317 INFO:tasks.workunit.client.1.smithi150.stdout:2/543: creat d0/d3/d11/fbe x:0 0 0 2023-12-05T09:57:33.317 INFO:tasks.workunit.client.1.smithi150.stdout:2/544: write d0/d3/d5/d13/d15/d30/d54/d57/fab [1114551,13855] 0 2023-12-05T09:57:33.317 INFO:tasks.workunit.client.1.smithi150.stdout:2/545: creat d0/d3/d5/d22/fbf x:0 0 0 2023-12-05T09:57:33.323 INFO:tasks.workunit.client.0.smithi100.stdout:5/542: rmdir d0/d1b/d4d 39 2023-12-05T09:57:33.324 INFO:tasks.workunit.client.1.smithi150.stdout:9/485: dwrite d3/d9/dc/d1f/f6c [0,4194304] 0 2023-12-05T09:57:33.326 INFO:tasks.workunit.client.1.smithi150.stdout:3/530: dread d6/d9/d3d/d87/f89 [0,4194304] 0 2023-12-05T09:57:33.327 INFO:tasks.workunit.client.1.smithi150.stdout:4/467: mkdir d0/d3e/d6d/d4b/d8c 0 2023-12-05T09:57:33.330 INFO:tasks.workunit.client.1.smithi150.stdout:1/519: rename d6/d38/d4a/l72 to d6/d8/db/d1b/lbd 0 2023-12-05T09:57:33.332 INFO:tasks.workunit.client.0.smithi100.stdout:3/612: dread d0/d2/d33/fae [0,4194304] 0 2023-12-05T09:57:33.332 INFO:tasks.workunit.client.0.smithi100.stdout:3/613: write d0/d2/de/d12/f18 [1718289,111002] 0 2023-12-05T09:57:33.332 INFO:tasks.workunit.client.0.smithi100.stdout:3/614: chown d0/d2/d62 10 1 2023-12-05T09:57:33.332 INFO:tasks.workunit.client.0.smithi100.stdout:3/615: write d0/d3d/d5c/d5f/d73/f9d [764639,46594] 0 2023-12-05T09:57:33.333 INFO:tasks.workunit.client.1.smithi150.stdout:1/520: write d6/d8/db/f16 [590346,68265] 0 2023-12-05T09:57:33.334 INFO:tasks.workunit.client.1.smithi150.stdout:8/565: unlink d0/d41/d49/d1b/d24/d38/d62/f75 0 2023-12-05T09:57:33.335 INFO:tasks.workunit.client.1.smithi150.stdout:8/566: dread - d0/d41/d49/d1b/d24/d2e/f53 zero size 2023-12-05T09:57:33.344 INFO:tasks.workunit.client.1.smithi150.stdout:6/472: symlink d2/d23/d2e/d44/l9d 0 2023-12-05T09:57:33.344 INFO:tasks.workunit.client.1.smithi150.stdout:6/473: chown d2/d23/d3b/d46 155280 1 2023-12-05T09:57:33.345 INFO:tasks.workunit.client.0.smithi100.stdout:4/469: read de/f14 [41908,81835] 0 2023-12-05T09:57:33.347 INFO:tasks.workunit.client.1.smithi150.stdout:1/521: write d6/d3c/f49 [832479,80429] 0 2023-12-05T09:57:33.354 INFO:tasks.workunit.client.0.smithi100.stdout:0/470: sync 2023-12-05T09:57:33.354 INFO:tasks.workunit.client.0.smithi100.stdout:9/511: sync 2023-12-05T09:57:33.354 INFO:tasks.workunit.client.0.smithi100.stdout:1/483: sync 2023-12-05T09:57:33.354 INFO:tasks.workunit.client.0.smithi100.stdout:1/484: stat db/d12/d61/d66/d67/l97 0 2023-12-05T09:57:33.354 INFO:tasks.workunit.client.0.smithi100.stdout:8/438: symlink d0/d12/d13/d16/d22/l74 0 2023-12-05T09:57:33.360 INFO:tasks.workunit.client.0.smithi100.stdout:3/616: unlink d0/d2/f56 0 2023-12-05T09:57:33.362 INFO:tasks.workunit.client.1.smithi150.stdout:0/568: symlink d5/d11/d71/d99/d9c/d46/lc9 0 2023-12-05T09:57:33.367 INFO:tasks.workunit.client.0.smithi100.stdout:7/473: sync 2023-12-05T09:57:33.367 INFO:tasks.workunit.client.0.smithi100.stdout:0/471: getdents da/d1b/d6b 0 2023-12-05T09:57:33.367 INFO:tasks.workunit.client.0.smithi100.stdout:7/474: truncate d3/dc/d11/f1e 1195818 0 2023-12-05T09:57:33.368 INFO:tasks.workunit.client.1.smithi150.stdout:7/529: symlink d2/db/d17/d20/lb4 0 2023-12-05T09:57:33.383 INFO:tasks.workunit.client.1.smithi150.stdout:9/486: dwrite d3/d9/dc/f4b [0,4194304] 0 2023-12-05T09:57:33.384 INFO:tasks.workunit.client.1.smithi150.stdout:2/546: symlink d0/d3/d5/d3b/lc0 0 2023-12-05T09:57:33.388 INFO:tasks.workunit.client.0.smithi100.stdout:9/512: readlink d7/d1b/d22/d51/l1a 0 2023-12-05T09:57:33.388 INFO:tasks.workunit.client.0.smithi100.stdout:3/617: mknod d0/d2/de/d12/d9b/cd3 0 2023-12-05T09:57:33.388 INFO:tasks.workunit.client.0.smithi100.stdout:9/513: chown d7/d1b/d22/d51/d32/c3f 1291 1 2023-12-05T09:57:33.388 INFO:tasks.workunit.client.0.smithi100.stdout:3/618: stat d0/d4/d3a/d45 0 2023-12-05T09:57:33.389 INFO:tasks.workunit.client.0.smithi100.stdout:3/619: fsync d0/d2/fc3 0 2023-12-05T09:57:33.389 INFO:tasks.workunit.client.0.smithi100.stdout:9/514: write d7/d1b/f30 [3327067,65378] 0 2023-12-05T09:57:33.389 INFO:tasks.workunit.client.0.smithi100.stdout:4/470: dread de/d16/d23/f24 [0,4194304] 0 2023-12-05T09:57:33.392 INFO:tasks.workunit.client.0.smithi100.stdout:2/635: dwrite d7/da/d13/f5d [0,4194304] 0 2023-12-05T09:57:33.394 INFO:tasks.workunit.client.1.smithi150.stdout:7/530: dread d2/d4/f23 [4194304,4194304] 0 2023-12-05T09:57:33.395 INFO:tasks.workunit.client.0.smithi100.stdout:0/472: unlink da/d1b/d6b/l7c 0 2023-12-05T09:57:33.400 INFO:tasks.workunit.client.1.smithi150.stdout:3/531: symlink d6/d9/d3d/d56/d53/d51/lab 0 2023-12-05T09:57:33.401 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:33.403+0000 7f1100c06700 1 -- 172.21.15.100:0/2945625824 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10fc0fde00 msgr2=0x7f10fc0fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:57:33.401 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:33.404+0000 7f1100c06700 1 --2- 172.21.15.100:0/2945625824 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10fc0fde00 0x7f10fc0fe250 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f10e4004940 tx=0x7f10e4009e30 comp rx=0 tx=0).stop 2023-12-05T09:57:33.401 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:33.404+0000 7f1100c06700 1 -- 172.21.15.100:0/2945625824 shutdown_connections 2023-12-05T09:57:33.401 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:33.404+0000 7f1100c06700 1 --2- 172.21.15.100:0/2945625824 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10fc0fde00 0x7f10fc0fe250 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:33.402 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:33.405+0000 7f1100c06700 1 --2- 172.21.15.100:0/2945625824 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10fc0fcbf0 0x7f10fc0fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:33.402 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:33.405+0000 7f1100c06700 1 -- 172.21.15.100:0/2945625824 >> 172.21.15.100:0/2945625824 conn(0x7f10fc0f82d0 msgr2=0x7f10fc0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:57:33.403 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:33.406+0000 7f1100c06700 1 -- 172.21.15.100:0/2945625824 shutdown_connections 2023-12-05T09:57:33.404 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:33.407+0000 7f1100c06700 1 -- 172.21.15.100:0/2945625824 wait complete. 2023-12-05T09:57:33.407 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:33.411+0000 7f1100c06700 1 Processor -- start 2023-12-05T09:57:33.408 INFO:tasks.workunit.client.1.smithi150.stdout:0/569: dwrite d5/d11/d16/f1e [0,4194304] 0 2023-12-05T09:57:33.408 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:33.411+0000 7f1100c06700 1 -- start start 2023-12-05T09:57:33.415 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:33.413+0000 7f1100c06700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10fc0fcbf0 0x7f10fc113b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:57:33.415 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:33.413+0000 7f1100c06700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10fc0fde00 0x7f10fc114090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:57:33.415 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:33.413+0000 7f1100c06700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10fc114690 con 0x7f10fc0fde00 2023-12-05T09:57:33.415 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:33.413+0000 7f1100c06700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10fc114f30 con 0x7f10fc0fcbf0 2023-12-05T09:57:33.415 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:33.416+0000 7f10fa59c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10fc0fcbf0 0x7f10fc113b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:57:33.415 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:33.416+0000 7f10fa59c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10fc0fcbf0 0x7f10fc113b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.100:49932/0 (socket says 172.21.15.100:49932) 2023-12-05T09:57:33.415 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:33.416+0000 7f10fa59c700 1 -- 172.21.15.100:0/1165470033 learned_addr learned my addr 172.21.15.100:0/1165470033 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:57:33.415 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:33.417+0000 7f10f9d9b700 1 --2- 172.21.15.100:0/1165470033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10fc0fde00 0x7f10fc114090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:57:33.415 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:33.417+0000 7f10fa59c700 1 -- 172.21.15.100:0/1165470033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10fc0fde00 msgr2=0x7f10fc114090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:57:33.416 INFO:tasks.workunit.client.1.smithi150.stdout:4/468: creat d0/d3e/f8d x:0 0 0 2023-12-05T09:57:33.416 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:33.418+0000 7f10fa59c700 1 --2- 172.21.15.100:0/1165470033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10fc0fde00 0x7f10fc114090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:33.417 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:33.418+0000 7f10fa59c700 1 -- 172.21.15.100:0/1165470033 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e4005040 con 0x7f10fc0fcbf0 2023-12-05T09:57:33.417 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:33.419+0000 7f10fa59c700 1 --2- 172.21.15.100:0/1165470033 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10fc0fcbf0 0x7f10fc113b50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f10f4002a50 tx=0x7f10f4004600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:57:33.417 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:33.419+0000 7f10f2ffd700 1 -- 172.21.15.100:0/1165470033 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10f4007cc0 con 0x7f10fc0fcbf0 2023-12-05T09:57:33.417 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:33.419+0000 7f10f2ffd700 1 -- 172.21.15.100:0/1165470033 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f10f400f040 con 0x7f10fc0fcbf0 2023-12-05T09:57:33.417 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:33.419+0000 7f10f2ffd700 1 -- 172.21.15.100:0/1165470033 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10f400d8e0 con 0x7f10fc0fcbf0 2023-12-05T09:57:33.419 INFO:tasks.workunit.client.1.smithi150.stdout:8/567: symlink d0/d41/d49/d1b/d24/d34/d56/lb0 0 2023-12-05T09:57:33.419 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:33.420+0000 7f1100c06700 1 -- 172.21.15.100:0/1165470033 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10fc115210 con 0x7f10fc0fcbf0 2023-12-05T09:57:33.419 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:33.420+0000 7f1100c06700 1 -- 172.21.15.100:0/1165470033 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10fc115700 con 0x7f10fc0fcbf0 2023-12-05T09:57:33.419 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:33.421+0000 7f1100c06700 1 -- 172.21.15.100:0/1165470033 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10fc04bb80 con 0x7f10fc0fcbf0 2023-12-05T09:57:33.422 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:33.423+0000 7f10f2ffd700 1 -- 172.21.15.100:0/1165470033 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 25) v1 ==== 88726+0+0 (secure 0 0 0) 0x7f10f400dba0 con 0x7f10fc0fcbf0 2023-12-05T09:57:33.422 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:33.425+0000 7f10f2ffd700 1 --2- 172.21.15.100:0/1165470033 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7f10e806ae90 0x7f10e806d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:57:33.422 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:33.425+0000 7f10f2ffd700 1 -- 172.21.15.100:0/1165470033 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f10f4089a20 con 0x7f10fc0fcbf0 2023-12-05T09:57:33.422 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:33.426+0000 7f10f9d9b700 1 --2- 172.21.15.100:0/1165470033 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7f10e806ae90 0x7f10e806d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:57:33.423 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:33.427+0000 7f10f9d9b700 1 --2- 172.21.15.100:0/1165470033 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7f10e806ae90 0x7f10e806d340 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f10e4004560 tx=0x7f10e4009e30 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:57:33.423 INFO:tasks.workunit.client.1.smithi150.stdout:6/474: creat d2/d23/d2e/d93/f9e x:0 0 0 2023-12-05T09:57:33.428 INFO:tasks.workunit.client.0.smithi100.stdout:1/485: dwrite db/d12/d1e/d26/d30/f8e [0,4194304] 0 2023-12-05T09:57:33.430 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:33.433+0000 7f10f2ffd700 1 -- 172.21.15.100:0/1165470033 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f10f4057750 con 0x7f10fc0fcbf0 2023-12-05T09:57:33.430 INFO:tasks.workunit.client.1.smithi150.stdout:9/487: dwrite d3/d9/dc/d1f/f2b [0,4194304] 0 2023-12-05T09:57:33.432 INFO:tasks.workunit.client.0.smithi100.stdout:8/439: rmdir d0/d35/d63 39 2023-12-05T09:57:33.440 INFO:tasks.workunit.client.0.smithi100.stdout:3/620: rmdir d0/d2/de/db8 39 2023-12-05T09:57:33.441 INFO:tasks.workunit.client.1.smithi150.stdout:2/547: symlink d0/da3/dae/lc1 0 2023-12-05T09:57:33.441 INFO:tasks.workunit.client.1.smithi150.stdout:2/548: truncate d0/d3/d5/d13/d15/d30/d54/d57/fb4 1179438 0 2023-12-05T09:57:33.446 INFO:tasks.workunit.client.1.smithi150.stdout:7/531: creat d2/db/d30/d13/d4f/d7e/fb5 x:0 0 0 2023-12-05T09:57:33.448 INFO:tasks.workunit.client.0.smithi100.stdout:4/471: dwrite de/f13 [0,4194304] 0 2023-12-05T09:57:33.448 INFO:tasks.workunit.client.0.smithi100.stdout:4/472: read - de/d16/d23/d36/f56 zero size 2023-12-05T09:57:33.453 INFO:tasks.workunit.client.1.smithi150.stdout:3/532: symlink d6/d25/d28/d9a/lac 0 2023-12-05T09:57:33.454 INFO:tasks.workunit.client.1.smithi150.stdout:3/533: getdents d6/d9/d3d/d8a 0 2023-12-05T09:57:33.455 INFO:tasks.workunit.client.0.smithi100.stdout:2/636: symlink d7/da/d18/d21/d4d/ld5 0 2023-12-05T09:57:33.455 INFO:tasks.workunit.client.0.smithi100.stdout:1/486: write db/d12/d1e/f38 [3924770,103423] 0 2023-12-05T09:57:33.464 INFO:tasks.workunit.client.0.smithi100.stdout:2/637: dread d7/da/d1a/f73 [0,4194304] 0 2023-12-05T09:57:33.468 INFO:tasks.workunit.client.1.smithi150.stdout:0/570: mknod d5/d11/d71/d99/d9c/d96/dc1/cca 0 2023-12-05T09:57:33.468 INFO:tasks.workunit.client.1.smithi150.stdout:2/549: dread d0/d3/d5/d13/d15/d30/d54/d57/f88 [0,4194304] 0 2023-12-05T09:57:33.468 INFO:tasks.workunit.client.1.smithi150.stdout:2/550: chown d0/d3/d5/d36/d86/fa0 2 1 2023-12-05T09:57:33.469 INFO:tasks.workunit.client.0.smithi100.stdout:9/515: write d7/d1b/d22/d51/f5f [1222793,111975] 0 2023-12-05T09:57:33.469 INFO:tasks.workunit.client.0.smithi100.stdout:9/516: write d7/fd [4517238,50549] 0 2023-12-05T09:57:33.469 INFO:tasks.workunit.client.0.smithi100.stdout:9/517: truncate d7/d35/d71/f7a 712840 0 2023-12-05T09:57:33.469 INFO:tasks.workunit.client.0.smithi100.stdout:9/518: creat d7/d1b/da5/fb0 x:0 0 0 2023-12-05T09:57:33.469 INFO:tasks.workunit.client.0.smithi100.stdout:9/519: stat d7/d1b/d22/d51/d32 0 2023-12-05T09:57:33.469 INFO:tasks.workunit.client.0.smithi100.stdout:9/520: fdatasync d7/f4d 0 2023-12-05T09:57:33.470 INFO:tasks.workunit.client.1.smithi150.stdout:1/522: sync 2023-12-05T09:57:33.470 INFO:tasks.workunit.client.1.smithi150.stdout:5/526: sync 2023-12-05T09:57:33.471 INFO:tasks.workunit.client.1.smithi150.stdout:6/475: mknod d2/d23/d3b/d64/c9f 0 2023-12-05T09:57:33.472 INFO:tasks.workunit.client.0.smithi100.stdout:0/473: dwrite da/f5a [0,4194304] 0 2023-12-05T09:57:33.473 INFO:tasks.workunit.client.0.smithi100.stdout:7/475: rmdir d3/dc 39 2023-12-05T09:57:33.477 INFO:tasks.workunit.client.1.smithi150.stdout:9/488: unlink d3/d9/f14 0 2023-12-05T09:57:33.482 INFO:tasks.workunit.client.1.smithi150.stdout:7/532: symlink d2/db/d17/d38/d85/lb6 0 2023-12-05T09:57:33.482 INFO:tasks.workunit.client.1.smithi150.stdout:7/533: truncate d2/db/d30/f94 865243 0 2023-12-05T09:57:33.485 INFO:tasks.workunit.client.0.smithi100.stdout:8/440: rename d0/f2b to d0/d12/d13/d16/d42/f75 0 2023-12-05T09:57:33.487 INFO:tasks.workunit.client.1.smithi150.stdout:3/534: creat d6/d9/d3d/d87/fad x:0 0 0 2023-12-05T09:57:33.487 INFO:tasks.workunit.client.1.smithi150.stdout:3/535: chown d6/d22/d37/da1/faa 0 1 2023-12-05T09:57:33.487 INFO:tasks.workunit.client.1.smithi150.stdout:3/536: read - d6/d9/d3d/d56/d53/f78 zero size 2023-12-05T09:57:33.488 INFO:tasks.workunit.client.0.smithi100.stdout:4/473: rmdir de/d38/d92 0 2023-12-05T09:57:33.489 INFO:tasks.workunit.client.0.smithi100.stdout:4/474: dread - de/d16/d1e/f62 zero size 2023-12-05T09:57:33.489 INFO:tasks.workunit.client.1.smithi150.stdout:0/571: symlink d5/d11/d71/d5f/lcb 0 2023-12-05T09:57:33.492 INFO:tasks.workunit.client.1.smithi150.stdout:1/523: rename d6/d3c/da8 to d6/d8/d85/dbe 0 2023-12-05T09:57:33.492 INFO:tasks.workunit.client.1.smithi150.stdout:1/524: readlink d6/d8/l2e 0 2023-12-05T09:57:33.493 INFO:tasks.workunit.client.0.smithi100.stdout:2/638: unlink d7/da/d13/d69/c7f 0 2023-12-05T09:57:33.500 INFO:tasks.workunit.client.1.smithi150.stdout:6/476: mkdir d2/d23/d2e/d44/da0 0 2023-12-05T09:57:33.501 INFO:tasks.workunit.client.1.smithi150.stdout:9/489: mkdir d3/d9/dc/d1f/d24/d75/d95/d9a 0 2023-12-05T09:57:33.508 INFO:tasks.workunit.client.0.smithi100.stdout:9/521: creat d7/d35/fb1 x:0 0 0 2023-12-05T09:57:33.508 INFO:tasks.workunit.client.0.smithi100.stdout:4/475: write de/d16/d23/f24 [876882,64978] 0 2023-12-05T09:57:33.509 INFO:tasks.workunit.client.1.smithi150.stdout:7/534: creat d2/d72/d82/fb7 x:0 0 0 2023-12-05T09:57:33.509 INFO:tasks.workunit.client.1.smithi150.stdout:9/490: mkdir d3/d9/d26/d9b 0 2023-12-05T09:57:33.509 INFO:tasks.workunit.client.0.smithi100.stdout:0/474: unlink da/d2a/d45/l68 0 2023-12-05T09:57:33.509 INFO:tasks.workunit.client.0.smithi100.stdout:0/475: truncate da/d1b/d6b/d78/f88 155288 0 2023-12-05T09:57:33.509 INFO:tasks.workunit.client.0.smithi100.stdout:0/476: stat da/d1b 0 2023-12-05T09:57:33.512 INFO:tasks.workunit.client.1.smithi150.stdout:9/491: mkdir d3/d9/d9c 0 2023-12-05T09:57:33.512 INFO:tasks.workunit.client.1.smithi150.stdout:9/492: creat d3/d9/dc/d1f/d24/f9d x:0 0 0 2023-12-05T09:57:33.519 INFO:tasks.workunit.client.0.smithi100.stdout:3/621: rename d0/d3d/d5c/d5f/d73/f9d to d0/d3d/d5c/fd4 0 2023-12-05T09:57:33.525 INFO:tasks.workunit.client.1.smithi150.stdout:9/493: rename d3/d9/dc/l8d to d3/d1b/d79/l9e 0 2023-12-05T09:57:33.528 INFO:tasks.workunit.client.0.smithi100.stdout:9/522: write d7/d1b/f33 [1316328,82419] 0 2023-12-05T09:57:33.539 INFO:tasks.workunit.client.0.smithi100.stdout:4/476: symlink de/d16/d23/d36/l97 0 2023-12-05T09:57:33.540 INFO:tasks.workunit.client.1.smithi150.stdout:8/568: sync 2023-12-05T09:57:33.540 INFO:tasks.workunit.client.0.smithi100.stdout:0/477: rmdir da/d2a/d8c 39 2023-12-05T09:57:33.540 INFO:tasks.workunit.client.0.smithi100.stdout:0/478: chown da/l32 0 1 2023-12-05T09:57:33.541 INFO:tasks.workunit.client.0.smithi100.stdout:7/476: symlink d3/dc/d11/d13/laf 0 2023-12-05T09:57:33.542 INFO:tasks.workunit.client.1.smithi150.stdout:7/535: read d2/db/d17/f78 [260925,41927] 0 2023-12-05T09:57:33.550 INFO:tasks.workunit.client.1.smithi150.stdout:8/569: creat d0/d41/fb1 x:0 0 0 2023-12-05T09:57:33.551 INFO:tasks.workunit.client.1.smithi150.stdout:8/570: write d0/d41/d49/d1b/d24/d34/d56/d67/f6c [1578221,43851] 0 2023-12-05T09:57:33.554 INFO:tasks.workunit.client.0.smithi100.stdout:4/477: unlink de/d16/d23/d60/d88/l89 0 2023-12-05T09:57:33.554 INFO:tasks.workunit.client.0.smithi100.stdout:4/478: fsync de/d16/d23/d33/d3d/d44/d4e/f50 0 2023-12-05T09:57:33.555 INFO:tasks.workunit.client.0.smithi100.stdout:4/479: write de/f1b [3599513,8135] 0 2023-12-05T09:57:33.559 INFO:tasks.workunit.client.1.smithi150.stdout:7/536: creat d2/db/d30/d53/d90/fb8 x:0 0 0 2023-12-05T09:57:33.559 INFO:tasks.workunit.client.1.smithi150.stdout:7/537: truncate d2/db/d17/d38/d85/f8b 38303 0 2023-12-05T09:57:33.559 INFO:tasks.workunit.client.1.smithi150.stdout:7/538: dread - d2/db/d30/d18/d1a/d1e/d2b/f84 zero size 2023-12-05T09:57:33.560 INFO:tasks.workunit.client.0.smithi100.stdout:0/479: mknod da/d1b/d6b/d78/c90 0 2023-12-05T09:57:33.565 INFO:tasks.workunit.client.0.smithi100.stdout:8/441: dwrite d0/d12/f36 [0,4194304] 0 2023-12-05T09:57:33.565 INFO:tasks.workunit.client.0.smithi100.stdout:7/477: rename d3/dc/d11/d13/d1b/l8a to d3/dc/d11/d13/de/d2d/d47/lb0 0 2023-12-05T09:57:33.565 INFO:tasks.workunit.client.0.smithi100.stdout:7/478: dread - d3/dc/d11/d13/de/d18/d3b/f9c zero size 2023-12-05T09:57:33.565 INFO:tasks.workunit.client.0.smithi100.stdout:7/479: readlink d3/dc/d11/d13/l51 0 2023-12-05T09:57:33.565 INFO:tasks.workunit.client.1.smithi150.stdout:7/539: write d2/d1b/d31/f8d [875213,10222] 0 2023-12-05T09:57:33.566 INFO:tasks.workunit.client.1.smithi150.stdout:8/571: mknod d0/d41/d49/d1b/d24/d2e/d4d/cb2 0 2023-12-05T09:57:33.567 INFO:tasks.workunit.client.1.smithi150.stdout:8/572: truncate d0/d8/fa9 685418 0 2023-12-05T09:57:33.567 INFO:tasks.workunit.client.1.smithi150.stdout:0/572: dwrite d5/d11/d32/d57/fa7 [0,4194304] 0 2023-12-05T09:57:33.568 INFO:tasks.workunit.client.1.smithi150.stdout:2/551: dwrite d0/d3/f70 [0,4194304] 0 2023-12-05T09:57:33.569 INFO:tasks.workunit.client.0.smithi100.stdout:3/622: rmdir d0/d2/de/d11 39 2023-12-05T09:57:33.569 INFO:tasks.workunit.client.0.smithi100.stdout:3/623: stat d0/d3d/d5c 0 2023-12-05T09:57:33.570 INFO:tasks.workunit.client.1.smithi150.stdout:7/540: rename d2/db/d17/f78 to d2/d9d/da0/fb9 0 2023-12-05T09:57:33.570 INFO:tasks.workunit.client.1.smithi150.stdout:9/494: write d3/d9/dc/d1f/f2b [1545335,83659] 0 2023-12-05T09:57:33.570 INFO:tasks.workunit.client.0.smithi100.stdout:4/480: mkdir de/d16/d23/d60/d98 0 2023-12-05T09:57:33.571 INFO:tasks.workunit.client.0.smithi100.stdout:4/481: truncate de/d66/f75 568699 0 2023-12-05T09:57:33.573 INFO:tasks.workunit.client.1.smithi150.stdout:0/573: link d5/d11/d71/l29 d5/d11/d71/d5f/d77/d87/lcc 0 2023-12-05T09:57:33.574 INFO:tasks.workunit.client.0.smithi100.stdout:0/480: mknod da/c91 0 2023-12-05T09:57:33.574 INFO:tasks.workunit.client.1.smithi150.stdout:3/537: dwrite d6/d9/f32 [0,4194304] 0 2023-12-05T09:57:33.574 INFO:tasks.workunit.client.1.smithi150.stdout:3/538: fsync d6/d9/d3d/d56/f3f 0 2023-12-05T09:57:33.575 INFO:tasks.workunit.client.1.smithi150.stdout:3/539: fdatasync d6/d9/d3d/d56/d30/f5e 0 2023-12-05T09:57:33.576 INFO:tasks.workunit.client.1.smithi150.stdout:7/541: rmdir d2/d1b/d31/d8e 0 2023-12-05T09:57:33.581 INFO:tasks.workunit.client.0.smithi100.stdout:7/480: creat d3/dc/d11/d13/fb1 x:0 0 0 2023-12-05T09:57:33.583 INFO:tasks.workunit.client.1.smithi150.stdout:3/540: rename d6/d25/d28/f2d to d6/d9/d43/d75/fae 0 2023-12-05T09:57:33.583 INFO:tasks.workunit.client.1.smithi150.stdout:3/541: fdatasync d6/d9/f50 0 2023-12-05T09:57:33.583 INFO:tasks.workunit.client.1.smithi150.stdout:3/542: chown d6/f6c 519 1 2023-12-05T09:57:33.583 INFO:tasks.workunit.client.1.smithi150.stdout:3/543: readlink d6/d9/d43/d47/l11 0 2023-12-05T09:57:33.584 INFO:tasks.workunit.client.0.smithi100.stdout:3/624: mknod d0/d3d/d5c/d5f/d73/cd5 0 2023-12-05T09:57:33.585 INFO:tasks.workunit.client.0.smithi100.stdout:7/481: symlink d3/dc/lb2 0 2023-12-05T09:57:33.590 INFO:tasks.workunit.client.0.smithi100.stdout:3/625: symlink d0/d2/de/d11/d7c/ld6 0 2023-12-05T09:57:33.595 INFO:tasks.workunit.client.1.smithi150.stdout:7/542: write d2/db/d30/d18/d63/f7f [4037734,45007] 0 2023-12-05T09:57:33.596 INFO:tasks.workunit.client.1.smithi150.stdout:7/543: readlink d2/d1b/d31/l3b 0 2023-12-05T09:57:33.596 INFO:tasks.workunit.client.1.smithi150.stdout:6/477: dwrite d2/f13 [0,4194304] 0 2023-12-05T09:57:33.600 INFO:tasks.workunit.client.1.smithi150.stdout:7/544: truncate d2/d4/f27 3141721 0 2023-12-05T09:57:33.601 INFO:tasks.workunit.client.1.smithi150.stdout:6/478: unlink d2/d23/d2e/d44/f54 0 2023-12-05T09:57:33.601 INFO:tasks.workunit.client.1.smithi150.stdout:7/545: truncate d2/db/d17/f7a 656136 0 2023-12-05T09:57:33.604 INFO:tasks.workunit.client.1.smithi150.stdout:6/479: creat d2/d23/d2e/d5f/fa1 x:0 0 0 2023-12-05T09:57:33.605 INFO:tasks.workunit.client.1.smithi150.stdout:6/480: creat d2/d23/d3b/d46/fa2 x:0 0 0 2023-12-05T09:57:33.621 INFO:tasks.workunit.client.1.smithi150.stdout:1/525: dwrite d6/d38/d4a/f57 [0,4194304] 0 2023-12-05T09:57:33.622 INFO:tasks.workunit.client.1.smithi150.stdout:4/469: dwrite d0/d3e/d48/d4d/f86 [0,4194304] 0 2023-12-05T09:57:33.625 INFO:tasks.workunit.client.1.smithi150.stdout:7/546: write d2/db/d17/d20/f3f [1933766,75918] 0 2023-12-05T09:57:33.625 INFO:tasks.workunit.client.1.smithi150.stdout:9/495: dwrite d3/f29 [0,4194304] 0 2023-12-05T09:57:33.635 INFO:tasks.workunit.client.1.smithi150.stdout:8/573: dread d0/d8/f82 [0,4194304] 0 2023-12-05T09:57:33.635 INFO:tasks.workunit.client.1.smithi150.stdout:8/574: write d0/d41/d49/d1b/d24/d34/d56/f60 [738491,23415] 0 2023-12-05T09:57:33.635 INFO:tasks.workunit.client.0.smithi100.stdout:7/482: write d3/dc/d11/d33/f62 [2727652,14178] 0 2023-12-05T09:57:33.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:33 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:57:33.646 INFO:tasks.workunit.client.1.smithi150.stdout:4/470: creat d0/d3e/d6d/d4b/d8c/f8e x:0 0 0 2023-12-05T09:57:33.648 INFO:tasks.workunit.client.0.smithi100.stdout:7/483: dread d3/dc/d11/d13/de/f48 [0,4194304] 0 2023-12-05T09:57:33.650 INFO:tasks.workunit.client.1.smithi150.stdout:7/547: creat d2/db/d30/daf/fba x:0 0 0 2023-12-05T09:57:33.650 INFO:tasks.workunit.client.1.smithi150.stdout:7/548: chown d2/db/d30/d18/f57 5740 1 2023-12-05T09:57:33.652 INFO:tasks.workunit.client.1.smithi150.stdout:4/471: dread d0/d3e/f79 [0,4194304] 0 2023-12-05T09:57:33.652 INFO:tasks.workunit.client.1.smithi150.stdout:4/472: fdatasync d0/d3e/d5b/d6e/f88 0 2023-12-05T09:57:33.653 INFO:tasks.workunit.client.0.smithi100.stdout:7/484: mkdir d3/db3 0 2023-12-05T09:57:33.653 INFO:tasks.workunit.client.0.smithi100.stdout:0/481: dwrite da/d22/d33/f7d [0,4194304] 0 2023-12-05T09:57:33.653 INFO:tasks.workunit.client.0.smithi100.stdout:0/482: readlink da/d2a/d4d/l3d 0 2023-12-05T09:57:33.654 INFO:tasks.workunit.client.1.smithi150.stdout:3/544: dwrite d6/d9/d3d/d56/d53/d51/f8b [0,4194304] 0 2023-12-05T09:57:33.655 INFO:tasks.workunit.client.1.smithi150.stdout:3/545: chown d6/d9/d8d 28 1 2023-12-05T09:57:33.655 INFO:tasks.workunit.client.1.smithi150.stdout:3/546: chown d6/d22/d37/c4f 39492552 1 2023-12-05T09:57:33.658 INFO:tasks.workunit.client.1.smithi150.stdout:8/575: rename d0/d41/d49/d1b/d24/d34/da2/lab to d0/d41/d49/d1b/d24/d38/dad/lb3 0 2023-12-05T09:57:33.658 INFO:tasks.workunit.client.1.smithi150.stdout:7/549: rename d2/db/d30 to d2/db/d30/d18/d63/dbb 22 2023-12-05T09:57:33.658 INFO:tasks.workunit.client.1.smithi150.stdout:8/576: creat d0/d41/d49/d1b/d24/d5b/fb4 x:0 0 0 2023-12-05T09:57:33.660 INFO:tasks.workunit.client.1.smithi150.stdout:9/496: creat d3/d9/d6e/d76/f9f x:0 0 0 2023-12-05T09:57:33.660 INFO:tasks.workunit.client.1.smithi150.stdout:9/497: fsync d3/f40 0 2023-12-05T09:57:33.661 INFO:tasks.workunit.client.1.smithi150.stdout:2/552: dwrite d0/d3/d5/d13/d15/d30/d54/d57/f75 [0,4194304] 0 2023-12-05T09:57:33.661 INFO:tasks.workunit.client.1.smithi150.stdout:2/553: write d0/d3/d5/d10/f19 [6306082,75269] 0 2023-12-05T09:57:33.663 INFO:tasks.workunit.client.1.smithi150.stdout:4/473: chown d0/f41 1677 1 2023-12-05T09:57:33.672 INFO:tasks.workunit.client.1.smithi150.stdout:6/481: dwrite d2/f34 [0,4194304] 0 2023-12-05T09:57:33.673 INFO:tasks.workunit.client.1.smithi150.stdout:1/526: dwrite d6/d8/d59/f91 [0,4194304] 0 2023-12-05T09:57:33.847 INFO:tasks.workunit.client.1.smithi150.stdout:1/527: dread - d6/d38/da1/fa6 zero size 2023-12-05T09:57:33.847 INFO:tasks.workunit.client.0.smithi100.stdout:0/483: getdents da/d1b 0 2023-12-05T09:57:33.847 INFO:tasks.workunit.client.0.smithi100.stdout:6/888: sync 2023-12-05T09:57:33.847 INFO:tasks.workunit.client.0.smithi100.stdout:5/543: sync 2023-12-05T09:57:33.852 INFO:tasks.workunit.client.0.smithi100.stdout:0/484: symlink da/d2a/d4d/l92 0 2023-12-05T09:57:33.852 INFO:tasks.workunit.client.0.smithi100.stdout:7/485: write d3/dc/d11/d13/de/d2d/f4e [3998799,127102] 0 2023-12-05T09:57:33.852 INFO:tasks.workunit.client.0.smithi100.stdout:6/889: creat d7/d27/d35/d5a/d11e/f123 x:0 0 0 2023-12-05T09:57:33.853 INFO:tasks.workunit.client.0.smithi100.stdout:7/486: creat d3/dc/d11/d33/fb4 x:0 0 0 2023-12-05T09:57:33.853 INFO:tasks.workunit.client.0.smithi100.stdout:0/485: rename da/d22/l5c to da/d1b/l93 0 2023-12-05T09:57:33.853 INFO:tasks.workunit.client.0.smithi100.stdout:0/486: mkdir da/d22/d33/d7f/d94 0 2023-12-05T09:57:33.853 INFO:tasks.workunit.client.0.smithi100.stdout:0/487: rmdir da/d60 39 2023-12-05T09:57:33.853 INFO:tasks.workunit.client.0.smithi100.stdout:5/544: dwrite d0/d16/d2b/d48/df/d51/f94 [0,4194304] 0 2023-12-05T09:57:33.853 INFO:tasks.workunit.client.0.smithi100.stdout:5/545: read - d0/d1f/d53/fac zero size 2023-12-05T09:57:33.853 INFO:tasks.workunit.client.0.smithi100.stdout:7/487: dread d3/dc/d11/d33/f79 [0,4194304] 0 2023-12-05T09:57:33.853 INFO:tasks.workunit.client.0.smithi100.stdout:5/546: mkdir d0/dbe 0 2023-12-05T09:57:33.853 INFO:tasks.workunit.client.0.smithi100.stdout:5/547: chown d0/d1b/d4d/d6c/f7d 53210833 1 2023-12-05T09:57:33.853 INFO:tasks.workunit.client.0.smithi100.stdout:6/890: dwrite d7/d11/f51 [4194304,4194304] 0 2023-12-05T09:57:33.853 INFO:tasks.workunit.client.0.smithi100.stdout:7/488: dwrite d3/dc/d11/d33/f62 [0,4194304] 0 2023-12-05T09:57:33.854 INFO:tasks.workunit.client.0.smithi100.stdout:7/489: chown d3/dc/d11/d13/de/d18/d3b/d40/d4c/d7f/ca0 203577265 1 2023-12-05T09:57:33.854 INFO:tasks.workunit.client.0.smithi100.stdout:7/490: dread - d3/dc/d11/d13/fb1 zero size 2023-12-05T09:57:33.854 INFO:tasks.workunit.client.0.smithi100.stdout:7/491: unlink d3/dc/d11/d33/fab 0 2023-12-05T09:57:33.854 INFO:tasks.workunit.client.0.smithi100.stdout:7/492: readlink d3/dc/d11/d13/d37/l5b 0 2023-12-05T09:57:33.854 INFO:tasks.workunit.client.0.smithi100.stdout:7/493: rename d3/dc/d11/d13/de/f86 to d3/dc/d11/d13/de/d18/d3b/d40/d4c/d7f/fb5 0 2023-12-05T09:57:33.854 INFO:tasks.workunit.client.0.smithi100.stdout:7/494: getdents d3/db3 0 2023-12-05T09:57:33.854 INFO:tasks.workunit.client.0.smithi100.stdout:7/495: truncate d3/dc/d11/d13/d1b/f45 822872 0 2023-12-05T09:57:33.854 INFO:tasks.workunit.client.0.smithi100.stdout:7/496: getdents d3/dc/d11/d13/de/d2d/d47 0 2023-12-05T09:57:33.860 INFO:tasks.workunit.client.1.smithi150.stdout:8/577: link d0/d41/d49/d1b/d24/d5b/l5f d0/d41/d49/d1b/d24/d38/d62/lb5 0 2023-12-05T09:57:33.861 INFO:tasks.workunit.client.1.smithi150.stdout:9/498: rename d3/d9/dc/l61 to d3/d1b/la0 0 2023-12-05T09:57:33.861 INFO:tasks.workunit.client.1.smithi150.stdout:9/499: dread d3/d1b/d46/d55/d64/f7c [0,4194304] 0 2023-12-05T09:57:33.861 INFO:tasks.workunit.client.1.smithi150.stdout:7/550: dwrite d2/db/d30/d13/d4f/f59 [0,4194304] 0 2023-12-05T09:57:33.861 INFO:tasks.workunit.client.1.smithi150.stdout:1/528: unlink d6/d47/l98 0 2023-12-05T09:57:33.861 INFO:tasks.workunit.client.1.smithi150.stdout:1/529: fsync d6/f8d 0 2023-12-05T09:57:33.861 INFO:tasks.workunit.client.1.smithi150.stdout:3/547: getdents d6/d9/d43/d47 0 2023-12-05T09:57:33.861 INFO:tasks.workunit.client.1.smithi150.stdout:3/548: readlink d6/d9/d43/l6d 0 2023-12-05T09:57:33.861 INFO:tasks.workunit.client.1.smithi150.stdout:8/578: mknod d0/d41/d49/d1b/d24/d5b/d9c/cb6 0 2023-12-05T09:57:33.861 INFO:tasks.workunit.client.1.smithi150.stdout:8/579: read - d0/d41/d49/d1b/d24/d38/d62/f68 zero size 2023-12-05T09:57:33.861 INFO:tasks.workunit.client.1.smithi150.stdout:8/580: truncate d0/d41/d49/f59 2377565 0 2023-12-05T09:57:33.861 INFO:tasks.workunit.client.1.smithi150.stdout:8/581: fdatasync d0/d41/d49/d1b/d24/d38/f3d 0 2023-12-05T09:57:33.861 INFO:tasks.workunit.client.1.smithi150.stdout:8/582: write d0/d41/d49/d1b/d24/d38/d62/f8c [627771,79039] 0 2023-12-05T09:57:33.861 INFO:tasks.workunit.client.1.smithi150.stdout:8/583: chown d0/d41/l88 306301 1 2023-12-05T09:57:33.861 INFO:tasks.workunit.client.1.smithi150.stdout:2/554: rename d0/f49 to d0/d3/d5/d3b/d4c/d71/fc2 0 2023-12-05T09:57:33.861 INFO:tasks.workunit.client.1.smithi150.stdout:5/527: sync 2023-12-05T09:57:33.862 INFO:tasks.workunit.client.1.smithi150.stdout:6/482: mknod d2/d23/d3b/d64/d7a/d5d/d6b/ca3 0 2023-12-05T09:57:33.862 INFO:tasks.workunit.client.1.smithi150.stdout:3/549: dread d6/d9/d3d/d56/f3f [4194304,4194304] 0 2023-12-05T09:57:33.862 INFO:tasks.workunit.client.1.smithi150.stdout:8/584: symlink d0/d41/d49/d1b/d24/d5b/d87/lb7 0 2023-12-05T09:57:33.862 INFO:tasks.workunit.client.1.smithi150.stdout:8/585: write d0/d41/d49/d1b/f1c [4635722,32301] 0 2023-12-05T09:57:33.862 INFO:tasks.workunit.client.1.smithi150.stdout:8/586: dread - d0/d41/d49/d1b/d24/d5b/fb4 zero size 2023-12-05T09:57:33.862 INFO:tasks.workunit.client.1.smithi150.stdout:8/587: write d0/d41/d49/d1b/d24/d2e/d4d/f7c [2378338,116630] 0 2023-12-05T09:57:33.862 INFO:tasks.workunit.client.1.smithi150.stdout:7/551: dwrite d2/d1b/d5b/f9c [0,4194304] 0 2023-12-05T09:57:33.862 INFO:tasks.workunit.client.1.smithi150.stdout:7/552: dread - d2/d39/f67 zero size 2023-12-05T09:57:33.862 INFO:tasks.workunit.client.1.smithi150.stdout:2/555: mkdir d0/da3/dae/dc3 0 2023-12-05T09:57:33.862 INFO:tasks.workunit.client.1.smithi150.stdout:8/588: mkdir d0/d41/d49/d1b/d24/d38/d62/dac/db8 0 2023-12-05T09:57:33.862 INFO:tasks.workunit.client.1.smithi150.stdout:8/589: dread - d0/d41/d49/d1b/d24/d5b/fb4 zero size 2023-12-05T09:57:33.862 INFO:tasks.workunit.client.1.smithi150.stdout:9/500: rename d3/d9/dc/f96 to d3/d9/dc/d1f/fa1 0 2023-12-05T09:57:33.862 INFO:tasks.workunit.client.1.smithi150.stdout:9/501: stat d3/d9/dc/d1f/f2b 0 2023-12-05T09:57:33.862 INFO:tasks.workunit.client.1.smithi150.stdout:7/553: link d2/d39/f64 d2/db/d30/d13/d4f/fbc 0 2023-12-05T09:57:33.862 INFO:tasks.workunit.client.1.smithi150.stdout:2/556: creat d0/d3/d5/d10/d3d/da1/fc4 x:0 0 0 2023-12-05T09:57:33.863 INFO:tasks.workunit.client.1.smithi150.stdout:2/557: chown d0/d3/d5/d13 76 1 2023-12-05T09:57:33.863 INFO:tasks.workunit.client.1.smithi150.stdout:2/558: creat d0/fc5 x:0 0 0 2023-12-05T09:57:33.863 INFO:tasks.workunit.client.1.smithi150.stdout:6/483: rename d2/d23/d2e/d44/f9b to d2/d23/d3b/fa4 0 2023-12-05T09:57:33.863 INFO:tasks.workunit.client.1.smithi150.stdout:1/530: dwrite d6/d8/db/f6e [0,4194304] 0 2023-12-05T09:57:33.863 INFO:tasks.workunit.client.1.smithi150.stdout:1/531: chown d6/d8/c3b 3946342 1 2023-12-05T09:57:33.863 INFO:tasks.workunit.client.1.smithi150.stdout:7/554: mknod d2/db/d30/d18/d63/cbd 0 2023-12-05T09:57:33.863 INFO:tasks.workunit.client.1.smithi150.stdout:8/590: getdents d0/d41/d49 0 2023-12-05T09:57:33.863 INFO:tasks.workunit.client.1.smithi150.stdout:8/591: creat d0/d41/d49/d1b/d24/d38/d62/fb9 x:0 0 0 2023-12-05T09:57:33.863 INFO:tasks.workunit.client.1.smithi150.stdout:8/592: truncate d0/d41/d49/d1b/d24/d5b/f96 750323 0 2023-12-05T09:57:33.863 INFO:tasks.workunit.client.1.smithi150.stdout:8/593: write d0/d41/d49/d1b/f2b [86202,24972] 0 2023-12-05T09:57:33.863 INFO:tasks.workunit.client.1.smithi150.stdout:0/574: sync 2023-12-05T09:57:33.863 INFO:tasks.workunit.client.1.smithi150.stdout:6/484: rename d2/c36 to d2/d23/d3b/d64/d7a/ca5 0 2023-12-05T09:57:33.863 INFO:tasks.workunit.client.1.smithi150.stdout:6/485: fdatasync d2/f13 0 2023-12-05T09:57:33.863 INFO:tasks.workunit.client.1.smithi150.stdout:2/559: getdents d0/d3/d27 0 2023-12-05T09:57:33.863 INFO:tasks.workunit.client.1.smithi150.stdout:8/594: symlink d0/d41/d49/d1b/d24/d34/da2/lba 0 2023-12-05T09:57:33.864 INFO:tasks.workunit.client.1.smithi150.stdout:0/575: mknod d5/d11/d71/d74/ccd 0 2023-12-05T09:57:33.864 INFO:tasks.workunit.client.1.smithi150.stdout:8/595: write d0/d41/d49/d1b/d24/d34/d56/f60 [355277,74459] 0 2023-12-05T09:57:33.864 INFO:tasks.workunit.client.1.smithi150.stdout:8/596: creat d0/d41/d49/d1b/d24/fbb x:0 0 0 2023-12-05T09:57:33.864 INFO:tasks.workunit.client.1.smithi150.stdout:8/597: fdatasync d0/d41/d49/d1b/d24/d2e/f53 0 2023-12-05T09:57:33.864 INFO:tasks.workunit.client.1.smithi150.stdout:8/598: mkdir d0/d41/d49/d1b/d24/d34/dbc 0 2023-12-05T09:57:33.864 INFO:tasks.workunit.client.1.smithi150.stdout:8/599: chown d0/d41/d49/d1b/f1c 49 1 2023-12-05T09:57:33.864 INFO:tasks.workunit.client.1.smithi150.stdout:8/600: chown d0/d41/d49/d1b/d24/d34/d56/d67/l80 0 1 2023-12-05T09:57:33.864 INFO:tasks.workunit.client.1.smithi150.stdout:8/601: creat d0/d41/d49/fbd x:0 0 0 2023-12-05T09:57:33.866 INFO:tasks.workunit.client.1.smithi150.stdout:8/602: readlink d0/d41/d49/d1b/d24/d2e/l5a 0 2023-12-05T09:57:33.866 INFO:tasks.workunit.client.1.smithi150.stdout:8/603: truncate d0/d41/d49/d1b/d24/d38/d62/fb9 624996 0 2023-12-05T09:57:33.866 INFO:tasks.workunit.client.1.smithi150.stdout:8/604: fdatasync d0/d8/fa9 0 2023-12-05T09:57:33.866 INFO:tasks.workunit.client.1.smithi150.stdout:8/605: truncate d0/d41/d49/d1b/d24/fbb 561628 0 2023-12-05T09:57:33.866 INFO:tasks.workunit.client.1.smithi150.stdout:8/606: dread - d0/d41/d49/d1b/f93 zero size 2023-12-05T09:57:33.866 INFO:tasks.workunit.client.1.smithi150.stdout:2/560: read d0/d3/d27/f83 [3292702,12948] 0 2023-12-05T09:57:33.867 INFO:tasks.workunit.client.1.smithi150.stdout:2/561: dread d0/d3/d5/d13/d15/d30/d54/d57/f88 [0,4194304] 0 2023-12-05T09:57:33.867 INFO:tasks.workunit.client.1.smithi150.stdout:2/562: creat d0/d3/d27/db6/fc6 x:0 0 0 2023-12-05T09:57:33.867 INFO:tasks.workunit.client.1.smithi150.stdout:2/563: creat d0/d3/d5/d10/d3d/da1/daa/fc7 x:0 0 0 2023-12-05T09:57:33.867 INFO:tasks.workunit.client.1.smithi150.stdout:7/555: dwrite d2/d4/f23 [4194304,4194304] 0 2023-12-05T09:57:33.867 INFO:tasks.workunit.client.1.smithi150.stdout:2/564: mknod d0/d3/d5/d10/d3d/da1/cc8 0 2023-12-05T09:57:33.867 INFO:tasks.workunit.client.1.smithi150.stdout:7/556: symlink d2/db/d30/d18/d1a/d1e/lbe 0 2023-12-05T09:57:33.867 INFO:tasks.workunit.client.1.smithi150.stdout:2/565: rmdir d0/d3/d5 39 2023-12-05T09:57:33.869 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:33 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:57:33.870 INFO:tasks.workunit.client.1.smithi150.stdout:6/486: rename d2/d23/d3b/d64/d7a/ca5 to d2/d23/d2e/d44/da0/ca6 0 2023-12-05T09:57:33.871 INFO:tasks.workunit.client.1.smithi150.stdout:4/474: sync 2023-12-05T09:57:33.871 INFO:tasks.workunit.client.1.smithi150.stdout:6/487: dread - d2/d23/d2e/d93/f9e zero size 2023-12-05T09:57:33.871 INFO:tasks.workunit.client.1.smithi150.stdout:4/475: chown d0/d3e/d5b/d80/f7c 2408151 1 2023-12-05T09:57:33.871 INFO:tasks.workunit.client.1.smithi150.stdout:4/476: rmdir d0/d3e/d5b/d80/d44 39 2023-12-05T09:57:33.871 INFO:tasks.workunit.client.1.smithi150.stdout:6/488: unlink d2/d23/d3b/d83/l79 0 2023-12-05T09:57:33.871 INFO:tasks.workunit.client.1.smithi150.stdout:6/489: chown d2/c4e 3 1 2023-12-05T09:57:33.871 INFO:tasks.workunit.client.1.smithi150.stdout:6/490: mknod d2/d23/d3b/d64/d7a/d5d/ca7 0 2023-12-05T09:57:33.871 INFO:tasks.workunit.client.1.smithi150.stdout:3/550: dwrite d6/d9/f57 [0,4194304] 0 2023-12-05T09:57:33.871 INFO:tasks.workunit.client.1.smithi150.stdout:4/477: dread d0/f51 [0,4194304] 0 2023-12-05T09:57:33.871 INFO:tasks.workunit.client.1.smithi150.stdout:3/551: mkdir d6/d9/daf 0 2023-12-05T09:57:33.871 INFO:tasks.workunit.client.1.smithi150.stdout:8/607: dwrite d0/d41/d49/f81 [0,4194304] 0 2023-12-05T09:57:33.871 INFO:tasks.workunit.client.1.smithi150.stdout:8/608: readlink d0/d41/d49/d1b/d24/d2e/l3f 0 2023-12-05T09:57:33.872 INFO:tasks.workunit.client.0.smithi100.stdout:5/548: dwrite d0/d27/f29 [0,4194304] 0 2023-12-05T09:57:33.872 INFO:tasks.workunit.client.0.smithi100.stdout:6/891: dwrite d7/d11/d82/f28 [0,4194304] 0 2023-12-05T09:57:33.873 INFO:tasks.workunit.client.0.smithi100.stdout:5/549: creat d0/d1b/d4d/d60/fbf x:0 0 0 2023-12-05T09:57:33.873 INFO:tasks.workunit.client.0.smithi100.stdout:1/487: sync 2023-12-05T09:57:33.873 INFO:tasks.workunit.client.0.smithi100.stdout:1/488: stat db/d12/d1e/f5d 0 2023-12-05T09:57:33.873 INFO:tasks.workunit.client.0.smithi100.stdout:7/497: dwrite d3/dc/d11/d13/de/d18/d3b/d40/d46/f5f [0,4194304] 0 2023-12-05T09:57:33.873 INFO:tasks.workunit.client.0.smithi100.stdout:7/498: write d3/dc/d11/d13/f43 [151806,84178] 0 2023-12-05T09:57:33.873 INFO:tasks.workunit.client.0.smithi100.stdout:7/499: fsync d3/dc/d11/d13/d1b/f7e 0 2023-12-05T09:57:33.873 INFO:tasks.workunit.client.0.smithi100.stdout:5/550: mkdir d0/d27/dc0 0 2023-12-05T09:57:33.874 INFO:tasks.workunit.client.1.smithi150.stdout:4/478: creat d0/d3e/d6d/f8f x:0 0 0 2023-12-05T09:57:33.877 INFO:tasks.workunit.client.1.smithi150.stdout:3/552: mkdir d6/d9/d3d/d56/d71/db0 0 2023-12-05T09:57:33.887 INFO:tasks.workunit.client.0.smithi100.stdout:7/500: symlink d3/db3/lb6 0 2023-12-05T09:57:33.889 INFO:tasks.workunit.client.1.smithi150.stdout:2/566: dwrite d0/d3/f70 [4194304,4194304] 0 2023-12-05T09:57:33.896 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:33.898+0000 7f1100c06700 1 -- 172.21.15.100:0/1165470033 --> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f10fc102170 con 0x7f10e806ae90 2023-12-05T09:57:33.899 INFO:tasks.workunit.client.0.smithi100.stdout:7/501: symlink d3/dc/d11/d13/d1b/d60/lb7 0 2023-12-05T09:57:33.899 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:33.902+0000 7f10f2ffd700 1 -- 172.21.15.100:0/1165470033 <== mgr.24423 v2:172.21.15.150:6828/896268868 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f10fc102170 con 0x7f10e806ae90 2023-12-05T09:57:33.900 INFO:tasks.workunit.client.1.smithi150.stdout:6/491: getdents d2/d23/d2e/d44/da0 0 2023-12-05T09:57:33.900 INFO:tasks.workunit.client.1.smithi150.stdout:6/492: readlink d2/d23/d2e/d93/d97/l96 0 2023-12-05T09:57:33.900 INFO:tasks.workunit.client.1.smithi150.stdout:6/493: stat d2/d23/d2e/d93/d97/f98 0 2023-12-05T09:57:33.909 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:33.908+0000 7f1100c06700 1 -- 172.21.15.100:0/1165470033 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7f10e806ae90 msgr2=0x7f10e806d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:57:33.909 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:33.908+0000 7f1100c06700 1 --2- 172.21.15.100:0/1165470033 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7f10e806ae90 0x7f10e806d340 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f10e4004560 tx=0x7f10e4009e30 comp rx=0 tx=0).stop 2023-12-05T09:57:33.909 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:33.908+0000 7f1100c06700 1 -- 172.21.15.100:0/1165470033 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10fc0fcbf0 msgr2=0x7f10fc113b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:57:33.909 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:33.908+0000 7f1100c06700 1 --2- 172.21.15.100:0/1165470033 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10fc0fcbf0 0x7f10fc113b50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f10f4002a50 tx=0x7f10f4004600 comp rx=0 tx=0).stop 2023-12-05T09:57:33.910 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:33.910+0000 7f1100c06700 1 -- 172.21.15.100:0/1165470033 shutdown_connections 2023-12-05T09:57:33.910 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:33.910+0000 7f1100c06700 1 --2- 172.21.15.100:0/1165470033 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7f10e806ae90 0x7f10e806d340 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:33.910 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:33.910+0000 7f1100c06700 1 --2- 172.21.15.100:0/1165470033 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10fc0fcbf0 0x7f10fc113b50 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:33.910 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:33.910+0000 7f1100c06700 1 --2- 172.21.15.100:0/1165470033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10fc0fde00 0x7f10fc114090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:33.910 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:33.910+0000 7f1100c06700 1 -- 172.21.15.100:0/1165470033 >> 172.21.15.100:0/1165470033 conn(0x7f10fc0f82d0 msgr2=0x7f10fc0fa2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:57:33.912 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:33.912+0000 7f1100c06700 1 -- 172.21.15.100:0/1165470033 shutdown_connections 2023-12-05T09:57:33.914 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:33.915+0000 7f1100c06700 1 -- 172.21.15.100:0/1165470033 wait complete. 2023-12-05T09:57:33.914 INFO:tasks.workunit.client.1.smithi150.stdout:6/494: write d2/d23/f67 [2550650,106653] 0 2023-12-05T09:57:33.914 INFO:tasks.workunit.client.1.smithi150.stdout:6/495: dread - d2/d23/d2e/d93/d97/f84 zero size 2023-12-05T09:57:33.915 INFO:tasks.workunit.client.0.smithi100.stdout:6/892: dwrite d7/d2d/d6a/fad [0,4194304] 0 2023-12-05T09:57:33.915 INFO:tasks.workunit.client.0.smithi100.stdout:5/551: rename d0/d16/d2b/d48/df/d51/d7b to d0/d1b/d4d/d8e/d96/dc1 0 2023-12-05T09:57:33.920 INFO:tasks.workunit.client.0.smithi100.stdout:2/639: sync 2023-12-05T09:57:33.921 INFO:tasks.workunit.client.1.smithi150.stdout:5/528: sync 2023-12-05T09:57:33.926 INFO:tasks.workunit.client.1.smithi150.stdout:6/496: rename d2/d23/d3b/d64/d7a/d5d/ca7 to d2/d23/d2e/d72/ca8 0 2023-12-05T09:57:33.934 INFO:tasks.workunit.client.0.smithi100.stdout:6/893: rename d7/dcc/dda/l11c to d7/d2d/d115/l124 0 2023-12-05T09:57:33.934 INFO:tasks.workunit.client.0.smithi100.stdout:6/894: dread - d7/f11d zero size 2023-12-05T09:57:33.934 INFO:tasks.workunit.client.0.smithi100.stdout:6/895: fdatasync d7/d11/f8f 0 2023-12-05T09:57:33.934 INFO:tasks.workunit.client.0.smithi100.stdout:6/896: readlink d7/d2d/l85 0 2023-12-05T09:57:33.934 INFO:tasks.workunit.client.0.smithi100.stdout:6/897: chown d7/d27/d35/d5a/d11e 2894710 1 2023-12-05T09:57:33.935 INFO:tasks.workunit.client.1.smithi150.stdout:6/497: symlink d2/d23/d2e/d93/d97/la9 0 2023-12-05T09:57:33.935 INFO:tasks.workunit.client.1.smithi150.stdout:6/498: stat d2/d23/d3b/d64/d7a/d5d/f86 0 2023-12-05T09:57:33.935 INFO:tasks.workunit.client.0.smithi100.stdout:2/640: mkdir d7/da/da7/dd6 0 2023-12-05T09:57:33.935 INFO:tasks.workunit.client.0.smithi100.stdout:2/641: creat d7/da/d18/d21/d86/fd7 x:0 0 0 2023-12-05T09:57:33.938 INFO:tasks.workunit.client.1.smithi150.stdout:5/529: write d1/d2e/da6/d86/f88 [690306,48610] 0 2023-12-05T09:57:33.938 INFO:tasks.workunit.client.1.smithi150.stdout:5/530: write d1/d3/f7d [204248,111215] 0 2023-12-05T09:57:33.940 INFO:tasks.workunit.client.0.smithi100.stdout:6/898: rename d7/d2d/f43 to d7/d27/d35/d5a/d11e/f125 0 2023-12-05T09:57:33.940 INFO:tasks.workunit.client.0.smithi100.stdout:6/899: stat d7/d27/d97/fea 0 2023-12-05T09:57:33.940 INFO:tasks.workunit.client.0.smithi100.stdout:1/489: dwrite db/f1a [0,4194304] 0 2023-12-05T09:57:33.940 INFO:tasks.workunit.client.1.smithi150.stdout:6/499: rmdir d2/d23/d3b/d64/d7a/d5d 39 2023-12-05T09:57:33.940 INFO:tasks.workunit.client.1.smithi150.stdout:6/500: stat d2/d23/d2e/c35 0 2023-12-05T09:57:33.942 INFO:tasks.workunit.client.1.smithi150.stdout:3/553: dwrite d6/d22/d37/da1/faa [0,4194304] 0 2023-12-05T09:57:33.943 INFO:tasks.workunit.client.0.smithi100.stdout:6/900: read d7/d2d/d6a/d7c/f88 [1590630,10385] 0 2023-12-05T09:57:33.943 INFO:tasks.workunit.client.0.smithi100.stdout:6/901: chown d7/d27/d97/fbb 70 1 2023-12-05T09:57:33.947 INFO:teuthology.orchestra.run.smithi100.stdout:true 2023-12-05T09:57:33.951 INFO:tasks.workunit.client.0.smithi100.stdout:1/490: rename db/c7a to db/d12/d61/d66/c99 0 2023-12-05T09:57:33.959 INFO:tasks.workunit.client.1.smithi150.stdout:2/567: dwrite d0/da3/fbc [0,4194304] 0 2023-12-05T09:57:33.959 INFO:tasks.workunit.client.1.smithi150.stdout:2/568: write d0/d3/d5/f40 [4447245,64575] 0 2023-12-05T09:57:33.959 INFO:tasks.workunit.client.1.smithi150.stdout:5/531: mknod d1/d3/cbd 0 2023-12-05T09:57:33.960 INFO:tasks.workunit.client.1.smithi150.stdout:5/532: fsync d1/d3/f85 0 2023-12-05T09:57:33.960 INFO:tasks.workunit.client.1.smithi150.stdout:9/502: sync 2023-12-05T09:57:33.961 INFO:tasks.workunit.client.0.smithi100.stdout:2/642: unlink d7/da/d18/d21/c99 0 2023-12-05T09:57:33.966 INFO:tasks.workunit.client.0.smithi100.stdout:1/491: unlink db/d12/d61/d66/c6a 0 2023-12-05T09:57:33.971 INFO:tasks.workunit.client.1.smithi150.stdout:3/554: creat d6/d9/d43/d47/fb1 x:0 0 0 2023-12-05T09:57:33.972 INFO:tasks.workunit.client.0.smithi100.stdout:7/502: dwrite d3/dc/d11/d13/de/d18/d3b/d40/d46/f95 [0,4194304] 0 2023-12-05T09:57:33.972 INFO:tasks.workunit.client.1.smithi150.stdout:8/609: dwrite d0/d41/d49/f81 [4194304,4194304] 0 2023-12-05T09:57:33.973 INFO:tasks.workunit.client.0.smithi100.stdout:2/643: mknod d7/da/d18/d1b/d2c/cd8 0 2023-12-05T09:57:33.978 INFO:tasks.workunit.client.0.smithi100.stdout:1/492: creat db/d31/d3a/f9a x:0 0 0 2023-12-05T09:57:33.979 INFO:tasks.workunit.client.0.smithi100.stdout:1/493: write db/d31/d3a/f5b [3444069,82125] 0 2023-12-05T09:57:33.993 INFO:tasks.workunit.client.0.smithi100.stdout:7/503: write d3/dc/d11/d13/de/d18/d3b/f5d [762406,11796] 0 2023-12-05T09:57:33.998 INFO:tasks.workunit.client.1.smithi150.stdout:2/569: mknod d0/d42/cc9 0 2023-12-05T09:57:34.001 INFO:tasks.workunit.client.1.smithi150.stdout:5/533: link d1/d7f/f4f d1/d7f/d65/d3b/d8d/fbe 0 2023-12-05T09:57:34.006 INFO:tasks.workunit.client.1.smithi150.stdout:0/576: sync 2023-12-05T09:57:34.006 INFO:tasks.workunit.client.1.smithi150.stdout:1/532: sync 2023-12-05T09:57:34.011 INFO:tasks.workunit.client.0.smithi100.stdout:7/504: creat d3/dc/d11/d13/de/d18/d3b/d40/fb8 x:0 0 0 2023-12-05T09:57:34.013 INFO:tasks.workunit.client.0.smithi100.stdout:6/902: rename d7/d2d to d7/d11/d1a/db7/df7/d126 0 2023-12-05T09:57:34.014 INFO:tasks.workunit.client.0.smithi100.stdout:6/903: truncate d7/d27/da0/f112 108455 0 2023-12-05T09:57:34.015 INFO:tasks.workunit.client.0.smithi100.stdout:2/644: mknod d7/da/d18/d21/da3/cd9 0 2023-12-05T09:57:34.015 INFO:tasks.workunit.client.0.smithi100.stdout:2/645: chown d7/da/d18/fab 112 1 2023-12-05T09:57:34.020 INFO:tasks.workunit.client.1.smithi150.stdout:2/570: mknod d0/d3/d27/d95/cca 0 2023-12-05T09:57:34.020 INFO:tasks.workunit.client.1.smithi150.stdout:2/571: chown d0/d3/d5/d36/f9a 10 1 2023-12-05T09:57:34.026 INFO:tasks.workunit.client.0.smithi100.stdout:6/904: mknod d7/d11/c127 0 2023-12-05T09:57:34.027 INFO:tasks.workunit.client.0.smithi100.stdout:6/905: write d7/d11/d1a/f6b [197598,129371] 0 2023-12-05T09:57:34.027 INFO:tasks.workunit.client.1.smithi150.stdout:5/534: mkdir d1/d3/d92/dbf 0 2023-12-05T09:57:34.027 INFO:tasks.workunit.client.1.smithi150.stdout:6/501: dwrite d2/d23/d2e/d44/f50 [0,4194304] 0 2023-12-05T09:57:34.027 INFO:tasks.workunit.client.1.smithi150.stdout:6/502: getdents d2/d23/d3b/d64/d7a/d5d/d6b/d9c 0 2023-12-05T09:57:34.027 INFO:tasks.workunit.client.1.smithi150.stdout:6/503: dread - d2/d23/d3b/d46/fa2 zero size 2023-12-05T09:57:34.028 INFO:tasks.workunit.client.0.smithi100.stdout:1/494: dwrite db/d12/d61/d66/d67/f6b [4194304,4194304] 0 2023-12-05T09:57:34.028 INFO:tasks.workunit.client.1.smithi150.stdout:8/610: dwrite d0/d41/fb1 [0,4194304] 0 2023-12-05T09:57:34.029 INFO:tasks.workunit.client.1.smithi150.stdout:0/577: rename d5/d11/d16/d1f to d5/d11/dce 0 2023-12-05T09:57:34.030 INFO:tasks.workunit.client.1.smithi150.stdout:1/533: symlink d6/d8/db/db1/lbf 0 2023-12-05T09:57:34.030 INFO:tasks.workunit.client.1.smithi150.stdout:1/534: fdatasync d6/d8/db/fac 0 2023-12-05T09:57:34.030 INFO:tasks.workunit.client.1.smithi150.stdout:1/535: creat d6/d8/d59/fc0 x:0 0 0 2023-12-05T09:57:34.031 INFO:tasks.workunit.client.0.smithi100.stdout:6/906: getdents d7/d11/d1a 0 2023-12-05T09:57:34.031 INFO:tasks.workunit.client.0.smithi100.stdout:6/907: read - d7/d27/d35/d5a/db0/ff9 zero size 2023-12-05T09:57:34.031 INFO:tasks.workunit.client.0.smithi100.stdout:6/908: chown d7/dcc/df0/d100/f10a 1 1 2023-12-05T09:57:34.033 INFO:tasks.workunit.client.1.smithi150.stdout:3/555: unlink d6/d9/d43/d47/fb1 0 2023-12-05T09:57:34.035 INFO:tasks.workunit.client.1.smithi150.stdout:5/535: dread d1/d7f/f5c [0,4194304] 0 2023-12-05T09:57:34.044 INFO:tasks.workunit.client.1.smithi150.stdout:6/504: mknod d2/d23/d2e/d44/da0/caa 0 2023-12-05T09:57:34.045 INFO:tasks.workunit.client.0.smithi100.stdout:1/495: stat db/c15 0 2023-12-05T09:57:34.046 INFO:tasks.workunit.client.0.smithi100.stdout:9/523: sync 2023-12-05T09:57:34.046 INFO:tasks.workunit.client.0.smithi100.stdout:8/442: sync 2023-12-05T09:57:34.050 INFO:tasks.workunit.client.1.smithi150.stdout:3/556: write d6/d9/d3d/d56/d53/d51/f8b [370430,22108] 0 2023-12-05T09:57:34.050 INFO:tasks.workunit.client.1.smithi150.stdout:3/557: stat d6/f5d 0 2023-12-05T09:57:34.050 INFO:tasks.workunit.client.1.smithi150.stdout:0/578: dread d5/d11/d65/f76 [0,4194304] 0 2023-12-05T09:57:34.051 INFO:tasks.workunit.client.1.smithi150.stdout:0/579: creat d5/d11/d71/d99/d9c/fcf x:0 0 0 2023-12-05T09:57:34.051 INFO:tasks.workunit.client.0.smithi100.stdout:1/496: read db/d12/d61/d66/d67/f6d [12371,89651] 0 2023-12-05T09:57:34.055 INFO:tasks.workunit.client.1.smithi150.stdout:1/536: creat d6/d8/d85/dbe/fc1 x:0 0 0 2023-12-05T09:57:34.059 INFO:tasks.workunit.client.0.smithi100.stdout:1/497: creat db/d31/d3a/d3b/f9b x:0 0 0 2023-12-05T09:57:34.059 INFO:tasks.workunit.client.1.smithi150.stdout:7/557: sync 2023-12-05T09:57:34.060 INFO:tasks.workunit.client.1.smithi150.stdout:7/558: fsync d2/d39/f64 0 2023-12-05T09:57:34.060 INFO:tasks.workunit.client.1.smithi150.stdout:5/536: mknod d1/d7f/d65/d3b/d6b/cc0 0 2023-12-05T09:57:34.060 INFO:tasks.workunit.client.1.smithi150.stdout:4/479: sync 2023-12-05T09:57:34.062 INFO:tasks.workunit.client.1.smithi150.stdout:2/572: getdents d0/d3/d5/d22/d52/d5a 0 2023-12-05T09:57:34.063 INFO:tasks.workunit.client.0.smithi100.stdout:9/524: dread d7/d35/d71/f78 [0,4194304] 0 2023-12-05T09:57:34.064 INFO:tasks.workunit.client.0.smithi100.stdout:8/443: rename d0/d12/d13/d16/d22/d24 to d0/d35/d63/d76 0 2023-12-05T09:57:34.067 INFO:tasks.workunit.client.0.smithi100.stdout:1/498: mknod db/d12/d1e/d26/d30/c9c 0 2023-12-05T09:57:34.069 INFO:tasks.workunit.client.0.smithi100.stdout:9/525: mknod d7/d1b/d22/d2a/d56/d9c/daa/cb2 0 2023-12-05T09:57:34.070 INFO:tasks.workunit.client.0.smithi100.stdout:9/526: chown d7/d20/c70 75225 1 2023-12-05T09:57:34.072 INFO:tasks.workunit.client.1.smithi150.stdout:8/611: rmdir d0/d41/d49/d1b/d24/d2e/d30 39 2023-12-05T09:57:34.072 INFO:tasks.workunit.client.1.smithi150.stdout:8/612: write d0/d41/d49/d1b/d24/d2e/fa5 [388698,85947] 0 2023-12-05T09:57:34.074 INFO:tasks.workunit.client.0.smithi100.stdout:1/499: write db/d12/d1e/d26/d30/d52/f5f [787592,107342] 0 2023-12-05T09:57:34.074 INFO:tasks.workunit.client.0.smithi100.stdout:1/500: creat db/d31/d3a/f9d x:0 0 0 2023-12-05T09:57:34.074 INFO:tasks.workunit.client.0.smithi100.stdout:1/501: chown c7 533306 1 2023-12-05T09:57:34.077 INFO:tasks.workunit.client.0.smithi100.stdout:8/444: symlink d0/d12/d13/d45/l77 0 2023-12-05T09:57:34.078 INFO:tasks.workunit.client.1.smithi150.stdout:3/558: rmdir d6/d9/d3d/d56/d53/d51 39 2023-12-05T09:57:34.086 INFO:tasks.workunit.client.0.smithi100.stdout:1/502: mknod db/d12/d1e/d26/d30/d52/d84/d8c/c9e 0 2023-12-05T09:57:34.086 INFO:tasks.workunit.client.0.smithi100.stdout:1/503: fsync db/d12/d1e/d26/d30/f83 0 2023-12-05T09:57:34.086 INFO:tasks.workunit.client.0.smithi100.stdout:1/504: fdatasync db/f35 0 2023-12-05T09:57:34.087 INFO:tasks.workunit.client.0.smithi100.stdout:2/646: write d7/da/dc/f56 [268662,130977] 0 2023-12-05T09:57:34.087 INFO:tasks.workunit.client.0.smithi100.stdout:8/445: creat d0/d12/f78 x:0 0 0 2023-12-05T09:57:34.088 INFO:tasks.workunit.client.0.smithi100.stdout:8/446: dread - d0/f5b zero size 2023-12-05T09:57:34.088 INFO:tasks.workunit.client.0.smithi100.stdout:8/447: readlink d0/d12/d13/d16/d22/l34 0 2023-12-05T09:57:34.091 INFO:tasks.workunit.client.0.smithi100.stdout:1/505: rename db/d12/d61/f80 to db/d12/d1e/f9f 0 2023-12-05T09:57:34.091 INFO:tasks.workunit.client.0.smithi100.stdout:1/506: fsync db/d12/d1e/d26/d30/d6e/f57 0 2023-12-05T09:57:34.093 INFO:tasks.workunit.client.1.smithi150.stdout:9/503: dwrite d3/f71 [0,4194304] 0 2023-12-05T09:57:34.095 INFO:tasks.workunit.client.1.smithi150.stdout:4/480: mknod d0/d3e/d6d/c90 0 2023-12-05T09:57:34.095 INFO:tasks.workunit.client.1.smithi150.stdout:6/505: getdents d2/d23/d3b 0 2023-12-05T09:57:34.095 INFO:tasks.workunit.client.1.smithi150.stdout:0/580: rename d5/d11/d71/d5f/d77/f95 to d5/d11/d71/d74/fd0 0 2023-12-05T09:57:34.095 INFO:tasks.workunit.client.1.smithi150.stdout:8/613: mkdir d0/d41/d49/d1b/d24/d34/dbc/dbe 0 2023-12-05T09:57:34.095 INFO:tasks.workunit.client.0.smithi100.stdout:1/507: chown db/d31/d3a/f4c 286413 1 2023-12-05T09:57:34.095 INFO:tasks.workunit.client.0.smithi100.stdout:7/505: dwrite d3/dc/d11/d13/f91 [0,4194304] 0 2023-12-05T09:57:34.096 INFO:tasks.workunit.client.0.smithi100.stdout:7/506: chown d3/dc/d11/d13/de/d2d/d42/c9a 632248 1 2023-12-05T09:57:34.096 INFO:tasks.workunit.client.0.smithi100.stdout:2/647: creat d7/da/d13/fda x:0 0 0 2023-12-05T09:57:34.097 INFO:tasks.workunit.client.0.smithi100.stdout:6/909: dwrite d7/d27/d97/fea [0,4194304] 0 2023-12-05T09:57:34.100 INFO:tasks.workunit.client.1.smithi150.stdout:2/573: write d0/d3/d27/db6/fba [1597777,111282] 0 2023-12-05T09:57:34.101 INFO:tasks.workunit.client.0.smithi100.stdout:8/448: creat d0/d12/d13/d16/f79 x:0 0 0 2023-12-05T09:57:34.101 INFO:tasks.workunit.client.0.smithi100.stdout:8/449: rename d0/d12/d13/d16 to d0/d12/d13/d16/d22/d7a 22 2023-12-05T09:57:34.107 INFO:tasks.workunit.client.1.smithi150.stdout:9/504: creat d3/d9/dc/fa2 x:0 0 0 2023-12-05T09:57:34.110 INFO:tasks.workunit.client.0.smithi100.stdout:7/507: creat d3/dc/d11/d13/de/d18/d3b/d40/d46/d9e/fb9 x:0 0 0 2023-12-05T09:57:34.110 INFO:tasks.workunit.client.0.smithi100.stdout:7/508: write d3/dc/d11/d13/de/f73 [882517,3905] 0 2023-12-05T09:57:34.112 INFO:tasks.workunit.client.0.smithi100.stdout:8/450: dread d0/d35/d63/f69 [0,4194304] 0 2023-12-05T09:57:34.116 INFO:tasks.workunit.client.0.smithi100.stdout:1/508: read db/d12/d61/d66/d67/f6b [5420669,108079] 0 2023-12-05T09:57:34.119 INFO:tasks.workunit.client.1.smithi150.stdout:8/614: unlink d0/d41/d49/d1b/f2f 0 2023-12-05T09:57:34.123 INFO:tasks.workunit.client.1.smithi150.stdout:7/559: dwrite d2/d39/f64 [0,4194304] 0 2023-12-05T09:57:34.129 INFO:tasks.workunit.client.1.smithi150.stdout:0/581: rename d5/d11/d71/d99/d9c/d96/cba to d5/d11/d71/d5f/d6a/cd1 0 2023-12-05T09:57:34.145 INFO:tasks.workunit.client.0.smithi100.stdout:9/527: dwrite d7/d20/d68/f7e [0,4194304] 0 2023-12-05T09:57:34.145 INFO:tasks.workunit.client.0.smithi100.stdout:7/509: dread d3/dc/d11/d13/d1b/f7e [0,4194304] 0 2023-12-05T09:57:34.148 INFO:tasks.workunit.client.1.smithi150.stdout:7/560: dread d2/db/d30/d18/f57 [0,4194304] 0 2023-12-05T09:57:34.149 INFO:tasks.workunit.client.1.smithi150.stdout:9/505: write d3/d9/d26/f3f [1754029,121311] 0 2023-12-05T09:57:34.149 INFO:tasks.workunit.client.1.smithi150.stdout:9/506: dread - d3/d1b/d46/f50 zero size 2023-12-05T09:57:34.152 INFO:tasks.workunit.client.1.smithi150.stdout:8/615: link d0/d41/d49/d1b/d24/d34/c94 d0/d41/d49/d1b/d24/d38/d62/cbf 0 2023-12-05T09:57:34.155 INFO:tasks.workunit.client.1.smithi150.stdout:1/537: dwrite d6/d8/d85/dbe/fc1 [0,4194304] 0 2023-12-05T09:57:34.155 INFO:tasks.workunit.client.1.smithi150.stdout:0/582: creat d5/d11/d71/d5f/fd2 x:0 0 0 2023-12-05T09:57:34.156 INFO:tasks.workunit.client.0.smithi100.stdout:2/648: getdents d7/da/d18 0 2023-12-05T09:57:34.158 INFO:tasks.workunit.client.1.smithi150.stdout:2/574: getdents d0/da3/dae 0 2023-12-05T09:57:34.159 INFO:tasks.workunit.client.1.smithi150.stdout:2/575: dread - d0/d3/d5/d22/fbf zero size 2023-12-05T09:57:34.162 INFO:tasks.workunit.client.0.smithi100.stdout:8/451: symlink d0/d12/d13/d16/d42/d43/l7b 0 2023-12-05T09:57:34.163 INFO:tasks.workunit.client.1.smithi150.stdout:6/506: dwrite d2/d23/d2e/d5f/fa1 [0,4194304] 0 2023-12-05T09:57:34.163 INFO:tasks.workunit.client.1.smithi150.stdout:6/507: chown d2/d23/d2e/d44 2587 1 2023-12-05T09:57:34.163 INFO:tasks.workunit.client.1.smithi150.stdout:7/561: rename d2/db/d30/d13/d4f/d5a/d5c/c96 to d2/db/d2e/d71/cbf 0 2023-12-05T09:57:34.163 INFO:tasks.workunit.client.1.smithi150.stdout:4/481: dwrite d0/d3e/d5b/d80/d44/f6f [0,4194304] 0 2023-12-05T09:57:34.164 INFO:tasks.workunit.client.1.smithi150.stdout:3/559: dwrite d6/d9/d3d/d56/f3f [8388608,4194304] 0 2023-12-05T09:57:34.164 INFO:tasks.workunit.client.1.smithi150.stdout:9/507: rmdir d3/d1b/d46/d55 39 2023-12-05T09:57:34.169 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.172+0000 7fc794d69700 1 -- 172.21.15.100:0/3862003968 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7900fdbd0 msgr2=0x7fc7900fe020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:57:34.169 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.172+0000 7fc794d69700 1 --2- 172.21.15.100:0/3862003968 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7900fdbd0 0x7fc7900fe020 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fc784004880 tx=0x7fc784009e30 comp rx=0 tx=0).stop 2023-12-05T09:57:34.170 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.172+0000 7fc794d69700 1 -- 172.21.15.100:0/3862003968 shutdown_connections 2023-12-05T09:57:34.170 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.172+0000 7fc794d69700 1 --2- 172.21.15.100:0/3862003968 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7900fdbd0 0x7fc7900fe020 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:34.170 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.172+0000 7fc794d69700 1 --2- 172.21.15.100:0/3862003968 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7900fc9c0 0x7fc7900fcdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:34.170 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.172+0000 7fc794d69700 1 -- 172.21.15.100:0/3862003968 >> 172.21.15.100:0/3862003968 conn(0x7fc7900f8060 msgr2=0x7fc7900fa4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:57:34.170 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.172+0000 7fc794d69700 1 -- 172.21.15.100:0/3862003968 shutdown_connections 2023-12-05T09:57:34.170 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.172+0000 7fc794d69700 1 -- 172.21.15.100:0/3862003968 wait complete. 2023-12-05T09:57:34.171 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.173+0000 7fc794d69700 1 Processor -- start 2023-12-05T09:57:34.171 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.174+0000 7fc794d69700 1 -- start start 2023-12-05T09:57:34.171 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.174+0000 7fc794d69700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7900fc9c0 0x7fc79010d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:57:34.171 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.174+0000 7fc794d69700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7900fdbd0 0x7fc79010d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:57:34.171 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.174+0000 7fc794d69700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc79010dd60 con 0x7fc7900fdbd0 2023-12-05T09:57:34.171 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.174+0000 7fc794d69700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc79010e600 con 0x7fc7900fc9c0 2023-12-05T09:57:34.171 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.174+0000 7fc78effd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7900fdbd0 0x7fc79010d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:57:34.171 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.175+0000 7fc78effd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7900fdbd0 0x7fc79010d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42460/0 (socket says 172.21.15.100:42460) 2023-12-05T09:57:34.172 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.175+0000 7fc78effd700 1 -- 172.21.15.100:0/579604853 learned_addr learned my addr 172.21.15.100:0/579604853 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:57:34.173 INFO:tasks.workunit.client.1.smithi150.stdout:0/583: dread d5/d11/d65/f76 [0,4194304] 0 2023-12-05T09:57:34.173 INFO:tasks.workunit.client.1.smithi150.stdout:0/584: read - d5/d11/d16/fa3 zero size 2023-12-05T09:57:34.173 INFO:tasks.workunit.client.1.smithi150.stdout:0/585: creat d5/d11/d71/d99/d9c/fd3 x:0 0 0 2023-12-05T09:57:34.173 INFO:tasks.workunit.client.1.smithi150.stdout:0/586: fsync d5/d11/f59 0 2023-12-05T09:57:34.173 INFO:tasks.workunit.client.1.smithi150.stdout:0/587: write d5/d11/d32/d57/fa2 [287395,51537] 0 2023-12-05T09:57:34.173 INFO:tasks.workunit.client.1.smithi150.stdout:0/588: chown d5/d11/d32/d57/l5e 2066 1 2023-12-05T09:57:34.175 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.175+0000 7fc78effd700 1 -- 172.21.15.100:0/579604853 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7900fc9c0 msgr2=0x7fc79010d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:57:34.175 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.175+0000 7fc78f7fe700 1 --2- 172.21.15.100:0/579604853 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7900fc9c0 0x7fc79010d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:57:34.175 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.175+0000 7fc78effd700 1 --2- 172.21.15.100:0/579604853 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7900fc9c0 0x7fc79010d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:34.175 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.175+0000 7fc78effd700 1 -- 172.21.15.100:0/579604853 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc784005040 con 0x7fc7900fdbd0 2023-12-05T09:57:34.175 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.175+0000 7fc78f7fe700 1 --2- 172.21.15.100:0/579604853 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7900fc9c0 0x7fc79010d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-05T09:57:34.175 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.176+0000 7fc78effd700 1 --2- 172.21.15.100:0/579604853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7900fdbd0 0x7fc79010d760 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc7840094d0 tx=0x7fc784009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:57:34.176 INFO:tasks.workunit.client.1.smithi150.stdout:8/616: link d0/d41/d49/d1b/d24/d34/d56/d67/d64/c7f d0/d41/d49/d1b/cc0 0 2023-12-05T09:57:34.178 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.180+0000 7fc777fff700 1 -- 172.21.15.100:0/579604853 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc78400e040 con 0x7fc7900fdbd0 2023-12-05T09:57:34.178 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.180+0000 7fc777fff700 1 -- 172.21.15.100:0/579604853 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc784014dc0 con 0x7fc7900fdbd0 2023-12-05T09:57:34.178 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.180+0000 7fc777fff700 1 -- 172.21.15.100:0/579604853 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc78401b5d0 con 0x7fc7900fdbd0 2023-12-05T09:57:34.178 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.180+0000 7fc794d69700 1 -- 172.21.15.100:0/579604853 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc79010e800 con 0x7fc7900fdbd0 2023-12-05T09:57:34.178 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.180+0000 7fc794d69700 1 -- 172.21.15.100:0/579604853 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc79010ed60 con 0x7fc7900fdbd0 2023-12-05T09:57:34.179 INFO:tasks.workunit.client.0.smithi100.stdout:8/452: dread d0/d12/d13/d45/f58 [0,4194304] 0 2023-12-05T09:57:34.179 INFO:tasks.workunit.client.0.smithi100.stdout:8/453: write d0/f5b [829923,119718] 0 2023-12-05T09:57:34.180 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.182+0000 7fc794d69700 1 -- 172.21.15.100:0/579604853 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc79004bb80 con 0x7fc7900fdbd0 2023-12-05T09:57:34.180 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.183+0000 7fc777fff700 1 -- 172.21.15.100:0/579604853 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 25) v1 ==== 88726+0+0 (secure 0 0 0) 0x7fc78401c9e0 con 0x7fc7900fdbd0 2023-12-05T09:57:34.181 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.184+0000 7fc777fff700 1 --2- 172.21.15.100:0/579604853 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7fc77806ae40 0x7fc77806d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:57:34.181 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.184+0000 7fc777fff700 1 -- 172.21.15.100:0/579604853 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fc78408b340 con 0x7fc7900fdbd0 2023-12-05T09:57:34.182 INFO:tasks.workunit.client.0.smithi100.stdout:9/528: mknod d7/d1b/d22/d2a/d56/cb3 0 2023-12-05T09:57:34.182 INFO:tasks.workunit.client.0.smithi100.stdout:9/529: write d7/d20/d69/fa0 [928094,117976] 0 2023-12-05T09:57:34.182 INFO:tasks.workunit.client.0.smithi100.stdout:9/530: read d7/d1b/f33 [2849650,90166] 0 2023-12-05T09:57:34.183 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.185+0000 7fc78f7fe700 1 --2- 172.21.15.100:0/579604853 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7fc77806ae40 0x7fc77806d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:57:34.183 INFO:tasks.workunit.client.0.smithi100.stdout:9/531: dread - d7/d1b/d89/f90 zero size 2023-12-05T09:57:34.183 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.186+0000 7fc78f7fe700 1 --2- 172.21.15.100:0/579604853 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7fc77806ae40 0x7fc77806d2f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc7800046c0 tx=0x7fc78000b040 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:57:34.184 INFO:tasks.workunit.client.1.smithi150.stdout:1/538: mkdir d6/d3c/dc2 0 2023-12-05T09:57:34.184 INFO:tasks.workunit.client.1.smithi150.stdout:1/539: write d6/d38/da1/fa6 [1005220,124288] 0 2023-12-05T09:57:34.184 INFO:tasks.workunit.client.0.smithi100.stdout:7/510: dread d3/dc/d11/d33/f53 [0,4194304] 0 2023-12-05T09:57:34.185 INFO:tasks.workunit.client.0.smithi100.stdout:2/649: unlink d7/da/d18/ca6 0 2023-12-05T09:57:34.185 INFO:tasks.workunit.client.1.smithi150.stdout:0/589: dread d5/fb3 [4194304,4194304] 0 2023-12-05T09:57:34.186 INFO:tasks.workunit.client.1.smithi150.stdout:2/576: creat d0/d3/d5/d13/db9/fcb x:0 0 0 2023-12-05T09:57:34.187 INFO:tasks.workunit.client.0.smithi100.stdout:3/626: sync 2023-12-05T09:57:34.187 INFO:tasks.workunit.client.0.smithi100.stdout:0/488: sync 2023-12-05T09:57:34.187 INFO:tasks.workunit.client.0.smithi100.stdout:4/482: sync 2023-12-05T09:57:34.187 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.190+0000 7fc777fff700 1 -- 172.21.15.100:0/579604853 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fc7840591b0 con 0x7fc7900fdbd0 2023-12-05T09:57:34.188 INFO:tasks.workunit.client.0.smithi100.stdout:4/483: dread - de/d16/d23/d33/d51/f79 zero size 2023-12-05T09:57:34.188 INFO:tasks.workunit.client.0.smithi100.stdout:8/454: creat d0/d35/d64/f7c x:0 0 0 2023-12-05T09:57:34.188 INFO:tasks.workunit.client.0.smithi100.stdout:8/455: fsync d0/d35/d63/d76/f3f 0 2023-12-05T09:57:34.188 INFO:tasks.workunit.client.0.smithi100.stdout:8/456: stat d0/d12/d13/d16/f2e 0 2023-12-05T09:57:34.189 INFO:tasks.workunit.client.0.smithi100.stdout:8/457: read - d0/d12/d13/d45/f5d zero size 2023-12-05T09:57:34.192 INFO:tasks.workunit.client.0.smithi100.stdout:9/532: rename d7/d1b/d22/f31 to d7/d1b/d22/d93/fb4 0 2023-12-05T09:57:34.193 INFO:tasks.workunit.client.0.smithi100.stdout:9/533: write d7/d20/f3a [1030604,84356] 0 2023-12-05T09:57:34.200 INFO:tasks.workunit.client.0.smithi100.stdout:9/534: read d7/d1b/d22/d2a/f6b [565017,24879] 0 2023-12-05T09:57:34.204 INFO:tasks.workunit.client.1.smithi150.stdout:1/540: write d6/d8/d54/fb3 [2270413,35254] 0 2023-12-05T09:57:34.204 INFO:tasks.workunit.client.1.smithi150.stdout:1/541: chown d6/d8/db/db1/fbc 11 1 2023-12-05T09:57:34.211 INFO:tasks.workunit.client.0.smithi100.stdout:4/484: dread f1 [0,4194304] 0 2023-12-05T09:57:34.212 INFO:tasks.workunit.client.0.smithi100.stdout:4/485: write de/d16/f83 [875287,38159] 0 2023-12-05T09:57:34.212 INFO:tasks.workunit.client.0.smithi100.stdout:4/486: chown de/d16/d23/d36/c8e 585 1 2023-12-05T09:57:34.212 INFO:tasks.workunit.client.0.smithi100.stdout:4/487: write de/d16/f83 [1828434,115827] 0 2023-12-05T09:57:34.212 INFO:tasks.workunit.client.0.smithi100.stdout:9/535: dread d7/d20/d69/f72 [0,4194304] 0 2023-12-05T09:57:34.212 INFO:tasks.workunit.client.0.smithi100.stdout:2/650: write d7/da/d1a/f1c [7134030,85542] 0 2023-12-05T09:57:34.242 INFO:tasks.workunit.client.1.smithi150.stdout:2/577: dwrite d0/d3/d11/fb3 [0,4194304] 0 2023-12-05T09:57:34.244 INFO:tasks.workunit.client.0.smithi100.stdout:8/458: dwrite d0/d12/f32 [0,4194304] 0 2023-12-05T09:57:34.250 INFO:tasks.workunit.client.0.smithi100.stdout:8/459: dread d0/d12/d13/f2f [0,4194304] 0 2023-12-05T09:57:34.282 INFO:tasks.workunit.client.0.smithi100.stdout:7/511: link d3/dc/d11/f32 d3/dc/d11/d13/de/d18/d3b/d40/d46/fba 0 2023-12-05T09:57:34.288 INFO:tasks.workunit.client.0.smithi100.stdout:0/489: unlink da/d1b/l93 0 2023-12-05T09:57:34.290 INFO:tasks.workunit.client.0.smithi100.stdout:4/488: dwrite de/f13 [4194304,4194304] 0 2023-12-05T09:57:34.291 INFO:tasks.workunit.client.1.smithi150.stdout:6/508: symlink d2/d23/d2e/d44/da0/lab 0 2023-12-05T09:57:34.293 INFO:tasks.workunit.client.1.smithi150.stdout:7/562: truncate d2/d39/f60 6163870 0 2023-12-05T09:57:34.294 INFO:tasks.workunit.client.1.smithi150.stdout:7/563: write d2/db/f99 [1034909,81227] 0 2023-12-05T09:57:34.296 INFO:tasks.workunit.client.1.smithi150.stdout:4/482: creat d0/f91 x:0 0 0 2023-12-05T09:57:34.296 INFO:tasks.workunit.client.1.smithi150.stdout:4/483: fsync d0/f51 0 2023-12-05T09:57:34.298 INFO:tasks.workunit.client.1.smithi150.stdout:3/560: unlink d6/d9/d8d/f9b 0 2023-12-05T09:57:34.300 INFO:tasks.workunit.client.0.smithi100.stdout:2/651: rename d7/da/d1a/f45 to d7/da/d1a/fdb 0 2023-12-05T09:57:34.306 INFO:tasks.workunit.client.1.smithi150.stdout:6/509: dread d2/d23/d3b/d64/d7a/d5d/f86 [0,4194304] 0 2023-12-05T09:57:34.322 INFO:tasks.workunit.client.1.smithi150.stdout:8/617: unlink d0/d41/d49/d1b/d24/d2e/c47 0 2023-12-05T09:57:34.326 INFO:tasks.workunit.client.1.smithi150.stdout:0/590: mknod d5/d11/d32/d57/cd4 0 2023-12-05T09:57:34.338 INFO:tasks.workunit.client.1.smithi150.stdout:1/542: creat d6/d8/db/de/d75/da5/fc3 x:0 0 0 2023-12-05T09:57:34.339 INFO:tasks.workunit.client.1.smithi150.stdout:1/543: stat d6/d47/d4c/fa2 0 2023-12-05T09:57:34.339 INFO:tasks.workunit.client.1.smithi150.stdout:1/544: fsync d6/d38/fa3 0 2023-12-05T09:57:34.342 INFO:tasks.workunit.client.1.smithi150.stdout:4/484: dwrite d0/d3e/d5b/d80/f7c [4194304,4194304] 0 2023-12-05T09:57:34.354 INFO:tasks.workunit.client.1.smithi150.stdout:6/510: dwrite d2/d23/d3b/d64/d7a/f4d [0,4194304] 0 2023-12-05T09:57:34.374 INFO:tasks.workunit.client.0.smithi100.stdout:8/460: rename d0/d35/c40 to d0/c7d 0 2023-12-05T09:57:34.375 INFO:tasks.workunit.client.0.smithi100.stdout:8/461: read d0/d35/d63/f69 [87750,22389] 0 2023-12-05T09:57:34.383 INFO:tasks.workunit.client.0.smithi100.stdout:0/490: truncate da/d22/f2b 1928967 0 2023-12-05T09:57:34.385 INFO:tasks.workunit.client.0.smithi100.stdout:4/489: symlink de/d16/d23/d60/l99 0 2023-12-05T09:57:34.389 INFO:tasks.workunit.client.0.smithi100.stdout:9/536: mkdir d7/db5 0 2023-12-05T09:57:34.389 INFO:tasks.workunit.client.0.smithi100.stdout:9/537: dread - d7/d1b/d22/f77 zero size 2023-12-05T09:57:34.390 INFO:tasks.workunit.client.1.smithi150.stdout:6/511: write d2/f26 [2503985,19375] 0 2023-12-05T09:57:34.390 INFO:tasks.workunit.client.1.smithi150.stdout:8/618: dwrite d0/d8/f51 [0,4194304] 0 2023-12-05T09:57:34.390 INFO:tasks.workunit.client.1.smithi150.stdout:8/619: creat d0/d41/d49/d1b/d24/d38/d62/fc1 x:0 0 0 2023-12-05T09:57:34.390 INFO:tasks.workunit.client.1.smithi150.stdout:8/620: creat d0/d41/d49/d1b/d24/d2e/fc2 x:0 0 0 2023-12-05T09:57:34.394 INFO:tasks.workunit.client.0.smithi100.stdout:2/652: mkdir d7/da/ddc 0 2023-12-05T09:57:34.412 INFO:tasks.workunit.client.0.smithi100.stdout:8/462: link d0/d35/d63/d76/f3f d0/d12/d52/f7e 0 2023-12-05T09:57:34.416 INFO:tasks.workunit.client.0.smithi100.stdout:9/538: mkdir d7/d35/d71/db6 0 2023-12-05T09:57:34.432 INFO:tasks.workunit.client.0.smithi100.stdout:9/539: symlink d7/d35/d71/d9a/lb7 0 2023-12-05T09:57:34.432 INFO:tasks.workunit.client.0.smithi100.stdout:9/540: stat d7/d20/d68/ca1 0 2023-12-05T09:57:34.437 INFO:tasks.workunit.client.0.smithi100.stdout:9/541: unlink d7/d1b/d22/l24 0 2023-12-05T09:57:34.446 INFO:tasks.workunit.client.0.smithi100.stdout:9/542: creat d7/d1b/d22/d2a/d56/d2e/fb8 x:0 0 0 2023-12-05T09:57:34.447 INFO:tasks.workunit.client.0.smithi100.stdout:9/543: readlink d7/d1b/d22/d2a/d74/l81 0 2023-12-05T09:57:34.448 INFO:tasks.workunit.client.0.smithi100.stdout:9/544: write d7/d1b/d22/f77 [112477,36275] 0 2023-12-05T09:57:34.448 INFO:tasks.workunit.client.1.smithi150.stdout:2/578: mknod d0/d3/d27/dac/ccc 0 2023-12-05T09:57:34.460 INFO:tasks.workunit.client.0.smithi100.stdout:0/491: dwrite da/d2a/f56 [0,4194304] 0 2023-12-05T09:57:34.462 INFO:tasks.workunit.client.1.smithi150.stdout:5/537: sync 2023-12-05T09:57:34.471 INFO:tasks.workunit.client.0.smithi100.stdout:2/653: dread d7/da/d18/d1b/d2c/d3f/d46/f26 [0,4194304] 0 2023-12-05T09:57:34.484 INFO:tasks.workunit.client.0.smithi100.stdout:4/490: dwrite de/d16/f2f [4194304,4194304] 0 2023-12-05T09:57:34.496 INFO:tasks.workunit.client.0.smithi100.stdout:8/463: dwrite d0/d35/d63/d76/f6f [0,4194304] 0 2023-12-05T09:57:34.500 INFO:tasks.workunit.client.0.smithi100.stdout:4/491: link de/d38/c7f de/d16/d23/d60/d88/c9a 0 2023-12-05T09:57:34.503 INFO:tasks.workunit.client.0.smithi100.stdout:8/464: dread d0/d12/d13/f2f [0,4194304] 0 2023-12-05T09:57:34.520 INFO:tasks.workunit.client.0.smithi100.stdout:8/465: mknod d0/d12/d13/c7f 0 2023-12-05T09:57:34.524 INFO:tasks.workunit.client.0.smithi100.stdout:2/654: dread d7/da/d18/d21/f7e [0,4194304] 0 2023-12-05T09:57:34.525 INFO:tasks.workunit.client.1.smithi150.stdout:5/538: dwrite d1/d2e/da6/d24/f93 [0,4194304] 0 2023-12-05T09:57:34.525 INFO:tasks.workunit.client.1.smithi150.stdout:5/539: write d1/f8c [889759,76571] 0 2023-12-05T09:57:34.528 INFO:tasks.workunit.client.0.smithi100.stdout:0/492: dwrite da/d2a/f7b [0,4194304] 0 2023-12-05T09:57:34.537 INFO:tasks.workunit.client.0.smithi100.stdout:8/466: write d0/f31 [2287505,19297] 0 2023-12-05T09:57:34.641 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.577+0000 7fc794d69700 1 -- 172.21.15.100:0/579604853 --> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc79010f2e0 con 0x7fc77806ae40 2023-12-05T09:57:34.641 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.578+0000 7fc777fff700 1 -- 172.21.15.100:0/579604853 <== mgr.24423 v2:172.21.15.150:6828/896268868 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7fc79010f2e0 con 0x7fc77806ae40 2023-12-05T09:57:34.641 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.581+0000 7fc794d69700 1 -- 172.21.15.100:0/579604853 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7fc77806ae40 msgr2=0x7fc77806d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:57:34.642 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.581+0000 7fc794d69700 1 --2- 172.21.15.100:0/579604853 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7fc77806ae40 0x7fc77806d2f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc7800046c0 tx=0x7fc78000b040 comp rx=0 tx=0).stop 2023-12-05T09:57:34.642 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.581+0000 7fc794d69700 1 -- 172.21.15.100:0/579604853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7900fdbd0 msgr2=0x7fc79010d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:57:34.642 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.581+0000 7fc794d69700 1 --2- 172.21.15.100:0/579604853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7900fdbd0 0x7fc79010d760 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc7840094d0 tx=0x7fc784009e30 comp rx=0 tx=0).stop 2023-12-05T09:57:34.642 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.581+0000 7fc794d69700 1 -- 172.21.15.100:0/579604853 shutdown_connections 2023-12-05T09:57:34.643 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.581+0000 7fc794d69700 1 --2- 172.21.15.100:0/579604853 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7fc77806ae40 0x7fc77806d2f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:34.643 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.581+0000 7fc794d69700 1 --2- 172.21.15.100:0/579604853 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7900fc9c0 0x7fc79010d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:34.643 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.581+0000 7fc794d69700 1 --2- 172.21.15.100:0/579604853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7900fdbd0 0x7fc79010d760 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:34.643 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.581+0000 7fc794d69700 1 -- 172.21.15.100:0/579604853 >> 172.21.15.100:0/579604853 conn(0x7fc7900f8060 msgr2=0x7fc790100e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:57:34.643 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.581+0000 7fc794d69700 1 -- 172.21.15.100:0/579604853 shutdown_connections 2023-12-05T09:57:34.643 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.581+0000 7fc794d69700 1 -- 172.21.15.100:0/579604853 wait complete. 2023-12-05T09:57:34.652 INFO:tasks.workunit.client.1.smithi150.stdout:7/564: symlink d2/db/lc0 0 2023-12-05T09:57:34.654 INFO:tasks.workunit.client.0.smithi100.stdout:2/655: dwrite d7/da/d18/d1b/d2c/d3f/d46/f47 [0,4194304] 0 2023-12-05T09:57:34.654 INFO:tasks.workunit.client.0.smithi100.stdout:2/656: dread - d7/da/d18/d21/d4d/f83 zero size 2023-12-05T09:57:34.654 INFO:tasks.workunit.client.0.smithi100.stdout:2/657: read d7/da/d65/f77 [2139862,41007] 0 2023-12-05T09:57:34.655 INFO:tasks.workunit.client.1.smithi150.stdout:5/540: dwrite d1/d2e/f90 [0,4194304] 0 2023-12-05T09:57:34.655 INFO:tasks.workunit.client.1.smithi150.stdout:5/541: chown d1/d2e/da6/f32 6 1 2023-12-05T09:57:34.655 INFO:tasks.workunit.client.1.smithi150.stdout:5/542: write d1/d7f/d65/d3b/d37/faf [845869,26029] 0 2023-12-05T09:57:34.655 INFO:tasks.workunit.client.1.smithi150.stdout:5/543: chown d1/d2e/da6/d24/c73 1320647 1 2023-12-05T09:57:34.655 INFO:tasks.workunit.client.1.smithi150.stdout:5/544: chown d1/d7f/d65/d3b/d37/ca4 2 1 2023-12-05T09:57:34.656 INFO:tasks.workunit.client.1.smithi150.stdout:3/561: truncate d6/f6c 758157 0 2023-12-05T09:57:34.656 INFO:tasks.workunit.client.1.smithi150.stdout:9/508: symlink d3/d9/d67/la3 0 2023-12-05T09:57:34.656 INFO:tasks.workunit.client.1.smithi150.stdout:9/509: chown d3/d9/dc/d1f/d24/f6b 1 1 2023-12-05T09:57:34.657 INFO:tasks.workunit.client.0.smithi100.stdout:0/493: dwrite da/d2a/f56 [0,4194304] 0 2023-12-05T09:57:34.660 INFO:tasks.workunit.client.0.smithi100.stdout:4/492: rmdir de/d16/d23/d33/d3d/d44 39 2023-12-05T09:57:34.660 INFO:tasks.workunit.client.0.smithi100.stdout:4/493: write de/d38/d5d/f71 [891749,119402] 0 2023-12-05T09:57:34.662 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:34 smithi100 ceph-mon[107145]: pgmap v33: 65 pgs: 65 active+clean; 1.8 GiB data, 7.0 GiB used, 529 GiB / 536 GiB avail; 176 MiB/s rd, 202 MiB/s wr, 315 op/s 2023-12-05T09:57:34.662 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:34 smithi100 ceph-mon[107145]: from='client.24511 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:57:34.665 INFO:tasks.workunit.client.1.smithi150.stdout:1/545: rename d6/d8/d85/dbe to d6/d8/db/de/d75/dc4 0 2023-12-05T09:57:34.673 INFO:tasks.workunit.client.0.smithi100.stdout:2/658: symlink d7/da/d18/d21/d86/d92/ldd 0 2023-12-05T09:57:34.675 INFO:tasks.workunit.client.0.smithi100.stdout:4/494: symlink de/d16/d23/d33/l9b 0 2023-12-05T09:57:34.675 INFO:tasks.workunit.client.0.smithi100.stdout:4/495: stat de/f12 0 2023-12-05T09:57:34.675 INFO:tasks.workunit.client.0.smithi100.stdout:4/496: fsync de/f12 0 2023-12-05T09:57:34.679 INFO:tasks.workunit.client.0.smithi100.stdout:3/627: link d0/d3d/d5c/fd4 d0/d3d/d5c/d6f/d7f/fd7 0 2023-12-05T09:57:34.679 INFO:tasks.workunit.client.0.smithi100.stdout:3/628: chown d0/d10/l93 6 1 2023-12-05T09:57:34.679 INFO:tasks.workunit.client.0.smithi100.stdout:3/629: stat d0/d2/de/d12/d9b 0 2023-12-05T09:57:34.679 INFO:tasks.workunit.client.0.smithi100.stdout:3/630: fsync d0/d2/de/d11/f30 0 2023-12-05T09:57:34.690 INFO:tasks.workunit.client.0.smithi100.stdout:4/497: rmdir de/d16/d23 39 2023-12-05T09:57:34.690 INFO:tasks.workunit.client.0.smithi100.stdout:4/498: read de/d16/d23/d36/f3e [1343869,10282] 0 2023-12-05T09:57:34.693 INFO:tasks.workunit.client.0.smithi100.stdout:4/499: write de/d16/d1e/f7c [345511,104196] 0 2023-12-05T09:57:34.693 INFO:tasks.workunit.client.0.smithi100.stdout:4/500: write de/d16/d1e/f7c [863430,74486] 0 2023-12-05T09:57:34.694 INFO:tasks.workunit.client.1.smithi150.stdout:6/512: creat d2/d23/d2e/d5f/d99/fac x:0 0 0 2023-12-05T09:57:34.694 INFO:tasks.workunit.client.1.smithi150.stdout:6/513: truncate d2/f26 5280913 0 2023-12-05T09:57:34.694 INFO:tasks.workunit.client.1.smithi150.stdout:1/546: write d6/d8/d54/d94/f96 [1146888,123743] 0 2023-12-05T09:57:34.705 INFO:tasks.workunit.client.1.smithi150.stdout:8/621: truncate d0/d41/d49/d1b/d24/d34/d56/f60 173646 0 2023-12-05T09:57:34.707 INFO:tasks.workunit.client.1.smithi150.stdout:2/579: creat d0/d3/d27/dac/fcd x:0 0 0 2023-12-05T09:57:34.711 INFO:tasks.workunit.client.1.smithi150.stdout:5/545: dwrite d1/d7f/d65/f9f [0,4194304] 0 2023-12-05T09:57:34.714 INFO:tasks.workunit.client.1.smithi150.stdout:3/562: dwrite d6/d22/d37/da1/faa [4194304,4194304] 0 2023-12-05T09:57:34.719 INFO:tasks.workunit.client.1.smithi150.stdout:6/514: rmdir d2/d23/d3b/d64/d7a/d8c 39 2023-12-05T09:57:34.719 INFO:tasks.workunit.client.1.smithi150.stdout:6/515: creat d2/d23/d2e/fad x:0 0 0 2023-12-05T09:57:34.719 INFO:tasks.workunit.client.1.smithi150.stdout:6/516: write d2/d23/d2e/f85 [957683,55866] 0 2023-12-05T09:57:34.719 INFO:tasks.workunit.client.1.smithi150.stdout:6/517: dread - d2/d23/d2e/f94 zero size 2023-12-05T09:57:34.726 INFO:tasks.workunit.client.1.smithi150.stdout:6/518: write d2/d23/d2e/f85 [570740,59961] 0 2023-12-05T09:57:34.726 INFO:tasks.workunit.client.1.smithi150.stdout:8/622: truncate d0/d41/d49/d1b/d24/d38/d84/f9e 579161 0 2023-12-05T09:57:34.728 INFO:tasks.workunit.client.1.smithi150.stdout:2/580: creat d0/d3/d5/d36/d86/fce x:0 0 0 2023-12-05T09:57:34.733 INFO:tasks.workunit.client.1.smithi150.stdout:5/546: creat d1/d3/d92/dbf/fc1 x:0 0 0 2023-12-05T09:57:34.734 INFO:tasks.workunit.client.1.smithi150.stdout:5/547: dread - d1/d7f/fa5 zero size 2023-12-05T09:57:34.735 INFO:tasks.workunit.client.0.smithi100.stdout:0/494: dwrite da/d22/d33/d35/d3a/f83 [0,4194304] 0 2023-12-05T09:57:34.735 INFO:tasks.workunit.client.0.smithi100.stdout:4/501: dread de/d16/d23/f24 [0,4194304] 0 2023-12-05T09:57:34.745 INFO:tasks.workunit.client.0.smithi100.stdout:4/502: symlink de/d16/d23/d33/d3d/d44/l9c 0 2023-12-05T09:57:34.745 INFO:tasks.workunit.client.0.smithi100.stdout:0/495: write da/d2a/f3f [822924,22617] 0 2023-12-05T09:57:34.748 INFO:tasks.workunit.client.0.smithi100.stdout:7/512: rename d3/dc/d11/d13/de/d18/d3b/d40/d46/d9e/fb9 to d3/dc/d11/d13/de/d18/d3b/d40/fbb 0 2023-12-05T09:57:34.748 INFO:tasks.workunit.client.1.smithi150.stdout:1/547: dwrite d6/d8/db/de/ff [0,4194304] 0 2023-12-05T09:57:34.748 INFO:tasks.workunit.client.1.smithi150.stdout:1/548: readlink d6/d8/d59/l7b 0 2023-12-05T09:57:34.749 INFO:tasks.workunit.client.1.smithi150.stdout:4/485: rename d0/fc to d0/d3e/d6d/f92 0 2023-12-05T09:57:34.756 INFO:tasks.workunit.client.0.smithi100.stdout:2/659: dwrite d7/da/dc/d88/fb8 [0,4194304] 0 2023-12-05T09:57:34.757 INFO:tasks.workunit.client.0.smithi100.stdout:2/660: write d7/da/d1a/f1c [8086019,5105] 0 2023-12-05T09:57:34.762 INFO:tasks.workunit.client.0.smithi100.stdout:8/467: rename d0/d12/d13/d16/f4a to d0/d12/f80 0 2023-12-05T09:57:34.762 INFO:tasks.workunit.client.0.smithi100.stdout:8/468: chown d0/d12/d13/f4d 79257 1 2023-12-05T09:57:34.765 INFO:tasks.workunit.client.1.smithi150.stdout:3/563: dwrite d6/d9/d3d/d56/d53/f9e [0,4194304] 0 2023-12-05T09:57:34.765 INFO:tasks.workunit.client.1.smithi150.stdout:3/564: stat d6/d9/c9d 0 2023-12-05T09:57:34.765 INFO:tasks.workunit.client.1.smithi150.stdout:3/565: write d6/d9/d3d/d52/f6f [674826,25569] 0 2023-12-05T09:57:34.766 INFO:tasks.workunit.client.1.smithi150.stdout:6/519: symlink d2/d23/d2e/d5f/d99/lae 0 2023-12-05T09:57:34.772 INFO:tasks.workunit.client.1.smithi150.stdout:8/623: mknod d0/d8/cc3 0 2023-12-05T09:57:34.773 INFO:tasks.workunit.client.0.smithi100.stdout:3/631: dwrite d0/d2/de/d11/d7c/fb6 [0,4194304] 0 2023-12-05T09:57:34.774 INFO:tasks.workunit.client.1.smithi150.stdout:2/581: mknod d0/d3/d27/db6/ccf 0 2023-12-05T09:57:34.774 INFO:tasks.workunit.client.1.smithi150.stdout:2/582: chown d0/d3/d5/d13/l9c 10 1 2023-12-05T09:57:34.782 INFO:tasks.workunit.client.1.smithi150.stdout:1/549: rename d6/d8/fc to d6/d8/fc5 0 2023-12-05T09:57:34.782 INFO:tasks.workunit.client.1.smithi150.stdout:6/520: write d2/d23/d2e/d5f/f87 [3949331,38348] 0 2023-12-05T09:57:34.782 INFO:tasks.workunit.client.1.smithi150.stdout:6/521: chown d2/d23/c57 283 1 2023-12-05T09:57:34.783 INFO:tasks.workunit.client.0.smithi100.stdout:8/469: truncate d0/f3c 130264 0 2023-12-05T09:57:34.783 INFO:tasks.workunit.client.1.smithi150.stdout:4/486: chown d0/f61 29802 1 2023-12-05T09:57:34.783 INFO:tasks.workunit.client.1.smithi150.stdout:4/487: chown d0/d3e/d5b/d80/d44/l7a 502643556 1 2023-12-05T09:57:34.787 INFO:tasks.workunit.client.1.smithi150.stdout:9/510: rename d3/d42/d62/l53 to d3/d9/d58/d90/la4 0 2023-12-05T09:57:34.787 INFO:tasks.workunit.client.1.smithi150.stdout:9/511: fdatasync d3/d9/dc/f92 0 2023-12-05T09:57:34.791 INFO:tasks.workunit.client.1.smithi150.stdout:6/522: read d2/d23/d3b/d64/d7a/d5d/d6b/f1a [4623569,26242] 0 2023-12-05T09:57:34.794 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.794+0000 7ffaedd9b700 1 -- 172.21.15.100:0/2997898890 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffae400bc00 con 0x7ffaf006f0c0 2023-12-05T09:57:34.794 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.794+0000 7ffaf5138700 1 -- 172.21.15.100:0/2997898890 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffaf006f0c0 msgr2=0x7ffaf0108cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:57:34.794 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.794+0000 7ffaf5138700 1 --2- 172.21.15.100:0/2997898890 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffaf006f0c0 0x7ffaf0108cc0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ffae4004940 tx=0x7ffae4009e30 comp rx=0 tx=0).stop 2023-12-05T09:57:34.794 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.795+0000 7ffaf5138700 1 -- 172.21.15.100:0/2997898890 shutdown_connections 2023-12-05T09:57:34.794 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.795+0000 7ffaf5138700 1 --2- 172.21.15.100:0/2997898890 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffaf006f0c0 0x7ffaf0108cc0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:34.794 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.795+0000 7ffaf5138700 1 --2- 172.21.15.100:0/2997898890 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffaf006e6e0 0x7ffaf006eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:34.795 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.795+0000 7ffaf5138700 1 -- 172.21.15.100:0/2997898890 >> 172.21.15.100:0/2997898890 conn(0x7ffaf0069f70 msgr2=0x7ffaf006c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:57:34.795 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.795+0000 7ffaf5138700 1 -- 172.21.15.100:0/2997898890 shutdown_connections 2023-12-05T09:57:34.795 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.795+0000 7ffaf5138700 1 -- 172.21.15.100:0/2997898890 wait complete. 2023-12-05T09:57:34.796 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.797+0000 7ffaf5138700 1 Processor -- start 2023-12-05T09:57:34.796 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.798+0000 7ffaf5138700 1 -- start start 2023-12-05T09:57:34.796 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.799+0000 7ffaf5138700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffaf006e6e0 0x7ffaf0113c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:57:34.796 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.799+0000 7ffaf5138700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffaf01141b0 0x7ffaf01150a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:57:34.796 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.799+0000 7ffaf5138700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf0114700 con 0x7ffaf006e6e0 2023-12-05T09:57:34.796 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.799+0000 7ffaf5138700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf0114870 con 0x7ffaf01141b0 2023-12-05T09:57:34.796 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.799+0000 7ffaee59c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffaf01141b0 0x7ffaf01150a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:57:34.796 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.799+0000 7ffaee59c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffaf01141b0 0x7ffaf01150a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.100:49976/0 (socket says 172.21.15.100:49976) 2023-12-05T09:57:34.796 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.799+0000 7ffaee59c700 1 -- 172.21.15.100:0/867949935 learned_addr learned my addr 172.21.15.100:0/867949935 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:57:34.797 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.800+0000 7ffaeed9d700 1 --2- 172.21.15.100:0/867949935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffaf006e6e0 0x7ffaf0113c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:57:34.797 INFO:tasks.workunit.client.0.smithi100.stdout:8/470: mkdir d0/d35/d64/d81 0 2023-12-05T09:57:34.797 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.800+0000 7ffaee59c700 1 -- 172.21.15.100:0/867949935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffaf006e6e0 msgr2=0x7ffaf0113c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:57:34.797 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.801+0000 7ffaee59c700 1 --2- 172.21.15.100:0/867949935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffaf006e6e0 0x7ffaf0113c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:34.797 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.801+0000 7ffaee59c700 1 -- 172.21.15.100:0/867949935 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffae4005040 con 0x7ffaf01141b0 2023-12-05T09:57:34.797 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.801+0000 7ffaeed9d700 1 --2- 172.21.15.100:0/867949935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffaf006e6e0 0x7ffaf0113c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-05T09:57:34.798 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.802+0000 7ffaee59c700 1 --2- 172.21.15.100:0/867949935 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffaf01141b0 0x7ffaf01150a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ffae4009360 tx=0x7ffae4009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:57:34.800 INFO:tasks.workunit.client.0.smithi100.stdout:0/496: dwrite da/f2c [0,4194304] 0 2023-12-05T09:57:34.808 INFO:tasks.workunit.client.1.smithi150.stdout:2/583: dread d0/d3/d5/d22/d52/d56/f73 [0,4194304] 0 2023-12-05T09:57:34.808 INFO:tasks.workunit.client.1.smithi150.stdout:2/584: write d0/d3/d5/d13/d15/d30/d54/d57/f91 [4895481,84528] 0 2023-12-05T09:57:34.808 INFO:tasks.workunit.client.1.smithi150.stdout:2/585: read d0/d3/d5/d13/d15/d30/d54/d57/f88 [133973,43908] 0 2023-12-05T09:57:34.809 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.806+0000 7ffad77fe700 1 -- 172.21.15.100:0/867949935 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffae400e040 con 0x7ffaf01141b0 2023-12-05T09:57:34.809 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.806+0000 7ffad77fe700 1 -- 172.21.15.100:0/867949935 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ffae400bc50 con 0x7ffaf01141b0 2023-12-05T09:57:34.809 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.806+0000 7ffad77fe700 1 -- 172.21.15.100:0/867949935 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffae401c3f0 con 0x7ffaf01141b0 2023-12-05T09:57:34.809 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.807+0000 7ffaf5138700 1 -- 172.21.15.100:0/867949935 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaf0115720 con 0x7ffaf01141b0 2023-12-05T09:57:34.809 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.807+0000 7ffaf5138700 1 -- 172.21.15.100:0/867949935 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaf0115c60 con 0x7ffaf01141b0 2023-12-05T09:57:34.809 INFO:tasks.workunit.client.0.smithi100.stdout:8/471: mkdir d0/d12/d13/d16/d22/d82 0 2023-12-05T09:57:34.810 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.809+0000 7ffaf5138700 1 -- 172.21.15.100:0/867949935 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaf004bb80 con 0x7ffaf01141b0 2023-12-05T09:57:34.810 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.811+0000 7ffad77fe700 1 -- 172.21.15.100:0/867949935 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 25) v1 ==== 88726+0+0 (secure 0 0 0) 0x7ffae4013420 con 0x7ffaf01141b0 2023-12-05T09:57:34.810 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.813+0000 7ffad77fe700 1 --2- 172.21.15.100:0/867949935 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7ffad806af10 0x7ffad806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:57:34.810 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.813+0000 7ffad77fe700 1 -- 172.21.15.100:0/867949935 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7ffae408aa00 con 0x7ffaf01141b0 2023-12-05T09:57:34.811 INFO:tasks.workunit.client.1.smithi150.stdout:3/566: mkdir d6/d25/d28/d9a/da0/db2 0 2023-12-05T09:57:34.811 INFO:tasks.workunit.client.0.smithi100.stdout:2/661: dwrite d7/da/d18/d21/f7e [0,4194304] 0 2023-12-05T09:57:34.811 INFO:tasks.workunit.client.0.smithi100.stdout:2/662: creat d7/da/d13/d69/fde x:0 0 0 2023-12-05T09:57:34.811 INFO:tasks.workunit.client.0.smithi100.stdout:2/663: write d7/da/dc/d88/fd0 [516250,86432] 0 2023-12-05T09:57:34.811 INFO:tasks.workunit.client.0.smithi100.stdout:2/664: write d7/da/d13/fda [432622,77286] 0 2023-12-05T09:57:34.812 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.814+0000 7ffaeed9d700 1 --2- 172.21.15.100:0/867949935 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7ffad806af10 0x7ffad806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:57:34.813 INFO:tasks.workunit.client.1.smithi150.stdout:6/523: read d2/d23/d3b/d64/d7a/d5d/d6b/f10 [3490001,18174] 0 2023-12-05T09:57:34.820 INFO:tasks.workunit.client.1.smithi150.stdout:1/550: mkdir d6/d38/da1/dc6 0 2023-12-05T09:57:34.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.816+0000 7ffaeed9d700 1 --2- 172.21.15.100:0/867949935 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7ffad806af10 0x7ffad806d3c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ffaf0113a00 tx=0x7ffae00091a0 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:57:34.821 INFO:tasks.workunit.client.0.smithi100.stdout:8/472: symlink d0/d12/d13/d16/l83 0 2023-12-05T09:57:34.821 INFO:tasks.workunit.client.0.smithi100.stdout:8/473: fsync d0/d35/d63/d76/f3f 0 2023-12-05T09:57:34.821 INFO:tasks.workunit.client.0.smithi100.stdout:8/474: truncate d0/d12/d13/d45/f5d 170537 0 2023-12-05T09:57:34.821 INFO:tasks.workunit.client.0.smithi100.stdout:8/475: write d0/d12/f48 [820289,8212] 0 2023-12-05T09:57:34.821 INFO:tasks.workunit.client.0.smithi100.stdout:2/665: write d7/da/d18/d1b/f6c [1117171,16779] 0 2023-12-05T09:57:34.821 INFO:tasks.workunit.client.0.smithi100.stdout:3/632: dwrite d0/d10/d39/f8b [0,4194304] 0 2023-12-05T09:57:34.821 INFO:tasks.workunit.client.0.smithi100.stdout:3/633: truncate d0/d10/d39/f57 45695 0 2023-12-05T09:57:34.821 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:34.820+0000 7ffad77fe700 1 -- 172.21.15.100:0/867949935 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7ffae4054d20 con 0x7ffaf01141b0 2023-12-05T09:57:34.826 INFO:tasks.workunit.client.1.smithi150.stdout:2/586: dread d0/d3/f14 [0,4194304] 0 2023-12-05T09:57:34.826 INFO:tasks.workunit.client.0.smithi100.stdout:4/503: dwrite f9 [0,4194304] 0 2023-12-05T09:57:34.826 INFO:tasks.workunit.client.0.smithi100.stdout:4/504: fsync de/d16/f83 0 2023-12-05T09:57:34.827 INFO:tasks.workunit.client.1.smithi150.stdout:4/488: symlink d0/d3e/d5b/l93 0 2023-12-05T09:57:34.831 INFO:tasks.workunit.client.0.smithi100.stdout:2/666: mknod d7/da/d18/d1b/cdf 0 2023-12-05T09:57:34.831 INFO:tasks.workunit.client.0.smithi100.stdout:1/509: sync 2023-12-05T09:57:34.831 INFO:tasks.workunit.client.0.smithi100.stdout:5/552: sync 2023-12-05T09:57:34.831 INFO:tasks.workunit.client.0.smithi100.stdout:5/553: chown d0/d4/d14/d35/d62 48839 1 2023-12-05T09:57:34.831 INFO:tasks.workunit.client.0.smithi100.stdout:6/910: sync 2023-12-05T09:57:34.841 INFO:tasks.workunit.client.1.smithi150.stdout:9/512: symlink d3/d1b/d46/d55/d64/d94/la5 0 2023-12-05T09:57:34.841 INFO:tasks.workunit.client.1.smithi150.stdout:9/513: creat d3/d1b/d46/d55/d64/fa6 x:0 0 0 2023-12-05T09:57:34.842 INFO:tasks.workunit.client.0.smithi100.stdout:3/634: creat d0/d3d/d5c/fd8 x:0 0 0 2023-12-05T09:57:34.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:34 smithi150 ceph-mon[116142]: pgmap v33: 65 pgs: 65 active+clean; 1.8 GiB data, 7.0 GiB used, 529 GiB / 536 GiB avail; 176 MiB/s rd, 202 MiB/s wr, 315 op/s 2023-12-05T09:57:34.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:34 smithi150 ceph-mon[116142]: from='client.24511 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:57:34.849 INFO:tasks.workunit.client.0.smithi100.stdout:4/505: mknod de/d16/d23/d33/c9d 0 2023-12-05T09:57:34.858 INFO:tasks.workunit.client.0.smithi100.stdout:2/667: rename d7/da/d18/d1b/d2c/d3f/d46/fc2 to d7/da/d13/fe0 0 2023-12-05T09:57:34.859 INFO:tasks.workunit.client.1.smithi150.stdout:8/624: link d0/d41/d49/d1b/d24/d34/d56/d67/f6c d0/fc4 0 2023-12-05T09:57:34.859 INFO:tasks.workunit.client.1.smithi150.stdout:8/625: chown d0/d41/d49/d1b/d24/d38/d62/lb5 22019337 1 2023-12-05T09:57:34.859 INFO:tasks.workunit.client.1.smithi150.stdout:8/626: truncate d0/d41/d49/d1b/d24/d2e/fa5 907866 0 2023-12-05T09:57:34.859 INFO:tasks.workunit.client.1.smithi150.stdout:8/627: creat d0/d41/d49/d1b/fc5 x:0 0 0 2023-12-05T09:57:34.860 INFO:tasks.workunit.client.0.smithi100.stdout:2/668: write d7/da/d18/d21/d4d/d81/f50 [5591861,122553] 0 2023-12-05T09:57:34.861 INFO:tasks.workunit.client.1.smithi150.stdout:1/551: mkdir d6/d47/d4c/d60/dc7 0 2023-12-05T09:57:34.865 INFO:tasks.workunit.client.1.smithi150.stdout:2/587: dread d0/f16 [0,4194304] 0 2023-12-05T09:57:34.865 INFO:tasks.workunit.client.1.smithi150.stdout:2/588: chown d0/d3/d5/d22/d52 29756194 1 2023-12-05T09:57:34.865 INFO:tasks.workunit.client.1.smithi150.stdout:2/589: chown d0/da3/fbc 902352 1 2023-12-05T09:57:34.865 INFO:tasks.workunit.client.1.smithi150.stdout:2/590: stat d0/d3/d5/d13/d15/l55 0 2023-12-05T09:57:34.867 INFO:tasks.workunit.client.0.smithi100.stdout:1/510: rmdir db/d12 39 2023-12-05T09:57:34.867 INFO:tasks.workunit.client.0.smithi100.stdout:1/511: dread - db/d12/d1e/d26/d30/d52/d84/f87 zero size 2023-12-05T09:57:34.868 INFO:tasks.workunit.client.0.smithi100.stdout:4/506: rmdir de/d16/d23/d33/d3d/d44/d4e 39 2023-12-05T09:57:34.880 INFO:tasks.workunit.client.1.smithi150.stdout:0/591: sync 2023-12-05T09:57:34.880 INFO:tasks.workunit.client.1.smithi150.stdout:1/552: truncate d6/d8/db/de/f32 1835854 0 2023-12-05T09:57:34.892 INFO:tasks.workunit.client.1.smithi150.stdout:5/548: rename d1/d7f/l67 to d1/d3/lc2 0 2023-12-05T09:57:34.892 INFO:tasks.workunit.client.1.smithi150.stdout:2/591: mkdir d0/d3/d27/dac/dd0 0 2023-12-05T09:57:34.892 INFO:tasks.workunit.client.1.smithi150.stdout:5/549: dread - d1/d7f/fa5 zero size 2023-12-05T09:57:34.892 INFO:tasks.workunit.client.1.smithi150.stdout:2/592: read - d0/d3/d5/d22/fbf zero size 2023-12-05T09:57:34.892 INFO:tasks.workunit.client.1.smithi150.stdout:5/550: creat d1/d3/d6/d72/fc3 x:0 0 0 2023-12-05T09:57:34.893 INFO:tasks.workunit.client.0.smithi100.stdout:5/554: rename d0/d4/c84 to d0/d16/d37/cc2 0 2023-12-05T09:57:34.902 INFO:tasks.workunit.client.0.smithi100.stdout:9/545: sync 2023-12-05T09:57:34.909 INFO:tasks.workunit.client.0.smithi100.stdout:9/546: stat d7/d1b/d22/d2a/d56/d2e/d50/c8f 0 2023-12-05T09:57:34.909 INFO:tasks.workunit.client.0.smithi100.stdout:9/547: fsync d7/d1b/f30 0 2023-12-05T09:57:34.911 INFO:tasks.workunit.client.0.smithi100.stdout:4/507: rename de/d16/d23/f53 to de/d16/d23/d33/d3d/f9e 0 2023-12-05T09:57:34.914 INFO:tasks.workunit.client.1.smithi150.stdout:5/551: symlink d1/d7f/d65/lc4 0 2023-12-05T09:57:34.914 INFO:tasks.workunit.client.1.smithi150.stdout:5/552: readlink d1/d2e/da6/d24/l5e 0 2023-12-05T09:57:34.916 INFO:tasks.workunit.client.1.smithi150.stdout:3/567: dwrite d6/d25/f62 [0,4194304] 0 2023-12-05T09:57:34.916 INFO:tasks.workunit.client.1.smithi150.stdout:3/568: truncate d6/d9/d3d/d52/f6f 1412391 0 2023-12-05T09:57:34.917 INFO:tasks.workunit.client.0.smithi100.stdout:0/497: dwrite da/f2d [0,4194304] 0 2023-12-05T09:57:34.917 INFO:tasks.workunit.client.0.smithi100.stdout:0/498: readlink da/l19 0 2023-12-05T09:57:34.921 INFO:tasks.workunit.client.0.smithi100.stdout:9/548: unlink d7/d20/c4b 0 2023-12-05T09:57:34.922 INFO:tasks.workunit.client.0.smithi100.stdout:9/549: readlink d7/l41 0 2023-12-05T09:57:34.926 INFO:tasks.workunit.client.0.smithi100.stdout:0/499: truncate da/d22/d33/d7f/f81 333395 0 2023-12-05T09:57:34.934 INFO:tasks.workunit.client.0.smithi100.stdout:0/500: dread da/d1b/d6b/d78/f88 [0,4194304] 0 2023-12-05T09:57:34.935 INFO:tasks.workunit.client.1.smithi150.stdout:2/593: write d0/d3/d11/f18 [704693,53605] 0 2023-12-05T09:57:34.946 INFO:tasks.workunit.client.0.smithi100.stdout:8/476: dwrite d0/f31 [0,4194304] 0 2023-12-05T09:57:34.947 INFO:tasks.workunit.client.0.smithi100.stdout:8/477: chown d0/c7d 14 1 2023-12-05T09:57:34.947 INFO:tasks.workunit.client.0.smithi100.stdout:8/478: creat d0/d12/f84 x:0 0 0 2023-12-05T09:57:34.947 INFO:tasks.workunit.client.1.smithi150.stdout:3/569: mknod d6/d25/d28/d67/cb3 0 2023-12-05T09:57:34.951 INFO:tasks.workunit.client.1.smithi150.stdout:7/565: sync 2023-12-05T09:57:34.952 INFO:tasks.workunit.client.1.smithi150.stdout:9/514: dwrite d3/d9/dc/f92 [0,4194304] 0 2023-12-05T09:57:34.952 INFO:tasks.workunit.client.0.smithi100.stdout:6/911: dwrite d7/d11/d1a/f54 [0,4194304] 0 2023-12-05T09:57:34.956 INFO:tasks.workunit.client.1.smithi150.stdout:5/553: rmdir d1/d7f/d65/d3b/d8d 39 2023-12-05T09:57:34.958 INFO:tasks.workunit.client.0.smithi100.stdout:3/635: dwrite d0/d3d/fb2 [0,4194304] 0 2023-12-05T09:57:34.958 INFO:tasks.workunit.client.0.smithi100.stdout:3/636: creat d0/d2/de/d8d/fd9 x:0 0 0 2023-12-05T09:57:34.961 INFO:tasks.workunit.client.1.smithi150.stdout:6/524: dwrite d2/d23/d2e/d5f/f6d [0,4194304] 0 2023-12-05T09:57:34.962 INFO:tasks.workunit.client.1.smithi150.stdout:3/570: dread d6/d25/f62 [0,4194304] 0 2023-12-05T09:57:34.963 INFO:tasks.workunit.client.1.smithi150.stdout:2/594: unlink d0/d3/d5/d3b/d4c/c50 0 2023-12-05T09:57:34.963 INFO:tasks.workunit.client.1.smithi150.stdout:2/595: readlink d0/da3/dae/lc1 0 2023-12-05T09:57:34.966 INFO:tasks.workunit.client.1.smithi150.stdout:7/566: creat d2/db/d30/d18/d1a/d1e/d2b/fc1 x:0 0 0 2023-12-05T09:57:34.966 INFO:tasks.workunit.client.1.smithi150.stdout:7/567: readlink d2/db/d30/d18/d1a/d1e/lae 0 2023-12-05T09:57:34.974 INFO:tasks.workunit.client.0.smithi100.stdout:9/550: mkdir d7/d1b/d22/d51/d32/d96/db9 0 2023-12-05T09:57:34.976 INFO:tasks.workunit.client.1.smithi150.stdout:8/628: dwrite d0/d41/d49/d1b/d24/d2e/f8b [0,4194304] 0 2023-12-05T09:57:34.980 INFO:tasks.workunit.client.0.smithi100.stdout:2/669: dwrite d7/da/d18/d1b/f59 [0,4194304] 0 2023-12-05T09:57:34.982 INFO:tasks.workunit.client.1.smithi150.stdout:5/554: getdents d1/d2e/da6 0 2023-12-05T09:57:34.982 INFO:tasks.workunit.client.1.smithi150.stdout:5/555: chown d1/f51 1718276 1 2023-12-05T09:57:34.985 INFO:tasks.workunit.client.1.smithi150.stdout:0/592: dwrite d5/d11/d71/d74/fd0 [0,4194304] 0 2023-12-05T09:57:34.986 INFO:tasks.workunit.client.1.smithi150.stdout:6/525: mknod d2/d23/d2e/caf 0 2023-12-05T09:57:34.987 INFO:tasks.workunit.client.0.smithi100.stdout:1/512: dwrite db/f1a [0,4194304] 0 2023-12-05T09:57:34.996 INFO:tasks.workunit.client.0.smithi100.stdout:8/479: getdents d0/d12/d13/d16/d22 0 2023-12-05T09:57:34.996 INFO:tasks.workunit.client.0.smithi100.stdout:8/480: readlink d0/d35/d63/d76/l59 0 2023-12-05T09:57:34.996 INFO:tasks.workunit.client.0.smithi100.stdout:8/481: chown d0/d12/d13/d16/f79 4777 1 2023-12-05T09:57:34.996 INFO:tasks.workunit.client.0.smithi100.stdout:8/482: stat d0/d12/d13/d16/d42/d43/f66 0 2023-12-05T09:57:34.997 INFO:tasks.workunit.client.1.smithi150.stdout:3/571: rename d6/d25/d28/d67/cb3 to d6/d25/d28/d9a/da0/db2/cb4 0 2023-12-05T09:57:34.997 INFO:tasks.workunit.client.1.smithi150.stdout:3/572: fdatasync d6/d9/d43/d47/f1a 0 2023-12-05T09:57:34.997 INFO:tasks.workunit.client.1.smithi150.stdout:8/629: write d0/d41/d49/d1b/d24/d2e/f44 [2871097,14371] 0 2023-12-05T09:57:34.997 INFO:tasks.workunit.client.1.smithi150.stdout:2/596: mknod d0/d3/d5/d13/d15/cd1 0 2023-12-05T09:57:34.997 INFO:tasks.workunit.client.1.smithi150.stdout:2/597: fsync d0/d3/d5/d10/f20 0 2023-12-05T09:57:34.999 INFO:tasks.workunit.client.0.smithi100.stdout:6/912: mknod d7/d11/d82/db9/c128 0 2023-12-05T09:57:35.006 INFO:tasks.workunit.client.1.smithi150.stdout:3/573: read d6/d9/f32 [1008378,48467] 0 2023-12-05T09:57:35.017 INFO:tasks.workunit.client.0.smithi100.stdout:5/555: dwrite d0/d16/d2b/fa4 [0,4194304] 0 2023-12-05T09:57:35.018 INFO:tasks.workunit.client.1.smithi150.stdout:9/515: link d3/d9/dc/d1f/l6a d3/d9/la7 0 2023-12-05T09:57:35.018 INFO:tasks.workunit.client.1.smithi150.stdout:9/516: fsync d3/d9/dc/d1f/f2b 0 2023-12-05T09:57:35.018 INFO:tasks.workunit.client.1.smithi150.stdout:9/517: readlink d3/d9/dc/l3e 0 2023-12-05T09:57:35.018 INFO:tasks.workunit.client.1.smithi150.stdout:9/518: write d3/d9/dc/f1d [3327939,79056] 0 2023-12-05T09:57:35.018 INFO:tasks.workunit.client.1.smithi150.stdout:9/519: chown d3/d9/dc/d1f/d24/c80 26482179 1 2023-12-05T09:57:35.037 INFO:tasks.workunit.client.1.smithi150.stdout:7/568: dwrite d2/db/d62/f92 [0,4194304] 0 2023-12-05T09:57:35.037 INFO:tasks.workunit.client.1.smithi150.stdout:7/569: chown d2/d1b/d31 23276912 1 2023-12-05T09:57:35.038 INFO:tasks.workunit.client.0.smithi100.stdout:9/551: mknod d7/d35/d71/cba 0 2023-12-05T09:57:35.048 INFO:tasks.workunit.client.0.smithi100.stdout:1/513: dread db/d12/f96 [0,4194304] 0 2023-12-05T09:57:35.048 INFO:tasks.workunit.client.0.smithi100.stdout:3/637: dread d0/d10/d39/f55 [0,4194304] 0 2023-12-05T09:57:35.058 INFO:tasks.workunit.client.0.smithi100.stdout:5/556: rmdir d0/d1f/da1 39 2023-12-05T09:57:35.058 INFO:tasks.workunit.client.0.smithi100.stdout:6/913: truncate d7/d27/d97/fea 820626 0 2023-12-05T09:57:35.059 INFO:tasks.workunit.client.0.smithi100.stdout:6/914: write d7/f59 [810710,35241] 0 2023-12-05T09:57:35.059 INFO:tasks.workunit.client.1.smithi150.stdout:6/526: dwrite d2/d23/d2e/f91 [0,4194304] 0 2023-12-05T09:57:35.059 INFO:tasks.workunit.client.1.smithi150.stdout:6/527: fsync d2/d23/f7e 0 2023-12-05T09:57:35.064 INFO:tasks.workunit.client.1.smithi150.stdout:0/593: rmdir d5/d11/dce/d67/da8 39 2023-12-05T09:57:35.065 INFO:tasks.workunit.client.1.smithi150.stdout:0/594: getdents d5/d11/dce/d7f/db4 0 2023-12-05T09:57:35.072 INFO:tasks.workunit.client.0.smithi100.stdout:2/670: dwrite d7/da/d13/d69/fba [0,4194304] 0 2023-12-05T09:57:35.073 INFO:tasks.workunit.client.0.smithi100.stdout:5/557: dread d0/d16/d2b/f3a [0,4194304] 0 2023-12-05T09:57:35.073 INFO:tasks.workunit.client.0.smithi100.stdout:5/558: write d0/d1f/f86 [4616786,68434] 0 2023-12-05T09:57:35.073 INFO:tasks.workunit.client.1.smithi150.stdout:5/556: dwrite d1/d2e/da6/d24/d59/fb4 [0,4194304] 0 2023-12-05T09:57:35.073 INFO:tasks.workunit.client.1.smithi150.stdout:5/557: readlink d1/d2e/da6/la9 0 2023-12-05T09:57:35.074 INFO:tasks.workunit.client.0.smithi100.stdout:9/552: link d7/d35/c94 d7/d60/cbb 0 2023-12-05T09:57:35.084 INFO:tasks.workunit.client.0.smithi100.stdout:3/638: read d0/d2/de/d12/f29 [1583300,75336] 0 2023-12-05T09:57:35.087 INFO:tasks.workunit.client.0.smithi100.stdout:0/501: dwrite da/d22/f23 [0,4194304] 0 2023-12-05T09:57:35.087 INFO:tasks.workunit.client.0.smithi100.stdout:1/514: dread db/f1a [0,4194304] 0 2023-12-05T09:57:35.088 INFO:tasks.workunit.client.0.smithi100.stdout:1/515: creat db/d12/d1e/fa0 x:0 0 0 2023-12-05T09:57:35.088 INFO:tasks.workunit.client.0.smithi100.stdout:8/483: dwrite d0/d12/d13/f6c [0,4194304] 0 2023-12-05T09:57:35.088 INFO:tasks.workunit.client.0.smithi100.stdout:8/484: read - d0/f5a zero size 2023-12-05T09:57:35.090 INFO:tasks.workunit.client.0.smithi100.stdout:1/516: creat db/d31/d3a/d3b/fa1 x:0 0 0 2023-12-05T09:57:35.090 INFO:tasks.workunit.client.1.smithi150.stdout:8/630: creat d0/d41/d49/d1b/d24/d5b/d9c/fc6 x:0 0 0 2023-12-05T09:57:35.090 INFO:tasks.workunit.client.1.smithi150.stdout:2/598: mkdir d0/d3/d21/d77/dd2 0 2023-12-05T09:57:35.094 INFO:tasks.workunit.client.1.smithi150.stdout:3/574: mknod d6/d25/cb5 0 2023-12-05T09:57:35.094 INFO:tasks.workunit.client.1.smithi150.stdout:3/575: chown d6/d25/c61 537468 1 2023-12-05T09:57:35.103 INFO:tasks.workunit.client.1.smithi150.stdout:8/631: dread d0/d41/d49/f86 [0,4194304] 0 2023-12-05T09:57:35.104 INFO:tasks.workunit.client.0.smithi100.stdout:2/671: symlink d7/da/d18/d21/dae/le1 0 2023-12-05T09:57:35.104 INFO:tasks.workunit.client.1.smithi150.stdout:9/520: unlink d3/f2e 0 2023-12-05T09:57:35.107 INFO:tasks.workunit.client.1.smithi150.stdout:7/570: mknod d2/d9d/da0/cc2 0 2023-12-05T09:57:35.112 INFO:tasks.workunit.client.0.smithi100.stdout:9/553: creat d7/d1b/d22/d51/fbc x:0 0 0 2023-12-05T09:57:35.119 INFO:tasks.workunit.client.0.smithi100.stdout:2/672: symlink d7/da/dc/le2 0 2023-12-05T09:57:35.119 INFO:tasks.workunit.client.0.smithi100.stdout:2/673: fsync d7/da/d18/d1b/d2c/d3f/faa 0 2023-12-05T09:57:35.123 INFO:tasks.workunit.client.1.smithi150.stdout:0/595: rename d5/d11/dce to d5/d11/d71/d99/d9c/d96/dd5 0 2023-12-05T09:57:35.123 INFO:tasks.workunit.client.1.smithi150.stdout:0/596: creat d5/d11/d32/fd6 x:0 0 0 2023-12-05T09:57:35.123 INFO:tasks.workunit.client.1.smithi150.stdout:0/597: chown d5/d11/d71/d99/d9c/d96/dd5/d67/f73 0 1 2023-12-05T09:57:35.124 INFO:tasks.workunit.client.0.smithi100.stdout:9/554: truncate d7/d1b/d22/d2a/d56/f6e 621190 0 2023-12-05T09:57:35.126 INFO:tasks.workunit.client.1.smithi150.stdout:9/521: read d3/d9/dc/d1f/f5f [748720,42911] 0 2023-12-05T09:57:35.127 INFO:tasks.workunit.client.1.smithi150.stdout:2/599: truncate d0/d3/fb7 57803 0 2023-12-05T09:57:35.130 INFO:tasks.workunit.client.1.smithi150.stdout:1/553: sync 2023-12-05T09:57:35.130 INFO:tasks.workunit.client.1.smithi150.stdout:4/489: sync 2023-12-05T09:57:35.134 INFO:tasks.workunit.client.0.smithi100.stdout:2/674: mknod d7/da/d18/d21/dae/ce3 0 2023-12-05T09:57:35.136 INFO:tasks.workunit.client.1.smithi150.stdout:6/528: rmdir d2/d23/d2e/d5f 39 2023-12-05T09:57:35.138 INFO:tasks.workunit.client.1.smithi150.stdout:5/558: rename d1/d3/d6/d26/c2d to d1/d2e/da6/d24/cc5 0 2023-12-05T09:57:35.138 INFO:tasks.workunit.client.1.smithi150.stdout:5/559: chown d1/d7f/d65/l8a 37 1 2023-12-05T09:57:35.139 INFO:tasks.workunit.client.1.smithi150.stdout:2/600: dread d0/d3/d5/d13/d15/d30/d54/d57/fab [0,4194304] 0 2023-12-05T09:57:35.140 INFO:tasks.workunit.client.1.smithi150.stdout:9/522: mknod d3/d9/d6e/d76/ca8 0 2023-12-05T09:57:35.141 INFO:tasks.workunit.client.0.smithi100.stdout:9/555: symlink d7/d1b/da5/da2/lbd 0 2023-12-05T09:57:35.142 INFO:tasks.workunit.client.1.smithi150.stdout:4/490: creat d0/d3e/d5b/f94 x:0 0 0 2023-12-05T09:57:35.142 INFO:tasks.workunit.client.1.smithi150.stdout:1/554: dread d6/d8/db/f5b [0,4194304] 0 2023-12-05T09:57:35.145 INFO:tasks.workunit.client.1.smithi150.stdout:3/576: rename d6/d25/d28/d9a/da0 to d6/d9/d3d/d56/d71/db6 0 2023-12-05T09:57:35.145 INFO:tasks.workunit.client.1.smithi150.stdout:5/560: mknod d1/d3/d6/d89/cc6 0 2023-12-05T09:57:35.147 INFO:tasks.workunit.client.1.smithi150.stdout:9/523: creat d3/d9/d58/fa9 x:0 0 0 2023-12-05T09:57:35.153 INFO:tasks.workunit.client.1.smithi150.stdout:7/571: rename d2/db/d2e/c70 to d2/db/d62/cc3 0 2023-12-05T09:57:35.153 INFO:tasks.workunit.client.1.smithi150.stdout:5/561: unlink d1/d7f/d65/d3b/l44 0 2023-12-05T09:57:35.154 INFO:tasks.workunit.client.1.smithi150.stdout:9/524: creat d3/d9/d26/d9b/faa x:0 0 0 2023-12-05T09:57:35.156 INFO:tasks.workunit.client.1.smithi150.stdout:9/525: symlink d3/d1b/d46/d55/d64/lab 0 2023-12-05T09:57:35.156 INFO:tasks.workunit.client.1.smithi150.stdout:6/529: rename d2/d23/d2e/d44/da0/caa to d2/d23/cb0 0 2023-12-05T09:57:35.161 INFO:tasks.workunit.client.1.smithi150.stdout:6/530: mknod d2/d23/d3b/d64/cb1 0 2023-12-05T09:57:35.164 INFO:tasks.workunit.client.1.smithi150.stdout:1/555: dread f4 [0,4194304] 0 2023-12-05T09:57:35.164 INFO:tasks.workunit.client.1.smithi150.stdout:1/556: creat d6/d47/d4c/d60/fc8 x:0 0 0 2023-12-05T09:57:35.167 INFO:tasks.workunit.client.0.smithi100.stdout:6/915: dwrite d7/dcc/df0/f10d [0,4194304] 0 2023-12-05T09:57:35.178 INFO:tasks.workunit.client.0.smithi100.stdout:0/502: dwrite da/d2a/d45/f49 [0,4194304] 0 2023-12-05T09:57:35.178 INFO:tasks.workunit.client.0.smithi100.stdout:0/503: write da/f2d [7088797,70136] 0 2023-12-05T09:57:35.178 INFO:tasks.workunit.client.0.smithi100.stdout:3/639: dwrite d0/d2/d33/f35 [0,4194304] 0 2023-12-05T09:57:35.181 INFO:tasks.workunit.client.1.smithi150.stdout:3/577: dread d6/d22/d37/f4a [0,4194304] 0 2023-12-05T09:57:35.181 INFO:tasks.workunit.client.0.smithi100.stdout:4/508: sync 2023-12-05T09:57:35.181 INFO:tasks.workunit.client.0.smithi100.stdout:7/513: sync 2023-12-05T09:57:35.183 INFO:tasks.workunit.client.0.smithi100.stdout:8/485: dwrite d0/d12/f48 [0,4194304] 0 2023-12-05T09:57:35.183 INFO:tasks.workunit.client.0.smithi100.stdout:8/486: creat d0/d35/d64/f85 x:0 0 0 2023-12-05T09:57:35.183 INFO:tasks.workunit.client.1.smithi150.stdout:7/572: dread d2/d1b/d91/fa3 [0,4194304] 0 2023-12-05T09:57:35.187 INFO:tasks.workunit.client.1.smithi150.stdout:7/573: mknod d2/db/d17/d88/cc4 0 2023-12-05T09:57:35.188 INFO:tasks.workunit.client.1.smithi150.stdout:7/574: stat d2/db/d17/d20/l33 0 2023-12-05T09:57:35.188 INFO:tasks.workunit.client.1.smithi150.stdout:3/578: truncate d6/d9/f1d 192439 0 2023-12-05T09:57:35.188 INFO:tasks.workunit.client.1.smithi150.stdout:3/579: chown d6/d9/d3d/d56/d79/f7f 1843419652 1 2023-12-05T09:57:35.188 INFO:tasks.workunit.client.0.smithi100.stdout:5/559: dread d0/d1f/f97 [4194304,4194304] 0 2023-12-05T09:57:35.191 INFO:tasks.workunit.client.1.smithi150.stdout:7/575: truncate d2/db/d17/d38/d85/f8b 11224 0 2023-12-05T09:57:35.191 INFO:tasks.workunit.client.1.smithi150.stdout:7/576: creat d2/db/d17/d38/d85/fc5 x:0 0 0 2023-12-05T09:57:35.197 INFO:tasks.workunit.client.0.smithi100.stdout:3/640: creat d0/d3d/d90/fda x:0 0 0 2023-12-05T09:57:35.198 INFO:tasks.workunit.client.0.smithi100.stdout:3/641: write d0/d3d/d90/fda [999590,117163] 0 2023-12-05T09:57:35.199 INFO:tasks.workunit.client.1.smithi150.stdout:7/577: rename d2/db/lb3 to d2/db/d30/d47/lc6 0 2023-12-05T09:57:35.200 INFO:tasks.workunit.client.1.smithi150.stdout:7/578: chown d2/db/d17/d20/c4c 25781 1 2023-12-05T09:57:35.200 INFO:tasks.workunit.client.1.smithi150.stdout:7/579: write d2/db/d30/d13/d4f/d5a/d5c/f89 [392848,97267] 0 2023-12-05T09:57:35.200 INFO:tasks.workunit.client.1.smithi150.stdout:7/580: write d2/db/d30/d18/d1a/d1e/fa8 [245678,123292] 0 2023-12-05T09:57:35.205 INFO:tasks.workunit.client.0.smithi100.stdout:4/509: creat de/d16/d23/d60/f9f x:0 0 0 2023-12-05T09:57:35.207 INFO:tasks.workunit.client.1.smithi150.stdout:6/531: dread d2/d23/d2e/f43 [0,4194304] 0 2023-12-05T09:57:35.207 INFO:tasks.workunit.client.1.smithi150.stdout:6/532: stat d2/d23/d3b/d83/f71 0 2023-12-05T09:57:35.212 INFO:tasks.workunit.client.1.smithi150.stdout:3/580: read d6/d22/f31 [3898784,76189] 0 2023-12-05T09:57:35.213 INFO:tasks.workunit.client.1.smithi150.stdout:7/581: link d2/db/d17/d88/cc4 d2/db/d30/cc7 0 2023-12-05T09:57:35.213 INFO:tasks.workunit.client.1.smithi150.stdout:7/582: fdatasync d2/f12 0 2023-12-05T09:57:35.213 INFO:tasks.workunit.client.1.smithi150.stdout:6/533: link c1 d2/d23/d2e/d93/d97/cb2 0 2023-12-05T09:57:35.213 INFO:tasks.workunit.client.1.smithi150.stdout:0/598: dwrite d5/d11/d32/fd6 [0,4194304] 0 2023-12-05T09:57:35.214 INFO:tasks.workunit.client.0.smithi100.stdout:0/504: dread da/f11 [0,4194304] 0 2023-12-05T09:57:35.215 INFO:tasks.workunit.client.0.smithi100.stdout:2/675: dwrite d7/da/d18/d21/d4d/fa0 [0,4194304] 0 2023-12-05T09:57:35.219 INFO:tasks.workunit.client.0.smithi100.stdout:8/487: getdents d0/d35/d63 0 2023-12-05T09:57:35.220 INFO:tasks.workunit.client.0.smithi100.stdout:7/514: write d3/dc/d11/d13/d1b/d60/f75 [1367937,64973] 0 2023-12-05T09:57:35.220 INFO:tasks.workunit.client.0.smithi100.stdout:7/515: chown d3/dc/d11/d13/de/d18/d3b/d40/d4c/l90 86 1 2023-12-05T09:57:35.220 INFO:tasks.workunit.client.0.smithi100.stdout:7/516: stat d3/dc/d11/d13/de/d18/d3b/d40/d4c/c80 0 2023-12-05T09:57:35.220 INFO:tasks.workunit.client.0.smithi100.stdout:8/488: creat d0/f86 x:0 0 0 2023-12-05T09:57:35.222 INFO:tasks.workunit.client.0.smithi100.stdout:1/517: dwrite db/f1a [4194304,4194304] 0 2023-12-05T09:57:35.222 INFO:tasks.workunit.client.0.smithi100.stdout:1/518: fdatasync db/d12/f1d 0 2023-12-05T09:57:35.223 INFO:tasks.workunit.client.0.smithi100.stdout:3/642: getdents d0/d2/de/d11/d7c 0 2023-12-05T09:57:35.225 INFO:tasks.workunit.client.1.smithi150.stdout:6/534: symlink d2/d23/d2e/d44/da0/lb3 0 2023-12-05T09:57:35.231 INFO:tasks.workunit.client.1.smithi150.stdout:4/491: dwrite d0/d3e/d5b/d80/f4c [0,4194304] 0 2023-12-05T09:57:35.231 INFO:tasks.workunit.client.1.smithi150.stdout:4/492: truncate d0/d3e/d5b/f94 59218 0 2023-12-05T09:57:35.231 INFO:tasks.workunit.client.1.smithi150.stdout:0/599: mknod d5/d11/d71/d99/d9c/d46/cd7 0 2023-12-05T09:57:35.231 INFO:tasks.workunit.client.1.smithi150.stdout:3/581: write d6/d9/f1b [4149307,78285] 0 2023-12-05T09:57:35.233 INFO:tasks.workunit.client.0.smithi100.stdout:0/505: rmdir da/d22/d33/d35/d3a/d8b 39 2023-12-05T09:57:35.233 INFO:tasks.workunit.client.0.smithi100.stdout:0/506: dread - da/d1b/d73/d82/f8a zero size 2023-12-05T09:57:35.233 INFO:tasks.workunit.client.0.smithi100.stdout:4/510: write de/d16/d1e/f2e [3006584,109336] 0 2023-12-05T09:57:35.233 INFO:tasks.workunit.client.0.smithi100.stdout:7/517: getdents d3/db3 0 2023-12-05T09:57:35.234 INFO:tasks.workunit.client.0.smithi100.stdout:7/518: readlink d3/l61 0 2023-12-05T09:57:35.234 INFO:tasks.workunit.client.0.smithi100.stdout:7/519: dread - d3/dc/d11/d13/de/d18/d3b/d40/d4c/d7f/f92 zero size 2023-12-05T09:57:35.234 INFO:tasks.workunit.client.0.smithi100.stdout:7/520: readlink d3/dc/d11/d13/d1b/l36 0 2023-12-05T09:57:35.234 INFO:tasks.workunit.client.0.smithi100.stdout:7/521: write d3/dc/d11/d13/fb1 [341189,75327] 0 2023-12-05T09:57:35.235 INFO:tasks.workunit.client.1.smithi150.stdout:5/562: dwrite d1/d3/fa2 [0,4194304] 0 2023-12-05T09:57:35.235 INFO:tasks.workunit.client.1.smithi150.stdout:6/535: mkdir d2/d23/d3b/db4 0 2023-12-05T09:57:35.235 INFO:tasks.workunit.client.1.smithi150.stdout:6/536: dread - d2/d23/d3b/d46/fa2 zero size 2023-12-05T09:57:35.235 INFO:tasks.workunit.client.0.smithi100.stdout:4/511: write de/d16/d23/d33/d3d/d44/d4e/f87 [260727,89748] 0 2023-12-05T09:57:35.235 INFO:tasks.workunit.client.0.smithi100.stdout:4/512: read de/d16/d1e/f2e [2188430,87888] 0 2023-12-05T09:57:35.235 INFO:tasks.workunit.client.0.smithi100.stdout:9/556: dwrite d7/d1b/d22/d93/f9f [0,4194304] 0 2023-12-05T09:57:35.239 INFO:tasks.workunit.client.1.smithi150.stdout:4/493: mkdir d0/d3e/d6d/d95 0 2023-12-05T09:57:35.240 INFO:tasks.workunit.client.1.smithi150.stdout:4/494: stat d0/d3e/d48/d4d/f57 0 2023-12-05T09:57:35.240 INFO:tasks.workunit.client.1.smithi150.stdout:4/495: read - d0/d3e/f71 zero size 2023-12-05T09:57:35.240 INFO:tasks.workunit.client.1.smithi150.stdout:4/496: stat d0/d3e/d6d/f12 0 2023-12-05T09:57:35.240 INFO:tasks.workunit.client.0.smithi100.stdout:1/519: dread db/d12/d1e/d26/d30/d52/f5f [0,4194304] 0 2023-12-05T09:57:35.240 INFO:tasks.workunit.client.0.smithi100.stdout:1/520: write db/d12/d1e/d26/d30/d52/d84/f87 [774706,70259] 0 2023-12-05T09:57:35.241 INFO:tasks.workunit.client.0.smithi100.stdout:5/560: rmdir d0/d16/d2b 39 2023-12-05T09:57:35.242 INFO:tasks.workunit.client.1.smithi150.stdout:0/600: creat d5/d11/d65/fd8 x:0 0 0 2023-12-05T09:57:35.243 INFO:tasks.workunit.client.0.smithi100.stdout:3/643: truncate d0/fa7 2840104 0 2023-12-05T09:57:35.244 INFO:tasks.workunit.client.0.smithi100.stdout:8/489: dread d0/d12/d13/d16/d42/f75 [0,4194304] 0 2023-12-05T09:57:35.246 INFO:tasks.workunit.client.0.smithi100.stdout:2/676: mknod d7/db4/ce4 0 2023-12-05T09:57:35.248 INFO:tasks.workunit.client.1.smithi150.stdout:7/583: rename d2/d1b/d91 to d2/db/d17/d38/dc8 0 2023-12-05T09:57:35.255 INFO:tasks.workunit.client.0.smithi100.stdout:7/522: unlink d3/dc/d11/d13/de/d18/d3b/d40/d46/d9e/fa7 0 2023-12-05T09:57:35.263 INFO:tasks.workunit.client.1.smithi150.stdout:3/582: unlink d6/d9/f32 0 2023-12-05T09:57:35.266 INFO:tasks.workunit.client.1.smithi150.stdout:5/563: mkdir d1/d3/d6/d26/d9a/dc7 0 2023-12-05T09:57:35.266 INFO:tasks.workunit.client.1.smithi150.stdout:5/564: write d1/d2e/f80 [1338327,66471] 0 2023-12-05T09:57:35.270 INFO:tasks.workunit.client.0.smithi100.stdout:4/513: truncate de/d16/d23/f58 1402336 0 2023-12-05T09:57:35.270 INFO:tasks.workunit.client.0.smithi100.stdout:4/514: read de/f55 [683651,56792] 0 2023-12-05T09:57:35.279 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:35.271+0000 7ffaf5138700 1 -- 172.21.15.100:0/867949935 --> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ffaf006f0c0 con 0x7ffad806af10 2023-12-05T09:57:35.281 INFO:tasks.workunit.client.0.smithi100.stdout:5/561: mknod d0/cc3 0 2023-12-05T09:57:35.292 INFO:teuthology.orchestra.run.smithi100.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-05T09:57:35.292 INFO:teuthology.orchestra.run.smithi100.stdout:alertmanager.smithi100 smithi100 *:9093,9094 starting - - - - 2023-12-05T09:57:35.292 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi100 smithi100 running (7m) 50s ago 7m 7822k - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 6379a3185d48 2023-12-05T09:57:35.292 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi150 smithi150 running (6m) 41s ago 6m 7826k - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 349d37092dbd 2023-12-05T09:57:35.293 INFO:teuthology.orchestra.run.smithi100.stdout:grafana.smithi100 smithi100 *:3000 starting - - - - 2023-12-05T09:57:35.293 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.akmstb smithi100 running (2m) 50s ago 2m 1314M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 6ce55c42c55b 2023-12-05T09:57:35.293 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.sqplhn smithi100 running (3m) 50s ago 3m 13.3M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc c2682d65f0c9 2023-12-05T09:57:35.293 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi150.fcnhsv smithi150 running (2m) 41s ago 2m 12.9M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 1a259762235d 2023-12-05T09:57:35.293 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi150.pcbpxm smithi150 running (2m) 41s ago 2m 12.9M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 27f730f8b9f9 2023-12-05T09:57:35.293 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi100.ehmuhg smithi100 *:9283 running (8m) 50s ago 8m 357M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc a724d569b69c 2023-12-05T09:57:35.293 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi150.zkskag smithi150 *:8443,9283 running (72s) 41s ago 6m 497M - 19.0.0-11-g3fe8d441 56dea28e5206 154eb1df84c7 2023-12-05T09:57:35.293 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi100 smithi100 running (8m) 50s ago 9m 81.5M 2048M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 8e091d6081cc 2023-12-05T09:57:35.293 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi150 smithi150 running (6m) 41s ago 6m 54.9M 2048M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 05fe70420b09 2023-12-05T09:57:35.293 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi100 smithi100 *:9100 starting - - - - 2023-12-05T09:57:35.293 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi150 smithi150 *:9100 running (6m) 41s ago 6m 9512k - 1.5.0 0da6a335fe13 d3babc3b947c 2023-12-05T09:57:35.293 INFO:teuthology.orchestra.run.smithi100.stdout:osd.0 smithi100 running (6m) 50s ago 6m 135M 1618M 17.2.7-109-g1fd3ca3c e139fc5fd9fc c8e64a62cd47 2023-12-05T09:57:35.293 INFO:teuthology.orchestra.run.smithi100.stdout:osd.1 smithi100 running (5m) 50s ago 5m 147M 1618M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 0500895cdfc2 2023-12-05T09:57:35.293 INFO:teuthology.orchestra.run.smithi100.stdout:osd.2 smithi100 running (5m) 50s ago 5m 117M 1618M 17.2.7-109-g1fd3ca3c e139fc5fd9fc f145372c8ccc 2023-12-05T09:57:35.294 INFO:teuthology.orchestra.run.smithi100.stdout:osd.3 smithi150 running (4m) 41s ago 4m 148M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 78137d463d29 2023-12-05T09:57:35.294 INFO:teuthology.orchestra.run.smithi100.stdout:osd.4 smithi150 running (4m) 41s ago 4m 125M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc dfef9accd162 2023-12-05T09:57:35.294 INFO:teuthology.orchestra.run.smithi100.stdout:osd.5 smithi150 running (4m) 41s ago 4m 142M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc d9720b1eae0c 2023-12-05T09:57:35.294 INFO:teuthology.orchestra.run.smithi100.stdout:prometheus.smithi100 smithi100 *:9095 running (6m) 50s ago 7m 47.0M - 2.43.0 a07b618ecd1d 74a355bfd7ab 2023-12-05T09:57:35.294 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:35.294+0000 7ffad77fe700 1 -- 172.21.15.100:0/867949935 <== mgr.24423 v2:172.21.15.150:6828/896268868 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7ffaf006f0c0 con 0x7ffad806af10 2023-12-05T09:57:35.295 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:35.298+0000 7ffaf5138700 1 -- 172.21.15.100:0/867949935 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7ffad806af10 msgr2=0x7ffad806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:57:35.295 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:35.298+0000 7ffaf5138700 1 --2- 172.21.15.100:0/867949935 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7ffad806af10 0x7ffad806d3c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ffaf0113a00 tx=0x7ffae00091a0 comp rx=0 tx=0).stop 2023-12-05T09:57:35.296 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:35.298+0000 7ffaf5138700 1 -- 172.21.15.100:0/867949935 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffaf01141b0 msgr2=0x7ffaf01150a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:57:35.296 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:35.298+0000 7ffaf5138700 1 --2- 172.21.15.100:0/867949935 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffaf01141b0 0x7ffaf01150a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ffae4009360 tx=0x7ffae4009e30 comp rx=0 tx=0).stop 2023-12-05T09:57:35.299 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:35.301+0000 7ffaf5138700 1 -- 172.21.15.100:0/867949935 shutdown_connections 2023-12-05T09:57:35.299 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:35.301+0000 7ffaf5138700 1 --2- 172.21.15.100:0/867949935 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7ffad806af10 0x7ffad806d3c0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:35.299 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:35.301+0000 7ffaf5138700 1 --2- 172.21.15.100:0/867949935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffaf006e6e0 0x7ffaf0113c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:35.299 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:35.301+0000 7ffaf5138700 1 --2- 172.21.15.100:0/867949935 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffaf01141b0 0x7ffaf01150a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:35.299 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:35.301+0000 7ffaf5138700 1 -- 172.21.15.100:0/867949935 >> 172.21.15.100:0/867949935 conn(0x7ffaf0069f70 msgr2=0x7ffaf0106c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:57:35.300 INFO:tasks.workunit.client.1.smithi150.stdout:7/584: link d2/db/d30/d13/d4f/d5a/d5c/f43 d2/db/d30/d53/d90/fc9 0 2023-12-05T09:57:35.300 INFO:tasks.workunit.client.1.smithi150.stdout:7/585: dread - d2/d1b/d5b/d6a/fa6 zero size 2023-12-05T09:57:35.302 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:35.304+0000 7ffaf5138700 1 -- 172.21.15.100:0/867949935 shutdown_connections 2023-12-05T09:57:35.303 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:35.306+0000 7ffaf5138700 1 -- 172.21.15.100:0/867949935 wait complete. 2023-12-05T09:57:35.307 INFO:tasks.workunit.client.1.smithi150.stdout:3/583: mknod d6/d9/daf/cb7 0 2023-12-05T09:57:35.309 INFO:tasks.workunit.client.0.smithi100.stdout:1/521: dread db/ff [0,4194304] 0 2023-12-05T09:57:35.309 INFO:tasks.workunit.client.0.smithi100.stdout:0/507: dwrite da/d1b/f54 [0,4194304] 0 2023-12-05T09:57:35.309 INFO:tasks.workunit.client.0.smithi100.stdout:0/508: fsync da/d1b/f54 0 2023-12-05T09:57:35.314 INFO:tasks.workunit.client.0.smithi100.stdout:0/509: write da/f30 [40793,21319] 0 2023-12-05T09:57:35.321 INFO:tasks.workunit.client.0.smithi100.stdout:7/523: mknod d3/dc/daa/cbc 0 2023-12-05T09:57:35.321 INFO:tasks.workunit.client.1.smithi150.stdout:4/497: dread d0/d3e/d6d/f3f [4194304,4194304] 0 2023-12-05T09:57:35.322 INFO:tasks.workunit.client.0.smithi100.stdout:5/562: mknod d0/d16/d2b/d48/df/d51/cc4 0 2023-12-05T09:57:35.322 INFO:tasks.workunit.client.0.smithi100.stdout:5/563: fdatasync d0/d4/d14/d35/fb3 0 2023-12-05T09:57:35.322 INFO:tasks.workunit.client.0.smithi100.stdout:5/564: fdatasync d0/d1f/d53/f7c 0 2023-12-05T09:57:35.328 INFO:tasks.workunit.client.0.smithi100.stdout:3/644: rmdir d0/d3d/d5c 39 2023-12-05T09:57:35.329 INFO:tasks.workunit.client.0.smithi100.stdout:3/645: fdatasync d0/d2/d33/fae 0 2023-12-05T09:57:35.329 INFO:tasks.workunit.client.0.smithi100.stdout:3/646: chown d0/d4/d3a/d45 61 1 2023-12-05T09:57:35.329 INFO:tasks.workunit.client.0.smithi100.stdout:3/647: stat d0/d2/d62 0 2023-12-05T09:57:35.332 INFO:tasks.workunit.client.1.smithi150.stdout:0/601: dwrite d5/d11/f59 [0,4194304] 0 2023-12-05T09:57:35.336 INFO:tasks.workunit.client.0.smithi100.stdout:9/557: dwrite d7/d20/d69/f72 [0,4194304] 0 2023-12-05T09:57:35.337 INFO:tasks.workunit.client.1.smithi150.stdout:3/584: dread d6/d9/d3d/d87/f89 [0,4194304] 0 2023-12-05T09:57:35.337 INFO:tasks.workunit.client.1.smithi150.stdout:3/585: chown d6/d22/d37/f4a 18788807 1 2023-12-05T09:57:35.337 INFO:tasks.workunit.client.1.smithi150.stdout:3/586: truncate d6/d9/d3d/d56/d53/d51/f6b 4592561 0 2023-12-05T09:57:35.338 INFO:tasks.workunit.client.1.smithi150.stdout:4/498: rename d0/l19 to d0/d3e/l96 0 2023-12-05T09:57:35.338 INFO:tasks.workunit.client.1.smithi150.stdout:4/499: dread - d0/d3e/d5b/d6e/f88 zero size 2023-12-05T09:57:35.339 INFO:tasks.workunit.client.0.smithi100.stdout:5/565: creat d0/d16/d2b/d75/fc5 x:0 0 0 2023-12-05T09:57:35.339 INFO:tasks.workunit.client.0.smithi100.stdout:9/558: creat d7/d1b/da5/fbe x:0 0 0 2023-12-05T09:57:35.339 INFO:tasks.workunit.client.0.smithi100.stdout:9/559: chown d7/f8 5935 1 2023-12-05T09:57:35.339 INFO:tasks.workunit.client.0.smithi100.stdout:9/560: chown d7/ff 439292 1 2023-12-05T09:57:35.339 INFO:tasks.workunit.client.0.smithi100.stdout:3/648: chown d0/d3d/d5c/d5f/d67/f69 578520833 1 2023-12-05T09:57:35.340 INFO:tasks.workunit.client.1.smithi150.stdout:0/602: rmdir d5 39 2023-12-05T09:57:35.341 INFO:tasks.workunit.client.1.smithi150.stdout:3/587: mkdir d6/d22/d37/db8 0 2023-12-05T09:57:35.341 INFO:tasks.workunit.client.0.smithi100.stdout:0/510: dread da/d22/d33/d35/d3a/f83 [0,4194304] 0 2023-12-05T09:57:35.342 INFO:tasks.workunit.client.0.smithi100.stdout:2/677: dwrite d7/da/d18/d21/d86/d92/fbe [0,4194304] 0 2023-12-05T09:57:35.342 INFO:tasks.workunit.client.0.smithi100.stdout:2/678: chown d7/da/d18/d1b/d2c/f70 651798 1 2023-12-05T09:57:35.342 INFO:tasks.workunit.client.0.smithi100.stdout:1/522: dread db/d31/d3a/f4c [0,4194304] 0 2023-12-05T09:57:35.343 INFO:tasks.workunit.client.1.smithi150.stdout:5/565: dwrite d1/d3/d6/d72/f8f [0,4194304] 0 2023-12-05T09:57:35.343 INFO:tasks.workunit.client.0.smithi100.stdout:3/649: symlink d0/d3d/ldb 0 2023-12-05T09:57:35.345 INFO:tasks.workunit.client.0.smithi100.stdout:3/650: read d0/d2/f23 [2776186,15839] 0 2023-12-05T09:57:35.345 INFO:tasks.workunit.client.0.smithi100.stdout:3/651: fdatasync d0/d4/f14 0 2023-12-05T09:57:35.345 INFO:tasks.workunit.client.1.smithi150.stdout:4/500: rename d0/d3e/d5b/d80/d44/f6f to d0/d3e/d48/d4d/f97 0 2023-12-05T09:57:35.347 INFO:tasks.workunit.client.1.smithi150.stdout:0/603: rmdir d5/d11/d71/d99/d9c/d96/dd5/d7f 39 2023-12-05T09:57:35.350 INFO:tasks.workunit.client.1.smithi150.stdout:3/588: mknod d6/d9/d3d/d56/d71/db0/cb9 0 2023-12-05T09:57:35.354 INFO:tasks.workunit.client.1.smithi150.stdout:2/601: sync 2023-12-05T09:57:35.354 INFO:tasks.workunit.client.1.smithi150.stdout:8/632: sync 2023-12-05T09:57:35.354 INFO:tasks.workunit.client.1.smithi150.stdout:2/602: write d0/d3/fb7 [393149,5748] 0 2023-12-05T09:57:35.354 INFO:tasks.workunit.client.1.smithi150.stdout:2/603: fsync d0/f16 0 2023-12-05T09:57:35.355 INFO:tasks.workunit.client.1.smithi150.stdout:4/501: dread d0/d3e/d6d/f37 [0,4194304] 0 2023-12-05T09:57:35.355 INFO:tasks.workunit.client.1.smithi150.stdout:4/502: stat d0/d3e/c40 0 2023-12-05T09:57:35.355 INFO:tasks.workunit.client.1.smithi150.stdout:4/503: fdatasync d0/d3e/f78 0 2023-12-05T09:57:35.358 INFO:tasks.workunit.client.0.smithi100.stdout:8/490: dwrite d0/f5b [0,4194304] 0 2023-12-05T09:57:35.359 INFO:tasks.workunit.client.0.smithi100.stdout:2/679: creat d7/da/d13/d4e/d87/fe5 x:0 0 0 2023-12-05T09:57:35.360 INFO:tasks.workunit.client.0.smithi100.stdout:2/680: chown d7/da/d13/d69/d6e/fd4 4 1 2023-12-05T09:57:35.360 INFO:tasks.workunit.client.0.smithi100.stdout:2/681: chown d7/da/d18/d1b 0 1 2023-12-05T09:57:35.360 INFO:tasks.workunit.client.0.smithi100.stdout:0/511: symlink da/d1b/d73/d82/l95 0 2023-12-05T09:57:35.360 INFO:tasks.workunit.client.0.smithi100.stdout:0/512: fdatasync da/d2a/f62 0 2023-12-05T09:57:35.360 INFO:tasks.workunit.client.0.smithi100.stdout:9/561: write d7/d20/d68/f7e [1779913,111612] 0 2023-12-05T09:57:35.360 INFO:tasks.workunit.client.0.smithi100.stdout:9/562: stat d7/d1b/d22/d51/l1a 0 2023-12-05T09:57:35.366 INFO:tasks.workunit.client.1.smithi150.stdout:7/586: dwrite d2/d1b/d5b/d6a/fa6 [0,4194304] 0 2023-12-05T09:57:35.366 INFO:tasks.workunit.client.1.smithi150.stdout:7/587: write d2/d4/f27 [960804,81434] 0 2023-12-05T09:57:35.366 INFO:tasks.workunit.client.1.smithi150.stdout:5/566: mknod d1/d3/d6/d26/d9a/dc7/cc8 0 2023-12-05T09:57:35.370 INFO:tasks.workunit.client.0.smithi100.stdout:4/515: dwrite f1 [4194304,4194304] 0 2023-12-05T09:57:35.370 INFO:tasks.workunit.client.0.smithi100.stdout:1/523: readlink db/l1f 0 2023-12-05T09:57:35.370 INFO:tasks.workunit.client.0.smithi100.stdout:1/524: chown db/d12/d1e/d26/d30/f83 83276 1 2023-12-05T09:57:35.370 INFO:tasks.workunit.client.0.smithi100.stdout:1/525: truncate db/d12/f75 1362460 0 2023-12-05T09:57:35.370 INFO:tasks.workunit.client.0.smithi100.stdout:3/652: creat d0/d2/de/d11/d7c/dd0/fdc x:0 0 0 2023-12-05T09:57:35.370 INFO:tasks.workunit.client.0.smithi100.stdout:1/526: creat db/d12/d1e/fa2 x:0 0 0 2023-12-05T09:57:35.370 INFO:tasks.workunit.client.0.smithi100.stdout:7/524: write d3/dc/d11/d13/de/d18/d3b/d40/d46/f95 [2073983,11152] 0 2023-12-05T09:57:35.370 INFO:tasks.workunit.client.0.smithi100.stdout:3/653: write d0/d4/f4a [2063391,69905] 0 2023-12-05T09:57:35.370 INFO:tasks.workunit.client.0.smithi100.stdout:3/654: stat d0/d2/de/d11/d7c/fb6 0 2023-12-05T09:57:35.370 INFO:tasks.workunit.client.0.smithi100.stdout:3/655: creat d0/d2/d62/fdd x:0 0 0 2023-12-05T09:57:35.370 INFO:tasks.workunit.client.0.smithi100.stdout:3/656: fdatasync d0/d2/de/d11/fad 0 2023-12-05T09:57:35.371 INFO:tasks.workunit.client.0.smithi100.stdout:3/657: readlink d0/d2/de/d11/db5/lcb 0 2023-12-05T09:57:35.371 INFO:tasks.workunit.client.0.smithi100.stdout:3/658: write d0/d2/f37 [693291,29012] 0 2023-12-05T09:57:35.371 INFO:tasks.workunit.client.0.smithi100.stdout:3/659: write d0/d2/d62/f95 [341976,115814] 0 2023-12-05T09:57:35.372 INFO:tasks.workunit.client.0.smithi100.stdout:2/682: dread d7/da/f8a [0,4194304] 0 2023-12-05T09:57:35.372 INFO:tasks.workunit.client.1.smithi150.stdout:0/604: rename d5/f41 to d5/d11/d16/fd9 0 2023-12-05T09:57:35.376 INFO:tasks.workunit.client.0.smithi100.stdout:8/491: symlink d0/d12/l87 0 2023-12-05T09:57:35.376 INFO:tasks.workunit.client.0.smithi100.stdout:8/492: creat d0/d12/d13/d16/d42/d43/f88 x:0 0 0 2023-12-05T09:57:35.376 INFO:tasks.workunit.client.1.smithi150.stdout:3/589: mknod d6/d9/d43/cba 0 2023-12-05T09:57:35.379 INFO:tasks.workunit.client.0.smithi100.stdout:0/513: symlink da/d1b/d6b/d78/l96 0 2023-12-05T09:57:35.379 INFO:tasks.workunit.client.0.smithi100.stdout:0/514: creat da/d2a/d45/f97 x:0 0 0 2023-12-05T09:57:35.380 INFO:tasks.workunit.client.1.smithi150.stdout:0/605: dread d5/d11/f26 [0,4194304] 0 2023-12-05T09:57:35.383 INFO:tasks.workunit.client.1.smithi150.stdout:8/633: symlink d0/d41/d49/d1b/d24/lc7 0 2023-12-05T09:57:35.383 INFO:tasks.workunit.client.1.smithi150.stdout:8/634: truncate d0/d41/d49/d1b/d24/d38/d62/fb9 1264032 0 2023-12-05T09:57:35.386 INFO:tasks.workunit.client.1.smithi150.stdout:1/557: sync 2023-12-05T09:57:35.390 INFO:tasks.workunit.client.0.smithi100.stdout:9/563: unlink d7/d1b/d22/f38 0 2023-12-05T09:57:35.390 INFO:tasks.workunit.client.0.smithi100.stdout:9/564: readlink d7/d1b/d22/l82 0 2023-12-05T09:57:35.393 INFO:tasks.workunit.client.1.smithi150.stdout:2/604: link d0/d3/d11/d1d/l4e d0/d3/d21/d4d/ld3 0 2023-12-05T09:57:35.396 INFO:tasks.workunit.client.0.smithi100.stdout:5/566: dwrite d0/d16/d2b/d48/f95 [0,4194304] 0 2023-12-05T09:57:35.398 INFO:tasks.workunit.client.1.smithi150.stdout:4/504: creat d0/d3e/d5b/d80/d44/f98 x:0 0 0 2023-12-05T09:57:35.399 INFO:tasks.workunit.client.0.smithi100.stdout:4/516: creat de/d16/d23/d33/fa0 x:0 0 0 2023-12-05T09:57:35.404 INFO:tasks.workunit.client.0.smithi100.stdout:7/525: mkdir d3/dc/d11/d13/de/d2d/d47/dbd 0 2023-12-05T09:57:35.407 INFO:tasks.workunit.client.1.smithi150.stdout:7/588: mknod d2/db/d30/d18/d1a/d1e/d2b/cca 0 2023-12-05T09:57:35.410 INFO:tasks.workunit.client.0.smithi100.stdout:1/527: dwrite db/d31/d3a/f5b [4194304,4194304] 0 2023-12-05T09:57:35.413 INFO:tasks.workunit.client.0.smithi100.stdout:2/683: mkdir d7/da/da7/dd6/de6 0 2023-12-05T09:57:35.418 INFO:tasks.workunit.client.1.smithi150.stdout:3/590: rmdir d6/d22/da4 0 2023-12-05T09:57:35.420 INFO:tasks.workunit.client.0.smithi100.stdout:8/493: symlink d0/d12/d13/d16/d22/d72/l89 0 2023-12-05T09:57:35.420 INFO:tasks.workunit.client.1.smithi150.stdout:6/537: sync 2023-12-05T09:57:35.420 INFO:tasks.workunit.client.1.smithi150.stdout:9/526: sync 2023-12-05T09:57:35.421 INFO:tasks.workunit.client.0.smithi100.stdout:8/494: creat d0/d35/f8a x:0 0 0 2023-12-05T09:57:35.425 INFO:tasks.workunit.client.1.smithi150.stdout:0/606: mkdir d5/d11/d71/dda 0 2023-12-05T09:57:35.431 INFO:tasks.workunit.client.1.smithi150.stdout:1/558: dwrite d6/d47/d4c/d7c/fbb [0,4194304] 0 2023-12-05T09:57:35.431 INFO:tasks.workunit.client.1.smithi150.stdout:1/559: write d6/d8/d54/d94/fb9 [295253,73374] 0 2023-12-05T09:57:35.431 INFO:tasks.workunit.client.1.smithi150.stdout:1/560: fdatasync d6/d47/d4c/d60/fc8 0 2023-12-05T09:57:35.432 INFO:tasks.workunit.client.1.smithi150.stdout:1/561: fsync d6/d8/db/f5b 0 2023-12-05T09:57:35.432 INFO:tasks.workunit.client.0.smithi100.stdout:1/528: dread db/d12/d1e/f38 [0,4194304] 0 2023-12-05T09:57:35.432 INFO:tasks.workunit.client.0.smithi100.stdout:1/529: readlink db/d12/d61/l69 0 2023-12-05T09:57:35.435 INFO:tasks.workunit.client.0.smithi100.stdout:0/515: mknod da/d22/d33/d35/d3a/c98 0 2023-12-05T09:57:35.437 INFO:tasks.workunit.client.0.smithi100.stdout:9/565: mknod d7/d1b/d22/d2a/d56/d2e/cbf 0 2023-12-05T09:57:35.437 INFO:tasks.workunit.client.1.smithi150.stdout:8/635: truncate d0/d41/d49/d1b/f1d 2996702 0 2023-12-05T09:57:35.437 INFO:tasks.workunit.client.1.smithi150.stdout:4/505: chown d0/l33 60798 1 2023-12-05T09:57:35.437 INFO:tasks.workunit.client.1.smithi150.stdout:4/506: write d0/d3e/f6b [667205,26389] 0 2023-12-05T09:57:35.437 INFO:tasks.workunit.client.1.smithi150.stdout:5/567: rmdir d1/d64/d31 39 2023-12-05T09:57:35.437 INFO:tasks.workunit.client.1.smithi150.stdout:5/568: write d1/d3/fa2 [5205067,45056] 0 2023-12-05T09:57:35.444 INFO:tasks.workunit.client.0.smithi100.stdout:4/517: mknod de/d38/ca1 0 2023-12-05T09:57:35.448 INFO:tasks.workunit.client.0.smithi100.stdout:7/526: creat d3/dc/d11/fbe x:0 0 0 2023-12-05T09:57:35.452 INFO:tasks.workunit.client.1.smithi150.stdout:6/538: rename d2/d23/d3b/d64/d7a/d5d/d6b/l76 to d2/d23/d3b/db4/lb5 0 2023-12-05T09:57:35.452 INFO:tasks.workunit.client.1.smithi150.stdout:0/607: mkdir d5/d11/d71/ddb 0 2023-12-05T09:57:35.453 INFO:tasks.workunit.client.1.smithi150.stdout:1/562: dread d6/fa0 [0,4194304] 0 2023-12-05T09:57:35.458 INFO:tasks.workunit.client.1.smithi150.stdout:8/636: symlink d0/d41/d49/d1b/d24/d34/dbc/lc8 0 2023-12-05T09:57:35.459 INFO:tasks.workunit.client.1.smithi150.stdout:8/637: chown d0/d41/d49/d1b/d24/d38/f78 24943683 1 2023-12-05T09:57:35.459 INFO:tasks.workunit.client.1.smithi150.stdout:8/638: write d0/d41/d49/d1b/d24/d38/d62/f68 [257724,82040] 0 2023-12-05T09:57:35.460 INFO:tasks.workunit.client.1.smithi150.stdout:4/507: creat d0/d3e/d48/d4d/f99 x:0 0 0 2023-12-05T09:57:35.467 INFO:tasks.workunit.client.1.smithi150.stdout:7/589: dread d2/d1b/d5b/f9c [0,4194304] 0 2023-12-05T09:57:35.467 INFO:tasks.workunit.client.1.smithi150.stdout:5/569: symlink d1/d3/d6/d1b/lc9 0 2023-12-05T09:57:35.467 INFO:tasks.workunit.client.1.smithi150.stdout:1/563: symlink d6/d8/db/de/lc9 0 2023-12-05T09:57:35.467 INFO:tasks.workunit.client.1.smithi150.stdout:1/564: chown d6/d38/da1/fa6 13 1 2023-12-05T09:57:35.468 INFO:tasks.workunit.client.1.smithi150.stdout:1/565: truncate d6/d3c/f7e 5199897 0 2023-12-05T09:57:35.468 INFO:tasks.workunit.client.1.smithi150.stdout:2/605: dwrite d0/d3/d5/d36/d86/fce [0,4194304] 0 2023-12-05T09:57:35.468 INFO:tasks.workunit.client.1.smithi150.stdout:7/590: mkdir d2/db/d30/d13/d4f/d5a/d5c/dcb 0 2023-12-05T09:57:35.470 INFO:tasks.workunit.client.0.smithi100.stdout:2/684: mknod d7/da/d18/d1b/d2c/d3f/d46/dc8/ce7 0 2023-12-05T09:57:35.473 INFO:tasks.workunit.client.1.smithi150.stdout:0/608: dread d5/d11/d71/d99/d9c/fc0 [0,4194304] 0 2023-12-05T09:57:35.481 INFO:tasks.workunit.client.0.smithi100.stdout:0/516: symlink da/d1b/d6b/d78/l99 0 2023-12-05T09:57:35.481 INFO:tasks.workunit.client.1.smithi150.stdout:2/606: getdents d0 0 2023-12-05T09:57:35.486 INFO:tasks.workunit.client.0.smithi100.stdout:7/527: dread d3/dc/d11/d13/f91 [0,4194304] 0 2023-12-05T09:57:35.499 INFO:tasks.workunit.client.1.smithi150.stdout:0/609: symlink d5/d11/d71/d5f/ldc 0 2023-12-05T09:57:35.499 INFO:tasks.workunit.client.1.smithi150.stdout:0/610: truncate d5/d11/d71/d99/d9c/d96/dd5/d7f/fac 1475963 0 2023-12-05T09:57:35.505 INFO:tasks.workunit.client.0.smithi100.stdout:2/685: write d7/da/dc/f7a [856150,107030] 0 2023-12-05T09:57:35.506 INFO:tasks.workunit.client.0.smithi100.stdout:3/660: rename d0/d3d/d5c/d5f/d67/c91 to d0/d3d/d5c/d5f/d67/da4/cde 0 2023-12-05T09:57:35.506 INFO:tasks.workunit.client.0.smithi100.stdout:3/661: chown d0/d2/de/f47 6112 1 2023-12-05T09:57:35.506 INFO:tasks.workunit.client.0.smithi100.stdout:2/686: readlink d7/da/d18/d21/d4d/l7d 0 2023-12-05T09:57:35.506 INFO:tasks.workunit.client.0.smithi100.stdout:9/566: stat d7/d1b/d22/d51/d32/c3f 0 2023-12-05T09:57:35.510 INFO:tasks.workunit.client.1.smithi150.stdout:2/607: truncate d0/d3/f14 672330 0 2023-12-05T09:57:35.513 INFO:tasks.workunit.client.0.smithi100.stdout:2/687: mknod d7/da/da7/dd6/ce8 0 2023-12-05T09:57:35.514 INFO:tasks.workunit.client.0.smithi100.stdout:4/518: symlink de/d38/d5d/la2 0 2023-12-05T09:57:35.514 INFO:tasks.workunit.client.0.smithi100.stdout:4/519: fsync de/d16/d23/d36/f56 0 2023-12-05T09:57:35.519 INFO:tasks.workunit.client.1.smithi150.stdout:7/591: getdents d2/db 0 2023-12-05T09:57:35.522 INFO:tasks.workunit.client.0.smithi100.stdout:2/688: symlink d7/da/d13/d69/d6e/d71/le9 0 2023-12-05T09:57:35.523 INFO:tasks.workunit.client.0.smithi100.stdout:2/689: write d7/da/fac [2247383,114615] 0 2023-12-05T09:57:35.523 INFO:tasks.workunit.client.0.smithi100.stdout:2/690: creat d7/da/d1a/fea x:0 0 0 2023-12-05T09:57:35.523 INFO:tasks.workunit.client.0.smithi100.stdout:2/691: creat d7/da/d18/d1b/d2c/d3f/d98/feb x:0 0 0 2023-12-05T09:57:35.529 INFO:tasks.workunit.client.1.smithi150.stdout:0/611: rmdir d5/d11 39 2023-12-05T09:57:35.530 INFO:tasks.workunit.client.1.smithi150.stdout:2/608: unlink d0/d3/d5/d10/d3d/da1/fc4 0 2023-12-05T09:57:35.530 INFO:tasks.workunit.client.1.smithi150.stdout:0/612: creat d5/d11/d32/fdd x:0 0 0 2023-12-05T09:57:35.530 INFO:tasks.workunit.client.1.smithi150.stdout:0/613: chown d5/d11/d32/d57/l5e 55245 1 2023-12-05T09:57:35.531 INFO:tasks.workunit.client.1.smithi150.stdout:9/527: dwrite d3/d9/dc/fa2 [0,4194304] 0 2023-12-05T09:57:35.531 INFO:tasks.workunit.client.1.smithi150.stdout:8/639: dread d0/d41/d49/d1b/d24/d38/d62/f65 [0,4194304] 0 2023-12-05T09:57:35.531 INFO:tasks.workunit.client.1.smithi150.stdout:3/591: dwrite d6/d9/d3d/d56/f7d [0,4194304] 0 2023-12-05T09:57:35.532 INFO:tasks.workunit.client.1.smithi150.stdout:8/640: dread - d0/d41/d49/d1b/d24/d2e/f95 zero size 2023-12-05T09:57:35.532 INFO:tasks.workunit.client.0.smithi100.stdout:6/916: sync 2023-12-05T09:57:35.532 INFO:tasks.workunit.client.0.smithi100.stdout:6/917: fdatasync d7/d11/d1a/db7/d11f/f11b 0 2023-12-05T09:57:35.533 INFO:tasks.workunit.client.0.smithi100.stdout:6/918: dread - d7/dcc/df0/d100/fff zero size 2023-12-05T09:57:35.534 INFO:tasks.workunit.client.1.smithi150.stdout:7/592: rename d2/db/d30/d18/d1a/d1e/f21 to d2/db/d30/d53/fcc 0 2023-12-05T09:57:35.538 INFO:tasks.workunit.client.0.smithi100.stdout:3/662: fsync d0/d2/d62/f95 0 2023-12-05T09:57:35.538 INFO:tasks.workunit.client.0.smithi100.stdout:3/663: creat d0/d4/d3a/d45/fdf x:0 0 0 2023-12-05T09:57:35.543 INFO:tasks.workunit.client.1.smithi150.stdout:2/609: rename d0/d3/d5/d13/f69 to d0/d3/d5/d13/fd4 0 2023-12-05T09:57:35.543 INFO:tasks.workunit.client.1.smithi150.stdout:2/610: readlink d0/d3/d21/d4d/l87 0 2023-12-05T09:57:35.543 INFO:tasks.workunit.client.1.smithi150.stdout:2/611: chown d0/d3/fb2 8464996 1 2023-12-05T09:57:35.543 INFO:tasks.workunit.client.1.smithi150.stdout:0/614: truncate d5/d11/d71/f30 3749413 0 2023-12-05T09:57:35.548 INFO:tasks.workunit.client.0.smithi100.stdout:8/495: dwrite d0/d35/f70 [0,4194304] 0 2023-12-05T09:57:35.549 INFO:tasks.workunit.client.0.smithi100.stdout:5/567: dwrite d0/d1b/d4d/d8e/d96/dc1/dae/fb2 [0,4194304] 0 2023-12-05T09:57:35.563 INFO:tasks.workunit.client.0.smithi100.stdout:3/664: rename d0/d3d/d5c/d5f/d67/f69 to d0/d2/fe0 0 2023-12-05T09:57:35.563 INFO:tasks.workunit.client.0.smithi100.stdout:3/665: chown d0/d3d/d5c/d6f/d7f/d87/f9a 698008 1 2023-12-05T09:57:35.563 INFO:tasks.workunit.client.0.smithi100.stdout:2/692: dread d7/da/d13/d69/d6e/d71/f9a [0,4194304] 0 2023-12-05T09:57:35.565 INFO:tasks.workunit.client.1.smithi150.stdout:9/528: mkdir d3/d9/d67/dac 0 2023-12-05T09:57:35.566 INFO:tasks.workunit.client.1.smithi150.stdout:9/529: fsync d3/d9/dc/d1f/fa1 0 2023-12-05T09:57:35.568 INFO:tasks.workunit.client.0.smithi100.stdout:6/919: dread d7/d27/d35/d5a/fe6 [0,4194304] 0 2023-12-05T09:57:35.574 INFO:tasks.workunit.client.1.smithi150.stdout:1/566: dwrite d6/d8/db/de/f22 [4194304,4194304] 0 2023-12-05T09:57:35.580 INFO:tasks.workunit.client.1.smithi150.stdout:3/592: mknod d6/d25/d28/cbb 0 2023-12-05T09:57:35.584 INFO:tasks.workunit.client.0.smithi100.stdout:5/568: dread d0/d1b/f32 [0,4194304] 0 2023-12-05T09:57:35.586 INFO:tasks.workunit.client.1.smithi150.stdout:7/593: symlink d2/d1b/lcd 0 2023-12-05T09:57:35.587 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:35.588+0000 7f1733675700 1 -- 172.21.15.100:0/1048730337 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f172c071bc0 msgr2=0x7f172c070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:57:35.587 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:35.588+0000 7f1733675700 1 --2- 172.21.15.100:0/1048730337 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f172c071bc0 0x7f172c070030 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1720004880 tx=0x7f1720009e30 comp rx=0 tx=0).stop 2023-12-05T09:57:35.587 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:35.588+0000 7f1733675700 1 -- 172.21.15.100:0/1048730337 shutdown_connections 2023-12-05T09:57:35.587 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:35.588+0000 7f1733675700 1 --2- 172.21.15.100:0/1048730337 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f172c070570 0x7f172c0709c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:35.587 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:35.588+0000 7f1733675700 1 --2- 172.21.15.100:0/1048730337 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f172c071bc0 0x7f172c070030 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:35.587 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:35.588+0000 7f1733675700 1 -- 172.21.15.100:0/1048730337 >> 172.21.15.100:0/1048730337 conn(0x7f172c0f82d0 msgr2=0x7f172c0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:57:35.587 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:35.588+0000 7f1733675700 1 -- 172.21.15.100:0/1048730337 shutdown_connections 2023-12-05T09:57:35.587 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:35.588+0000 7f1733675700 1 -- 172.21.15.100:0/1048730337 wait complete. 2023-12-05T09:57:35.589 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:35.590+0000 7f1733675700 1 Processor -- start 2023-12-05T09:57:35.589 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:35.590+0000 7f1733675700 1 -- start start 2023-12-05T09:57:35.589 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:35.591+0000 7f1733675700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f172c070570 0x7f172c113b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:57:35.589 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:35.591+0000 7f1733675700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f172c071bc0 0x7f172c114080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:57:35.589 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:35.591+0000 7f1731411700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f172c070570 0x7f172c113b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:57:35.590 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:35.591+0000 7f1733675700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f172c114680 con 0x7f172c070570 2023-12-05T09:57:35.590 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:35.591+0000 7f1733675700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f172c114f20 con 0x7f172c071bc0 2023-12-05T09:57:35.590 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:35.592+0000 7f1731411700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f172c070570 0x7f172c113b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42476/0 (socket says 172.21.15.100:42476) 2023-12-05T09:57:35.590 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:35.592+0000 7f1731411700 1 -- 172.21.15.100:0/1446072827 learned_addr learned my addr 172.21.15.100:0/1446072827 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:57:35.590 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:35.592+0000 7f1731411700 1 -- 172.21.15.100:0/1446072827 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f172c071bc0 msgr2=0x7f172c114080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:57:35.590 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:35.592+0000 7f1731411700 1 --2- 172.21.15.100:0/1446072827 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f172c071bc0 0x7f172c114080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:35.590 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:35.592+0000 7f1731411700 1 -- 172.21.15.100:0/1446072827 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1720005040 con 0x7f172c070570 2023-12-05T09:57:35.590 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:35.592+0000 7f1731411700 1 --2- 172.21.15.100:0/1446072827 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f172c070570 0x7f172c113b40 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f1720000c00 tx=0x7f1720009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:57:35.592 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:35.595+0000 7f171dffb700 1 -- 172.21.15.100:0/1446072827 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f172000e040 con 0x7f172c070570 2023-12-05T09:57:35.593 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:35.595+0000 7f1733675700 1 -- 172.21.15.100:0/1446072827 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f172c1151a0 con 0x7f172c070570 2023-12-05T09:57:35.593 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:35.595+0000 7f171dffb700 1 -- 172.21.15.100:0/1446072827 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1720014d10 con 0x7f172c070570 2023-12-05T09:57:35.593 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:35.595+0000 7f171dffb700 1 -- 172.21.15.100:0/1446072827 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1720012600 con 0x7f172c070570 2023-12-05T09:57:35.593 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:35.595+0000 7f1733675700 1 -- 172.21.15.100:0/1446072827 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f172c115680 con 0x7f172c070570 2023-12-05T09:57:35.593 INFO:tasks.workunit.client.1.smithi150.stdout:2/612: getdents d0/d3/d27 0 2023-12-05T09:57:35.594 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:35.597+0000 7f1733675700 1 -- 172.21.15.100:0/1446072827 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f172c04bb80 con 0x7f172c070570 2023-12-05T09:57:35.598 INFO:tasks.workunit.client.0.smithi100.stdout:8/496: symlink d0/d12/d13/d16/d42/l8b 0 2023-12-05T09:57:35.600 INFO:tasks.workunit.client.1.smithi150.stdout:0/615: rename d5/d11/d71/d99/cb0 to d5/d11/d71/d5f/d77/d87/cde 0 2023-12-05T09:57:35.601 INFO:tasks.workunit.client.0.smithi100.stdout:3/666: symlink d0/d48/le1 0 2023-12-05T09:57:35.601 INFO:tasks.workunit.client.0.smithi100.stdout:3/667: fsync d0/f3b 0 2023-12-05T09:57:35.601 INFO:tasks.workunit.client.0.smithi100.stdout:3/668: readlink d0/d2/de/d11/d58/l60 0 2023-12-05T09:57:35.603 INFO:tasks.workunit.client.0.smithi100.stdout:2/693: chown d7/da/d18/fab 132551 1 2023-12-05T09:57:35.603 INFO:tasks.workunit.client.0.smithi100.stdout:2/694: dread - d7/da/d18/d1b/d2c/d3f/d46/fb6 zero size 2023-12-05T09:57:35.604 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:35.606+0000 7f171dffb700 1 -- 172.21.15.100:0/1446072827 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 25) v1 ==== 88726+0+0 (secure 0 0 0) 0x7f172001ca30 con 0x7f172c070570 2023-12-05T09:57:35.605 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:35.608+0000 7f171dffb700 1 --2- 172.21.15.100:0/1446072827 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7f171806ae90 0x7f171806d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:57:35.607 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:35.608+0000 7f171dffb700 1 -- 172.21.15.100:0/1446072827 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f172008b8b0 con 0x7f172c070570 2023-12-05T09:57:35.607 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:35.609+0000 7f1730c10700 1 --2- 172.21.15.100:0/1446072827 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7f171806ae90 0x7f171806d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:57:35.607 INFO:tasks.workunit.client.1.smithi150.stdout:9/530: truncate d3/d9/dc/f1d 3158883 0 2023-12-05T09:57:35.608 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:35.610+0000 7f1730c10700 1 --2- 172.21.15.100:0/1446072827 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7f171806ae90 0x7f171806d340 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f17280043d0 tx=0x7f1728002330 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:57:35.608 INFO:tasks.workunit.client.0.smithi100.stdout:3/669: symlink d0/d4/d3a/d45/le2 0 2023-12-05T09:57:35.611 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:35.614+0000 7f171dffb700 1 -- 172.21.15.100:0/1446072827 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f1720059660 con 0x7f172c070570 2023-12-05T09:57:35.614 INFO:tasks.workunit.client.1.smithi150.stdout:1/567: mkdir d6/d8/db/d1b/d79/dca 0 2023-12-05T09:57:35.616 INFO:tasks.workunit.client.1.smithi150.stdout:1/568: write d6/d8/d54/f67 [975854,68289] 0 2023-12-05T09:57:35.616 INFO:tasks.workunit.client.1.smithi150.stdout:1/569: stat d6/d38/da1/dc6 0 2023-12-05T09:57:35.617 INFO:tasks.workunit.client.0.smithi100.stdout:2/695: rename d7/da/d18/d1b/c57 to d7/da/d18/d21/d4d/d81/cec 0 2023-12-05T09:57:35.617 INFO:tasks.workunit.client.1.smithi150.stdout:3/593: creat d6/d22/d37/d63/fbc x:0 0 0 2023-12-05T09:57:35.617 INFO:tasks.workunit.client.1.smithi150.stdout:3/594: write d6/d25/d28/d67/f86 [379355,104056] 0 2023-12-05T09:57:35.618 INFO:tasks.workunit.client.0.smithi100.stdout:9/567: dwrite d7/d1b/d22/d93/f9f [0,4194304] 0 2023-12-05T09:57:35.618 INFO:tasks.workunit.client.0.smithi100.stdout:9/568: chown d7/d1b/f1e 370 1 2023-12-05T09:57:35.618 INFO:tasks.workunit.client.0.smithi100.stdout:9/569: readlink d7/d1b/d22/d2a/d56/l34 0 2023-12-05T09:57:35.622 INFO:tasks.workunit.client.0.smithi100.stdout:1/530: dwrite db/d12/d61/d66/f89 [0,4194304] 0 2023-12-05T09:57:35.622 INFO:tasks.workunit.client.0.smithi100.stdout:1/531: creat db/d31/d3a/d4a/fa3 x:0 0 0 2023-12-05T09:57:35.622 INFO:tasks.workunit.client.0.smithi100.stdout:1/532: creat db/d12/d61/d66/d67/fa4 x:0 0 0 2023-12-05T09:57:35.629 INFO:tasks.workunit.client.0.smithi100.stdout:6/920: dread d7/d11/f2c [0,4194304] 0 2023-12-05T09:57:35.630 INFO:tasks.workunit.client.0.smithi100.stdout:3/670: mkdir d0/d2/de/d8d/de3 0 2023-12-05T09:57:35.630 INFO:tasks.workunit.client.0.smithi100.stdout:3/671: write d0/d2/de/d11/db5/fba [609559,47034] 0 2023-12-05T09:57:35.631 INFO:tasks.workunit.client.1.smithi150.stdout:5/570: dwrite d1/d7f/d65/d3b/d6b/f8b [0,4194304] 0 2023-12-05T09:57:35.634 INFO:tasks.workunit.client.0.smithi100.stdout:8/497: read d0/d12/d13/f6c [1902765,39104] 0 2023-12-05T09:57:35.634 INFO:tasks.workunit.client.0.smithi100.stdout:8/498: dread - d0/d12/d13/d16/d42/d43/f88 zero size 2023-12-05T09:57:35.634 INFO:tasks.workunit.client.0.smithi100.stdout:8/499: chown d0/lf 26 1 2023-12-05T09:57:35.638 INFO:tasks.workunit.client.1.smithi150.stdout:0/616: creat d5/d11/d71/d99/d9c/d3b/dad/fdf x:0 0 0 2023-12-05T09:57:35.638 INFO:tasks.workunit.client.1.smithi150.stdout:0/617: write d5/d11/d71/d99/d9c/d46/d80/f86 [4342224,110538] 0 2023-12-05T09:57:35.638 INFO:tasks.workunit.client.1.smithi150.stdout:0/618: write d5/d11/d32/d57/fa2 [572227,92802] 0 2023-12-05T09:57:35.641 INFO:tasks.workunit.client.1.smithi150.stdout:5/571: dread d1/d7f/d65/d3b/d37/faf [0,4194304] 0 2023-12-05T09:57:35.642 INFO:tasks.workunit.client.1.smithi150.stdout:5/572: write d1/d7f/d65/d3b/d6b/fb5 [1043529,70917] 0 2023-12-05T09:57:35.642 INFO:tasks.workunit.client.1.smithi150.stdout:5/573: write d1/d7f/d65/d3b/d37/faf [1010909,101439] 0 2023-12-05T09:57:35.649 INFO:tasks.workunit.client.1.smithi150.stdout:9/531: mkdir d3/d9/d67/dac/dad 0 2023-12-05T09:57:35.649 INFO:tasks.workunit.client.1.smithi150.stdout:9/532: rename d3/d9 to d3/d9/d58/d90/dae 22 2023-12-05T09:57:35.650 INFO:tasks.workunit.client.0.smithi100.stdout:0/517: dwrite da/f2d [4194304,4194304] 0 2023-12-05T09:57:35.650 INFO:tasks.workunit.client.0.smithi100.stdout:2/696: rename d7/da/d18/d1b/c39 to d7/da/d18/d21/d86/d92/ced 0 2023-12-05T09:57:35.650 INFO:tasks.workunit.client.0.smithi100.stdout:2/697: dread - d7/da/d1a/fb7 zero size 2023-12-05T09:57:35.650 INFO:tasks.workunit.client.0.smithi100.stdout:5/569: write d0/d16/d2b/f3a [1220903,8672] 0 2023-12-05T09:57:35.650 INFO:tasks.workunit.client.0.smithi100.stdout:5/570: fdatasync d0/d1f/d25/f63 0 2023-12-05T09:57:35.650 INFO:tasks.workunit.client.0.smithi100.stdout:5/571: dread - d0/d1b/d4d/d8e/d96/dc1/dae/faf zero size 2023-12-05T09:57:35.651 INFO:tasks.workunit.client.1.smithi150.stdout:8/641: dwrite d0/f99 [0,4194304] 0 2023-12-05T09:57:35.651 INFO:tasks.workunit.client.1.smithi150.stdout:3/595: creat d6/d9/fbd x:0 0 0 2023-12-05T09:57:35.652 INFO:tasks.workunit.client.1.smithi150.stdout:3/596: fdatasync d6/d25/d28/d9a/fa9 0 2023-12-05T09:57:35.652 INFO:tasks.workunit.client.1.smithi150.stdout:3/597: readlink d6/d9/d43/d47/l45 0 2023-12-05T09:57:35.653 INFO:tasks.workunit.client.1.smithi150.stdout:2/613: dwrite d0/d3/d5/d10/f19 [0,4194304] 0 2023-12-05T09:57:35.653 INFO:tasks.workunit.client.1.smithi150.stdout:5/574: mkdir d1/d3/d6/d26/dca 0 2023-12-05T09:57:35.654 INFO:tasks.workunit.client.0.smithi100.stdout:6/921: truncate d7/d11/f8f 3291935 0 2023-12-05T09:57:35.654 INFO:tasks.workunit.client.1.smithi150.stdout:9/533: mkdir d3/d9/d26/daf 0 2023-12-05T09:57:35.656 INFO:tasks.workunit.client.0.smithi100.stdout:3/672: creat d0/d2/de/d11/d58/fe4 x:0 0 0 2023-12-05T09:57:35.661 INFO:tasks.workunit.client.1.smithi150.stdout:1/570: rmdir d6/d8/d54/d94 39 2023-12-05T09:57:35.661 INFO:tasks.workunit.client.0.smithi100.stdout:8/500: creat d0/d12/d13/d16/d42/f8c x:0 0 0 2023-12-05T09:57:35.665 INFO:tasks.workunit.client.0.smithi100.stdout:7/528: dwrite d3/dc/d11/d13/de/d2d/d42/f83 [0,4194304] 0 2023-12-05T09:57:35.666 INFO:tasks.workunit.client.0.smithi100.stdout:6/922: dread d7/d27/d35/d5a/f70 [0,4194304] 0 2023-12-05T09:57:35.666 INFO:tasks.workunit.client.0.smithi100.stdout:6/923: stat d7/f89 0 2023-12-05T09:57:35.672 INFO:tasks.workunit.client.1.smithi150.stdout:7/594: dwrite d2/d9d/da0/fb9 [0,4194304] 0 2023-12-05T09:57:35.672 INFO:tasks.workunit.client.0.smithi100.stdout:0/518: mknod da/d22/d33/d7f/c9a 0 2023-12-05T09:57:35.675 INFO:tasks.workunit.client.1.smithi150.stdout:2/614: write d0/da3/fbc [3469262,96573] 0 2023-12-05T09:57:35.675 INFO:tasks.workunit.client.1.smithi150.stdout:2/615: write d0/d3/d5/d22/f7f [427181,77469] 0 2023-12-05T09:57:35.679 INFO:tasks.workunit.client.0.smithi100.stdout:5/572: dread d0/d4/d14/d35/fb3 [0,4194304] 0 2023-12-05T09:57:35.680 INFO:tasks.workunit.client.0.smithi100.stdout:1/533: rename db/d12/d1e/c71 to db/d12/ca5 0 2023-12-05T09:57:35.687 INFO:tasks.workunit.client.0.smithi100.stdout:9/570: dwrite d7/f9 [0,4194304] 0 2023-12-05T09:57:35.701 INFO:tasks.workunit.client.0.smithi100.stdout:0/519: dread da/d22/f3b [0,4194304] 0 2023-12-05T09:57:35.701 INFO:tasks.workunit.client.0.smithi100.stdout:0/520: write da/d1b/d36/f4f [3343270,89487] 0 2023-12-05T09:57:35.701 INFO:tasks.workunit.client.0.smithi100.stdout:0/521: truncate da/d1b/d73/d82/f8a 108772 0 2023-12-05T09:57:35.704 INFO:tasks.workunit.client.0.smithi100.stdout:0/522: write da/d1b/f66 [1107291,115424] 0 2023-12-05T09:57:35.704 INFO:tasks.workunit.client.0.smithi100.stdout:0/523: readlink da/d1b/l1c 0 2023-12-05T09:57:35.704 INFO:tasks.workunit.client.0.smithi100.stdout:3/673: creat d0/d2/de/d11/d58/db0/fe5 x:0 0 0 2023-12-05T09:57:35.714 INFO:tasks.workunit.client.0.smithi100.stdout:2/698: link d7/da/d18/d21/d86/d92/ced d7/da/d13/cee 0 2023-12-05T09:57:35.724 INFO:tasks.workunit.client.1.smithi150.stdout:7/595: dwrite d2/db/f99 [0,4194304] 0 2023-12-05T09:57:35.731 INFO:tasks.workunit.client.0.smithi100.stdout:7/529: link d3/dc/d11/d33/f7b d3/dc/d11/d33/fbf 0 2023-12-05T09:57:35.733 INFO:tasks.workunit.client.1.smithi150.stdout:8/642: creat d0/d41/d49/d1b/d24/d34/da2/fc9 x:0 0 0 2023-12-05T09:57:35.735 INFO:tasks.workunit.client.1.smithi150.stdout:2/616: dwrite d0/fc5 [0,4194304] 0 2023-12-05T09:57:35.736 INFO:tasks.workunit.client.0.smithi100.stdout:6/924: symlink d7/d11/d1a/db7/df7/d126/d115/l129 0 2023-12-05T09:57:35.738 INFO:tasks.workunit.client.1.smithi150.stdout:3/598: creat d6/d22/d37/db8/fbe x:0 0 0 2023-12-05T09:57:35.742 INFO:tasks.workunit.client.1.smithi150.stdout:5/575: truncate d1/d7f/d65/d3b/d6b/f91 2371840 0 2023-12-05T09:57:35.744 INFO:tasks.workunit.client.0.smithi100.stdout:8/501: dwrite d0/d35/f39 [0,4194304] 0 2023-12-05T09:57:35.745 INFO:tasks.workunit.client.0.smithi100.stdout:9/571: unlink d7/d60/la9 0 2023-12-05T09:57:35.747 INFO:tasks.workunit.client.1.smithi150.stdout:7/596: dread d2/db/d62/f92 [0,4194304] 0 2023-12-05T09:57:35.748 INFO:tasks.workunit.client.1.smithi150.stdout:7/597: fdatasync d2/db/d30/d18/d1a/d1e/d2b/f84 0 2023-12-05T09:57:35.748 INFO:tasks.workunit.client.1.smithi150.stdout:7/598: stat d2/db/d30/d13/d4f/d7e 0 2023-12-05T09:57:35.750 INFO:tasks.workunit.client.0.smithi100.stdout:5/573: dwrite d0/d1f/d25/f63 [0,4194304] 0 2023-12-05T09:57:35.751 INFO:tasks.workunit.client.1.smithi150.stdout:1/571: rename d6/d8/d85/f97 to d6/d38/da1/dc6/fcb 0 2023-12-05T09:57:35.753 INFO:tasks.workunit.client.1.smithi150.stdout:3/599: dread d6/d9/d3d/d56/d53/f9e [0,4194304] 0 2023-12-05T09:57:35.768 INFO:tasks.workunit.client.0.smithi100.stdout:0/524: rename da/d1b/d73/d82/l8e to da/d1b/d6b/d78/l9b 0 2023-12-05T09:57:35.769 INFO:tasks.workunit.client.0.smithi100.stdout:0/525: chown da/d2a 3212 1 2023-12-05T09:57:35.769 INFO:tasks.workunit.client.0.smithi100.stdout:0/526: chown da/d1b/d6b/d78 160200423 1 2023-12-05T09:57:35.769 INFO:tasks.workunit.client.0.smithi100.stdout:8/502: dread d0/d35/f70 [0,4194304] 0 2023-12-05T09:57:35.772 INFO:tasks.workunit.client.1.smithi150.stdout:2/617: dwrite d0/d3/d27/db6/fba [4194304,4194304] 0 2023-12-05T09:57:35.772 INFO:tasks.workunit.client.1.smithi150.stdout:2/618: readlink d0/d3/d5/d13/l92 0 2023-12-05T09:57:35.773 INFO:tasks.workunit.client.0.smithi100.stdout:3/674: truncate d0/d2/f23 234483 0 2023-12-05T09:57:35.779 INFO:tasks.workunit.client.0.smithi100.stdout:2/699: creat d7/da/d18/d1b/fef x:0 0 0 2023-12-05T09:57:35.781 INFO:tasks.workunit.client.0.smithi100.stdout:7/530: creat d3/dc/d11/d13/d37/fc0 x:0 0 0 2023-12-05T09:57:35.783 INFO:tasks.workunit.client.0.smithi100.stdout:6/925: creat d7/d11/d1a/db7/df7/d126/d6a/f12a x:0 0 0 2023-12-05T09:57:35.784 INFO:tasks.workunit.client.0.smithi100.stdout:6/926: read - d7/d27/d35/d5a/f9d zero size 2023-12-05T09:57:35.786 INFO:tasks.workunit.client.1.smithi150.stdout:8/643: creat d0/d41/d49/d1b/d24/d2e/d4d/d83/fca x:0 0 0 2023-12-05T09:57:35.790 INFO:tasks.workunit.client.0.smithi100.stdout:9/572: rmdir d7/d35/d71/db6 0 2023-12-05T09:57:35.794 INFO:tasks.workunit.client.1.smithi150.stdout:7/599: dwrite d2/db/d30/d13/d4f/d5a/d5c/fa5 [0,4194304] 0 2023-12-05T09:57:35.796 INFO:tasks.workunit.client.1.smithi150.stdout:6/539: sync 2023-12-05T09:57:35.796 INFO:tasks.workunit.client.1.smithi150.stdout:4/508: sync 2023-12-05T09:57:35.796 INFO:tasks.workunit.client.1.smithi150.stdout:6/540: chown d2/d23/d3b/d64/d7a/d5d/d6b/c81 826 1 2023-12-05T09:57:35.796 INFO:tasks.workunit.client.0.smithi100.stdout:5/574: creat d0/d16/d2b/d48/df/fc6 x:0 0 0 2023-12-05T09:57:35.799 INFO:tasks.workunit.client.1.smithi150.stdout:3/600: dwrite d6/d9/d43/f72 [0,4194304] 0 2023-12-05T09:57:35.799 INFO:tasks.workunit.client.1.smithi150.stdout:3/601: write d6/d22/d37/db8/fbe [224257,87984] 0 2023-12-05T09:57:35.799 INFO:tasks.workunit.client.1.smithi150.stdout:7/600: write d2/db/d30/d13/d4f/d5a/d5c/f7c [1008479,127597] 0 2023-12-05T09:57:35.801 INFO:tasks.workunit.client.0.smithi100.stdout:0/527: truncate da/d2a/f7b 3555447 0 2023-12-05T09:57:35.802 INFO:tasks.workunit.client.1.smithi150.stdout:5/576: mkdir d1/d7f/d65/d3b/d6b/dcb 0 2023-12-05T09:57:35.804 INFO:tasks.workunit.client.1.smithi150.stdout:9/534: rmdir d3/d42/d62 39 2023-12-05T09:57:35.805 INFO:tasks.workunit.client.0.smithi100.stdout:3/675: getdents d0/d3d/d5c/d6f/d7f 0 2023-12-05T09:57:35.809 INFO:tasks.workunit.client.0.smithi100.stdout:7/531: truncate d3/dc/d11/d13/f91 3401401 0 2023-12-05T09:57:35.813 INFO:tasks.workunit.client.0.smithi100.stdout:6/927: link d7/lae d7/d11/d1a/db7/df7/d126/l12b 0 2023-12-05T09:57:35.818 INFO:tasks.workunit.client.0.smithi100.stdout:0/528: dread da/d1b/f3c [0,4194304] 0 2023-12-05T09:57:35.822 INFO:tasks.workunit.client.1.smithi150.stdout:2/619: rename d0/d3/d27/dac/fcd to d0/d3/d27/d51/fd5 0 2023-12-05T09:57:35.822 INFO:tasks.workunit.client.1.smithi150.stdout:2/620: write d0/d3/d5/d10/f20 [2138172,95438] 0 2023-12-05T09:57:35.823 INFO:tasks.workunit.client.0.smithi100.stdout:2/700: dwrite d7/da/d13/fe0 [0,4194304] 0 2023-12-05T09:57:35.823 INFO:tasks.workunit.client.0.smithi100.stdout:5/575: truncate d0/d1f/d25/f50 3019063 0 2023-12-05T09:57:35.825 INFO:tasks.workunit.client.1.smithi150.stdout:8/644: link d0/d41/d49/d1b/d24/d2e/f5e d0/d41/d49/fcb 0 2023-12-05T09:57:35.825 INFO:tasks.workunit.client.1.smithi150.stdout:8/645: dread - d0/d41/d49/d1b/d24/d5b/fb4 zero size 2023-12-05T09:57:35.827 INFO:tasks.workunit.client.0.smithi100.stdout:8/503: getdents d0/d12 0 2023-12-05T09:57:35.827 INFO:tasks.workunit.client.0.smithi100.stdout:8/504: stat d0/d12/d13/d16/l83 0 2023-12-05T09:57:35.827 INFO:tasks.workunit.client.0.smithi100.stdout:8/505: read - d0/d35/f68 zero size 2023-12-05T09:57:35.829 INFO:tasks.workunit.client.0.smithi100.stdout:7/532: mkdir d3/dc/d11/d13/d37/d97/dc1 0 2023-12-05T09:57:35.830 INFO:tasks.workunit.client.0.smithi100.stdout:7/533: read - d3/dc/d11/d13/de/f99 zero size 2023-12-05T09:57:35.832 INFO:tasks.workunit.client.0.smithi100.stdout:7/534: fdatasync d3/dc/d11/d13/de/d18/d3b/d40/d4c/fa4 0 2023-12-05T09:57:35.832 INFO:tasks.workunit.client.0.smithi100.stdout:6/928: rename d7/d11/d1a/db7/df7/d126/f4a to d7/d27/d72/f12c 0 2023-12-05T09:57:35.832 INFO:tasks.workunit.client.0.smithi100.stdout:6/929: write d7/f11d [884206,83698] 0 2023-12-05T09:57:35.832 INFO:tasks.workunit.client.0.smithi100.stdout:6/930: chown d7/d11/d1a/db7/fc0 7940 1 2023-12-05T09:57:35.835 INFO:tasks.workunit.client.1.smithi150.stdout:4/509: unlink d0/d3e/d48/l6c 0 2023-12-05T09:57:35.835 INFO:tasks.workunit.client.1.smithi150.stdout:4/510: fdatasync d0/f91 0 2023-12-05T09:57:35.838 INFO:tasks.workunit.client.0.smithi100.stdout:0/529: creat da/d22/d33/d7f/d94/f9c x:0 0 0 2023-12-05T09:57:35.840 INFO:tasks.workunit.client.0.smithi100.stdout:9/573: mkdir d7/d1b/d22/d51/dc0 0 2023-12-05T09:57:35.843 INFO:tasks.workunit.client.1.smithi150.stdout:3/602: dread d6/d22/f31 [0,4194304] 0 2023-12-05T09:57:35.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:35 smithi150 ceph-mon[116142]: from='client.14710 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:57:35.852 INFO:tasks.workunit.client.0.smithi100.stdout:2/701: getdents d7/da/d13/d4e 0 2023-12-05T09:57:35.853 INFO:tasks.workunit.client.1.smithi150.stdout:8/646: dread d0/d41/d49/d1b/d24/d2e/fa5 [0,4194304] 0 2023-12-05T09:57:35.854 INFO:tasks.workunit.client.1.smithi150.stdout:8/647: readlink d0/d41/d49/d1b/d24/d34/da2/lba 0 2023-12-05T09:57:35.854 INFO:tasks.workunit.client.1.smithi150.stdout:8/648: truncate d0/d41/d49/d1b/d24/d5b/d9c/fc6 466740 0 2023-12-05T09:57:35.854 INFO:tasks.workunit.client.1.smithi150.stdout:8/649: chown d0/d41/d49/d1b/d24/lc7 1935988 1 2023-12-05T09:57:35.854 INFO:tasks.workunit.client.1.smithi150.stdout:8/650: write d0/d41/d49/d1b/d24/d2e/d30/f36 [3902288,87590] 0 2023-12-05T09:57:35.858 INFO:tasks.workunit.client.1.smithi150.stdout:4/511: chown d0/c22 890 1 2023-12-05T09:57:35.858 INFO:tasks.workunit.client.0.smithi100.stdout:5/576: creat d0/d1b/d4d/d8e/d96/fc7 x:0 0 0 2023-12-05T09:57:35.860 INFO:tasks.workunit.client.1.smithi150.stdout:8/651: read d0/d41/d49/d1b/d24/d5b/d87/f98 [36224,114653] 0 2023-12-05T09:57:35.860 INFO:tasks.workunit.client.1.smithi150.stdout:8/652: read d0/d8/f11 [2155410,59299] 0 2023-12-05T09:57:35.864 INFO:tasks.workunit.client.1.smithi150.stdout:9/535: truncate d3/d9/f31 3182129 0 2023-12-05T09:57:35.864 INFO:tasks.workunit.client.1.smithi150.stdout:2/621: dread d0/d3/d21/f2c [0,4194304] 0 2023-12-05T09:57:35.864 INFO:tasks.workunit.client.1.smithi150.stdout:2/622: creat d0/d3/d5/d10/d3d/da1/daa/fd6 x:0 0 0 2023-12-05T09:57:35.867 INFO:tasks.workunit.client.0.smithi100.stdout:7/535: write d3/f1f [5821461,66224] 0 2023-12-05T09:57:35.868 INFO:tasks.workunit.client.1.smithi150.stdout:7/601: dwrite d2/db/d30/d18/d1a/f3c [0,4194304] 0 2023-12-05T09:57:35.868 INFO:tasks.workunit.client.1.smithi150.stdout:7/602: write d2/db/d30/d13/d4f/d5a/d5c/f89 [1385627,125315] 0 2023-12-05T09:57:35.869 INFO:tasks.workunit.client.1.smithi150.stdout:3/603: write d6/d9/d3d/d56/f3f [173705,40262] 0 2023-12-05T09:57:35.870 INFO:tasks.workunit.client.1.smithi150.stdout:0/619: sync 2023-12-05T09:57:35.870 INFO:tasks.workunit.client.1.smithi150.stdout:0/620: stat d5/d11/c53 0 2023-12-05T09:57:35.878 INFO:tasks.workunit.client.1.smithi150.stdout:8/653: symlink d0/d41/d49/d1b/d24/d34/d56/d67/lcc 0 2023-12-05T09:57:35.879 INFO:tasks.workunit.client.1.smithi150.stdout:8/654: fdatasync d0/d41/d49/d1b/d24/d34/f97 0 2023-12-05T09:57:35.879 INFO:tasks.workunit.client.1.smithi150.stdout:8/655: chown d0/d41/d49/d1b/d24/d2e/fc2 407 1 2023-12-05T09:57:35.881 INFO:tasks.workunit.client.0.smithi100.stdout:0/530: truncate da/f2d 47145 0 2023-12-05T09:57:35.882 INFO:tasks.workunit.client.1.smithi150.stdout:9/536: symlink d3/d1b/lb0 0 2023-12-05T09:57:35.885 INFO:tasks.workunit.client.0.smithi100.stdout:5/577: dread d0/d1b/d4d/d60/f6d [0,4194304] 0 2023-12-05T09:57:35.886 INFO:tasks.workunit.client.0.smithi100.stdout:3/676: dwrite d0/d2/f75 [0,4194304] 0 2023-12-05T09:57:35.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:35 smithi100 ceph-mon[107145]: from='client.14710 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:57:35.901 INFO:tasks.workunit.client.0.smithi100.stdout:2/702: mknod d7/da/d18/d1b/d2c/d3f/dc5/cf0 0 2023-12-05T09:57:35.903 INFO:tasks.workunit.client.1.smithi150.stdout:5/577: dwrite d1/d64/f58 [0,4194304] 0 2023-12-05T09:57:35.917 INFO:tasks.workunit.client.1.smithi150.stdout:2/623: rename d0/d42/cc9 to d0/d3/d5/d3b/cd7 0 2023-12-05T09:57:35.922 INFO:tasks.workunit.client.0.smithi100.stdout:7/536: rmdir d3/dc/d11/d13 39 2023-12-05T09:57:35.922 INFO:tasks.workunit.client.0.smithi100.stdout:7/537: fdatasync d3/dc/d11/d13/de/f87 0 2023-12-05T09:57:35.929 INFO:tasks.workunit.client.0.smithi100.stdout:9/574: dwrite d7/d35/d71/f78 [0,4194304] 0 2023-12-05T09:57:35.931 INFO:tasks.workunit.client.1.smithi150.stdout:5/578: write d1/d7f/d65/f9d [1239761,22708] 0 2023-12-05T09:57:35.932 INFO:tasks.workunit.client.1.smithi150.stdout:4/512: dwrite d0/d3e/d5b/d80/f4c [0,4194304] 0 2023-12-05T09:57:35.935 INFO:tasks.workunit.client.1.smithi150.stdout:2/624: dread d0/d3/f14 [0,4194304] 0 2023-12-05T09:57:35.935 INFO:tasks.workunit.client.1.smithi150.stdout:2/625: creat d0/d3/d5/d13/db9/fd8 x:0 0 0 2023-12-05T09:57:35.938 INFO:tasks.workunit.client.1.smithi150.stdout:7/603: rmdir d2/d72 39 2023-12-05T09:57:35.938 INFO:tasks.workunit.client.1.smithi150.stdout:7/604: fdatasync d2/d72/d82/fb7 0 2023-12-05T09:57:35.938 INFO:tasks.workunit.client.1.smithi150.stdout:7/605: read d2/db/d30/d13/d4f/d5a/d5c/f7c [682451,101826] 0 2023-12-05T09:57:35.938 INFO:tasks.workunit.client.1.smithi150.stdout:7/606: read - d2/db/d17/d38/d85/fc5 zero size 2023-12-05T09:57:35.942 INFO:tasks.workunit.client.0.smithi100.stdout:0/531: truncate da/f2c 2537226 0 2023-12-05T09:57:35.942 INFO:tasks.workunit.client.0.smithi100.stdout:0/532: write da/d22/d33/f7d [5077172,70896] 0 2023-12-05T09:57:35.945 INFO:tasks.workunit.client.1.smithi150.stdout:9/537: dwrite d3/d9/dc/f1d [0,4194304] 0 2023-12-05T09:57:35.950 INFO:tasks.workunit.client.0.smithi100.stdout:9/575: write d7/f8 [529660,124428] 0 2023-12-05T09:57:35.955 INFO:tasks.workunit.client.1.smithi150.stdout:3/604: mknod d6/d9/d3d/d8a/cbf 0 2023-12-05T09:57:35.958 INFO:tasks.workunit.client.0.smithi100.stdout:0/533: dread da/d22/d33/d35/d3a/f83 [0,4194304] 0 2023-12-05T09:57:35.959 INFO:tasks.workunit.client.1.smithi150.stdout:0/621: mkdir d5/d11/d71/d99/d9c/d3b/de0 0 2023-12-05T09:57:35.960 INFO:tasks.workunit.client.1.smithi150.stdout:0/622: read - d5/d11/d71/d99/fb2 zero size 2023-12-05T09:57:35.960 INFO:tasks.workunit.client.1.smithi150.stdout:0/623: write d5/d11/d71/d99/d9c/d96/dd5/d67/f73 [1532103,84541] 0 2023-12-05T09:57:35.966 INFO:tasks.workunit.client.0.smithi100.stdout:3/677: dwrite d0/d2/f23 [0,4194304] 0 2023-12-05T09:57:35.966 INFO:tasks.workunit.client.0.smithi100.stdout:5/578: rename d0/d4/d14/l9c to d0/d1b/d4d/d8e/d96/dc1/lc8 0 2023-12-05T09:57:35.993 INFO:tasks.workunit.client.0.smithi100.stdout:9/576: dread d7/d20/f2c [0,4194304] 0 2023-12-05T09:57:35.993 INFO:tasks.workunit.client.0.smithi100.stdout:9/577: creat d7/d1b/d22/d2a/d56/d2e/fc1 x:0 0 0 2023-12-05T09:57:35.994 INFO:tasks.workunit.client.1.smithi150.stdout:9/538: dwrite d3/d9/dc/d1f/d24/f78 [0,4194304] 0 2023-12-05T09:57:35.998 INFO:tasks.workunit.client.0.smithi100.stdout:2/703: creat d7/da/da7/ff1 x:0 0 0 2023-12-05T09:57:35.998 INFO:tasks.workunit.client.0.smithi100.stdout:2/704: fsync d7/da/d13/f5d 0 2023-12-05T09:57:35.998 INFO:tasks.workunit.client.0.smithi100.stdout:2/705: truncate d7/da/d1a/fb7 26622 0 2023-12-05T09:57:35.998 INFO:tasks.workunit.client.0.smithi100.stdout:2/706: readlink d7/da/d18/d1b/d2c/d3f/d46/dc8/ld3 0 2023-12-05T09:57:36.005 INFO:tasks.workunit.client.1.smithi150.stdout:3/605: dwrite d6/d22/d37/d63/f4d [4194304,4194304] 0 2023-12-05T09:57:36.006 INFO:tasks.workunit.client.0.smithi100.stdout:7/538: truncate d3/dc/d11/f59 568775 0 2023-12-05T09:57:36.009 INFO:tasks.workunit.client.0.smithi100.stdout:6/931: truncate d7/f11d 617616 0 2023-12-05T09:57:36.009 INFO:tasks.workunit.client.0.smithi100.stdout:6/932: chown d7/d11/d1a/db1 207 1 2023-12-05T09:57:36.013 INFO:tasks.workunit.client.1.smithi150.stdout:8/656: rmdir d0 39 2023-12-05T09:57:36.014 INFO:tasks.workunit.client.1.smithi150.stdout:0/624: dwrite d5/d11/d32/d57/fa7 [4194304,4194304] 0 2023-12-05T09:57:36.016 INFO:tasks.workunit.client.0.smithi100.stdout:3/678: dwrite d0/d3d/d5c/d6f/d7f/d87/f9a [0,4194304] 0 2023-12-05T09:57:36.024 INFO:tasks.workunit.client.0.smithi100.stdout:0/534: truncate da/d2a/f56 1548123 0 2023-12-05T09:57:36.034 INFO:tasks.workunit.client.1.smithi150.stdout:5/579: symlink d1/d3/d6/lcc 0 2023-12-05T09:57:36.044 INFO:tasks.workunit.client.1.smithi150.stdout:4/513: rename d0/d3e/d6d/f23 to d0/d3e/d6d/d95/f9a 0 2023-12-05T09:57:36.046 INFO:tasks.workunit.client.0.smithi100.stdout:3/679: dread d0/d3d/d5c/fa9 [0,4194304] 0 2023-12-05T09:57:36.050 INFO:tasks.workunit.client.1.smithi150.stdout:2/626: link d0/d3/d5/d10/f1b d0/da3/dae/fd9 0 2023-12-05T09:57:36.054 INFO:tasks.workunit.client.1.smithi150.stdout:7/607: rmdir d2/d4 39 2023-12-05T09:57:36.058 INFO:tasks.workunit.client.0.smithi100.stdout:5/579: unlink d0/d1b/d4d/d8e/d96/dc1/da0/lb6 0 2023-12-05T09:57:36.061 INFO:tasks.workunit.client.1.smithi150.stdout:8/657: dwrite d0/d41/d49/d1b/d24/d34/d56/f60 [0,4194304] 0 2023-12-05T09:57:36.061 INFO:tasks.workunit.client.1.smithi150.stdout:8/658: readlink d0/d41/d49/d1b/d24/d34/d56/l85 0 2023-12-05T09:57:36.064 INFO:tasks.workunit.client.1.smithi150.stdout:0/625: dwrite d5/d11/d32/f91 [0,4194304] 0 2023-12-05T09:57:36.066 INFO:tasks.workunit.client.1.smithi150.stdout:8/659: read d0/d41/d49/d1b/d24/d34/d56/d67/d64/f7e [733893,117046] 0 2023-12-05T09:57:36.067 INFO:tasks.workunit.client.0.smithi100.stdout:0/535: dread da/d22/f23 [0,4194304] 0 2023-12-05T09:57:36.067 INFO:tasks.workunit.client.1.smithi150.stdout:1/572: sync 2023-12-05T09:57:36.068 INFO:tasks.workunit.client.1.smithi150.stdout:1/573: truncate d6/d47/d4c/f5d 1004576 0 2023-12-05T09:57:36.073 INFO:tasks.workunit.client.0.smithi100.stdout:2/707: unlink d7/da/f8a 0 2023-12-05T09:57:36.079 INFO:tasks.workunit.client.0.smithi100.stdout:7/539: truncate d3/dc/d11/f58 2088262 0 2023-12-05T09:57:36.079 INFO:tasks.workunit.client.0.smithi100.stdout:8/506: sync 2023-12-05T09:57:36.079 INFO:tasks.workunit.client.0.smithi100.stdout:4/520: sync 2023-12-05T09:57:36.079 INFO:tasks.workunit.client.0.smithi100.stdout:6/933: creat d7/dcc/f12d x:0 0 0 2023-12-05T09:57:36.079 INFO:tasks.workunit.client.0.smithi100.stdout:3/680: dread d0/d2/de/f47 [0,4194304] 0 2023-12-05T09:57:36.082 INFO:tasks.workunit.client.0.smithi100.stdout:1/534: sync 2023-12-05T09:57:36.090 INFO:tasks.workunit.client.0.smithi100.stdout:0/536: dread da/f2d [0,4194304] 0 2023-12-05T09:57:36.091 INFO:tasks.workunit.client.0.smithi100.stdout:9/578: mkdir d7/d1b/d22/d51/d32/dc2 0 2023-12-05T09:57:36.091 INFO:tasks.workunit.client.0.smithi100.stdout:9/579: creat d7/d1b/da5/da2/fc3 x:0 0 0 2023-12-05T09:57:36.092 INFO:tasks.workunit.client.1.smithi150.stdout:5/580: dwrite d1/d2e/da6/d24/f41 [0,4194304] 0 2023-12-05T09:57:36.093 INFO:tasks.workunit.client.1.smithi150.stdout:3/606: symlink d6/d9/d3d/d56/d53/lc0 0 2023-12-05T09:57:36.101 INFO:tasks.workunit.client.0.smithi100.stdout:6/934: dread d7/d11/d1a/f22 [0,4194304] 0 2023-12-05T09:57:36.101 INFO:tasks.workunit.client.0.smithi100.stdout:7/540: symlink d3/dc/d11/d13/de/d2d/d42/lc2 0 2023-12-05T09:57:36.104 INFO:tasks.workunit.client.1.smithi150.stdout:6/541: sync 2023-12-05T09:57:36.106 INFO:tasks.workunit.client.1.smithi150.stdout:5/581: dread d1/d3/d6/f10 [0,4194304] 0 2023-12-05T09:57:36.109 INFO:tasks.workunit.client.0.smithi100.stdout:4/521: creat de/d16/d23/d33/d3d/d44/d4e/d85/fa3 x:0 0 0 2023-12-05T09:57:36.110 INFO:tasks.workunit.client.1.smithi150.stdout:7/608: truncate d2/f12 4071581 0 2023-12-05T09:57:36.112 INFO:tasks.workunit.client.0.smithi100.stdout:1/535: mkdir db/d12/d1e/d26/d39/da6 0 2023-12-05T09:57:36.114 INFO:tasks.workunit.client.0.smithi100.stdout:5/580: dwrite d0/d1b/f32 [0,4194304] 0 2023-12-05T09:57:36.115 INFO:tasks.workunit.client.0.smithi100.stdout:0/537: creat da/d1b/d73/f9d x:0 0 0 2023-12-05T09:57:36.115 INFO:tasks.workunit.client.0.smithi100.stdout:0/538: creat da/d22/d33/d7f/d94/f9e x:0 0 0 2023-12-05T09:57:36.115 INFO:tasks.workunit.client.0.smithi100.stdout:0/539: write da/d1b/d36/f4f [532212,15204] 0 2023-12-05T09:57:36.115 INFO:tasks.workunit.client.0.smithi100.stdout:3/681: write d0/d10/d39/dab/faf [756163,58445] 0 2023-12-05T09:57:36.116 INFO:tasks.workunit.client.0.smithi100.stdout:3/682: fdatasync d0/d10/d39/f80 0 2023-12-05T09:57:36.119 INFO:tasks.workunit.client.1.smithi150.stdout:2/627: dwrite d0/d3/d5/d3b/d4c/f64 [0,4194304] 0 2023-12-05T09:57:36.119 INFO:tasks.workunit.client.1.smithi150.stdout:2/628: truncate d0/d3/d5/d36/d86/fa0 1325614 0 2023-12-05T09:57:36.119 INFO:tasks.workunit.client.1.smithi150.stdout:2/629: chown d0/d3/d27/la8 149904038 1 2023-12-05T09:57:36.120 INFO:tasks.workunit.client.1.smithi150.stdout:0/626: dwrite d5/d11/f8f [0,4194304] 0 2023-12-05T09:57:36.122 INFO:tasks.workunit.client.0.smithi100.stdout:7/541: read d3/dc/d11/d13/de/d18/d3b/d40/d46/fba [2596317,122868] 0 2023-12-05T09:57:36.125 INFO:tasks.workunit.client.1.smithi150.stdout:2/630: dread d0/d3/d5/d22/f82 [0,4194304] 0 2023-12-05T09:57:36.125 INFO:tasks.workunit.client.1.smithi150.stdout:2/631: read - d0/d3/d27/db6/fc6 zero size 2023-12-05T09:57:36.127 INFO:tasks.workunit.client.0.smithi100.stdout:9/580: creat d7/d1b/d22/d2a/d56/fc4 x:0 0 0 2023-12-05T09:57:36.132 INFO:tasks.workunit.client.0.smithi100.stdout:2/708: getdents d7/da/d13/d69/d6e/d71 0 2023-12-05T09:57:36.132 INFO:tasks.workunit.client.0.smithi100.stdout:6/935: getdents d7/d11/d1a/d78 0 2023-12-05T09:57:36.135 INFO:tasks.workunit.client.1.smithi150.stdout:8/660: symlink d0/d41/d49/d1b/d24/d34/da2/lcd 0 2023-12-05T09:57:36.135 INFO:tasks.workunit.client.1.smithi150.stdout:8/661: chown d0/d41/d49/d1b/d24/d2e/d30/c4b 111749 1 2023-12-05T09:57:36.136 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:36.138+0000 7f1733675700 1 -- 172.21.15.100:0/1446072827 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f172c115c70 con 0x7f172c070570 2023-12-05T09:57:36.136 INFO:tasks.workunit.client.1.smithi150.stdout:0/627: dread d5/d11/f24 [0,4194304] 0 2023-12-05T09:57:36.136 INFO:tasks.workunit.client.1.smithi150.stdout:0/628: chown d5/d11/d71/d99/d9c/c2d 285 1 2023-12-05T09:57:36.137 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:36.139+0000 7f171dffb700 1 -- 172.21.15.100:0/1446072827 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+840 (secure 0 0 0) 0x7f17200591f0 con 0x7f172c070570 2023-12-05T09:57:36.137 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2023-12-05T09:57:36.137 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": { 2023-12-05T09:57:36.137 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 2 2023-12-05T09:57:36.137 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-12-05T09:57:36.138 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": { 2023-12-05T09:57:36.138 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 1, 2023-12-05T09:57:36.138 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 1 2023-12-05T09:57:36.138 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-12-05T09:57:36.138 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": { 2023-12-05T09:57:36.138 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 6 2023-12-05T09:57:36.138 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-12-05T09:57:36.138 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": { 2023-12-05T09:57:36.138 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 4 2023-12-05T09:57:36.138 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-12-05T09:57:36.139 INFO:teuthology.orchestra.run.smithi100.stdout: "overall": { 2023-12-05T09:57:36.139 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 13, 2023-12-05T09:57:36.139 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 1 2023-12-05T09:57:36.139 INFO:teuthology.orchestra.run.smithi100.stdout: } 2023-12-05T09:57:36.139 INFO:teuthology.orchestra.run.smithi100.stdout:} 2023-12-05T09:57:36.140 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:36.142+0000 7f1733675700 1 -- 172.21.15.100:0/1446072827 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7f171806ae90 msgr2=0x7f171806d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:57:36.140 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:36.142+0000 7f1733675700 1 --2- 172.21.15.100:0/1446072827 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7f171806ae90 0x7f171806d340 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f17280043d0 tx=0x7f1728002330 comp rx=0 tx=0).stop 2023-12-05T09:57:36.140 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:36.142+0000 7f1733675700 1 -- 172.21.15.100:0/1446072827 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f172c070570 msgr2=0x7f172c113b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:57:36.140 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:36.142+0000 7f1733675700 1 --2- 172.21.15.100:0/1446072827 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f172c070570 0x7f172c113b40 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f1720000c00 tx=0x7f1720009e30 comp rx=0 tx=0).stop 2023-12-05T09:57:36.141 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:36.143+0000 7f1733675700 1 -- 172.21.15.100:0/1446072827 shutdown_connections 2023-12-05T09:57:36.141 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:36.143+0000 7f1733675700 1 --2- 172.21.15.100:0/1446072827 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7f171806ae90 0x7f171806d340 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:36.141 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:36.143+0000 7f1733675700 1 --2- 172.21.15.100:0/1446072827 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f172c070570 0x7f172c113b40 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:36.141 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:36.143+0000 7f1733675700 1 --2- 172.21.15.100:0/1446072827 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f172c071bc0 0x7f172c114080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:36.141 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:36.143+0000 7f1733675700 1 -- 172.21.15.100:0/1446072827 >> 172.21.15.100:0/1446072827 conn(0x7f172c0f82d0 msgr2=0x7f172c0fe630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:57:36.141 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:36.143+0000 7f1733675700 1 -- 172.21.15.100:0/1446072827 shutdown_connections 2023-12-05T09:57:36.141 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:36.143+0000 7f1733675700 1 -- 172.21.15.100:0/1446072827 wait complete. 2023-12-05T09:57:36.142 INFO:tasks.workunit.client.0.smithi100.stdout:1/536: mknod db/d12/d61/ca7 0 2023-12-05T09:57:36.145 INFO:tasks.workunit.client.1.smithi150.stdout:2/632: dread d0/f16 [0,4194304] 0 2023-12-05T09:57:36.146 INFO:tasks.workunit.client.0.smithi100.stdout:5/581: truncate d0/d1f/d25/d31/f3e 884675 0 2023-12-05T09:57:36.149 INFO:tasks.workunit.client.1.smithi150.stdout:1/574: creat d6/d3c/dc2/fcc x:0 0 0 2023-12-05T09:57:36.152 INFO:tasks.workunit.client.1.smithi150.stdout:9/539: truncate d3/d9/f17 8083799 0 2023-12-05T09:57:36.158 INFO:tasks.workunit.client.0.smithi100.stdout:0/540: rename da/d2a/d8c to da/d1b/d36/d9f 0 2023-12-05T09:57:36.159 INFO:tasks.workunit.client.0.smithi100.stdout:0/541: read da/f37 [819530,59028] 0 2023-12-05T09:57:36.161 INFO:tasks.workunit.client.0.smithi100.stdout:3/683: link d0/d2/de/d11/d58/l7e d0/d2/d33/le6 0 2023-12-05T09:57:36.161 INFO:tasks.workunit.client.0.smithi100.stdout:3/684: write d0/d2/d62/f95 [474935,7464] 0 2023-12-05T09:57:36.161 INFO:tasks.workunit.client.0.smithi100.stdout:3/685: fsync d0/d2/de/d11/d7c/fb6 0 2023-12-05T09:57:36.162 INFO:tasks.workunit.client.1.smithi150.stdout:6/542: creat d2/d23/fb6 x:0 0 0 2023-12-05T09:57:36.162 INFO:tasks.workunit.client.1.smithi150.stdout:1/575: write d6/d8/f27 [2071973,45624] 0 2023-12-05T09:57:36.162 INFO:tasks.workunit.client.1.smithi150.stdout:1/576: chown d6/d8/db/d1b/d79/f86 1217 1 2023-12-05T09:57:36.162 INFO:tasks.workunit.client.1.smithi150.stdout:1/577: dread - d6/d38/d4a/f88 zero size 2023-12-05T09:57:36.164 INFO:tasks.workunit.client.0.smithi100.stdout:7/542: symlink d3/dc/d11/d13/de/d2d/d42/lc3 0 2023-12-05T09:57:36.165 INFO:tasks.workunit.client.1.smithi150.stdout:7/609: symlink d2/db/d2e/d9a/lce 0 2023-12-05T09:57:36.165 INFO:tasks.workunit.client.0.smithi100.stdout:9/581: rmdir d7 39 2023-12-05T09:57:36.165 INFO:tasks.workunit.client.0.smithi100.stdout:9/582: readlink d7/d1b/lab 0 2023-12-05T09:57:36.166 INFO:tasks.workunit.client.0.smithi100.stdout:4/522: dwrite de/d16/d23/d33/d3d/d44/f4d [4194304,4194304] 0 2023-12-05T09:57:36.168 INFO:tasks.workunit.client.0.smithi100.stdout:6/936: mkdir d7/d27/d35/d5a/db0/d12e 0 2023-12-05T09:57:36.170 INFO:tasks.workunit.client.0.smithi100.stdout:1/537: symlink db/d31/la8 0 2023-12-05T09:57:36.180 INFO:tasks.workunit.client.0.smithi100.stdout:0/542: write da/f5a [2065553,57321] 0 2023-12-05T09:57:36.181 INFO:tasks.workunit.client.0.smithi100.stdout:3/686: creat d0/d2/de/db8/fe7 x:0 0 0 2023-12-05T09:57:36.182 INFO:tasks.workunit.client.0.smithi100.stdout:7/543: creat d3/dc/d11/d13/de/d18/fc4 x:0 0 0 2023-12-05T09:57:36.184 INFO:tasks.workunit.client.1.smithi150.stdout:8/662: link d0/d41/d49/d1b/d24/d2e/d4d/cb2 d0/d41/d49/d1b/d24/d2e/d30/cce 0 2023-12-05T09:57:36.185 INFO:tasks.workunit.client.0.smithi100.stdout:9/583: creat d7/fc5 x:0 0 0 2023-12-05T09:57:36.186 INFO:tasks.workunit.client.0.smithi100.stdout:1/538: dread db/d12/d1e/f34 [0,4194304] 0 2023-12-05T09:57:36.187 INFO:tasks.workunit.client.1.smithi150.stdout:9/540: creat d3/d9/d6e/d84/fb1 x:0 0 0 2023-12-05T09:57:36.187 INFO:tasks.workunit.client.1.smithi150.stdout:9/541: write d3/d9/dc/f33 [836218,91487] 0 2023-12-05T09:57:36.187 INFO:tasks.workunit.client.1.smithi150.stdout:9/542: dread - d3/d9/d6e/d76/f9f zero size 2023-12-05T09:57:36.189 INFO:tasks.workunit.client.1.smithi150.stdout:3/607: rename d6/d25/d28 to d6/d9/d3d/d56/d71/db6/dc1 0 2023-12-05T09:57:36.191 INFO:tasks.workunit.client.0.smithi100.stdout:4/523: creat de/d16/d23/fa4 x:0 0 0 2023-12-05T09:57:36.192 INFO:tasks.workunit.client.1.smithi150.stdout:5/582: getdents d1 0 2023-12-05T09:57:36.196 INFO:tasks.workunit.client.1.smithi150.stdout:1/578: unlink d6/d8/db/l25 0 2023-12-05T09:57:36.196 INFO:tasks.workunit.client.1.smithi150.stdout:1/579: chown d6/d47/d4c/d60/f63 31605 1 2023-12-05T09:57:36.198 INFO:tasks.workunit.client.1.smithi150.stdout:7/610: getdents d2/db/d30/d13/d4f 0 2023-12-05T09:57:36.202 INFO:tasks.workunit.client.1.smithi150.stdout:8/663: mknod d0/d41/d49/d1b/d24/d34/dbc/ccf 0 2023-12-05T09:57:36.202 INFO:tasks.workunit.client.0.smithi100.stdout:0/543: mknod da/d1b/d73/d82/ca0 0 2023-12-05T09:57:36.202 INFO:tasks.workunit.client.0.smithi100.stdout:0/544: chown da/l25 751990 1 2023-12-05T09:57:36.203 INFO:tasks.workunit.client.1.smithi150.stdout:9/543: link d3/d9/d58/fa9 d3/d1b/d79/fb2 0 2023-12-05T09:57:36.204 INFO:tasks.workunit.client.0.smithi100.stdout:3/687: link d0/d2/de/d11/d58/l7e d0/d3d/d90/le8 0 2023-12-05T09:57:36.205 INFO:tasks.workunit.client.1.smithi150.stdout:6/543: dwrite d2/d23/d3b/d64/d7a/d5d/d6b/f89 [0,4194304] 0 2023-12-05T09:57:36.206 INFO:tasks.workunit.client.1.smithi150.stdout:3/608: dread d6/d9/d43/d75/fae [0,4194304] 0 2023-12-05T09:57:36.206 INFO:tasks.workunit.client.1.smithi150.stdout:3/609: creat d6/d9/d3d/d56/d71/fc2 x:0 0 0 2023-12-05T09:57:36.207 INFO:tasks.workunit.client.0.smithi100.stdout:7/544: mknod d3/dc/d11/d13/de/d2d/d42/cc5 0 2023-12-05T09:57:36.209 INFO:tasks.workunit.client.1.smithi150.stdout:2/633: rename d0/d3/d27/f83 to d0/d3/d5/d13/d15/d30/fda 0 2023-12-05T09:57:36.209 INFO:tasks.workunit.client.1.smithi150.stdout:5/583: mkdir d1/d3/d6/d26/dca/dcd 0 2023-12-05T09:57:36.209 INFO:tasks.workunit.client.1.smithi150.stdout:1/580: truncate d6/d8/db/de/d75/dc4/fc1 1911023 0 2023-12-05T09:57:36.209 INFO:tasks.workunit.client.1.smithi150.stdout:5/584: fsync d1/d3/fa2 0 2023-12-05T09:57:36.209 INFO:tasks.workunit.client.1.smithi150.stdout:2/634: truncate d0/d3/d11/fbe 651071 0 2023-12-05T09:57:36.209 INFO:tasks.workunit.client.0.smithi100.stdout:1/539: mkdir db/d12/d61/d66/da9 0 2023-12-05T09:57:36.210 INFO:tasks.workunit.client.0.smithi100.stdout:1/540: read - db/d12/f8f zero size 2023-12-05T09:57:36.210 INFO:tasks.workunit.client.1.smithi150.stdout:2/635: read d0/d3/d11/fbe [61079,70605] 0 2023-12-05T09:57:36.210 INFO:tasks.workunit.client.1.smithi150.stdout:7/611: truncate d2/db/f45 4164311 0 2023-12-05T09:57:36.210 INFO:tasks.workunit.client.1.smithi150.stdout:7/612: chown d2/d1b 1445 1 2023-12-05T09:57:36.211 INFO:tasks.workunit.client.0.smithi100.stdout:4/524: creat de/d38/fa5 x:0 0 0 2023-12-05T09:57:36.211 INFO:tasks.workunit.client.0.smithi100.stdout:4/525: fsync de/d16/d23/d36/f6a 0 2023-12-05T09:57:36.212 INFO:tasks.workunit.client.0.smithi100.stdout:4/526: fdatasync de/d16/d23/d36/f3e 0 2023-12-05T09:57:36.213 INFO:tasks.workunit.client.1.smithi150.stdout:4/514: sync 2023-12-05T09:57:36.213 INFO:tasks.workunit.client.1.smithi150.stdout:4/515: chown d0/d3e/d48/d4d/f99 5694540 1 2023-12-05T09:57:36.214 INFO:tasks.workunit.client.1.smithi150.stdout:8/664: mkdir d0/d41/d49/d1b/d24/d34/dd0 0 2023-12-05T09:57:36.215 INFO:tasks.workunit.client.0.smithi100.stdout:5/582: rename d0/d1b/d4d/d8e/d96/dc1/da0 to d0/d16/dc9 0 2023-12-05T09:57:36.216 INFO:tasks.workunit.client.1.smithi150.stdout:9/544: symlink d3/d82/lb3 0 2023-12-05T09:57:36.220 INFO:tasks.workunit.client.0.smithi100.stdout:0/545: creat da/d22/d33/d35/d3a/fa1 x:0 0 0 2023-12-05T09:57:36.223 INFO:tasks.workunit.client.0.smithi100.stdout:9/584: getdents d7/d1b/da5 0 2023-12-05T09:57:36.226 INFO:tasks.workunit.client.0.smithi100.stdout:7/545: write d3/dc/d11/d33/f62 [405979,23480] 0 2023-12-05T09:57:36.230 INFO:tasks.workunit.client.0.smithi100.stdout:6/937: rename d7/d27/d97/fbb to d7/d27/d72/f12f 0 2023-12-05T09:57:36.245 INFO:tasks.workunit.client.0.smithi100.stdout:5/583: creat d0/d4/d14/d35/d62/fca x:0 0 0 2023-12-05T09:57:36.246 INFO:tasks.workunit.client.0.smithi100.stdout:5/584: getdents d0/d1b/d4d/d8e/d96/dc1/dae/db9 0 2023-12-05T09:57:36.251 INFO:tasks.workunit.client.0.smithi100.stdout:0/546: write da/d22/d33/d74/f84 [29564,76094] 0 2023-12-05T09:57:36.251 INFO:tasks.workunit.client.0.smithi100.stdout:0/547: read da/d1b/d6b/f6c [1503,103127] 0 2023-12-05T09:57:36.256 INFO:tasks.workunit.client.0.smithi100.stdout:1/541: mkdir db/daa 0 2023-12-05T09:57:36.258 INFO:tasks.workunit.client.1.smithi150.stdout:3/610: creat d6/d9/d3d/d56/d79/fc3 x:0 0 0 2023-12-05T09:57:36.262 INFO:tasks.workunit.client.0.smithi100.stdout:9/585: rmdir d7/d1b/d22/d2a/d74 39 2023-12-05T09:57:36.266 INFO:tasks.workunit.client.0.smithi100.stdout:4/527: write de/f12 [26278,100615] 0 2023-12-05T09:57:36.267 INFO:tasks.workunit.client.1.smithi150.stdout:5/585: creat d1/d64/fce x:0 0 0 2023-12-05T09:57:36.267 INFO:tasks.workunit.client.1.smithi150.stdout:0/629: sync 2023-12-05T09:57:36.267 INFO:tasks.workunit.client.1.smithi150.stdout:0/630: chown d5/d11/d32/d57/cb8 49 1 2023-12-05T09:57:36.267 INFO:tasks.workunit.client.1.smithi150.stdout:5/586: fsync d1/d7f/fbc 0 2023-12-05T09:57:36.267 INFO:tasks.workunit.client.1.smithi150.stdout:5/587: dread - d1/d2e/da6/d24/d59/fa3 zero size 2023-12-05T09:57:36.267 INFO:tasks.workunit.client.1.smithi150.stdout:5/588: truncate d1/d3/d6/d26/f3e 4978887 0 2023-12-05T09:57:36.275 INFO:tasks.workunit.client.1.smithi150.stdout:8/665: dwrite d0/fc4 [0,4194304] 0 2023-12-05T09:57:36.275 INFO:tasks.workunit.client.1.smithi150.stdout:8/666: chown d0/d41/d49/d1b/d24/d2e/d4d/f7c 9948 1 2023-12-05T09:57:36.276 INFO:tasks.workunit.client.1.smithi150.stdout:1/581: rename d6/d8/db/de/d75/da5/cae to d6/d8/db/de/d75/ccd 0 2023-12-05T09:57:36.277 INFO:tasks.workunit.client.0.smithi100.stdout:5/585: dread d0/d1b/f39 [0,4194304] 0 2023-12-05T09:57:36.277 INFO:tasks.workunit.client.0.smithi100.stdout:1/542: mknod db/d31/d3a/d3b/cab 0 2023-12-05T09:57:36.280 INFO:tasks.workunit.client.1.smithi150.stdout:2/636: truncate d0/d3/d5/f40 1925814 0 2023-12-05T09:57:36.282 INFO:tasks.workunit.client.1.smithi150.stdout:6/544: dwrite d2/d23/d2e/f91 [0,4194304] 0 2023-12-05T09:57:36.282 INFO:tasks.workunit.client.0.smithi100.stdout:0/548: dread da/d1b/f54 [0,4194304] 0 2023-12-05T09:57:36.284 INFO:tasks.workunit.client.1.smithi150.stdout:4/516: dwrite d0/f51 [0,4194304] 0 2023-12-05T09:57:36.284 INFO:tasks.workunit.client.1.smithi150.stdout:4/517: read - d0/d3e/d5b/d80/f7b zero size 2023-12-05T09:57:36.285 INFO:tasks.workunit.client.1.smithi150.stdout:7/613: rmdir d2/d1b/d31/da4 39 2023-12-05T09:57:36.286 INFO:tasks.workunit.client.1.smithi150.stdout:9/545: mknod d3/d9/d67/cb4 0 2023-12-05T09:57:36.286 INFO:tasks.workunit.client.1.smithi150.stdout:9/546: truncate d3/d42/f8e 423892 0 2023-12-05T09:57:36.291 INFO:tasks.workunit.client.0.smithi100.stdout:3/688: dwrite d0/d2/de/d12/f18 [0,4194304] 0 2023-12-05T09:57:36.291 INFO:tasks.workunit.client.0.smithi100.stdout:5/586: mkdir d0/d1b/d4d/d8e/d96/dc1/dae/db9/dcb 0 2023-12-05T09:57:36.291 INFO:tasks.workunit.client.0.smithi100.stdout:5/587: read d0/d4/d14/d35/f89 [994878,14996] 0 2023-12-05T09:57:36.291 INFO:tasks.workunit.client.0.smithi100.stdout:1/543: creat db/d31/d73/fac x:0 0 0 2023-12-05T09:57:36.294 INFO:tasks.workunit.client.1.smithi150.stdout:3/611: symlink d6/d9/d3d/d56/d79/lc4 0 2023-12-05T09:57:36.294 INFO:tasks.workunit.client.0.smithi100.stdout:6/938: dwrite d7/d11/d1a/f2f [0,4194304] 0 2023-12-05T09:57:36.295 INFO:tasks.workunit.client.1.smithi150.stdout:2/637: dread d0/d3/f70 [0,4194304] 0 2023-12-05T09:57:36.295 INFO:tasks.workunit.client.1.smithi150.stdout:2/638: read - d0/d3/d5/d13/db9/fd8 zero size 2023-12-05T09:57:36.295 INFO:tasks.workunit.client.1.smithi150.stdout:5/589: creat d1/d2e/da6/d24/fcf x:0 0 0 2023-12-05T09:57:36.298 INFO:tasks.workunit.client.0.smithi100.stdout:0/549: creat da/d2a/d4d/fa2 x:0 0 0 2023-12-05T09:57:36.298 INFO:tasks.workunit.client.0.smithi100.stdout:0/550: chown da/d2a/f56 191 1 2023-12-05T09:57:36.299 INFO:tasks.workunit.client.0.smithi100.stdout:0/551: creat da/fa3 x:0 0 0 2023-12-05T09:57:36.299 INFO:tasks.workunit.client.0.smithi100.stdout:0/552: readlink da/d22/d33/d35/l80 0 2023-12-05T09:57:36.309 INFO:tasks.workunit.client.0.smithi100.stdout:3/689: mkdir d0/d3d/d5c/d5f/de9 0 2023-12-05T09:57:36.310 INFO:tasks.workunit.client.0.smithi100.stdout:5/588: symlink d0/d16/d2b/d48/df/d51/da8/lcc 0 2023-12-05T09:57:36.311 INFO:tasks.workunit.client.1.smithi150.stdout:8/667: truncate d0/f99 2747347 0 2023-12-05T09:57:36.314 INFO:tasks.workunit.client.1.smithi150.stdout:0/631: rename d5/d11/d71/d5f/d77/d87/l8d to d5/d11/d32/le1 0 2023-12-05T09:57:36.316 INFO:tasks.workunit.client.1.smithi150.stdout:1/582: mknod d6/d8/cce 0 2023-12-05T09:57:36.317 INFO:tasks.workunit.client.1.smithi150.stdout:1/583: chown d6/d8/d59/f90 638673 1 2023-12-05T09:57:36.320 INFO:tasks.workunit.client.0.smithi100.stdout:6/939: mknod d7/d27/d35/c130 0 2023-12-05T09:57:36.324 INFO:tasks.workunit.client.1.smithi150.stdout:4/518: chown d0/d5f 42599456 1 2023-12-05T09:57:36.325 INFO:tasks.workunit.client.0.smithi100.stdout:0/553: getdents da/d1b 0 2023-12-05T09:57:36.325 INFO:tasks.workunit.client.0.smithi100.stdout:5/589: creat d0/d1b/d4d/d8e/d96/dc1/dae/fcd x:0 0 0 2023-12-05T09:57:36.326 INFO:tasks.workunit.client.1.smithi150.stdout:3/612: creat d6/d9/d3d/d52/fc5 x:0 0 0 2023-12-05T09:57:36.328 INFO:tasks.workunit.client.1.smithi150.stdout:2/639: mknod d0/d3/d21/cdb 0 2023-12-05T09:57:36.328 INFO:tasks.workunit.client.0.smithi100.stdout:1/544: rename db/d12/d61/d66 to db/d31/d3a/d4a/dad 0 2023-12-05T09:57:36.329 INFO:tasks.workunit.client.0.smithi100.stdout:1/545: read - db/d31/d3a/d4a/dad/d67/fa4 zero size 2023-12-05T09:57:36.330 INFO:tasks.workunit.client.1.smithi150.stdout:5/590: unlink d1/d2e/da6/l56 0 2023-12-05T09:57:36.334 INFO:tasks.workunit.client.1.smithi150.stdout:8/668: mknod d0/d41/d49/d1b/d24/d38/dad/cd1 0 2023-12-05T09:57:36.336 INFO:tasks.workunit.client.1.smithi150.stdout:0/632: mknod d5/d11/d71/d5f/d77/d87/ce2 0 2023-12-05T09:57:36.337 INFO:tasks.workunit.client.0.smithi100.stdout:6/940: mknod d7/d11/d1a/db7/df7/d126/d6a/d7c/c131 0 2023-12-05T09:57:36.338 INFO:tasks.workunit.client.0.smithi100.stdout:6/941: chown d7/d27/da0/f112 6816 1 2023-12-05T09:57:36.338 INFO:tasks.workunit.client.0.smithi100.stdout:6/942: fdatasync d7/d27/d72/f87 0 2023-12-05T09:57:36.338 INFO:tasks.workunit.client.1.smithi150.stdout:1/584: mkdir d6/d47/dcf 0 2023-12-05T09:57:36.339 INFO:tasks.workunit.client.0.smithi100.stdout:1/546: dread db/d31/f51 [0,4194304] 0 2023-12-05T09:57:36.340 INFO:tasks.workunit.client.0.smithi100.stdout:0/554: symlink da/d22/d33/d35/d3a/d8b/d8f/la4 0 2023-12-05T09:57:36.341 INFO:tasks.workunit.client.1.smithi150.stdout:4/519: getdents d0/d3e/d6d 0 2023-12-05T09:57:36.341 INFO:tasks.workunit.client.1.smithi150.stdout:4/520: creat d0/d3e/d5b/f9b x:0 0 0 2023-12-05T09:57:36.344 INFO:tasks.workunit.client.0.smithi100.stdout:3/690: rename d0/d3d/d5c/d6f/f84 to d0/fea 0 2023-12-05T09:57:36.346 INFO:tasks.workunit.client.1.smithi150.stdout:3/613: mknod d6/d9/d3d/d56/d71/cc6 0 2023-12-05T09:57:36.346 INFO:tasks.workunit.client.0.smithi100.stdout:4/528: dwrite de/d66/f77 [4194304,4194304] 0 2023-12-05T09:57:36.347 INFO:tasks.workunit.client.0.smithi100.stdout:4/529: readlink de/d16/d23/l27 0 2023-12-05T09:57:36.347 INFO:tasks.workunit.client.1.smithi150.stdout:7/614: dwrite d2/db/f99 [0,4194304] 0 2023-12-05T09:57:36.350 INFO:tasks.workunit.client.1.smithi150.stdout:6/545: dwrite d2/f1c [0,4194304] 0 2023-12-05T09:57:36.350 INFO:tasks.workunit.client.1.smithi150.stdout:6/546: chown d2/d23/d3b/d46/fa2 5 1 2023-12-05T09:57:36.351 INFO:tasks.workunit.client.1.smithi150.stdout:2/640: truncate d0/d3/f99 2403575 0 2023-12-05T09:57:36.352 INFO:tasks.workunit.client.1.smithi150.stdout:2/641: creat d0/d3/d11/fdc x:0 0 0 2023-12-05T09:57:36.352 INFO:tasks.workunit.client.1.smithi150.stdout:2/642: readlink d0/d3/d5/d22/d52/d56/l72 0 2023-12-05T09:57:36.352 INFO:tasks.workunit.client.1.smithi150.stdout:2/643: creat d0/d3/d21/d4d/fdd x:0 0 0 2023-12-05T09:57:36.352 INFO:tasks.workunit.client.1.smithi150.stdout:2/644: truncate d0/d3/fb2 4279560 0 2023-12-05T09:57:36.352 INFO:tasks.workunit.client.0.smithi100.stdout:5/590: dread d0/d16/d2b/d75/f78 [0,4194304] 0 2023-12-05T09:57:36.353 INFO:tasks.workunit.client.0.smithi100.stdout:9/586: dwrite d7/d1b/d22/d51/d32/f8c [0,4194304] 0 2023-12-05T09:57:36.353 INFO:tasks.workunit.client.0.smithi100.stdout:6/943: mknod d7/d11/d1a/db7/df7/d126/d115/c132 0 2023-12-05T09:57:36.356 INFO:tasks.workunit.client.0.smithi100.stdout:1/547: creat db/d12/fae x:0 0 0 2023-12-05T09:57:36.357 INFO:tasks.workunit.client.0.smithi100.stdout:1/548: read db/d12/f13 [3111170,54347] 0 2023-12-05T09:57:36.357 INFO:tasks.workunit.client.0.smithi100.stdout:1/549: readlink db/d12/d61/l69 0 2023-12-05T09:57:36.357 INFO:tasks.workunit.client.0.smithi100.stdout:1/550: chown db/d31/c44 13 1 2023-12-05T09:57:36.357 INFO:tasks.workunit.client.0.smithi100.stdout:1/551: creat db/d12/d1e/d26/d30/d52/d84/faf x:0 0 0 2023-12-05T09:57:36.359 INFO:tasks.workunit.client.0.smithi100.stdout:3/691: rename d0/d2/l2d to d0/d3d/d5c/d5f/leb 0 2023-12-05T09:57:36.360 INFO:tasks.workunit.client.1.smithi150.stdout:9/547: rename d3/d9/d26/d34/c37 to d3/d9/dc/d1f/cb5 0 2023-12-05T09:57:36.360 INFO:tasks.workunit.client.1.smithi150.stdout:0/633: getdents d5/d11 0 2023-12-05T09:57:36.360 INFO:tasks.workunit.client.1.smithi150.stdout:0/634: stat d5/d11/d71/f56 0 2023-12-05T09:57:36.360 INFO:tasks.workunit.client.1.smithi150.stdout:0/635: truncate d5/d11/d71/d99/d9c/d3b/dad/fdf 377067 0 2023-12-05T09:57:36.364 INFO:tasks.workunit.client.0.smithi100.stdout:4/530: mkdir de/d16/d23/d60/d98/da6 0 2023-12-05T09:57:36.365 INFO:tasks.workunit.client.1.smithi150.stdout:7/615: dread d2/db/d30/d13/d4f/d5a/d5c/fa5 [0,4194304] 0 2023-12-05T09:57:36.365 INFO:tasks.workunit.client.1.smithi150.stdout:7/616: dread - d2/db/d17/d38/d85/fc5 zero size 2023-12-05T09:57:36.366 INFO:tasks.workunit.client.1.smithi150.stdout:4/521: symlink d0/d3e/d5b/d80/d44/l9c 0 2023-12-05T09:57:36.366 INFO:tasks.workunit.client.0.smithi100.stdout:4/531: creat de/d66/fa7 x:0 0 0 2023-12-05T09:57:36.372 INFO:tasks.workunit.client.0.smithi100.stdout:5/591: truncate d0/d4/fd 8957511 0 2023-12-05T09:57:36.372 INFO:tasks.workunit.client.0.smithi100.stdout:5/592: stat d0/d1b/d4d/d60/fbf 0 2023-12-05T09:57:36.372 INFO:tasks.workunit.client.1.smithi150.stdout:3/614: rmdir d6/d9/d3d/d56/d71/db6/dc1/d9a 39 2023-12-05T09:57:36.377 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:36.379+0000 7f1410ec1700 1 -- 172.21.15.100:0/2613557042 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f140c071bc0 msgr2=0x7f140c070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:57:36.378 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:36.379+0000 7f1410ec1700 1 --2- 172.21.15.100:0/2613557042 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f140c071bc0 0x7f140c070030 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1400004880 tx=0x7f1400009e30 comp rx=0 tx=0).stop 2023-12-05T09:57:36.378 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:36.380+0000 7f1410ec1700 1 -- 172.21.15.100:0/2613557042 shutdown_connections 2023-12-05T09:57:36.378 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:36.380+0000 7f1410ec1700 1 --2- 172.21.15.100:0/2613557042 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f140c070570 0x7f140c0709c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:36.378 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:36.380+0000 7f1410ec1700 1 --2- 172.21.15.100:0/2613557042 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f140c071bc0 0x7f140c070030 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:36.378 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:36.380+0000 7f1410ec1700 1 -- 172.21.15.100:0/2613557042 >> 172.21.15.100:0/2613557042 conn(0x7f140c0f82d0 msgr2=0x7f140c0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:57:36.389 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:36.391+0000 7f1410ec1700 1 -- 172.21.15.100:0/2613557042 shutdown_connections 2023-12-05T09:57:36.389 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:36.392+0000 7f1410ec1700 1 -- 172.21.15.100:0/2613557042 wait complete. 2023-12-05T09:57:36.390 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:36.393+0000 7f1410ec1700 1 Processor -- start 2023-12-05T09:57:36.390 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:36.393+0000 7f1410ec1700 1 -- start start 2023-12-05T09:57:36.391 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:36.394+0000 7f1410ec1700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f140c108320 0x7f140c108730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:57:36.391 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:36.394+0000 7f1410ec1700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f140c108c70 0x7f140c11d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:57:36.391 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:36.394+0000 7f1410ec1700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f140c11dfb0 con 0x7f140c108c70 2023-12-05T09:57:36.391 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:36.394+0000 7f1410ec1700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f140c11e120 con 0x7f140c108320 2023-12-05T09:57:36.392 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:36.394+0000 7f140a59c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f140c108320 0x7f140c108730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:57:36.392 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:36.395+0000 7f140a59c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f140c108320 0x7f140c108730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.100:50012/0 (socket says 172.21.15.100:50012) 2023-12-05T09:57:36.392 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:36.395+0000 7f140a59c700 1 -- 172.21.15.100:0/2709858199 learned_addr learned my addr 172.21.15.100:0/2709858199 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:57:36.392 INFO:tasks.workunit.client.1.smithi150.stdout:6/547: mknod d2/d23/d3b/d64/d7a/d5d/cb7 0 2023-12-05T09:57:36.394 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:36.395+0000 7f140a59c700 1 -- 172.21.15.100:0/2709858199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f140c108c70 msgr2=0x7f140c11d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:57:36.394 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:36.395+0000 7f140a59c700 1 --2- 172.21.15.100:0/2709858199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f140c108c70 0x7f140c11d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:36.394 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:36.397+0000 7f140a59c700 1 -- 172.21.15.100:0/2709858199 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1400005040 con 0x7f140c108320 2023-12-05T09:57:36.396 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:36.398+0000 7f140a59c700 1 --2- 172.21.15.100:0/2709858199 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f140c108320 0x7f140c108730 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1400005010 tx=0x7f1400009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:57:36.396 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:36.399+0000 7f13faffd700 1 -- 172.21.15.100:0/2709858199 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f140000e030 con 0x7f140c108320 2023-12-05T09:57:36.396 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:36.399+0000 7f13faffd700 1 -- 172.21.15.100:0/2709858199 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f140001c3c0 con 0x7f140c108320 2023-12-05T09:57:36.396 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:36.399+0000 7f13faffd700 1 -- 172.21.15.100:0/2709858199 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1400012600 con 0x7f140c108320 2023-12-05T09:57:36.397 INFO:tasks.workunit.client.0.smithi100.stdout:9/587: symlink d7/d35/d71/d9a/lc6 0 2023-12-05T09:57:36.398 INFO:tasks.workunit.client.0.smithi100.stdout:4/532: dread de/d38/f42 [0,4194304] 0 2023-12-05T09:57:36.400 INFO:tasks.workunit.client.0.smithi100.stdout:5/593: dread d0/d1b/d4d/d60/f6d [0,4194304] 0 2023-12-05T09:57:36.404 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:36.401+0000 7f1410ec1700 1 -- 172.21.15.100:0/2709858199 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f140c11e3a0 con 0x7f140c108320 2023-12-05T09:57:36.404 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:36.401+0000 7f1410ec1700 1 -- 172.21.15.100:0/2709858199 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f140c122b60 con 0x7f140c108320 2023-12-05T09:57:36.405 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:36.406+0000 7f13faffd700 1 -- 172.21.15.100:0/2709858199 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 25) v1 ==== 88726+0+0 (secure 0 0 0) 0x7f140001c9c0 con 0x7f140c108320 2023-12-05T09:57:36.406 INFO:tasks.workunit.client.1.smithi150.stdout:9/548: dwrite d3/d9/dc/fa2 [0,4194304] 0 2023-12-05T09:57:36.408 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:36.407+0000 7f1410ec1700 1 -- 172.21.15.100:0/2709858199 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f140c1021d0 con 0x7f140c108320 2023-12-05T09:57:36.408 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:36.408+0000 7f13faffd700 1 --2- 172.21.15.100:0/2709858199 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7f13f406af00 0x7f13f406d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:57:36.408 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:36.408+0000 7f13faffd700 1 -- 172.21.15.100:0/2709858199 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f1400058d80 con 0x7f140c108320 2023-12-05T09:57:36.409 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:36.410+0000 7f1409d9b700 1 --2- 172.21.15.100:0/2709858199 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7f13f406af00 0x7f13f406d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:57:36.409 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:36.411+0000 7f1409d9b700 1 --2- 172.21.15.100:0/2709858199 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7f13f406af00 0x7f13f406d3b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f140c071150 tx=0x7f13fc004630 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:57:36.409 INFO:tasks.workunit.client.0.smithi100.stdout:1/552: link db/d31/d3a/d4a/dad/d67/l79 db/d12/d1e/lb0 0 2023-12-05T09:57:36.409 INFO:tasks.workunit.client.0.smithi100.stdout:1/553: dread - db/d12/d1e/d26/d30/f83 zero size 2023-12-05T09:57:36.410 INFO:tasks.workunit.client.0.smithi100.stdout:6/944: rename d7/d11/d82/db9/fca to d7/d27/d35/f133 0 2023-12-05T09:57:36.411 INFO:tasks.workunit.client.1.smithi150.stdout:1/585: dwrite d6/d8/db/d1b/d79/f7a [0,4194304] 0 2023-12-05T09:57:36.411 INFO:tasks.workunit.client.1.smithi150.stdout:1/586: getdents d6/d8/db/d1b/d79/dca 0 2023-12-05T09:57:36.411 INFO:tasks.workunit.client.1.smithi150.stdout:1/587: chown d6/d38/f81 1099 1 2023-12-05T09:57:36.411 INFO:tasks.workunit.client.1.smithi150.stdout:1/588: write d6/d8/db/db1/fba [99543,93166] 0 2023-12-05T09:57:36.412 INFO:tasks.workunit.client.1.smithi150.stdout:5/591: getdents d1/d7f/d65 0 2023-12-05T09:57:36.412 INFO:tasks.workunit.client.1.smithi150.stdout:2/645: dread d0/d3/d5/d36/d86/fa0 [0,4194304] 0 2023-12-05T09:57:36.415 INFO:tasks.workunit.client.0.smithi100.stdout:0/555: dwrite da/d1b/d6b/d78/f88 [0,4194304] 0 2023-12-05T09:57:36.416 INFO:tasks.workunit.client.1.smithi150.stdout:8/669: dwrite d0/d41/f50 [0,4194304] 0 2023-12-05T09:57:36.416 INFO:tasks.workunit.client.0.smithi100.stdout:3/692: creat d0/d3d/d5c/d6f/d7f/d87/fec x:0 0 0 2023-12-05T09:57:36.419 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:36.422+0000 7f13faffd700 1 -- 172.21.15.100:0/2709858199 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f1400055150 con 0x7f140c108320 2023-12-05T09:57:36.420 INFO:tasks.workunit.client.1.smithi150.stdout:0/636: mkdir d5/d11/d71/d99/d9c/d96/de3 0 2023-12-05T09:57:36.420 INFO:tasks.workunit.client.1.smithi150.stdout:0/637: chown d5/d11/d32/l60 147 1 2023-12-05T09:57:36.420 INFO:tasks.workunit.client.1.smithi150.stdout:0/638: dread - d5/d11/d65/fb5 zero size 2023-12-05T09:57:36.420 INFO:tasks.workunit.client.1.smithi150.stdout:0/639: fsync d5/d11/d71/d74/fd0 0 2023-12-05T09:57:36.422 INFO:tasks.workunit.client.0.smithi100.stdout:1/554: dread db/d31/d3a/d4a/dad/f89 [0,4194304] 0 2023-12-05T09:57:36.424 INFO:tasks.workunit.client.0.smithi100.stdout:9/588: symlink d7/d1b/d22/lc7 0 2023-12-05T09:57:36.426 INFO:tasks.workunit.client.1.smithi150.stdout:3/615: truncate d6/d22/f31 2491538 0 2023-12-05T09:57:36.426 INFO:tasks.workunit.client.1.smithi150.stdout:3/616: write d6/d9/d3d/d56/d79/f7f [114910,3504] 0 2023-12-05T09:57:36.426 INFO:tasks.workunit.client.1.smithi150.stdout:3/617: chown d6/d9/d3d/d56/d53/d51/f8b 1136635 1 2023-12-05T09:57:36.427 INFO:tasks.workunit.client.0.smithi100.stdout:5/594: creat d0/d1b/d4d/d8e/d96/dc1/fce x:0 0 0 2023-12-05T09:57:36.427 INFO:tasks.workunit.client.1.smithi150.stdout:7/617: dwrite d2/f12 [0,4194304] 0 2023-12-05T09:57:36.427 INFO:tasks.workunit.client.1.smithi150.stdout:7/618: chown d2/d1b/d5b 68 1 2023-12-05T09:57:36.427 INFO:tasks.workunit.client.1.smithi150.stdout:7/619: truncate d2/db/d2e/d71/f8f 398375 0 2023-12-05T09:57:36.428 INFO:tasks.workunit.client.1.smithi150.stdout:6/548: dread d2/f26 [0,4194304] 0 2023-12-05T09:57:36.430 INFO:tasks.workunit.client.1.smithi150.stdout:1/589: rename d6/d47/d4c/d7c/d89/l8f to d6/d47/d4c/d60/dc7/ld0 0 2023-12-05T09:57:36.432 INFO:tasks.workunit.client.0.smithi100.stdout:4/533: rename de/d16/d1e/f96 to de/d16/d23/d60/d98/fa8 0 2023-12-05T09:57:36.433 INFO:tasks.workunit.client.0.smithi100.stdout:4/534: fsync de/d16/d23/d33/d3d/d44/f4d 0 2023-12-05T09:57:36.434 INFO:tasks.workunit.client.0.smithi100.stdout:6/945: symlink d7/d11/d1a/db7/df7/d126/d6a/de2/l134 0 2023-12-05T09:57:36.435 INFO:tasks.workunit.client.0.smithi100.stdout:6/946: fsync d7/d11/d1a/db7/df7/d126/d6a/d7c/f88 0 2023-12-05T09:57:36.436 INFO:tasks.workunit.client.1.smithi150.stdout:4/522: dread d0/f26 [0,4194304] 0 2023-12-05T09:57:36.437 INFO:tasks.workunit.client.1.smithi150.stdout:4/523: write d0/d3e/d48/d4d/f64 [848655,11470] 0 2023-12-05T09:57:36.440 INFO:tasks.workunit.client.0.smithi100.stdout:5/595: dread d0/d16/d2b/f7f [0,4194304] 0 2023-12-05T09:57:36.440 INFO:tasks.workunit.client.1.smithi150.stdout:8/670: rmdir d0/d41/d49/d1b/d24/d34/dbc/dbe 0 2023-12-05T09:57:36.440 INFO:tasks.workunit.client.1.smithi150.stdout:8/671: dread - d0/d41/d49/d1b/d24/d34/f97 zero size 2023-12-05T09:57:36.446 INFO:tasks.workunit.client.0.smithi100.stdout:3/693: mkdir d0/d2/de/d8d/de3/ded 0 2023-12-05T09:57:36.446 INFO:tasks.workunit.client.0.smithi100.stdout:3/694: stat d0/d3d/l3e 0 2023-12-05T09:57:36.446 INFO:tasks.workunit.client.0.smithi100.stdout:3/695: dread - d0/d2/de/d11/d7c/dd0/fdc zero size 2023-12-05T09:57:36.446 INFO:tasks.workunit.client.0.smithi100.stdout:3/696: fsync d0/d10/d39/f8b 0 2023-12-05T09:57:36.447 INFO:tasks.workunit.client.0.smithi100.stdout:3/697: chown d0/d2/d33/le6 276065 1 2023-12-05T09:57:36.447 INFO:tasks.workunit.client.0.smithi100.stdout:3/698: truncate d0/d3d/d5c/d5f/d73/fcd 56733 0 2023-12-05T09:57:36.447 INFO:tasks.workunit.client.0.smithi100.stdout:3/699: dread - d0/d2/de/d8d/fd9 zero size 2023-12-05T09:57:36.447 INFO:tasks.workunit.client.0.smithi100.stdout:3/700: write d0/d10/d39/f9c [980665,69513] 0 2023-12-05T09:57:36.447 INFO:tasks.workunit.client.0.smithi100.stdout:3/701: fsync d0/d2/de/d11/d7c/dd0/fdc 0 2023-12-05T09:57:36.447 INFO:tasks.workunit.client.1.smithi150.stdout:3/618: creat d6/d22/d37/fc7 x:0 0 0 2023-12-05T09:57:36.450 INFO:tasks.workunit.client.0.smithi100.stdout:9/589: link d7/d1b/d22/d93/c9e d7/d1b/da5/cc8 0 2023-12-05T09:57:36.451 INFO:tasks.workunit.client.1.smithi150.stdout:5/592: rename d1/d3/cbd to d1/d3/d6/d89/cd0 0 2023-12-05T09:57:36.451 INFO:tasks.workunit.client.1.smithi150.stdout:5/593: chown d1/d7f/d65/c82 39 1 2023-12-05T09:57:36.451 INFO:tasks.workunit.client.1.smithi150.stdout:5/594: write d1/d7f/fbc [832122,56452] 0 2023-12-05T09:57:36.456 INFO:tasks.workunit.client.0.smithi100.stdout:4/535: mknod de/ca9 0 2023-12-05T09:57:36.458 INFO:tasks.workunit.client.0.smithi100.stdout:6/947: symlink d7/d11/d1a/db7/d11f/l135 0 2023-12-05T09:57:36.461 INFO:tasks.workunit.client.0.smithi100.stdout:0/556: rename da/d22/d33/d74/f84 to da/d22/d33/d7f/fa5 0 2023-12-05T09:57:36.461 INFO:tasks.workunit.client.1.smithi150.stdout:1/590: mknod d6/d8/db/cd1 0 2023-12-05T09:57:36.462 INFO:tasks.workunit.client.1.smithi150.stdout:1/591: dread - d6/d8/d59/f90 zero size 2023-12-05T09:57:36.462 INFO:tasks.workunit.client.1.smithi150.stdout:1/592: write d6/d8/db/db1/fbc [522555,120014] 0 2023-12-05T09:57:36.462 INFO:tasks.workunit.client.1.smithi150.stdout:0/640: dwrite d5/d11/d71/f7c [0,4194304] 0 2023-12-05T09:57:36.465 INFO:tasks.workunit.client.0.smithi100.stdout:5/596: stat d0/d1f/d25/c71 0 2023-12-05T09:57:36.466 INFO:tasks.workunit.client.1.smithi150.stdout:3/619: read d6/d9/d3d/d56/d53/f9e [1217305,113508] 0 2023-12-05T09:57:36.466 INFO:tasks.workunit.client.1.smithi150.stdout:3/620: write d6/d9/d3d/d56/d79/f7f [570662,18028] 0 2023-12-05T09:57:36.466 INFO:tasks.workunit.client.1.smithi150.stdout:4/524: symlink d0/d3e/d6d/d95/l9d 0 2023-12-05T09:57:36.466 INFO:tasks.workunit.client.1.smithi150.stdout:3/621: write d6/d9/d3d/d56/d71/fc2 [55155,40268] 0 2023-12-05T09:57:36.466 INFO:tasks.workunit.client.1.smithi150.stdout:8/672: getdents d0/d41/d49/d1b/d24/d2e/d4d 0 2023-12-05T09:57:36.466 INFO:tasks.workunit.client.1.smithi150.stdout:3/622: write d6/d22/d37/f4a [2124870,13734] 0 2023-12-05T09:57:36.466 INFO:tasks.workunit.client.1.smithi150.stdout:8/673: write d0/d41/d49/d1b/d24/d2e/f44 [3970407,40607] 0 2023-12-05T09:57:36.467 INFO:tasks.workunit.client.1.smithi150.stdout:8/674: truncate d0/d41/d49/d1b/d24/d2e/f95 732654 0 2023-12-05T09:57:36.467 INFO:tasks.workunit.client.1.smithi150.stdout:8/675: chown d0/d8/c33 217917005 1 2023-12-05T09:57:36.468 INFO:tasks.workunit.client.1.smithi150.stdout:2/646: rename d0/d3/d27/c2d to d0/d3/d27/dac/d81/cde 0 2023-12-05T09:57:36.471 INFO:tasks.workunit.client.0.smithi100.stdout:3/702: mkdir d0/d2/de/db8/dee 0 2023-12-05T09:57:36.473 INFO:tasks.workunit.client.0.smithi100.stdout:0/557: dread da/f37 [0,4194304] 0 2023-12-05T09:57:36.474 INFO:tasks.workunit.client.0.smithi100.stdout:4/536: write f1 [6525659,64599] 0 2023-12-05T09:57:36.475 INFO:tasks.workunit.client.0.smithi100.stdout:1/555: getdents db/d12/d1e 0 2023-12-05T09:57:36.478 INFO:tasks.workunit.client.0.smithi100.stdout:9/590: mkdir d7/d1b/d22/d93/dc9 0 2023-12-05T09:57:36.478 INFO:tasks.workunit.client.0.smithi100.stdout:1/556: read db/d31/d3a/d3b/f4b [138842,79869] 0 2023-12-05T09:57:36.478 INFO:tasks.workunit.client.0.smithi100.stdout:1/557: stat db/d12/d1e/l2f 0 2023-12-05T09:57:36.478 INFO:tasks.workunit.client.0.smithi100.stdout:1/558: creat db/d12/fb1 x:0 0 0 2023-12-05T09:57:36.479 INFO:tasks.workunit.client.1.smithi150.stdout:0/641: mknod d5/d11/d71/d99/d9c/d96/dd5/d67/da8/ce4 0 2023-12-05T09:57:36.481 INFO:tasks.workunit.client.0.smithi100.stdout:6/948: getdents d7/d11/d1a/db7/df7/d126/d6a/de2 0 2023-12-05T09:57:36.483 INFO:tasks.workunit.client.1.smithi150.stdout:9/549: dwrite d3/d9/dc/d1f/d24/f9d [0,4194304] 0 2023-12-05T09:57:36.483 INFO:tasks.workunit.client.1.smithi150.stdout:4/525: creat d0/d3e/d48/f9e x:0 0 0 2023-12-05T09:57:36.486 INFO:tasks.workunit.client.0.smithi100.stdout:0/558: write da/fd [205314,17109] 0 2023-12-05T09:57:36.486 INFO:tasks.workunit.client.0.smithi100.stdout:0/559: truncate da/fd 1730745 0 2023-12-05T09:57:36.486 INFO:tasks.workunit.client.0.smithi100.stdout:0/560: write da/d22/d33/d7f/d94/f9c [884437,44764] 0 2023-12-05T09:57:36.487 INFO:tasks.workunit.client.1.smithi150.stdout:3/623: symlink d6/d9/d3d/d56/d79/lc8 0 2023-12-05T09:57:36.490 INFO:tasks.workunit.client.0.smithi100.stdout:3/703: mkdir d0/d3d/d90/def 0 2023-12-05T09:57:36.496 INFO:tasks.workunit.client.1.smithi150.stdout:8/676: symlink d0/d41/d49/d1b/d24/d5b/d87/ld2 0 2023-12-05T09:57:36.497 INFO:tasks.workunit.client.0.smithi100.stdout:4/537: creat de/d16/d23/d60/d98/da6/faa x:0 0 0 2023-12-05T09:57:36.500 INFO:tasks.workunit.client.1.smithi150.stdout:7/620: rename d2/db/d17/d38/dc8/fa7 to d2/db/d17/d88/fcf 0 2023-12-05T09:57:36.502 INFO:tasks.workunit.client.1.smithi150.stdout:2/647: truncate d0/f16 688779 0 2023-12-05T09:57:36.507 INFO:tasks.workunit.client.0.smithi100.stdout:6/949: unlink d7/d27/d97/ca9 0 2023-12-05T09:57:36.508 INFO:tasks.workunit.client.1.smithi150.stdout:0/642: mknod d5/d11/d71/d74/ce5 0 2023-12-05T09:57:36.508 INFO:tasks.workunit.client.1.smithi150.stdout:1/593: dwrite d6/d8/d54/d94/f96 [4194304,4194304] 0 2023-12-05T09:57:36.508 INFO:tasks.workunit.client.1.smithi150.stdout:1/594: creat d6/d8/db/de/fd2 x:0 0 0 2023-12-05T09:57:36.510 INFO:tasks.workunit.client.0.smithi100.stdout:3/704: creat d0/d2/de/d11/ff0 x:0 0 0 2023-12-05T09:57:36.511 INFO:tasks.workunit.client.0.smithi100.stdout:4/538: mknod de/d16/d23/d36/d7d/cab 0 2023-12-05T09:57:36.511 INFO:tasks.workunit.client.0.smithi100.stdout:4/539: chown de/d16/f83 354 1 2023-12-05T09:57:36.512 INFO:tasks.workunit.client.1.smithi150.stdout:4/526: mknod d0/d3e/d5b/d80/c9f 0 2023-12-05T09:57:36.513 INFO:tasks.workunit.client.0.smithi100.stdout:5/597: dwrite d0/d16/d2b/d48/df/fc6 [0,4194304] 0 2023-12-05T09:57:36.513 INFO:tasks.workunit.client.0.smithi100.stdout:9/591: link d7/d1b/d22/d2a/f48 d7/d1b/d22/d51/fca 0 2023-12-05T09:57:36.514 INFO:tasks.workunit.client.1.smithi150.stdout:3/624: write d6/d9/d3d/d52/f76 [2451998,16112] 0 2023-12-05T09:57:36.515 INFO:tasks.workunit.client.1.smithi150.stdout:3/625: chown d6/d9/d3d/d56/d71/db6/dc1/d67/f7a 15858 1 2023-12-05T09:57:36.518 INFO:tasks.workunit.client.1.smithi150.stdout:6/549: rename d2/d23/d2e/c56 to d2/d23/d3b/d64/d7a/d5d/d6b/d9c/cb8 0 2023-12-05T09:57:36.518 INFO:tasks.workunit.client.1.smithi150.stdout:6/550: truncate d2/d23/f67 4566996 0 2023-12-05T09:57:36.518 INFO:tasks.workunit.client.1.smithi150.stdout:6/551: fdatasync d2/d23/d3b/d64/d7a/d5d/d6b/f4b 0 2023-12-05T09:57:36.519 INFO:tasks.workunit.client.0.smithi100.stdout:6/950: symlink d7/d11/d82/db9/dfd/l136 0 2023-12-05T09:57:36.519 INFO:tasks.workunit.client.0.smithi100.stdout:6/951: chown d7/d11/d82/cce 654520331 1 2023-12-05T09:57:36.525 INFO:tasks.workunit.client.1.smithi150.stdout:0/643: write d5/d11/f24 [3275094,81998] 0 2023-12-05T09:57:36.526 INFO:tasks.workunit.client.1.smithi150.stdout:5/595: dwrite d1/d7f/d65/d3b/d37/f48 [0,4194304] 0 2023-12-05T09:57:36.526 INFO:tasks.workunit.client.1.smithi150.stdout:5/596: write d1/f96 [404017,81577] 0 2023-12-05T09:57:36.527 INFO:tasks.workunit.client.1.smithi150.stdout:5/597: getdents d1/d3/d6/d26/dca/dcd 0 2023-12-05T09:57:36.528 INFO:tasks.workunit.client.1.smithi150.stdout:7/621: creat d2/db/d30/d47/fd0 x:0 0 0 2023-12-05T09:57:36.534 INFO:tasks.workunit.client.1.smithi150.stdout:1/595: unlink d6/d8/d54/f67 0 2023-12-05T09:57:36.535 INFO:tasks.workunit.client.0.smithi100.stdout:5/598: creat d0/fcf x:0 0 0 2023-12-05T09:57:36.536 INFO:tasks.workunit.client.1.smithi150.stdout:9/550: symlink d3/d9/dc/d1f/lb6 0 2023-12-05T09:57:36.539 INFO:tasks.workunit.client.0.smithi100.stdout:3/705: rename d0/d10/d39/dab/faf to d0/d2/de/d12/ff1 0 2023-12-05T09:57:36.543 INFO:tasks.workunit.client.1.smithi150.stdout:3/626: unlink d6/d9/d8d/c82 0 2023-12-05T09:57:36.545 INFO:tasks.workunit.client.0.smithi100.stdout:5/599: symlink d0/ld0 0 2023-12-05T09:57:36.545 INFO:tasks.workunit.client.0.smithi100.stdout:5/600: creat d0/d1b/d4d/d8e/d96/dc1/fd1 x:0 0 0 2023-12-05T09:57:36.546 INFO:tasks.workunit.client.1.smithi150.stdout:1/596: dread d6/d3c/fa9 [0,4194304] 0 2023-12-05T09:57:36.547 INFO:tasks.workunit.client.1.smithi150.stdout:1/597: write d6/d8/d59/f90 [312393,11976] 0 2023-12-05T09:57:36.548 INFO:tasks.workunit.client.1.smithi150.stdout:1/598: chown d6/d8/db/de/lc9 99181864 1 2023-12-05T09:57:36.548 INFO:tasks.workunit.client.1.smithi150.stdout:6/552: creat d2/d23/d3b/d64/d7a/fb9 x:0 0 0 2023-12-05T09:57:36.549 INFO:tasks.workunit.client.1.smithi150.stdout:2/648: read d0/d3/d5/d36/d86/fce [1203476,129189] 0 2023-12-05T09:57:36.549 INFO:tasks.workunit.client.1.smithi150.stdout:2/649: chown d0/d3/c4b 1437059 1 2023-12-05T09:57:36.554 INFO:tasks.workunit.client.0.smithi100.stdout:1/559: dwrite db/d12/d1e/d26/d30/d52/d84/faf [0,4194304] 0 2023-12-05T09:57:36.554 INFO:tasks.workunit.client.0.smithi100.stdout:1/560: write db/d12/d1e/f38 [2796930,45755] 0 2023-12-05T09:57:36.554 INFO:tasks.workunit.client.0.smithi100.stdout:0/561: write da/d1b/d6b/d78/f88 [2292939,59210] 0 2023-12-05T09:57:36.554 INFO:tasks.workunit.client.1.smithi150.stdout:0/644: creat d5/d11/d71/d5f/d6a/fe6 x:0 0 0 2023-12-05T09:57:36.560 INFO:tasks.workunit.client.1.smithi150.stdout:7/622: mknod d2/db/d30/d13/d4f/d5a/d5c/cd1 0 2023-12-05T09:57:36.560 INFO:tasks.workunit.client.1.smithi150.stdout:7/623: fdatasync d2/db/d30/d18/f6c 0 2023-12-05T09:57:36.560 INFO:tasks.workunit.client.1.smithi150.stdout:7/624: fdatasync d2/db/d62/f92 0 2023-12-05T09:57:36.562 INFO:tasks.workunit.client.1.smithi150.stdout:1/599: write d6/d8/d59/f91 [2152338,75376] 0 2023-12-05T09:57:36.566 INFO:tasks.workunit.client.1.smithi150.stdout:9/551: mkdir d3/d9/d67/dac/dad/db7 0 2023-12-05T09:57:36.576 INFO:tasks.workunit.client.0.smithi100.stdout:1/561: dread db/d31/f81 [0,4194304] 0 2023-12-05T09:57:36.577 INFO:tasks.workunit.client.1.smithi150.stdout:3/627: creat d6/d9/d43/d47/d8c/fc9 x:0 0 0 2023-12-05T09:57:36.577 INFO:tasks.workunit.client.0.smithi100.stdout:4/540: dwrite de/d16/d1e/f7c [0,4194304] 0 2023-12-05T09:57:36.577 INFO:tasks.workunit.client.0.smithi100.stdout:4/541: chown de/d66 62667749 1 2023-12-05T09:57:36.577 INFO:tasks.workunit.client.0.smithi100.stdout:4/542: write f1 [2607615,58082] 0 2023-12-05T09:57:36.578 INFO:tasks.workunit.client.1.smithi150.stdout:2/650: dread d0/fc5 [0,4194304] 0 2023-12-05T09:57:36.594 INFO:tasks.workunit.client.0.smithi100.stdout:9/592: dwrite d7/d1b/d22/f4a [0,4194304] 0 2023-12-05T09:57:36.594 INFO:tasks.workunit.client.1.smithi150.stdout:4/527: dwrite d0/d3e/d48/d4d/f99 [0,4194304] 0 2023-12-05T09:57:36.603 INFO:tasks.workunit.client.1.smithi150.stdout:6/553: rename d2/d23/d3b/d64/d7a/f4d to d2/d23/d2e/d93/fba 0 2023-12-05T09:57:36.604 INFO:tasks.workunit.client.1.smithi150.stdout:0/645: mknod d5/dbd/ce7 0 2023-12-05T09:57:36.610 INFO:tasks.workunit.client.1.smithi150.stdout:1/600: stat d6/d47/d4c/d7c/c9e 0 2023-12-05T09:57:36.616 INFO:tasks.workunit.client.1.smithi150.stdout:4/528: write d0/d3e/d48/d4d/f57 [2777977,93348] 0 2023-12-05T09:57:36.616 INFO:tasks.workunit.client.1.smithi150.stdout:4/529: stat d0/d3e/d6d/d4b/c4f 0 2023-12-05T09:57:36.617 INFO:tasks.workunit.client.1.smithi150.stdout:8/677: dwrite d0/d41/fb1 [0,4194304] 0 2023-12-05T09:57:36.617 INFO:tasks.workunit.client.1.smithi150.stdout:5/598: dwrite d1/d2e/da6/d24/f7a [0,4194304] 0 2023-12-05T09:57:36.617 INFO:tasks.workunit.client.1.smithi150.stdout:9/552: symlink d3/d1b/d46/d55/d64/d94/lb8 0 2023-12-05T09:57:36.617 INFO:tasks.workunit.client.0.smithi100.stdout:6/952: dwrite d7/d11/d82/ffb [0,4194304] 0 2023-12-05T09:57:36.617 INFO:tasks.workunit.client.0.smithi100.stdout:6/953: creat d7/d11/d82/db9/f137 x:0 0 0 2023-12-05T09:57:36.621 INFO:tasks.workunit.client.0.smithi100.stdout:5/601: dwrite d0/d27/fbb [4194304,4194304] 0 2023-12-05T09:57:36.622 INFO:tasks.workunit.client.1.smithi150.stdout:2/651: mkdir d0/d3/d27/d95/ddf 0 2023-12-05T09:57:36.626 INFO:tasks.workunit.client.0.smithi100.stdout:0/562: rename da/d1b/c21 to da/d1b/d36/d9f/ca6 0 2023-12-05T09:57:36.630 INFO:tasks.workunit.client.0.smithi100.stdout:3/706: mkdir d0/d3d/d5c/d5f/d67/df2 0 2023-12-05T09:57:36.645 INFO:tasks.workunit.client.1.smithi150.stdout:6/554: rename d2/d23/d3b/d64/l77 to d2/d23/d2e/d44/lbb 0 2023-12-05T09:57:36.645 INFO:tasks.workunit.client.1.smithi150.stdout:4/530: dread d0/f24 [0,4194304] 0 2023-12-05T09:57:36.645 INFO:tasks.workunit.client.1.smithi150.stdout:0/646: link d5/fa d5/d11/d71/d5f/d6a/fe8 0 2023-12-05T09:57:36.645 INFO:tasks.workunit.client.1.smithi150.stdout:6/555: creat d2/d23/d2e/d44/fbc x:0 0 0 2023-12-05T09:57:36.646 INFO:tasks.workunit.client.1.smithi150.stdout:3/628: dwrite d6/d9/fbd [0,4194304] 0 2023-12-05T09:57:36.647 INFO:tasks.workunit.client.1.smithi150.stdout:1/601: mknod d6/d8c/cd3 0 2023-12-05T09:57:36.647 INFO:tasks.workunit.client.1.smithi150.stdout:1/602: chown d6/d8/l2e 53331 1 2023-12-05T09:57:36.647 INFO:tasks.workunit.client.1.smithi150.stdout:1/603: dread - d6/d8/db/de/f93 zero size 2023-12-05T09:57:36.647 INFO:tasks.workunit.client.1.smithi150.stdout:1/604: chown d6/d3c/lb8 3488409 1 2023-12-05T09:57:36.649 INFO:tasks.workunit.client.1.smithi150.stdout:7/625: dwrite d2/db/d30/d53/d90/fc9 [0,4194304] 0 2023-12-05T09:57:36.649 INFO:tasks.workunit.client.1.smithi150.stdout:2/652: dread d0/d3/d11/f18 [0,4194304] 0 2023-12-05T09:57:36.651 INFO:tasks.workunit.client.0.smithi100.stdout:1/562: creat db/d12/d1e/d26/d30/d52/d84/d8c/fb2 x:0 0 0 2023-12-05T09:57:36.651 INFO:tasks.workunit.client.0.smithi100.stdout:1/563: creat db/d12/fb3 x:0 0 0 2023-12-05T09:57:36.653 INFO:tasks.workunit.client.1.smithi150.stdout:8/678: mkdir d0/d41/d49/dd3 0 2023-12-05T09:57:36.653 INFO:tasks.workunit.client.1.smithi150.stdout:8/679: creat d0/d41/d49/d1b/fd4 x:0 0 0 2023-12-05T09:57:36.655 INFO:tasks.workunit.client.0.smithi100.stdout:4/543: rename de/d16/d23/d33/d51/c69 to de/d16/d23/d33/d51/cac 0 2023-12-05T09:57:36.655 INFO:tasks.workunit.client.0.smithi100.stdout:4/544: dread - de/d16/d23/d33/d3d/f6f zero size 2023-12-05T09:57:36.658 INFO:tasks.workunit.client.1.smithi150.stdout:9/553: mknod d3/d9/dc/d1f/d24/d75/d95/cb9 0 2023-12-05T09:57:36.659 INFO:tasks.workunit.client.0.smithi100.stdout:9/593: mkdir d7/d1b/d22/d93/dc9/dcb 0 2023-12-05T09:57:36.659 INFO:tasks.workunit.client.0.smithi100.stdout:9/594: chown d7/d60/cbb 34 1 2023-12-05T09:57:36.660 INFO:tasks.workunit.client.0.smithi100.stdout:8/507: sync 2023-12-05T09:57:36.660 INFO:tasks.workunit.client.0.smithi100.stdout:8/508: readlink d0/d12/d13/d16/d22/d72/l89 0 2023-12-05T09:57:36.660 INFO:tasks.workunit.client.0.smithi100.stdout:8/509: fsync d0/d12/d13/d45/f5d 0 2023-12-05T09:57:36.662 INFO:tasks.workunit.client.1.smithi150.stdout:5/599: rename d1/d7f/f4f to d1/d3/fd1 0 2023-12-05T09:57:36.665 INFO:tasks.workunit.client.1.smithi150.stdout:4/531: mknod d0/d3e/d6d/ca0 0 2023-12-05T09:57:36.670 INFO:tasks.workunit.client.1.smithi150.stdout:0/647: rmdir d5/d11/d16 39 2023-12-05T09:57:36.675 INFO:tasks.workunit.client.1.smithi150.stdout:6/556: stat d2/d23/d3b/d64/d7a/d5d/d6b/d9c/cb8 0 2023-12-05T09:57:36.675 INFO:tasks.workunit.client.0.smithi100.stdout:7/546: sync 2023-12-05T09:57:36.675 INFO:tasks.workunit.client.0.smithi100.stdout:7/547: dread - d3/dc/d11/d13/de/d18/d3b/d40/d4c/d7f/f92 zero size 2023-12-05T09:57:36.675 INFO:tasks.workunit.client.0.smithi100.stdout:2/709: sync 2023-12-05T09:57:36.676 INFO:tasks.workunit.client.0.smithi100.stdout:6/954: truncate d7/d27/d97/fb2 493176 0 2023-12-05T09:57:36.678 INFO:tasks.workunit.client.0.smithi100.stdout:0/563: creat da/d1b/d6b/fa7 x:0 0 0 2023-12-05T09:57:36.679 INFO:tasks.workunit.client.1.smithi150.stdout:1/605: symlink d6/d47/d4c/ld4 0 2023-12-05T09:57:36.680 INFO:tasks.workunit.client.1.smithi150.stdout:1/606: stat d6/d8/fc5 0 2023-12-05T09:57:36.680 INFO:tasks.workunit.client.1.smithi150.stdout:1/607: fdatasync d6/d47/d4c/f5d 0 2023-12-05T09:57:36.682 INFO:tasks.workunit.client.0.smithi100.stdout:3/707: creat d0/d2/de/db8/dee/ff3 x:0 0 0 2023-12-05T09:57:36.687 INFO:tasks.workunit.client.1.smithi150.stdout:2/653: symlink d0/d3/le0 0 2023-12-05T09:57:36.690 INFO:tasks.workunit.client.0.smithi100.stdout:1/564: rename db/d31/d3a/c65 to db/d12/cb4 0 2023-12-05T09:57:36.693 INFO:tasks.workunit.client.0.smithi100.stdout:2/710: dread d7/da/d18/d1b/d2c/d3f/d46/f47 [0,4194304] 0 2023-12-05T09:57:36.703 INFO:tasks.workunit.client.0.smithi100.stdout:1/565: dread db/d12/f14 [0,4194304] 0 2023-12-05T09:57:36.703 INFO:tasks.workunit.client.1.smithi150.stdout:9/554: getdents d3/d1b/d79 0 2023-12-05T09:57:36.703 INFO:tasks.workunit.client.1.smithi150.stdout:9/555: chown d3/d9/dc/f33 13303 1 2023-12-05T09:57:36.704 INFO:tasks.workunit.client.1.smithi150.stdout:9/556: read - d3/d9/d6e/d76/f9f zero size 2023-12-05T09:57:36.705 INFO:tasks.workunit.client.1.smithi150.stdout:3/629: rename d6/d9/d3d/d56/d71/db6/dc1/d9a/fa9 to d6/d25/fca 0 2023-12-05T09:57:36.708 INFO:tasks.workunit.client.1.smithi150.stdout:5/600: creat d1/d7f/fd2 x:0 0 0 2023-12-05T09:57:36.712 INFO:tasks.workunit.client.1.smithi150.stdout:4/532: mkdir d0/d3e/d5b/d80/da1 0 2023-12-05T09:57:36.714 INFO:tasks.workunit.client.0.smithi100.stdout:6/955: unlink d7/d11/d1a/db7/d11f/l135 0 2023-12-05T09:57:36.714 INFO:tasks.workunit.client.0.smithi100.stdout:6/956: write d7/d11/d82/ff4 [734349,61987] 0 2023-12-05T09:57:36.715 INFO:tasks.workunit.client.1.smithi150.stdout:0/648: symlink d5/d11/d71/d5f/le9 0 2023-12-05T09:57:36.717 INFO:tasks.workunit.client.0.smithi100.stdout:5/602: getdents d0/d1f/d25 0 2023-12-05T09:57:36.718 INFO:tasks.workunit.client.1.smithi150.stdout:9/557: write d3/d9/f31 [1357715,26159] 0 2023-12-05T09:57:36.718 INFO:tasks.workunit.client.1.smithi150.stdout:1/608: dwrite d6/d8/db/de/fd2 [0,4194304] 0 2023-12-05T09:57:36.719 INFO:tasks.workunit.client.1.smithi150.stdout:6/557: dwrite d2/d23/d2e/d93/fba [4194304,4194304] 0 2023-12-05T09:57:36.723 INFO:tasks.workunit.client.0.smithi100.stdout:3/708: unlink d0/d10/f71 0 2023-12-05T09:57:36.723 INFO:tasks.workunit.client.1.smithi150.stdout:7/626: getdents d2/db/d30/d18/d1a/d1e 0 2023-12-05T09:57:36.723 INFO:tasks.workunit.client.1.smithi150.stdout:7/627: chown d2/d1b 4 1 2023-12-05T09:57:36.723 INFO:tasks.workunit.client.1.smithi150.stdout:7/628: chown d2/db/d30/d13/d4f/d5a 4119 1 2023-12-05T09:57:36.723 INFO:tasks.workunit.client.1.smithi150.stdout:7/629: stat d2/db/d30/d53/d90/fb8 0 2023-12-05T09:57:36.727 INFO:tasks.workunit.client.0.smithi100.stdout:1/566: dread db/d12/f16 [0,4194304] 0 2023-12-05T09:57:36.727 INFO:tasks.workunit.client.0.smithi100.stdout:1/567: read - db/d12/d1e/f95 zero size 2023-12-05T09:57:36.731 INFO:tasks.workunit.client.1.smithi150.stdout:9/558: write d3/d9/dc/f92 [389983,71272] 0 2023-12-05T09:57:36.732 INFO:tasks.workunit.client.0.smithi100.stdout:9/595: rename d7/d35/d71/f78 to d7/d60/fcc 0 2023-12-05T09:57:36.737 INFO:tasks.workunit.client.0.smithi100.stdout:2/711: rmdir d7/da/d13/d69/d6e 39 2023-12-05T09:57:36.737 INFO:tasks.workunit.client.0.smithi100.stdout:2/712: chown d7/da/d18/d1b/d2c 219 1 2023-12-05T09:57:36.740 INFO:tasks.workunit.client.1.smithi150.stdout:8/680: mknod d0/cd5 0 2023-12-05T09:57:36.743 INFO:tasks.workunit.client.1.smithi150.stdout:3/630: mknod d6/d22/d37/ccb 0 2023-12-05T09:57:36.743 INFO:tasks.workunit.client.1.smithi150.stdout:3/631: readlink d6/d22/l54 0 2023-12-05T09:57:36.743 INFO:tasks.workunit.client.0.smithi100.stdout:4/545: rmdir de/d16/d23/d36 39 2023-12-05T09:57:36.747 INFO:tasks.workunit.client.1.smithi150.stdout:5/601: rename d1/d3/d6/d11/lb1 to d1/d64/d31/ld3 0 2023-12-05T09:57:36.747 INFO:tasks.workunit.client.1.smithi150.stdout:5/602: readlink d1/d2e/da6/d24/d59/l99 0 2023-12-05T09:57:36.750 INFO:tasks.workunit.client.1.smithi150.stdout:4/533: mkdir d0/d3e/d5b/d80/d44/da2 0 2023-12-05T09:57:36.750 INFO:tasks.workunit.client.1.smithi150.stdout:4/534: dread - d0/d3e/d5b/d80/f7b zero size 2023-12-05T09:57:36.750 INFO:tasks.workunit.client.1.smithi150.stdout:4/535: stat d0/f41 0 2023-12-05T09:57:36.750 INFO:tasks.workunit.client.1.smithi150.stdout:4/536: creat d0/d5f/fa3 x:0 0 0 2023-12-05T09:57:36.752 INFO:tasks.workunit.client.1.smithi150.stdout:0/649: creat d5/d11/d71/d99/d9c/d96/dd5/d67/fea x:0 0 0 2023-12-05T09:57:36.757 INFO:tasks.workunit.client.0.smithi100.stdout:8/510: rmdir d0/d12/d13 39 2023-12-05T09:57:36.759 INFO:tasks.workunit.client.1.smithi150.stdout:1/609: mknod d6/d38/cd5 0 2023-12-05T09:57:36.763 INFO:tasks.workunit.client.0.smithi100.stdout:6/957: symlink d7/d11/d1a/db7/df7/d126/d6a/d7c/d8d/l138 0 2023-12-05T09:57:36.766 INFO:tasks.workunit.client.1.smithi150.stdout:6/558: link d2/d23/d2e/f43 d2/d23/d3b/d64/d7a/d5d/fbd 0 2023-12-05T09:57:36.768 INFO:tasks.workunit.client.0.smithi100.stdout:5/603: unlink d0/d4/d14/l76 0 2023-12-05T09:57:36.769 INFO:tasks.workunit.client.0.smithi100.stdout:5/604: write d0/d16/dc9/fa6 [704571,51052] 0 2023-12-05T09:57:36.772 INFO:tasks.workunit.client.0.smithi100.stdout:3/709: link d0/d3d/d5c/d6f/d7f/fd7 d0/d2/de/d11/d7c/dd0/ff4 0 2023-12-05T09:57:36.772 INFO:tasks.workunit.client.0.smithi100.stdout:3/710: chown d0/d3d/d5c/d5f/l85 393 1 2023-12-05T09:57:36.773 INFO:tasks.workunit.client.1.smithi150.stdout:9/559: mknod d3/d82/cba 0 2023-12-05T09:57:36.773 INFO:tasks.workunit.client.1.smithi150.stdout:9/560: fdatasync d3/d9/d6e/d84/fb1 0 2023-12-05T09:57:36.774 INFO:tasks.workunit.client.0.smithi100.stdout:1/568: mknod db/d12/d1e/d26/d30/d6e/cb5 0 2023-12-05T09:57:36.776 INFO:tasks.workunit.client.1.smithi150.stdout:2/654: getdents d0/d3/d5/d36/d86 0 2023-12-05T09:57:36.780 INFO:tasks.workunit.client.0.smithi100.stdout:2/713: creat d7/da/ff2 x:0 0 0 2023-12-05T09:57:36.782 INFO:tasks.workunit.client.0.smithi100.stdout:4/546: truncate f9 44626 0 2023-12-05T09:57:36.786 INFO:tasks.workunit.client.0.smithi100.stdout:8/511: truncate d0/d12/d13/d16/f3a 1418598 0 2023-12-05T09:57:36.786 INFO:tasks.workunit.client.0.smithi100.stdout:3/711: creat d0/d2/d33/ff5 x:0 0 0 2023-12-05T09:57:36.791 INFO:tasks.workunit.client.0.smithi100.stdout:1/569: unlink db/d12/d1e/d26/d39/c54 0 2023-12-05T09:57:36.791 INFO:tasks.workunit.client.0.smithi100.stdout:1/570: truncate db/d12/fb1 828046 0 2023-12-05T09:57:36.791 INFO:tasks.workunit.client.0.smithi100.stdout:7/548: rename d3/dc/d11/d13/de/d18/d3b/d40/fbb to d3/dc/d11/d13/fc6 0 2023-12-05T09:57:36.791 INFO:tasks.workunit.client.0.smithi100.stdout:7/549: dread - d3/dc/d11/d13/d37/fa9 zero size 2023-12-05T09:57:36.795 INFO:tasks.workunit.client.1.smithi150.stdout:2/655: read d0/d3/fb2 [913498,94586] 0 2023-12-05T09:57:36.795 INFO:tasks.workunit.client.0.smithi100.stdout:4/547: write de/d16/d23/d36/f6a [18056,106899] 0 2023-12-05T09:57:36.797 INFO:tasks.workunit.client.0.smithi100.stdout:2/714: unlink d7/f34 0 2023-12-05T09:57:36.804 INFO:tasks.workunit.client.0.smithi100.stdout:8/512: link d0/d12/d13/d16/d42/d43/l62 d0/d12/d13/d16/d22/d72/l8d 0 2023-12-05T09:57:36.805 INFO:tasks.workunit.client.0.smithi100.stdout:6/958: getdents d7 0 2023-12-05T09:57:36.809 INFO:tasks.workunit.client.0.smithi100.stdout:3/712: mkdir d0/d2/de/db8/dee/df6 0 2023-12-05T09:57:36.809 INFO:tasks.workunit.client.0.smithi100.stdout:3/713: write d0/d3d/d5c/d6f/d7f/fd7 [1657451,73140] 0 2023-12-05T09:57:36.815 INFO:tasks.workunit.client.0.smithi100.stdout:1/571: dread db/d31/d3a/f3e [4194304,4194304] 0 2023-12-05T09:57:36.816 INFO:tasks.workunit.client.0.smithi100.stdout:0/564: rename da/d22/d33/d7f/fa5 to da/d22/d33/d74/fa8 0 2023-12-05T09:57:36.817 INFO:tasks.workunit.client.0.smithi100.stdout:0/565: write da/d1b/f3c [1660079,79437] 0 2023-12-05T09:57:36.817 INFO:tasks.workunit.client.0.smithi100.stdout:0/566: write da/f11 [5373864,708] 0 2023-12-05T09:57:36.821 INFO:tasks.workunit.client.0.smithi100.stdout:4/548: symlink de/d16/d23/d33/d3d/d44/lad 0 2023-12-05T09:57:36.821 INFO:tasks.workunit.client.0.smithi100.stdout:4/549: chown de/d16/f67 202015524 1 2023-12-05T09:57:36.825 INFO:tasks.workunit.client.0.smithi100.stdout:2/715: symlink d7/da/ddc/lf3 0 2023-12-05T09:57:36.829 INFO:tasks.workunit.client.0.smithi100.stdout:2/716: truncate d7/da/d13/d69/d6e/d71/f8c 2820700 0 2023-12-05T09:57:36.829 INFO:tasks.workunit.client.0.smithi100.stdout:2/717: fsync d7/da/d18/d21/d86/fd7 0 2023-12-05T09:57:36.829 INFO:tasks.workunit.client.0.smithi100.stdout:7/550: dwrite d3/dc/d11/d13/de/d18/d3b/d40/d46/fba [0,4194304] 0 2023-12-05T09:57:36.829 INFO:tasks.workunit.client.0.smithi100.stdout:8/513: unlink d0/d12/d13/f6c 0 2023-12-05T09:57:36.832 INFO:tasks.workunit.client.0.smithi100.stdout:0/567: dread da/d1b/f66 [0,4194304] 0 2023-12-05T09:57:36.832 INFO:tasks.workunit.client.0.smithi100.stdout:0/568: creat da/d22/d33/fa9 x:0 0 0 2023-12-05T09:57:36.832 INFO:tasks.workunit.client.0.smithi100.stdout:0/569: write da/d2a/d45/f97 [72193,60980] 0 2023-12-05T09:57:36.844 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:36 smithi100 ceph-mon[107145]: pgmap v34: 65 pgs: 65 active+clean; 2.4 GiB data, 8.7 GiB used, 528 GiB / 536 GiB avail; 257 MiB/s rd, 304 MiB/s wr, 469 op/s 2023-12-05T09:57:36.844 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:36 smithi100 ceph-mon[107145]: from='client.24517 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:57:36.844 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:36 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/1446072827' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:57:36.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:36 smithi150 ceph-mon[116142]: pgmap v34: 65 pgs: 65 active+clean; 2.4 GiB data, 8.7 GiB used, 528 GiB / 536 GiB avail; 257 MiB/s rd, 304 MiB/s wr, 469 op/s 2023-12-05T09:57:36.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:36 smithi150 ceph-mon[116142]: from='client.24517 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:57:36.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:36 smithi150 ceph-mon[116142]: from='client.? 172.21.15.100:0/1446072827' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:57:36.846 INFO:tasks.workunit.client.0.smithi100.stdout:3/714: creat d0/d3d/d5c/d5f/d67/df2/ff7 x:0 0 0 2023-12-05T09:57:36.846 INFO:tasks.workunit.client.0.smithi100.stdout:9/596: rename d7/d1b/d22/d51/d32/d96/db9 to d7/d35/d71/d9a/dcd 0 2023-12-05T09:57:36.846 INFO:tasks.workunit.client.0.smithi100.stdout:4/550: mkdir de/d16/d23/d33/dae 0 2023-12-05T09:57:36.850 INFO:tasks.workunit.client.0.smithi100.stdout:9/597: creat d7/d1b/d22/fce x:0 0 0 2023-12-05T09:57:36.850 INFO:tasks.workunit.client.0.smithi100.stdout:7/551: symlink d3/dc/d11/d13/de/d2d/d42/lc7 0 2023-12-05T09:57:36.855 INFO:tasks.workunit.client.0.smithi100.stdout:8/514: rmdir d0/d12/d13/d16 39 2023-12-05T09:57:36.857 INFO:tasks.workunit.client.1.smithi150.stdout:8/681: creat d0/d41/d49/dd3/fd6 x:0 0 0 2023-12-05T09:57:36.859 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:36.862+0000 7f1410ec1700 1 -- 172.21.15.100:0/2709858199 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f140c10bc10 con 0x7f140c108320 2023-12-05T09:57:36.860 INFO:tasks.workunit.client.1.smithi150.stdout:3/632: creat d6/d9/d3d/d56/d71/db6/dc1/d9a/fcc x:0 0 0 2023-12-05T09:57:36.860 INFO:tasks.workunit.client.1.smithi150.stdout:3/633: dread - d6/d9/d3d/d56/d71/fa3 zero size 2023-12-05T09:57:36.864 INFO:tasks.workunit.client.1.smithi150.stdout:5/603: symlink d1/d3/d6/d11/ld4 0 2023-12-05T09:57:36.864 INFO:tasks.workunit.client.1.smithi150.stdout:4/537: mkdir d0/d3e/d5b/d80/d44/da2/da4 0 2023-12-05T09:57:36.865 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:36.866+0000 7f13faffd700 1 -- 172.21.15.100:0/2709858199 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1814 (secure 0 0 0) 0x7f1400023030 con 0x7f140c108320 2023-12-05T09:57:36.865 INFO:tasks.workunit.client.0.smithi100.stdout:3/715: getdents d0/d3d/d5c/d6f 0 2023-12-05T09:57:36.865 INFO:tasks.workunit.client.0.smithi100.stdout:3/716: chown d0/d10/d39/c66 2421 1 2023-12-05T09:57:36.865 INFO:tasks.workunit.client.0.smithi100.stdout:3/717: readlink d0/d2/de/d11/d58/l72 0 2023-12-05T09:57:36.865 INFO:tasks.workunit.client.0.smithi100.stdout:2/718: write d7/da/d18/d21/d4d/fa0 [2699661,88048] 0 2023-12-05T09:57:36.865 INFO:tasks.workunit.client.0.smithi100.stdout:0/570: write da/d22/f3b [3985006,95565] 0 2023-12-05T09:57:36.865 INFO:tasks.workunit.client.0.smithi100.stdout:2/719: write d7/da/d18/d21/d4d/fa0 [3069505,44496] 0 2023-12-05T09:57:36.865 INFO:tasks.workunit.client.0.smithi100.stdout:2/720: stat d7/da 0 2023-12-05T09:57:36.866 INFO:teuthology.orchestra.run.smithi100.stdout:e13 2023-12-05T09:57:36.866 INFO:teuthology.orchestra.run.smithi100.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-05T09:57:36.866 INFO:teuthology.orchestra.run.smithi100.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T09:57:36.866 INFO:teuthology.orchestra.run.smithi100.stdout:legacy client fscid: 1 2023-12-05T09:57:36.866 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:57:36.866 INFO:teuthology.orchestra.run.smithi100.stdout:Filesystem 'cephfs' (1) 2023-12-05T09:57:36.866 INFO:teuthology.orchestra.run.smithi100.stdout:fs_name cephfs 2023-12-05T09:57:36.866 INFO:teuthology.orchestra.run.smithi100.stdout:epoch 13 2023-12-05T09:57:36.867 INFO:teuthology.orchestra.run.smithi100.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-05T09:57:36.867 INFO:teuthology.orchestra.run.smithi100.stdout:created 2023-12-05T09:54:30.515778+0000 2023-12-05T09:57:36.867 INFO:teuthology.orchestra.run.smithi100.stdout:modified 2023-12-05T09:54:46.403009+0000 2023-12-05T09:57:36.867 INFO:teuthology.orchestra.run.smithi100.stdout:tableserver 0 2023-12-05T09:57:36.867 INFO:teuthology.orchestra.run.smithi100.stdout:root 0 2023-12-05T09:57:36.867 INFO:teuthology.orchestra.run.smithi100.stdout:session_timeout 60 2023-12-05T09:57:36.867 INFO:teuthology.orchestra.run.smithi100.stdout:session_autoclose 300 2023-12-05T09:57:36.867 INFO:teuthology.orchestra.run.smithi100.stdout:max_file_size 1099511627776 2023-12-05T09:57:36.867 INFO:teuthology.orchestra.run.smithi100.stdout:required_client_features {} 2023-12-05T09:57:36.867 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure 0 2023-12-05T09:57:36.867 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure_osd_epoch 46 2023-12-05T09:57:36.867 INFO:teuthology.orchestra.run.smithi100.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T09:57:36.867 INFO:teuthology.orchestra.run.smithi100.stdout:max_mds 1 2023-12-05T09:57:36.867 INFO:teuthology.orchestra.run.smithi100.stdout:in 0 2023-12-05T09:57:36.868 INFO:teuthology.orchestra.run.smithi100.stdout:up {0=14490} 2023-12-05T09:57:36.868 INFO:teuthology.orchestra.run.smithi100.stdout:failed 2023-12-05T09:57:36.868 INFO:teuthology.orchestra.run.smithi100.stdout:damaged 2023-12-05T09:57:36.868 INFO:teuthology.orchestra.run.smithi100.stdout:stopped 2023-12-05T09:57:36.868 INFO:teuthology.orchestra.run.smithi100.stdout:data_pools [3] 2023-12-05T09:57:36.868 INFO:teuthology.orchestra.run.smithi100.stdout:metadata_pool 2 2023-12-05T09:57:36.868 INFO:teuthology.orchestra.run.smithi100.stdout:inline_data disabled 2023-12-05T09:57:36.868 INFO:teuthology.orchestra.run.smithi100.stdout:balancer 2023-12-05T09:57:36.868 INFO:teuthology.orchestra.run.smithi100.stdout:standby_count_wanted 1 2023-12-05T09:57:36.868 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi100.akmstb{0:14490} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.100:6828/627555128,v1:172.21.15.100:6829/627555128] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:57:36.868 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:57:36.868 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:57:36.868 INFO:teuthology.orchestra.run.smithi100.stdout:Standby daemons: 2023-12-05T09:57:36.868 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:57:36.868 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi150.pcbpxm{-1:14486} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.150:6824/3645854543,v1:172.21.15.150:6825/3645854543] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:57:36.869 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi150.fcnhsv{-1:14498} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.150:6826/3249949736,v1:172.21.15.150:6827/3249949736] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:57:36.869 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi100.sqplhn{-1:14506} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.100:6826/2472212864,v1:172.21.15.100:6827/2472212864] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:57:36.869 INFO:tasks.workunit.client.1.smithi150.stdout:1/610: creat d6/d3c/fd6 x:0 0 0 2023-12-05T09:57:36.869 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:36.870+0000 7f1410ec1700 1 -- 172.21.15.100:0/2709858199 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7f13f406af00 msgr2=0x7f13f406d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:57:36.870 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:36.870+0000 7f1410ec1700 1 --2- 172.21.15.100:0/2709858199 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7f13f406af00 0x7f13f406d3b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f140c071150 tx=0x7f13fc004630 comp rx=0 tx=0).stop 2023-12-05T09:57:36.870 INFO:tasks.workunit.client.0.smithi100.stdout:4/551: rename de/d16/f2f to de/d16/d23/d33/d51/faf 0 2023-12-05T09:57:36.870 INFO:tasks.workunit.client.0.smithi100.stdout:4/552: truncate de/d16/d23/d33/d3d/d44/d4e/f87 408872 0 2023-12-05T09:57:36.870 INFO:tasks.workunit.client.0.smithi100.stdout:4/553: readlink de/d16/l1a 0 2023-12-05T09:57:36.870 INFO:tasks.workunit.client.0.smithi100.stdout:4/554: fsync de/d16/d23/d33/f6b 0 2023-12-05T09:57:36.870 INFO:tasks.workunit.client.0.smithi100.stdout:4/555: stat de/d16/d23/d33/d3d/d44/d4e/d80 0 2023-12-05T09:57:36.871 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:36.870+0000 7f1410ec1700 1 -- 172.21.15.100:0/2709858199 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f140c108320 msgr2=0x7f140c108730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:57:36.871 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:36.870+0000 7f1410ec1700 1 --2- 172.21.15.100:0/2709858199 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f140c108320 0x7f140c108730 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1400005010 tx=0x7f1400009e30 comp rx=0 tx=0).stop 2023-12-05T09:57:36.871 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:36.870+0000 7f1410ec1700 1 -- 172.21.15.100:0/2709858199 shutdown_connections 2023-12-05T09:57:36.871 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:36.870+0000 7f1410ec1700 1 --2- 172.21.15.100:0/2709858199 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7f13f406af00 0x7f13f406d3b0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:36.871 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:36.870+0000 7f1410ec1700 1 --2- 172.21.15.100:0/2709858199 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f140c108320 0x7f140c108730 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:36.871 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:36.870+0000 7f1410ec1700 1 --2- 172.21.15.100:0/2709858199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f140c108c70 0x7f140c11d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:36.871 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:36.870+0000 7f1410ec1700 1 -- 172.21.15.100:0/2709858199 >> 172.21.15.100:0/2709858199 conn(0x7f140c0f82d0 msgr2=0x7f140c0fa6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:57:36.871 INFO:tasks.workunit.client.0.smithi100.stdout:7/552: creat d3/dc/d11/d13/de/d2d/d42/fc8 x:0 0 0 2023-12-05T09:57:36.871 INFO:tasks.workunit.client.0.smithi100.stdout:7/553: fdatasync d3/dc/d11/d13/de/f48 0 2023-12-05T09:57:36.872 INFO:tasks.workunit.client.0.smithi100.stdout:7/554: dread - d3/dc/d11/d13/de/d18/fc4 zero size 2023-12-05T09:57:36.872 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:36.872+0000 7f1410ec1700 1 -- 172.21.15.100:0/2709858199 shutdown_connections 2023-12-05T09:57:36.872 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:36.872+0000 7f1410ec1700 1 -- 172.21.15.100:0/2709858199 wait complete. 2023-12-05T09:57:36.872 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 13 2023-12-05T09:57:36.872 INFO:tasks.workunit.client.1.smithi150.stdout:4/538: dread d0/d3e/d48/f4e [0,4194304] 0 2023-12-05T09:57:36.873 INFO:tasks.workunit.client.1.smithi150.stdout:6/559: mknod d2/d23/d3b/d64/d7a/d5d/cbe 0 2023-12-05T09:57:36.878 INFO:tasks.workunit.client.0.smithi100.stdout:8/515: truncate d0/d12/d13/d16/f46 259934 0 2023-12-05T09:57:36.878 INFO:tasks.workunit.client.0.smithi100.stdout:8/516: dread - d0/d35/d64/f7c zero size 2023-12-05T09:57:36.886 INFO:tasks.workunit.client.1.smithi150.stdout:2/656: symlink d0/d3/d5/d13/d15/d30/d54/d57/le1 0 2023-12-05T09:57:36.889 INFO:tasks.workunit.client.0.smithi100.stdout:5/605: dwrite d0/d27/f29 [0,4194304] 0 2023-12-05T09:57:36.892 INFO:tasks.workunit.client.0.smithi100.stdout:0/571: symlink da/d22/d33/d7f/laa 0 2023-12-05T09:57:36.892 INFO:tasks.workunit.client.0.smithi100.stdout:0/572: getdents da/d22/d33/d7f/d87 0 2023-12-05T09:57:36.895 INFO:tasks.workunit.client.1.smithi150.stdout:4/539: dread d0/d3e/d5b/d80/f7c [0,4194304] 0 2023-12-05T09:57:36.898 INFO:tasks.workunit.client.0.smithi100.stdout:2/721: link d7/da/d18/d1b/d2c/d3f/d72/cb0 d7/da/da7/dd6/cf4 0 2023-12-05T09:57:36.902 INFO:tasks.workunit.client.0.smithi100.stdout:1/572: rename db/d12/d1e/f95 to db/d12/d1e/d26/d39/da6/fb6 0 2023-12-05T09:57:36.909 INFO:tasks.workunit.client.1.smithi150.stdout:8/682: mkdir d0/d41/d49/d1b/d24/d34/da2/dd7 0 2023-12-05T09:57:36.911 INFO:tasks.workunit.client.0.smithi100.stdout:7/555: mknod d3/dc/d11/d13/de/d18/cc9 0 2023-12-05T09:57:36.912 INFO:tasks.workunit.client.1.smithi150.stdout:3/634: mkdir d6/d22/d37/dcd 0 2023-12-05T09:57:36.912 INFO:tasks.workunit.client.0.smithi100.stdout:9/598: dwrite d7/fb [0,4194304] 0 2023-12-05T09:57:36.912 INFO:tasks.workunit.client.0.smithi100.stdout:9/599: chown d7/d35/f63 0 1 2023-12-05T09:57:36.917 INFO:tasks.workunit.client.0.smithi100.stdout:6/959: write d7/d27/d35/d5a/f7f [1057854,46212] 0 2023-12-05T09:57:36.920 INFO:tasks.workunit.client.1.smithi150.stdout:5/604: link d1/f55 d1/d64/d31/fd5 0 2023-12-05T09:57:36.920 INFO:tasks.workunit.client.1.smithi150.stdout:5/605: write d1/d3/d6/f10 [4176250,589] 0 2023-12-05T09:57:36.927 INFO:tasks.workunit.client.0.smithi100.stdout:5/606: readlink d0/d1f/l24 0 2023-12-05T09:57:36.929 INFO:tasks.workunit.client.1.smithi150.stdout:8/683: write d0/d8/f82 [1912925,124508] 0 2023-12-05T09:57:36.958 INFO:tasks.workunit.client.1.smithi150.stdout:2/657: dwrite d0/d3/fb7 [0,4194304] 0 2023-12-05T09:57:36.958 INFO:tasks.workunit.client.1.smithi150.stdout:2/658: fdatasync d0/da3/fbc 0 2023-12-05T09:57:36.960 INFO:tasks.workunit.client.1.smithi150.stdout:6/560: mknod d2/d23/cbf 0 2023-12-05T09:57:36.967 INFO:tasks.workunit.client.1.smithi150.stdout:9/561: link d3/d9/dc/c23 d3/d9/dc/d1f/cbb 0 2023-12-05T09:57:36.969 INFO:tasks.workunit.client.0.smithi100.stdout:1/573: dwrite db/d31/d3a/d4a/dad/f89 [0,4194304] 0 2023-12-05T09:57:36.970 INFO:tasks.workunit.client.0.smithi100.stdout:3/718: dwrite d0/d10/d39/f80 [0,4194304] 0 2023-12-05T09:57:36.973 INFO:tasks.workunit.client.1.smithi150.stdout:4/540: creat d0/d3e/d5b/d80/da1/fa5 x:0 0 0 2023-12-05T09:57:36.976 INFO:tasks.workunit.client.0.smithi100.stdout:4/556: rename de/d16/d23/d36/d7d to de/d16/d23/d33/d3d/db0 0 2023-12-05T09:57:36.976 INFO:tasks.workunit.client.0.smithi100.stdout:4/557: readlink de/d16/l17 0 2023-12-05T09:57:36.976 INFO:tasks.workunit.client.0.smithi100.stdout:4/558: dread - de/d16/d23/d60/d98/fa8 zero size 2023-12-05T09:57:36.978 INFO:tasks.workunit.client.0.smithi100.stdout:8/517: dwrite d0/d12/f32 [0,4194304] 0 2023-12-05T09:57:36.979 INFO:tasks.workunit.client.0.smithi100.stdout:9/600: mknod d7/d1b/d22/d51/d32/d96/ccf 0 2023-12-05T09:57:36.986 INFO:tasks.workunit.client.0.smithi100.stdout:7/556: creat d3/dc/d11/d13/de/d2d/d47/fca x:0 0 0 2023-12-05T09:57:36.986 INFO:tasks.workunit.client.1.smithi150.stdout:9/562: dread d3/d9/f17 [4194304,4194304] 0 2023-12-05T09:57:36.986 INFO:tasks.workunit.client.1.smithi150.stdout:5/606: creat d1/d7f/d65/d3b/d8d/fd6 x:0 0 0 2023-12-05T09:57:36.987 INFO:tasks.workunit.client.1.smithi150.stdout:1/611: rmdir d6/d8/db/de/d75/da5 39 2023-12-05T09:57:36.990 INFO:tasks.workunit.client.1.smithi150.stdout:8/684: dwrite d0/d41/d49/d1b/d24/d5b/d87/f98 [0,4194304] 0 2023-12-05T09:57:36.990 INFO:tasks.workunit.client.1.smithi150.stdout:2/659: dread d0/d3/fb2 [0,4194304] 0 2023-12-05T09:57:36.990 INFO:tasks.workunit.client.0.smithi100.stdout:2/722: dread d7/da/d18/d21/f40 [0,4194304] 0 2023-12-05T09:57:36.990 INFO:tasks.workunit.client.0.smithi100.stdout:2/723: chown d7/da/d13/c5c 0 1 2023-12-05T09:57:36.990 INFO:tasks.workunit.client.0.smithi100.stdout:5/607: mkdir d0/d1b/d4d/d8e/d96/dc1/dae/db9/dd2 0 2023-12-05T09:57:36.990 INFO:tasks.workunit.client.0.smithi100.stdout:2/724: chown d7/da/dc/d88 14 1 2023-12-05T09:57:36.992 INFO:tasks.workunit.client.1.smithi150.stdout:4/541: dread d0/d3e/d6d/f2a [0,4194304] 0 2023-12-05T09:57:36.995 INFO:tasks.workunit.client.1.smithi150.stdout:7/630: sync 2023-12-05T09:57:36.995 INFO:tasks.workunit.client.1.smithi150.stdout:0/650: sync 2023-12-05T09:57:36.995 INFO:tasks.workunit.client.1.smithi150.stdout:7/631: readlink d2/d1b/lcd 0 2023-12-05T09:57:37.008 INFO:tasks.workunit.client.1.smithi150.stdout:5/607: write d1/d2e/da6/d24/f93 [686180,56259] 0 2023-12-05T09:57:37.008 INFO:tasks.workunit.client.1.smithi150.stdout:7/632: dread d2/db/d30/f9 [0,4194304] 0 2023-12-05T09:57:37.008 INFO:tasks.workunit.client.1.smithi150.stdout:7/633: stat d2/db/d30/d13/d4f/d5a/d5c/f89 0 2023-12-05T09:57:37.010 INFO:tasks.workunit.client.0.smithi100.stdout:5/608: read d0/d16/d2b/d48/df/d51/f94 [3879260,128304] 0 2023-12-05T09:57:37.010 INFO:tasks.workunit.client.0.smithi100.stdout:0/573: getdents da/d22/d33/d7f/d94 0 2023-12-05T09:57:37.010 INFO:tasks.workunit.client.0.smithi100.stdout:0/574: write da/d1b/d36/f4f [2387273,19118] 0 2023-12-05T09:57:37.011 INFO:tasks.workunit.client.1.smithi150.stdout:6/561: mkdir d2/d23/d3b/db4/dc0 0 2023-12-05T09:57:37.015 INFO:tasks.workunit.client.1.smithi150.stdout:3/635: symlink d6/d9/d8d/lce 0 2023-12-05T09:57:37.018 INFO:tasks.workunit.client.0.smithi100.stdout:6/960: dwrite d7/d27/d72/f12f [0,4194304] 0 2023-12-05T09:57:37.020 INFO:tasks.workunit.client.0.smithi100.stdout:1/574: rmdir db/daa 0 2023-12-05T09:57:37.022 INFO:tasks.workunit.client.1.smithi150.stdout:9/563: rmdir d3/d42/d62 39 2023-12-05T09:57:37.023 INFO:tasks.workunit.client.1.smithi150.stdout:1/612: truncate d6/d8/db/f19 176675 0 2023-12-05T09:57:37.024 INFO:tasks.workunit.client.1.smithi150.stdout:1/613: write d6/d8/db/de/f13 [7392151,125906] 0 2023-12-05T09:57:37.025 INFO:tasks.workunit.client.0.smithi100.stdout:8/518: link d0/d12/f48 d0/d12/d52/f8e 0 2023-12-05T09:57:37.026 INFO:tasks.workunit.client.0.smithi100.stdout:8/519: creat d0/d35/d64/f8f x:0 0 0 2023-12-05T09:57:37.028 INFO:tasks.workunit.client.0.smithi100.stdout:9/601: rename d7/d1b/d22/d2a/d56/d2e/d50/f61 to d7/d1b/d22/d2a/d56/daf/fd0 0 2023-12-05T09:57:37.028 INFO:tasks.workunit.client.0.smithi100.stdout:9/602: write d7/d1b/da5/fa7 [278144,67743] 0 2023-12-05T09:57:37.030 INFO:tasks.workunit.client.0.smithi100.stdout:7/557: mkdir d3/dc/d11/d13/de/d18/dcb 0 2023-12-05T09:57:37.032 INFO:tasks.workunit.client.0.smithi100.stdout:2/725: symlink d7/da/d18/d1b/lf5 0 2023-12-05T09:57:37.035 INFO:tasks.workunit.client.0.smithi100.stdout:6/961: symlink d7/d11/d1a/db7/df7/d126/d6a/d7c/d8d/l139 0 2023-12-05T09:57:37.035 INFO:tasks.workunit.client.0.smithi100.stdout:6/962: truncate d7/d11/d1a/fdf 21373 0 2023-12-05T09:57:37.035 INFO:tasks.workunit.client.0.smithi100.stdout:6/963: readlink d7/d11/d1a/l114 0 2023-12-05T09:57:37.038 INFO:tasks.workunit.client.1.smithi150.stdout:8/685: mknod d0/d41/d49/d1b/d24/d34/da2/dd7/cd8 0 2023-12-05T09:57:37.038 INFO:tasks.workunit.client.1.smithi150.stdout:4/542: creat d0/d3e/d48/d8a/fa6 x:0 0 0 2023-12-05T09:57:37.039 INFO:tasks.workunit.client.0.smithi100.stdout:6/964: fsync d7/d11/d82/ffb 0 2023-12-05T09:57:37.039 INFO:tasks.workunit.client.0.smithi100.stdout:1/575: mknod db/d31/cb7 0 2023-12-05T09:57:37.039 INFO:tasks.workunit.client.0.smithi100.stdout:1/576: truncate db/d12/d1e/fa2 214242 0 2023-12-05T09:57:37.039 INFO:tasks.workunit.client.1.smithi150.stdout:0/651: rmdir d5/d11/d16 39 2023-12-05T09:57:37.040 INFO:tasks.workunit.client.1.smithi150.stdout:0/652: fsync d5/d11/d71/d5f/d6a/fe8 0 2023-12-05T09:57:37.041 INFO:tasks.workunit.client.1.smithi150.stdout:3/636: mkdir d6/d25/dcf 0 2023-12-05T09:57:37.045 INFO:tasks.workunit.client.0.smithi100.stdout:0/575: rename da/fa3 to da/d1b/d6b/d78/fab 0 2023-12-05T09:57:37.049 INFO:tasks.workunit.client.0.smithi100.stdout:4/559: dwrite de/d16/d23/d33/d3d/d44/d4e/f50 [0,4194304] 0 2023-12-05T09:57:37.050 INFO:tasks.workunit.client.0.smithi100.stdout:4/560: creat de/d16/d1e/fb1 x:0 0 0 2023-12-05T09:57:37.050 INFO:tasks.workunit.client.0.smithi100.stdout:4/561: readlink de/d16/d23/l27 0 2023-12-05T09:57:37.051 INFO:tasks.workunit.client.1.smithi150.stdout:1/614: mknod d6/d8/db/db1/cd7 0 2023-12-05T09:57:37.052 INFO:tasks.workunit.client.1.smithi150.stdout:8/686: rename d0/d41/d49/d1b/d24/d2e/l5a to d0/d41/d49/d1b/d24/d5b/d87/ld9 0 2023-12-05T09:57:37.055 INFO:tasks.workunit.client.0.smithi100.stdout:7/558: creat d3/dc/d11/d13/de/d2d/d47/dbd/fcc x:0 0 0 2023-12-05T09:57:37.057 INFO:tasks.workunit.client.1.smithi150.stdout:0/653: write d5/fa [1675886,84550] 0 2023-12-05T09:57:37.060 INFO:tasks.workunit.client.0.smithi100.stdout:2/726: link d7/da/dc/c8d d7/da/d18/d1b/d2c/d3f/d72/d9d/cf6 0 2023-12-05T09:57:37.064 INFO:tasks.workunit.client.0.smithi100.stdout:2/727: read d7/da/d13/d69/d6e/d71/f8c [2445330,89472] 0 2023-12-05T09:57:37.064 INFO:tasks.workunit.client.0.smithi100.stdout:8/520: unlink d0/d35/d64/f8f 0 2023-12-05T09:57:37.065 INFO:tasks.workunit.client.1.smithi150.stdout:3/637: creat d6/d9/d3d/d56/d53/fd0 x:0 0 0 2023-12-05T09:57:37.067 INFO:tasks.workunit.client.0.smithi100.stdout:3/719: dwrite d0/d2/de/d12/d9b/fca [0,4194304] 0 2023-12-05T09:57:37.067 INFO:tasks.workunit.client.0.smithi100.stdout:3/720: readlink d0/d10/l96 0 2023-12-05T09:57:37.068 INFO:tasks.workunit.client.0.smithi100.stdout:1/577: rename db/d31/d3a/d4a/dad/da9 to db/d12/d1e/d26/d39/da6/db8 0 2023-12-05T09:57:37.068 INFO:tasks.workunit.client.0.smithi100.stdout:0/576: symlink da/d22/d33/d35/lac 0 2023-12-05T09:57:37.070 INFO:tasks.workunit.client.1.smithi150.stdout:8/687: mkdir d0/d41/d49/dda 0 2023-12-05T09:57:37.071 INFO:tasks.workunit.client.1.smithi150.stdout:4/543: write d0/d3e/d48/d4d/f97 [714447,13534] 0 2023-12-05T09:57:37.071 INFO:tasks.workunit.client.1.smithi150.stdout:4/544: write d0/d3e/d6d/d4b/d8c/f8e [390431,126038] 0 2023-12-05T09:57:37.081 INFO:tasks.workunit.client.0.smithi100.stdout:4/562: symlink de/d16/d23/d60/d88/lb2 0 2023-12-05T09:57:37.081 INFO:tasks.workunit.client.0.smithi100.stdout:4/563: readlink de/d16/d1e/l40 0 2023-12-05T09:57:37.083 INFO:tasks.workunit.client.1.smithi150.stdout:3/638: symlink d6/d9/d43/d47/ld1 0 2023-12-05T09:57:37.089 INFO:tasks.workunit.client.0.smithi100.stdout:4/564: creat de/d16/d23/d33/d51/fb3 x:0 0 0 2023-12-05T09:57:37.089 INFO:tasks.workunit.client.0.smithi100.stdout:4/565: dread - de/d38/d86/f95 zero size 2023-12-05T09:57:37.092 INFO:tasks.workunit.client.0.smithi100.stdout:7/559: getdents d3/dc/d11/d13/de/d2d 0 2023-12-05T09:57:37.094 INFO:tasks.workunit.client.0.smithi100.stdout:8/521: creat d0/d12/d13/f90 x:0 0 0 2023-12-05T09:57:37.097 INFO:tasks.workunit.client.1.smithi150.stdout:6/562: dwrite d2/d23/d2e/d44/fbc [0,4194304] 0 2023-12-05T09:57:37.097 INFO:tasks.workunit.client.1.smithi150.stdout:6/563: fsync d2/d23/d2e/f91 0 2023-12-05T09:57:37.097 INFO:tasks.workunit.client.1.smithi150.stdout:6/564: readlink d2/d23/d2e/d93/d97/l96 0 2023-12-05T09:57:37.103 INFO:tasks.workunit.client.1.smithi150.stdout:8/688: mkdir d0/d41/ddb 0 2023-12-05T09:57:37.110 INFO:tasks.workunit.client.0.smithi100.stdout:1/578: symlink db/d12/d1e/d26/lb9 0 2023-12-05T09:57:37.111 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.112+0000 7f9368eb4700 1 -- 172.21.15.100:0/3353996035 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f936406f0e0 msgr2=0x7f9364108c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:57:37.111 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.112+0000 7f9368eb4700 1 --2- 172.21.15.100:0/3353996035 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f936406f0e0 0x7f9364108c60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9358004940 tx=0x7f9358009e30 comp rx=0 tx=0).stop 2023-12-05T09:57:37.112 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.113+0000 7f9368eb4700 1 -- 172.21.15.100:0/3353996035 shutdown_connections 2023-12-05T09:57:37.112 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.113+0000 7f9368eb4700 1 --2- 172.21.15.100:0/3353996035 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f936406f0e0 0x7f9364108c60 secure :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9358004940 tx=0x7f9358009e30 comp rx=0 tx=0).stop 2023-12-05T09:57:37.112 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.113+0000 7f9368eb4700 1 --2- 172.21.15.100:0/3353996035 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f936406e700 0x7f936406eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:37.112 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.113+0000 7f9368eb4700 1 -- 172.21.15.100:0/3353996035 >> 172.21.15.100:0/3353996035 conn(0x7f9364069b20 msgr2=0x7f936406bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:57:37.112 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.113+0000 7f9368eb4700 1 -- 172.21.15.100:0/3353996035 shutdown_connections 2023-12-05T09:57:37.112 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.114+0000 7f9368eb4700 1 -- 172.21.15.100:0/3353996035 wait complete. 2023-12-05T09:57:37.113 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.116+0000 7f9368eb4700 1 Processor -- start 2023-12-05T09:57:37.119 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.118+0000 7f9368eb4700 1 -- start start 2023-12-05T09:57:37.120 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.119+0000 7f9368eb4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f936406e700 0x7f936410c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:57:37.120 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.119+0000 7f9368eb4700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f936410cd70 0x7f936410dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:57:37.120 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.119+0000 7f9368eb4700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f936410d230 con 0x7f936410cd70 2023-12-05T09:57:37.120 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.119+0000 7f9368eb4700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f936410d3a0 con 0x7f936406e700 2023-12-05T09:57:37.120 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.120+0000 7f936259c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f936406e700 0x7f936410c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:57:37.120 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.120+0000 7f936259c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f936406e700 0x7f936410c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.100:50038/0 (socket says 172.21.15.100:50038) 2023-12-05T09:57:37.120 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.120+0000 7f936259c700 1 -- 172.21.15.100:0/2910657241 learned_addr learned my addr 172.21.15.100:0/2910657241 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:57:37.120 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.121+0000 7f9361d9b700 1 --2- 172.21.15.100:0/2910657241 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f936410cd70 0x7f936410dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:57:37.120 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.121+0000 7f936259c700 1 -- 172.21.15.100:0/2910657241 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f936410cd70 msgr2=0x7f936410dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:57:37.120 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.121+0000 7f936259c700 1 --2- 172.21.15.100:0/2910657241 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f936410cd70 0x7f936410dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:37.120 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.121+0000 7f936259c700 1 -- 172.21.15.100:0/2910657241 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9358005040 con 0x7f936406e700 2023-12-05T09:57:37.120 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.122+0000 7f936259c700 1 --2- 172.21.15.100:0/2910657241 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f936406e700 0x7f936410c830 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f935c00ec90 tx=0x7f935c00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:57:37.121 INFO:tasks.workunit.client.1.smithi150.stdout:4/545: rmdir d0/d3e/d6d/d4b/d8c 39 2023-12-05T09:57:37.123 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.122+0000 7f9352ffd700 1 -- 172.21.15.100:0/2910657241 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f935c00eea0 con 0x7f936406e700 2023-12-05T09:57:37.123 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.122+0000 7f9352ffd700 1 -- 172.21.15.100:0/2910657241 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f935c00f040 con 0x7f936406e700 2023-12-05T09:57:37.123 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.122+0000 7f9352ffd700 1 -- 172.21.15.100:0/2910657241 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f935c009570 con 0x7f936406e700 2023-12-05T09:57:37.123 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.122+0000 7f9368eb4700 1 -- 172.21.15.100:0/2910657241 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f936410e2c0 con 0x7f936406e700 2023-12-05T09:57:37.123 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.123+0000 7f9368eb4700 1 -- 172.21.15.100:0/2910657241 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f936410e7b0 con 0x7f936406e700 2023-12-05T09:57:37.123 INFO:tasks.workunit.client.0.smithi100.stdout:7/560: unlink d3/dc/d11/d13/de/d2d/d42/lc3 0 2023-12-05T09:57:37.124 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.124+0000 7f9368eb4700 1 -- 172.21.15.100:0/2910657241 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f936406d790 con 0x7f936406e700 2023-12-05T09:57:37.125 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.127+0000 7f9352ffd700 1 -- 172.21.15.100:0/2910657241 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 25) v1 ==== 88726+0+0 (secure 0 0 0) 0x7f935c00c940 con 0x7f936406e700 2023-12-05T09:57:37.125 INFO:tasks.workunit.client.1.smithi150.stdout:6/565: creat d2/d23/d3b/db4/fc1 x:0 0 0 2023-12-05T09:57:37.126 INFO:tasks.workunit.client.1.smithi150.stdout:3/639: dread d6/d9/f1d [0,4194304] 0 2023-12-05T09:57:37.126 INFO:tasks.workunit.client.1.smithi150.stdout:3/640: dread - d6/d22/d37/d63/fbc zero size 2023-12-05T09:57:37.127 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.129+0000 7f9352ffd700 1 --2- 172.21.15.100:0/2910657241 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7f934c06af50 0x7f934c06d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:57:37.128 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.130+0000 7f9352ffd700 1 -- 172.21.15.100:0/2910657241 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f935c08a360 con 0x7f936406e700 2023-12-05T09:57:37.128 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.130+0000 7f9361d9b700 1 --2- 172.21.15.100:0/2910657241 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7f934c06af50 0x7f934c06d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:57:37.129 INFO:tasks.workunit.client.1.smithi150.stdout:5/608: dwrite d1/d3/f7 [0,4194304] 0 2023-12-05T09:57:37.129 INFO:tasks.workunit.client.1.smithi150.stdout:9/564: dwrite d3/d9/dc/d1f/d24/f9d [0,4194304] 0 2023-12-05T09:57:37.129 INFO:tasks.workunit.client.1.smithi150.stdout:9/565: write d3/d9/d26/d9b/faa [579133,98534] 0 2023-12-05T09:57:37.129 INFO:tasks.workunit.client.1.smithi150.stdout:9/566: fdatasync d3/d9/dc/d1f/f25 0 2023-12-05T09:57:37.130 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.132+0000 7f9361d9b700 1 --2- 172.21.15.100:0/2910657241 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7f934c06af50 0x7f934c06d400 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f936410d8a0 tx=0x7f9358009e30 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:57:37.130 INFO:tasks.workunit.client.1.smithi150.stdout:8/689: mkdir d0/d41/d49/d1b/d24/d5b/ddc 0 2023-12-05T09:57:37.131 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.134+0000 7f9352ffd700 1 -- 172.21.15.100:0/2910657241 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f935c054680 con 0x7f936406e700 2023-12-05T09:57:37.135 INFO:tasks.workunit.client.0.smithi100.stdout:5/609: dwrite d0/d1f/d25/d31/f3f [0,4194304] 0 2023-12-05T09:57:37.135 INFO:tasks.workunit.client.1.smithi150.stdout:4/546: rename d0/d3e/d5b/d80/d44/l6a to d0/d3e/d5b/d80/d44/da2/la7 0 2023-12-05T09:57:37.135 INFO:tasks.workunit.client.1.smithi150.stdout:4/547: chown d0/c22 516472336 1 2023-12-05T09:57:37.135 INFO:tasks.workunit.client.1.smithi150.stdout:4/548: dread - d0/d3e/f71 zero size 2023-12-05T09:57:37.139 INFO:tasks.workunit.client.1.smithi150.stdout:6/566: link d2/d23/d2e/f94 d2/d23/d2e/d93/fc2 0 2023-12-05T09:57:37.141 INFO:tasks.workunit.client.0.smithi100.stdout:7/561: mkdir d3/dc/d11/d13/d37/d97/dc1/dcd 0 2023-12-05T09:57:37.144 INFO:tasks.workunit.client.1.smithi150.stdout:1/615: dwrite d6/d47/d4c/f5d [0,4194304] 0 2023-12-05T09:57:37.146 INFO:tasks.workunit.client.0.smithi100.stdout:6/965: dwrite d7/fee [0,4194304] 0 2023-12-05T09:57:37.150 INFO:tasks.workunit.client.0.smithi100.stdout:3/721: dwrite d0/d2/de/d11/d58/db0/fe5 [0,4194304] 0 2023-12-05T09:57:37.150 INFO:tasks.workunit.client.0.smithi100.stdout:8/522: dread d0/f9 [8388608,4194304] 0 2023-12-05T09:57:37.151 INFO:tasks.workunit.client.0.smithi100.stdout:8/523: write d0/d12/d13/d16/f46 [1049116,57208] 0 2023-12-05T09:57:37.151 INFO:tasks.workunit.client.0.smithi100.stdout:8/524: truncate d0/d12/d13/f2f 1730780 0 2023-12-05T09:57:37.151 INFO:tasks.workunit.client.0.smithi100.stdout:8/525: stat d0/d12/d13/d16/d42/d43/c73 0 2023-12-05T09:57:37.157 INFO:tasks.workunit.client.0.smithi100.stdout:0/577: getdents da/d22/d33/d35 0 2023-12-05T09:57:37.158 INFO:tasks.workunit.client.1.smithi150.stdout:5/609: unlink d1/d64/fce 0 2023-12-05T09:57:37.162 INFO:tasks.workunit.client.1.smithi150.stdout:5/610: write d1/d2e/f80 [1214980,12076] 0 2023-12-05T09:57:37.162 INFO:tasks.workunit.client.1.smithi150.stdout:5/611: write d1/d7f/d65/d3b/d8d/fbe [4252236,39584] 0 2023-12-05T09:57:37.162 INFO:tasks.workunit.client.1.smithi150.stdout:5/612: creat d1/d3/d6/d26/fd7 x:0 0 0 2023-12-05T09:57:37.163 INFO:tasks.workunit.client.0.smithi100.stdout:1/579: dwrite db/d12/d1e/f41 [0,4194304] 0 2023-12-05T09:57:37.163 INFO:tasks.workunit.client.1.smithi150.stdout:8/690: creat d0/da1/fdd x:0 0 0 2023-12-05T09:57:37.163 INFO:tasks.workunit.client.1.smithi150.stdout:8/691: write d0/d41/d49/d1b/d24/d2e/f44 [5100085,102180] 0 2023-12-05T09:57:37.167 INFO:tasks.workunit.client.1.smithi150.stdout:9/567: rename d3/d9/d67/dac to d3/d9/dc/d1f/d24/d75/d95/dbc 0 2023-12-05T09:57:37.172 INFO:tasks.workunit.client.1.smithi150.stdout:4/549: mknod d0/d3e/d6d/d4b/ca8 0 2023-12-05T09:57:37.172 INFO:tasks.workunit.client.1.smithi150.stdout:8/692: dread d0/d41/d49/f59 [0,4194304] 0 2023-12-05T09:57:37.172 INFO:tasks.workunit.client.0.smithi100.stdout:4/566: dwrite de/d16/d23/d33/fa0 [0,4194304] 0 2023-12-05T09:57:37.172 INFO:tasks.workunit.client.0.smithi100.stdout:4/567: stat de/d16/d23/d33/d51/c54 0 2023-12-05T09:57:37.172 INFO:tasks.workunit.client.0.smithi100.stdout:4/568: chown de/d16/d23/d33/d3d/db0/cab 11662719 1 2023-12-05T09:57:37.172 INFO:tasks.workunit.client.0.smithi100.stdout:4/569: stat de/d66/f77 0 2023-12-05T09:57:37.173 INFO:tasks.workunit.client.0.smithi100.stdout:9/603: truncate d7/fb 4338384 0 2023-12-05T09:57:37.179 INFO:tasks.workunit.client.0.smithi100.stdout:7/562: rename d3/dc/d11/fbe to d3/dc/d11/d13/d37/d97/dc1/fce 0 2023-12-05T09:57:37.179 INFO:tasks.workunit.client.0.smithi100.stdout:7/563: stat d3/dc/d11/d13/de/d18/d3b/d40/d4c/c65 0 2023-12-05T09:57:37.183 INFO:tasks.workunit.client.1.smithi150.stdout:9/568: read d3/d1b/d46/d55/d64/f7c [2518742,15785] 0 2023-12-05T09:57:37.183 INFO:tasks.workunit.client.0.smithi100.stdout:1/580: write db/d12/d1e/f34 [7549622,23129] 0 2023-12-05T09:57:37.184 INFO:tasks.workunit.client.0.smithi100.stdout:1/581: write db/d12/d1e/f9f [359044,86701] 0 2023-12-05T09:57:37.184 INFO:tasks.workunit.client.0.smithi100.stdout:1/582: chown db/d12/fae 0 1 2023-12-05T09:57:37.184 INFO:tasks.workunit.client.1.smithi150.stdout:9/569: write d3/d1b/d46/f50 [783166,81946] 0 2023-12-05T09:57:37.191 INFO:tasks.workunit.client.1.smithi150.stdout:1/616: creat d6/d8/db/de/daf/fd8 x:0 0 0 2023-12-05T09:57:37.191 INFO:tasks.workunit.client.0.smithi100.stdout:3/722: symlink d0/d3d/d5c/d5f/d73/lf8 0 2023-12-05T09:57:37.191 INFO:tasks.workunit.client.0.smithi100.stdout:3/723: fsync d0/d4/d3a/f64 0 2023-12-05T09:57:37.192 INFO:tasks.workunit.client.0.smithi100.stdout:3/724: creat d0/d2/de/ff9 x:0 0 0 2023-12-05T09:57:37.195 INFO:tasks.workunit.client.0.smithi100.stdout:9/604: dread d7/ff [0,4194304] 0 2023-12-05T09:57:37.196 INFO:tasks.workunit.client.0.smithi100.stdout:8/526: getdents d0/d12/d52 0 2023-12-05T09:57:37.197 INFO:tasks.workunit.client.1.smithi150.stdout:3/641: rmdir d6/d22/d37 39 2023-12-05T09:57:37.198 INFO:tasks.workunit.client.0.smithi100.stdout:3/725: write d0/d10/d39/f41 [142444,128674] 0 2023-12-05T09:57:37.208 INFO:tasks.workunit.client.1.smithi150.stdout:4/550: symlink d0/d3e/d48/d8a/la9 0 2023-12-05T09:57:37.208 INFO:tasks.workunit.client.0.smithi100.stdout:4/570: symlink de/d16/d23/d60/d98/da6/lb4 0 2023-12-05T09:57:37.212 INFO:tasks.workunit.client.1.smithi150.stdout:6/567: getdents d2/d23 0 2023-12-05T09:57:37.217 INFO:tasks.workunit.client.0.smithi100.stdout:6/966: rename d7/fee to d7/d11/d1a/db7/df7/d126/d6a/d7c/f13a 0 2023-12-05T09:57:37.217 INFO:tasks.workunit.client.0.smithi100.stdout:6/967: truncate d7/d11/d1a/f9b 542793 0 2023-12-05T09:57:37.220 INFO:tasks.workunit.client.1.smithi150.stdout:9/570: mknod d3/d9/dc/d1f/d24/d75/d95/dbc/cbd 0 2023-12-05T09:57:37.226 INFO:tasks.workunit.client.1.smithi150.stdout:9/571: mkdir d3/d9/d58/dbe 0 2023-12-05T09:57:37.228 INFO:tasks.workunit.client.0.smithi100.stdout:9/605: creat d7/d1b/d22/d2a/d56/daf/fd1 x:0 0 0 2023-12-05T09:57:37.228 INFO:tasks.workunit.client.0.smithi100.stdout:9/606: creat d7/d1b/d22/d2a/d56/d2e/fd2 x:0 0 0 2023-12-05T09:57:37.230 INFO:tasks.workunit.client.0.smithi100.stdout:8/527: mkdir d0/d35/d63/d76/d91 0 2023-12-05T09:57:37.232 INFO:tasks.workunit.client.0.smithi100.stdout:3/726: mknod d0/d2/de/db8/dee/cfa 0 2023-12-05T09:57:37.233 INFO:tasks.workunit.client.1.smithi150.stdout:2/660: sync 2023-12-05T09:57:37.234 INFO:tasks.workunit.client.0.smithi100.stdout:3/727: dread - d0/d2/de/ff9 zero size 2023-12-05T09:57:37.235 INFO:tasks.workunit.client.1.smithi150.stdout:3/642: dread d6/d9/d3d/d87/f89 [0,4194304] 0 2023-12-05T09:57:37.235 INFO:tasks.workunit.client.1.smithi150.stdout:9/572: symlink d3/d9/dc/d1f/d24/d75/d95/d9a/lbf 0 2023-12-05T09:57:37.235 INFO:tasks.workunit.client.1.smithi150.stdout:9/573: dread - d3/d1b/d79/fb2 zero size 2023-12-05T09:57:37.235 INFO:tasks.workunit.client.1.smithi150.stdout:9/574: fdatasync d3/d9/dc/f33 0 2023-12-05T09:57:37.237 INFO:tasks.workunit.client.0.smithi100.stdout:4/571: link de/f11 de/d16/d23/d60/d98/da6/fb5 0 2023-12-05T09:57:37.238 INFO:tasks.workunit.client.0.smithi100.stdout:4/572: chown de/f13 4 1 2023-12-05T09:57:37.238 INFO:tasks.workunit.client.0.smithi100.stdout:4/573: stat de/d16/d23/d60/f9f 0 2023-12-05T09:57:37.238 INFO:tasks.workunit.client.0.smithi100.stdout:4/574: creat de/d38/fb6 x:0 0 0 2023-12-05T09:57:37.238 INFO:tasks.workunit.client.0.smithi100.stdout:4/575: dread - de/f73 zero size 2023-12-05T09:57:37.240 INFO:tasks.workunit.client.0.smithi100.stdout:1/583: rename db/d31/d3a/f9d to db/d12/d1e/d26/d39/da6/db8/fba 0 2023-12-05T09:57:37.242 INFO:tasks.workunit.client.1.smithi150.stdout:2/661: mknod d0/d3/d5/d13/d15/d30/d54/d57/ce2 0 2023-12-05T09:57:37.245 INFO:tasks.workunit.client.0.smithi100.stdout:9/607: stat d7/d1b/d22/d51/d32/f42 0 2023-12-05T09:57:37.246 INFO:tasks.workunit.client.1.smithi150.stdout:3/643: truncate d6/d9/d43/d75/fae 1597569 0 2023-12-05T09:57:37.246 INFO:tasks.workunit.client.1.smithi150.stdout:5/613: dwrite d1/d2e/fa1 [0,4194304] 0 2023-12-05T09:57:37.247 INFO:tasks.workunit.client.1.smithi150.stdout:5/614: write d1/d3/d6/d72/fad [506985,87038] 0 2023-12-05T09:57:37.250 INFO:tasks.workunit.client.0.smithi100.stdout:1/584: symlink db/d12/d1e/d26/d30/d52/lbb 0 2023-12-05T09:57:37.252 INFO:tasks.workunit.client.0.smithi100.stdout:0/578: dwrite da/d2a/d45/f49 [0,4194304] 0 2023-12-05T09:57:37.258 INFO:tasks.workunit.client.0.smithi100.stdout:4/576: write de/d16/d1e/f41 [2096908,96350] 0 2023-12-05T09:57:37.260 INFO:tasks.workunit.client.1.smithi150.stdout:2/662: symlink d0/d3/d5/d3b/d4c/d71/le3 0 2023-12-05T09:57:37.261 INFO:tasks.workunit.client.1.smithi150.stdout:3/644: link d6/l66 d6/d9/d3d/d56/d30/ld2 0 2023-12-05T09:57:37.261 INFO:tasks.workunit.client.1.smithi150.stdout:3/645: write d6/d9/d3d/d56/d53/f9e [4172017,68415] 0 2023-12-05T09:57:37.261 INFO:tasks.workunit.client.1.smithi150.stdout:3/646: readlink d6/d9/d3d/d56/d79/lc8 0 2023-12-05T09:57:37.261 INFO:tasks.workunit.client.1.smithi150.stdout:3/647: fsync d6/d9/d3d/d56/d30/f5e 0 2023-12-05T09:57:37.266 INFO:tasks.workunit.client.0.smithi100.stdout:9/608: creat d7/d20/d68/fd3 x:0 0 0 2023-12-05T09:57:37.266 INFO:tasks.workunit.client.0.smithi100.stdout:9/609: chown d7/d1b/da5/fa7 2029 1 2023-12-05T09:57:37.266 INFO:tasks.workunit.client.0.smithi100.stdout:1/585: creat db/d12/d61/fbc x:0 0 0 2023-12-05T09:57:37.266 INFO:tasks.workunit.client.0.smithi100.stdout:4/577: rename de/d16/l39 to de/d38/lb7 0 2023-12-05T09:57:37.266 INFO:tasks.workunit.client.0.smithi100.stdout:1/586: truncate db/d12/fae 191984 0 2023-12-05T09:57:37.266 INFO:tasks.workunit.client.0.smithi100.stdout:1/587: chown db/d12/d1e/f5d 93 1 2023-12-05T09:57:37.266 INFO:tasks.workunit.client.0.smithi100.stdout:1/588: dread - db/d12/d1e/d26/d30/d52/d84/d8c/fb2 zero size 2023-12-05T09:57:37.267 INFO:tasks.workunit.client.0.smithi100.stdout:9/610: chown d7/d1b/d22/d51/f7f 847660883 1 2023-12-05T09:57:37.270 INFO:tasks.workunit.client.1.smithi150.stdout:8/693: dwrite d0/d41/d49/d1b/d24/d34/d56/d67/d64/f7e [0,4194304] 0 2023-12-05T09:57:37.270 INFO:tasks.workunit.client.0.smithi100.stdout:1/589: creat db/d12/d1e/d26/fbd x:0 0 0 2023-12-05T09:57:37.273 INFO:tasks.workunit.client.0.smithi100.stdout:9/611: symlink d7/d1b/d22/d2a/ld4 0 2023-12-05T09:57:37.274 INFO:tasks.workunit.client.0.smithi100.stdout:6/968: dwrite d7/d11/d1a/db7/df7/d126/d6a/d7c/d8d/f8e [0,4194304] 0 2023-12-05T09:57:37.275 INFO:tasks.workunit.client.0.smithi100.stdout:6/969: dread - d7/d27/d72/f113 zero size 2023-12-05T09:57:37.275 INFO:tasks.workunit.client.0.smithi100.stdout:6/970: write d7/d27/f38 [2123125,19153] 0 2023-12-05T09:57:37.277 INFO:tasks.workunit.client.1.smithi150.stdout:1/617: rename d6/d8/db/de to d6/d47/d4c/dd9 0 2023-12-05T09:57:37.278 INFO:tasks.workunit.client.1.smithi150.stdout:5/615: write d1/d3/fa2 [985515,92015] 0 2023-12-05T09:57:37.278 INFO:tasks.workunit.client.1.smithi150.stdout:2/663: creat d0/d3/d27/dac/dd0/fe4 x:0 0 0 2023-12-05T09:57:37.281 INFO:tasks.workunit.client.0.smithi100.stdout:9/612: unlink d7/d1b/d22/f77 0 2023-12-05T09:57:37.282 INFO:tasks.workunit.client.1.smithi150.stdout:4/551: dwrite d0/d3e/d5b/d80/f63 [0,4194304] 0 2023-12-05T09:57:37.283 INFO:tasks.workunit.client.1.smithi150.stdout:5/616: rmdir d1/d2e/da6/d24/d59 39 2023-12-05T09:57:37.283 INFO:tasks.workunit.client.1.smithi150.stdout:5/617: read - d1/d7f/fa5 zero size 2023-12-05T09:57:37.283 INFO:tasks.workunit.client.1.smithi150.stdout:5/618: fdatasync d1/d3/d6/f3f 0 2023-12-05T09:57:37.283 INFO:tasks.workunit.client.1.smithi150.stdout:5/619: stat d1/d7f/d65/d3b/l20 0 2023-12-05T09:57:37.285 INFO:tasks.workunit.client.0.smithi100.stdout:6/971: mknod d7/d27/da0/c13b 0 2023-12-05T09:57:37.285 INFO:tasks.workunit.client.0.smithi100.stdout:6/972: chown d7/d11/l13 108 1 2023-12-05T09:57:37.287 INFO:tasks.workunit.client.0.smithi100.stdout:9/613: creat d7/d35/d97/fd5 x:0 0 0 2023-12-05T09:57:37.289 INFO:tasks.workunit.client.1.smithi150.stdout:4/552: mkdir d0/d3e/d5b/d6e/daa 0 2023-12-05T09:57:37.290 INFO:tasks.workunit.client.0.smithi100.stdout:7/564: dwrite d3/dc/d11/d13/de/d18/d3b/d40/d46/fba [0,4194304] 0 2023-12-05T09:57:37.294 INFO:tasks.workunit.client.0.smithi100.stdout:0/579: read da/d22/d33/f75 [1794591,65372] 0 2023-12-05T09:57:37.294 INFO:tasks.workunit.client.0.smithi100.stdout:9/614: rename d7/d35/c94 to d7/d35/d71/cd6 0 2023-12-05T09:57:37.294 INFO:tasks.workunit.client.0.smithi100.stdout:9/615: readlink d7/d1b/d22/d51/l1a 0 2023-12-05T09:57:37.296 INFO:tasks.workunit.client.0.smithi100.stdout:6/973: dread d7/f23 [0,4194304] 0 2023-12-05T09:57:37.296 INFO:tasks.workunit.client.0.smithi100.stdout:6/974: stat d7/d27/f2e 0 2023-12-05T09:57:37.296 INFO:tasks.workunit.client.0.smithi100.stdout:0/580: mknod da/d22/d33/d35/d3a/cad 0 2023-12-05T09:57:37.297 INFO:tasks.workunit.client.1.smithi150.stdout:4/553: readlink d0/le 0 2023-12-05T09:57:37.297 INFO:tasks.workunit.client.1.smithi150.stdout:4/554: write d0/d3e/d5b/f9b [467858,636] 0 2023-12-05T09:57:37.300 INFO:tasks.workunit.client.0.smithi100.stdout:4/578: write de/d66/f77 [7612938,47495] 0 2023-12-05T09:57:37.303 INFO:tasks.workunit.client.0.smithi100.stdout:9/616: link d7/fc d7/d1b/d22/d93/fd7 0 2023-12-05T09:57:37.311 INFO:tasks.workunit.client.1.smithi150.stdout:4/555: mknod d0/d3e/d5b/d80/cab 0 2023-12-05T09:57:37.318 INFO:tasks.workunit.client.0.smithi100.stdout:8/528: dwrite d0/d12/d13/d16/f79 [0,4194304] 0 2023-12-05T09:57:37.321 INFO:tasks.workunit.client.0.smithi100.stdout:8/529: truncate d0/d12/d13/d16/f46 1149179 0 2023-12-05T09:57:37.322 INFO:tasks.workunit.client.0.smithi100.stdout:8/530: chown d0/d12/d13/d16/f2e 0 1 2023-12-05T09:57:37.322 INFO:tasks.workunit.client.0.smithi100.stdout:4/579: mknod de/d16/cb8 0 2023-12-05T09:57:37.322 INFO:tasks.workunit.client.0.smithi100.stdout:4/580: creat de/d38/fb9 x:0 0 0 2023-12-05T09:57:37.322 INFO:tasks.workunit.client.0.smithi100.stdout:4/581: creat de/d16/d23/d33/d51/fba x:0 0 0 2023-12-05T09:57:37.323 INFO:tasks.workunit.client.0.smithi100.stdout:4/582: stat de/d16/d23 0 2023-12-05T09:57:37.323 INFO:tasks.workunit.client.0.smithi100.stdout:4/583: write de/d16/d23/d33/d3d/d44/f82 [193533,5467] 0 2023-12-05T09:57:37.323 INFO:tasks.workunit.client.1.smithi150.stdout:5/620: dread d1/d7f/d65/d3b/d6b/f91 [0,4194304] 0 2023-12-05T09:57:37.323 INFO:tasks.workunit.client.1.smithi150.stdout:5/621: write d1/d2e/da6/f32 [5434765,8691] 0 2023-12-05T09:57:37.325 INFO:tasks.workunit.client.1.smithi150.stdout:8/694: dread d0/d41/d49/d1b/d24/d38/d62/f9b [0,4194304] 0 2023-12-05T09:57:37.331 INFO:tasks.workunit.client.1.smithi150.stdout:4/556: dread d0/d3e/d48/d4d/f64 [0,4194304] 0 2023-12-05T09:57:37.332 INFO:tasks.workunit.client.1.smithi150.stdout:5/622: creat d1/d7f/d65/d3b/d6b/dcb/fd8 x:0 0 0 2023-12-05T09:57:37.332 INFO:tasks.workunit.client.1.smithi150.stdout:5/623: fsync d1/d7f/d65/f9d 0 2023-12-05T09:57:37.338 INFO:tasks.workunit.client.0.smithi100.stdout:8/531: truncate d0/d12/f36 1617465 0 2023-12-05T09:57:37.338 INFO:tasks.workunit.client.0.smithi100.stdout:8/532: chown d0/d12/d13/d16/d42/f75 133 1 2023-12-05T09:57:37.340 INFO:tasks.workunit.client.1.smithi150.stdout:6/568: dwrite d2/d23/d2e/d93/d97/f98 [0,4194304] 0 2023-12-05T09:57:37.346 INFO:tasks.workunit.client.1.smithi150.stdout:5/624: symlink d1/d3/d6/ld9 0 2023-12-05T09:57:37.348 INFO:tasks.workunit.client.0.smithi100.stdout:0/581: write da/d2a/d45/f49 [2354551,51302] 0 2023-12-05T09:57:37.349 INFO:tasks.workunit.client.1.smithi150.stdout:8/695: write d0/d41/d49/d1b/d24/d2e/f8b [746545,28019] 0 2023-12-05T09:57:37.349 INFO:tasks.workunit.client.1.smithi150.stdout:8/696: write d0/d41/d49/d1b/d24/d5b/fb4 [351826,81862] 0 2023-12-05T09:57:37.349 INFO:tasks.workunit.client.0.smithi100.stdout:3/728: dwrite d0/d2/de/d11/fad [0,4194304] 0 2023-12-05T09:57:37.354 INFO:tasks.workunit.client.1.smithi150.stdout:4/557: dread d0/d3e/d48/d4d/f57 [0,4194304] 0 2023-12-05T09:57:37.356 INFO:tasks.workunit.client.1.smithi150.stdout:0/654: sync 2023-12-05T09:57:37.356 INFO:tasks.workunit.client.1.smithi150.stdout:7/634: sync 2023-12-05T09:57:37.361 INFO:tasks.workunit.client.1.smithi150.stdout:8/697: dread d0/d41/d49/d1b/d24/d38/f78 [0,4194304] 0 2023-12-05T09:57:37.361 INFO:tasks.workunit.client.1.smithi150.stdout:8/698: chown d0/da1 5555859 1 2023-12-05T09:57:37.362 INFO:tasks.workunit.client.1.smithi150.stdout:8/699: readlink d0/d41/d49/d1b/d24/lc7 0 2023-12-05T09:57:37.362 INFO:tasks.workunit.client.1.smithi150.stdout:6/569: dread d2/d23/f45 [0,4194304] 0 2023-12-05T09:57:37.367 INFO:tasks.workunit.client.1.smithi150.stdout:5/625: rmdir d1/d2e 39 2023-12-05T09:57:37.368 INFO:tasks.workunit.client.1.smithi150.stdout:0/655: dread d5/d11/d71/d99/d9c/d3b/fbc [0,4194304] 0 2023-12-05T09:57:37.369 INFO:tasks.workunit.client.0.smithi100.stdout:7/565: dwrite d3/dc/d11/d13/de/d18/d3b/d40/d4c/d7f/f98 [0,4194304] 0 2023-12-05T09:57:37.369 INFO:tasks.workunit.client.0.smithi100.stdout:7/566: creat d3/dc/d11/d13/de/d2d/d42/fcf x:0 0 0 2023-12-05T09:57:37.370 INFO:tasks.workunit.client.1.smithi150.stdout:3/648: dwrite d6/d22/d37/d63/fbc [0,4194304] 0 2023-12-05T09:57:37.370 INFO:tasks.workunit.client.1.smithi150.stdout:9/575: dwrite d3/d9/d26/d34/f5b [0,4194304] 0 2023-12-05T09:57:37.370 INFO:tasks.workunit.client.1.smithi150.stdout:2/664: dwrite d0/d3/d5/d36/d86/fce [0,4194304] 0 2023-12-05T09:57:37.373 INFO:tasks.workunit.client.1.smithi150.stdout:6/570: dread d2/d23/d3b/d64/d7a/d5d/d6b/f22 [0,4194304] 0 2023-12-05T09:57:37.373 INFO:tasks.workunit.client.0.smithi100.stdout:9/617: dwrite d7/d20/f3c [0,4194304] 0 2023-12-05T09:57:37.376 INFO:tasks.workunit.client.1.smithi150.stdout:4/558: creat d0/d3e/d6d/fac x:0 0 0 2023-12-05T09:57:37.376 INFO:tasks.workunit.client.1.smithi150.stdout:5/626: symlink d1/d7f/d65/d3b/d6b/lda 0 2023-12-05T09:57:37.377 INFO:tasks.workunit.client.1.smithi150.stdout:7/635: dread d2/db/d30/d18/d63/f7b [0,4194304] 0 2023-12-05T09:57:37.381 INFO:tasks.workunit.client.1.smithi150.stdout:0/656: mkdir d5/d11/d65/d82/deb 0 2023-12-05T09:57:37.381 INFO:tasks.workunit.client.0.smithi100.stdout:8/533: symlink d0/d12/l92 0 2023-12-05T09:57:37.382 INFO:tasks.workunit.client.1.smithi150.stdout:8/700: dread d0/d41/d49/d1b/d24/d5b/fb4 [0,4194304] 0 2023-12-05T09:57:37.382 INFO:tasks.workunit.client.1.smithi150.stdout:8/701: fdatasync d0/d41/d49/d1b/f2b 0 2023-12-05T09:57:37.382 INFO:tasks.workunit.client.1.smithi150.stdout:8/702: write d0/d41/d49/f86 [4666194,115966] 0 2023-12-05T09:57:37.383 INFO:tasks.workunit.client.1.smithi150.stdout:8/703: creat d0/d41/d49/d1b/fde x:0 0 0 2023-12-05T09:57:37.383 INFO:tasks.workunit.client.1.smithi150.stdout:8/704: chown d0/d41/d49/d1b/d24/d2e/d30/c66 107076181 1 2023-12-05T09:57:37.388 INFO:tasks.workunit.client.0.smithi100.stdout:0/582: rename da/d1b/d6b/d78/fab to da/d22/d33/d35/d3a/d8b/d8f/fae 0 2023-12-05T09:57:37.388 INFO:tasks.workunit.client.0.smithi100.stdout:0/583: fdatasync da/d22/f2b 0 2023-12-05T09:57:37.389 INFO:tasks.workunit.client.1.smithi150.stdout:9/576: stat d3/d9/dc/d1f/l6a 0 2023-12-05T09:57:37.392 INFO:tasks.workunit.client.1.smithi150.stdout:3/649: mknod d6/d9/d43/d47/d94/cd3 0 2023-12-05T09:57:37.393 INFO:tasks.workunit.client.0.smithi100.stdout:3/729: symlink d0/d2/de/db8/dee/lfb 0 2023-12-05T09:57:37.393 INFO:tasks.workunit.client.0.smithi100.stdout:3/730: fdatasync d0/d3d/d5c/d6f/d7f/d87/f9a 0 2023-12-05T09:57:37.393 INFO:tasks.workunit.client.0.smithi100.stdout:4/584: dwrite f1 [4194304,4194304] 0 2023-12-05T09:57:37.393 INFO:tasks.workunit.client.0.smithi100.stdout:4/585: dread - de/d38/d5d/f5e zero size 2023-12-05T09:57:37.396 INFO:tasks.workunit.client.1.smithi150.stdout:2/665: symlink d0/d3/d5/d13/d15/d30/le5 0 2023-12-05T09:57:37.396 INFO:tasks.workunit.client.1.smithi150.stdout:2/666: chown d0/d3/d5/d13/d15/d30/d54/faf 22 1 2023-12-05T09:57:37.396 INFO:tasks.workunit.client.1.smithi150.stdout:2/667: chown d0/d3/d27/dac/ccc 467 1 2023-12-05T09:57:37.403 INFO:tasks.workunit.client.1.smithi150.stdout:6/571: truncate d2/d23/d3b/d64/d7a/f5e 435213 0 2023-12-05T09:57:37.408 INFO:tasks.workunit.client.1.smithi150.stdout:5/627: symlink d1/d2e/ldb 0 2023-12-05T09:57:37.409 INFO:tasks.workunit.client.1.smithi150.stdout:9/577: dread d3/d9/d26/d34/f5b [0,4194304] 0 2023-12-05T09:57:37.409 INFO:tasks.workunit.client.1.smithi150.stdout:9/578: stat d3/d9/d26/d34/f5b 0 2023-12-05T09:57:37.411 INFO:tasks.workunit.client.0.smithi100.stdout:7/567: symlink d3/dc/d11/d13/de/d2d/d47/dbd/ld0 0 2023-12-05T09:57:37.411 INFO:tasks.workunit.client.0.smithi100.stdout:7/568: write d3/dc/d11/d13/de/f28 [1200507,7197] 0 2023-12-05T09:57:37.412 INFO:tasks.workunit.client.1.smithi150.stdout:7/636: read - d2/db/d30/d13/f1d zero size 2023-12-05T09:57:37.412 INFO:tasks.workunit.client.0.smithi100.stdout:9/618: write d7/d1b/d22/d51/f11 [1420338,56178] 0 2023-12-05T09:57:37.413 INFO:tasks.workunit.client.0.smithi100.stdout:9/619: getdents d7/d1b/d22/d51/d32/dc2 0 2023-12-05T09:57:37.413 INFO:tasks.workunit.client.0.smithi100.stdout:9/620: readlink d7/d1b/d22/d2a/d74/l81 0 2023-12-05T09:57:37.415 INFO:tasks.workunit.client.1.smithi150.stdout:0/657: creat d5/d11/d71/d99/d9c/d96/dd5/d7f/fec x:0 0 0 2023-12-05T09:57:37.417 INFO:tasks.workunit.client.0.smithi100.stdout:0/584: rename da/d22/d33/d35/d3a/c42 to da/d2a/caf 0 2023-12-05T09:57:37.418 INFO:tasks.workunit.client.1.smithi150.stdout:2/668: write d0/f8e [1199784,126709] 0 2023-12-05T09:57:37.419 INFO:tasks.workunit.client.1.smithi150.stdout:2/669: read d0/d3/d11/f18 [957289,115955] 0 2023-12-05T09:57:37.422 INFO:tasks.workunit.client.0.smithi100.stdout:3/731: mkdir d0/d3d/dfc 0 2023-12-05T09:57:37.425 INFO:tasks.workunit.client.0.smithi100.stdout:4/586: mknod de/d16/d23/d33/d3d/db0/cbb 0 2023-12-05T09:57:37.428 INFO:tasks.workunit.client.1.smithi150.stdout:8/705: mkdir d0/d41/d49/d1b/d24/d34/dd0/ddf 0 2023-12-05T09:57:37.428 INFO:tasks.workunit.client.1.smithi150.stdout:8/706: chown d0/d41/d49/f52 18709202 1 2023-12-05T09:57:37.428 INFO:tasks.workunit.client.1.smithi150.stdout:8/707: fsync d0/d41/d49/fbd 0 2023-12-05T09:57:37.430 INFO:tasks.workunit.client.1.smithi150.stdout:4/559: dwrite d0/d3e/d5b/d80/f63 [0,4194304] 0 2023-12-05T09:57:37.433 INFO:tasks.workunit.client.1.smithi150.stdout:3/650: truncate d6/d9/d43/f60 605866 0 2023-12-05T09:57:37.436 INFO:tasks.workunit.client.1.smithi150.stdout:7/637: dread d2/d4/f23 [0,4194304] 0 2023-12-05T09:57:37.439 INFO:tasks.workunit.client.0.smithi100.stdout:0/585: symlink da/d60/lb0 0 2023-12-05T09:57:37.439 INFO:tasks.workunit.client.0.smithi100.stdout:0/586: write da/d2a/f62 [1270870,111463] 0 2023-12-05T09:57:37.441 INFO:tasks.workunit.client.0.smithi100.stdout:9/621: write d7/fd [378136,35221] 0 2023-12-05T09:57:37.441 INFO:tasks.workunit.client.0.smithi100.stdout:6/975: dwrite d7/d27/d97/fb2 [0,4194304] 0 2023-12-05T09:57:37.442 INFO:tasks.workunit.client.0.smithi100.stdout:6/976: chown d7/d11/d1a/db7/df7/d126/d6a/fad 335673257 1 2023-12-05T09:57:37.444 INFO:tasks.workunit.client.1.smithi150.stdout:1/618: sync 2023-12-05T09:57:37.445 INFO:tasks.workunit.client.0.smithi100.stdout:3/732: creat d0/d3d/d5c/d6f/ffd x:0 0 0 2023-12-05T09:57:37.445 INFO:tasks.workunit.client.0.smithi100.stdout:3/733: fdatasync d0/d3d/d5c/fd8 0 2023-12-05T09:57:37.445 INFO:tasks.workunit.client.0.smithi100.stdout:3/734: chown d0/d3d/d5c/d6f 2 1 2023-12-05T09:57:37.446 INFO:tasks.workunit.client.1.smithi150.stdout:6/572: creat d2/d23/d3b/fc3 x:0 0 0 2023-12-05T09:57:37.450 INFO:tasks.workunit.client.0.smithi100.stdout:4/587: creat de/d16/d23/d33/dae/fbc x:0 0 0 2023-12-05T09:57:37.450 INFO:tasks.workunit.client.0.smithi100.stdout:4/588: write f9 [511729,100992] 0 2023-12-05T09:57:37.455 INFO:tasks.workunit.client.1.smithi150.stdout:9/579: symlink d3/d9/dc/d91/lc0 0 2023-12-05T09:57:37.458 INFO:tasks.workunit.client.1.smithi150.stdout:7/638: dread d2/db/d30/d13/f14 [0,4194304] 0 2023-12-05T09:57:37.459 INFO:tasks.workunit.client.0.smithi100.stdout:7/569: dwrite d3/f24 [0,4194304] 0 2023-12-05T09:57:37.459 INFO:tasks.workunit.client.1.smithi150.stdout:0/658: creat d5/d11/d71/d99/d9c/d96/dd5/d7f/db4/fed x:0 0 0 2023-12-05T09:57:37.461 INFO:tasks.workunit.client.1.smithi150.stdout:5/628: dwrite d1/d2e/da6/d86/fb7 [4194304,4194304] 0 2023-12-05T09:57:37.461 INFO:tasks.workunit.client.0.smithi100.stdout:8/534: dwrite d0/d35/d64/f85 [0,4194304] 0 2023-12-05T09:57:37.461 INFO:tasks.workunit.client.0.smithi100.stdout:8/535: creat d0/d35/f93 x:0 0 0 2023-12-05T09:57:37.471 INFO:tasks.workunit.client.0.smithi100.stdout:9/622: write d7/f9 [158692,106019] 0 2023-12-05T09:57:37.472 INFO:tasks.workunit.client.1.smithi150.stdout:6/573: dread d2/d23/d2e/d44/f50 [0,4194304] 0 2023-12-05T09:57:37.472 INFO:tasks.workunit.client.1.smithi150.stdout:2/670: creat d0/d3/d5/fe6 x:0 0 0 2023-12-05T09:57:37.472 INFO:tasks.workunit.client.1.smithi150.stdout:8/708: creat d0/d41/d49/dda/fe0 x:0 0 0 2023-12-05T09:57:37.472 INFO:tasks.workunit.client.1.smithi150.stdout:8/709: truncate d0/d41/d49/d1b/d24/fbb 609813 0 2023-12-05T09:57:37.473 INFO:tasks.workunit.client.0.smithi100.stdout:3/735: mknod d0/d3d/d90/def/cfe 0 2023-12-05T09:57:37.475 INFO:tasks.workunit.client.0.smithi100.stdout:4/589: mknod de/d16/d23/d33/d3d/db0/cbd 0 2023-12-05T09:57:37.484 INFO:tasks.workunit.client.1.smithi150.stdout:1/619: symlink d6/d38/d4a/lda 0 2023-12-05T09:57:37.484 INFO:tasks.workunit.client.1.smithi150.stdout:1/620: chown d6/d47/d4c/dd9/l62 3481580 1 2023-12-05T09:57:37.484 INFO:tasks.workunit.client.1.smithi150.stdout:1/621: truncate d6/d38/fb7 485510 0 2023-12-05T09:57:37.489 INFO:tasks.workunit.client.1.smithi150.stdout:9/580: symlink d3/lc1 0 2023-12-05T09:57:37.489 INFO:tasks.workunit.client.1.smithi150.stdout:9/581: chown d3/d9/d26/d34/f5b 1920 1 2023-12-05T09:57:37.489 INFO:tasks.workunit.client.1.smithi150.stdout:9/582: fdatasync d3/d1b/f59 0 2023-12-05T09:57:37.489 INFO:tasks.workunit.client.1.smithi150.stdout:9/583: chown d3/d1b/f36 2 1 2023-12-05T09:57:37.494 INFO:tasks.workunit.client.1.smithi150.stdout:5/629: creat d1/d7f/d65/d3b/fdc x:0 0 0 2023-12-05T09:57:37.496 INFO:tasks.workunit.client.0.smithi100.stdout:0/587: dwrite da/d22/d33/f7d [0,4194304] 0 2023-12-05T09:57:37.497 INFO:tasks.workunit.client.0.smithi100.stdout:0/588: readlink da/d22/d33/d35/l80 0 2023-12-05T09:57:37.498 INFO:tasks.workunit.client.1.smithi150.stdout:2/671: link d0/d3/d11/d1d/l60 d0/le7 0 2023-12-05T09:57:37.502 INFO:tasks.workunit.client.1.smithi150.stdout:4/560: unlink d0/f3b 0 2023-12-05T09:57:37.502 INFO:tasks.workunit.client.1.smithi150.stdout:4/561: readlink d0/d3e/d5b/d80/d44/da2/la7 0 2023-12-05T09:57:37.509 INFO:tasks.workunit.client.0.smithi100.stdout:9/623: write d7/d60/fcc [2977661,26250] 0 2023-12-05T09:57:37.513 INFO:tasks.workunit.client.0.smithi100.stdout:4/590: getdents de/d38/d8b 0 2023-12-05T09:57:37.513 INFO:tasks.workunit.client.0.smithi100.stdout:4/591: read de/f1b [596932,126986] 0 2023-12-05T09:57:37.516 INFO:tasks.workunit.client.1.smithi150.stdout:5/630: mknod d1/d3/d6/d26/d9a/cdd 0 2023-12-05T09:57:37.516 INFO:tasks.workunit.client.0.smithi100.stdout:9/624: symlink d7/d1b/d22/d2a/d74/ld8 0 2023-12-05T09:57:37.517 INFO:tasks.workunit.client.0.smithi100.stdout:9/625: dread - d7/d1b/d22/d51/d32/f42 zero size 2023-12-05T09:57:37.520 INFO:tasks.workunit.client.1.smithi150.stdout:5/631: creat d1/d7f/fde x:0 0 0 2023-12-05T09:57:37.520 INFO:tasks.workunit.client.1.smithi150.stdout:4/562: creat d0/d3e/d6d/d4b/d8c/fad x:0 0 0 2023-12-05T09:57:37.520 INFO:tasks.workunit.client.1.smithi150.stdout:3/651: rename d6/d22/d37/db8/fbe to d6/fd4 0 2023-12-05T09:57:37.520 INFO:tasks.workunit.client.1.smithi150.stdout:3/652: fsync d6/d9/d3d/d56/d53/d51/f8b 0 2023-12-05T09:57:37.520 INFO:tasks.workunit.client.1.smithi150.stdout:2/672: truncate d0/d3/d5/d3b/d4c/f64 3850374 0 2023-12-05T09:57:37.521 INFO:tasks.workunit.client.0.smithi100.stdout:4/592: mkdir de/d16/d23/d33/d3d/d44/d4e/dbe 0 2023-12-05T09:57:37.521 INFO:tasks.workunit.client.0.smithi100.stdout:4/593: write de/f1b [3179369,65923] 0 2023-12-05T09:57:37.521 INFO:tasks.workunit.client.0.smithi100.stdout:4/594: dread - de/d16/d23/d33/d3d/d44/d4e/d80/f8a zero size 2023-12-05T09:57:37.521 INFO:tasks.workunit.client.0.smithi100.stdout:4/595: fsync de/d38/d5d/f6e 0 2023-12-05T09:57:37.527 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.524+0000 7f9368eb4700 1 -- 172.21.15.100:0/2910657241 --> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f936402b260 con 0x7f934c06af50 2023-12-05T09:57:37.528 INFO:tasks.workunit.client.0.smithi100.stdout:9/626: readlink d7/d1b/d22/d51/l64 0 2023-12-05T09:57:37.529 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.530+0000 7f9352ffd700 1 -- 172.21.15.100:0/2910657241 <== mgr.24423 v2:172.21.15.150:6828/896268868 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f936402b260 con 0x7f934c06af50 2023-12-05T09:57:37.529 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2023-12-05T09:57:37.529 INFO:teuthology.orchestra.run.smithi100.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ff918c95653912ae4c171d8d1db5f5eabc756f85ff7e3ce78f13f9c521198459", 2023-12-05T09:57:37.529 INFO:teuthology.orchestra.run.smithi100.stdout: "in_progress": true, 2023-12-05T09:57:37.529 INFO:teuthology.orchestra.run.smithi100.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-05T09:57:37.529 INFO:teuthology.orchestra.run.smithi100.stdout: "services_complete": [], 2023-12-05T09:57:37.529 INFO:teuthology.orchestra.run.smithi100.stdout: "progress": "1/21 daemons upgraded", 2023-12-05T09:57:37.529 INFO:teuthology.orchestra.run.smithi100.stdout: "message": "", 2023-12-05T09:57:37.530 INFO:teuthology.orchestra.run.smithi100.stdout: "is_paused": false 2023-12-05T09:57:37.530 INFO:teuthology.orchestra.run.smithi100.stdout:} 2023-12-05T09:57:37.530 INFO:tasks.workunit.client.1.smithi150.stdout:4/563: rename d0/d3e/d6d/f8f to d0/d3e/d6d/d4b/fae 0 2023-12-05T09:57:37.530 INFO:tasks.workunit.client.1.smithi150.stdout:2/673: mknod d0/d3/d21/d4d/ce8 0 2023-12-05T09:57:37.530 INFO:tasks.workunit.client.1.smithi150.stdout:4/564: mknod d0/d5f/caf 0 2023-12-05T09:57:37.531 INFO:tasks.workunit.client.1.smithi150.stdout:4/565: chown d0/d3e/d5b/d80/l66 0 1 2023-12-05T09:57:37.531 INFO:tasks.workunit.client.1.smithi150.stdout:4/566: chown d0/d3e/d6d/d95 521224 1 2023-12-05T09:57:37.534 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.536+0000 7f9368eb4700 1 -- 172.21.15.100:0/2910657241 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7f934c06af50 msgr2=0x7f934c06d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:57:37.534 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.536+0000 7f9368eb4700 1 --2- 172.21.15.100:0/2910657241 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7f934c06af50 0x7f934c06d400 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f936410d8a0 tx=0x7f9358009e30 comp rx=0 tx=0).stop 2023-12-05T09:57:37.534 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.536+0000 7f9368eb4700 1 -- 172.21.15.100:0/2910657241 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f936406e700 msgr2=0x7f936410c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:57:37.534 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.536+0000 7f9368eb4700 1 --2- 172.21.15.100:0/2910657241 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f936406e700 0x7f936410c830 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f935c00ec90 tx=0x7f935c00b040 comp rx=0 tx=0).stop 2023-12-05T09:57:37.534 INFO:tasks.workunit.client.0.smithi100.stdout:9/627: unlink d7/d1b/d22/d2a/d56/d2e/cbf 0 2023-12-05T09:57:37.535 INFO:tasks.workunit.client.1.smithi150.stdout:5/632: dread d1/f8c [0,4194304] 0 2023-12-05T09:57:37.535 INFO:tasks.workunit.client.1.smithi150.stdout:5/633: write d1/d3/fd1 [870171,48083] 0 2023-12-05T09:57:37.535 INFO:tasks.workunit.client.1.smithi150.stdout:5/634: chown d1/d3/d6/l5a 0 1 2023-12-05T09:57:37.535 INFO:tasks.workunit.client.1.smithi150.stdout:5/635: fsync d1/d7f/d65/d3b/d8d/fa8 0 2023-12-05T09:57:37.535 INFO:tasks.workunit.client.1.smithi150.stdout:5/636: readlink d1/d3/d6/d11/ld4 0 2023-12-05T09:57:37.536 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.538+0000 7f9368eb4700 1 -- 172.21.15.100:0/2910657241 shutdown_connections 2023-12-05T09:57:37.537 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.538+0000 7f9368eb4700 1 --2- 172.21.15.100:0/2910657241 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7f934c06af50 0x7f934c06d400 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:37.537 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.538+0000 7f9368eb4700 1 --2- 172.21.15.100:0/2910657241 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f936406e700 0x7f936410c830 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:37.537 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.538+0000 7f9368eb4700 1 --2- 172.21.15.100:0/2910657241 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f936410cd70 0x7f936410dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:37.537 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.538+0000 7f9368eb4700 1 -- 172.21.15.100:0/2910657241 >> 172.21.15.100:0/2910657241 conn(0x7f9364069b20 msgr2=0x7f93641074e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:57:37.537 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.538+0000 7f9368eb4700 1 -- 172.21.15.100:0/2910657241 shutdown_connections 2023-12-05T09:57:37.537 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.538+0000 7f9368eb4700 1 -- 172.21.15.100:0/2910657241 wait complete. 2023-12-05T09:57:37.537 INFO:tasks.workunit.client.0.smithi100.stdout:6/977: dwrite d7/d27/f9a [0,4194304] 0 2023-12-05T09:57:37.537 INFO:tasks.workunit.client.0.smithi100.stdout:6/978: fsync d7/d27/d35/d5a/db0/ff9 0 2023-12-05T09:57:37.538 INFO:tasks.workunit.client.1.smithi150.stdout:8/710: dwrite d0/d41/d49/d1b/d24/d34/da2/fc9 [0,4194304] 0 2023-12-05T09:57:37.538 INFO:tasks.workunit.client.1.smithi150.stdout:8/711: dread - d0/d41/d49/d1b/d24/d2e/fc2 zero size 2023-12-05T09:57:37.539 INFO:tasks.workunit.client.0.smithi100.stdout:9/628: mkdir d7/d1b/d22/d93/dd9 0 2023-12-05T09:57:37.550 INFO:tasks.workunit.client.1.smithi150.stdout:7/639: dwrite d2/db/d30/d18/d1a/f68 [0,4194304] 0 2023-12-05T09:57:37.551 INFO:tasks.workunit.client.1.smithi150.stdout:5/637: rename d1/d3/d6/d89 to d1/d64/d31/d5b/ddf 0 2023-12-05T09:57:37.552 INFO:tasks.workunit.client.1.smithi150.stdout:5/638: chown d1/d3/f7 92733 1 2023-12-05T09:57:37.553 INFO:tasks.workunit.client.0.smithi100.stdout:7/570: dwrite d3/dc/d11/d33/f7b [0,4194304] 0 2023-12-05T09:57:37.553 INFO:tasks.workunit.client.0.smithi100.stdout:7/571: chown d3/dc/d11/d13/de/c70 19 1 2023-12-05T09:57:37.566 INFO:tasks.workunit.client.1.smithi150.stdout:3/653: write d6/d9/fbd [1695505,23994] 0 2023-12-05T09:57:37.567 INFO:tasks.workunit.client.1.smithi150.stdout:4/567: unlink d0/l89 0 2023-12-05T09:57:37.567 INFO:tasks.workunit.client.1.smithi150.stdout:4/568: write d0/d3e/f8d [67980,66445] 0 2023-12-05T09:57:37.569 INFO:tasks.workunit.client.1.smithi150.stdout:8/712: truncate d0/d41/d49/d1b/d24/d34/d56/d67/d64/f7e 2679959 0 2023-12-05T09:57:37.569 INFO:tasks.workunit.client.1.smithi150.stdout:8/713: write d0/d41/d49/d1b/d24/d5b/faa [1600044,103039] 0 2023-12-05T09:57:37.569 INFO:tasks.workunit.client.1.smithi150.stdout:8/714: dread - d0/d41/d49/d1b/fc5 zero size 2023-12-05T09:57:37.569 INFO:tasks.workunit.client.1.smithi150.stdout:8/715: write d0/d41/d49/d1b/fd4 [403307,43483] 0 2023-12-05T09:57:37.570 INFO:tasks.workunit.client.1.smithi150.stdout:6/574: dwrite d2/d23/d2e/f85 [0,4194304] 0 2023-12-05T09:57:37.573 INFO:tasks.workunit.client.1.smithi150.stdout:7/640: mkdir d2/db/d30/d18/d1a/d1e/d2b/dd2 0 2023-12-05T09:57:37.574 INFO:tasks.workunit.client.1.smithi150.stdout:7/641: chown d2/db/d30/d13/c86 3 1 2023-12-05T09:57:37.577 INFO:tasks.workunit.client.0.smithi100.stdout:6/979: creat d7/d11/d1a/db7/df7/d126/d6a/de2/f13c x:0 0 0 2023-12-05T09:57:37.580 INFO:tasks.workunit.client.0.smithi100.stdout:9/629: mkdir d7/d35/d71/dda 0 2023-12-05T09:57:37.582 INFO:tasks.workunit.client.1.smithi150.stdout:5/639: mknod d1/d3/d6/ce0 0 2023-12-05T09:57:37.586 INFO:tasks.workunit.client.0.smithi100.stdout:0/589: dwrite da/d1b/d73/d82/f8a [0,4194304] 0 2023-12-05T09:57:37.586 INFO:tasks.workunit.client.0.smithi100.stdout:0/590: creat da/fb1 x:0 0 0 2023-12-05T09:57:37.587 INFO:tasks.workunit.client.1.smithi150.stdout:4/569: mknod d0/d3e/d5b/d80/da1/cb0 0 2023-12-05T09:57:37.587 INFO:tasks.workunit.client.1.smithi150.stdout:4/570: truncate d0/d3e/f8d 1078183 0 2023-12-05T09:57:37.587 INFO:tasks.workunit.client.1.smithi150.stdout:4/571: read d0/d3e/d48/f4e [2919023,119149] 0 2023-12-05T09:57:37.587 INFO:tasks.workunit.client.1.smithi150.stdout:4/572: dread - d0/d3e/d48/f53 zero size 2023-12-05T09:57:37.587 INFO:tasks.workunit.client.1.smithi150.stdout:4/573: fsync d0/d5f/f68 0 2023-12-05T09:57:37.589 INFO:tasks.workunit.client.0.smithi100.stdout:7/572: link d3/dc/d11/d13/de/ca1 d3/dc/d11/d13/de/cd1 0 2023-12-05T09:57:37.594 INFO:tasks.workunit.client.0.smithi100.stdout:6/980: mkdir d7/d11/dd1/d13d 0 2023-12-05T09:57:37.595 INFO:tasks.workunit.client.0.smithi100.stdout:9/630: creat d7/d1b/d22/d51/fdb x:0 0 0 2023-12-05T09:57:37.597 INFO:tasks.workunit.client.1.smithi150.stdout:6/575: truncate d2/d23/d2e/f3c 996365 0 2023-12-05T09:57:37.597 INFO:tasks.workunit.client.1.smithi150.stdout:6/576: chown d2/d23/d3b/d64/d7a/c65 250535 1 2023-12-05T09:57:37.597 INFO:tasks.workunit.client.1.smithi150.stdout:6/577: chown d2/d23/d2e/d44/l9d 948 1 2023-12-05T09:57:37.597 INFO:tasks.workunit.client.1.smithi150.stdout:6/578: fdatasync d2/d23/d3b/d64/d7a/d5d/fbd 0 2023-12-05T09:57:37.597 INFO:tasks.workunit.client.1.smithi150.stdout:6/579: write d2/d23/d3b/d64/d7a/fb9 [982976,59118] 0 2023-12-05T09:57:37.599 INFO:tasks.workunit.client.0.smithi100.stdout:2/728: sync 2023-12-05T09:57:37.599 INFO:tasks.workunit.client.0.smithi100.stdout:2/729: chown d7/da/d18/d21/d86/fca 460079546 1 2023-12-05T09:57:37.599 INFO:tasks.workunit.client.0.smithi100.stdout:2/730: write d7/da/d18/d21/d4d/f58 [537814,24047] 0 2023-12-05T09:57:37.601 INFO:tasks.workunit.client.1.smithi150.stdout:0/659: dwrite d5/d11/d71/d99/d9c/fcf [0,4194304] 0 2023-12-05T09:57:37.601 INFO:tasks.workunit.client.0.smithi100.stdout:4/596: dwrite de/d38/fb6 [0,4194304] 0 2023-12-05T09:57:37.603 INFO:tasks.workunit.client.1.smithi150.stdout:9/584: dwrite d3/d9/f20 [0,4194304] 0 2023-12-05T09:57:37.603 INFO:tasks.workunit.client.0.smithi100.stdout:3/736: dwrite d0/d10/f43 [4194304,4194304] 0 2023-12-05T09:57:37.607 INFO:tasks.workunit.client.1.smithi150.stdout:4/574: mknod d0/d3e/d5b/d80/cb1 0 2023-12-05T09:57:37.609 INFO:tasks.workunit.client.0.smithi100.stdout:0/591: getdents da/d1b 0 2023-12-05T09:57:37.610 INFO:tasks.workunit.client.1.smithi150.stdout:1/622: dwrite d6/d8/d59/fc0 [0,4194304] 0 2023-12-05T09:57:37.610 INFO:tasks.workunit.client.1.smithi150.stdout:2/674: dwrite d0/da3/dae/fd9 [0,4194304] 0 2023-12-05T09:57:37.610 INFO:tasks.workunit.client.1.smithi150.stdout:2/675: fsync d0/da3/fbc 0 2023-12-05T09:57:37.617 INFO:tasks.workunit.client.0.smithi100.stdout:7/573: creat d3/db3/fd2 x:0 0 0 2023-12-05T09:57:37.620 INFO:tasks.workunit.client.1.smithi150.stdout:6/580: unlink d2/d23/f7e 0 2023-12-05T09:57:37.621 INFO:tasks.workunit.client.1.smithi150.stdout:6/581: creat d2/d23/d2e/fc4 x:0 0 0 2023-12-05T09:57:37.621 INFO:tasks.workunit.client.1.smithi150.stdout:6/582: dread - d2/d23/d3b/fa4 zero size 2023-12-05T09:57:37.624 INFO:tasks.workunit.client.0.smithi100.stdout:2/731: dread d7/da/d18/d21/d4d/f58 [0,4194304] 0 2023-12-05T09:57:37.624 INFO:tasks.workunit.client.0.smithi100.stdout:1/590: sync 2023-12-05T09:57:37.624 INFO:tasks.workunit.client.0.smithi100.stdout:1/591: fdatasync db/d12/d1e/f50 0 2023-12-05T09:57:37.624 INFO:tasks.workunit.client.0.smithi100.stdout:5/610: sync 2023-12-05T09:57:37.631 INFO:tasks.workunit.client.1.smithi150.stdout:0/660: symlink d5/d11/d16/lee 0 2023-12-05T09:57:37.631 INFO:tasks.workunit.client.1.smithi150.stdout:0/661: stat d5/d11/d71/d5f/d77/c7e 0 2023-12-05T09:57:37.631 INFO:tasks.workunit.client.1.smithi150.stdout:0/662: chown d5/d11/d71/d99/d9c/d3b/fbc 931687674 1 2023-12-05T09:57:37.631 INFO:tasks.workunit.client.1.smithi150.stdout:8/716: dwrite d0/d41/d49/d1b/d24/d38/f78 [0,4194304] 0 2023-12-05T09:57:37.633 INFO:tasks.workunit.client.1.smithi150.stdout:1/623: dread d6/f8d [0,4194304] 0 2023-12-05T09:57:37.633 INFO:tasks.workunit.client.1.smithi150.stdout:3/654: dwrite d6/f17 [0,4194304] 0 2023-12-05T09:57:37.634 INFO:tasks.workunit.client.0.smithi100.stdout:4/597: link de/d16/d23/d60/d98/fa8 de/d16/d23/fbf 0 2023-12-05T09:57:37.639 INFO:tasks.workunit.client.0.smithi100.stdout:3/737: symlink d0/d4/d3a/lff 0 2023-12-05T09:57:37.639 INFO:tasks.workunit.client.1.smithi150.stdout:7/642: rename d2/db/d30/d18/d1a/d1e to d2/db/d30/daf/dd3 0 2023-12-05T09:57:37.642 INFO:tasks.workunit.client.0.smithi100.stdout:0/592: rename da/c13 to da/d1b/cb2 0 2023-12-05T09:57:37.648 INFO:tasks.workunit.client.0.smithi100.stdout:6/981: getdents d7/d11/de8 0 2023-12-05T09:57:37.654 INFO:tasks.workunit.client.1.smithi150.stdout:5/640: fdatasync d1/d2e/da6/f32 0 2023-12-05T09:57:37.655 INFO:tasks.workunit.client.0.smithi100.stdout:9/631: link d7/d1b/d22/d2a/d74/c8b d7/cdc 0 2023-12-05T09:57:37.656 INFO:tasks.workunit.client.1.smithi150.stdout:2/676: truncate d0/d3/d11/d1d/f29 555326 0 2023-12-05T09:57:37.656 INFO:tasks.workunit.client.1.smithi150.stdout:2/677: fdatasync d0/fc5 0 2023-12-05T09:57:37.656 INFO:tasks.workunit.client.1.smithi150.stdout:4/575: read d0/f41 [932974,71423] 0 2023-12-05T09:57:37.658 INFO:tasks.workunit.client.0.smithi100.stdout:5/611: truncate d0/d4/d14/d35/f70 4136567 0 2023-12-05T09:57:37.667 INFO:tasks.workunit.client.0.smithi100.stdout:3/738: mkdir d0/d2/de/d11/d58/db0/d100 0 2023-12-05T09:57:37.668 INFO:tasks.workunit.client.1.smithi150.stdout:6/583: symlink d2/d23/d3b/db4/dc0/lc5 0 2023-12-05T09:57:37.668 INFO:tasks.workunit.client.0.smithi100.stdout:9/632: mkdir d7/d1b/d22/d2a/d56/d2e/d50/ddd 0 2023-12-05T09:57:37.670 INFO:tasks.workunit.client.1.smithi150.stdout:6/584: read d2/d23/d3b/d64/d7a/d5d/d6b/f22 [1149062,125433] 0 2023-12-05T09:57:37.671 INFO:tasks.workunit.client.0.smithi100.stdout:5/612: mknod d0/d1b/d4d/d8e/d96/cd3 0 2023-12-05T09:57:37.671 INFO:tasks.workunit.client.0.smithi100.stdout:5/613: creat d0/d4/d14/d35/d62/fd4 x:0 0 0 2023-12-05T09:57:37.671 INFO:tasks.workunit.client.0.smithi100.stdout:3/739: rename d0/d2/de/l81 to d0/d10/d39/l101 0 2023-12-05T09:57:37.671 INFO:tasks.workunit.client.0.smithi100.stdout:3/740: stat d0/d2/de/db8/dee/lfb 0 2023-12-05T09:57:37.677 INFO:tasks.workunit.client.1.smithi150.stdout:7/643: write d2/db/d30/daf/dd3/d2b/f34 [6300596,67142] 0 2023-12-05T09:57:37.677 INFO:tasks.workunit.client.1.smithi150.stdout:3/655: link d6/d9/d3d/d56/d53/lc0 d6/d9/d3d/d56/d71/db0/ld5 0 2023-12-05T09:57:37.678 INFO:tasks.workunit.client.1.smithi150.stdout:3/656: readlink d6/d9/d3d/d56/d53/d51/lab 0 2023-12-05T09:57:37.678 INFO:tasks.workunit.client.1.smithi150.stdout:3/657: write d6/d9/d3d/d56/d71/db6/dc1/f96 [828869,99269] 0 2023-12-05T09:57:37.678 INFO:tasks.workunit.client.0.smithi100.stdout:3/741: rmdir d0/d2/de/d8d/de3/ded 0 2023-12-05T09:57:37.684 INFO:tasks.workunit.client.1.smithi150.stdout:1/624: rename d6/d8/db/d1b/c5a to d6/d8/db/cdb 0 2023-12-05T09:57:37.685 INFO:tasks.workunit.client.1.smithi150.stdout:5/641: mkdir d1/d7f/de1 0 2023-12-05T09:57:37.685 INFO:tasks.workunit.client.1.smithi150.stdout:5/642: truncate d1/d3/d6/d1b/fa7 632951 0 2023-12-05T09:57:37.692 INFO:tasks.workunit.client.1.smithi150.stdout:2/678: unlink d0/d3/d5/d10/d3d/l80 0 2023-12-05T09:57:37.693 INFO:tasks.workunit.client.1.smithi150.stdout:6/585: unlink d2/d23/d2e/d5f/l8b 0 2023-12-05T09:57:37.693 INFO:tasks.workunit.client.1.smithi150.stdout:6/586: truncate d2/d23/d2e/d93/d97/f84 646115 0 2023-12-05T09:57:37.693 INFO:tasks.workunit.client.1.smithi150.stdout:0/663: rmdir d5/d11/d32/d57 39 2023-12-05T09:57:37.697 INFO:tasks.workunit.client.1.smithi150.stdout:7/644: mkdir d2/d9d/da0/dd4 0 2023-12-05T09:57:37.697 INFO:tasks.workunit.client.1.smithi150.stdout:3/658: mknod d6/d9/d3d/d56/cd6 0 2023-12-05T09:57:37.697 INFO:tasks.workunit.client.1.smithi150.stdout:5/643: mkdir d1/d3/d6/d26/dca/de2 0 2023-12-05T09:57:37.701 INFO:tasks.workunit.client.1.smithi150.stdout:2/679: rename d0/f7 to d0/da3/dae/dc3/fe9 0 2023-12-05T09:57:37.702 INFO:tasks.workunit.client.1.smithi150.stdout:6/587: mkdir d2/d23/d3b/d64/d7a/d5d/d6b/d9c/dc6 0 2023-12-05T09:57:37.703 INFO:tasks.workunit.client.1.smithi150.stdout:0/664: creat d5/d11/d71/d99/d9c/d46/d80/fef x:0 0 0 2023-12-05T09:57:37.706 INFO:tasks.workunit.client.1.smithi150.stdout:3/659: mkdir d6/d25/dd7 0 2023-12-05T09:57:37.706 INFO:tasks.workunit.client.1.smithi150.stdout:3/660: truncate d6/d9/d3d/d52/fc5 515521 0 2023-12-05T09:57:37.706 INFO:tasks.workunit.client.1.smithi150.stdout:5/644: mkdir d1/d7f/d65/de3 0 2023-12-05T09:57:37.706 INFO:tasks.workunit.client.1.smithi150.stdout:0/665: write d5/d11/d71/d99/d9c/d3b/fbc [268356,39486] 0 2023-12-05T09:57:37.707 INFO:tasks.workunit.client.0.smithi100.stdout:2/732: dwrite d7/da/d18/d1b/f28 [0,4194304] 0 2023-12-05T09:57:37.707 INFO:tasks.workunit.client.0.smithi100.stdout:2/733: truncate d7/da/d18/d21/dae/fcd 238239 0 2023-12-05T09:57:37.707 INFO:tasks.workunit.client.0.smithi100.stdout:2/734: chown d7/da/d18/d1b/d2c/d3f/dc5/cf0 19555 1 2023-12-05T09:57:37.707 INFO:tasks.workunit.client.1.smithi150.stdout:2/680: mkdir d0/d3/d27/dea 0 2023-12-05T09:57:37.717 INFO:tasks.workunit.client.0.smithi100.stdout:2/735: rename d7/da/d18/d21/d86/fca to d7/da/d18/d21/d86/d92/ff7 0 2023-12-05T09:57:37.719 INFO:tasks.workunit.client.0.smithi100.stdout:9/633: dread d7/d1b/d22/d51/f5f [0,4194304] 0 2023-12-05T09:57:37.719 INFO:tasks.workunit.client.0.smithi100.stdout:9/634: write d7/d1b/d89/f90 [127510,1735] 0 2023-12-05T09:57:37.722 INFO:tasks.workunit.client.1.smithi150.stdout:5/645: rmdir d1/d7f/de1 0 2023-12-05T09:57:37.725 INFO:tasks.workunit.client.1.smithi150.stdout:2/681: dread d0/d3/d21/f44 [0,4194304] 0 2023-12-05T09:57:37.725 INFO:tasks.workunit.client.1.smithi150.stdout:2/682: chown d0/d3/d27/d95/ddf 59491027 1 2023-12-05T09:57:37.725 INFO:tasks.workunit.client.1.smithi150.stdout:9/585: dwrite d3/d9/dc/d1f/f25 [0,4194304] 0 2023-12-05T09:57:37.727 INFO:tasks.workunit.client.1.smithi150.stdout:5/646: mkdir d1/d64/d31/d5b/ddf/de4 0 2023-12-05T09:57:37.727 INFO:tasks.workunit.client.1.smithi150.stdout:8/717: dwrite d0/d41/d49/d1b/d24/f63 [0,4194304] 0 2023-12-05T09:57:37.731 INFO:tasks.workunit.client.0.smithi100.stdout:6/982: dread d7/d11/f4c [0,4194304] 0 2023-12-05T09:57:37.732 INFO:tasks.workunit.client.0.smithi100.stdout:9/635: dread d7/d20/d69/fa0 [0,4194304] 0 2023-12-05T09:57:37.732 INFO:tasks.workunit.client.0.smithi100.stdout:6/983: creat d7/d11/d1a/f13e x:0 0 0 2023-12-05T09:57:37.733 INFO:tasks.workunit.client.1.smithi150.stdout:9/586: creat d3/fc2 x:0 0 0 2023-12-05T09:57:37.733 INFO:tasks.workunit.client.1.smithi150.stdout:5/647: mknod d1/d3/d6/d26/dca/ce5 0 2023-12-05T09:57:37.733 INFO:tasks.workunit.client.0.smithi100.stdout:9/636: mknod d7/d1b/d22/d93/dd9/cde 0 2023-12-05T09:57:37.733 INFO:tasks.workunit.client.0.smithi100.stdout:9/637: write d7/d1b/d22/d2a/d56/daf/fd1 [692074,60646] 0 2023-12-05T09:57:37.733 INFO:tasks.workunit.client.0.smithi100.stdout:9/638: chown d7/d1b/d22/d93/f9f 933008852 1 2023-12-05T09:57:37.738 INFO:tasks.workunit.client.1.smithi150.stdout:0/666: write d5/d11/d71/d99/d9c/f3d [331587,15331] 0 2023-12-05T09:57:37.739 INFO:tasks.workunit.client.1.smithi150.stdout:0/667: readlink d5/d11/d16/l40 0 2023-12-05T09:57:37.739 INFO:tasks.workunit.client.1.smithi150.stdout:0/668: fdatasync d5/d11/d32/f91 0 2023-12-05T09:57:37.739 INFO:tasks.workunit.client.1.smithi150.stdout:0/669: creat d5/d11/d71/d99/d9c/d96/dd5/d67/ff0 x:0 0 0 2023-12-05T09:57:37.740 INFO:tasks.workunit.client.0.smithi100.stdout:2/736: dread d7/da/d13/f4a [0,4194304] 0 2023-12-05T09:57:37.741 INFO:tasks.workunit.client.0.smithi100.stdout:2/737: creat d7/da/d18/d1b/ff8 x:0 0 0 2023-12-05T09:57:37.749 INFO:tasks.workunit.client.1.smithi150.stdout:0/670: mkdir d5/d11/d71/d99/d9c/d96/dd5/d67/da8/df1 0 2023-12-05T09:57:37.750 INFO:tasks.workunit.client.0.smithi100.stdout:7/574: dwrite d3/dc/d11/d13/de/d2d/d47/f72 [0,4194304] 0 2023-12-05T09:57:37.750 INFO:tasks.workunit.client.0.smithi100.stdout:7/575: truncate d3/dc/d11/d13/de/d18/d3b/d40/d46/f5f 4977292 0 2023-12-05T09:57:37.752 INFO:tasks.workunit.client.0.smithi100.stdout:3/742: dread d0/f36 [0,4194304] 0 2023-12-05T09:57:37.754 INFO:tasks.workunit.client.1.smithi150.stdout:0/671: mkdir d5/d11/d32/df2 0 2023-12-05T09:57:37.755 INFO:tasks.workunit.client.1.smithi150.stdout:0/672: fdatasync d5/d11/d71/d5f/fd2 0 2023-12-05T09:57:37.755 INFO:tasks.workunit.client.1.smithi150.stdout:4/576: dwrite d0/d3e/d6d/f2e [4194304,4194304] 0 2023-12-05T09:57:37.759 INFO:tasks.workunit.client.0.smithi100.stdout:5/614: dwrite d0/f36 [0,4194304] 0 2023-12-05T09:57:37.759 INFO:tasks.workunit.client.0.smithi100.stdout:5/615: creat d0/d16/d2b/d75/fd5 x:0 0 0 2023-12-05T09:57:37.759 INFO:tasks.workunit.client.0.smithi100.stdout:5/616: readlink d0/d16/d2b/d48/df/d51/la2 0 2023-12-05T09:57:37.759 INFO:tasks.workunit.client.0.smithi100.stdout:5/617: chown d0/d27 1 1 2023-12-05T09:57:37.759 INFO:tasks.workunit.client.0.smithi100.stdout:9/639: dread d7/fb [0,4194304] 0 2023-12-05T09:57:37.759 INFO:tasks.workunit.client.0.smithi100.stdout:9/640: truncate d7/d1b/d89/f90 441604 0 2023-12-05T09:57:37.759 INFO:tasks.workunit.client.0.smithi100.stdout:4/598: dwrite de/d16/d23/f37 [0,4194304] 0 2023-12-05T09:57:37.764 INFO:tasks.workunit.client.0.smithi100.stdout:1/592: dwrite db/d31/d3a/d4a/dad/d67/f6d [0,4194304] 0 2023-12-05T09:57:37.768 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.769+0000 7f0af496b700 1 -- 172.21.15.100:0/3862605386 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0af00fee00 msgr2=0x7f0af00ff210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:57:37.768 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.769+0000 7f0af496b700 1 --2- 172.21.15.100:0/3862605386 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0af00fee00 0x7f0af00ff210 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0ae40049c0 tx=0x7f0ae4009e30 comp rx=0 tx=0).stop 2023-12-05T09:57:37.768 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.770+0000 7f0af496b700 1 -- 172.21.15.100:0/3862605386 shutdown_connections 2023-12-05T09:57:37.768 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.770+0000 7f0af496b700 1 --2- 172.21.15.100:0/3862605386 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0af00fff70 0x7f0af01003e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:37.768 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.770+0000 7f0af496b700 1 --2- 172.21.15.100:0/3862605386 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0af00fee00 0x7f0af00ff210 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:37.768 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.770+0000 7f0af496b700 1 -- 172.21.15.100:0/3862605386 >> 172.21.15.100:0/3862605386 conn(0x7f0af00fa5d0 msgr2=0x7f0af00fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:57:37.769 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.770+0000 7f0af496b700 1 -- 172.21.15.100:0/3862605386 shutdown_connections 2023-12-05T09:57:37.769 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.770+0000 7f0af496b700 1 -- 172.21.15.100:0/3862605386 wait complete. 2023-12-05T09:57:37.769 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.771+0000 7f0af496b700 1 Processor -- start 2023-12-05T09:57:37.769 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.772+0000 7f0af496b700 1 -- start start 2023-12-05T09:57:37.770 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.772+0000 7f0af496b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0af00fee00 0x7f0af010b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:57:37.770 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.772+0000 7f0af496b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0af00fff70 0x7f0af010b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:57:37.770 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.772+0000 7f0af496b700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af010bec0 con 0x7f0af00fff70 2023-12-05T09:57:37.770 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.772+0000 7f0af496b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af010c760 con 0x7f0af00fee00 2023-12-05T09:57:37.771 INFO:tasks.workunit.client.1.smithi150.stdout:4/577: mkdir d0/d3e/d5b/d80/da1/db2 0 2023-12-05T09:57:37.771 INFO:tasks.workunit.client.1.smithi150.stdout:4/578: chown d0/d3e/d6d/ca0 6097493 1 2023-12-05T09:57:37.772 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.773+0000 7f0aee59c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0af00fee00 0x7f0af010b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:57:37.772 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.773+0000 7f0aee59c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0af00fee00 0x7f0af010b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.100:50046/0 (socket says 172.21.15.100:50046) 2023-12-05T09:57:37.772 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.773+0000 7f0aee59c700 1 -- 172.21.15.100:0/334917497 learned_addr learned my addr 172.21.15.100:0/334917497 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:57:37.772 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.773+0000 7f0aedd9b700 1 --2- 172.21.15.100:0/334917497 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0af00fff70 0x7f0af010b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:57:37.772 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.773+0000 7f0aee59c700 1 -- 172.21.15.100:0/334917497 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0af00fff70 msgr2=0x7f0af010b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:57:37.772 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.773+0000 7f0aee59c700 1 --2- 172.21.15.100:0/334917497 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0af00fff70 0x7f0af010b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:37.773 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.773+0000 7f0aee59c700 1 -- 172.21.15.100:0/334917497 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae4005040 con 0x7f0af00fee00 2023-12-05T09:57:37.773 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.774+0000 7f0aee59c700 1 --2- 172.21.15.100:0/334917497 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0af00fee00 0x7f0af010b380 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0ae4000c00 tx=0x7f0ae4009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:57:37.773 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.774+0000 7f0adeffd700 1 -- 172.21.15.100:0/334917497 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ae40093b0 con 0x7f0af00fee00 2023-12-05T09:57:37.773 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.774+0000 7f0af496b700 1 -- 172.21.15.100:0/334917497 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0af010c9e0 con 0x7f0af00fee00 2023-12-05T09:57:37.773 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.774+0000 7f0adeffd700 1 -- 172.21.15.100:0/334917497 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0ae400b9f0 con 0x7f0af00fee00 2023-12-05T09:57:37.773 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.774+0000 7f0adeffd700 1 -- 172.21.15.100:0/334917497 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ae401d950 con 0x7f0af00fee00 2023-12-05T09:57:37.773 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.774+0000 7f0af496b700 1 -- 172.21.15.100:0/334917497 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0af010cec0 con 0x7f0af00fee00 2023-12-05T09:57:37.775 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.776+0000 7f0adcff9700 1 -- 172.21.15.100:0/334917497 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ad40052b0 con 0x7f0af00fee00 2023-12-05T09:57:37.775 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.777+0000 7f0adeffd700 1 -- 172.21.15.100:0/334917497 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 25) v1 ==== 88726+0+0 (secure 0 0 0) 0x7f0ae401a020 con 0x7f0af00fee00 2023-12-05T09:57:37.775 INFO:tasks.workunit.client.0.smithi100.stdout:7/576: creat d3/fd3 x:0 0 0 2023-12-05T09:57:37.775 INFO:tasks.workunit.client.0.smithi100.stdout:7/577: fdatasync d3/dc/d11/d13/de/d18/d3b/d40/d4c/d7f/f88 0 2023-12-05T09:57:37.775 INFO:tasks.workunit.client.0.smithi100.stdout:7/578: write d3/dc/d11/d13/de/d18/d3b/d40/d46/f85 [77312,51141] 0 2023-12-05T09:57:37.776 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.778+0000 7f0adeffd700 1 --2- 172.21.15.100:0/334917497 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7f0ad806aeb0 0x7f0ad806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:57:37.776 INFO:tasks.workunit.client.0.smithi100.stdout:7/579: write d3/dc/d11/d13/de/d2d/d47/fca [743669,60242] 0 2023-12-05T09:57:37.776 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.778+0000 7f0adeffd700 1 -- 172.21.15.100:0/334917497 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f0ae40615b0 con 0x7f0af00fee00 2023-12-05T09:57:37.776 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.778+0000 7f0aedd9b700 1 --2- 172.21.15.100:0/334917497 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7f0ad806aeb0 0x7f0ad806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:57:37.777 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.779+0000 7f0aedd9b700 1 --2- 172.21.15.100:0/334917497 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7f0ad806aeb0 0x7f0ad806d360 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0ae0004f40 tx=0x7f0ae000b040 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:57:37.778 INFO:tasks.workunit.client.1.smithi150.stdout:6/588: dwrite d2/d23/d2e/d5f/f87 [0,4194304] 0 2023-12-05T09:57:37.781 INFO:tasks.workunit.client.0.smithi100.stdout:2/738: dread d7/da/d18/d1b/f28 [4194304,4194304] 0 2023-12-05T09:57:37.782 INFO:tasks.workunit.client.1.smithi150.stdout:8/718: dwrite d0/d8/fa9 [0,4194304] 0 2023-12-05T09:57:37.782 INFO:tasks.workunit.client.1.smithi150.stdout:8/719: readlink d0/d41/d49/d1b/d24/d34/da2/lcd 0 2023-12-05T09:57:37.790 INFO:tasks.workunit.client.0.smithi100.stdout:9/641: mkdir d7/d1b/da5/ddf 0 2023-12-05T09:57:37.790 INFO:tasks.workunit.client.0.smithi100.stdout:9/642: dread - d7/d1b/d22/d51/d32/f42 zero size 2023-12-05T09:57:37.791 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:37.789+0000 7f0adeffd700 1 -- 172.21.15.100:0/334917497 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f0ae405d980 con 0x7f0af00fee00 2023-12-05T09:57:37.792 INFO:tasks.workunit.client.0.smithi100.stdout:3/743: write d0/d2/de/d11/db5/fba [153533,112064] 0 2023-12-05T09:57:37.797 INFO:tasks.workunit.client.0.smithi100.stdout:4/599: dread f1 [0,4194304] 0 2023-12-05T09:57:37.801 INFO:tasks.workunit.client.0.smithi100.stdout:7/580: unlink d3/dc/d11/d13/de/l20 0 2023-12-05T09:57:37.804 INFO:tasks.workunit.client.0.smithi100.stdout:3/744: symlink d0/d2/de/d11/db5/l102 0 2023-12-05T09:57:37.804 INFO:tasks.workunit.client.0.smithi100.stdout:3/745: fdatasync d0/d2/de/d8d/fc1 0 2023-12-05T09:57:37.805 INFO:tasks.workunit.client.1.smithi150.stdout:9/587: dwrite d3/d1b/d46/f98 [0,4194304] 0 2023-12-05T09:57:37.812 INFO:tasks.workunit.client.0.smithi100.stdout:1/593: rmdir db/d31/d3a/d3b 39 2023-12-05T09:57:37.814 INFO:tasks.workunit.client.1.smithi150.stdout:4/579: creat d0/d3e/d5b/d6e/daa/fb3 x:0 0 0 2023-12-05T09:57:37.814 INFO:tasks.workunit.client.1.smithi150.stdout:4/580: fsync d0/d3e/d48/f52 0 2023-12-05T09:57:37.817 INFO:tasks.workunit.client.0.smithi100.stdout:4/600: rename de/d16/d23/d33/d3d/d44/d4e/f87 to de/d16/fc0 0 2023-12-05T09:57:37.826 INFO:tasks.workunit.client.1.smithi150.stdout:9/588: rmdir d3/d9/d26/d34 39 2023-12-05T09:57:37.826 INFO:tasks.workunit.client.1.smithi150.stdout:9/589: creat d3/d1b/d46/d55/d64/fc3 x:0 0 0 2023-12-05T09:57:37.826 INFO:tasks.workunit.client.1.smithi150.stdout:9/590: readlink d3/d9/dc/d1f/l5e 0 2023-12-05T09:57:37.827 INFO:tasks.workunit.client.0.smithi100.stdout:1/594: symlink db/d12/d1e/d72/lbe 0 2023-12-05T09:57:37.827 INFO:tasks.workunit.client.0.smithi100.stdout:1/595: dread - db/d12/fb3 zero size 2023-12-05T09:57:37.827 INFO:tasks.workunit.client.0.smithi100.stdout:1/596: read f1 [977205,106388] 0 2023-12-05T09:57:37.827 INFO:tasks.workunit.client.0.smithi100.stdout:7/581: rename d3/dc/d11/c82 to d3/dc/d11/d13/de/d2d/d47/dbd/cd4 0 2023-12-05T09:57:37.830 INFO:tasks.workunit.client.1.smithi150.stdout:4/581: truncate d0/f61 2011321 0 2023-12-05T09:57:37.830 INFO:tasks.workunit.client.1.smithi150.stdout:4/582: creat d0/d3e/d5b/fb4 x:0 0 0 2023-12-05T09:57:37.834 INFO:tasks.workunit.client.0.smithi100.stdout:5/618: dwrite d0/d4/d14/d35/fb3 [0,4194304] 0 2023-12-05T09:57:37.834 INFO:tasks.workunit.client.0.smithi100.stdout:5/619: fsync d0/d1b/d4d/d8e/d96/dc1/fce 0 2023-12-05T09:57:37.834 INFO:tasks.workunit.client.0.smithi100.stdout:5/620: read d0/d16/d2b/d48/f65 [712648,117376] 0 2023-12-05T09:57:37.834 INFO:tasks.workunit.client.0.smithi100.stdout:5/621: dread - d0/d1f/d25/fa9 zero size 2023-12-05T09:57:37.835 INFO:tasks.workunit.client.1.smithi150.stdout:0/673: dwrite d5/d11/d32/d57/f9d [0,4194304] 0 2023-12-05T09:57:37.836 INFO:tasks.workunit.client.1.smithi150.stdout:2/683: rmdir d0/da3 39 2023-12-05T09:57:37.836 INFO:tasks.workunit.client.1.smithi150.stdout:2/684: chown d0/d3/d5/d13/d15/d30/d54/d57 427584 1 2023-12-05T09:57:37.842 INFO:tasks.workunit.client.0.smithi100.stdout:4/601: link de/d16/d23/d33/d3d/d44/d4e/c8c de/d16/d23/d60/d88/cc1 0 2023-12-05T09:57:37.842 INFO:tasks.workunit.client.0.smithi100.stdout:6/984: dwrite d7/d27/f38 [0,4194304] 0 2023-12-05T09:57:37.843 INFO:tasks.workunit.client.1.smithi150.stdout:3/661: dwrite d6/d25/f62 [0,4194304] 0 2023-12-05T09:57:37.845 INFO:tasks.workunit.client.0.smithi100.stdout:1/597: creat db/d31/d3a/d4a/dad/fbf x:0 0 0 2023-12-05T09:57:37.845 INFO:tasks.workunit.client.0.smithi100.stdout:7/582: mknod d3/dc/d11/d13/de/d2d/d47/dbd/cd5 0 2023-12-05T09:57:37.845 INFO:tasks.workunit.client.0.smithi100.stdout:7/583: stat d3/dc/d11/d13/de/d18/c2f 0 2023-12-05T09:57:37.845 INFO:tasks.workunit.client.0.smithi100.stdout:7/584: dread - d3/dc/d11/d13/de/d18/d3b/d40/d4c/d7f/f92 zero size 2023-12-05T09:57:37.846 INFO:tasks.workunit.client.1.smithi150.stdout:9/591: rmdir d3/d1b/d79 39 2023-12-05T09:57:37.848 INFO:tasks.workunit.client.0.smithi100.stdout:2/739: dwrite d7/da/d18/d21/d86/d92/ff7 [0,4194304] 0 2023-12-05T09:57:37.848 INFO:tasks.workunit.client.1.smithi150.stdout:6/589: dwrite d2/d23/d2e/f43 [0,4194304] 0 2023-12-05T09:57:37.852 INFO:tasks.workunit.client.0.smithi100.stdout:4/602: dread f9 [0,4194304] 0 2023-12-05T09:57:37.854 INFO:tasks.workunit.client.0.smithi100.stdout:5/622: getdents d0/d1f/d25/d31 0 2023-12-05T09:57:37.857 INFO:tasks.workunit.client.1.smithi150.stdout:4/583: link d0/d3e/d5b/d80/cb1 d0/d5f/cb5 0 2023-12-05T09:57:37.864 INFO:tasks.workunit.client.1.smithi150.stdout:0/674: symlink d5/d11/d71/d99/d9c/d96/dd5/d7f/lf3 0 2023-12-05T09:57:37.867 INFO:tasks.workunit.client.1.smithi150.stdout:8/720: dwrite d0/d41/d49/d1b/d24/d2e/f8b [0,4194304] 0 2023-12-05T09:57:37.868 INFO:tasks.workunit.client.0.smithi100.stdout:2/740: read d7/da/dc/f12 [1453424,130069] 0 2023-12-05T09:57:37.868 INFO:tasks.workunit.client.0.smithi100.stdout:9/643: dwrite d7/d1b/f33 [0,4194304] 0 2023-12-05T09:57:37.873 INFO:tasks.workunit.client.1.smithi150.stdout:3/662: creat d6/d9/d3d/fd8 x:0 0 0 2023-12-05T09:57:37.873 INFO:tasks.workunit.client.1.smithi150.stdout:3/663: fdatasync d6/d22/d37/d63/f4d 0 2023-12-05T09:57:37.879 INFO:tasks.workunit.client.1.smithi150.stdout:9/592: creat d3/d1b/d46/d55/fc4 x:0 0 0 2023-12-05T09:57:37.879 INFO:tasks.workunit.client.1.smithi150.stdout:9/593: creat d3/d9/d58/fc5 x:0 0 0 2023-12-05T09:57:37.879 INFO:tasks.workunit.client.0.smithi100.stdout:3/746: dwrite d0/d4/f14 [0,4194304] 0 2023-12-05T09:57:37.885 INFO:tasks.workunit.client.1.smithi150.stdout:6/590: symlink d2/d23/d2e/d5f/d99/lc7 0 2023-12-05T09:57:37.885 INFO:tasks.workunit.client.1.smithi150.stdout:6/591: stat d2/d23/d3b/d64/d7a/d5d/d6b/f1a 0 2023-12-05T09:57:37.885 INFO:tasks.workunit.client.1.smithi150.stdout:6/592: write d2/d23/d2e/d93/fc2 [848808,14490] 0 2023-12-05T09:57:37.887 INFO:tasks.workunit.client.0.smithi100.stdout:6/985: dwrite d7/d27/d35/d5a/f9d [0,4194304] 0 2023-12-05T09:57:37.890 INFO:tasks.workunit.client.0.smithi100.stdout:1/598: link db/d12/d61/ca7 db/d12/d1e/d26/d30/d52/d84/d8c/cc0 0 2023-12-05T09:57:37.892 INFO:tasks.workunit.client.1.smithi150.stdout:4/584: symlink d0/d3e/d48/lb6 0 2023-12-05T09:57:37.897 INFO:tasks.workunit.client.0.smithi100.stdout:8/536: sync 2023-12-05T09:57:37.898 INFO:tasks.workunit.client.1.smithi150.stdout:0/675: write d5/d11/f8f [1742191,85390] 0 2023-12-05T09:57:37.900 INFO:tasks.workunit.client.0.smithi100.stdout:4/603: truncate de/f1b 1533748 0 2023-12-05T09:57:37.900 INFO:tasks.workunit.client.0.smithi100.stdout:4/604: write de/d16/d23/fa4 [518216,129593] 0 2023-12-05T09:57:37.901 INFO:tasks.workunit.client.1.smithi150.stdout:3/664: mkdir d6/d25/dd9 0 2023-12-05T09:57:37.902 INFO:tasks.workunit.client.0.smithi100.stdout:5/623: symlink d0/d4/d14/d35/d62/ld6 0 2023-12-05T09:57:37.902 INFO:tasks.workunit.client.0.smithi100.stdout:5/624: getdents d0/d1f/d9f 0 2023-12-05T09:57:37.902 INFO:tasks.workunit.client.0.smithi100.stdout:5/625: chown d0/lb1 802949611 1 2023-12-05T09:57:37.902 INFO:tasks.workunit.client.0.smithi100.stdout:5/626: creat d0/d27/fd7 x:0 0 0 2023-12-05T09:57:37.903 INFO:tasks.workunit.client.0.smithi100.stdout:5/627: write d0/d1b/d4d/d60/fbf [1041398,125134] 0 2023-12-05T09:57:37.903 INFO:tasks.workunit.client.1.smithi150.stdout:0/676: write d5/d11/d71/d5f/f70 [464020,97144] 0 2023-12-05T09:57:37.903 INFO:tasks.workunit.client.1.smithi150.stdout:9/594: write d3/d9/f17 [6092220,8499] 0 2023-12-05T09:57:37.904 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:37 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/2709858199' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-05T09:57:37.904 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:37 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:57:37.904 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:37 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:57:37.905 INFO:tasks.workunit.client.1.smithi150.stdout:6/593: dread d2/d23/f45 [0,4194304] 0 2023-12-05T09:57:37.909 INFO:tasks.workunit.client.1.smithi150.stdout:3/665: creat d6/d25/dcf/fda x:0 0 0 2023-12-05T09:57:37.910 INFO:tasks.workunit.client.1.smithi150.stdout:3/666: fdatasync d6/d25/f97 0 2023-12-05T09:57:37.910 INFO:tasks.workunit.client.1.smithi150.stdout:3/667: write d6/d9/d43/d75/fae [1530525,49635] 0 2023-12-05T09:57:37.911 INFO:tasks.workunit.client.0.smithi100.stdout:6/986: mknod d7/d27/d35/d5a/db0/d12e/c13f 0 2023-12-05T09:57:37.911 INFO:tasks.workunit.client.0.smithi100.stdout:6/987: write d7/d11/d1a/db7/df7/d126/f40 [742326,21099] 0 2023-12-05T09:57:37.912 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:37 smithi150 ceph-mon[116142]: from='client.? 172.21.15.100:0/2709858199' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-05T09:57:37.913 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:37 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:57:37.913 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:37 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:57:37.916 INFO:tasks.workunit.client.0.smithi100.stdout:2/741: dwrite d7/da/d13/d69/d6e/d71/f9a [0,4194304] 0 2023-12-05T09:57:37.916 INFO:tasks.workunit.client.0.smithi100.stdout:2/742: chown d7/da/d13/f5d 4 1 2023-12-05T09:57:37.921 INFO:tasks.workunit.client.0.smithi100.stdout:1/599: mknod db/d12/d1e/d26/d30/d52/cc1 0 2023-12-05T09:57:37.922 INFO:tasks.workunit.client.0.smithi100.stdout:8/537: creat d0/d12/d13/d16/d22/d72/f94 x:0 0 0 2023-12-05T09:57:37.925 INFO:tasks.workunit.client.1.smithi150.stdout:0/677: mkdir d5/dbd/df4 0 2023-12-05T09:57:37.925 INFO:tasks.workunit.client.1.smithi150.stdout:9/595: creat d3/d9/dc/d1f/d24/d75/fc6 x:0 0 0 2023-12-05T09:57:37.925 INFO:tasks.workunit.client.1.smithi150.stdout:9/596: write d3/d9/dc/f33 [1589460,126350] 0 2023-12-05T09:57:37.929 INFO:tasks.workunit.client.0.smithi100.stdout:7/585: dwrite d3/dc/d11/d13/d37/fc0 [0,4194304] 0 2023-12-05T09:57:37.931 INFO:tasks.workunit.client.1.smithi150.stdout:2/685: dwrite d0/d3/d5/d13/d15/d30/d54/d57/fab [0,4194304] 0 2023-12-05T09:57:37.931 INFO:tasks.workunit.client.0.smithi100.stdout:4/605: unlink de/d16/d23/d33/d3d/d44/c5b 0 2023-12-05T09:57:37.931 INFO:tasks.workunit.client.0.smithi100.stdout:5/628: mknod d0/d1b/d4d/d8e/d96/dc1/dae/db9/dcb/cd8 0 2023-12-05T09:57:37.933 INFO:tasks.workunit.client.0.smithi100.stdout:2/743: chown d7/da/d18/d21/l54 266299772 1 2023-12-05T09:57:37.938 INFO:tasks.workunit.client.1.smithi150.stdout:6/594: dread d2/f26 [0,4194304] 0 2023-12-05T09:57:37.939 INFO:tasks.workunit.client.1.smithi150.stdout:3/668: getdents d6 0 2023-12-05T09:57:37.939 INFO:tasks.workunit.client.1.smithi150.stdout:3/669: readlink d6/d9/la 0 2023-12-05T09:57:37.939 INFO:tasks.workunit.client.1.smithi150.stdout:3/670: fsync d6/d9/d3d/d56/f3f 0 2023-12-05T09:57:37.940 INFO:tasks.workunit.client.1.smithi150.stdout:0/678: creat d5/d11/ff5 x:0 0 0 2023-12-05T09:57:37.940 INFO:tasks.workunit.client.0.smithi100.stdout:8/538: read d0/d12/d13/d16/f20 [2423551,118637] 0 2023-12-05T09:57:37.940 INFO:tasks.workunit.client.0.smithi100.stdout:1/600: symlink db/d12/d1e/d26/d30/d52/lc2 0 2023-12-05T09:57:37.950 INFO:tasks.workunit.client.0.smithi100.stdout:3/747: dwrite d0/d3d/d5c/d6f/d7f/d87/f9a [0,4194304] 0 2023-12-05T09:57:37.950 INFO:tasks.workunit.client.1.smithi150.stdout:9/597: dread d3/d9/d58/f7e [0,4194304] 0 2023-12-05T09:57:37.950 INFO:tasks.workunit.client.1.smithi150.stdout:9/598: readlink d3/d82/lb3 0 2023-12-05T09:57:37.951 INFO:tasks.workunit.client.1.smithi150.stdout:9/599: chown d3/f29 63858734 1 2023-12-05T09:57:37.951 INFO:tasks.workunit.client.1.smithi150.stdout:9/600: read - d3/d9/d58/fc5 zero size 2023-12-05T09:57:37.961 INFO:tasks.workunit.client.0.smithi100.stdout:7/586: unlink d3/dc/d11/d13/de/c66 0 2023-12-05T09:57:37.961 INFO:tasks.workunit.client.0.smithi100.stdout:8/539: dread d0/d35/f70 [0,4194304] 0 2023-12-05T09:57:37.963 INFO:tasks.workunit.client.1.smithi150.stdout:8/721: dwrite d0/d41/d49/d1b/d24/d38/d62/fb9 [0,4194304] 0 2023-12-05T09:57:37.966 INFO:tasks.workunit.client.0.smithi100.stdout:9/644: dwrite d7/d1b/d22/d51/d32/f42 [0,4194304] 0 2023-12-05T09:57:37.969 INFO:tasks.workunit.client.0.smithi100.stdout:5/629: mknod d0/d1f/d25/d31/cd9 0 2023-12-05T09:57:37.981 INFO:tasks.workunit.client.0.smithi100.stdout:2/744: rename d7/c16 to d7/da/d13/d4e/d87/cf9 0 2023-12-05T09:57:37.981 INFO:tasks.workunit.client.1.smithi150.stdout:0/679: dread d5/d11/d65/f76 [0,4194304] 0 2023-12-05T09:57:37.981 INFO:tasks.workunit.client.1.smithi150.stdout:4/585: rmdir d0/d3e/d5b 39 2023-12-05T09:57:37.989 INFO:tasks.workunit.client.0.smithi100.stdout:7/587: mknod d3/dc/d11/d13/de/d18/cd6 0 2023-12-05T09:57:37.992 INFO:tasks.workunit.client.1.smithi150.stdout:1/625: sync 2023-12-05T09:57:37.994 INFO:tasks.workunit.client.0.smithi100.stdout:0/593: sync 2023-12-05T09:57:37.995 INFO:tasks.workunit.client.1.smithi150.stdout:2/686: rmdir d0/d3/d5/d10 39 2023-12-05T09:57:37.997 INFO:tasks.workunit.client.0.smithi100.stdout:9/645: creat d7/d20/fe0 x:0 0 0 2023-12-05T09:57:37.998 INFO:tasks.workunit.client.1.smithi150.stdout:6/595: symlink d2/d23/d3b/d64/lc8 0 2023-12-05T09:57:37.998 INFO:tasks.workunit.client.1.smithi150.stdout:6/596: creat d2/d23/d3b/d64/d7a/fc9 x:0 0 0 2023-12-05T09:57:38.001 INFO:tasks.workunit.client.0.smithi100.stdout:6/988: dwrite d7/d27/d35/d5a/f65 [0,4194304] 0 2023-12-05T09:57:38.001 INFO:tasks.workunit.client.0.smithi100.stdout:8/540: rename d0/d12/l92 to d0/d12/d13/d45/l95 0 2023-12-05T09:57:38.001 INFO:tasks.workunit.client.0.smithi100.stdout:6/989: chown d7/d11/d1a/db7/df7/d126/d115/c132 4093389 1 2023-12-05T09:57:38.001 INFO:tasks.workunit.client.0.smithi100.stdout:8/541: fsync d0/d12/f36 0 2023-12-05T09:57:38.002 INFO:tasks.workunit.client.1.smithi150.stdout:3/671: mknod d6/d9/d3d/d56/d71/db6/dc1/cdb 0 2023-12-05T09:57:38.005 INFO:tasks.workunit.client.0.smithi100.stdout:2/745: mknod d7/da/d18/d21/da3/cfa 0 2023-12-05T09:57:38.006 INFO:tasks.workunit.client.1.smithi150.stdout:7/645: sync 2023-12-05T09:57:38.006 INFO:tasks.workunit.client.0.smithi100.stdout:0/594: rmdir da/d22/d33/d35 39 2023-12-05T09:57:38.006 INFO:tasks.workunit.client.0.smithi100.stdout:0/595: truncate da/f2c 2912458 0 2023-12-05T09:57:38.006 INFO:tasks.workunit.client.0.smithi100.stdout:0/596: write da/d22/d33/fa9 [404737,11858] 0 2023-12-05T09:57:38.007 INFO:tasks.workunit.client.1.smithi150.stdout:9/601: unlink d3/d1b/c85 0 2023-12-05T09:57:38.008 INFO:tasks.workunit.client.0.smithi100.stdout:1/601: dwrite db/d12/d1e/d26/f62 [0,4194304] 0 2023-12-05T09:57:38.009 INFO:tasks.workunit.client.0.smithi100.stdout:3/748: dwrite d0/d4/d3a/d45/fa6 [0,4194304] 0 2023-12-05T09:57:38.009 INFO:tasks.workunit.client.0.smithi100.stdout:3/749: write d0/d3d/d5c/d6f/ffd [852266,112608] 0 2023-12-05T09:57:38.014 INFO:tasks.workunit.client.0.smithi100.stdout:7/588: dread d3/dc/d11/d13/de/d2d/f4e [0,4194304] 0 2023-12-05T09:57:38.020 INFO:tasks.workunit.client.0.smithi100.stdout:8/542: dread d0/d12/d13/d16/f23 [4194304,4194304] 0 2023-12-05T09:57:38.020 INFO:tasks.workunit.client.1.smithi150.stdout:9/602: write d3/d9/dc/d1f/f25 [1315743,55457] 0 2023-12-05T09:57:38.023 INFO:tasks.workunit.client.0.smithi100.stdout:9/646: symlink d7/d1b/d22/d2a/d56/d2e/d50/ddd/le1 0 2023-12-05T09:57:38.027 INFO:tasks.workunit.client.0.smithi100.stdout:5/630: rename d0/d16/d2b/d48/df/f43 to d0/d1b/d4d/d8e/fda 0 2023-12-05T09:57:38.028 INFO:tasks.workunit.client.1.smithi150.stdout:0/680: truncate d5/d11/d71/d99/d9c/d3b/f6c 432798 0 2023-12-05T09:57:38.032 INFO:tasks.workunit.client.1.smithi150.stdout:4/586: mknod d0/d3e/d5b/cb7 0 2023-12-05T09:57:38.034 INFO:tasks.workunit.client.1.smithi150.stdout:1/626: rmdir d6/d47/d4c/dd9/d75 39 2023-12-05T09:57:38.034 INFO:tasks.workunit.client.1.smithi150.stdout:1/627: readlink d6/d8/db/l66 0 2023-12-05T09:57:38.034 INFO:tasks.workunit.client.1.smithi150.stdout:1/628: chown d6/d47/d4c/dd9/f13 5252 1 2023-12-05T09:57:38.034 INFO:tasks.workunit.client.1.smithi150.stdout:1/629: creat d6/d38/d4a/fdc x:0 0 0 2023-12-05T09:57:38.034 INFO:tasks.workunit.client.1.smithi150.stdout:1/630: chown d6/d47/db4/fb5 1645030 1 2023-12-05T09:57:38.035 INFO:tasks.workunit.client.1.smithi150.stdout:1/631: readlink d6/d3c/l58 0 2023-12-05T09:57:38.037 INFO:tasks.workunit.client.1.smithi150.stdout:2/687: rename d0/d3/d5/d36 to d0/d3/d21/d4d/deb 0 2023-12-05T09:57:38.041 INFO:tasks.workunit.client.0.smithi100.stdout:2/746: write d7/da/d13/d69/d6e/d71/f9a [3492661,12050] 0 2023-12-05T09:57:38.041 INFO:tasks.workunit.client.0.smithi100.stdout:7/589: mkdir d3/dc/d11/d13/de/d18/d3b/dd7 0 2023-12-05T09:57:38.042 INFO:tasks.workunit.client.0.smithi100.stdout:2/747: creat d7/da/d18/d1b/d2c/d3f/ffb x:0 0 0 2023-12-05T09:57:38.042 INFO:tasks.workunit.client.0.smithi100.stdout:7/590: read d3/dc/d11/d13/de/f2b [1709483,95754] 0 2023-12-05T09:57:38.042 INFO:tasks.workunit.client.0.smithi100.stdout:8/543: symlink d0/d35/l96 0 2023-12-05T09:57:38.047 INFO:tasks.workunit.client.1.smithi150.stdout:3/672: creat d6/d22/fdc x:0 0 0 2023-12-05T09:57:38.047 INFO:tasks.workunit.client.1.smithi150.stdout:3/673: dread - d6/d22/d37/fc7 zero size 2023-12-05T09:57:38.050 INFO:tasks.workunit.client.0.smithi100.stdout:9/647: mknod d7/db5/ce2 0 2023-12-05T09:57:38.050 INFO:tasks.workunit.client.0.smithi100.stdout:9/648: dread - d7/d1b/d22/fac zero size 2023-12-05T09:57:38.050 INFO:tasks.workunit.client.0.smithi100.stdout:9/649: truncate d7/d1b/d22/d2a/d56/f5c 398607 0 2023-12-05T09:57:38.050 INFO:tasks.workunit.client.0.smithi100.stdout:9/650: fsync d7/f9 0 2023-12-05T09:57:38.050 INFO:tasks.workunit.client.0.smithi100.stdout:9/651: fsync d7/d35/f55 0 2023-12-05T09:57:38.050 INFO:tasks.workunit.client.0.smithi100.stdout:9/652: read - d7/d1b/d22/d2a/d56/d9c/fae zero size 2023-12-05T09:57:38.055 INFO:tasks.workunit.client.1.smithi150.stdout:7/646: mkdir d2/db/d17/d20/dd5 0 2023-12-05T09:57:38.055 INFO:tasks.workunit.client.1.smithi150.stdout:9/603: rmdir d3/d9/dc/d91 39 2023-12-05T09:57:38.055 INFO:tasks.workunit.client.1.smithi150.stdout:7/647: chown d2/d9d/da0/dd4 246 1 2023-12-05T09:57:38.055 INFO:tasks.workunit.client.1.smithi150.stdout:5/648: sync 2023-12-05T09:57:38.055 INFO:tasks.workunit.client.0.smithi100.stdout:4/606: dwrite de/d16/d23/f37 [0,4194304] 0 2023-12-05T09:57:38.059 INFO:tasks.workunit.client.1.smithi150.stdout:8/722: symlink d0/le1 0 2023-12-05T09:57:38.064 INFO:tasks.workunit.client.0.smithi100.stdout:5/631: read d0/d16/f99 [2822223,85439] 0 2023-12-05T09:57:38.065 INFO:tasks.workunit.client.0.smithi100.stdout:2/748: unlink d7/da/d18/d1b/d2c/d3f/d72/cb0 0 2023-12-05T09:57:38.073 INFO:tasks.workunit.client.0.smithi100.stdout:7/591: symlink d3/dc/d11/d13/de/d2d/ld8 0 2023-12-05T09:57:38.076 INFO:tasks.workunit.client.1.smithi150.stdout:0/681: mknod d5/d11/db6/cf6 0 2023-12-05T09:57:38.078 INFO:tasks.workunit.client.0.smithi100.stdout:3/750: rename d0/d2/d33/ff5 to d0/d2/f103 0 2023-12-05T09:57:38.078 INFO:tasks.workunit.client.0.smithi100.stdout:3/751: fsync d0/d3d/d90/fda 0 2023-12-05T09:57:38.079 INFO:tasks.workunit.client.1.smithi150.stdout:7/648: dread d2/db/d30/d13/f66 [0,4194304] 0 2023-12-05T09:57:38.079 INFO:tasks.workunit.client.1.smithi150.stdout:7/649: read d2/db/d17/d20/fab [431522,7903] 0 2023-12-05T09:57:38.082 INFO:tasks.workunit.client.0.smithi100.stdout:1/602: dwrite db/d12/f18 [0,4194304] 0 2023-12-05T09:57:38.089 INFO:tasks.workunit.client.0.smithi100.stdout:0/597: dwrite da/d1b/d73/f9d [0,4194304] 0 2023-12-05T09:57:38.098 INFO:tasks.workunit.client.0.smithi100.stdout:4/607: link de/d16/f83 de/d16/d23/d60/d98/da6/fc2 0 2023-12-05T09:57:38.098 INFO:tasks.workunit.client.0.smithi100.stdout:6/990: dwrite d7/d11/d1a/db7/df7/d126/d6a/d7c/d8d/f8e [4194304,4194304] 0 2023-12-05T09:57:38.105 INFO:tasks.workunit.client.0.smithi100.stdout:5/632: creat d0/d1f/fdb x:0 0 0 2023-12-05T09:57:38.106 INFO:tasks.workunit.client.0.smithi100.stdout:5/633: dread - d0/d27/fd7 zero size 2023-12-05T09:57:38.106 INFO:tasks.workunit.client.0.smithi100.stdout:5/634: write d0/d1f/d53/f8a [391792,27925] 0 2023-12-05T09:57:38.107 INFO:tasks.workunit.client.1.smithi150.stdout:4/587: link d0/d3e/d6d/f34 d0/d3e/d5b/d80/da1/fb8 0 2023-12-05T09:57:38.109 INFO:tasks.workunit.client.0.smithi100.stdout:2/749: rename d7/da/fac to d7/da/d13/d69/ffc 0 2023-12-05T09:57:38.111 INFO:tasks.workunit.client.1.smithi150.stdout:1/632: mkdir d6/d47/d4c/dd9/d75/ddd 0 2023-12-05T09:57:38.115 INFO:tasks.workunit.client.1.smithi150.stdout:2/688: getdents d0/d3/d27/dac/d81 0 2023-12-05T09:57:38.116 INFO:tasks.workunit.client.1.smithi150.stdout:6/597: link d2/d23/d3b/d64/d7a/d5d/f86 d2/d23/d3b/d64/d7a/d5d/d6b/fca 0 2023-12-05T09:57:38.119 INFO:tasks.workunit.client.1.smithi150.stdout:4/588: dread d0/d3e/d5b/f9b [0,4194304] 0 2023-12-05T09:57:38.122 INFO:tasks.workunit.client.0.smithi100.stdout:5/635: mkdir d0/d1b/d4d/d8e/d96/dc1/dae/db9/ddc 0 2023-12-05T09:57:38.123 INFO:tasks.workunit.client.0.smithi100.stdout:3/752: dread d0/d10/d39/f98 [0,4194304] 0 2023-12-05T09:57:38.123 INFO:tasks.workunit.client.0.smithi100.stdout:0/598: dread da/d22/f2b [0,4194304] 0 2023-12-05T09:57:38.125 INFO:tasks.workunit.client.0.smithi100.stdout:2/750: mknod d7/da/d18/d21/d86/cfd 0 2023-12-05T09:57:38.125 INFO:tasks.workunit.client.1.smithi150.stdout:9/604: creat d3/d42/fc7 x:0 0 0 2023-12-05T09:57:38.129 INFO:tasks.workunit.client.1.smithi150.stdout:5/649: mknod d1/d7f/d65/d3b/d8d/ce6 0 2023-12-05T09:57:38.130 INFO:tasks.workunit.client.0.smithi100.stdout:0/599: mkdir da/d1b/d73/db3 0 2023-12-05T09:57:38.133 INFO:tasks.workunit.client.0.smithi100.stdout:9/653: dwrite d7/d35/f86 [0,4194304] 0 2023-12-05T09:57:38.135 INFO:tasks.workunit.client.1.smithi150.stdout:0/682: creat d5/d11/d71/d5f/ff7 x:0 0 0 2023-12-05T09:57:38.135 INFO:tasks.workunit.client.1.smithi150.stdout:0/683: fsync d5/f23 0 2023-12-05T09:57:38.137 INFO:tasks.workunit.client.0.smithi100.stdout:2/751: unlink d7/da/d13/fe0 0 2023-12-05T09:57:38.141 INFO:tasks.workunit.client.0.smithi100.stdout:8/544: dwrite d0/d12/d13/d45/f4f [0,4194304] 0 2023-12-05T09:57:38.142 INFO:tasks.workunit.client.1.smithi150.stdout:7/650: creat d2/db/d17/d88/fd6 x:0 0 0 2023-12-05T09:57:38.142 INFO:tasks.workunit.client.1.smithi150.stdout:6/598: dread d2/d23/f3f [0,4194304] 0 2023-12-05T09:57:38.146 INFO:tasks.workunit.client.1.smithi150.stdout:8/723: dwrite d0/d41/d49/d1b/d24/d2e/f44 [0,4194304] 0 2023-12-05T09:57:38.148 INFO:tasks.workunit.client.1.smithi150.stdout:1/633: truncate d6/d8/d59/f91 549211 0 2023-12-05T09:57:38.151 INFO:tasks.workunit.client.0.smithi100.stdout:7/592: dwrite d3/dc/d11/d13/de/d18/d3b/f9c [4194304,4194304] 0 2023-12-05T09:57:38.151 INFO:tasks.workunit.client.0.smithi100.stdout:2/752: unlink d7/da/d18/d1b/l24 0 2023-12-05T09:57:38.155 INFO:tasks.workunit.client.0.smithi100.stdout:8/545: symlink d0/d12/d13/d16/d22/d72/l97 0 2023-12-05T09:57:38.155 INFO:tasks.workunit.client.0.smithi100.stdout:8/546: chown d0/d12 198 1 2023-12-05T09:57:38.157 INFO:tasks.workunit.client.1.smithi150.stdout:5/650: mkdir d1/d64/de7 0 2023-12-05T09:57:38.157 INFO:tasks.workunit.client.1.smithi150.stdout:0/684: symlink d5/d11/d32/lf8 0 2023-12-05T09:57:38.157 INFO:tasks.workunit.client.1.smithi150.stdout:0/685: fdatasync d5/d11/d32/f50 0 2023-12-05T09:57:38.159 INFO:tasks.workunit.client.0.smithi100.stdout:6/991: write d7/d11/d1a/db7/df7/d126/d6a/d7c/f13a [2423475,13937] 0 2023-12-05T09:57:38.160 INFO:tasks.workunit.client.0.smithi100.stdout:0/600: mkdir da/d1b/d36/db4 0 2023-12-05T09:57:38.161 INFO:tasks.workunit.client.0.smithi100.stdout:0/601: creat da/d22/d33/d7f/fb5 x:0 0 0 2023-12-05T09:57:38.164 INFO:tasks.workunit.client.0.smithi100.stdout:7/593: creat d3/dc/d11/d13/fd9 x:0 0 0 2023-12-05T09:57:38.165 INFO:tasks.workunit.client.1.smithi150.stdout:1/634: mkdir d6/d3c/dc2/dde 0 2023-12-05T09:57:38.165 INFO:tasks.workunit.client.1.smithi150.stdout:1/635: creat d6/d8/d54/fdf x:0 0 0 2023-12-05T09:57:38.174 INFO:tasks.workunit.client.1.smithi150.stdout:3/674: rmdir d6/d22/d37/db8 0 2023-12-05T09:57:38.174 INFO:tasks.workunit.client.1.smithi150.stdout:3/675: chown d6/d9/d3d/d56/d71/db6/dc1/cbb 12 1 2023-12-05T09:57:38.185 INFO:tasks.workunit.client.1.smithi150.stdout:9/605: rename d3/d9/dc/d1f/d24/l4f to d3/d9/dc/d1f/lc8 0 2023-12-05T09:57:38.185 INFO:tasks.workunit.client.0.smithi100.stdout:3/753: write d0/d2/d33/fae [2432678,97482] 0 2023-12-05T09:57:38.185 INFO:tasks.workunit.client.0.smithi100.stdout:3/754: stat d0/d2/f37 0 2023-12-05T09:57:38.185 INFO:tasks.workunit.client.0.smithi100.stdout:3/755: truncate d0/d4/d3a/d45/fdf 119781 0 2023-12-05T09:57:38.186 INFO:tasks.workunit.client.0.smithi100.stdout:4/608: dwrite de/d16/d23/d36/f3e [0,4194304] 0 2023-12-05T09:57:38.187 INFO:tasks.workunit.client.0.smithi100.stdout:2/753: mkdir d7/da/d18/d1b/d2c/d3f/d46/dc8/dfe 0 2023-12-05T09:57:38.190 INFO:tasks.workunit.client.0.smithi100.stdout:6/992: dread d7/d11/f8f [0,4194304] 0 2023-12-05T09:57:38.195 INFO:tasks.workunit.client.0.smithi100.stdout:8/547: rename d0/d12/d13/d45/f4f to d0/d35/d64/d81/f98 0 2023-12-05T09:57:38.201 INFO:tasks.workunit.client.0.smithi100.stdout:0/602: read da/f2c [2182427,75746] 0 2023-12-05T09:57:38.201 INFO:tasks.workunit.client.0.smithi100.stdout:1/603: dwrite db/d12/d1e/d26/d30/d52/d84/d8c/fb2 [0,4194304] 0 2023-12-05T09:57:38.212 INFO:tasks.workunit.client.1.smithi150.stdout:7/651: dwrite d2/d4/f23 [8388608,4194304] 0 2023-12-05T09:57:38.212 INFO:tasks.workunit.client.1.smithi150.stdout:7/652: truncate d2/db/d17/d88/fd6 353862 0 2023-12-05T09:57:38.213 INFO:tasks.workunit.client.1.smithi150.stdout:3/676: unlink d6/d9/d3d/d56/d53/d51/f8b 0 2023-12-05T09:57:38.218 INFO:tasks.workunit.client.1.smithi150.stdout:9/606: dread d3/d9/dc/fa2 [0,4194304] 0 2023-12-05T09:57:38.219 INFO:tasks.workunit.client.1.smithi150.stdout:8/724: rename d0/d41/d49/d1b/d24/d5b/d9c/cb6 to d0/d41/d49/ce2 0 2023-12-05T09:57:38.219 INFO:tasks.workunit.client.1.smithi150.stdout:8/725: readlink d0/d41/d49/d1b/d24/d2e/d30/l3e 0 2023-12-05T09:57:38.223 INFO:tasks.workunit.client.1.smithi150.stdout:2/689: dwrite d0/fc5 [0,4194304] 0 2023-12-05T09:57:38.228 INFO:tasks.workunit.client.0.smithi100.stdout:7/594: creat d3/dc/d11/d13/d1b/d60/fda x:0 0 0 2023-12-05T09:57:38.233 INFO:tasks.workunit.client.1.smithi150.stdout:0/686: rmdir d5/d11/d71/d99/d9c/d96/dd5/d7f 39 2023-12-05T09:57:38.233 INFO:tasks.workunit.client.1.smithi150.stdout:0/687: fsync d5/d11/d71/d99/d9c/d3b/dad/fdf 0 2023-12-05T09:57:38.234 INFO:tasks.workunit.client.1.smithi150.stdout:6/599: dwrite d2/d23/d3b/d64/d7a/d5d/d6b/f22 [0,4194304] 0 2023-12-05T09:57:38.236 INFO:tasks.workunit.client.0.smithi100.stdout:9/654: dwrite d7/d1b/d22/d2a/d56/daf/fd0 [0,4194304] 0 2023-12-05T09:57:38.236 INFO:tasks.workunit.client.0.smithi100.stdout:9/655: readlink d7/d1b/d22/d2a/d56/d2e/d50/ddd/le1 0 2023-12-05T09:57:38.240 INFO:tasks.workunit.client.0.smithi100.stdout:3/756: creat d0/d3d/d5c/d5f/f104 x:0 0 0 2023-12-05T09:57:38.240 INFO:tasks.workunit.client.0.smithi100.stdout:3/757: write d0/d2/de/d11/d58/fe4 [560509,126883] 0 2023-12-05T09:57:38.252 INFO:tasks.workunit.client.1.smithi150.stdout:5/651: rename d1/d3/d6/d26/d9a/dc7/cc8 to d1/d64/d31/d5b/ce8 0 2023-12-05T09:57:38.252 INFO:tasks.workunit.client.1.smithi150.stdout:8/726: stat d0/d41/c70 0 2023-12-05T09:57:38.252 INFO:tasks.workunit.client.0.smithi100.stdout:8/548: mkdir d0/d35/d63/d76/d91/d99 0 2023-12-05T09:57:38.253 INFO:tasks.workunit.client.0.smithi100.stdout:8/549: dread - d0/d12/f78 zero size 2023-12-05T09:57:38.253 INFO:tasks.workunit.client.0.smithi100.stdout:8/550: readlink d0/d12/d13/d16/d22/d72/l8d 0 2023-12-05T09:57:38.258 INFO:tasks.workunit.client.1.smithi150.stdout:2/690: creat d0/d3/d5/d3b/d4c/d71/fec x:0 0 0 2023-12-05T09:57:38.269 INFO:tasks.workunit.client.1.smithi150.stdout:4/589: dwrite d0/d3e/d5b/f94 [0,4194304] 0 2023-12-05T09:57:38.270 INFO:tasks.workunit.client.1.smithi150.stdout:0/688: dread d5/d11/d71/f30 [0,4194304] 0 2023-12-05T09:57:38.270 INFO:tasks.workunit.client.1.smithi150.stdout:0/689: write d5/d11/d71/d99/d9c/d46/d80/f86 [468801,80697] 0 2023-12-05T09:57:38.271 INFO:tasks.workunit.client.0.smithi100.stdout:4/609: dwrite de/d16/d1e/f7c [0,4194304] 0 2023-12-05T09:57:38.271 INFO:tasks.workunit.client.0.smithi100.stdout:2/754: dwrite d7/da/dc/d88/fb8 [4194304,4194304] 0 2023-12-05T09:57:38.272 INFO:tasks.workunit.client.0.smithi100.stdout:2/755: dread - d7/da/d13/d4e/d87/fe5 zero size 2023-12-05T09:57:38.272 INFO:tasks.workunit.client.0.smithi100.stdout:2/756: fdatasync d7/da/dc/d88/fb8 0 2023-12-05T09:57:38.272 INFO:tasks.workunit.client.0.smithi100.stdout:2/757: write d7/da/d13/d69/d6e/d71/f8c [3834877,124313] 0 2023-12-05T09:57:38.272 INFO:tasks.workunit.client.0.smithi100.stdout:0/603: write da/d1b/d6b/fa7 [186886,69889] 0 2023-12-05T09:57:38.274 INFO:tasks.workunit.client.1.smithi150.stdout:3/677: dwrite d6/d9/d43/f60 [0,4194304] 0 2023-12-05T09:57:38.274 INFO:tasks.workunit.client.0.smithi100.stdout:6/993: dwrite d7/d27/fb5 [4194304,4194304] 0 2023-12-05T09:57:38.276 INFO:tasks.workunit.client.1.smithi150.stdout:5/652: mknod d1/d2e/ce9 0 2023-12-05T09:57:38.277 INFO:tasks.workunit.client.1.smithi150.stdout:5/653: stat d1/d2e/da6/l4e 0 2023-12-05T09:57:38.277 INFO:tasks.workunit.client.0.smithi100.stdout:1/604: creat db/d12/d1e/fc3 x:0 0 0 2023-12-05T09:57:38.290 INFO:tasks.workunit.client.0.smithi100.stdout:7/595: rename d3/dc/d11/d13/de/d18/d3b/d40/d4c/cad to d3/dc/d11/d13/d37/d97/dc1/dcd/cdb 0 2023-12-05T09:57:38.294 INFO:tasks.workunit.client.0.smithi100.stdout:8/551: read d0/f5b [3638718,51804] 0 2023-12-05T09:57:38.294 INFO:tasks.workunit.client.0.smithi100.stdout:8/552: fdatasync d0/d12/d52/f7e 0 2023-12-05T09:57:38.295 INFO:tasks.workunit.client.1.smithi150.stdout:0/690: read d5/d11/d16/f51 [1841799,97367] 0 2023-12-05T09:57:38.295 INFO:tasks.workunit.client.1.smithi150.stdout:0/691: dread - d5/d11/ff5 zero size 2023-12-05T09:57:38.300 INFO:tasks.workunit.client.0.smithi100.stdout:6/994: dread d7/d11/d1a/db7/df7/d126/f40 [4194304,4194304] 0 2023-12-05T09:57:38.301 INFO:tasks.workunit.client.1.smithi150.stdout:6/600: rmdir d2/d23/d2e 39 2023-12-05T09:57:38.304 INFO:tasks.workunit.client.0.smithi100.stdout:8/553: dread d0/d12/d13/d16/d22/f55 [0,4194304] 0 2023-12-05T09:57:38.308 INFO:tasks.workunit.client.1.smithi150.stdout:7/653: dwrite d2/db/d30/daf/dd3/d2b/f34 [4194304,4194304] 0 2023-12-05T09:57:38.311 INFO:tasks.workunit.client.1.smithi150.stdout:5/654: dread d1/d3/fd1 [0,4194304] 0 2023-12-05T09:57:38.311 INFO:tasks.workunit.client.1.smithi150.stdout:5/655: readlink d1/d2e/da6/d24/l5e 0 2023-12-05T09:57:38.311 INFO:tasks.workunit.client.1.smithi150.stdout:5/656: write d1/f96 [1053052,67971] 0 2023-12-05T09:57:38.311 INFO:tasks.workunit.client.1.smithi150.stdout:5/657: write d1/f8c [1265239,103537] 0 2023-12-05T09:57:38.313 INFO:tasks.workunit.client.1.smithi150.stdout:9/607: dwrite d3/d9/dc/f1d [0,4194304] 0 2023-12-05T09:57:38.313 INFO:tasks.workunit.client.1.smithi150.stdout:9/608: stat d3/d9/d26/f3f 0 2023-12-05T09:57:38.314 INFO:tasks.workunit.client.0.smithi100.stdout:0/604: fdatasync da/d1b/f66 0 2023-12-05T09:57:38.314 INFO:tasks.workunit.client.0.smithi100.stdout:0/605: fsync da/d22/d33/d74/f79 0 2023-12-05T09:57:38.317 INFO:tasks.workunit.client.1.smithi150.stdout:3/678: link d6/d9/d3d/d56/d71/db6/dc1/d67/c7c d6/d9/d3d/d56/d71/db0/cdd 0 2023-12-05T09:57:38.317 INFO:tasks.workunit.client.1.smithi150.stdout:3/679: readlink d6/d9/la 0 2023-12-05T09:57:38.319 INFO:tasks.workunit.client.1.smithi150.stdout:0/692: mknod d5/d11/d71/d99/d9c/d96/dd5/d7f/cf9 0 2023-12-05T09:57:38.319 INFO:tasks.workunit.client.1.smithi150.stdout:0/693: write d5/d11/d71/d99/d9c/fa5 [122023,111669] 0 2023-12-05T09:57:38.322 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:38.325+0000 7f0adcff9700 1 -- 172.21.15.100:0/334917497 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f0ad4005830 con 0x7f0af00fee00 2023-12-05T09:57:38.323 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:38.325+0000 7f0adeffd700 1 -- 172.21.15.100:0/334917497 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f0ae405db20 con 0x7f0af00fee00 2023-12-05T09:57:38.323 INFO:teuthology.orchestra.run.smithi100.stdout:HEALTH_OK 2023-12-05T09:57:38.326 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:38.328+0000 7f0adcff9700 1 -- 172.21.15.100:0/334917497 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7f0ad806aeb0 msgr2=0x7f0ad806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:57:38.326 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:38.328+0000 7f0adcff9700 1 --2- 172.21.15.100:0/334917497 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7f0ad806aeb0 0x7f0ad806d360 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0ae0004f40 tx=0x7f0ae000b040 comp rx=0 tx=0).stop 2023-12-05T09:57:38.326 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:38.328+0000 7f0adcff9700 1 -- 172.21.15.100:0/334917497 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0af00fee00 msgr2=0x7f0af010b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:57:38.326 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:38.328+0000 7f0adcff9700 1 --2- 172.21.15.100:0/334917497 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0af00fee00 0x7f0af010b380 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0ae4000c00 tx=0x7f0ae4009e30 comp rx=0 tx=0).stop 2023-12-05T09:57:38.326 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:38.328+0000 7f0adcff9700 1 -- 172.21.15.100:0/334917497 shutdown_connections 2023-12-05T09:57:38.326 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:38.328+0000 7f0adcff9700 1 --2- 172.21.15.100:0/334917497 >> [v2:172.21.15.150:6828/896268868,v1:172.21.15.150:6829/896268868] conn(0x7f0ad806aeb0 0x7f0ad806d360 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:38.327 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:38.328+0000 7f0adcff9700 1 --2- 172.21.15.100:0/334917497 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0af00fee00 0x7f0af010b380 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:38.327 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:38.328+0000 7f0adcff9700 1 --2- 172.21.15.100:0/334917497 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0af00fff70 0x7f0af010b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:57:38.327 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:38.328+0000 7f0adcff9700 1 -- 172.21.15.100:0/334917497 >> 172.21.15.100:0/334917497 conn(0x7f0af00fa5d0 msgr2=0x7f0af00fbe30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:57:38.327 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:38.329+0000 7f0adcff9700 1 -- 172.21.15.100:0/334917497 shutdown_connections 2023-12-05T09:57:38.327 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:57:38.329+0000 7f0adcff9700 1 -- 172.21.15.100:0/334917497 wait complete. 2023-12-05T09:57:38.328 INFO:tasks.workunit.client.1.smithi150.stdout:5/658: mkdir d1/d3/d92/dea 0 2023-12-05T09:57:38.328 INFO:tasks.workunit.client.1.smithi150.stdout:5/659: chown d1/f96 65169 1 2023-12-05T09:57:38.328 INFO:tasks.workunit.client.1.smithi150.stdout:5/660: chown d1/d7f/d65/d3b/d6b 40 1 2023-12-05T09:57:38.328 INFO:tasks.workunit.client.1.smithi150.stdout:5/661: fdatasync d1/f55 0 2023-12-05T09:57:38.329 INFO:tasks.workunit.client.0.smithi100.stdout:9/656: dwrite d7/d1b/d22/d51/f23 [0,4194304] 0 2023-12-05T09:57:38.329 INFO:tasks.workunit.client.0.smithi100.stdout:9/657: fdatasync d7/d1b/d22/d2a/f40 0 2023-12-05T09:57:38.330 INFO:tasks.workunit.client.1.smithi150.stdout:7/654: dread d2/db/d30/d13/d4f/fbc [0,4194304] 0 2023-12-05T09:57:38.331 INFO:tasks.workunit.client.1.smithi150.stdout:3/680: rename d6/cc to d6/d25/dcf/cde 0 2023-12-05T09:57:38.331 INFO:tasks.workunit.client.1.smithi150.stdout:3/681: write d6/d9/d3d/d56/d79/fc3 [781246,18791] 0 2023-12-05T09:57:38.332 INFO:tasks.workunit.client.1.smithi150.stdout:0/694: mknod d5/d11/d71/d99/d9c/d3b/de0/cfa 0 2023-12-05T09:57:38.335 INFO:tasks.workunit.client.1.smithi150.stdout:8/727: dwrite d0/d41/d49/d1b/fa4 [0,4194304] 0 2023-12-05T09:57:38.335 INFO:tasks.workunit.client.1.smithi150.stdout:8/728: truncate d0/d41/d49/d1b/d24/d2e/fa5 1697887 0 2023-12-05T09:57:38.338 INFO:tasks.workunit.client.1.smithi150.stdout:3/682: read d6/f6c [492420,104389] 0 2023-12-05T09:57:38.338 INFO:tasks.workunit.client.1.smithi150.stdout:9/609: link d3/d9/ce d3/d9/d67/cc9 0 2023-12-05T09:57:38.339 INFO:tasks.workunit.client.0.smithi100.stdout:1/605: mkdir db/d12/d1e/d72/dc4 0 2023-12-05T09:57:38.339 INFO:tasks.workunit.client.0.smithi100.stdout:1/606: chown db/d31/d3a/d4a/dad/d67/l97 416703 1 2023-12-05T09:57:38.339 INFO:tasks.workunit.client.0.smithi100.stdout:4/610: dwrite de/d16/d23/f37 [4194304,4194304] 0 2023-12-05T09:57:38.341 INFO:tasks.workunit.client.1.smithi150.stdout:9/610: chown d3/d9/dc/f4b 15693 1 2023-12-05T09:57:38.341 INFO:tasks.workunit.client.1.smithi150.stdout:9/611: chown d3/d42/d62 68916681 1 2023-12-05T09:57:38.341 INFO:tasks.workunit.client.0.smithi100.stdout:7/596: mknod d3/dc/d11/d13/de/d2d/d47/dbd/cdc 0 2023-12-05T09:57:38.341 INFO:tasks.workunit.client.0.smithi100.stdout:7/597: fsync d3/dc/d11/d13/de/d18/d3b/d40/d4c/d7f/f92 0 2023-12-05T09:57:38.345 INFO:tasks.workunit.client.0.smithi100.stdout:3/758: symlink d0/d3d/d5c/d5f/d67/l105 0 2023-12-05T09:57:38.346 INFO:tasks.workunit.client.1.smithi150.stdout:8/729: truncate d0/d41/d49/d1b/d24/d5b/d87/f98 499603 0 2023-12-05T09:57:38.346 INFO:tasks.workunit.client.0.smithi100.stdout:6/995: creat d7/d11/d1a/db7/df7/d126/d6a/d7c/f140 x:0 0 0 2023-12-05T09:57:38.347 INFO:tasks.workunit.client.1.smithi150.stdout:0/695: dread d5/d11/d71/d99/d9c/d96/dd5/d67/f73 [0,4194304] 0 2023-12-05T09:57:38.348 INFO:tasks.workunit.client.1.smithi150.stdout:5/662: write d1/d3/f7 [848961,7497] 0 2023-12-05T09:57:38.348 INFO:tasks.workunit.client.1.smithi150.stdout:0/696: write d5/d11/d32/f50 [5024943,88266] 0 2023-12-05T09:57:38.356 INFO:tasks.workunit.client.1.smithi150.stdout:4/590: dwrite d0/d3e/d5b/d80/da1/fa5 [0,4194304] 0 2023-12-05T09:57:38.356 INFO:tasks.workunit.client.1.smithi150.stdout:4/591: dread - d0/d3e/d5b/d6e/daa/fb3 zero size 2023-12-05T09:57:38.358 INFO:tasks.workunit.client.1.smithi150.stdout:3/683: mknod d6/d9/d3d/d56/d71/db6/dc1/d9a/cdf 0 2023-12-05T09:57:38.358 INFO:tasks.workunit.client.1.smithi150.stdout:1/636: sync 2023-12-05T09:57:38.358 INFO:tasks.workunit.client.1.smithi150.stdout:1/637: readlink d6/d38/d4a/l4f 0 2023-12-05T09:57:38.363 INFO:tasks.workunit.client.1.smithi150.stdout:5/663: mkdir d1/d3/d92/dbf/deb 0 2023-12-05T09:57:38.374 INFO:tasks.workunit.client.1.smithi150.stdout:4/592: mknod d0/d3e/d6d/d4b/cb9 0 2023-12-05T09:57:38.375 INFO:tasks.workunit.client.1.smithi150.stdout:4/593: write d0/d3e/d6d/d4b/d8c/fad [862269,65332] 0 2023-12-05T09:57:38.375 INFO:tasks.workunit.client.1.smithi150.stdout:4/594: readlink d0/d3e/d48/lb6 0 2023-12-05T09:57:38.379 INFO:tasks.workunit.client.1.smithi150.stdout:1/638: creat d6/d47/d4c/dd9/fe0 x:0 0 0 2023-12-05T09:57:38.382 INFO:tasks.workunit.client.0.smithi100.stdout:2/758: rmdir d7/da/d18 39 2023-12-05T09:57:38.382 INFO:tasks.workunit.client.1.smithi150.stdout:6/601: dwrite d2/d23/d3b/d46/fa2 [0,4194304] 0 2023-12-05T09:57:38.384 INFO:tasks.workunit.client.1.smithi150.stdout:4/595: rename d0/d3e/d5b/d80/cab to d0/d3e/d5b/d80/d44/cba 0 2023-12-05T09:57:38.386 INFO:tasks.workunit.client.0.smithi100.stdout:0/606: getdents da/d22/d33/d35/d3a/d8b 0 2023-12-05T09:57:38.386 INFO:tasks.workunit.client.0.smithi100.stdout:0/607: stat da/d1b/d36 0 2023-12-05T09:57:38.393 INFO:tasks.workunit.client.0.smithi100.stdout:9/658: link d7/d35/d71/cba d7/d1b/d22/d2a/d56/d2e/ce3 0 2023-12-05T09:57:38.393 INFO:tasks.workunit.client.0.smithi100.stdout:9/659: chown d7/fc 11370550 1 2023-12-05T09:57:38.393 INFO:tasks.workunit.client.0.smithi100.stdout:9/660: dread - d7/d1b/d22/d51/fbc zero size 2023-12-05T09:57:38.399 INFO:tasks.workunit.client.1.smithi150.stdout:8/730: dwrite d0/d41/d49/d1b/d24/d38/d62/f8c [0,4194304] 0 2023-12-05T09:57:38.400 INFO:tasks.workunit.client.0.smithi100.stdout:3/759: creat d0/d2/de/d11/db5/f106 x:0 0 0 2023-12-05T09:57:38.401 INFO:tasks.workunit.client.1.smithi150.stdout:1/639: link d6/d8/db/cd1 d6/d38/da1/dc6/ce1 0 2023-12-05T09:57:38.402 INFO:tasks.workunit.client.1.smithi150.stdout:6/602: creat d2/d23/d2e/d72/fcb x:0 0 0 2023-12-05T09:57:38.402 INFO:tasks.workunit.client.1.smithi150.stdout:6/603: write d2/d23/d2e/f94 [1449946,89871] 0 2023-12-05T09:57:38.402 INFO:tasks.workunit.client.1.smithi150.stdout:2/691: dwrite d0/d3/d21/d4d/deb/d86/fa0 [0,4194304] 0 2023-12-05T09:57:38.405 INFO:tasks.workunit.client.0.smithi100.stdout:6/996: truncate d7/fc7 4022228 0 2023-12-05T09:57:38.407 INFO:tasks.workunit.client.1.smithi150.stdout:8/731: mknod d0/d41/d49/d1b/d24/d34/da2/dd7/ce3 0 2023-12-05T09:57:38.408 INFO:tasks.workunit.client.0.smithi100.stdout:8/554: rmdir d0 39 2023-12-05T09:57:38.408 INFO:tasks.workunit.client.0.smithi100.stdout:8/555: readlink d0/d12/d52/l6a 0 2023-12-05T09:57:38.410 INFO:tasks.workunit.client.0.smithi100.stdout:7/598: dwrite d3/f1f [0,4194304] 0 2023-12-05T09:57:38.411 INFO:tasks.workunit.client.0.smithi100.stdout:2/759: symlink d7/da/d18/d21/dae/lff 0 2023-12-05T09:57:38.413 INFO:tasks.workunit.client.0.smithi100.stdout:0/608: truncate da/d1b/d36/f48 2487466 0 2023-12-05T09:57:38.416 INFO:tasks.workunit.client.1.smithi150.stdout:1/640: mkdir d6/d47/d4c/dd9/de2 0 2023-12-05T09:57:38.417 INFO:tasks.workunit.client.0.smithi100.stdout:1/607: rmdir db/d31/d3a/d4a/dad 39 2023-12-05T09:57:38.420 INFO:tasks.workunit.client.1.smithi150.stdout:7/655: dwrite d2/db/d30/daf/dd3/d2b/f34 [8388608,4194304] 0 2023-12-05T09:57:38.422 INFO:tasks.workunit.client.0.smithi100.stdout:4/611: getdents de/d16/d23 0 2023-12-05T09:57:38.424 INFO:tasks.workunit.client.1.smithi150.stdout:6/604: symlink d2/d23/d3b/d64/lcc 0 2023-12-05T09:57:38.424 INFO:tasks.workunit.client.1.smithi150.stdout:6/605: chown d2/d23/d2e/fad 63709960 1 2023-12-05T09:57:38.428 INFO:tasks.workunit.client.1.smithi150.stdout:2/692: creat d0/d3/d5/d10/fed x:0 0 0 2023-12-05T09:57:38.428 INFO:tasks.workunit.client.0.smithi100.stdout:1/608: dread db/d31/d3a/f42 [0,4194304] 0 2023-12-05T09:57:38.429 INFO:tasks.workunit.client.0.smithi100.stdout:2/760: write d7/da/d18/d21/d86/d92/fbe [1696328,80604] 0 2023-12-05T09:57:38.431 INFO:tasks.workunit.client.0.smithi100.stdout:3/760: mknod d0/d3d/c107 0 2023-12-05T09:57:38.431 INFO:tasks.workunit.client.0.smithi100.stdout:3/761: chown d0/d10/l93 0 1 2023-12-05T09:57:38.431 INFO:tasks.workunit.client.0.smithi100.stdout:5/636: sync 2023-12-05T09:57:38.431 INFO:tasks.workunit.client.1.smithi150.stdout:8/732: readlink d0/d41/l61 0 2023-12-05T09:57:38.432 INFO:tasks.workunit.client.0.smithi100.stdout:5/637: write d0/f36 [4324949,68638] 0 2023-12-05T09:57:38.432 INFO:tasks.workunit.client.0.smithi100.stdout:5/638: truncate d0/d1f/fdb 300946 0 2023-12-05T09:57:38.433 INFO:tasks.workunit.client.0.smithi100.stdout:6/997: dread d7/d11/d82/ff4 [0,4194304] 0 2023-12-05T09:57:38.433 INFO:tasks.workunit.client.0.smithi100.stdout:6/998: chown d7/d27/f38 14 1 2023-12-05T09:57:38.434 INFO:tasks.workunit.client.1.smithi150.stdout:1/641: mkdir d6/d47/d4c/dd9/d75/ddd/de3 0 2023-12-05T09:57:38.436 INFO:tasks.workunit.client.0.smithi100.stdout:8/556: unlink d0/d12/d13/d16/f3a 0 2023-12-05T09:57:38.446 INFO:tasks.workunit.client.1.smithi150.stdout:7/656: creat d2/db/d30/d13/d4f/fd7 x:0 0 0 2023-12-05T09:57:38.446 INFO:tasks.workunit.client.0.smithi100.stdout:7/599: mkdir d3/dc/d11/d13/de/d2d/d47/ddd 0 2023-12-05T09:57:38.447 INFO:tasks.workunit.client.1.smithi150.stdout:7/657: creat d2/db/d30/d47/fd8 x:0 0 0 2023-12-05T09:57:38.452 INFO:tasks.workunit.client.0.smithi100.stdout:5/639: symlink d0/d4/d14/d35/d62/ldd 0 2023-12-05T09:57:38.454 INFO:tasks.workunit.client.0.smithi100.stdout:9/661: dwrite d7/d20/d69/fa0 [0,4194304] 0 2023-12-05T09:57:38.455 INFO:tasks.workunit.client.1.smithi150.stdout:2/693: dread d0/d3/d5/f40 [0,4194304] 0 2023-12-05T09:57:38.455 INFO:tasks.workunit.client.1.smithi150.stdout:1/642: rename d6/d8/d54/c5f to d6/d8/d54/d94/ce4 0 2023-12-05T09:57:38.455 INFO:tasks.workunit.client.1.smithi150.stdout:1/643: write d6/d47/d4c/dd9/fd2 [4729990,64666] 0 2023-12-05T09:57:38.455 INFO:tasks.workunit.client.1.smithi150.stdout:1/644: readlink d6/d8/db/l66 0 2023-12-05T09:57:38.458 INFO:tasks.workunit.client.0.smithi100.stdout:8/557: mkdir d0/d35/d64/d81/d9a 0 2023-12-05T09:57:38.462 INFO:tasks.workunit.client.1.smithi150.stdout:5/664: dwrite d1/f55 [0,4194304] 0 2023-12-05T09:57:38.463 INFO:tasks.workunit.client.1.smithi150.stdout:7/658: symlink d2/db/d30/d13/d4f/ld9 0 2023-12-05T09:57:38.465 INFO:tasks.workunit.client.0.smithi100.stdout:2/761: rename d7/da/d18/l90 to d7/da/d13/l100 0 2023-12-05T09:57:38.470 INFO:tasks.workunit.client.1.smithi150.stdout:2/694: unlink d0/da3/dae/fd9 0 2023-12-05T09:57:38.470 INFO:tasks.workunit.client.1.smithi150.stdout:2/695: chown d0/d3/d27/d95/ddf 1105042 1 2023-12-05T09:57:38.474 INFO:tasks.workunit.client.0.smithi100.stdout:5/640: unlink d0/d16/d2b/d48/df/c47 0 2023-12-05T09:57:38.477 INFO:tasks.workunit.client.0.smithi100.stdout:2/762: dread d7/da/d18/d1b/d2c/d3f/fd1 [0,4194304] 0 2023-12-05T09:57:38.477 INFO:tasks.workunit.client.0.smithi100.stdout:2/763: readlink d7/da/d13/l1d 0 2023-12-05T09:57:38.483 INFO:tasks.workunit.client.0.smithi100.stdout:3/762: rename d0/d2/de/fcc to d0/d3d/f108 0 2023-12-05T09:57:38.485 INFO:tasks.workunit.client.1.smithi150.stdout:5/665: mkdir d1/d2e/dec 0 2023-12-05T09:57:38.486 INFO:tasks.workunit.client.1.smithi150.stdout:7/659: truncate d2/db/d17/f7a 53800 0 2023-12-05T09:57:38.486 INFO:tasks.workunit.client.0.smithi100.stdout:8/558: read d0/d12/f48 [1535662,21699] 0 2023-12-05T09:57:38.488 INFO:tasks.workunit.client.0.smithi100.stdout:6/999: rename d7/d11/d1a/db7/df7/d126/d6a/de2/f11a to d7/d27/d35/d5a/d120/f141 0 2023-12-05T09:57:38.490 INFO:tasks.workunit.client.1.smithi150.stdout:2/696: mkdir d0/d3/d5/d13/d15/d30/d54/d57/dee 0 2023-12-05T09:57:38.491 INFO:tasks.workunit.client.0.smithi100.stdout:3/763: unlink d0/d2/f59 0 2023-12-05T09:57:38.492 INFO:tasks.workunit.client.0.smithi100.stdout:8/559: rmdir d0/d35 39 2023-12-05T09:57:38.495 INFO:tasks.workunit.client.0.smithi100.stdout:7/600: rename d3/dc/d11/d13/de/d18/d3b/d40/d46/f85 to d3/dc/d11/d13/de/d18/d3b/d40/fde 0 2023-12-05T09:57:38.496 INFO:tasks.workunit.client.0.smithi100.stdout:8/560: truncate d0/d35/d64/f85 1031269 0 2023-12-05T09:57:38.498 INFO:tasks.workunit.client.0.smithi100.stdout:9/662: rename d7/d1b/d22/d93/c9e to d7/d1b/d22/ce4 0 2023-12-05T09:57:38.499 INFO:tasks.workunit.client.0.smithi100.stdout:7/601: creat d3/dc/d11/d13/de/d18/d3b/d40/d4c/fdf x:0 0 0 2023-12-05T09:57:38.499 INFO:tasks.workunit.client.0.smithi100.stdout:7/602: creat d3/dc/d11/d13/d1b/d60/fe0 x:0 0 0 2023-12-05T09:57:38.500 INFO:tasks.workunit.client.0.smithi100.stdout:7/603: dread - d3/dc/fa6 zero size 2023-12-05T09:57:38.500 INFO:tasks.workunit.client.0.smithi100.stdout:5/641: fsync d0/f36 0 2023-12-05T09:57:38.500 INFO:tasks.workunit.client.1.smithi150.stdout:4/596: dwrite d0/f3c [4194304,4194304] 0 2023-12-05T09:57:38.500 INFO:tasks.workunit.client.1.smithi150.stdout:4/597: chown d0/d3e/d6d/l1b 301216411 1 2023-12-05T09:57:38.500 INFO:tasks.workunit.client.0.smithi100.stdout:4/612: dwrite de/f55 [0,4194304] 0 2023-12-05T09:57:38.502 INFO:tasks.workunit.client.0.smithi100.stdout:0/609: dwrite da/d1b/d6b/d78/f88 [0,4194304] 0 2023-12-05T09:57:38.502 INFO:tasks.workunit.client.0.smithi100.stdout:1/609: dwrite db/d31/d3a/d3b/fa1 [0,4194304] 0 2023-12-05T09:57:38.502 INFO:tasks.workunit.client.0.smithi100.stdout:1/610: write db/d31/d3a/f4c [1373368,38169] 0 2023-12-05T09:57:38.502 INFO:tasks.workunit.client.1.smithi150.stdout:6/606: dwrite d2/d23/d2e/f3e [0,4194304] 0 2023-12-05T09:57:38.502 INFO:tasks.workunit.client.1.smithi150.stdout:1/645: rmdir d6/d38/da1 39 2023-12-05T09:57:38.502 INFO:tasks.workunit.client.1.smithi150.stdout:5/666: mkdir d1/d64/ded 0 2023-12-05T09:57:38.502 INFO:tasks.workunit.client.0.smithi100.stdout:9/663: rename d7/d35/l91 to d7/d1b/d22/d51/d32/dc2/le5 0 2023-12-05T09:57:38.506 INFO:tasks.workunit.client.0.smithi100.stdout:3/764: dread d0/f36 [0,4194304] 0 2023-12-05T09:57:38.506 INFO:tasks.workunit.client.0.smithi100.stdout:3/765: chown d0/d2/de/db8 208 1 2023-12-05T09:57:38.506 INFO:tasks.workunit.client.0.smithi100.stdout:3/766: stat d0/d3d/d5c/d6f 0 2023-12-05T09:57:38.512 INFO:tasks.workunit.client.1.smithi150.stdout:4/598: mkdir d0/d3e/d48/dbb 0 2023-12-05T09:57:38.512 INFO:tasks.workunit.client.1.smithi150.stdout:4/599: creat d0/d3e/d48/fbc x:0 0 0 2023-12-05T09:57:38.513 INFO:tasks.workunit.client.0.smithi100.stdout:7/604: creat d3/dc/daa/fe1 x:0 0 0 2023-12-05T09:57:38.513 INFO:tasks.workunit.client.0.smithi100.stdout:7/605: write d3/dc/d11/d13/d37/f4b [1079962,81068] 0 2023-12-05T09:57:38.513 INFO:tasks.workunit.client.1.smithi150.stdout:1/646: dread d6/f53 [0,4194304] 0 2023-12-05T09:57:38.518 INFO:tasks.workunit.client.1.smithi150.stdout:5/667: dread d1/f8c [0,4194304] 0 2023-12-05T09:57:38.518 INFO:tasks.workunit.client.1.smithi150.stdout:5/668: dread - d1/d7f/d65/d3b/d6b/fb0 zero size 2023-12-05T09:57:38.518 INFO:tasks.workunit.client.1.smithi150.stdout:8/733: dwrite d0/d41/d49/d1b/d24/d2e/d30/f9f [0,4194304] 0 2023-12-05T09:57:38.519 INFO:tasks.workunit.client.0.smithi100.stdout:8/561: write d0/f19 [2693665,78991] 0 2023-12-05T09:57:38.519 INFO:tasks.workunit.client.0.smithi100.stdout:5/642: creat d0/d1b/d4d/d6c/fde x:0 0 0 2023-12-05T09:57:38.520 INFO:tasks.workunit.client.0.smithi100.stdout:2/764: dread d7/da/d13/d69/ffc [0,4194304] 0 2023-12-05T09:57:38.521 INFO:tasks.workunit.client.1.smithi150.stdout:6/607: mkdir d2/d23/d3b/d64/d7a/d5d/dcd 0 2023-12-05T09:57:38.523 INFO:tasks.workunit.client.0.smithi100.stdout:3/767: dread d0/d3d/d5c/d6f/ffd [0,4194304] 0 2023-12-05T09:57:38.523 INFO:tasks.workunit.client.0.smithi100.stdout:3/768: chown d0/d3d/d5c/d5f/d73/cd5 13568 1 2023-12-05T09:57:38.523 INFO:tasks.workunit.client.0.smithi100.stdout:3/769: creat d0/d2/de/d12/d9b/f109 x:0 0 0 2023-12-05T09:57:38.523 INFO:tasks.workunit.client.0.smithi100.stdout:3/770: chown d0/d10/d39/f41 8137523 1 2023-12-05T09:57:38.523 INFO:tasks.workunit.client.0.smithi100.stdout:3/771: chown d0/d10/d39/f8b 27 1 2023-12-05T09:57:38.523 INFO:tasks.workunit.client.0.smithi100.stdout:3/772: read - d0/d2/de/d11/ff0 zero size 2023-12-05T09:57:38.523 INFO:tasks.workunit.client.1.smithi150.stdout:2/697: getdents d0/d3/d5/d22/d52/d56 0 2023-12-05T09:57:38.527 INFO:tasks.workunit.client.0.smithi100.stdout:4/613: mkdir de/dc3 0 2023-12-05T09:57:38.528 INFO:tasks.workunit.client.0.smithi100.stdout:4/614: stat de/f12 0 2023-12-05T09:57:38.529 INFO:tasks.workunit.client.1.smithi150.stdout:4/600: mkdir d0/d3e/d5b/d80/d44/da2/dbd 0 2023-12-05T09:57:38.532 INFO:tasks.workunit.client.0.smithi100.stdout:1/611: symlink db/d12/d1e/d26/d39/da6/db8/lc5 0 2023-12-05T09:57:38.534 INFO:tasks.workunit.client.1.smithi150.stdout:7/660: dwrite d2/db/d30/f94 [0,4194304] 0 2023-12-05T09:57:38.538 INFO:tasks.workunit.client.1.smithi150.stdout:1/647: link d6/d38/d4a/l4f d6/d8/d59/le5 0 2023-12-05T09:57:38.539 INFO:tasks.workunit.client.0.smithi100.stdout:7/606: mkdir d3/dc/d11/d13/de/d18/d3b/de2 0 2023-12-05T09:57:38.551 INFO:tasks.workunit.client.1.smithi150.stdout:5/669: getdents d1/d64/d31/d5b/ddf 0 2023-12-05T09:57:38.551 INFO:tasks.workunit.client.1.smithi150.stdout:5/670: write d1/d2e/f90 [4630436,61303] 0 2023-12-05T09:57:38.552 INFO:tasks.workunit.client.0.smithi100.stdout:1/612: creat db/d12/d1e/d72/fc6 x:0 0 0 2023-12-05T09:57:38.555 INFO:tasks.workunit.client.1.smithi150.stdout:8/734: link d0/d8/f51 d0/d41/d49/d1b/d24/fe4 0 2023-12-05T09:57:38.558 INFO:tasks.workunit.client.0.smithi100.stdout:9/664: rename d7/l2f to d7/d1b/d22/d51/d32/le6 0 2023-12-05T09:57:38.563 INFO:tasks.workunit.client.1.smithi150.stdout:6/608: rename d2/l21 to d2/d23/d2e/d44/da0/lce 0 2023-12-05T09:57:38.564 INFO:tasks.workunit.client.0.smithi100.stdout:8/562: dwrite d0/d12/d13/f30 [0,4194304] 0 2023-12-05T09:57:38.564 INFO:tasks.workunit.client.1.smithi150.stdout:4/601: getdents d0/d3e/d5b/d6e 0 2023-12-05T09:57:38.566 INFO:tasks.workunit.client.0.smithi100.stdout:7/607: creat d3/dc/d11/d13/da8/fe3 x:0 0 0 2023-12-05T09:57:38.567 INFO:tasks.workunit.client.0.smithi100.stdout:1/613: mkdir db/d12/d1e/d26/d39/da6/dc7 0 2023-12-05T09:57:38.569 INFO:tasks.workunit.client.0.smithi100.stdout:9/665: symlink d7/d1b/d22/d2a/d56/d2e/le7 0 2023-12-05T09:57:38.572 INFO:tasks.workunit.client.0.smithi100.stdout:5/643: dwrite d0/d16/d2b/d75/f78 [0,4194304] 0 2023-12-05T09:57:38.572 INFO:tasks.workunit.client.0.smithi100.stdout:5/644: fdatasync d0/d16/d2b/f91 0 2023-12-05T09:57:38.573 INFO:tasks.workunit.client.0.smithi100.stdout:4/615: rename de/d16/d23/d33/d3d/db0 to de/d16/d23/d60/dc4 0 2023-12-05T09:57:38.575 INFO:tasks.workunit.client.0.smithi100.stdout:5/645: creat d0/d16/d2b/d48/df/fdf x:0 0 0 2023-12-05T09:57:38.575 INFO:tasks.workunit.client.0.smithi100.stdout:7/608: creat d3/dc/d11/d13/d37/d97/dc1/dcd/fe4 x:0 0 0 2023-12-05T09:57:38.575 INFO:tasks.workunit.client.0.smithi100.stdout:7/609: stat d3/dc/d11/d13/de/d18/c2f 0 2023-12-05T09:57:38.576 INFO:tasks.workunit.client.0.smithi100.stdout:2/765: dwrite d7/da/d18/d1b/d2c/d3f/fd1 [0,4194304] 0 2023-12-05T09:57:38.576 INFO:tasks.workunit.client.0.smithi100.stdout:1/614: mknod db/d12/d1e/cc8 0 2023-12-05T09:57:38.577 INFO:tasks.workunit.client.0.smithi100.stdout:2/766: fsync d7/da/d13/d69/d6e/d71/f9a 0 2023-12-05T09:57:38.578 INFO:tasks.workunit.client.1.smithi150.stdout:1/648: creat d6/d47/d4c/dd9/d75/dc4/fe6 x:0 0 0 2023-12-05T09:57:38.579 INFO:tasks.workunit.client.1.smithi150.stdout:1/649: write d6/d38/f43 [55274,40615] 0 2023-12-05T09:57:38.579 INFO:tasks.workunit.client.1.smithi150.stdout:1/650: readlink d6/d3c/lb8 0 2023-12-05T09:57:38.579 INFO:tasks.workunit.client.1.smithi150.stdout:1/651: write d6/d47/d4c/fa2 [1989502,434] 0 2023-12-05T09:57:38.584 INFO:tasks.workunit.client.0.smithi100.stdout:8/563: dread d0/d12/f48 [0,4194304] 0 2023-12-05T09:57:38.589 INFO:tasks.workunit.client.1.smithi150.stdout:5/671: creat d1/d2e/da6/d86/fee x:0 0 0 2023-12-05T09:57:38.590 INFO:tasks.workunit.client.1.smithi150.stdout:9/612: sync 2023-12-05T09:57:38.592 INFO:tasks.workunit.client.1.smithi150.stdout:1/652: dread d6/d8/d59/f91 [0,4194304] 0 2023-12-05T09:57:38.592 INFO:tasks.workunit.client.1.smithi150.stdout:1/653: creat d6/d47/d4c/dd9/fe7 x:0 0 0 2023-12-05T09:57:38.592 INFO:tasks.workunit.client.1.smithi150.stdout:1/654: fsync d6/d8/db/db1/fbc 0 2023-12-05T09:57:38.597 INFO:tasks.workunit.client.1.smithi150.stdout:8/735: creat d0/d41/d49/d1b/d24/d34/dbc/fe5 x:0 0 0 2023-12-05T09:57:38.597 INFO:tasks.workunit.client.1.smithi150.stdout:8/736: chown d0/d41/c70 0 1 2023-12-05T09:57:38.597 INFO:tasks.workunit.client.0.smithi100.stdout:7/610: readlink d3/dc/d11/d13/l10 0 2023-12-05T09:57:38.597 INFO:tasks.workunit.client.0.smithi100.stdout:9/666: read d7/d1b/d22/d51/d32/f42 [1229983,46612] 0 2023-12-05T09:57:38.600 INFO:tasks.workunit.client.1.smithi150.stdout:0/697: sync 2023-12-05T09:57:38.601 INFO:tasks.workunit.client.0.smithi100.stdout:3/773: dwrite d0/d2/fe0 [0,4194304] 0 2023-12-05T09:57:38.604 INFO:tasks.workunit.client.1.smithi150.stdout:7/661: dwrite d2/d4/f23 [0,4194304] 0 2023-12-05T09:57:38.604 INFO:tasks.workunit.client.1.smithi150.stdout:2/698: rename d0/cb to d0/d3/d27/dac/dd0/cef 0 2023-12-05T09:57:38.604 INFO:tasks.workunit.client.1.smithi150.stdout:2/699: write d0/d3/d5/f40 [1973334,31479] 0 2023-12-05T09:57:38.605 INFO:tasks.workunit.client.0.smithi100.stdout:4/616: dread de/d16/d23/d60/d98/da6/fb5 [0,4194304] 0 2023-12-05T09:57:38.608 INFO:tasks.workunit.client.0.smithi100.stdout:1/615: mknod db/d31/cc9 0 2023-12-05T09:57:38.609 INFO:tasks.workunit.client.0.smithi100.stdout:1/616: write db/d12/d1e/d26/d30/f56 [3352680,46097] 0 2023-12-05T09:57:38.609 INFO:tasks.workunit.client.0.smithi100.stdout:1/617: dread - db/d12/d1e/fc3 zero size 2023-12-05T09:57:38.609 INFO:tasks.workunit.client.1.smithi150.stdout:4/602: dread - d0/f45 zero size 2023-12-05T09:57:38.610 INFO:tasks.workunit.client.1.smithi150.stdout:3/684: sync 2023-12-05T09:57:38.611 INFO:tasks.workunit.client.0.smithi100.stdout:5/646: write d0/d1f/f86 [2249914,108964] 0 2023-12-05T09:57:38.612 INFO:tasks.workunit.client.0.smithi100.stdout:2/767: symlink d7/da/d18/d1b/l101 0 2023-12-05T09:57:38.614 INFO:tasks.workunit.client.1.smithi150.stdout:5/672: link l0 d1/d3/d92/dbf/deb/lef 0 2023-12-05T09:57:38.614 INFO:tasks.workunit.client.1.smithi150.stdout:6/609: dwrite d2/f26 [0,4194304] 0 2023-12-05T09:57:38.618 INFO:tasks.workunit.client.0.smithi100.stdout:8/564: creat d0/d35/f9b x:0 0 0 2023-12-05T09:57:38.619 INFO:tasks.workunit.client.1.smithi150.stdout:1/655: mknod d6/d8/db/db1/ce8 0 2023-12-05T09:57:38.621 INFO:tasks.workunit.client.1.smithi150.stdout:8/737: symlink d0/d41/d49/d1b/d24/d38/dad/le6 0 2023-12-05T09:57:38.622 INFO:tasks.workunit.client.1.smithi150.stdout:5/673: dread d1/d7f/d65/d3b/d37/faf [0,4194304] 0 2023-12-05T09:57:38.624 INFO:tasks.workunit.client.0.smithi100.stdout:3/774: rename d0/d10/d39/f55 to d0/d3d/d5c/d6f/d7f/f10a 0 2023-12-05T09:57:38.624 INFO:tasks.workunit.client.0.smithi100.stdout:3/775: fdatasync d0/d2/de/d8d/fd9 0 2023-12-05T09:57:38.626 INFO:tasks.workunit.client.1.smithi150.stdout:2/700: unlink d0/d3/d5/d22/f65 0 2023-12-05T09:57:38.628 INFO:tasks.workunit.client.1.smithi150.stdout:4/603: mkdir d0/d3e/d5b/d80/da1/db2/dbe 0 2023-12-05T09:57:38.632 INFO:tasks.workunit.client.1.smithi150.stdout:3/685: mknod d6/d25/dcf/ce0 0 2023-12-05T09:57:38.635 INFO:tasks.workunit.client.1.smithi150.stdout:6/610: symlink d2/d23/d3b/d64/lcf 0 2023-12-05T09:57:38.637 INFO:tasks.workunit.client.0.smithi100.stdout:1/618: dread db/d12/d1e/f38 [0,4194304] 0 2023-12-05T09:57:38.638 INFO:tasks.workunit.client.1.smithi150.stdout:1/656: getdents d6/d47/d4c/dd9/d75 0 2023-12-05T09:57:38.638 INFO:tasks.workunit.client.1.smithi150.stdout:1/657: dread - d6/d47/d4c/dd9/f93 zero size 2023-12-05T09:57:38.640 INFO:tasks.workunit.client.0.smithi100.stdout:2/768: write d7/da/d18/d1b/f59 [3646082,112881] 0 2023-12-05T09:57:38.641 INFO:tasks.workunit.client.0.smithi100.stdout:4/617: mkdir de/d16/d23/d60/d88/dc5 0 2023-12-05T09:57:38.642 INFO:tasks.workunit.client.0.smithi100.stdout:8/565: dread d0/d12/d13/d45/f58 [0,4194304] 0 2023-12-05T09:57:38.642 INFO:tasks.workunit.client.1.smithi150.stdout:5/674: creat d1/d3/d6/ff0 x:0 0 0 2023-12-05T09:57:38.642 INFO:tasks.workunit.client.1.smithi150.stdout:5/675: chown d1/d2e 8525187 1 2023-12-05T09:57:38.643 INFO:tasks.workunit.client.0.smithi100.stdout:5/647: mknod d0/d27/ce0 0 2023-12-05T09:57:38.645 INFO:tasks.workunit.client.0.smithi100.stdout:9/667: rmdir d7/d20/d68 39 2023-12-05T09:57:38.647 INFO:tasks.workunit.client.1.smithi150.stdout:0/698: rmdir d5/d11/d71/d5f 39 2023-12-05T09:57:38.647 INFO:tasks.workunit.client.1.smithi150.stdout:0/699: fdatasync d5/d11/d32/fdd 0 2023-12-05T09:57:38.647 INFO:tasks.workunit.client.1.smithi150.stdout:0/700: chown d5/d11/d71/d99/d9c/d96/dd5/f44 7445 1 2023-12-05T09:57:38.650 INFO:tasks.workunit.client.1.smithi150.stdout:4/604: creat d0/d3e/d5b/d80/da1/fbf x:0 0 0 2023-12-05T09:57:38.650 INFO:tasks.workunit.client.1.smithi150.stdout:4/605: readlink d0/d3e/d5b/l93 0 2023-12-05T09:57:38.651 INFO:tasks.workunit.client.0.smithi100.stdout:1/619: truncate db/d12/d1e/d26/f62 3727129 0 2023-12-05T09:57:38.652 INFO:tasks.workunit.client.1.smithi150.stdout:2/701: write d0/d3/d21/f39 [7385077,44706] 0 2023-12-05T09:57:38.653 INFO:tasks.workunit.client.1.smithi150.stdout:9/613: dwrite d3/d9/d26/d9b/faa [0,4194304] 0 2023-12-05T09:57:38.653 INFO:tasks.workunit.client.1.smithi150.stdout:9/614: write d3/d1b/d46/d55/d64/fc3 [417062,51250] 0 2023-12-05T09:57:38.654 INFO:tasks.workunit.client.1.smithi150.stdout:6/611: symlink d2/d23/d2e/ld0 0 2023-12-05T09:57:38.660 INFO:tasks.workunit.client.0.smithi100.stdout:2/769: getdents d7/da/d18/d1b/d2c/d3f/d46 0 2023-12-05T09:57:38.660 INFO:tasks.workunit.client.0.smithi100.stdout:4/618: symlink de/d38/d86/lc6 0 2023-12-05T09:57:38.660 INFO:tasks.workunit.client.0.smithi100.stdout:2/770: creat d7/da/d13/d4e/d87/f102 x:0 0 0 2023-12-05T09:57:38.661 INFO:tasks.workunit.client.1.smithi150.stdout:5/676: rename d1/d3/c43 to d1/d2e/dec/cf1 0 2023-12-05T09:57:38.661 INFO:tasks.workunit.client.1.smithi150.stdout:5/677: write d1/d64/d31/fd5 [8643196,89946] 0 2023-12-05T09:57:38.662 INFO:tasks.workunit.client.1.smithi150.stdout:5/678: read - d1/d7f/d65/d3b/d8d/fd6 zero size 2023-12-05T09:57:38.662 INFO:tasks.workunit.client.1.smithi150.stdout:5/679: write d1/d3/d6/f1c [2603378,100433] 0 2023-12-05T09:57:38.662 INFO:tasks.workunit.client.1.smithi150.stdout:5/680: chown d1/d2e/da6/d24/cc5 129728 1 2023-12-05T09:57:38.662 INFO:tasks.workunit.client.1.smithi150.stdout:4/606: mknod d0/d3e/d5b/d6e/daa/cc0 0 2023-12-05T09:57:38.662 INFO:tasks.workunit.client.1.smithi150.stdout:1/658: dread d6/d47/d4c/dd9/ff [0,4194304] 0 2023-12-05T09:57:38.662 INFO:tasks.workunit.client.1.smithi150.stdout:1/659: read d6/d8/d54/d94/f96 [3763332,112225] 0 2023-12-05T09:57:38.662 INFO:tasks.workunit.client.0.smithi100.stdout:8/566: mkdir d0/d35/d63/d9c 0 2023-12-05T09:57:38.664 INFO:tasks.workunit.client.1.smithi150.stdout:2/702: link d0/d3/cb0 d0/d3/d5/d13/d15/d30/cf0 0 2023-12-05T09:57:38.664 INFO:tasks.workunit.client.1.smithi150.stdout:2/703: chown d0/d3/d5/d13/d15/d30/cbd 24 1 2023-12-05T09:57:38.664 INFO:tasks.workunit.client.1.smithi150.stdout:3/686: write d6/d9/d43/f72 [1514810,19670] 0 2023-12-05T09:57:38.665 INFO:tasks.workunit.client.0.smithi100.stdout:5/648: symlink d0/d4/d14/d35/d62/le1 0 2023-12-05T09:57:38.665 INFO:tasks.workunit.client.0.smithi100.stdout:5/649: stat d0/d1f/d53 0 2023-12-05T09:57:38.665 INFO:tasks.workunit.client.0.smithi100.stdout:5/650: creat d0/d16/d2b/d48/df/fe2 x:0 0 0 2023-12-05T09:57:38.669 INFO:tasks.workunit.client.1.smithi150.stdout:7/662: dwrite d2/db/d30/daf/dd3/d2b/f34 [4194304,4194304] 0 2023-12-05T09:57:38.669 INFO:tasks.workunit.client.1.smithi150.stdout:7/663: chown d2/d1b/d5b/f9c 2029862010 1 2023-12-05T09:57:38.669 INFO:tasks.workunit.client.1.smithi150.stdout:7/664: dread - d2/db/d30/d18/d1a/faa zero size 2023-12-05T09:57:38.669 INFO:tasks.workunit.client.1.smithi150.stdout:7/665: fsync d2/db/d30/d18/d1a/f68 0 2023-12-05T09:57:38.671 INFO:tasks.workunit.client.0.smithi100.stdout:7/611: dwrite d3/dc/d11/d13/de/f87 [0,4194304] 0 2023-12-05T09:57:38.671 INFO:tasks.workunit.client.0.smithi100.stdout:7/612: stat d3/dc/d11/d13/d1b/c69 0 2023-12-05T09:57:38.671 INFO:tasks.workunit.client.0.smithi100.stdout:2/771: dread d7/da/d1a/fb7 [0,4194304] 0 2023-12-05T09:57:38.671 INFO:tasks.workunit.client.0.smithi100.stdout:3/776: getdents d0/d2/de/db8/dee 0 2023-12-05T09:57:38.680 INFO:tasks.workunit.client.1.smithi150.stdout:9/615: mkdir d3/d1b/dca 0 2023-12-05T09:57:38.685 INFO:tasks.workunit.client.0.smithi100.stdout:4/619: creat de/d38/d8b/fc7 x:0 0 0 2023-12-05T09:57:38.685 INFO:tasks.workunit.client.0.smithi100.stdout:4/620: fsync de/d16/d23/f26 0 2023-12-05T09:57:38.685 INFO:tasks.workunit.client.1.smithi150.stdout:8/738: dwrite d0/d41/d49/d1b/d24/d34/da2/fc9 [0,4194304] 0 2023-12-05T09:57:38.691 INFO:tasks.workunit.client.0.smithi100.stdout:8/567: mkdir d0/d35/d64/d81/d9a/d9d 0 2023-12-05T09:57:38.692 INFO:tasks.workunit.client.1.smithi150.stdout:5/681: rename d1/d7f/d65/c61 to d1/d64/de7/cf2 0 2023-12-05T09:57:38.695 INFO:tasks.workunit.client.0.smithi100.stdout:2/772: dread d7/da/dc/f7a [0,4194304] 0 2023-12-05T09:57:38.696 INFO:tasks.workunit.client.1.smithi150.stdout:1/660: dread d6/d8/d59/f65 [0,4194304] 0 2023-12-05T09:57:38.696 INFO:tasks.workunit.client.1.smithi150.stdout:1/661: dread - d6/d8/d54/fdf zero size 2023-12-05T09:57:38.697 INFO:tasks.workunit.client.1.smithi150.stdout:4/607: unlink d0/d3e/d48/d4d/f64 0 2023-12-05T09:57:38.698 INFO:tasks.workunit.client.0.smithi100.stdout:5/651: mkdir d0/d16/d2b/de3 0 2023-12-05T09:57:38.699 INFO:tasks.workunit.client.0.smithi100.stdout:5/652: creat d0/d16/d2b/d48/df/fe4 x:0 0 0 2023-12-05T09:57:38.702 INFO:tasks.workunit.client.0.smithi100.stdout:9/668: rename d7/d1b/d22/d51/d32/cad to d7/d1b/d22/d51/d32/dc2/ce8 0 2023-12-05T09:57:38.703 INFO:tasks.workunit.client.1.smithi150.stdout:2/704: dwrite d0/f8e [0,4194304] 0 2023-12-05T09:57:38.703 INFO:tasks.workunit.client.1.smithi150.stdout:2/705: readlink d0/d3/d5/d13/d15/d30/le5 0 2023-12-05T09:57:38.703 INFO:tasks.workunit.client.1.smithi150.stdout:3/687: mkdir d6/d9/d3d/d56/d71/db6/dc1/d67/de1 0 2023-12-05T09:57:38.705 INFO:tasks.workunit.client.1.smithi150.stdout:7/666: rmdir d2/db/d2e 39 2023-12-05T09:57:38.705 INFO:tasks.workunit.client.1.smithi150.stdout:7/667: write d2/d72/d82/fb7 [275599,120251] 0 2023-12-05T09:57:38.708 INFO:tasks.workunit.client.0.smithi100.stdout:8/568: symlink d0/d12/d13/d16/d22/d72/l9e 0 2023-12-05T09:57:38.708 INFO:tasks.workunit.client.0.smithi100.stdout:2/773: getdents d7/da/d18/d1b/d2c/d3f/dc5 0 2023-12-05T09:57:38.709 INFO:tasks.workunit.client.1.smithi150.stdout:9/616: mkdir d3/d9/dc/d1f/d24/d75/d95/d9a/dcb 0 2023-12-05T09:57:38.711 INFO:tasks.workunit.client.1.smithi150.stdout:8/739: creat d0/d41/d49/d1b/d24/d34/d56/fe7 x:0 0 0 2023-12-05T09:57:38.712 INFO:tasks.workunit.client.1.smithi150.stdout:8/740: chown d0/d41/d49/ce2 42855722 1 2023-12-05T09:57:38.715 INFO:tasks.workunit.client.0.smithi100.stdout:1/620: rename db/d12/d1e/d26/d39/f7b to db/d12/d1e/d26/d39/da6/dc7/fca 0 2023-12-05T09:57:38.715 INFO:tasks.workunit.client.1.smithi150.stdout:6/612: unlink d2/d23/d3b/d64/d7a/d5d/d6b/c11 0 2023-12-05T09:57:38.716 INFO:tasks.workunit.client.0.smithi100.stdout:1/621: write db/d31/f51 [1087173,53868] 0 2023-12-05T09:57:38.716 INFO:tasks.workunit.client.0.smithi100.stdout:1/622: dread - db/d31/d3a/d4a/dad/d67/fa4 zero size 2023-12-05T09:57:38.718 INFO:tasks.workunit.client.0.smithi100.stdout:1/623: fsync db/d12/f1d 0 2023-12-05T09:57:38.718 INFO:tasks.workunit.client.0.smithi100.stdout:1/624: dread - db/d31/d73/fac zero size 2023-12-05T09:57:38.718 INFO:tasks.workunit.client.0.smithi100.stdout:1/625: chown db/d31/d3a/d4a/dad/c99 92 1 2023-12-05T09:57:38.718 INFO:tasks.workunit.client.0.smithi100.stdout:8/569: mkdir d0/d12/d13/d16/d22/d72/d9f 0 2023-12-05T09:57:38.721 INFO:tasks.workunit.client.0.smithi100.stdout:9/669: write d7/d1b/d22/d51/d32/f8c [1055696,15831] 0 2023-12-05T09:57:38.726 INFO:tasks.workunit.client.0.smithi100.stdout:5/653: rename d0/d27/fd7 to d0/d1f/da1/fe5 0 2023-12-05T09:57:38.726 INFO:tasks.workunit.client.0.smithi100.stdout:5/654: chown d0/d16/d2b/d75/f78 89932 1 2023-12-05T09:57:38.726 INFO:tasks.workunit.client.0.smithi100.stdout:5/655: dread - d0/d1f/d53/fac zero size 2023-12-05T09:57:38.726 INFO:tasks.workunit.client.0.smithi100.stdout:5/656: fdatasync d0/d4/f10 0 2023-12-05T09:57:38.726 INFO:tasks.workunit.client.0.smithi100.stdout:5/657: truncate d0/d1b/d4d/d8e/d96/dc1/fd1 504148 0 2023-12-05T09:57:38.727 INFO:tasks.workunit.client.0.smithi100.stdout:1/626: dread db/d31/d3a/d3b/f4b [0,4194304] 0 2023-12-05T09:57:38.727 INFO:tasks.workunit.client.0.smithi100.stdout:1/627: write db/d12/d1e/f34 [7700212,114366] 0 2023-12-05T09:57:38.727 INFO:tasks.workunit.client.0.smithi100.stdout:7/613: dwrite d3/dc/d11/d13/fc6 [0,4194304] 0 2023-12-05T09:57:38.729 INFO:tasks.workunit.client.0.smithi100.stdout:8/570: creat d0/d35/d64/fa0 x:0 0 0 2023-12-05T09:57:38.729 INFO:tasks.workunit.client.0.smithi100.stdout:8/571: readlink d0/d12/d13/d16/d42/l6b 0 2023-12-05T09:57:38.730 INFO:tasks.workunit.client.1.smithi150.stdout:9/617: write d3/d9/dc/f1d [23831,109323] 0 2023-12-05T09:57:38.736 INFO:tasks.workunit.client.1.smithi150.stdout:1/662: creat d6/d3c/dc2/dde/fe9 x:0 0 0 2023-12-05T09:57:38.736 INFO:tasks.workunit.client.1.smithi150.stdout:1/663: dread - d6/d3c/fd6 zero size 2023-12-05T09:57:38.736 INFO:tasks.workunit.client.1.smithi150.stdout:1/664: readlink d6/d8/d59/le5 0 2023-12-05T09:57:38.737 INFO:tasks.workunit.client.1.smithi150.stdout:1/665: write d6/d8/f11 [281996,130463] 0 2023-12-05T09:57:38.738 INFO:tasks.workunit.client.0.smithi100.stdout:5/658: creat d0/d1b/d4d/d8e/d96/dc1/dae/db9/dcb/fe6 x:0 0 0 2023-12-05T09:57:38.740 INFO:tasks.workunit.client.1.smithi150.stdout:4/608: creat d0/d3e/fc1 x:0 0 0 2023-12-05T09:57:38.743 INFO:tasks.workunit.client.0.smithi100.stdout:9/670: write d7/d1b/d22/d93/fb4 [1789424,120552] 0 2023-12-05T09:57:38.743 INFO:tasks.workunit.client.1.smithi150.stdout:2/706: rename d0/d3/d5/d22/d52/d5a/f7a to d0/da3/ff1 0 2023-12-05T09:57:38.747 INFO:tasks.workunit.client.1.smithi150.stdout:3/688: symlink d6/d9/d3d/d56/d79/le2 0 2023-12-05T09:57:38.749 INFO:tasks.workunit.client.0.smithi100.stdout:1/628: symlink db/d12/d61/lcb 0 2023-12-05T09:57:38.750 INFO:tasks.workunit.client.1.smithi150.stdout:5/682: rmdir d1/d7f/d65/d3b/d6b 39 2023-12-05T09:57:38.754 INFO:tasks.workunit.client.0.smithi100.stdout:0/610: sync 2023-12-05T09:57:38.754 INFO:tasks.workunit.client.0.smithi100.stdout:0/611: readlink da/d1b/d73/d82/l95 0 2023-12-05T09:57:38.754 INFO:tasks.workunit.client.0.smithi100.stdout:0/612: chown da/d22/d33/d35/d3a/c98 9 1 2023-12-05T09:57:38.754 INFO:tasks.workunit.client.0.smithi100.stdout:7/614: symlink d3/dc/d11/d13/d37/le5 0 2023-12-05T09:57:38.754 INFO:tasks.workunit.client.0.smithi100.stdout:2/774: rename d7/da/d18/d21/c9f to d7/da/d18/d21/dae/c103 0 2023-12-05T09:57:38.754 INFO:tasks.workunit.client.0.smithi100.stdout:2/775: stat d7/f66 0 2023-12-05T09:57:38.755 INFO:tasks.workunit.client.1.smithi150.stdout:9/618: mknod d3/d42/d62/d97/ccc 0 2023-12-05T09:57:38.755 INFO:tasks.workunit.client.0.smithi100.stdout:5/659: rename d0/ld0 to d0/le7 0 2023-12-05T09:57:38.758 INFO:tasks.workunit.client.1.smithi150.stdout:1/666: mkdir d6/d8/d54/dea 0 2023-12-05T09:57:38.759 INFO:tasks.workunit.client.1.smithi150.stdout:1/667: write d6/d38/d4a/f57 [4783595,58742] 0 2023-12-05T09:57:38.760 INFO:tasks.workunit.client.0.smithi100.stdout:1/629: getdents db/d31/d3a/d4a/dad 0 2023-12-05T09:57:38.760 INFO:tasks.workunit.client.0.smithi100.stdout:1/630: creat db/d12/d1e/d26/d30/d6e/fcc x:0 0 0 2023-12-05T09:57:38.760 INFO:tasks.workunit.client.0.smithi100.stdout:1/631: chown db/d31/d3a/d4a/dad/c99 1 1 2023-12-05T09:57:38.761 INFO:tasks.workunit.client.1.smithi150.stdout:2/707: mkdir d0/d3/d5/d3b/df2 0 2023-12-05T09:57:38.763 INFO:tasks.workunit.client.1.smithi150.stdout:8/741: dwrite d0/d41/f55 [0,4194304] 0 2023-12-05T09:57:38.763 INFO:tasks.workunit.client.1.smithi150.stdout:8/742: write d0/d41/d49/d1b/d24/d2e/fc2 [857829,103412] 0 2023-12-05T09:57:38.763 INFO:tasks.workunit.client.0.smithi100.stdout:0/613: creat da/d22/d33/d35/d3a/d8b/d8f/fb6 x:0 0 0 2023-12-05T09:57:38.765 INFO:tasks.workunit.client.1.smithi150.stdout:3/689: creat d6/d9/d8d/fe3 x:0 0 0 2023-12-05T09:57:38.765 INFO:tasks.workunit.client.1.smithi150.stdout:3/690: write d6/d9/d43/d47/f1a [1822828,2790] 0 2023-12-05T09:57:38.767 INFO:tasks.workunit.client.0.smithi100.stdout:8/572: rename d0/d12/f80 to d0/d35/d64/d81/fa1 0 2023-12-05T09:57:38.767 INFO:tasks.workunit.client.0.smithi100.stdout:8/573: fsync d0/d12/d13/d16/d22/f65 0 2023-12-05T09:57:38.767 INFO:tasks.workunit.client.1.smithi150.stdout:7/668: dwrite d2/db/d30/d13/f66 [4194304,4194304] 0 2023-12-05T09:57:38.768 INFO:tasks.workunit.client.1.smithi150.stdout:7/669: dread - d2/db/d30/d18/d1a/faa zero size 2023-12-05T09:57:38.771 INFO:tasks.workunit.client.1.smithi150.stdout:5/683: truncate d1/d7f/d65/f9f 2965150 0 2023-12-05T09:57:38.773 INFO:tasks.workunit.client.0.smithi100.stdout:5/660: creat d0/d16/d37/fe8 x:0 0 0 2023-12-05T09:57:38.778 INFO:tasks.workunit.client.1.smithi150.stdout:1/668: creat d6/d8/db/d1b/d79/dca/feb x:0 0 0 2023-12-05T09:57:38.778 INFO:tasks.workunit.client.1.smithi150.stdout:1/669: truncate d6/d47/d4c/d7c/fab 5005995 0 2023-12-05T09:57:38.779 INFO:tasks.workunit.client.0.smithi100.stdout:8/574: symlink d0/d35/d64/la2 0 2023-12-05T09:57:38.779 INFO:tasks.workunit.client.0.smithi100.stdout:0/614: dread da/f2c [0,4194304] 0 2023-12-05T09:57:38.780 INFO:tasks.workunit.client.1.smithi150.stdout:2/708: rename d0/d3/d27/dac/l6c to d0/d3/d5/d10/d3d/da1/daa/lf3 0 2023-12-05T09:57:38.782 INFO:tasks.workunit.client.0.smithi100.stdout:7/615: rename d3/fd3 to d3/dc/d11/d13/d37/fe6 0 2023-12-05T09:57:38.783 INFO:tasks.workunit.client.1.smithi150.stdout:9/619: write d3/d9/dc/d1f/d24/f78 [3670126,72747] 0 2023-12-05T09:57:38.783 INFO:tasks.workunit.client.0.smithi100.stdout:5/661: rmdir d0/d16/dc9 39 2023-12-05T09:57:38.785 INFO:tasks.workunit.client.0.smithi100.stdout:8/575: rmdir d0/d12/d13/d16/d22/d72 39 2023-12-05T09:57:38.788 INFO:tasks.workunit.client.1.smithi150.stdout:8/743: write d0/d8/f51 [2152694,52392] 0 2023-12-05T09:57:38.788 INFO:tasks.workunit.client.0.smithi100.stdout:0/615: unlink da/d22/d33/d7f/f81 0 2023-12-05T09:57:38.789 INFO:tasks.workunit.client.1.smithi150.stdout:7/670: dread d2/d4/ff [0,4194304] 0 2023-12-05T09:57:38.789 INFO:tasks.workunit.client.1.smithi150.stdout:5/684: creat d1/d3/d6/d26/d9a/ff3 x:0 0 0 2023-12-05T09:57:38.791 INFO:tasks.workunit.client.0.smithi100.stdout:5/662: link d0/d1b/d4d/d8e/d96/dc1/dae/fb2 d0/d1b/d4d/d6c/fe9 0 2023-12-05T09:57:38.791 INFO:tasks.workunit.client.1.smithi150.stdout:2/709: link d0/d3/d11/d1d/f29 d0/d3/d27/dea/ff4 0 2023-12-05T09:57:38.792 INFO:tasks.workunit.client.0.smithi100.stdout:8/576: mkdir d0/d12/d13/d16/da3 0 2023-12-05T09:57:38.793 INFO:tasks.workunit.client.0.smithi100.stdout:0/616: unlink da/d22/d33/d35/lac 0 2023-12-05T09:57:38.795 INFO:tasks.workunit.client.1.smithi150.stdout:4/609: dwrite d0/d3e/f8d [0,4194304] 0 2023-12-05T09:57:38.795 INFO:tasks.workunit.client.1.smithi150.stdout:4/610: readlink d0/d3e/d5b/d80/d44/da2/la7 0 2023-12-05T09:57:38.795 INFO:tasks.workunit.client.1.smithi150.stdout:4/611: write d0/d3e/f76 [873896,11031] 0 2023-12-05T09:57:38.795 INFO:tasks.workunit.client.1.smithi150.stdout:4/612: chown d0/le 21905 1 2023-12-05T09:57:38.795 INFO:tasks.workunit.client.1.smithi150.stdout:6/613: dwrite d2/d23/d3b/d64/f88 [0,4194304] 0 2023-12-05T09:57:38.796 INFO:tasks.workunit.client.0.smithi100.stdout:2/776: rename d7/da/d18/d1b/d2c/d3f/d46/f47 to d7/da/da7/dd6/f104 0 2023-12-05T09:57:38.798 INFO:tasks.workunit.client.1.smithi150.stdout:7/671: rename d2/d1b/d5b/d6a/fa6 to d2/db/d2e/d9a/fda 0 2023-12-05T09:57:38.799 INFO:tasks.workunit.client.0.smithi100.stdout:8/577: symlink d0/d35/d64/d81/la4 0 2023-12-05T09:57:38.799 INFO:tasks.workunit.client.0.smithi100.stdout:8/578: truncate d0/d12/f84 716041 0 2023-12-05T09:57:38.799 INFO:tasks.workunit.client.0.smithi100.stdout:8/579: chown d0/d12/d13/d16/d42/d43/f66 10302183 1 2023-12-05T09:57:38.800 INFO:tasks.workunit.client.0.smithi100.stdout:0/617: symlink da/d2a/lb7 0 2023-12-05T09:57:38.802 INFO:tasks.workunit.client.1.smithi150.stdout:2/710: unlink d0/d3/d21/f39 0 2023-12-05T09:57:38.802 INFO:tasks.workunit.client.1.smithi150.stdout:2/711: chown d0/d3/d11/d1d 3387 1 2023-12-05T09:57:38.802 INFO:tasks.workunit.client.1.smithi150.stdout:2/712: fdatasync d0/d3/fb2 0 2023-12-05T09:57:38.802 INFO:tasks.workunit.client.1.smithi150.stdout:2/713: fdatasync d0/da3/fbc 0 2023-12-05T09:57:38.804 INFO:tasks.workunit.client.0.smithi100.stdout:1/632: rename db/d31/d3a/f42 to db/d12/d1e/d26/d30/d52/fcd 0 2023-12-05T09:57:38.804 INFO:tasks.workunit.client.0.smithi100.stdout:8/580: dread d0/d12/d13/d16/d22/f55 [0,4194304] 0 2023-12-05T09:57:38.804 INFO:tasks.workunit.client.0.smithi100.stdout:1/633: creat db/d12/d1e/d26/d30/d52/d84/fce x:0 0 0 2023-12-05T09:57:38.804 INFO:tasks.workunit.client.0.smithi100.stdout:1/634: truncate db/d12/d1e/fc3 283422 0 2023-12-05T09:57:38.807 INFO:tasks.workunit.client.0.smithi100.stdout:2/777: mknod d7/da/d18/d1b/d2c/d3f/c105 0 2023-12-05T09:57:38.814 INFO:tasks.workunit.client.0.smithi100.stdout:7/616: rename d3/dc/d11/d13/de/d18/d3b/d40/l55 to d3/db3/le7 0 2023-12-05T09:57:38.816 INFO:tasks.workunit.client.1.smithi150.stdout:4/613: symlink d0/d3e/d48/d8a/lc2 0 2023-12-05T09:57:38.817 INFO:tasks.workunit.client.1.smithi150.stdout:4/614: chown d0/c22 325928202 1 2023-12-05T09:57:38.817 INFO:tasks.workunit.client.1.smithi150.stdout:4/615: write d0/d3e/d48/d4d/f67 [369088,65500] 0 2023-12-05T09:57:38.817 INFO:tasks.workunit.client.1.smithi150.stdout:4/616: readlink d0/d3e/d5b/d80/d44/l7a 0 2023-12-05T09:57:38.817 INFO:tasks.workunit.client.0.smithi100.stdout:7/617: creat d3/dc/d11/d13/de/d18/dcb/fe8 x:0 0 0 2023-12-05T09:57:38.818 INFO:tasks.workunit.client.0.smithi100.stdout:5/663: rename d0/d1f/d9f to d0/d1b/d4d/d8e/d96/dea 0 2023-12-05T09:57:38.820 INFO:tasks.workunit.client.0.smithi100.stdout:8/581: write d0/d35/f39 [3162435,63102] 0 2023-12-05T09:57:38.820 INFO:tasks.workunit.client.0.smithi100.stdout:8/582: truncate d0/fc 488470 0 2023-12-05T09:57:38.821 INFO:tasks.workunit.client.0.smithi100.stdout:8/583: fsync d0/d35/f93 0 2023-12-05T09:57:38.821 INFO:tasks.workunit.client.0.smithi100.stdout:2/778: dread d7/da/d1a/f73 [0,4194304] 0 2023-12-05T09:57:38.821 INFO:tasks.workunit.client.0.smithi100.stdout:8/584: chown d0/d12/d13/d16 0 1 2023-12-05T09:57:38.821 INFO:tasks.workunit.client.0.smithi100.stdout:1/635: rename db/d12/d1e/f34 to db/d12/d1e/d26/d39/da6/fcf 0 2023-12-05T09:57:38.821 INFO:tasks.workunit.client.0.smithi100.stdout:1/636: write db/d12/f75 [1641413,66024] 0 2023-12-05T09:57:38.825 INFO:tasks.workunit.client.0.smithi100.stdout:7/618: rename d3/dc/d11/d13/de/d18/d3b/d40/d4c/d7f/f88 to d3/dc/d11/d13/de/d2d/d42/fe9 0 2023-12-05T09:57:38.829 INFO:tasks.workunit.client.0.smithi100.stdout:1/637: mkdir db/d12/d1e/d26/d30/d52/dd0 0 2023-12-05T09:57:38.831 INFO:tasks.workunit.client.0.smithi100.stdout:8/585: dread d0/d35/f3b [0,4194304] 0 2023-12-05T09:57:38.831 INFO:tasks.workunit.client.0.smithi100.stdout:5/664: mknod d0/d1f/ceb 0 2023-12-05T09:57:38.832 INFO:tasks.workunit.client.0.smithi100.stdout:1/638: creat db/d31/fd1 x:0 0 0 2023-12-05T09:57:38.832 INFO:tasks.workunit.client.0.smithi100.stdout:1/639: chown db/d12/d1e/c4e 0 1 2023-12-05T09:57:38.832 INFO:tasks.workunit.client.0.smithi100.stdout:1/640: readlink db/d31/la8 0 2023-12-05T09:57:38.836 INFO:tasks.workunit.client.0.smithi100.stdout:8/586: symlink d0/la5 0 2023-12-05T09:57:38.837 INFO:tasks.workunit.client.1.smithi150.stdout:8/744: dread d0/d41/d49/d1b/d24/fbb [0,4194304] 0 2023-12-05T09:57:38.837 INFO:tasks.workunit.client.1.smithi150.stdout:8/745: chown d0/d41/d49/d1b/d24/d34/d56/c74 92663 1 2023-12-05T09:57:38.838 INFO:tasks.workunit.client.0.smithi100.stdout:5/665: creat d0/d16/d2b/de3/fec x:0 0 0 2023-12-05T09:57:38.838 INFO:tasks.workunit.client.1.smithi150.stdout:4/617: getdents d0/d3e/d6d/d4b/d8c 0 2023-12-05T09:57:38.839 INFO:tasks.workunit.client.1.smithi150.stdout:5/685: read d1/d7f/d65/d3b/d6b/f91 [751818,85984] 0 2023-12-05T09:57:38.840 INFO:tasks.workunit.client.1.smithi150.stdout:5/686: truncate d1/d7f/d65/d3b/d6b/fb0 823957 0 2023-12-05T09:57:38.841 INFO:tasks.workunit.client.0.smithi100.stdout:8/587: rename d0/d35/d63 to d0/d12/d13/d45/da6 0 2023-12-05T09:57:38.841 INFO:tasks.workunit.client.0.smithi100.stdout:8/588: write d0/f5a [987774,122887] 0 2023-12-05T09:57:38.844 INFO:tasks.workunit.client.1.smithi150.stdout:5/687: truncate d1/d64/f58 1242826 0 2023-12-05T09:57:38.844 INFO:tasks.workunit.client.0.smithi100.stdout:8/589: symlink d0/d12/d13/d45/da6/d76/d91/la7 0 2023-12-05T09:57:38.846 INFO:tasks.workunit.client.0.smithi100.stdout:8/590: symlink d0/d12/d13/d45/la8 0 2023-12-05T09:57:38.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:38 smithi150 ceph-mon[116142]: pgmap v35: 65 pgs: 65 active+clean; 2.4 GiB data, 8.7 GiB used, 528 GiB / 536 GiB avail; 168 MiB/s rd, 200 MiB/s wr, 304 op/s 2023-12-05T09:57:38.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:38 smithi150 ceph-mon[116142]: Reconfiguring node-exporter.smithi150 (dependencies changed)... 2023-12-05T09:57:38.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:38 smithi150 ceph-mon[116142]: Reconfiguring daemon node-exporter.smithi150 on smithi150 2023-12-05T09:57:38.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:38 smithi150 ceph-mon[116142]: from='client.24527 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:57:38.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:38 smithi150 ceph-mon[116142]: from='client.? 172.21.15.100:0/334917497' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-05T09:57:38.848 INFO:tasks.workunit.client.1.smithi150.stdout:5/688: link d1/d2e/da6/d24/l33 d1/lf4 0 2023-12-05T09:57:38.849 INFO:tasks.workunit.client.0.smithi100.stdout:8/591: mkdir d0/d12/d13/d16/d22/d72/da9 0 2023-12-05T09:57:38.852 INFO:tasks.workunit.client.1.smithi150.stdout:9/620: dread d3/d9/d26/d34/f72 [0,4194304] 0 2023-12-05T09:57:38.852 INFO:tasks.workunit.client.1.smithi150.stdout:9/621: chown d3/d42/d62/d97/ccc 627597152 1 2023-12-05T09:57:38.853 INFO:tasks.workunit.client.1.smithi150.stdout:5/689: link d1/d7f/d65/d3b/d6b/fb0 d1/d3/d6/d26/dca/dcd/ff5 0 2023-12-05T09:57:38.853 INFO:tasks.workunit.client.1.smithi150.stdout:5/690: chown d1/d7f/d65/d3b/d37/l9c 180941236 1 2023-12-05T09:57:38.856 INFO:tasks.workunit.client.0.smithi100.stdout:8/592: link d0/d35/f6d d0/d12/d13/d45/da6/d76/d91/faa 0 2023-12-05T09:57:38.856 INFO:tasks.workunit.client.0.smithi100.stdout:8/593: dread - d0/d35/d64/fa0 zero size 2023-12-05T09:57:38.856 INFO:tasks.workunit.client.0.smithi100.stdout:8/594: write d0/d35/f6d [331534,52744] 0 2023-12-05T09:57:38.859 INFO:tasks.workunit.client.0.smithi100.stdout:2/779: dread d7/da/d18/f62 [0,4194304] 0 2023-12-05T09:57:38.859 INFO:tasks.workunit.client.0.smithi100.stdout:2/780: fdatasync d7/da/da7/dd6/f104 0 2023-12-05T09:57:38.863 INFO:tasks.workunit.client.1.smithi150.stdout:8/746: write d0/f13 [1790152,57212] 0 2023-12-05T09:57:38.867 INFO:tasks.workunit.client.0.smithi100.stdout:7/619: write d3/dc/d11/d13/d37/fc0 [2546172,124585] 0 2023-12-05T09:57:38.867 INFO:tasks.workunit.client.0.smithi100.stdout:7/620: chown d3/dc/d11/d13/de/d18/d3b 779337 1 2023-12-05T09:57:38.867 INFO:tasks.workunit.client.0.smithi100.stdout:8/595: stat d0/d12/d52/l6a 0 2023-12-05T09:57:38.868 INFO:tasks.workunit.client.1.smithi150.stdout:1/670: dwrite d6/d8/d85/f9b [0,4194304] 0 2023-12-05T09:57:38.868 INFO:tasks.workunit.client.1.smithi150.stdout:7/672: dwrite d2/db/d30/d13/f37 [0,4194304] 0 2023-12-05T09:57:38.868 INFO:tasks.workunit.client.1.smithi150.stdout:5/691: truncate d1/d3/d6/d26/f3e 3614901 0 2023-12-05T09:57:38.870 INFO:tasks.workunit.client.1.smithi150.stdout:3/691: dwrite d6/f5d [0,4194304] 0 2023-12-05T09:57:38.874 INFO:tasks.workunit.client.1.smithi150.stdout:9/622: creat d3/d9/d9c/fcd x:0 0 0 2023-12-05T09:57:38.875 INFO:tasks.workunit.client.0.smithi100.stdout:2/781: mknod d7/da/d18/d1b/d2c/d3f/d46/dc8/dfe/c106 0 2023-12-05T09:57:38.876 INFO:tasks.workunit.client.0.smithi100.stdout:5/666: dread d0/d4/fd [4194304,4194304] 0 2023-12-05T09:57:38.883 INFO:tasks.workunit.client.1.smithi150.stdout:7/673: rename d2/d1b/d5b/d6a/l73 to d2/db/d17/d88/ldb 0 2023-12-05T09:57:38.883 INFO:tasks.workunit.client.1.smithi150.stdout:7/674: readlink d2/db/l56 0 2023-12-05T09:57:38.883 INFO:tasks.workunit.client.1.smithi150.stdout:7/675: write d2/d72/d82/fb7 [415357,57954] 0 2023-12-05T09:57:38.884 INFO:tasks.workunit.client.1.smithi150.stdout:7/676: creat d2/db/d17/d20/fdc x:0 0 0 2023-12-05T09:57:38.884 INFO:tasks.workunit.client.1.smithi150.stdout:7/677: chown d2/db/d30/d13/d4f/d5a/c83 4761022 1 2023-12-05T09:57:38.885 INFO:tasks.workunit.client.0.smithi100.stdout:2/782: rename d7/da/d13/d69/fc6 to d7/da/d18/d1b/d2c/d3f/d72/d9d/f107 0 2023-12-05T09:57:38.885 INFO:tasks.workunit.client.0.smithi100.stdout:2/783: truncate d7/da/d13/d4e/d87/fe5 679019 0 2023-12-05T09:57:38.887 INFO:tasks.workunit.client.1.smithi150.stdout:1/671: mknod d6/d47/d4c/d7c/d89/cec 0 2023-12-05T09:57:38.890 INFO:tasks.workunit.client.1.smithi150.stdout:1/672: creat d6/d38/fed x:0 0 0 2023-12-05T09:57:38.890 INFO:tasks.workunit.client.1.smithi150.stdout:8/747: dread d0/d41/d49/d1b/d24/d38/d62/fb9 [0,4194304] 0 2023-12-05T09:57:38.892 INFO:tasks.workunit.client.1.smithi150.stdout:5/692: mkdir d1/d3/d6/d26/df6 0 2023-12-05T09:57:38.893 INFO:tasks.workunit.client.1.smithi150.stdout:6/614: dwrite d2/d23/d2e/d93/f9e [0,4194304] 0 2023-12-05T09:57:38.893 INFO:tasks.workunit.client.0.smithi100.stdout:5/667: rename d0/d1f/d53/fac to d0/d1b/d4d/d8e/d96/fed 0 2023-12-05T09:57:38.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:38 smithi100 ceph-mon[107145]: pgmap v35: 65 pgs: 65 active+clean; 2.4 GiB data, 8.7 GiB used, 528 GiB / 536 GiB avail; 168 MiB/s rd, 200 MiB/s wr, 304 op/s 2023-12-05T09:57:38.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:38 smithi100 ceph-mon[107145]: Reconfiguring node-exporter.smithi150 (dependencies changed)... 2023-12-05T09:57:38.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:38 smithi100 ceph-mon[107145]: Reconfiguring daemon node-exporter.smithi150 on smithi150 2023-12-05T09:57:38.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:38 smithi100 ceph-mon[107145]: from='client.24527 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:57:38.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:38 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/334917497' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-05T09:57:38.897 INFO:tasks.workunit.client.1.smithi150.stdout:3/692: dread d6/d9/d3d/d56/f7d [0,4194304] 0 2023-12-05T09:57:38.897 INFO:tasks.workunit.client.0.smithi100.stdout:2/784: link d7/f66 d7/da/d13/d69/d6e/d71/f108 0 2023-12-05T09:57:38.898 INFO:tasks.workunit.client.1.smithi150.stdout:3/693: write d6/d25/dcf/fda [361322,123332] 0 2023-12-05T09:57:38.900 INFO:tasks.workunit.client.1.smithi150.stdout:9/623: rename d3/f40 to d3/d9/dc/fce 0 2023-12-05T09:57:38.900 INFO:tasks.workunit.client.1.smithi150.stdout:9/624: chown d3/d9/d58/f7e 264684 1 2023-12-05T09:57:38.900 INFO:tasks.workunit.client.1.smithi150.stdout:9/625: truncate d3/d1b/d79/fb2 939213 0 2023-12-05T09:57:38.901 INFO:tasks.workunit.client.1.smithi150.stdout:9/626: creat d3/d9/d58/fcf x:0 0 0 2023-12-05T09:57:38.901 INFO:tasks.workunit.client.1.smithi150.stdout:2/714: dwrite d0/d3/d5/d13/d15/d30/fda [0,4194304] 0 2023-12-05T09:57:38.901 INFO:tasks.workunit.client.0.smithi100.stdout:8/596: write d0/f31 [1160608,29401] 0 2023-12-05T09:57:38.906 INFO:tasks.workunit.client.0.smithi100.stdout:5/668: mkdir d0/d16/d2b/d48/df/d51/da8/dee 0 2023-12-05T09:57:38.910 INFO:tasks.workunit.client.0.smithi100.stdout:0/618: dwrite da/d2a/f56 [0,4194304] 0 2023-12-05T09:57:38.910 INFO:tasks.workunit.client.0.smithi100.stdout:0/619: truncate da/f37 1914625 0 2023-12-05T09:57:38.910 INFO:tasks.workunit.client.0.smithi100.stdout:0/620: read da/f2c [2686996,113876] 0 2023-12-05T09:57:38.915 INFO:tasks.workunit.client.1.smithi150.stdout:4/618: dwrite d0/d3e/d6d/f2e [0,4194304] 0 2023-12-05T09:57:38.917 INFO:tasks.workunit.client.1.smithi150.stdout:7/678: creat d2/d9d/fdd x:0 0 0 2023-12-05T09:57:38.917 INFO:tasks.workunit.client.1.smithi150.stdout:7/679: chown d2/d1b/d31/f8d 16 1 2023-12-05T09:57:38.917 INFO:tasks.workunit.client.1.smithi150.stdout:7/680: write d2/db/d17/d20/fdc [472513,90136] 0 2023-12-05T09:57:38.918 INFO:tasks.workunit.client.1.smithi150.stdout:5/693: dread d1/d3/d6/f10 [0,4194304] 0 2023-12-05T09:57:38.918 INFO:tasks.workunit.client.1.smithi150.stdout:1/673: unlink d6/d38/fa3 0 2023-12-05T09:57:38.924 INFO:tasks.workunit.client.0.smithi100.stdout:8/597: link d0/d12/d13/d45/l77 d0/d12/d13/d45/da6/d76/d91/lab 0 2023-12-05T09:57:38.928 INFO:tasks.workunit.client.1.smithi150.stdout:8/748: symlink d0/d41/d49/d1b/d24/d5b/le8 0 2023-12-05T09:57:38.928 INFO:tasks.workunit.client.1.smithi150.stdout:2/715: dread d0/d3/d5/d13/d15/d30/fda [0,4194304] 0 2023-12-05T09:57:38.930 INFO:tasks.workunit.client.1.smithi150.stdout:6/615: write d2/f34 [2447589,124046] 0 2023-12-05T09:57:38.938 INFO:tasks.workunit.client.1.smithi150.stdout:4/619: rename d0/f91 to d0/d3e/d6d/fc3 0 2023-12-05T09:57:38.938 INFO:tasks.workunit.client.1.smithi150.stdout:4/620: chown d0/d3e/l96 236 1 2023-12-05T09:57:38.939 INFO:tasks.workunit.client.1.smithi150.stdout:4/621: fdatasync d0/d3e/d5b/d80/d44/f46 0 2023-12-05T09:57:38.941 INFO:tasks.workunit.client.0.smithi100.stdout:8/598: dread d0/d12/f48 [0,4194304] 0 2023-12-05T09:57:38.941 INFO:tasks.workunit.client.0.smithi100.stdout:8/599: read - d0/d35/d64/f7c zero size 2023-12-05T09:57:38.944 INFO:tasks.workunit.client.1.smithi150.stdout:0/701: sync 2023-12-05T09:57:38.944 INFO:tasks.workunit.client.1.smithi150.stdout:9/627: write d3/d9/dc/d1f/d24/f9d [2592790,123801] 0 2023-12-05T09:57:38.944 INFO:tasks.workunit.client.1.smithi150.stdout:7/681: mknod d2/db/d30/d13/cde 0 2023-12-05T09:57:38.944 INFO:tasks.workunit.client.1.smithi150.stdout:7/682: fdatasync d2/db/d30/d53/fcc 0 2023-12-05T09:57:38.944 INFO:tasks.workunit.client.1.smithi150.stdout:1/674: rmdir d6 39 2023-12-05T09:57:38.945 INFO:tasks.workunit.client.0.smithi100.stdout:7/621: dwrite d3/dc/d11/d13/de/d2d/d47/fca [0,4194304] 0 2023-12-05T09:57:38.945 INFO:tasks.workunit.client.0.smithi100.stdout:1/641: dwrite db/d12/f75 [0,4194304] 0 2023-12-05T09:57:38.946 INFO:tasks.workunit.client.0.smithi100.stdout:1/642: chown db/d12/d1e/lb0 1445983 1 2023-12-05T09:57:38.948 INFO:tasks.workunit.client.0.smithi100.stdout:2/785: dread d7/da/d1a/fdb [0,4194304] 0 2023-12-05T09:57:38.951 INFO:tasks.workunit.client.1.smithi150.stdout:8/749: mknod d0/d41/d49/d1b/d24/d34/da2/dd7/ce9 0 2023-12-05T09:57:38.960 INFO:tasks.workunit.client.1.smithi150.stdout:4/622: dread d0/d3e/d48/d4d/f86 [0,4194304] 0 2023-12-05T09:57:38.960 INFO:tasks.workunit.client.1.smithi150.stdout:4/623: write d0/d3e/d6d/f39 [1004185,127700] 0 2023-12-05T09:57:38.960 INFO:tasks.workunit.client.1.smithi150.stdout:2/716: symlink d0/d3/d5/d22/d52/d5a/lf5 0 2023-12-05T09:57:38.962 INFO:tasks.workunit.client.0.smithi100.stdout:5/669: creat d0/d1b/d4d/d8e/fef x:0 0 0 2023-12-05T09:57:38.964 INFO:tasks.workunit.client.0.smithi100.stdout:8/600: dread d0/d35/f70 [0,4194304] 0 2023-12-05T09:57:38.971 INFO:tasks.workunit.client.0.smithi100.stdout:7/622: mknod d3/dc/d11/d13/da8/cea 0 2023-12-05T09:57:38.971 INFO:tasks.workunit.client.0.smithi100.stdout:7/623: readlink d3/dc/d11/d13/de/d2d/d47/l6e 0 2023-12-05T09:57:38.971 INFO:tasks.workunit.client.0.smithi100.stdout:2/786: dread d7/da/d18/d21/d4d/d81/f8f [0,4194304] 0 2023-12-05T09:57:38.972 INFO:tasks.workunit.client.1.smithi150.stdout:8/750: read d0/d41/d49/d1b/d24/d38/d62/f65 [3521938,125606] 0 2023-12-05T09:57:38.972 INFO:tasks.workunit.client.0.smithi100.stdout:0/621: dwrite da/d2a/f3f [0,4194304] 0 2023-12-05T09:57:38.973 INFO:tasks.workunit.client.1.smithi150.stdout:5/694: dwrite d1/d2e/da6/d24/fcf [0,4194304] 0 2023-12-05T09:57:38.973 INFO:tasks.workunit.client.0.smithi100.stdout:1/643: mkdir db/d12/d1e/d72/dc4/dd2 0 2023-12-05T09:57:38.976 INFO:tasks.workunit.client.0.smithi100.stdout:5/670: creat d0/d27/dc0/ff0 x:0 0 0 2023-12-05T09:57:38.976 INFO:tasks.workunit.client.0.smithi100.stdout:5/671: write d0/d1b/d4d/d8e/d96/fed [739908,14569] 0 2023-12-05T09:57:38.976 INFO:tasks.workunit.client.1.smithi150.stdout:2/717: dread d0/d3/d21/d4d/deb/fb5 [0,4194304] 0 2023-12-05T09:57:38.978 INFO:tasks.workunit.client.1.smithi150.stdout:6/616: rename d2/d23/d2e/d44/l78 to d2/d23/d3b/d46/ld1 0 2023-12-05T09:57:38.978 INFO:tasks.workunit.client.1.smithi150.stdout:6/617: chown d2/d23/d2e/f43 279 1 2023-12-05T09:57:38.980 INFO:tasks.workunit.client.0.smithi100.stdout:8/601: rename d0/f2 to d0/d12/d13/d16/d42/fac 0 2023-12-05T09:57:38.980 INFO:tasks.workunit.client.0.smithi100.stdout:1/644: dread db/d12/f14 [0,4194304] 0 2023-12-05T09:57:38.980 INFO:tasks.workunit.client.0.smithi100.stdout:8/602: stat d0/c5e 0 2023-12-05T09:57:38.980 INFO:tasks.workunit.client.0.smithi100.stdout:8/603: truncate d0/d12/d13/f90 848486 0 2023-12-05T09:57:38.982 INFO:tasks.workunit.client.1.smithi150.stdout:0/702: mkdir d5/d11/d71/d99/d9c/d96/dd5/d7f/db4/dfb 0 2023-12-05T09:57:38.983 INFO:tasks.workunit.client.0.smithi100.stdout:7/624: creat d3/dc/d11/d13/de/d18/d3b/de2/feb x:0 0 0 2023-12-05T09:57:38.984 INFO:tasks.workunit.client.0.smithi100.stdout:7/625: stat d3/dc/d11/d13/de/c17 0 2023-12-05T09:57:38.984 INFO:tasks.workunit.client.0.smithi100.stdout:0/622: dread da/d22/d33/f75 [0,4194304] 0 2023-12-05T09:57:38.984 INFO:tasks.workunit.client.0.smithi100.stdout:0/623: truncate da/d2a/d45/f97 507088 0 2023-12-05T09:57:38.985 INFO:tasks.workunit.client.1.smithi150.stdout:9/628: mkdir d3/d9/dc/d1f/d24/d75/d95/dd0 0 2023-12-05T09:57:38.985 INFO:tasks.workunit.client.1.smithi150.stdout:9/629: write d3/d1b/d46/f50 [1301720,3022] 0 2023-12-05T09:57:38.988 INFO:tasks.workunit.client.0.smithi100.stdout:2/787: link d7/da/d18/d1b/d2c/d3f/d46/f76 d7/da/d13/d69/f109 0 2023-12-05T09:57:38.988 INFO:tasks.workunit.client.0.smithi100.stdout:2/788: write d7/da/d18/d21/d4d/f83 [83307,96861] 0 2023-12-05T09:57:38.994 INFO:tasks.workunit.client.1.smithi150.stdout:7/683: symlink d2/db/d30/d13/d4f/d5a/ldf 0 2023-12-05T09:57:38.994 INFO:tasks.workunit.client.1.smithi150.stdout:4/624: rmdir d0/d3e/d5b/d80/da1/db2 39 2023-12-05T09:57:38.994 INFO:tasks.workunit.client.1.smithi150.stdout:4/625: dread - d0/d3e/d6d/fc3 zero size 2023-12-05T09:57:38.998 INFO:tasks.workunit.client.1.smithi150.stdout:8/751: mkdir d0/d41/d49/d1b/dea 0 2023-12-05T09:57:39.003 INFO:tasks.workunit.client.0.smithi100.stdout:5/672: symlink d0/d1f/d25/lf1 0 2023-12-05T09:57:39.003 INFO:tasks.workunit.client.0.smithi100.stdout:7/626: dread d3/dc/d11/d13/de/f87 [0,4194304] 0 2023-12-05T09:57:39.005 INFO:tasks.workunit.client.1.smithi150.stdout:2/718: creat d0/d3/d21/d4d/deb/ff6 x:0 0 0 2023-12-05T09:57:39.006 INFO:tasks.workunit.client.0.smithi100.stdout:1/645: rmdir db/d12/d1e/d26/d30 39 2023-12-05T09:57:39.009 INFO:tasks.workunit.client.0.smithi100.stdout:8/604: creat d0/d12/d13/d16/d42/d43/fad x:0 0 0 2023-12-05T09:57:39.009 INFO:tasks.workunit.client.0.smithi100.stdout:8/605: chown d0/fc 216770 1 2023-12-05T09:57:39.010 INFO:tasks.workunit.client.0.smithi100.stdout:8/606: chown d0/d12/d52/f7e 239611640 1 2023-12-05T09:57:39.014 INFO:tasks.workunit.client.0.smithi100.stdout:2/789: stat d7/da/d18/d1b/l2f 0 2023-12-05T09:57:39.015 INFO:tasks.workunit.client.0.smithi100.stdout:0/624: truncate da/f5a 2336931 0 2023-12-05T09:57:39.016 INFO:tasks.workunit.client.1.smithi150.stdout:9/630: rmdir d3/d9/d67 39 2023-12-05T09:57:39.019 INFO:tasks.workunit.client.1.smithi150.stdout:7/684: creat d2/db/d30/daf/dd3/d2b/fe0 x:0 0 0 2023-12-05T09:57:39.023 INFO:tasks.workunit.client.1.smithi150.stdout:0/703: dwrite d5/d11/d71/d74/fd0 [0,4194304] 0 2023-12-05T09:57:39.023 INFO:tasks.workunit.client.0.smithi100.stdout:4/621: sync 2023-12-05T09:57:39.023 INFO:tasks.workunit.client.0.smithi100.stdout:4/622: fdatasync de/f12 0 2023-12-05T09:57:39.023 INFO:tasks.workunit.client.0.smithi100.stdout:4/623: read - de/d16/d23/d60/d88/f8f zero size 2023-12-05T09:57:39.023 INFO:tasks.workunit.client.0.smithi100.stdout:3/777: sync 2023-12-05T09:57:39.023 INFO:tasks.workunit.client.0.smithi100.stdout:3/778: stat d0/d2/de/d12/ff1 0 2023-12-05T09:57:39.024 INFO:tasks.workunit.client.0.smithi100.stdout:7/627: truncate d3/dc/d11/f25 1620271 0 2023-12-05T09:57:39.026 INFO:tasks.workunit.client.1.smithi150.stdout:4/626: creat d0/d3e/d5b/fc4 x:0 0 0 2023-12-05T09:57:39.026 INFO:tasks.workunit.client.1.smithi150.stdout:4/627: write d0/d3e/d5b/d80/d44/f98 [409090,109997] 0 2023-12-05T09:57:39.031 INFO:tasks.workunit.client.0.smithi100.stdout:1/646: rename db/d12/d1e/d26/d39/da6 to db/d12/d1e/dd3 0 2023-12-05T09:57:39.037 INFO:tasks.workunit.client.1.smithi150.stdout:2/719: mknod d0/d3/d21/d4d/deb/cf7 0 2023-12-05T09:57:39.038 INFO:tasks.workunit.client.0.smithi100.stdout:2/790: fdatasync d7/da/d18/fce 0 2023-12-05T09:57:39.044 INFO:tasks.workunit.client.1.smithi150.stdout:1/675: rename d6/c31 to d6/d8/d54/d94/cee 0 2023-12-05T09:57:39.044 INFO:tasks.workunit.client.1.smithi150.stdout:1/676: write d6/d3c/f49 [3746892,50649] 0 2023-12-05T09:57:39.046 INFO:tasks.workunit.client.0.smithi100.stdout:3/779: read d0/d10/f2a [3511217,62259] 0 2023-12-05T09:57:39.047 INFO:tasks.workunit.client.0.smithi100.stdout:4/624: getdents de/d16/d23/d33/d3d/d44/d4e/d80 0 2023-12-05T09:57:39.047 INFO:tasks.workunit.client.0.smithi100.stdout:4/625: write de/d16/d23/d36/f6a [1037197,19632] 0 2023-12-05T09:57:39.052 INFO:tasks.workunit.client.0.smithi100.stdout:7/628: creat d3/dc/d11/d13/d37/d97/fec x:0 0 0 2023-12-05T09:57:39.053 INFO:tasks.workunit.client.0.smithi100.stdout:7/629: read - d3/dc/d11/d13/de/d18/dcb/fe8 zero size 2023-12-05T09:57:39.054 INFO:tasks.workunit.client.1.smithi150.stdout:8/752: dwrite d0/d41/d49/d1b/d24/d34/d56/f8f [0,4194304] 0 2023-12-05T09:57:39.054 INFO:tasks.workunit.client.1.smithi150.stdout:8/753: chown d0/d41/d49/d1b/d24/d38/d62/fb9 73828 1 2023-12-05T09:57:39.056 INFO:tasks.workunit.client.0.smithi100.stdout:1/647: truncate db/d31/d3a/d3b/f4b 348036 0 2023-12-05T09:57:39.056 INFO:tasks.workunit.client.0.smithi100.stdout:1/648: chown db/d12/d1e/dd3/dc7/fca 0 1 2023-12-05T09:57:39.056 INFO:tasks.workunit.client.0.smithi100.stdout:1/649: write db/d31/d3a/f9a [527574,124618] 0 2023-12-05T09:57:39.057 INFO:tasks.workunit.client.1.smithi150.stdout:6/618: rmdir d2/d23/d3b 39 2023-12-05T09:57:39.058 INFO:tasks.workunit.client.0.smithi100.stdout:4/626: unlink de/f13 0 2023-12-05T09:57:39.059 INFO:tasks.workunit.client.1.smithi150.stdout:5/695: dwrite d1/f74 [0,4194304] 0 2023-12-05T09:57:39.060 INFO:tasks.workunit.client.0.smithi100.stdout:3/780: write d0/d4/d3a/d45/fa6 [2682230,93447] 0 2023-12-05T09:57:39.060 INFO:tasks.workunit.client.1.smithi150.stdout:7/685: symlink d2/d9d/da0/le1 0 2023-12-05T09:57:39.060 INFO:tasks.workunit.client.1.smithi150.stdout:7/686: dread - d2/db/d17/d38/d85/fc5 zero size 2023-12-05T09:57:39.061 INFO:tasks.workunit.client.0.smithi100.stdout:8/607: dwrite d0/d35/d64/fa0 [0,4194304] 0 2023-12-05T09:57:39.061 INFO:tasks.workunit.client.0.smithi100.stdout:8/608: chown d0/d12/d13/d45 10749 1 2023-12-05T09:57:39.061 INFO:tasks.workunit.client.0.smithi100.stdout:8/609: chown d0/f9 591 1 2023-12-05T09:57:39.061 INFO:tasks.workunit.client.0.smithi100.stdout:7/630: mknod d3/dc/d11/d13/de/d18/d3b/d40/d46/d9e/ced 0 2023-12-05T09:57:39.063 INFO:tasks.workunit.client.0.smithi100.stdout:9/671: sync 2023-12-05T09:57:39.063 INFO:tasks.workunit.client.0.smithi100.stdout:5/673: dwrite d0/d1b/d4d/d8e/d96/dc1/fce [0,4194304] 0 2023-12-05T09:57:39.063 INFO:tasks.workunit.client.0.smithi100.stdout:5/674: fdatasync d0/d1b/d4d/f87 0 2023-12-05T09:57:39.063 INFO:tasks.workunit.client.0.smithi100.stdout:5/675: write d0/d27/dc0/ff0 [937483,2972] 0 2023-12-05T09:57:39.063 INFO:tasks.workunit.client.0.smithi100.stdout:9/672: write d7/d1b/d22/d2a/f79 [4459895,91733] 0 2023-12-05T09:57:39.063 INFO:tasks.workunit.client.0.smithi100.stdout:9/673: readlink d7/d60/l95 0 2023-12-05T09:57:39.063 INFO:tasks.workunit.client.0.smithi100.stdout:9/674: chown d7/d35 213 1 2023-12-05T09:57:39.064 INFO:tasks.workunit.client.1.smithi150.stdout:0/704: creat d5/d11/d71/d99/d9c/d3b/de0/ffc x:0 0 0 2023-12-05T09:57:39.065 INFO:tasks.workunit.client.0.smithi100.stdout:1/650: getdents db/d12/d1e/d26/d30/d52 0 2023-12-05T09:57:39.075 INFO:tasks.workunit.client.1.smithi150.stdout:4/628: dwrite d0/d3e/d5b/d80/da1/fbf [0,4194304] 0 2023-12-05T09:57:39.077 INFO:tasks.workunit.client.1.smithi150.stdout:1/677: dread d6/d8/db/f19 [0,4194304] 0 2023-12-05T09:57:39.079 INFO:tasks.workunit.client.0.smithi100.stdout:8/610: mknod d0/d12/d13/d16/d42/cae 0 2023-12-05T09:57:39.080 INFO:tasks.workunit.client.0.smithi100.stdout:8/611: truncate d0/d12/d13/d16/d42/d43/fad 627347 0 2023-12-05T09:57:39.080 INFO:tasks.workunit.client.0.smithi100.stdout:8/612: chown d0/d35/d64/d81 2 1 2023-12-05T09:57:39.082 INFO:tasks.workunit.client.1.smithi150.stdout:8/754: mkdir d0/d41/d49/d1b/d24/d38/dad/deb 0 2023-12-05T09:57:39.083 INFO:tasks.workunit.client.1.smithi150.stdout:1/678: dread d6/d8/db/d1b/d79/f86 [0,4194304] 0 2023-12-05T09:57:39.083 INFO:tasks.workunit.client.1.smithi150.stdout:1/679: creat d6/d3c/dc2/fef x:0 0 0 2023-12-05T09:57:39.084 INFO:tasks.workunit.client.1.smithi150.stdout:1/680: creat d6/d8/d54/ff0 x:0 0 0 2023-12-05T09:57:39.085 INFO:tasks.workunit.client.0.smithi100.stdout:7/631: rename d3/c1c to d3/dc/d11/d13/d37/d97/dc1/dcd/cee 0 2023-12-05T09:57:39.088 INFO:tasks.workunit.client.1.smithi150.stdout:6/619: creat d2/d23/d2e/d93/fd2 x:0 0 0 2023-12-05T09:57:39.096 INFO:tasks.workunit.client.1.smithi150.stdout:5/696: creat d1/d2e/ff7 x:0 0 0 2023-12-05T09:57:39.098 INFO:tasks.workunit.client.0.smithi100.stdout:9/675: creat d7/d20/d68/fe9 x:0 0 0 2023-12-05T09:57:39.105 INFO:tasks.workunit.client.0.smithi100.stdout:3/781: getdents d0/d2/de 0 2023-12-05T09:57:39.106 INFO:tasks.workunit.client.1.smithi150.stdout:7/687: mkdir d2/db/d30/d13/d4f/d5a/de2 0 2023-12-05T09:57:39.107 INFO:tasks.workunit.client.0.smithi100.stdout:2/791: dwrite d7/da/d18/fab [0,4194304] 0 2023-12-05T09:57:39.107 INFO:tasks.workunit.client.1.smithi150.stdout:0/705: creat d5/dbd/ffd x:0 0 0 2023-12-05T09:57:39.114 INFO:tasks.workunit.client.0.smithi100.stdout:1/651: rename db/d31/d3a/d4a/l93 to db/d12/d1e/d72/dc4/dd2/ld4 0 2023-12-05T09:57:39.114 INFO:tasks.workunit.client.0.smithi100.stdout:1/652: fdatasync db/d12/d1e/dd3/fb6 0 2023-12-05T09:57:39.115 INFO:tasks.workunit.client.1.smithi150.stdout:7/688: dread d2/d4/f42 [0,4194304] 0 2023-12-05T09:57:39.127 INFO:tasks.workunit.client.1.smithi150.stdout:4/629: unlink d0/d3e/d5b/d80/d44/l5c 0 2023-12-05T09:57:39.127 INFO:tasks.workunit.client.1.smithi150.stdout:3/694: sync 2023-12-05T09:57:39.128 INFO:tasks.workunit.client.0.smithi100.stdout:8/613: write d0/fc [1426176,31675] 0 2023-12-05T09:57:39.130 INFO:tasks.workunit.client.0.smithi100.stdout:5/676: dwrite d0/d1f/f97 [4194304,4194304] 0 2023-12-05T09:57:39.130 INFO:tasks.workunit.client.0.smithi100.stdout:9/676: read d7/d1b/d22/d2a/d56/daf/fd0 [2135638,119501] 0 2023-12-05T09:57:39.135 INFO:tasks.workunit.client.1.smithi150.stdout:8/755: unlink d0/d41/d49/d1b/d24/d2e/d4d/d83/la7 0 2023-12-05T09:57:39.138 INFO:tasks.workunit.client.0.smithi100.stdout:7/632: rename d3/dc/d11/d13/d1b/f5e to d3/dc/d11/d13/d37/fef 0 2023-12-05T09:57:39.138 INFO:tasks.workunit.client.0.smithi100.stdout:7/633: stat d3/dc/d11/d13/de/d18/f9b 0 2023-12-05T09:57:39.139 INFO:tasks.workunit.client.1.smithi150.stdout:1/681: creat d6/d38/da1/ff1 x:0 0 0 2023-12-05T09:57:39.139 INFO:tasks.workunit.client.1.smithi150.stdout:1/682: fsync d6/d47/d4c/dd9/f77 0 2023-12-05T09:57:39.140 INFO:tasks.workunit.client.0.smithi100.stdout:2/792: dread d7/da/d18/d1b/d2c/d3f/fd1 [0,4194304] 0 2023-12-05T09:57:39.141 INFO:tasks.workunit.client.1.smithi150.stdout:6/620: link d2/d23/d3b/d64/d7a/d5d/d6b/c1b d2/d23/cd3 0 2023-12-05T09:57:39.143 INFO:tasks.workunit.client.1.smithi150.stdout:5/697: stat d1/d3/d6/d26/f3e 0 2023-12-05T09:57:39.146 INFO:tasks.workunit.client.1.smithi150.stdout:0/706: mkdir d5/d11/d71/d99/d9c/d96/dd5/d7f/db4/dfe 0 2023-12-05T09:57:39.146 INFO:tasks.workunit.client.1.smithi150.stdout:0/707: read - d5/d11/d71/d99/fb2 zero size 2023-12-05T09:57:39.146 INFO:tasks.workunit.client.1.smithi150.stdout:0/708: stat d5/d11/d16/lee 0 2023-12-05T09:57:39.147 INFO:tasks.workunit.client.1.smithi150.stdout:0/709: dread - d5/d11/d71/d99/d9c/d96/dd5/d7f/fec zero size 2023-12-05T09:57:39.148 INFO:tasks.workunit.client.1.smithi150.stdout:7/689: symlink d2/db/d17/le3 0 2023-12-05T09:57:39.148 INFO:tasks.workunit.client.0.smithi100.stdout:0/625: truncate da/f5a 511980 0 2023-12-05T09:57:39.148 INFO:tasks.workunit.client.0.smithi100.stdout:0/626: chown da/d1b/d36/d9f/l86 28641524 1 2023-12-05T09:57:39.148 INFO:tasks.workunit.client.0.smithi100.stdout:0/627: dread - da/d22/d33/d7f/fb5 zero size 2023-12-05T09:57:39.149 INFO:tasks.workunit.client.0.smithi100.stdout:5/677: mknod d0/d27/dc0/cf2 0 2023-12-05T09:57:39.149 INFO:tasks.workunit.client.0.smithi100.stdout:4/627: dwrite f1 [4194304,4194304] 0 2023-12-05T09:57:39.150 INFO:tasks.workunit.client.1.smithi150.stdout:1/683: link d6/d8/d59/l7b d6/d8/db/d1b/d79/dca/lf2 0 2023-12-05T09:57:39.154 INFO:tasks.workunit.client.0.smithi100.stdout:2/793: symlink d7/da/da7/dd2/l10a 0 2023-12-05T09:57:39.159 INFO:tasks.workunit.client.0.smithi100.stdout:0/628: symlink da/d22/d33/lb8 0 2023-12-05T09:57:39.161 INFO:tasks.workunit.client.1.smithi150.stdout:5/698: symlink d1/d2e/da6/d24/d59/lf8 0 2023-12-05T09:57:39.167 INFO:tasks.workunit.client.1.smithi150.stdout:7/690: symlink d2/le4 0 2023-12-05T09:57:39.167 INFO:tasks.workunit.client.1.smithi150.stdout:7/691: creat d2/d1b/fe5 x:0 0 0 2023-12-05T09:57:39.167 INFO:tasks.workunit.client.1.smithi150.stdout:7/692: fsync d2/d4/f23 0 2023-12-05T09:57:39.170 INFO:tasks.workunit.client.0.smithi100.stdout:5/678: creat d0/d1f/ff3 x:0 0 0 2023-12-05T09:57:39.170 INFO:tasks.workunit.client.0.smithi100.stdout:5/679: chown d0/d1f/da1/laa 25 1 2023-12-05T09:57:39.170 INFO:tasks.workunit.client.1.smithi150.stdout:4/630: read d0/d3e/d5b/d80/f7c [4026413,75236] 0 2023-12-05T09:57:39.173 INFO:tasks.workunit.client.1.smithi150.stdout:1/684: creat d6/d47/dcf/ff3 x:0 0 0 2023-12-05T09:57:39.173 INFO:tasks.workunit.client.1.smithi150.stdout:1/685: fdatasync d6/d8/db/f6e 0 2023-12-05T09:57:39.175 INFO:tasks.workunit.client.0.smithi100.stdout:7/634: dread d3/dc/d11/d13/de/d18/d3b/d40/d4c/d7f/f98 [0,4194304] 0 2023-12-05T09:57:39.176 INFO:tasks.workunit.client.0.smithi100.stdout:4/628: read - de/f4a zero size 2023-12-05T09:57:39.178 INFO:tasks.workunit.client.1.smithi150.stdout:0/710: rmdir d5/d11/d71/d99/d9c/d46/d80 39 2023-12-05T09:57:39.179 INFO:tasks.workunit.client.0.smithi100.stdout:2/794: mkdir d7/da/d18/d1b/d2c/d3f/d10b 0 2023-12-05T09:57:39.181 INFO:tasks.workunit.client.0.smithi100.stdout:3/782: dwrite d0/d10/d39/f80 [0,4194304] 0 2023-12-05T09:57:39.181 INFO:tasks.workunit.client.0.smithi100.stdout:0/629: creat da/d60/fb9 x:0 0 0 2023-12-05T09:57:39.181 INFO:tasks.workunit.client.0.smithi100.stdout:0/630: getdents da/d1b/d73/db3 0 2023-12-05T09:57:39.187 INFO:tasks.workunit.client.1.smithi150.stdout:4/631: link d0/d3e/d6d/f34 d0/d3e/d5b/d80/d44/da2/da4/fc5 0 2023-12-05T09:57:39.188 INFO:tasks.workunit.client.1.smithi150.stdout:4/632: creat d0/d3e/d5b/fc6 x:0 0 0 2023-12-05T09:57:39.188 INFO:tasks.workunit.client.1.smithi150.stdout:4/633: write d0/d3e/d48/f4e [3091860,82591] 0 2023-12-05T09:57:39.189 INFO:tasks.workunit.client.0.smithi100.stdout:1/653: dwrite db/d31/f51 [0,4194304] 0 2023-12-05T09:57:39.189 INFO:tasks.workunit.client.0.smithi100.stdout:1/654: chown db/d31/d3a/d4a/dad/fbf 29 1 2023-12-05T09:57:39.189 INFO:tasks.workunit.client.0.smithi100.stdout:1/655: truncate db/d12/f8f 295480 0 2023-12-05T09:57:39.195 INFO:tasks.workunit.client.1.smithi150.stdout:1/686: mkdir d6/d3c/dc2/dde/df4 0 2023-12-05T09:57:39.195 INFO:tasks.workunit.client.1.smithi150.stdout:1/687: readlink d6/d47/l48 0 2023-12-05T09:57:39.204 INFO:tasks.workunit.client.1.smithi150.stdout:3/695: dwrite d6/d9/d3d/d56/d53/f69 [0,4194304] 0 2023-12-05T09:57:39.205 INFO:tasks.workunit.client.0.smithi100.stdout:9/677: dwrite d7/d1b/d22/d93/fb4 [0,4194304] 0 2023-12-05T09:57:39.205 INFO:tasks.workunit.client.0.smithi100.stdout:9/678: readlink d7/d1b/d22/d2a/d56/l34 0 2023-12-05T09:57:39.206 INFO:tasks.workunit.client.1.smithi150.stdout:5/699: dread d1/d64/d31/fb6 [0,4194304] 0 2023-12-05T09:57:39.206 INFO:tasks.workunit.client.1.smithi150.stdout:5/700: truncate d1/d2e/da6/d24/d59/fa3 573163 0 2023-12-05T09:57:39.206 INFO:tasks.workunit.client.1.smithi150.stdout:5/701: stat d1/d64/l2a 0 2023-12-05T09:57:39.213 INFO:tasks.workunit.client.1.smithi150.stdout:8/756: dwrite d0/d41/d49/d1b/d24/d5b/d87/f98 [0,4194304] 0 2023-12-05T09:57:39.235 INFO:tasks.workunit.client.1.smithi150.stdout:6/621: dwrite d2/d23/f67 [0,4194304] 0 2023-12-05T09:57:39.238 INFO:tasks.workunit.client.0.smithi100.stdout:5/680: dwrite d0/d27/f29 [0,4194304] 0 2023-12-05T09:57:39.238 INFO:tasks.workunit.client.0.smithi100.stdout:5/681: truncate d0/d1f/fdb 1227037 0 2023-12-05T09:57:39.238 INFO:tasks.workunit.client.0.smithi100.stdout:3/783: dwrite d0/f88 [4194304,4194304] 0 2023-12-05T09:57:39.248 INFO:tasks.workunit.client.1.smithi150.stdout:3/696: dwrite d6/f80 [0,4194304] 0 2023-12-05T09:57:39.249 INFO:tasks.workunit.client.1.smithi150.stdout:3/697: creat d6/d9/d3d/d87/fe4 x:0 0 0 2023-12-05T09:57:39.249 INFO:tasks.workunit.client.1.smithi150.stdout:3/698: dread - d6/d22/d37/da1/fa7 zero size 2023-12-05T09:57:39.266 INFO:tasks.workunit.client.0.smithi100.stdout:7/635: link d3/dc/d11/d13/de/d18/c54 d3/dc/d11/cf0 0 2023-12-05T09:57:39.267 INFO:tasks.workunit.client.0.smithi100.stdout:7/636: fsync d3/dc/d11/d13/d1b/f45 0 2023-12-05T09:57:39.267 INFO:tasks.workunit.client.0.smithi100.stdout:7/637: creat d3/dc/d11/d13/d1b/d60/ff1 x:0 0 0 2023-12-05T09:57:39.267 INFO:tasks.workunit.client.0.smithi100.stdout:7/638: chown d3/dc/d11/d13/de/d18/d3b/d40/d4c/d7f/l8e 93927 1 2023-12-05T09:57:39.267 INFO:tasks.workunit.client.0.smithi100.stdout:7/639: write d3/dc/d11/d13/de/d2d/f6d [4800276,92967] 0 2023-12-05T09:57:39.267 INFO:tasks.workunit.client.0.smithi100.stdout:7/640: chown d3/dc/d11/d13/de/d2d/d47/dbd/ld0 261888404 1 2023-12-05T09:57:39.269 INFO:tasks.workunit.client.1.smithi150.stdout:4/634: fsync d0/f30 0 2023-12-05T09:57:39.272 INFO:tasks.workunit.client.1.smithi150.stdout:1/688: mkdir d6/d8/d54/d94/df5 0 2023-12-05T09:57:39.272 INFO:tasks.workunit.client.1.smithi150.stdout:1/689: readlink d6/d47/l48 0 2023-12-05T09:57:39.272 INFO:tasks.workunit.client.1.smithi150.stdout:1/690: stat d6/d8/d85 0 2023-12-05T09:57:39.276 INFO:tasks.workunit.client.0.smithi100.stdout:2/795: rename d7/da/d18/d21/dae/lff to d7/da/d13/d4e/l10c 0 2023-12-05T09:57:39.279 INFO:tasks.workunit.client.0.smithi100.stdout:0/631: mkdir da/d60/dba 0 2023-12-05T09:57:39.279 INFO:tasks.workunit.client.0.smithi100.stdout:0/632: fsync da/d22/f3b 0 2023-12-05T09:57:39.280 INFO:tasks.workunit.client.0.smithi100.stdout:0/633: fdatasync da/d1b/d36/f4f 0 2023-12-05T09:57:39.280 INFO:tasks.workunit.client.0.smithi100.stdout:0/634: chown da/d2a/d4d/l92 9 1 2023-12-05T09:57:39.280 INFO:tasks.workunit.client.0.smithi100.stdout:0/635: chown da/d1b/d36 48791371 1 2023-12-05T09:57:39.281 INFO:tasks.workunit.client.0.smithi100.stdout:0/636: write da/d22/d33/fa9 [217833,110415] 0 2023-12-05T09:57:39.281 INFO:tasks.workunit.client.0.smithi100.stdout:0/637: truncate da/d22/d33/d74/f79 1246565 0 2023-12-05T09:57:39.290 INFO:tasks.workunit.client.0.smithi100.stdout:1/656: mknod db/d12/d1e/d72/dc4/cd5 0 2023-12-05T09:57:39.295 INFO:tasks.workunit.client.0.smithi100.stdout:9/679: symlink d7/d1b/d22/d2a/d56/daf/lea 0 2023-12-05T09:57:39.296 INFO:tasks.workunit.client.0.smithi100.stdout:9/680: creat d7/d1b/da5/da2/feb x:0 0 0 2023-12-05T09:57:39.311 INFO:tasks.workunit.client.1.smithi150.stdout:8/757: symlink d0/d41/d49/d1b/d24/d38/dad/lec 0 2023-12-05T09:57:39.367 INFO:tasks.workunit.client.1.smithi150.stdout:6/622: unlink d2/d23/d3b/d64/d7a/l8d 0 2023-12-05T09:57:39.368 INFO:tasks.workunit.client.1.smithi150.stdout:0/711: rename d5/d11/d16/f51 to d5/d11/d71/d99/d9c/d96/fff 0 2023-12-05T09:57:39.368 INFO:tasks.workunit.client.1.smithi150.stdout:0/712: fdatasync d5/d11/f59 0 2023-12-05T09:57:39.390 INFO:tasks.workunit.client.1.smithi150.stdout:0/713: write d5/d11/d71/d74/fd0 [3684739,107581] 0 2023-12-05T09:57:39.398 INFO:tasks.workunit.client.0.smithi100.stdout:3/784: getdents d0/d3d/d5c/d6f/d7f 0 2023-12-05T09:57:39.398 INFO:tasks.workunit.client.0.smithi100.stdout:3/785: write d0/d3d/f108 [144062,92613] 0 2023-12-05T09:57:39.404 INFO:tasks.workunit.client.1.smithi150.stdout:0/714: dread d5/d11/d32/f39 [0,4194304] 0 2023-12-05T09:57:39.442 INFO:tasks.workunit.client.1.smithi150.stdout:0/715: dwrite d5/d11/d71/d99/d9c/d3b/de0/ffc [0,4194304] 0 2023-12-05T09:57:39.458 INFO:tasks.workunit.client.1.smithi150.stdout:3/699: mknod d6/d22/ce5 0 2023-12-05T09:57:39.483 INFO:tasks.workunit.client.1.smithi150.stdout:5/702: creat d1/d7f/d65/ff9 x:0 0 0 2023-12-05T09:57:39.488 INFO:tasks.workunit.client.1.smithi150.stdout:4/635: unlink d0/d5f/l81 0 2023-12-05T09:57:39.501 INFO:tasks.workunit.client.1.smithi150.stdout:8/758: rename d0/d8/f51 to d0/d41/d49/d1b/d24/d2e/d4d/fed 0 2023-12-05T09:57:39.506 INFO:tasks.workunit.client.0.smithi100.stdout:4/629: unlink de/d16/d23/d33/d3d/d44/d4e/f50 0 2023-12-05T09:57:39.509 INFO:tasks.workunit.client.0.smithi100.stdout:0/638: symlink da/d60/dba/lbb 0 2023-12-05T09:57:39.512 INFO:tasks.workunit.client.1.smithi150.stdout:0/716: link d5/d11/d71/d99/d9c/d96/dd5/f44 d5/d11/d71/d99/d9c/d96/de3/f100 0 2023-12-05T09:57:39.512 INFO:tasks.workunit.client.1.smithi150.stdout:0/717: chown d5/dbd/ce7 2503730 1 2023-12-05T09:57:39.513 INFO:tasks.workunit.client.1.smithi150.stdout:0/718: fsync d5/f31 0 2023-12-05T09:57:39.513 INFO:tasks.workunit.client.1.smithi150.stdout:0/719: write d5/d11/d71/d99/d9c/d96/dd5/d7f/db4/fed [154605,113957] 0 2023-12-05T09:57:39.513 INFO:tasks.workunit.client.1.smithi150.stdout:0/720: fdatasync d5/d11/d32/d57/fa2 0 2023-12-05T09:57:39.514 INFO:tasks.workunit.client.0.smithi100.stdout:1/657: mkdir db/d12/d1e/d26/d30/d52/dd0/dd6 0 2023-12-05T09:57:39.514 INFO:tasks.workunit.client.0.smithi100.stdout:1/658: fsync db/f35 0 2023-12-05T09:57:39.515 INFO:tasks.workunit.client.0.smithi100.stdout:1/659: read db/d12/d1e/fc3 [167451,53968] 0 2023-12-05T09:57:39.515 INFO:tasks.workunit.client.1.smithi150.stdout:5/703: truncate d1/d3/d6/f1c 3550616 0 2023-12-05T09:57:39.523 INFO:tasks.workunit.client.1.smithi150.stdout:8/759: dread d0/d41/d49/d1b/d24/d5b/d9c/fc6 [0,4194304] 0 2023-12-05T09:57:39.523 INFO:tasks.workunit.client.1.smithi150.stdout:8/760: truncate d0/d41/d49/d1b/d24/d5b/f96 1174418 0 2023-12-05T09:57:39.526 INFO:tasks.workunit.client.1.smithi150.stdout:0/721: symlink d5/d11/d16/l101 0 2023-12-05T09:57:39.526 INFO:tasks.workunit.client.1.smithi150.stdout:0/722: dread - d5/d11/d65/fb5 zero size 2023-12-05T09:57:39.527 INFO:tasks.workunit.client.0.smithi100.stdout:9/681: mkdir d7/d1b/d22/d2a/d74/dec 0 2023-12-05T09:57:39.529 INFO:tasks.workunit.client.0.smithi100.stdout:0/639: write da/d1b/d73/d82/f8a [2222165,99351] 0 2023-12-05T09:57:39.529 INFO:tasks.workunit.client.1.smithi150.stdout:3/700: rename d6/d22/d37/d63 to d6/d9/d8d/de6 0 2023-12-05T09:57:39.530 INFO:tasks.workunit.client.1.smithi150.stdout:3/701: readlink d6/d9/d3d/d56/d30/ld2 0 2023-12-05T09:57:39.534 INFO:tasks.workunit.client.1.smithi150.stdout:0/723: link d5/d11/d71/d99/d9c/d96/fff d5/d11/d71/d99/d9c/d3b/de0/f102 0 2023-12-05T09:57:39.534 INFO:tasks.workunit.client.1.smithi150.stdout:0/724: truncate d5/d11/d71/d5f/d6a/fe6 129045 0 2023-12-05T09:57:39.534 INFO:tasks.workunit.client.1.smithi150.stdout:0/725: write d5/d11/d32/fdd [823678,60025] 0 2023-12-05T09:57:39.535 INFO:tasks.workunit.client.1.smithi150.stdout:0/726: fsync d5/d11/d71/d99/d9c/fcf 0 2023-12-05T09:57:39.535 INFO:tasks.workunit.client.1.smithi150.stdout:4/636: dwrite d0/d3e/d5b/d6e/daa/fb3 [0,4194304] 0 2023-12-05T09:57:39.539 INFO:tasks.workunit.client.1.smithi150.stdout:0/727: symlink d5/d11/d71/d99/d9c/d3b/dad/l103 0 2023-12-05T09:57:39.544 INFO:tasks.workunit.client.1.smithi150.stdout:1/691: mknod d6/d8/d54/cf6 0 2023-12-05T09:57:39.544 INFO:tasks.workunit.client.1.smithi150.stdout:1/692: truncate d6/d47/d4c/f5d 4665071 0 2023-12-05T09:57:39.544 INFO:tasks.workunit.client.1.smithi150.stdout:1/693: creat d6/d8/db/db1/ff7 x:0 0 0 2023-12-05T09:57:39.547 INFO:tasks.workunit.client.1.smithi150.stdout:3/702: dread d6/d9/d3d/d56/f3b [0,4194304] 0 2023-12-05T09:57:39.551 INFO:tasks.workunit.client.0.smithi100.stdout:3/786: link d0/d2/de/d12/f18 d0/d3d/d5c/d5f/de9/f10b 0 2023-12-05T09:57:39.555 INFO:tasks.workunit.client.1.smithi150.stdout:0/728: write d5/d11/d71/d99/d9c/d3b/de0/ffc [421663,56971] 0 2023-12-05T09:57:39.557 INFO:tasks.workunit.client.1.smithi150.stdout:3/703: truncate d6/d9/f1b 1911927 0 2023-12-05T09:57:39.557 INFO:tasks.workunit.client.1.smithi150.stdout:3/704: chown d6/d9/d3d/d87/la6 3201 1 2023-12-05T09:57:39.559 INFO:tasks.workunit.client.0.smithi100.stdout:2/796: mkdir d7/da/d18/d21/d10d 0 2023-12-05T09:57:39.565 INFO:tasks.workunit.client.1.smithi150.stdout:0/729: link d5/d11/d32/d57/faf d5/d11/d71/d99/d9c/d96/dc1/f104 0 2023-12-05T09:57:39.565 INFO:tasks.workunit.client.1.smithi150.stdout:3/705: truncate d6/d22/d37/f4a 885779 0 2023-12-05T09:57:39.570 INFO:tasks.workunit.client.1.smithi150.stdout:0/730: rmdir d5/d11/d71/d99/d9c/d46 39 2023-12-05T09:57:39.571 INFO:tasks.workunit.client.0.smithi100.stdout:2/797: symlink d7/da/d18/d1b/d2c/d3f/d98/l10e 0 2023-12-05T09:57:39.571 INFO:tasks.workunit.client.0.smithi100.stdout:2/798: chown d7/da/d13/d69/d6e/d71/f9a 0 1 2023-12-05T09:57:39.571 INFO:tasks.workunit.client.0.smithi100.stdout:2/799: read - d7/da/d18/d21/d86/fd7 zero size 2023-12-05T09:57:39.572 INFO:tasks.workunit.client.0.smithi100.stdout:2/800: unlink d7/da/ddc/lf3 0 2023-12-05T09:57:39.572 INFO:tasks.workunit.client.0.smithi100.stdout:2/801: stat d7/f43 0 2023-12-05T09:57:39.572 INFO:tasks.workunit.client.0.smithi100.stdout:2/802: write d7/da/d18/d1b/d2c/d3f/ffb [876734,28312] 0 2023-12-05T09:57:39.574 INFO:tasks.workunit.client.1.smithi150.stdout:3/706: mknod d6/d9/d3d/d56/ce7 0 2023-12-05T09:57:39.574 INFO:tasks.workunit.client.1.smithi150.stdout:3/707: fsync d6/d25/fca 0 2023-12-05T09:57:39.576 INFO:tasks.workunit.client.0.smithi100.stdout:2/803: link d7/l15 d7/da/d18/d21/d86/l10f 0 2023-12-05T09:57:39.576 INFO:tasks.workunit.client.0.smithi100.stdout:2/804: write d7/da/d18/d21/d4d/d81/f80 [3266199,77709] 0 2023-12-05T09:57:39.577 INFO:tasks.workunit.client.1.smithi150.stdout:0/731: dread d5/d11/d71/d99/d9c/d3b/fbc [0,4194304] 0 2023-12-05T09:57:39.577 INFO:tasks.workunit.client.1.smithi150.stdout:0/732: fsync d5/d11/d16/fa3 0 2023-12-05T09:57:39.580 INFO:tasks.workunit.client.0.smithi100.stdout:2/805: mknod d7/da/d18/d1b/d2c/d3f/d98/c110 0 2023-12-05T09:57:39.592 INFO:tasks.workunit.client.0.smithi100.stdout:1/660: dwrite db/d12/d1e/f41 [0,4194304] 0 2023-12-05T09:57:39.592 INFO:tasks.workunit.client.0.smithi100.stdout:1/661: fdatasync db/d12/fae 0 2023-12-05T09:57:39.592 INFO:tasks.workunit.client.0.smithi100.stdout:7/641: link d3/dc/d11/d13/d1b/f45 d3/ff2 0 2023-12-05T09:57:39.592 INFO:tasks.workunit.client.0.smithi100.stdout:7/642: creat d3/dc/ff3 x:0 0 0 2023-12-05T09:57:39.592 INFO:tasks.workunit.client.0.smithi100.stdout:7/643: dread - d3/dc/ff3 zero size 2023-12-05T09:57:39.592 INFO:tasks.workunit.client.1.smithi150.stdout:3/708: dread d6/d25/f62 [0,4194304] 0 2023-12-05T09:57:39.595 INFO:tasks.workunit.client.0.smithi100.stdout:9/682: dwrite d7/d20/f3a [0,4194304] 0 2023-12-05T09:57:39.598 INFO:tasks.workunit.client.1.smithi150.stdout:0/733: write d5/d11/d32/f50 [4107417,129102] 0 2023-12-05T09:57:39.599 INFO:tasks.workunit.client.0.smithi100.stdout:9/683: link d7/d1b/d89/f90 d7/d1b/da5/fed 0 2023-12-05T09:57:39.602 INFO:tasks.workunit.client.1.smithi150.stdout:0/734: mknod d5/d11/db6/c105 0 2023-12-05T09:57:39.604 INFO:tasks.workunit.client.0.smithi100.stdout:9/684: unlink d7/d1b/d22/d51/f11 0 2023-12-05T09:57:39.609 INFO:tasks.workunit.client.0.smithi100.stdout:1/662: dread db/d12/d1e/d26/f62 [0,4194304] 0 2023-12-05T09:57:39.609 INFO:tasks.workunit.client.0.smithi100.stdout:1/663: dread - db/d31/d3a/d3b/f9b zero size 2023-12-05T09:57:39.612 INFO:tasks.workunit.client.0.smithi100.stdout:3/787: dwrite d0/d2/fe0 [8388608,4194304] 0 2023-12-05T09:57:39.612 INFO:tasks.workunit.client.0.smithi100.stdout:3/788: fdatasync d0/fea 0 2023-12-05T09:57:39.612 INFO:tasks.workunit.client.0.smithi100.stdout:1/664: creat db/d12/d1e/d72/dc4/fd7 x:0 0 0 2023-12-05T09:57:39.613 INFO:tasks.workunit.client.0.smithi100.stdout:1/665: fdatasync db/d12/d1e/f38 0 2023-12-05T09:57:39.615 INFO:tasks.workunit.client.0.smithi100.stdout:3/789: creat d0/d10/f10c x:0 0 0 2023-12-05T09:57:39.617 INFO:tasks.workunit.client.1.smithi150.stdout:7/693: sync 2023-12-05T09:57:39.617 INFO:tasks.workunit.client.1.smithi150.stdout:9/631: sync 2023-12-05T09:57:39.618 INFO:tasks.workunit.client.1.smithi150.stdout:2/720: sync 2023-12-05T09:57:39.618 INFO:tasks.workunit.client.1.smithi150.stdout:7/694: write d2/db/d30/d13/d4f/d7e/fb5 [916405,11038] 0 2023-12-05T09:57:39.618 INFO:tasks.workunit.client.1.smithi150.stdout:7/695: truncate d2/db/d30/d13/f1d 898287 0 2023-12-05T09:57:39.618 INFO:tasks.workunit.client.1.smithi150.stdout:2/721: write d0/d3/d11/fdc [441079,107555] 0 2023-12-05T09:57:39.618 INFO:tasks.workunit.client.1.smithi150.stdout:7/696: write d2/db/d17/d20/fab [3169122,80937] 0 2023-12-05T09:57:39.618 INFO:tasks.workunit.client.0.smithi100.stdout:1/666: link db/l59 db/d12/d1e/d26/ld8 0 2023-12-05T09:57:39.619 INFO:tasks.workunit.client.0.smithi100.stdout:1/667: write db/d31/d3a/f9a [1145084,112734] 0 2023-12-05T09:57:39.619 INFO:tasks.workunit.client.0.smithi100.stdout:1/668: chown db/d12/ca5 1 1 2023-12-05T09:57:39.619 INFO:tasks.workunit.client.0.smithi100.stdout:5/682: symlink d0/d4/d14/d35/lf4 0 2023-12-05T09:57:39.620 INFO:tasks.workunit.client.1.smithi150.stdout:7/697: symlink d2/db/d30/d13/d4f/d5a/d5c/dcb/le6 0 2023-12-05T09:57:39.620 INFO:tasks.workunit.client.0.smithi100.stdout:1/669: stat db/d31/d3a/c3c 0 2023-12-05T09:57:39.621 INFO:tasks.workunit.client.0.smithi100.stdout:5/683: unlink d0/d1f/d53/f7c 0 2023-12-05T09:57:39.624 INFO:tasks.workunit.client.1.smithi150.stdout:7/698: unlink d2/db/d30/daf/dd3/c4b 0 2023-12-05T09:57:39.625 INFO:tasks.workunit.client.1.smithi150.stdout:3/709: dwrite d6/d9/f57 [0,4194304] 0 2023-12-05T09:57:39.625 INFO:tasks.workunit.client.1.smithi150.stdout:3/710: chown d6/d25/dcf 21263 1 2023-12-05T09:57:39.625 INFO:tasks.workunit.client.0.smithi100.stdout:5/684: symlink d0/d16/d2b/d48/df/lf5 0 2023-12-05T09:57:39.625 INFO:tasks.workunit.client.0.smithi100.stdout:5/685: fsync d0/d1b/d4d/d6c/fde 0 2023-12-05T09:57:39.631 INFO:tasks.workunit.client.1.smithi150.stdout:7/699: getdents d2/d72/d82 0 2023-12-05T09:57:39.635 INFO:tasks.workunit.client.1.smithi150.stdout:7/700: symlink d2/d72/le7 0 2023-12-05T09:57:39.636 INFO:tasks.workunit.client.1.smithi150.stdout:9/632: dread d3/f71 [0,4194304] 0 2023-12-05T09:57:39.639 INFO:tasks.workunit.client.1.smithi150.stdout:9/633: mknod d3/d1b/dca/cd1 0 2023-12-05T09:57:39.641 INFO:tasks.workunit.client.1.smithi150.stdout:0/735: dwrite d5/d11/d71/f7c [4194304,4194304] 0 2023-12-05T09:57:39.641 INFO:tasks.workunit.client.1.smithi150.stdout:0/736: write d5/d11/d71/d99/d9c/d96/de3/f100 [124226,60357] 0 2023-12-05T09:57:39.650 INFO:tasks.workunit.client.1.smithi150.stdout:0/737: mkdir d5/d11/d71/d99/d9c/d3b/de0/d106 0 2023-12-05T09:57:39.650 INFO:tasks.workunit.client.1.smithi150.stdout:6/623: rmdir d2/d23/d2e 39 2023-12-05T09:57:39.657 INFO:tasks.workunit.client.1.smithi150.stdout:0/738: dread d5/d11/d71/d99/d9c/d96/dd5/d7f/db4/fed [0,4194304] 0 2023-12-05T09:57:39.661 INFO:tasks.workunit.client.1.smithi150.stdout:0/739: mkdir d5/d11/d32/df2/d107 0 2023-12-05T09:57:39.663 INFO:tasks.workunit.client.1.smithi150.stdout:7/701: dread d2/d4/f6d [0,4194304] 0 2023-12-05T09:57:39.663 INFO:tasks.workunit.client.1.smithi150.stdout:7/702: read d2/db/d30/d18/f57 [2040096,83128] 0 2023-12-05T09:57:39.669 INFO:tasks.workunit.client.0.smithi100.stdout:4/630: mkdir de/d16/dc8 0 2023-12-05T09:57:39.679 INFO:tasks.workunit.client.1.smithi150.stdout:4/637: write d0/d3e/d6d/f3f [740738,38955] 0 2023-12-05T09:57:39.685 INFO:tasks.workunit.client.0.smithi100.stdout:9/685: unlink d7/d1b/d22/d2a/f40 0 2023-12-05T09:57:39.687 INFO:tasks.workunit.client.0.smithi100.stdout:4/631: dread de/f11 [0,4194304] 0 2023-12-05T09:57:39.687 INFO:tasks.workunit.client.1.smithi150.stdout:2/722: dwrite d0/d3/d27/db6/fc6 [0,4194304] 0 2023-12-05T09:57:39.687 INFO:tasks.workunit.client.1.smithi150.stdout:2/723: stat d0/d3/d11/c5f 0 2023-12-05T09:57:39.696 INFO:tasks.workunit.client.0.smithi100.stdout:5/686: mknod d0/d4/d14/cf6 0 2023-12-05T09:57:39.703 INFO:tasks.workunit.client.0.smithi100.stdout:0/640: rename da/d1b/d73/f9d to da/d22/d33/d35/d3a/fbc 0 2023-12-05T09:57:39.709 INFO:tasks.workunit.client.0.smithi100.stdout:5/687: creat d0/d1b/d4d/ff7 x:0 0 0 2023-12-05T09:57:39.709 INFO:tasks.workunit.client.0.smithi100.stdout:5/688: chown d0/cc3 1623 1 2023-12-05T09:57:39.710 INFO:tasks.workunit.client.1.smithi150.stdout:4/638: mknod d0/cc7 0 2023-12-05T09:57:39.712 INFO:tasks.workunit.client.0.smithi100.stdout:0/641: truncate da/f11 7898474 0 2023-12-05T09:57:39.713 INFO:tasks.workunit.client.0.smithi100.stdout:7/644: rename d3/dc/d11/d13/d37/d97/dc1/fce to d3/dc/d11/d13/de/d2d/ff4 0 2023-12-05T09:57:39.715 INFO:tasks.workunit.client.0.smithi100.stdout:5/689: truncate d0/d16/d2b/f3a 3022100 0 2023-12-05T09:57:39.717 INFO:tasks.workunit.client.0.smithi100.stdout:0/642: symlink da/d2a/d45/lbd 0 2023-12-05T09:57:39.719 INFO:tasks.workunit.client.1.smithi150.stdout:3/711: dwrite d6/d9/d3d/d56/d71/db6/dc1/f96 [0,4194304] 0 2023-12-05T09:57:39.720 INFO:tasks.workunit.client.0.smithi100.stdout:7/645: symlink d3/lf5 0 2023-12-05T09:57:39.720 INFO:tasks.workunit.client.0.smithi100.stdout:7/646: chown d3/dc/d11/d13/de/d2d/d42/fcf 70098 1 2023-12-05T09:57:39.720 INFO:tasks.workunit.client.0.smithi100.stdout:7/647: truncate d3/dc/d11/d13/de/d18/d3b/d40/d4c/fa4 103944 0 2023-12-05T09:57:39.721 INFO:tasks.workunit.client.1.smithi150.stdout:2/724: dread d0/d3/d5/d13/d15/d30/d54/d57/f88 [0,4194304] 0 2023-12-05T09:57:39.725 INFO:tasks.workunit.client.0.smithi100.stdout:8/614: sync 2023-12-05T09:57:39.725 INFO:tasks.workunit.client.0.smithi100.stdout:8/615: fsync d0/d12/d13/d16/f20 0 2023-12-05T09:57:39.725 INFO:tasks.workunit.client.0.smithi100.stdout:8/616: write d0/d12/d13/d45/da6/f69 [592531,33329] 0 2023-12-05T09:57:39.725 INFO:tasks.workunit.client.0.smithi100.stdout:8/617: truncate d0/d12/d52/f8e 4473633 0 2023-12-05T09:57:39.725 INFO:tasks.workunit.client.0.smithi100.stdout:8/618: fsync d0/d12/d13/f25 0 2023-12-05T09:57:39.725 INFO:tasks.workunit.client.0.smithi100.stdout:8/619: write d0/d35/f93 [445088,125515] 0 2023-12-05T09:57:39.725 INFO:tasks.workunit.client.0.smithi100.stdout:8/620: dread - d0/d35/d64/f7c zero size 2023-12-05T09:57:39.727 INFO:tasks.workunit.client.0.smithi100.stdout:0/643: mkdir da/d1b/dbe 0 2023-12-05T09:57:39.728 INFO:tasks.workunit.client.1.smithi150.stdout:2/725: creat d0/d3/d21/ff8 x:0 0 0 2023-12-05T09:57:39.729 INFO:tasks.workunit.client.1.smithi150.stdout:2/726: creat d0/d3/d5/d13/db9/ff9 x:0 0 0 2023-12-05T09:57:39.729 INFO:tasks.workunit.client.0.smithi100.stdout:8/621: unlink d0/d12/d13/d16/d22/d72/l8d 0 2023-12-05T09:57:39.730 INFO:tasks.workunit.client.0.smithi100.stdout:1/670: dwrite db/d12/d61/f85 [0,4194304] 0 2023-12-05T09:57:39.730 INFO:tasks.workunit.client.0.smithi100.stdout:1/671: read - db/d31/d3a/d4a/fa3 zero size 2023-12-05T09:57:39.730 INFO:tasks.workunit.client.0.smithi100.stdout:1/672: truncate db/d12/d1e/dd3/fcf 9113323 0 2023-12-05T09:57:39.731 INFO:tasks.workunit.client.1.smithi150.stdout:6/624: dwrite d2/d23/f3f [4194304,4194304] 0 2023-12-05T09:57:39.731 INFO:tasks.workunit.client.1.smithi150.stdout:6/625: write d2/d23/d3b/d64/d7a/f40 [2696529,117419] 0 2023-12-05T09:57:39.731 INFO:tasks.workunit.client.1.smithi150.stdout:3/712: dread d6/fd4 [0,4194304] 0 2023-12-05T09:57:39.731 INFO:tasks.workunit.client.1.smithi150.stdout:3/713: fsync d6/d9/d3d/d56/f7d 0 2023-12-05T09:57:39.731 INFO:tasks.workunit.client.0.smithi100.stdout:3/790: rename d0/d2/de/d11/d58 to d0/d3d/dfc/d10d 0 2023-12-05T09:57:39.732 INFO:tasks.workunit.client.1.smithi150.stdout:9/634: dwrite d3/d1b/d46/f98 [0,4194304] 0 2023-12-05T09:57:39.733 INFO:tasks.workunit.client.1.smithi150.stdout:7/703: dwrite d2/db/d30/d13/f37 [8388608,4194304] 0 2023-12-05T09:57:39.734 INFO:tasks.workunit.client.1.smithi150.stdout:0/740: dwrite d5/d11/d71/d74/fd0 [0,4194304] 0 2023-12-05T09:57:39.734 INFO:tasks.workunit.client.1.smithi150.stdout:0/741: chown d5/d11/d71/d99/d9c/d96/dd5/d7f/c9b 15 1 2023-12-05T09:57:39.734 INFO:tasks.workunit.client.1.smithi150.stdout:0/742: fdatasync d5/d11/f26 0 2023-12-05T09:57:39.734 INFO:tasks.workunit.client.1.smithi150.stdout:0/743: readlink d5/d11/d71/d99/d9c/d46/lc6 0 2023-12-05T09:57:39.739 INFO:tasks.workunit.client.0.smithi100.stdout:8/622: mknod d0/caf 0 2023-12-05T09:57:39.739 INFO:tasks.workunit.client.0.smithi100.stdout:8/623: write d0/d12/d13/d16/d42/f8c [788403,106239] 0 2023-12-05T09:57:39.740 INFO:tasks.workunit.client.1.smithi150.stdout:3/714: read d6/d25/f62 [3251909,112618] 0 2023-12-05T09:57:39.741 INFO:tasks.workunit.client.1.smithi150.stdout:2/727: symlink d0/lfa 0 2023-12-05T09:57:39.741 INFO:tasks.workunit.client.0.smithi100.stdout:5/690: write d0/d1b/d4d/d6c/fe9 [3766780,103756] 0 2023-12-05T09:57:39.744 INFO:tasks.workunit.client.0.smithi100.stdout:3/791: rename d0/d2/de/d11/c86 to d0/d3d/d5c/d6f/d7f/d87/c10e 0 2023-12-05T09:57:39.747 INFO:tasks.workunit.client.1.smithi150.stdout:6/626: creat d2/d23/d2e/d5f/d99/fd4 x:0 0 0 2023-12-05T09:57:39.747 INFO:tasks.workunit.client.1.smithi150.stdout:6/627: truncate d2/d23/fb6 309118 0 2023-12-05T09:57:39.747 INFO:tasks.workunit.client.1.smithi150.stdout:6/628: dread - d2/d23/d3b/d64/d7a/d5d/d6b/f4b zero size 2023-12-05T09:57:39.747 INFO:tasks.workunit.client.1.smithi150.stdout:6/629: write d2/d23/d3b/d83/f71 [1112803,112315] 0 2023-12-05T09:57:39.753 INFO:tasks.workunit.client.1.smithi150.stdout:4/639: dwrite d0/d3e/f76 [0,4194304] 0 2023-12-05T09:57:39.754 INFO:tasks.workunit.client.0.smithi100.stdout:5/691: symlink d0/d16/d37/lf8 0 2023-12-05T09:57:39.757 INFO:tasks.workunit.client.0.smithi100.stdout:9/686: rename d7/d1b/d22/d2a/f48 to d7/d1b/d22/d51/dc0/fee 0 2023-12-05T09:57:39.767 INFO:tasks.workunit.client.0.smithi100.stdout:5/692: creat d0/d4/d14/ff9 x:0 0 0 2023-12-05T09:57:39.767 INFO:tasks.workunit.client.0.smithi100.stdout:5/693: creat d0/d1b/d4d/d8e/d96/dc1/dae/ffa x:0 0 0 2023-12-05T09:57:39.770 INFO:tasks.workunit.client.0.smithi100.stdout:4/632: rename de/d66/f77 to de/d16/fc9 0 2023-12-05T09:57:39.774 INFO:tasks.workunit.client.1.smithi150.stdout:9/635: mkdir d3/d42/dd2 0 2023-12-05T09:57:39.774 INFO:tasks.workunit.client.1.smithi150.stdout:9/636: fdatasync d3/d9/d9c/fcd 0 2023-12-05T09:57:39.774 INFO:tasks.workunit.client.1.smithi150.stdout:9/637: chown d3/d9/dc/d1f/d24/f63 244472294 1 2023-12-05T09:57:39.787 INFO:tasks.workunit.client.0.smithi100.stdout:0/644: rename da/d22/d33/d35/d3a/d8b/d8f/la4 to da/d60/lbf 0 2023-12-05T09:57:39.795 INFO:tasks.workunit.client.0.smithi100.stdout:1/673: rename db/d12/d1e/d26/d30/f56 to db/d12/d1e/dd3/db8/fd9 0 2023-12-05T09:57:39.795 INFO:tasks.workunit.client.0.smithi100.stdout:8/624: dwrite d0/d12/f36 [0,4194304] 0 2023-12-05T09:57:39.798 INFO:tasks.workunit.client.0.smithi100.stdout:8/625: creat d0/d12/d13/d16/d42/fb0 x:0 0 0 2023-12-05T09:57:39.799 INFO:tasks.workunit.client.0.smithi100.stdout:8/626: chown d0/d12/d13/d16/d22/d72/f94 39 1 2023-12-05T09:57:39.799 INFO:tasks.workunit.client.0.smithi100.stdout:8/627: write d0/d12/d13/d16/d22/f26 [4571092,16085] 0 2023-12-05T09:57:39.799 INFO:tasks.workunit.client.0.smithi100.stdout:8/628: dread - d0/f86 zero size 2023-12-05T09:57:39.803 INFO:tasks.workunit.client.1.smithi150.stdout:7/704: getdents d2/d9d/da0 0 2023-12-05T09:57:39.803 INFO:tasks.workunit.client.1.smithi150.stdout:0/744: rmdir d5/d11/d71/d5f 39 2023-12-05T09:57:39.805 INFO:tasks.workunit.client.0.smithi100.stdout:9/687: rename d7/d1b/da5 to d7/d20/d69/def 0 2023-12-05T09:57:39.805 INFO:tasks.workunit.client.0.smithi100.stdout:4/633: rename de to de/d38/dca 22 2023-12-05T09:57:39.805 INFO:tasks.workunit.client.0.smithi100.stdout:9/688: write d7/d1b/d22/d51/dc0/fee [166301,6717] 0 2023-12-05T09:57:39.805 INFO:tasks.workunit.client.0.smithi100.stdout:9/689: dread - d7/f45 zero size 2023-12-05T09:57:39.806 INFO:tasks.workunit.client.1.smithi150.stdout:3/715: symlink d6/d25/le8 0 2023-12-05T09:57:39.807 INFO:tasks.workunit.client.1.smithi150.stdout:2/728: creat d0/d3/d27/d95/ddf/ffb x:0 0 0 2023-12-05T09:57:39.818 INFO:tasks.workunit.client.0.smithi100.stdout:4/634: creat de/d16/d23/d60/dc4/fcb x:0 0 0 2023-12-05T09:57:39.818 INFO:tasks.workunit.client.1.smithi150.stdout:4/640: rmdir d0/d3e/d6d/d4b/d8c 39 2023-12-05T09:57:39.819 INFO:tasks.workunit.client.1.smithi150.stdout:6/630: dwrite d2/d23/d3b/d64/d7a/d5d/d6b/f22 [0,4194304] 0 2023-12-05T09:57:39.821 INFO:tasks.workunit.client.1.smithi150.stdout:9/638: symlink d3/d9/dc/ld3 0 2023-12-05T09:57:39.825 INFO:tasks.workunit.client.0.smithi100.stdout:4/635: truncate de/d16/d23/f26 5861091 0 2023-12-05T09:57:39.826 INFO:tasks.workunit.client.1.smithi150.stdout:7/705: write d2/db/f99 [1765588,64750] 0 2023-12-05T09:57:39.827 INFO:tasks.workunit.client.1.smithi150.stdout:7/706: chown d2/db/d30/d18/d63/f7f 430 1 2023-12-05T09:57:39.827 INFO:tasks.workunit.client.0.smithi100.stdout:9/690: rename d7/d20/d68/f6f to d7/d1b/d22/d51/d32/dc2/ff0 0 2023-12-05T09:57:39.829 INFO:tasks.workunit.client.1.smithi150.stdout:3/716: mknod d6/d9/d3d/d56/d30/ce9 0 2023-12-05T09:57:39.829 INFO:tasks.workunit.client.1.smithi150.stdout:3/717: chown d6/d9/d3d/d56/d30 122970 1 2023-12-05T09:57:39.830 INFO:tasks.workunit.client.1.smithi150.stdout:1/694: sync 2023-12-05T09:57:39.831 INFO:tasks.workunit.client.0.smithi100.stdout:4/636: mknod de/d38/d86/ccc 0 2023-12-05T09:57:39.831 INFO:tasks.workunit.client.0.smithi100.stdout:4/637: readlink de/d38/l63 0 2023-12-05T09:57:39.833 INFO:tasks.workunit.client.1.smithi150.stdout:5/704: sync 2023-12-05T09:57:39.833 INFO:tasks.workunit.client.1.smithi150.stdout:0/745: write d5/d11/d32/fd6 [3196714,124628] 0 2023-12-05T09:57:39.836 INFO:tasks.workunit.client.1.smithi150.stdout:8/761: sync 2023-12-05T09:57:39.836 INFO:tasks.workunit.client.1.smithi150.stdout:8/762: chown d0/d41/d49/d1b/d24/fe4 1 1 2023-12-05T09:57:39.837 INFO:tasks.workunit.client.0.smithi100.stdout:1/674: write db/d31/d3a/d4a/dad/d67/f6d [3731643,75445] 0 2023-12-05T09:57:39.838 INFO:tasks.workunit.client.0.smithi100.stdout:9/691: mkdir d7/d35/d71/d9a/dcd/df1 0 2023-12-05T09:57:39.838 INFO:tasks.workunit.client.0.smithi100.stdout:9/692: stat d7/d1b/d22 0 2023-12-05T09:57:39.838 INFO:tasks.workunit.client.0.smithi100.stdout:3/792: dwrite d0/f3b [0,4194304] 0 2023-12-05T09:57:39.839 INFO:tasks.workunit.client.1.smithi150.stdout:4/641: mkdir d0/d3e/d5b/d80/dc8 0 2023-12-05T09:57:39.840 INFO:tasks.workunit.client.0.smithi100.stdout:4/638: symlink de/d16/d23/d33/d3d/d44/d4e/dbe/lcd 0 2023-12-05T09:57:39.840 INFO:tasks.workunit.client.0.smithi100.stdout:5/694: dwrite d0/d27/f4b [0,4194304] 0 2023-12-05T09:57:39.842 INFO:tasks.workunit.client.1.smithi150.stdout:9/639: truncate d3/d9/dc/f1d 427128 0 2023-12-05T09:57:39.846 INFO:tasks.workunit.client.1.smithi150.stdout:2/729: getdents d0/d3/d5/d3b/d4c/d71 0 2023-12-05T09:57:39.846 INFO:tasks.workunit.client.1.smithi150.stdout:2/730: fsync d0/d3/d11/f23 0 2023-12-05T09:57:39.847 INFO:tasks.workunit.client.1.smithi150.stdout:0/746: dread d5/d11/d32/fdd [0,4194304] 0 2023-12-05T09:57:39.847 INFO:tasks.workunit.client.1.smithi150.stdout:1/695: mknod d6/d47/d4c/dd9/d75/ddd/cf8 0 2023-12-05T09:57:39.847 INFO:tasks.workunit.client.1.smithi150.stdout:0/747: chown d5/d11/d71/d99/d9c/d96/dd5/d7f/c9b 1 1 2023-12-05T09:57:39.847 INFO:tasks.workunit.client.1.smithi150.stdout:0/748: chown d5/d11/d71/d99/d9c/d46/l4c 5895 1 2023-12-05T09:57:39.849 INFO:tasks.workunit.client.1.smithi150.stdout:5/705: symlink d1/d3/d92/dbf/lfa 0 2023-12-05T09:57:39.856 INFO:tasks.workunit.client.1.smithi150.stdout:4/642: creat d0/d3e/d48/dbb/fc9 x:0 0 0 2023-12-05T09:57:39.856 INFO:tasks.workunit.client.1.smithi150.stdout:4/643: getdents d0/d3e/d5b/d6e 0 2023-12-05T09:57:39.859 INFO:tasks.workunit.client.0.smithi100.stdout:0/645: dwrite da/d2a/d45/f97 [0,4194304] 0 2023-12-05T09:57:39.864 INFO:tasks.workunit.client.0.smithi100.stdout:1/675: mknod db/d12/d1e/d26/d30/d6e/cda 0 2023-12-05T09:57:39.865 INFO:tasks.workunit.client.1.smithi150.stdout:8/763: dread d0/d41/d49/d1b/d24/d5b/f96 [0,4194304] 0 2023-12-05T09:57:39.868 INFO:tasks.workunit.client.1.smithi150.stdout:2/731: rename d0/da3/fbc to d0/d3/d27/dac/ffc 0 2023-12-05T09:57:39.868 INFO:tasks.workunit.client.1.smithi150.stdout:2/732: readlink d0/d3/d5/d13/d15/d30/d54/d57/le1 0 2023-12-05T09:57:39.872 INFO:tasks.workunit.client.0.smithi100.stdout:9/693: truncate d7/fc 2338227 0 2023-12-05T09:57:39.874 INFO:tasks.workunit.client.1.smithi150.stdout:0/749: link d5/d11/d71/d99/d9c/d3b/c94 d5/d11/d71/c108 0 2023-12-05T09:57:39.875 INFO:tasks.workunit.client.1.smithi150.stdout:0/750: dread - d5/d11/d71/d99/fb2 zero size 2023-12-05T09:57:39.875 INFO:tasks.workunit.client.1.smithi150.stdout:0/751: stat d5/d11/d65/fb5 0 2023-12-05T09:57:39.876 INFO:tasks.workunit.client.1.smithi150.stdout:5/706: mkdir d1/d2e/dec/dfb 0 2023-12-05T09:57:39.878 INFO:tasks.workunit.client.0.smithi100.stdout:3/793: unlink d0/d4/c22 0 2023-12-05T09:57:39.878 INFO:tasks.workunit.client.0.smithi100.stdout:3/794: chown d0/d2/de/d12/f18 1873 1 2023-12-05T09:57:39.886 INFO:tasks.workunit.client.1.smithi150.stdout:7/707: dwrite d2/db/d30/d18/d63/f7f [4194304,4194304] 0 2023-12-05T09:57:39.886 INFO:tasks.workunit.client.0.smithi100.stdout:4/639: creat de/d16/d23/d33/d3d/fce x:0 0 0 2023-12-05T09:57:39.886 INFO:tasks.workunit.client.0.smithi100.stdout:0/646: dread da/d2a/d45/f49 [0,4194304] 0 2023-12-05T09:57:39.887 INFO:tasks.workunit.client.1.smithi150.stdout:4/644: mkdir d0/d3e/d48/dbb/dca 0 2023-12-05T09:57:39.888 INFO:tasks.workunit.client.0.smithi100.stdout:5/695: unlink d0/d1f/da1/fe5 0 2023-12-05T09:57:39.888 INFO:tasks.workunit.client.0.smithi100.stdout:5/696: fsync d0/d16/d2b/d75/fc5 0 2023-12-05T09:57:39.894 INFO:tasks.workunit.client.0.smithi100.stdout:8/629: dwrite d0/d12/d13/d16/d42/fb0 [0,4194304] 0 2023-12-05T09:57:39.895 INFO:tasks.workunit.client.1.smithi150.stdout:9/640: unlink d3/d9/f49 0 2023-12-05T09:57:39.901 INFO:tasks.workunit.client.1.smithi150.stdout:8/764: symlink d0/d41/d49/d1b/d24/d5b/ddc/lee 0 2023-12-05T09:57:39.903 INFO:tasks.workunit.client.1.smithi150.stdout:2/733: unlink d0/d3/d5/d10/d3d/da1/daa/lf3 0 2023-12-05T09:57:39.903 INFO:tasks.workunit.client.1.smithi150.stdout:2/734: readlink d0/d3/d5/d22/d52/d56/l72 0 2023-12-05T09:57:39.904 INFO:tasks.workunit.client.1.smithi150.stdout:2/735: readlink d0/d3/l4 0 2023-12-05T09:57:39.905 INFO:tasks.workunit.client.0.smithi100.stdout:4/640: mknod de/d16/d23/d36/ccf 0 2023-12-05T09:57:39.905 INFO:tasks.workunit.client.0.smithi100.stdout:4/641: truncate de/d16/d23/d33/d3d/d44/f82 633050 0 2023-12-05T09:57:39.905 INFO:tasks.workunit.client.1.smithi150.stdout:3/718: dwrite d6/f80 [0,4194304] 0 2023-12-05T09:57:39.905 INFO:tasks.workunit.client.1.smithi150.stdout:3/719: dread - d6/d9/d3d/d87/fe4 zero size 2023-12-05T09:57:39.917 INFO:tasks.workunit.client.1.smithi150.stdout:7/708: rename d2/db/d30/daf/dd3/lbe to d2/d1b/d31/da4/le8 0 2023-12-05T09:57:39.917 INFO:tasks.workunit.client.1.smithi150.stdout:7/709: chown d2/db/d30/d18/d63/f7f 20408 1 2023-12-05T09:57:39.917 INFO:tasks.workunit.client.1.smithi150.stdout:7/710: write d2/d1b/d31/f8d [675594,48407] 0 2023-12-05T09:57:39.918 INFO:tasks.workunit.client.0.smithi100.stdout:0/647: dread da/d22/d33/f75 [0,4194304] 0 2023-12-05T09:57:39.919 INFO:tasks.workunit.client.1.smithi150.stdout:9/641: symlink d3/d1b/d79/ld4 0 2023-12-05T09:57:39.919 INFO:tasks.workunit.client.1.smithi150.stdout:1/696: dwrite d6/d8/d59/f91 [0,4194304] 0 2023-12-05T09:57:39.919 INFO:tasks.workunit.client.1.smithi150.stdout:9/642: write d3/d9/dc/d1f/d24/d75/fc6 [78414,82983] 0 2023-12-05T09:57:39.919 INFO:tasks.workunit.client.1.smithi150.stdout:9/643: chown d3/d9/d26/f89 5647089 1 2023-12-05T09:57:39.922 INFO:tasks.workunit.client.0.smithi100.stdout:8/630: link d0/d35/l96 d0/d12/d13/d16/d22/lb1 0 2023-12-05T09:57:39.922 INFO:tasks.workunit.client.0.smithi100.stdout:8/631: fsync d0/d12/d52/f7e 0 2023-12-05T09:57:39.922 INFO:tasks.workunit.client.0.smithi100.stdout:8/632: write d0/d35/f93 [824808,43983] 0 2023-12-05T09:57:39.924 INFO:tasks.workunit.client.0.smithi100.stdout:4/642: rename de/d16/d23/d33/c6d to de/d16/d23/d60/dc4/cd0 0 2023-12-05T09:57:39.927 INFO:tasks.workunit.client.1.smithi150.stdout:0/752: dwrite d5/d11/d32/d57/faf [0,4194304] 0 2023-12-05T09:57:39.928 INFO:tasks.workunit.client.1.smithi150.stdout:8/765: dread d0/d41/d49/d1b/d24/d38/d62/f65 [0,4194304] 0 2023-12-05T09:57:39.928 INFO:tasks.workunit.client.1.smithi150.stdout:0/753: write d5/d11/d32/f91 [4676590,86190] 0 2023-12-05T09:57:39.928 INFO:tasks.workunit.client.1.smithi150.stdout:0/754: chown d5/d11/d71/d5f/d77/c7e 3 1 2023-12-05T09:57:39.928 INFO:tasks.workunit.client.1.smithi150.stdout:0/755: fdatasync d5/d11/d71/d99/d9c/d3b/fbc 0 2023-12-05T09:57:39.928 INFO:tasks.workunit.client.1.smithi150.stdout:3/720: mknod d6/d9/d3d/d8a/cea 0 2023-12-05T09:57:39.931 INFO:tasks.workunit.client.1.smithi150.stdout:7/711: creat d2/db/d30/d13/fe9 x:0 0 0 2023-12-05T09:57:39.931 INFO:tasks.workunit.client.1.smithi150.stdout:7/712: creat d2/db/d30/d47/fea x:0 0 0 2023-12-05T09:57:39.931 INFO:tasks.workunit.client.1.smithi150.stdout:7/713: fdatasync d2/d9d/da0/fb9 0 2023-12-05T09:57:39.931 INFO:tasks.workunit.client.1.smithi150.stdout:7/714: write d2/db/d17/d38/d85/f8b [257358,26328] 0 2023-12-05T09:57:39.931 INFO:tasks.workunit.client.1.smithi150.stdout:7/715: write d2/db/d17/d88/fd6 [411460,42395] 0 2023-12-05T09:57:39.932 INFO:tasks.workunit.client.1.smithi150.stdout:2/736: rename d0/d3/d11/c3e to d0/d3/d27/d95/ddf/cfd 0 2023-12-05T09:57:39.933 INFO:tasks.workunit.client.1.smithi150.stdout:2/737: readlink d0/d3/d5/d13/d15/l17 0 2023-12-05T09:57:39.933 INFO:tasks.workunit.client.1.smithi150.stdout:2/738: fsync d0/d3/f70 0 2023-12-05T09:57:39.934 INFO:tasks.workunit.client.1.smithi150.stdout:1/697: mkdir d6/d38/df9 0 2023-12-05T09:57:39.938 INFO:tasks.workunit.client.0.smithi100.stdout:0/648: creat da/d1b/d36/db4/fc0 x:0 0 0 2023-12-05T09:57:39.939 INFO:tasks.workunit.client.0.smithi100.stdout:0/649: fsync da/f2c 0 2023-12-05T09:57:39.946 INFO:tasks.workunit.client.0.smithi100.stdout:4/643: mkdir de/d16/d23/d33/dae/dd1 0 2023-12-05T09:57:39.948 INFO:tasks.workunit.client.0.smithi100.stdout:0/650: rename da/fb1 to da/d1b/d36/db4/fc1 0 2023-12-05T09:57:39.950 INFO:tasks.workunit.client.0.smithi100.stdout:8/633: dread d0/d12/d13/d16/f79 [0,4194304] 0 2023-12-05T09:57:39.954 INFO:tasks.workunit.client.1.smithi150.stdout:0/756: mknod d5/d11/d16/c109 0 2023-12-05T09:57:39.958 INFO:tasks.workunit.client.0.smithi100.stdout:8/634: creat d0/d35/d64/d81/d9a/d9d/fb2 x:0 0 0 2023-12-05T09:57:39.959 INFO:tasks.workunit.client.1.smithi150.stdout:7/716: symlink d2/d72/leb 0 2023-12-05T09:57:39.960 INFO:tasks.workunit.client.0.smithi100.stdout:4/644: symlink de/ld2 0 2023-12-05T09:57:39.960 INFO:tasks.workunit.client.0.smithi100.stdout:4/645: chown de/d38/d5d/f5e 3000 1 2023-12-05T09:57:39.961 INFO:tasks.workunit.client.1.smithi150.stdout:2/739: rmdir d0/da3 39 2023-12-05T09:57:39.964 INFO:tasks.workunit.client.1.smithi150.stdout:1/698: getdents d6/d8/d54 0 2023-12-05T09:57:39.964 INFO:tasks.workunit.client.0.smithi100.stdout:8/635: mknod d0/d12/d13/d16/da3/cb3 0 2023-12-05T09:57:39.964 INFO:tasks.workunit.client.1.smithi150.stdout:1/699: write d6/d38/f43 [1315021,94083] 0 2023-12-05T09:57:39.965 INFO:tasks.workunit.client.1.smithi150.stdout:1/700: creat d6/d3c/dc2/ffa x:0 0 0 2023-12-05T09:57:39.965 INFO:tasks.workunit.client.0.smithi100.stdout:4/646: mkdir de/d16/d23/d33/dae/dd3 0 2023-12-05T09:57:39.967 INFO:tasks.workunit.client.1.smithi150.stdout:7/717: creat d2/d1b/d31/da4/fec x:0 0 0 2023-12-05T09:57:39.967 INFO:tasks.workunit.client.1.smithi150.stdout:7/718: creat d2/db/d30/d47/fed x:0 0 0 2023-12-05T09:57:39.968 INFO:tasks.workunit.client.0.smithi100.stdout:5/697: dwrite d0/d4/d14/d35/f89 [0,4194304] 0 2023-12-05T09:57:39.968 INFO:tasks.workunit.client.0.smithi100.stdout:5/698: fsync d0/d1b/f39 0 2023-12-05T09:57:39.969 INFO:tasks.workunit.client.0.smithi100.stdout:8/636: rename d0/d35/l96 to d0/d35/d64/d81/lb4 0 2023-12-05T09:57:39.969 INFO:tasks.workunit.client.0.smithi100.stdout:8/637: chown d0/d12/d13/d16/f2e 21551698 1 2023-12-05T09:57:39.969 INFO:tasks.workunit.client.0.smithi100.stdout:8/638: chown d0/d12/d13/f3e 37 1 2023-12-05T09:57:39.972 INFO:tasks.workunit.client.0.smithi100.stdout:4/647: mknod de/d38/cd4 0 2023-12-05T09:57:39.974 INFO:tasks.workunit.client.1.smithi150.stdout:1/701: rmdir d6/d47/d4c/dd9/d75/ddd 39 2023-12-05T09:57:39.974 INFO:tasks.workunit.client.1.smithi150.stdout:1/702: truncate d6/d47/d4c/dd9/d75/da5/fc3 360452 0 2023-12-05T09:57:39.974 INFO:tasks.workunit.client.0.smithi100.stdout:9/694: dwrite d7/d20/d68/fe9 [0,4194304] 0 2023-12-05T09:57:39.977 INFO:tasks.workunit.client.0.smithi100.stdout:9/695: chown d7/d1b/d22/fac 738 1 2023-12-05T09:57:39.977 INFO:tasks.workunit.client.0.smithi100.stdout:9/696: stat d7/d1b/d22/d2a/f6b 0 2023-12-05T09:57:39.978 INFO:tasks.workunit.client.0.smithi100.stdout:5/699: creat d0/d16/dc9/ffb x:0 0 0 2023-12-05T09:57:39.978 INFO:tasks.workunit.client.0.smithi100.stdout:5/700: fsync d0/d4/d14/d35/d62/fca 0 2023-12-05T09:57:39.981 INFO:tasks.workunit.client.0.smithi100.stdout:4/648: link de/d16/d23/d36/c94 de/d16/cd5 0 2023-12-05T09:57:39.982 INFO:tasks.workunit.client.1.smithi150.stdout:2/740: dread d0/d3/d21/f2c [0,4194304] 0 2023-12-05T09:57:39.987 INFO:tasks.workunit.client.0.smithi100.stdout:5/701: mkdir d0/d16/d2b/d48/df/d51/da8/dee/dfc 0 2023-12-05T09:57:39.989 INFO:tasks.workunit.client.0.smithi100.stdout:4/649: chown de/f1b 13 1 2023-12-05T09:57:39.989 INFO:tasks.workunit.client.0.smithi100.stdout:4/650: readlink de/d38/d8b/l91 0 2023-12-05T09:57:39.989 INFO:tasks.workunit.client.0.smithi100.stdout:4/651: fsync de/d16/d23/f24 0 2023-12-05T09:57:39.989 INFO:tasks.workunit.client.1.smithi150.stdout:7/719: creat d2/fee x:0 0 0 2023-12-05T09:57:39.989 INFO:tasks.workunit.client.1.smithi150.stdout:7/720: dread - d2/db/d30/d47/fed zero size 2023-12-05T09:57:39.989 INFO:tasks.workunit.client.1.smithi150.stdout:3/721: dread d6/d9/f57 [0,4194304] 0 2023-12-05T09:57:39.990 INFO:tasks.workunit.client.1.smithi150.stdout:4/645: dwrite d0/d3e/d6d/f37 [0,4194304] 0 2023-12-05T09:57:39.991 INFO:tasks.workunit.client.0.smithi100.stdout:3/795: dwrite d0/d3d/fb2 [0,4194304] 0 2023-12-05T09:57:39.993 INFO:tasks.workunit.client.0.smithi100.stdout:9/697: link d7/d20/c98 d7/db5/cf2 0 2023-12-05T09:57:39.994 INFO:tasks.workunit.client.1.smithi150.stdout:9/644: dwrite d3/d1b/d46/d55/d64/f88 [0,4194304] 0 2023-12-05T09:57:39.995 INFO:tasks.workunit.client.0.smithi100.stdout:5/702: mknod d0/d1b/d4d/d8e/d96/dc1/dae/db9/dd2/cfd 0 2023-12-05T09:57:39.995 INFO:tasks.workunit.client.0.smithi100.stdout:1/676: dwrite db/d12/d1e/d26/d30/d52/f77 [0,4194304] 0 2023-12-05T09:57:39.999 INFO:tasks.workunit.client.0.smithi100.stdout:4/652: rename de/d16/d23/d36/c8e to de/d38/d8b/cd6 0 2023-12-05T09:57:39.999 INFO:tasks.workunit.client.0.smithi100.stdout:4/653: getdents de/d16/d23 0 2023-12-05T09:57:40.000 INFO:tasks.workunit.client.1.smithi150.stdout:5/707: dwrite d1/d7f/d65/d3b/f84 [0,4194304] 0 2023-12-05T09:57:40.001 INFO:tasks.workunit.client.1.smithi150.stdout:4/646: creat d0/d3e/d5b/d80/d44/da2/dbd/fcb x:0 0 0 2023-12-05T09:57:40.001 INFO:tasks.workunit.client.1.smithi150.stdout:1/703: write d6/d8/db/f35 [3033888,6144] 0 2023-12-05T09:57:40.002 INFO:tasks.workunit.client.1.smithi150.stdout:8/766: dwrite d0/d41/d49/fcb [0,4194304] 0 2023-12-05T09:57:40.002 INFO:tasks.workunit.client.1.smithi150.stdout:8/767: write d0/d41/d49/d1b/d24/d2e/d30/f36 [1530620,12964] 0 2023-12-05T09:57:40.004 INFO:tasks.workunit.client.0.smithi100.stdout:3/796: mknod d0/d2/de/db8/dee/df6/c10f 0 2023-12-05T09:57:40.015 INFO:tasks.workunit.client.0.smithi100.stdout:1/677: dread db/d12/d61/f64 [0,4194304] 0 2023-12-05T09:57:40.015 INFO:tasks.workunit.client.0.smithi100.stdout:1/678: rename db/d12/d1e/d26/d30/d52/dd0 to db/d12/d1e/d26/d30/d52/dd0/dd6/ddb 22 2023-12-05T09:57:40.015 INFO:tasks.workunit.client.0.smithi100.stdout:1/679: write db/d12/d1e/d26/f62 [4534252,8181] 0 2023-12-05T09:57:40.015 INFO:tasks.workunit.client.0.smithi100.stdout:9/698: getdents d7/d1b/d22/d93 0 2023-12-05T09:57:40.018 INFO:tasks.workunit.client.0.smithi100.stdout:0/651: dwrite da/d22/d33/d35/d3a/f67 [4194304,4194304] 0 2023-12-05T09:57:40.022 INFO:tasks.workunit.client.0.smithi100.stdout:0/652: stat da/d2a/d4d/c65 0 2023-12-05T09:57:40.022 INFO:tasks.workunit.client.0.smithi100.stdout:0/653: chown da/d2a/d4d/l53 5789194 1 2023-12-05T09:57:40.022 INFO:tasks.workunit.client.0.smithi100.stdout:0/654: dread - da/d22/d33/d7f/d94/f9e zero size 2023-12-05T09:57:40.022 INFO:tasks.workunit.client.0.smithi100.stdout:0/655: fdatasync da/d22/d33/d7f/d94/f9c 0 2023-12-05T09:57:40.022 INFO:tasks.workunit.client.0.smithi100.stdout:0/656: truncate da/d22/d33/d35/d3a/fa1 392949 0 2023-12-05T09:57:40.025 INFO:tasks.workunit.client.0.smithi100.stdout:5/703: truncate d0/d1b/d4d/d8e/d96/dc1/dae/fb2 3209048 0 2023-12-05T09:57:40.027 INFO:tasks.workunit.client.1.smithi150.stdout:2/741: dread d0/d3/d5/d3b/d4c/d71/fc2 [0,4194304] 0 2023-12-05T09:57:40.027 INFO:tasks.workunit.client.1.smithi150.stdout:2/742: readlink d0/d3/d5/d13/l92 0 2023-12-05T09:57:40.029 INFO:tasks.workunit.client.1.smithi150.stdout:1/704: read d6/d47/d4c/dd9/f22 [137242,113924] 0 2023-12-05T09:57:40.040 INFO:tasks.workunit.client.1.smithi150.stdout:5/708: mkdir d1/d64/dfc 0 2023-12-05T09:57:40.040 INFO:tasks.workunit.client.1.smithi150.stdout:5/709: dread - d1/d7f/d65/d3b/fdc zero size 2023-12-05T09:57:40.043 INFO:tasks.workunit.client.1.smithi150.stdout:4/647: rmdir d0/d3e/d6d/d4b 39 2023-12-05T09:57:40.043 INFO:tasks.workunit.client.1.smithi150.stdout:4/648: write d0/d3e/d48/f52 [749000,66330] 0 2023-12-05T09:57:40.050 INFO:tasks.workunit.client.1.smithi150.stdout:2/743: unlink d0/d3/d5/d22/l66 0 2023-12-05T09:57:40.051 INFO:tasks.workunit.client.0.smithi100.stdout:8/639: dwrite d0/d12/d13/d45/da6/d76/d91/faa [0,4194304] 0 2023-12-05T09:57:40.052 INFO:tasks.workunit.client.0.smithi100.stdout:9/699: dread d7/d1b/d22/d93/f9f [0,4194304] 0 2023-12-05T09:57:40.053 INFO:tasks.workunit.client.0.smithi100.stdout:9/700: chown d7/d1b/d89 15020 1 2023-12-05T09:57:40.053 INFO:tasks.workunit.client.1.smithi150.stdout:1/705: unlink d6/d38/fed 0 2023-12-05T09:57:40.054 INFO:tasks.workunit.client.0.smithi100.stdout:8/640: getdents d0/d12/d13/d45/da6/d9c 0 2023-12-05T09:57:40.057 INFO:tasks.workunit.client.1.smithi150.stdout:5/710: rename d1/d64/d31/d5b/ddf/de4 to d1/d64/dfd 0 2023-12-05T09:57:40.061 INFO:tasks.workunit.client.1.smithi150.stdout:1/706: mknod d6/d38/d4a/cfb 0 2023-12-05T09:57:40.061 INFO:tasks.workunit.client.1.smithi150.stdout:1/707: fsync d6/d8/d54/f87 0 2023-12-05T09:57:40.061 INFO:tasks.workunit.client.1.smithi150.stdout:1/708: fdatasync d6/d47/d4c/dd9/ff 0 2023-12-05T09:57:40.062 INFO:tasks.workunit.client.0.smithi100.stdout:8/641: rename d0/d12/d13/d16/d42/fb0 to d0/d12/d13/d16/d22/d82/fb5 0 2023-12-05T09:57:40.062 INFO:tasks.workunit.client.0.smithi100.stdout:8/642: fdatasync d0/d35/f39 0 2023-12-05T09:57:40.066 INFO:tasks.workunit.client.1.smithi150.stdout:2/744: rename d0/d3/d5/d13/d15/d30/d54/d57/f88 to d0/d3/d5/d22/ffe 0 2023-12-05T09:57:40.067 INFO:tasks.workunit.client.1.smithi150.stdout:3/722: dwrite d6/d9/d43/f60 [0,4194304] 0 2023-12-05T09:57:40.069 INFO:tasks.workunit.client.0.smithi100.stdout:9/701: write d7/d1b/d22/d51/f2d [3661231,13745] 0 2023-12-05T09:57:40.070 INFO:tasks.workunit.client.1.smithi150.stdout:5/711: mkdir d1/d3/d6/d1b/dfe 0 2023-12-05T09:57:40.070 INFO:tasks.workunit.client.0.smithi100.stdout:4/654: dwrite de/f1b [0,4194304] 0 2023-12-05T09:57:40.070 INFO:tasks.workunit.client.0.smithi100.stdout:4/655: chown de/d16/d1e/l40 477279 1 2023-12-05T09:57:40.070 INFO:tasks.workunit.client.0.smithi100.stdout:4/656: fsync de/f11 0 2023-12-05T09:57:40.070 INFO:tasks.workunit.client.0.smithi100.stdout:4/657: dread - de/d38/d8b/fc7 zero size 2023-12-05T09:57:40.071 INFO:tasks.workunit.client.1.smithi150.stdout:4/649: getdents d0/d3e/d5b/d80/d44 0 2023-12-05T09:57:40.071 INFO:tasks.workunit.client.1.smithi150.stdout:4/650: chown d0/d3e/d48/d4d/f97 33 1 2023-12-05T09:57:40.071 INFO:tasks.workunit.client.1.smithi150.stdout:4/651: chown d0/d3e/d6d/d4b/c7d 223 1 2023-12-05T09:57:40.073 INFO:tasks.workunit.client.0.smithi100.stdout:0/657: dwrite da/d22/d33/d7f/d94/f9e [0,4194304] 0 2023-12-05T09:57:40.076 INFO:tasks.workunit.client.0.smithi100.stdout:9/702: rmdir d7/d20 39 2023-12-05T09:57:40.080 INFO:tasks.workunit.client.1.smithi150.stdout:7/721: dwrite d2/db/d30/daf/dd3/d2b/fc1 [0,4194304] 0 2023-12-05T09:57:40.083 INFO:tasks.workunit.client.0.smithi100.stdout:0/658: stat da/d1b/l1c 0 2023-12-05T09:57:40.083 INFO:tasks.workunit.client.0.smithi100.stdout:3/797: dwrite d0/d10/d39/f98 [0,4194304] 0 2023-12-05T09:57:40.083 INFO:tasks.workunit.client.0.smithi100.stdout:0/659: creat da/d22/d33/d35/d3a/d8b/d8f/fc2 x:0 0 0 2023-12-05T09:57:40.084 INFO:tasks.workunit.client.0.smithi100.stdout:0/660: write da/d22/d33/d35/d3a/fa1 [1245135,8973] 0 2023-12-05T09:57:40.084 INFO:tasks.workunit.client.0.smithi100.stdout:5/704: dwrite d0/d16/d2b/f82 [0,4194304] 0 2023-12-05T09:57:40.084 INFO:tasks.workunit.client.0.smithi100.stdout:5/705: fdatasync d0/d4/d14/d35/fb3 0 2023-12-05T09:57:40.086 INFO:tasks.workunit.client.0.smithi100.stdout:9/703: rename d7/ce to d7/d1b/d22/d2a/d56/d9c/daa/cf3 0 2023-12-05T09:57:40.086 INFO:tasks.workunit.client.1.smithi150.stdout:4/652: mknod d0/d3e/d5b/d80/ccc 0 2023-12-05T09:57:40.087 INFO:tasks.workunit.client.0.smithi100.stdout:2/806: sync 2023-12-05T09:57:40.087 INFO:tasks.workunit.client.0.smithi100.stdout:7/648: sync 2023-12-05T09:57:40.087 INFO:tasks.workunit.client.0.smithi100.stdout:2/807: write d7/da/d65/f77 [3110219,24723] 0 2023-12-05T09:57:40.102 INFO:tasks.workunit.client.1.smithi150.stdout:4/653: rename d0/d3e/d5b/c75 to d0/d3e/ccd 0 2023-12-05T09:57:40.103 INFO:tasks.workunit.client.1.smithi150.stdout:7/722: write d2/db/d30/d18/f6c [1643223,119156] 0 2023-12-05T09:57:40.103 INFO:tasks.workunit.client.1.smithi150.stdout:7/723: write d2/db/d30/d47/fed [203188,87672] 0 2023-12-05T09:57:40.104 INFO:tasks.workunit.client.0.smithi100.stdout:5/706: rmdir d0/d16/d2b/d48/df/d51/da8/dee/dfc 0 2023-12-05T09:57:40.112 INFO:tasks.workunit.client.1.smithi150.stdout:4/654: creat d0/d3e/d5b/d80/dc8/fce x:0 0 0 2023-12-05T09:57:40.114 INFO:tasks.workunit.client.1.smithi150.stdout:7/724: symlink d2/db/d30/d13/d4f/d7e/lef 0 2023-12-05T09:57:40.115 INFO:tasks.workunit.client.0.smithi100.stdout:9/704: creat d7/d1b/d22/d51/d32/d96/ff4 x:0 0 0 2023-12-05T09:57:40.117 INFO:tasks.workunit.client.0.smithi100.stdout:4/658: dwrite de/d16/f45 [0,4194304] 0 2023-12-05T09:57:40.118 INFO:tasks.workunit.client.1.smithi150.stdout:3/723: dwrite d6/f17 [0,4194304] 0 2023-12-05T09:57:40.118 INFO:tasks.workunit.client.1.smithi150.stdout:3/724: write d6/d9/d8d/fe3 [849546,67644] 0 2023-12-05T09:57:40.118 INFO:tasks.workunit.client.1.smithi150.stdout:4/655: write d0/f3a [565770,117735] 0 2023-12-05T09:57:40.120 INFO:tasks.workunit.client.0.smithi100.stdout:3/798: rename d0/d3d/d90/def to d0/d2/de/d8d/dc9/d110 0 2023-12-05T09:57:40.120 INFO:tasks.workunit.client.0.smithi100.stdout:3/799: fdatasync d0/d2/de/d8d/fc1 0 2023-12-05T09:57:40.121 INFO:tasks.workunit.client.1.smithi150.stdout:1/709: write d6/d8/d59/fc0 [2206503,101056] 0 2023-12-05T09:57:40.125 INFO:tasks.workunit.client.1.smithi150.stdout:6/631: sync 2023-12-05T09:57:40.125 INFO:tasks.workunit.client.1.smithi150.stdout:6/632: chown d2/d23/d3b/d64/c9f 3394346 1 2023-12-05T09:57:40.126 INFO:tasks.workunit.client.1.smithi150.stdout:4/656: symlink d0/d3e/d5b/d80/dc8/lcf 0 2023-12-05T09:57:40.127 INFO:tasks.workunit.client.1.smithi150.stdout:4/657: write d0/d3e/d48/f53 [110785,84333] 0 2023-12-05T09:57:40.129 INFO:tasks.workunit.client.1.smithi150.stdout:6/633: write d2/d23/d2e/f94 [1218502,69629] 0 2023-12-05T09:57:40.134 INFO:tasks.workunit.client.0.smithi100.stdout:9/705: write d7/d20/d69/f72 [1998740,93401] 0 2023-12-05T09:57:40.138 INFO:tasks.workunit.client.0.smithi100.stdout:8/643: write d0/d35/f6d [5171279,107584] 0 2023-12-05T09:57:40.139 INFO:tasks.workunit.client.1.smithi150.stdout:5/712: read d1/d7f/d65/f9f [481081,103159] 0 2023-12-05T09:57:40.139 INFO:tasks.workunit.client.1.smithi150.stdout:5/713: readlink d1/d7f/d65/d3b/d37/l9c 0 2023-12-05T09:57:40.139 INFO:tasks.workunit.client.1.smithi150.stdout:5/714: fdatasync d1/d2e/fa1 0 2023-12-05T09:57:40.140 INFO:tasks.workunit.client.1.smithi150.stdout:3/725: write d6/d9/d43/f60 [2482066,47486] 0 2023-12-05T09:57:40.141 INFO:tasks.workunit.client.1.smithi150.stdout:3/726: read - d6/d9/d3d/d56/d53/fd0 zero size 2023-12-05T09:57:40.141 INFO:tasks.workunit.client.1.smithi150.stdout:3/727: fdatasync d6/d9/d3d/d56/f7d 0 2023-12-05T09:57:40.142 INFO:tasks.workunit.client.0.smithi100.stdout:5/707: link d0/d16/f68 d0/d1b/ffe 0 2023-12-05T09:57:40.142 INFO:tasks.workunit.client.0.smithi100.stdout:0/661: dwrite da/d1b/f54 [0,4194304] 0 2023-12-05T09:57:40.142 INFO:tasks.workunit.client.0.smithi100.stdout:0/662: fdatasync da/d1b/d73/d82/f8a 0 2023-12-05T09:57:40.142 INFO:tasks.workunit.client.1.smithi150.stdout:2/745: dwrite d0/d3/d21/d4d/deb/d86/fce [0,4194304] 0 2023-12-05T09:57:40.144 INFO:tasks.workunit.client.1.smithi150.stdout:5/715: creat d1/d3/d6/d1b/fff x:0 0 0 2023-12-05T09:57:40.149 INFO:tasks.workunit.client.0.smithi100.stdout:3/800: write d0/d3d/f6c [757989,54361] 0 2023-12-05T09:57:40.149 INFO:tasks.workunit.client.0.smithi100.stdout:3/801: chown d0/d3d/d5c/d5f/ca1 68 1 2023-12-05T09:57:40.154 INFO:tasks.workunit.client.1.smithi150.stdout:3/728: symlink d6/d9/d3d/d8a/leb 0 2023-12-05T09:57:40.155 INFO:tasks.workunit.client.0.smithi100.stdout:4/659: mknod de/d16/d23/d36/cd7 0 2023-12-05T09:57:40.158 INFO:tasks.workunit.client.1.smithi150.stdout:5/716: rename d1/d2e/da6/l4e to d1/d3/d6/d26/dca/de2/l100 0 2023-12-05T09:57:40.159 INFO:tasks.workunit.client.1.smithi150.stdout:4/658: getdents d0/d3e/d5b/d80 0 2023-12-05T09:57:40.159 INFO:tasks.workunit.client.1.smithi150.stdout:4/659: fsync d0/d3e/d5b/d80/da1/fbf 0 2023-12-05T09:57:40.165 INFO:tasks.workunit.client.1.smithi150.stdout:5/717: unlink d1/d7f/d65/d3b/d8d/ce6 0 2023-12-05T09:57:40.168 INFO:tasks.workunit.client.1.smithi150.stdout:4/660: link d0/d3e/d5b/d80/d44/da2/da4/fc5 d0/d3e/d5b/d6e/daa/fd0 0 2023-12-05T09:57:40.169 INFO:tasks.workunit.client.1.smithi150.stdout:1/710: dwrite d6/d8/d85/f9b [0,4194304] 0 2023-12-05T09:57:40.173 INFO:tasks.workunit.client.0.smithi100.stdout:5/708: mkdir d0/d1b/d4d/d8e/d96/dea/dff 0 2023-12-05T09:57:40.173 INFO:tasks.workunit.client.0.smithi100.stdout:5/709: write d0/d1f/f2e [4049220,3737] 0 2023-12-05T09:57:40.173 INFO:tasks.workunit.client.0.smithi100.stdout:5/710: chown d0/d1f/d53 1044535095 1 2023-12-05T09:57:40.176 INFO:tasks.workunit.client.0.smithi100.stdout:0/663: rmdir da/d2a 39 2023-12-05T09:57:40.176 INFO:tasks.workunit.client.0.smithi100.stdout:0/664: fsync da/d22/d33/d35/d3a/fa1 0 2023-12-05T09:57:40.176 INFO:tasks.workunit.client.0.smithi100.stdout:0/665: write da/d1b/d73/d82/f8a [3863680,64246] 0 2023-12-05T09:57:40.176 INFO:tasks.workunit.client.0.smithi100.stdout:0/666: write da/d22/d33/d74/fa8 [321314,33559] 0 2023-12-05T09:57:40.178 INFO:tasks.workunit.client.1.smithi150.stdout:1/711: symlink d6/d8/lfc 0 2023-12-05T09:57:40.180 INFO:tasks.workunit.client.0.smithi100.stdout:4/660: symlink de/d38/d5d/ld8 0 2023-12-05T09:57:40.180 INFO:tasks.workunit.client.0.smithi100.stdout:9/706: mknod d7/cf5 0 2023-12-05T09:57:40.185 INFO:tasks.workunit.client.1.smithi150.stdout:1/712: getdents d6/d8/db/d1b/d79 0 2023-12-05T09:57:40.189 INFO:tasks.workunit.client.1.smithi150.stdout:3/729: dread d6/d9/d43/f60 [0,4194304] 0 2023-12-05T09:57:40.189 INFO:tasks.workunit.client.0.smithi100.stdout:2/808: write d7/da/d1a/f73 [1802775,34386] 0 2023-12-05T09:57:40.190 INFO:tasks.workunit.client.1.smithi150.stdout:4/661: dread d0/d3e/d48/f4e [0,4194304] 0 2023-12-05T09:57:40.190 INFO:tasks.workunit.client.1.smithi150.stdout:4/662: write d0/d3e/d6d/fc3 [1007940,34444] 0 2023-12-05T09:57:40.190 INFO:tasks.workunit.client.1.smithi150.stdout:4/663: fdatasync d0/d3e/d5b/d80/f7b 0 2023-12-05T09:57:40.190 INFO:tasks.workunit.client.1.smithi150.stdout:4/664: write d0/d5f/f82 [782788,70271] 0 2023-12-05T09:57:40.190 INFO:tasks.workunit.client.1.smithi150.stdout:4/665: chown d0/d3e/f76 33 1 2023-12-05T09:57:40.191 INFO:tasks.workunit.client.1.smithi150.stdout:4/666: dread - d0/d3e/d5b/d80/f7b zero size 2023-12-05T09:57:40.191 INFO:tasks.workunit.client.1.smithi150.stdout:4/667: dread - d0/d3e/d5b/d80/d44/f46 zero size 2023-12-05T09:57:40.191 INFO:tasks.workunit.client.1.smithi150.stdout:4/668: getdents d0/d3e/d5b/d80/da1/db2/dbe 0 2023-12-05T09:57:40.193 INFO:tasks.workunit.client.1.smithi150.stdout:1/713: getdents d6/d8/db/db1 0 2023-12-05T09:57:40.195 INFO:tasks.workunit.client.0.smithi100.stdout:8/644: dwrite d0/d12/d13/d16/d22/f26 [0,4194304] 0 2023-12-05T09:57:40.196 INFO:tasks.workunit.client.0.smithi100.stdout:8/645: readlink d0/d12/d13/d16/l83 0 2023-12-05T09:57:40.196 INFO:tasks.workunit.client.1.smithi150.stdout:6/634: dwrite d2/d23/d2e/d93/fba [4194304,4194304] 0 2023-12-05T09:57:40.201 INFO:tasks.workunit.client.0.smithi100.stdout:0/667: dread da/d22/d33/d35/d3a/fbc [0,4194304] 0 2023-12-05T09:57:40.207 INFO:tasks.workunit.client.1.smithi150.stdout:3/730: rmdir d6/d9/d43/d47/d94 39 2023-12-05T09:57:40.207 INFO:tasks.workunit.client.1.smithi150.stdout:3/731: stat d6/d9/d3d/d56/d79/le2 0 2023-12-05T09:57:40.207 INFO:tasks.workunit.client.1.smithi150.stdout:1/714: creat d6/d47/d4c/dd9/ffd x:0 0 0 2023-12-05T09:57:40.207 INFO:tasks.workunit.client.1.smithi150.stdout:5/718: dread d1/d7f/d65/f9f [0,4194304] 0 2023-12-05T09:57:40.208 INFO:tasks.workunit.client.0.smithi100.stdout:4/661: mknod de/d16/d23/d33/d3d/d44/d4e/dbe/cd9 0 2023-12-05T09:57:40.208 INFO:tasks.workunit.client.0.smithi100.stdout:9/707: write d7/d20/f3a [5233862,117264] 0 2023-12-05T09:57:40.208 INFO:tasks.workunit.client.0.smithi100.stdout:9/708: write d7/d20/d69/def/fb0 [849066,114589] 0 2023-12-05T09:57:40.208 INFO:tasks.workunit.client.0.smithi100.stdout:9/709: fsync d7/d35/f55 0 2023-12-05T09:57:40.208 INFO:tasks.workunit.client.0.smithi100.stdout:9/710: chown d7/d1b/d22/d2a/d56/d9c 591453 1 2023-12-05T09:57:40.211 INFO:tasks.workunit.client.0.smithi100.stdout:2/809: rmdir d7/da/d18/d21/d10d 0 2023-12-05T09:57:40.212 INFO:tasks.workunit.client.1.smithi150.stdout:2/746: dwrite d0/d3/d21/d4d/f90 [0,4194304] 0 2023-12-05T09:57:40.213 INFO:tasks.workunit.client.0.smithi100.stdout:8/646: truncate d0/d12/d13/d16/d42/fac 4532486 0 2023-12-05T09:57:40.214 INFO:tasks.workunit.client.1.smithi150.stdout:1/715: mknod d6/d47/dcf/cfe 0 2023-12-05T09:57:40.215 INFO:tasks.workunit.client.0.smithi100.stdout:0/668: creat da/d2a/fc3 x:0 0 0 2023-12-05T09:57:40.215 INFO:tasks.workunit.client.0.smithi100.stdout:0/669: fsync da/d22/d33/d7f/d94/f9e 0 2023-12-05T09:57:40.215 INFO:tasks.workunit.client.0.smithi100.stdout:5/711: dread d0/d4/fa [4194304,4194304] 0 2023-12-05T09:57:40.215 INFO:tasks.workunit.client.0.smithi100.stdout:5/712: chown d0/d1b/d4d/d60 6209792 1 2023-12-05T09:57:40.215 INFO:tasks.workunit.client.0.smithi100.stdout:0/670: write da/f11 [8108215,127397] 0 2023-12-05T09:57:40.216 INFO:tasks.workunit.client.0.smithi100.stdout:0/671: chown da/d22/d33/d35/l4e 15 1 2023-12-05T09:57:40.216 INFO:tasks.workunit.client.1.smithi150.stdout:5/719: mknod d1/d64/ded/c101 0 2023-12-05T09:57:40.216 INFO:tasks.workunit.client.1.smithi150.stdout:5/720: fsync d1/d3/d6/d72/f8f 0 2023-12-05T09:57:40.219 INFO:tasks.workunit.client.0.smithi100.stdout:4/662: link de/d16/d23/d36/f3a de/d16/d1e/fda 0 2023-12-05T09:57:40.221 INFO:tasks.workunit.client.0.smithi100.stdout:9/711: symlink d7/d1b/d22/d2a/d56/d2e/lf6 0 2023-12-05T09:57:40.226 INFO:tasks.workunit.client.0.smithi100.stdout:2/810: unlink d7/da/d18/d1b/d2c/d3f/c4c 0 2023-12-05T09:57:40.226 INFO:tasks.workunit.client.0.smithi100.stdout:2/811: write d7/da/d18/d1b/f59 [1482745,118366] 0 2023-12-05T09:57:40.226 INFO:tasks.workunit.client.1.smithi150.stdout:3/732: dread d6/d9/fbd [0,4194304] 0 2023-12-05T09:57:40.233 INFO:tasks.workunit.client.0.smithi100.stdout:0/672: unlink da/l1a 0 2023-12-05T09:57:40.234 INFO:tasks.workunit.client.0.smithi100.stdout:0/673: write da/d60/fb9 [615626,20041] 0 2023-12-05T09:57:40.235 INFO:tasks.workunit.client.1.smithi150.stdout:5/721: link d1/d7f/d65/d3b/l18 d1/d7f/d65/l102 0 2023-12-05T09:57:40.237 INFO:tasks.workunit.client.1.smithi150.stdout:3/733: creat d6/d9/d3d/d56/d71/db6/db2/fec x:0 0 0 2023-12-05T09:57:40.237 INFO:tasks.workunit.client.1.smithi150.stdout:3/734: creat d6/d9/d3d/d87/fed x:0 0 0 2023-12-05T09:57:40.238 INFO:tasks.workunit.client.1.smithi150.stdout:2/747: dread d0/d3/d5/d3b/d4c/f64 [0,4194304] 0 2023-12-05T09:57:40.239 INFO:tasks.workunit.client.1.smithi150.stdout:3/735: mknod d6/d22/d37/da1/cee 0 2023-12-05T09:57:40.240 INFO:tasks.workunit.client.0.smithi100.stdout:9/712: creat d7/d20/d69/def/ff7 x:0 0 0 2023-12-05T09:57:40.241 INFO:tasks.workunit.client.0.smithi100.stdout:8/647: rmdir d0/d35/d64 39 2023-12-05T09:57:40.246 INFO:tasks.workunit.client.0.smithi100.stdout:4/663: rmdir de/d66 39 2023-12-05T09:57:40.246 INFO:tasks.workunit.client.0.smithi100.stdout:9/713: getdents d7/d1b/d22/d2a/d56/d2e/d50 0 2023-12-05T09:57:40.246 INFO:tasks.workunit.client.0.smithi100.stdout:2/812: dread d7/da/d13/d69/d6e/d71/f8c [0,4194304] 0 2023-12-05T09:57:40.246 INFO:tasks.workunit.client.0.smithi100.stdout:8/648: mknod d0/d12/d13/cb6 0 2023-12-05T09:57:40.246 INFO:tasks.workunit.client.0.smithi100.stdout:0/674: dread da/d1b/d6b/fa7 [0,4194304] 0 2023-12-05T09:57:40.248 INFO:tasks.workunit.client.1.smithi150.stdout:3/736: truncate d6/d22/f31 335344 0 2023-12-05T09:57:40.248 INFO:tasks.workunit.client.1.smithi150.stdout:3/737: readlink d6/d9/l99 0 2023-12-05T09:57:40.248 INFO:tasks.workunit.client.1.smithi150.stdout:3/738: fdatasync d6/d9/d3d/d56/d53/fd0 0 2023-12-05T09:57:40.248 INFO:tasks.workunit.client.1.smithi150.stdout:3/739: dread - d6/d9/d3d/d56/d53/f78 zero size 2023-12-05T09:57:40.248 INFO:tasks.workunit.client.1.smithi150.stdout:3/740: read d6/d9/fbd [2993760,36506] 0 2023-12-05T09:57:40.248 INFO:tasks.workunit.client.1.smithi150.stdout:6/635: write d2/d23/d2e/f43 [2759326,27988] 0 2023-12-05T09:57:40.248 INFO:tasks.workunit.client.1.smithi150.stdout:4/669: dwrite d0/d3e/d48/f4e [0,4194304] 0 2023-12-05T09:57:40.248 INFO:tasks.workunit.client.1.smithi150.stdout:6/636: symlink d2/d23/d2e/d93/d97/ld5 0 2023-12-05T09:57:40.248 INFO:tasks.workunit.client.0.smithi100.stdout:9/714: creat d7/d1b/d22/d2a/d56/ff8 x:0 0 0 2023-12-05T09:57:40.249 INFO:tasks.workunit.client.0.smithi100.stdout:9/715: fdatasync d7/d1b/d22/d2a/f6b 0 2023-12-05T09:57:40.249 INFO:tasks.workunit.client.0.smithi100.stdout:9/716: fdatasync d7/d20/d68/f8a 0 2023-12-05T09:57:40.249 INFO:tasks.workunit.client.0.smithi100.stdout:9/717: stat d7/d1b/d22/d2a/d56/d9c 0 2023-12-05T09:57:40.249 INFO:tasks.workunit.client.0.smithi100.stdout:2/813: mknod d7/da/d18/d21/dae/c111 0 2023-12-05T09:57:40.256 INFO:tasks.workunit.client.0.smithi100.stdout:9/718: rename d7/d1b/d22/d2a/d56/d9c/daa/cb2 to d7/d1b/d22/d93/dd9/cf9 0 2023-12-05T09:57:40.256 INFO:tasks.workunit.client.0.smithi100.stdout:9/719: write d7/d20/d69/def/da2/feb [906188,118045] 0 2023-12-05T09:57:40.256 INFO:tasks.workunit.client.0.smithi100.stdout:7/649: dwrite d3/dc/d11/f1e [0,4194304] 0 2023-12-05T09:57:40.256 INFO:tasks.workunit.client.0.smithi100.stdout:7/650: chown d3/dc/d11/d13/de/d18/d3b/d40/d46/d9e 911 1 2023-12-05T09:57:40.264 INFO:tasks.workunit.client.1.smithi150.stdout:6/637: unlink d2/d23/d2e/c35 0 2023-12-05T09:57:40.265 INFO:tasks.workunit.client.1.smithi150.stdout:4/670: symlink d0/d3e/d48/d8a/ld1 0 2023-12-05T09:57:40.265 INFO:tasks.workunit.client.1.smithi150.stdout:4/671: dread - d0/d3e/d5b/d80/d44/da2/dbd/fcb zero size 2023-12-05T09:57:40.271 INFO:tasks.workunit.client.1.smithi150.stdout:0/757: sync 2023-12-05T09:57:40.273 INFO:tasks.workunit.client.0.smithi100.stdout:2/814: dread d7/da/d18/d1b/d2c/d3f/d46/f76 [0,4194304] 0 2023-12-05T09:57:40.274 INFO:tasks.workunit.client.1.smithi150.stdout:6/638: mkdir d2/d23/d2e/dd6 0 2023-12-05T09:57:40.274 INFO:tasks.workunit.client.1.smithi150.stdout:6/639: chown d2/d23/d2e/d72/f75 11 1 2023-12-05T09:57:40.274 INFO:tasks.workunit.client.1.smithi150.stdout:6/640: chown d2/d23/d3b/d64/d7a/d5d/d6b/c55 5672287 1 2023-12-05T09:57:40.275 INFO:tasks.workunit.client.1.smithi150.stdout:4/672: mknod d0/d3e/d5b/d80/d44/da2/da4/cd2 0 2023-12-05T09:57:40.284 INFO:tasks.workunit.client.1.smithi150.stdout:0/758: link d5/d11/d71/d99/d9c/d96/dd5/d67/da8/caa d5/d11/d71/d99/d9c/d96/de3/c10a 0 2023-12-05T09:57:40.290 INFO:tasks.workunit.client.0.smithi100.stdout:5/713: dwrite d0/d16/d2b/d75/fc5 [0,4194304] 0 2023-12-05T09:57:40.290 INFO:tasks.workunit.client.0.smithi100.stdout:5/714: fsync d0/d1b/d4d/ff7 0 2023-12-05T09:57:40.293 INFO:tasks.workunit.client.1.smithi150.stdout:4/673: symlink d0/d3e/d48/d8a/ld3 0 2023-12-05T09:57:40.293 INFO:tasks.workunit.client.1.smithi150.stdout:4/674: creat d0/d5f/fd4 x:0 0 0 2023-12-05T09:57:40.293 INFO:tasks.workunit.client.1.smithi150.stdout:2/748: dread d0/d3/d5/d13/d15/d30/d54/d57/fb4 [0,4194304] 0 2023-12-05T09:57:40.299 INFO:tasks.workunit.client.1.smithi150.stdout:2/749: creat d0/d3/d21/d4d/deb/d86/fff x:0 0 0 2023-12-05T09:57:40.299 INFO:tasks.workunit.client.1.smithi150.stdout:2/750: dread - d0/d3/d5/d10/d3d/da1/daa/fc7 zero size 2023-12-05T09:57:40.299 INFO:tasks.workunit.client.1.smithi150.stdout:2/751: chown d0/d3/d5/d13/d15/d30/d54/d57/dee 108777871 1 2023-12-05T09:57:40.299 INFO:tasks.workunit.client.1.smithi150.stdout:2/752: write d0/d3/fb2 [4585579,24271] 0 2023-12-05T09:57:40.301 INFO:tasks.workunit.client.1.smithi150.stdout:6/641: read d2/d23/d3b/d83/f71 [5485848,75742] 0 2023-12-05T09:57:40.301 INFO:tasks.workunit.client.0.smithi100.stdout:7/651: dread d3/dc/d11/d13/f30 [0,4194304] 0 2023-12-05T09:57:40.302 INFO:tasks.workunit.client.0.smithi100.stdout:7/652: write d3/dc/d11/d13/de/f74 [5047987,111302] 0 2023-12-05T09:57:40.302 INFO:tasks.workunit.client.0.smithi100.stdout:7/653: fdatasync d3/f24 0 2023-12-05T09:57:40.304 INFO:tasks.workunit.client.1.smithi150.stdout:2/753: unlink d0/d3/fb7 0 2023-12-05T09:57:40.306 INFO:tasks.workunit.client.1.smithi150.stdout:6/642: getdents d2/d23/d3b/d64/d7a/d5d/d6b 0 2023-12-05T09:57:40.306 INFO:tasks.workunit.client.1.smithi150.stdout:2/754: rmdir d0/d3/d5/d13/d15/d30/d54 39 2023-12-05T09:57:40.307 INFO:tasks.workunit.client.1.smithi150.stdout:4/675: dread d0/d5f/f82 [0,4194304] 0 2023-12-05T09:57:40.307 INFO:tasks.workunit.client.1.smithi150.stdout:4/676: write d0/d3e/d5b/f9b [1182876,1913] 0 2023-12-05T09:57:40.307 INFO:tasks.workunit.client.1.smithi150.stdout:4/677: dread - d0/d3e/fc1 zero size 2023-12-05T09:57:40.309 INFO:tasks.workunit.client.1.smithi150.stdout:1/716: dwrite d6/d8/f27 [0,4194304] 0 2023-12-05T09:57:40.311 INFO:tasks.workunit.client.0.smithi100.stdout:7/654: mknod d3/dc/d11/d13/de/d18/d3b/d40/d46/d9e/cf6 0 2023-12-05T09:57:40.316 INFO:tasks.workunit.client.1.smithi150.stdout:6/643: rename d2/f5a to d2/d23/d2e/d93/fd7 0 2023-12-05T09:57:40.318 INFO:tasks.workunit.client.1.smithi150.stdout:2/755: creat d0/d3/d27/d51/f100 x:0 0 0 2023-12-05T09:57:40.319 INFO:tasks.workunit.client.0.smithi100.stdout:8/649: dwrite d0/f1d [0,4194304] 0 2023-12-05T09:57:40.319 INFO:tasks.workunit.client.0.smithi100.stdout:8/650: write d0/d12/d13/d16/d42/d43/f66 [4646664,99274] 0 2023-12-05T09:57:40.322 INFO:tasks.workunit.client.1.smithi150.stdout:4/678: creat d0/d3e/d5b/fd5 x:0 0 0 2023-12-05T09:57:40.322 INFO:tasks.workunit.client.1.smithi150.stdout:4/679: fsync d0/f30 0 2023-12-05T09:57:40.323 INFO:tasks.workunit.client.0.smithi100.stdout:7/655: rename d3/dc/d11/d13/d1b/d60/c81 to d3/dc/d11/d13/de/d18/d3b/de2/cf7 0 2023-12-05T09:57:40.323 INFO:tasks.workunit.client.0.smithi100.stdout:7/656: creat d3/dc/d11/d13/de/d2d/d47/dbd/ff8 x:0 0 0 2023-12-05T09:57:40.323 INFO:tasks.workunit.client.0.smithi100.stdout:4/664: dwrite de/d16/d23/d33/d3d/d44/f81 [0,4194304] 0 2023-12-05T09:57:40.326 INFO:tasks.workunit.client.1.smithi150.stdout:6/644: dread d2/d23/d3b/d83/f71 [4194304,4194304] 0 2023-12-05T09:57:40.331 INFO:tasks.workunit.client.1.smithi150.stdout:1/717: unlink d6/d8/d54/d94/fb9 0 2023-12-05T09:57:40.332 INFO:tasks.workunit.client.1.smithi150.stdout:5/722: dwrite d1/d3/d6/f3f [4194304,4194304] 0 2023-12-05T09:57:40.335 INFO:tasks.workunit.client.0.smithi100.stdout:4/665: link de/d16/f67 de/d16/d23/d33/d3d/fdb 0 2023-12-05T09:57:40.337 INFO:tasks.workunit.client.1.smithi150.stdout:2/756: rename d0/d3/d27/d51/f100 to d0/d3/d5/d13/f101 0 2023-12-05T09:57:40.339 INFO:tasks.workunit.client.1.smithi150.stdout:3/741: dwrite d6/d9/fbd [0,4194304] 0 2023-12-05T09:57:40.339 INFO:tasks.workunit.client.1.smithi150.stdout:3/742: creat d6/d9/d3d/d87/fef x:0 0 0 2023-12-05T09:57:40.339 INFO:tasks.workunit.client.1.smithi150.stdout:6/645: mkdir d2/d23/d2e/d5f/d99/dd8 0 2023-12-05T09:57:40.341 INFO:tasks.workunit.client.0.smithi100.stdout:9/720: dwrite d7/d1b/f1e [0,4194304] 0 2023-12-05T09:57:40.342 INFO:tasks.workunit.client.0.smithi100.stdout:7/657: getdents d3/dc/d11/d13/d37/d97/dc1/dcd 0 2023-12-05T09:57:40.342 INFO:tasks.workunit.client.0.smithi100.stdout:9/721: chown d7/d35/f65 116 1 2023-12-05T09:57:40.343 INFO:tasks.workunit.client.1.smithi150.stdout:1/718: truncate d6/d8/db/f16 762479 0 2023-12-05T09:57:40.343 INFO:tasks.workunit.client.1.smithi150.stdout:5/723: creat d1/d2e/da6/f103 x:0 0 0 2023-12-05T09:57:40.344 INFO:tasks.workunit.client.1.smithi150.stdout:5/724: dread - d1/d7f/d65/d3b/fdc zero size 2023-12-05T09:57:40.347 INFO:tasks.workunit.client.1.smithi150.stdout:2/757: link d0/d3/d5/d10/l33 d0/d3/d27/dea/l102 0 2023-12-05T09:57:40.349 INFO:tasks.workunit.client.0.smithi100.stdout:9/722: truncate d7/d1b/d22/d93/fb4 484236 0 2023-12-05T09:57:40.349 INFO:tasks.workunit.client.0.smithi100.stdout:5/715: dwrite d0/d1b/f32 [4194304,4194304] 0 2023-12-05T09:57:40.350 INFO:tasks.workunit.client.0.smithi100.stdout:5/716: fdatasync d0/d4/d14/d35/f69 0 2023-12-05T09:57:40.350 INFO:tasks.workunit.client.0.smithi100.stdout:9/723: read d7/d1b/d22/d51/d32/dc2/ff0 [310086,120523] 0 2023-12-05T09:57:40.351 INFO:tasks.workunit.client.1.smithi150.stdout:6/646: dread d2/d23/d2e/f94 [0,4194304] 0 2023-12-05T09:57:40.352 INFO:tasks.workunit.client.0.smithi100.stdout:4/666: dread de/d16/d23/d60/d98/da6/fc2 [0,4194304] 0 2023-12-05T09:57:40.352 INFO:tasks.workunit.client.0.smithi100.stdout:4/667: creat de/d16/d23/d33/d3d/fdc x:0 0 0 2023-12-05T09:57:40.352 INFO:tasks.workunit.client.0.smithi100.stdout:4/668: dread - de/d38/d86/f95 zero size 2023-12-05T09:57:40.353 INFO:tasks.workunit.client.0.smithi100.stdout:2/815: dwrite d7/da/d18/d1b/d2c/d3f/d46/f76 [4194304,4194304] 0 2023-12-05T09:57:40.353 INFO:tasks.workunit.client.0.smithi100.stdout:2/816: write d7/d61/f6b [5048619,1899] 0 2023-12-05T09:57:40.356 INFO:tasks.workunit.client.1.smithi150.stdout:2/758: dread d0/d3/d5/d22/f7f [0,4194304] 0 2023-12-05T09:57:40.361 INFO:tasks.workunit.client.1.smithi150.stdout:1/719: unlink d6/d38/l52 0 2023-12-05T09:57:40.364 INFO:tasks.workunit.client.1.smithi150.stdout:5/725: mkdir d1/d2e/da6/d24/d59/d104 0 2023-12-05T09:57:40.365 INFO:tasks.workunit.client.1.smithi150.stdout:5/726: truncate d1/d2e/da6/f103 72353 0 2023-12-05T09:57:40.367 INFO:tasks.workunit.client.1.smithi150.stdout:6/647: rename d2/d23/d2e/d93/d97/cb2 to d2/d23/d3b/cd9 0 2023-12-05T09:57:40.368 INFO:tasks.workunit.client.1.smithi150.stdout:1/720: dread d6/d3c/f7e [4194304,4194304] 0 2023-12-05T09:57:40.372 INFO:tasks.workunit.client.1.smithi150.stdout:5/727: unlink d1/d7f/f5c 0 2023-12-05T09:57:40.372 INFO:tasks.workunit.client.1.smithi150.stdout:5/728: creat d1/d3/d92/dbf/f105 x:0 0 0 2023-12-05T09:57:40.372 INFO:tasks.workunit.client.1.smithi150.stdout:5/729: stat d1/f51 0 2023-12-05T09:57:40.374 INFO:tasks.workunit.client.1.smithi150.stdout:3/743: dwrite d6/d9/d8d/de6/f4d [4194304,4194304] 0 2023-12-05T09:57:40.375 INFO:tasks.workunit.client.0.smithi100.stdout:7/658: rmdir d3/dc/d11/d13 39 2023-12-05T09:57:40.376 INFO:tasks.workunit.client.1.smithi150.stdout:1/721: creat d6/d8/d54/dea/fff x:0 0 0 2023-12-05T09:57:40.378 INFO:tasks.workunit.client.1.smithi150.stdout:9/645: sync 2023-12-05T09:57:40.378 INFO:tasks.workunit.client.1.smithi150.stdout:9/646: write d3/fc2 [454959,62844] 0 2023-12-05T09:57:40.379 INFO:tasks.workunit.client.0.smithi100.stdout:5/717: link d0/d1b/d4d/d8e/d96/fed d0/d1b/d4d/d8e/d96/dea/f100 0 2023-12-05T09:57:40.383 INFO:tasks.workunit.client.0.smithi100.stdout:9/724: write d7/d20/f9b [415844,82165] 0 2023-12-05T09:57:40.383 INFO:tasks.workunit.client.0.smithi100.stdout:9/725: fsync d7/fd 0 2023-12-05T09:57:40.385 INFO:tasks.workunit.client.1.smithi150.stdout:7/725: sync 2023-12-05T09:57:40.385 INFO:tasks.workunit.client.1.smithi150.stdout:8/768: sync 2023-12-05T09:57:40.385 INFO:tasks.workunit.client.1.smithi150.stdout:8/769: chown d0/d41/d49/d1b/d24/d2e/l3f 16 1 2023-12-05T09:57:40.385 INFO:tasks.workunit.client.1.smithi150.stdout:8/770: fdatasync d0/d41/d49/dd3/fd6 0 2023-12-05T09:57:40.386 INFO:tasks.workunit.client.1.smithi150.stdout:2/759: rename d0/d3/d5/d13 to d0/d3/d21/d4d/deb/d103 0 2023-12-05T09:57:40.389 INFO:tasks.workunit.client.1.smithi150.stdout:3/744: mkdir d6/d9/df0 0 2023-12-05T09:57:40.391 INFO:tasks.workunit.client.1.smithi150.stdout:1/722: creat d6/d47/f100 x:0 0 0 2023-12-05T09:57:40.391 INFO:tasks.workunit.client.1.smithi150.stdout:1/723: write d6/d8/f11 [996693,84419] 0 2023-12-05T09:57:40.391 INFO:tasks.workunit.client.1.smithi150.stdout:1/724: creat d6/d8/d54/dea/f101 x:0 0 0 2023-12-05T09:57:40.392 INFO:tasks.workunit.client.1.smithi150.stdout:9/647: dread d3/d9/dc/f92 [0,4194304] 0 2023-12-05T09:57:40.392 INFO:tasks.workunit.client.1.smithi150.stdout:9/648: write d3/d9/dc/f33 [849186,123309] 0 2023-12-05T09:57:40.392 INFO:tasks.workunit.client.1.smithi150.stdout:9/649: readlink d3/d42/d62/l68 0 2023-12-05T09:57:40.392 INFO:tasks.workunit.client.1.smithi150.stdout:9/650: write d3/d9/dc/fa2 [4313274,32464] 0 2023-12-05T09:57:40.397 INFO:tasks.workunit.client.0.smithi100.stdout:2/817: unlink d7/da/d13/d4e/d87/cf9 0 2023-12-05T09:57:40.397 INFO:tasks.workunit.client.0.smithi100.stdout:2/818: creat d7/da/da7/f112 x:0 0 0 2023-12-05T09:57:40.398 INFO:tasks.workunit.client.0.smithi100.stdout:5/718: dread d0/d16/d2b/d75/f85 [0,4194304] 0 2023-12-05T09:57:40.398 INFO:tasks.workunit.client.0.smithi100.stdout:5/719: truncate d0/d27/dc0/ff0 1945710 0 2023-12-05T09:57:40.399 INFO:tasks.workunit.client.1.smithi150.stdout:7/726: mkdir d2/db/d17/d38/dc8/df0 0 2023-12-05T09:57:40.402 INFO:tasks.workunit.client.1.smithi150.stdout:8/771: symlink d0/d41/d49/d1b/dea/lef 0 2023-12-05T09:57:40.402 INFO:tasks.workunit.client.1.smithi150.stdout:5/730: write d1/d7f/d65/d3b/d6b/f91 [368847,126307] 0 2023-12-05T09:57:40.403 INFO:tasks.workunit.client.0.smithi100.stdout:7/659: truncate d3/dc/d11/d13/de/d18/d3b/d40/d4c/d7f/f98 1658447 0 2023-12-05T09:57:40.406 INFO:tasks.workunit.client.1.smithi150.stdout:2/760: rename d0/d3/d21/d4d/deb/d103/d15/c2b to d0/da3/c104 0 2023-12-05T09:57:40.406 INFO:tasks.workunit.client.1.smithi150.stdout:2/761: write d0/d3/d21/d4d/deb/ff6 [999257,65034] 0 2023-12-05T09:57:40.406 INFO:tasks.workunit.client.1.smithi150.stdout:2/762: readlink d0/d3/d21/d4d/deb/d103/d15/d30/d54/d57/le1 0 2023-12-05T09:57:40.409 INFO:tasks.workunit.client.0.smithi100.stdout:9/726: creat d7/d1b/d22/d93/dc9/ffa x:0 0 0 2023-12-05T09:57:40.410 INFO:tasks.workunit.client.1.smithi150.stdout:3/745: mkdir d6/d9/d43/d47/d94/df1 0 2023-12-05T09:57:40.414 INFO:tasks.workunit.client.0.smithi100.stdout:2/819: truncate d7/da/d1a/fdb 2323722 0 2023-12-05T09:57:40.414 INFO:tasks.workunit.client.0.smithi100.stdout:1/680: sync 2023-12-05T09:57:40.414 INFO:tasks.workunit.client.0.smithi100.stdout:1/681: write db/d31/d73/fac [391038,100988] 0 2023-12-05T09:57:40.415 INFO:tasks.workunit.client.0.smithi100.stdout:3/802: sync 2023-12-05T09:57:40.420 INFO:tasks.workunit.client.1.smithi150.stdout:7/727: write d2/db/d30/d53/d90/fc9 [2284401,34466] 0 2023-12-05T09:57:40.420 INFO:tasks.workunit.client.1.smithi150.stdout:7/728: readlink d2/d1b/d5b/lb1 0 2023-12-05T09:57:40.420 INFO:tasks.workunit.client.0.smithi100.stdout:7/660: creat d3/dc/d11/d13/de/ff9 x:0 0 0 2023-12-05T09:57:40.424 INFO:tasks.workunit.client.1.smithi150.stdout:9/651: mkdir d3/d9/d26/d34/dd5 0 2023-12-05T09:57:40.425 INFO:tasks.workunit.client.0.smithi100.stdout:9/727: rename d7/d1b/d22/d2a/d56/d2e/l7d to d7/d1b/d22/d2a/d74/dec/lfb 0 2023-12-05T09:57:40.425 INFO:tasks.workunit.client.0.smithi100.stdout:9/728: chown d7/d20 75423282 1 2023-12-05T09:57:40.428 INFO:tasks.workunit.client.0.smithi100.stdout:3/803: getdents d0/d2/de/db8/dee/df6 0 2023-12-05T09:57:40.428 INFO:tasks.workunit.client.0.smithi100.stdout:3/804: chown d0/d2/d33/le6 31627000 1 2023-12-05T09:57:40.431 INFO:tasks.workunit.client.0.smithi100.stdout:1/682: creat db/d12/d1e/d26/d30/d52/dd0/dd6/fdc x:0 0 0 2023-12-05T09:57:40.438 INFO:tasks.workunit.client.0.smithi100.stdout:9/729: link d7/d1b/d22/d2a/d56/d2e/d50/c5d d7/d35/d71/d9a/cfc 0 2023-12-05T09:57:40.438 INFO:tasks.workunit.client.0.smithi100.stdout:9/730: chown d7/d1b/d22/l82 0 1 2023-12-05T09:57:40.439 INFO:tasks.workunit.client.0.smithi100.stdout:3/805: creat d0/d3d/dfc/d10d/db0/d100/f111 x:0 0 0 2023-12-05T09:57:40.441 INFO:tasks.workunit.client.1.smithi150.stdout:8/772: unlink d0/d41/d49/d1b/d24/d5b/faa 0 2023-12-05T09:57:40.442 INFO:tasks.workunit.client.0.smithi100.stdout:1/683: mkdir db/d12/d1e/d72/ddd 0 2023-12-05T09:57:40.442 INFO:tasks.workunit.client.0.smithi100.stdout:1/684: write db/d31/f81 [438808,128705] 0 2023-12-05T09:57:40.442 INFO:tasks.workunit.client.0.smithi100.stdout:1/685: fsync db/d12/d1e/d26/f68 0 2023-12-05T09:57:40.446 INFO:tasks.workunit.client.0.smithi100.stdout:7/661: link d3/dc/d11/d13/laf d3/dc/d11/d13/lfa 0 2023-12-05T09:57:40.446 INFO:tasks.workunit.client.0.smithi100.stdout:7/662: dread - d3/dc/d11/d13/de/d18/d3b/de2/feb zero size 2023-12-05T09:57:40.446 INFO:tasks.workunit.client.0.smithi100.stdout:7/663: write d3/dc/d11/d13/f30 [3350555,41501] 0 2023-12-05T09:57:40.447 INFO:tasks.workunit.client.1.smithi150.stdout:5/731: rename d1/d3/d92/dbf/fc1 to d1/d2e/da6/f106 0 2023-12-05T09:57:40.449 INFO:tasks.workunit.client.1.smithi150.stdout:2/763: rmdir d0/d3/d21/d4d/deb/d103/d15 39 2023-12-05T09:57:40.450 INFO:tasks.workunit.client.0.smithi100.stdout:9/731: mkdir d7/d1b/d22/d2a/d56/d9c/dfd 0 2023-12-05T09:57:40.452 INFO:tasks.workunit.client.1.smithi150.stdout:3/746: unlink d6/d9/d3d/d56/d53/f78 0 2023-12-05T09:57:40.452 INFO:tasks.workunit.client.1.smithi150.stdout:3/747: chown d6/d9/d3d/d56/d53/f9e 15208664 1 2023-12-05T09:57:40.452 INFO:tasks.workunit.client.1.smithi150.stdout:3/748: chown d6 6758448 1 2023-12-05T09:57:40.453 INFO:tasks.workunit.client.0.smithi100.stdout:3/806: symlink d0/d4/d3a/d45/l112 0 2023-12-05T09:57:40.453 INFO:tasks.workunit.client.0.smithi100.stdout:3/807: truncate d0/d2/d62/fdd 938362 0 2023-12-05T09:57:40.454 INFO:tasks.workunit.client.1.smithi150.stdout:1/725: getdents d6/d3c 0 2023-12-05T09:57:40.454 INFO:tasks.workunit.client.1.smithi150.stdout:1/726: write d6/d8/db/f5b [1418007,41395] 0 2023-12-05T09:57:40.454 INFO:tasks.workunit.client.1.smithi150.stdout:1/727: stat d6/d8/db/d1b/c51 0 2023-12-05T09:57:40.454 INFO:tasks.workunit.client.1.smithi150.stdout:1/728: readlink d6/l45 0 2023-12-05T09:57:40.454 INFO:tasks.workunit.client.1.smithi150.stdout:1/729: chown d6/d8/db/db1/cd7 9536 1 2023-12-05T09:57:40.455 INFO:tasks.workunit.client.1.smithi150.stdout:0/759: sync 2023-12-05T09:57:40.455 INFO:tasks.workunit.client.1.smithi150.stdout:7/729: mkdir d2/db/d2e/d9a/df1 0 2023-12-05T09:57:40.455 INFO:tasks.workunit.client.1.smithi150.stdout:7/730: readlink d2/db/d30/d13/d4f/l8c 0 2023-12-05T09:57:40.457 INFO:tasks.workunit.client.1.smithi150.stdout:9/652: getdents d3/d9/dc/d1f/d24/d75 0 2023-12-05T09:57:40.458 INFO:tasks.workunit.client.0.smithi100.stdout:5/720: dwrite d0/d1b/ffe [0,4194304] 0 2023-12-05T09:57:40.458 INFO:tasks.workunit.client.0.smithi100.stdout:5/721: dread - d0/d4/d14/f55 zero size 2023-12-05T09:57:40.459 INFO:tasks.workunit.client.0.smithi100.stdout:3/808: creat d0/d10/d39/f113 x:0 0 0 2023-12-05T09:57:40.462 INFO:tasks.workunit.client.0.smithi100.stdout:3/809: rmdir d0/d2/de/d8d/dc9/d110 39 2023-12-05T09:57:40.464 INFO:tasks.workunit.client.0.smithi100.stdout:7/664: write d3/dc/d11/d13/de/d2d/d42/f83 [3398996,99709] 0 2023-12-05T09:57:40.466 INFO:tasks.workunit.client.1.smithi150.stdout:3/749: rename d6/d9/d43/d75 to d6/d25/dd9/df2 0 2023-12-05T09:57:40.468 INFO:tasks.workunit.client.0.smithi100.stdout:3/810: rename d0/d4/d3a/caa to d0/d3d/dfc/d10d/db0/c114 0 2023-12-05T09:57:40.471 INFO:tasks.workunit.client.1.smithi150.stdout:1/730: creat d6/d47/d4c/f102 x:0 0 0 2023-12-05T09:57:40.473 INFO:tasks.workunit.client.0.smithi100.stdout:4/669: dwrite de/f14 [0,4194304] 0 2023-12-05T09:57:40.478 INFO:tasks.workunit.client.1.smithi150.stdout:0/760: rmdir d5/d11/d71/d99/d9c/d46/d80 39 2023-12-05T09:57:40.485 INFO:tasks.workunit.client.0.smithi100.stdout:7/665: mknod d3/dc/d11/d13/d37/cfb 0 2023-12-05T09:57:40.485 INFO:tasks.workunit.client.1.smithi150.stdout:7/731: mkdir d2/db/d2e/d71/df2 0 2023-12-05T09:57:40.492 INFO:tasks.workunit.client.1.smithi150.stdout:9/653: mknod d3/d9/d26/d34/cd6 0 2023-12-05T09:57:40.492 INFO:tasks.workunit.client.1.smithi150.stdout:8/773: mkdir d0/df0 0 2023-12-05T09:57:40.495 INFO:tasks.workunit.client.1.smithi150.stdout:5/732: getdents d1/d3/d6/d72 0 2023-12-05T09:57:40.499 INFO:tasks.workunit.client.1.smithi150.stdout:3/750: creat d6/d9/df0/ff3 x:0 0 0 2023-12-05T09:57:40.499 INFO:tasks.workunit.client.1.smithi150.stdout:1/731: mknod d6/d47/d4c/dd9/d75/ddd/c103 0 2023-12-05T09:57:40.499 INFO:tasks.workunit.client.1.smithi150.stdout:3/751: chown d6/fd4 123068 1 2023-12-05T09:57:40.499 INFO:tasks.workunit.client.1.smithi150.stdout:3/752: read - d6/d9/d3d/d87/fed zero size 2023-12-05T09:57:40.506 INFO:tasks.workunit.client.0.smithi100.stdout:1/686: dwrite db/d12/f96 [0,4194304] 0 2023-12-05T09:57:40.510 INFO:tasks.workunit.client.0.smithi100.stdout:7/666: dread d3/dc/d11/d13/de/d2d/d47/f72 [4194304,4194304] 0 2023-12-05T09:57:40.511 INFO:tasks.workunit.client.0.smithi100.stdout:7/667: chown d3/dc/d11/d13/de/d2d/d47 956 1 2023-12-05T09:57:40.511 INFO:tasks.workunit.client.0.smithi100.stdout:7/668: dread - d3/dc/d11/d13/de/d18/d3b/d40/d46/f94 zero size 2023-12-05T09:57:40.513 INFO:tasks.workunit.client.1.smithi150.stdout:9/654: symlink d3/d1b/d46/d55/d64/ld7 0 2023-12-05T09:57:40.513 INFO:tasks.workunit.client.1.smithi150.stdout:8/774: getdents d0/d41/d49/d1b/d24/d34/dd0 0 2023-12-05T09:57:40.513 INFO:tasks.workunit.client.1.smithi150.stdout:8/775: truncate d0/d41/d49/d1b/d24/d38/d62/f68 521871 0 2023-12-05T09:57:40.513 INFO:tasks.workunit.client.1.smithi150.stdout:1/732: rename d6/d8/db/f19 to d6/d8/d85/f104 0 2023-12-05T09:57:40.513 INFO:tasks.workunit.client.1.smithi150.stdout:1/733: truncate d6/d8/d54/dea/fff 587846 0 2023-12-05T09:57:40.514 INFO:tasks.workunit.client.0.smithi100.stdout:3/811: rmdir d0/d2/d33 39 2023-12-05T09:57:40.517 INFO:tasks.workunit.client.0.smithi100.stdout:7/669: link d3/dc/d11/d13/de/d2d/d47/dbd/cd4 d3/dc/d11/d13/de/cfc 0 2023-12-05T09:57:40.518 INFO:tasks.workunit.client.1.smithi150.stdout:9/655: rename d3/d9/dc/d1f/l5e to d3/d82/ld8 0 2023-12-05T09:57:40.518 INFO:tasks.workunit.client.1.smithi150.stdout:9/656: chown d3/d82/cba 32 1 2023-12-05T09:57:40.518 INFO:tasks.workunit.client.0.smithi100.stdout:3/812: rmdir d0/d2/de 39 2023-12-05T09:57:40.519 INFO:tasks.workunit.client.0.smithi100.stdout:5/722: dwrite d0/d16/f74 [0,4194304] 0 2023-12-05T09:57:40.520 INFO:tasks.workunit.client.1.smithi150.stdout:1/734: rename d6/d8/db/fac to d6/d8/db/f105 0 2023-12-05T09:57:40.520 INFO:tasks.workunit.client.1.smithi150.stdout:1/735: getdents d6/d3c 0 2023-12-05T09:57:40.523 INFO:tasks.workunit.client.0.smithi100.stdout:9/732: dwrite d7/d1b/d22/d2a/d56/fc4 [0,4194304] 0 2023-12-05T09:57:40.523 INFO:tasks.workunit.client.0.smithi100.stdout:7/670: rename d3/dc/d11/d13/fb1 to d3/dc/d11/d13/de/d2d/ffd 0 2023-12-05T09:57:40.523 INFO:tasks.workunit.client.0.smithi100.stdout:7/671: readlink d3/dc/d11/d13/d37/l5b 0 2023-12-05T09:57:40.523 INFO:tasks.workunit.client.0.smithi100.stdout:7/672: creat d3/dc/d11/d33/ffe x:0 0 0 2023-12-05T09:57:40.524 INFO:tasks.workunit.client.1.smithi150.stdout:2/764: dwrite d0/d3/d5/d3b/d4c/f64 [0,4194304] 0 2023-12-05T09:57:40.526 INFO:tasks.workunit.client.0.smithi100.stdout:3/813: rename d0/d3d/dfc/d10d/db0/fe5 to d0/d3d/dfc/d10d/db0/f115 0 2023-12-05T09:57:40.526 INFO:tasks.workunit.client.0.smithi100.stdout:3/814: dread - d0/d2/fc3 zero size 2023-12-05T09:57:40.529 INFO:tasks.workunit.client.1.smithi150.stdout:0/761: dwrite d5/d11/d71/d99/d9c/d96/dd5/d7f/fec [0,4194304] 0 2023-12-05T09:57:40.535 INFO:tasks.workunit.client.1.smithi150.stdout:1/736: mkdir d6/d47/d4c/dd9/d75/d106 0 2023-12-05T09:57:40.536 INFO:tasks.workunit.client.1.smithi150.stdout:1/737: chown d6/d8/db/d1b/d79/dca/feb 24240166 1 2023-12-05T09:57:40.536 INFO:tasks.workunit.client.0.smithi100.stdout:5/723: symlink d0/d16/d2b/d48/df/l101 0 2023-12-05T09:57:40.537 INFO:tasks.workunit.client.1.smithi150.stdout:8/776: dread d0/d41/d49/d1b/d24/fe4 [0,4194304] 0 2023-12-05T09:57:40.537 INFO:tasks.workunit.client.0.smithi100.stdout:0/675: sync 2023-12-05T09:57:40.538 INFO:tasks.workunit.client.1.smithi150.stdout:9/657: write d3/d9/d26/d34/f72 [3707294,27826] 0 2023-12-05T09:57:40.538 INFO:tasks.workunit.client.1.smithi150.stdout:9/658: write d3/d9/d26/d34/f6d [332818,101801] 0 2023-12-05T09:57:40.538 INFO:tasks.workunit.client.1.smithi150.stdout:9/659: fsync d3/d9/dc/d1f/d24/f9d 0 2023-12-05T09:57:40.542 INFO:tasks.workunit.client.1.smithi150.stdout:5/733: dwrite d1/d2e/da6/d86/fee [0,4194304] 0 2023-12-05T09:57:40.552 INFO:tasks.workunit.client.0.smithi100.stdout:9/733: mknod d7/db5/cfe 0 2023-12-05T09:57:40.554 INFO:tasks.workunit.client.0.smithi100.stdout:3/815: symlink d0/d3d/d5c/d6f/d7f/d87/l116 0 2023-12-05T09:57:40.558 INFO:tasks.workunit.client.1.smithi150.stdout:2/765: creat d0/d3/d5/f105 x:0 0 0 2023-12-05T09:57:40.558 INFO:tasks.workunit.client.1.smithi150.stdout:2/766: creat d0/d3/d27/dac/dd0/f106 x:0 0 0 2023-12-05T09:57:40.558 INFO:tasks.workunit.client.1.smithi150.stdout:2/767: fdatasync d0/d3/d21/d4d/deb/d103/d15/d30/d54/d57/f91 0 2023-12-05T09:57:40.559 INFO:tasks.workunit.client.0.smithi100.stdout:5/724: creat d0/d1b/d4d/d8e/d96/dea/f102 x:0 0 0 2023-12-05T09:57:40.563 INFO:tasks.workunit.client.0.smithi100.stdout:5/725: link d0/d1f/d53/l79 d0/d1b/d4d/d8e/l103 0 2023-12-05T09:57:40.565 INFO:tasks.workunit.client.1.smithi150.stdout:0/762: mkdir d5/d11/d71/ddb/d10b 0 2023-12-05T09:57:40.569 INFO:tasks.workunit.client.0.smithi100.stdout:5/726: mkdir d0/d1b/d4d/d6c/d104 0 2023-12-05T09:57:40.570 INFO:tasks.workunit.client.1.smithi150.stdout:4/680: sync 2023-12-05T09:57:40.570 INFO:tasks.workunit.client.1.smithi150.stdout:4/681: read d0/d3e/d6d/f12 [143829,38573] 0 2023-12-05T09:57:40.572 INFO:tasks.workunit.client.1.smithi150.stdout:9/660: truncate d3/d9/dc/d1f/f6c 1652065 0 2023-12-05T09:57:40.572 INFO:tasks.workunit.client.1.smithi150.stdout:9/661: write d3/d9/f31 [1517267,86467] 0 2023-12-05T09:57:40.574 INFO:tasks.workunit.client.1.smithi150.stdout:7/732: dwrite d2/db/d17/f7a [0,4194304] 0 2023-12-05T09:57:40.576 INFO:tasks.workunit.client.1.smithi150.stdout:5/734: mknod d1/d3/d6/d1b/c107 0 2023-12-05T09:57:40.576 INFO:tasks.workunit.client.1.smithi150.stdout:5/735: chown d1/d2e/f52 1832 1 2023-12-05T09:57:40.576 INFO:tasks.workunit.client.1.smithi150.stdout:5/736: read d1/d2e/f52 [1266044,87886] 0 2023-12-05T09:57:40.576 INFO:tasks.workunit.client.1.smithi150.stdout:5/737: chown d1/d3/d6/d26/dca/de2 17 1 2023-12-05T09:57:40.576 INFO:tasks.workunit.client.1.smithi150.stdout:5/738: write d1/d3/d6/d26/dca/dcd/ff5 [891199,77058] 0 2023-12-05T09:57:40.578 INFO:tasks.workunit.client.1.smithi150.stdout:2/768: mkdir d0/d3/d5/d22/d52/d56/d107 0 2023-12-05T09:57:40.581 INFO:tasks.workunit.client.1.smithi150.stdout:0/763: creat d5/d11/d71/d99/d9c/f10c x:0 0 0 2023-12-05T09:57:40.587 INFO:tasks.workunit.client.1.smithi150.stdout:9/662: dread d3/d9/dc/d1f/d24/d75/fc6 [0,4194304] 0 2023-12-05T09:57:40.588 INFO:tasks.workunit.client.1.smithi150.stdout:9/663: fdatasync d3/d9/d58/fa9 0 2023-12-05T09:57:40.594 INFO:tasks.workunit.client.1.smithi150.stdout:8/777: getdents d0/d41/d49/d1b/d24/d5b 0 2023-12-05T09:57:40.594 INFO:tasks.workunit.client.1.smithi150.stdout:5/739: creat d1/d3/d6/d26/dca/f108 x:0 0 0 2023-12-05T09:57:40.595 INFO:tasks.workunit.client.1.smithi150.stdout:6/648: sync 2023-12-05T09:57:40.595 INFO:tasks.workunit.client.1.smithi150.stdout:7/733: unlink d2/db/d17/f7a 0 2023-12-05T09:57:40.595 INFO:tasks.workunit.client.1.smithi150.stdout:0/764: symlink d5/d11/d71/dda/l10d 0 2023-12-05T09:57:40.595 INFO:tasks.workunit.client.1.smithi150.stdout:0/765: readlink d5/d11/l62 0 2023-12-05T09:57:40.595 INFO:tasks.workunit.client.1.smithi150.stdout:0/766: chown d5/d11/d71/d99/d9c/d96/fff 43 1 2023-12-05T09:57:40.595 INFO:tasks.workunit.client.1.smithi150.stdout:0/767: chown d5/d11/d71/d99/d9c/d96/fff 163827420 1 2023-12-05T09:57:40.596 INFO:tasks.workunit.client.0.smithi100.stdout:1/687: dwrite db/d31/d3a/d4a/dad/f89 [0,4194304] 0 2023-12-05T09:57:40.596 INFO:tasks.workunit.client.0.smithi100.stdout:1/688: dread - db/d12/d1e/d72/dc4/fd7 zero size 2023-12-05T09:57:40.599 INFO:tasks.workunit.client.1.smithi150.stdout:9/664: creat d3/d9/d58/dbe/fd9 x:0 0 0 2023-12-05T09:57:40.599 INFO:tasks.workunit.client.1.smithi150.stdout:9/665: fsync d3/d1b/d46/f98 0 2023-12-05T09:57:40.599 INFO:tasks.workunit.client.1.smithi150.stdout:9/666: chown d3/d9/dc 26 1 2023-12-05T09:57:40.602 INFO:tasks.workunit.client.1.smithi150.stdout:8/778: mknod d0/d41/d49/d1b/d24/d2e/d4d/d83/cf1 0 2023-12-05T09:57:40.602 INFO:tasks.workunit.client.1.smithi150.stdout:8/779: truncate d0/d41/d49/dda/fe0 315664 0 2023-12-05T09:57:40.602 INFO:tasks.workunit.client.1.smithi150.stdout:5/740: mkdir d1/d7f/d65/d3b/d6b/d109 0 2023-12-05T09:57:40.605 INFO:tasks.workunit.client.0.smithi100.stdout:7/673: dwrite d3/dc/d11/d13/d1b/d60/ff1 [0,4194304] 0 2023-12-05T09:57:40.605 INFO:tasks.workunit.client.0.smithi100.stdout:3/816: dread d0/d3d/d90/fda [0,4194304] 0 2023-12-05T09:57:40.610 INFO:tasks.workunit.client.1.smithi150.stdout:0/768: rename d5/d11/d71/d5f/d6a/fe6 to d5/d11/d71/f10e 0 2023-12-05T09:57:40.611 INFO:tasks.workunit.client.1.smithi150.stdout:0/769: readlink d5/d11/d71/l42 0 2023-12-05T09:57:40.611 INFO:tasks.workunit.client.1.smithi150.stdout:0/770: stat d5/d11/d71/d99/d9c/d96/fff 0 2023-12-05T09:57:40.611 INFO:tasks.workunit.client.1.smithi150.stdout:3/753: dwrite d6/d9/d3d/d56/d53/d51/f6b [0,4194304] 0 2023-12-05T09:57:40.611 INFO:tasks.workunit.client.1.smithi150.stdout:3/754: creat d6/d9/d3d/d56/d71/db6/db2/ff4 x:0 0 0 2023-12-05T09:57:40.611 INFO:tasks.workunit.client.1.smithi150.stdout:3/755: dread - d6/d9/d3d/d56/d71/db6/db2/ff4 zero size 2023-12-05T09:57:40.611 INFO:tasks.workunit.client.0.smithi100.stdout:9/734: dread d7/d1b/d22/d2a/d56/daf/fd0 [0,4194304] 0 2023-12-05T09:57:40.617 INFO:tasks.workunit.client.0.smithi100.stdout:0/676: dwrite da/d22/d33/d35/d3a/d8b/d8f/fc2 [0,4194304] 0 2023-12-05T09:57:40.617 INFO:tasks.workunit.client.0.smithi100.stdout:0/677: stat da/d1b/d36/db4 0 2023-12-05T09:57:40.617 INFO:tasks.workunit.client.0.smithi100.stdout:4/670: dwrite de/f55 [0,4194304] 0 2023-12-05T09:57:40.617 INFO:tasks.workunit.client.0.smithi100.stdout:4/671: write de/d38/fa5 [936397,837] 0 2023-12-05T09:57:40.617 INFO:tasks.workunit.client.0.smithi100.stdout:4/672: chown de/d38/ca1 2795610 1 2023-12-05T09:57:40.617 INFO:tasks.workunit.client.0.smithi100.stdout:4/673: dread - de/d16/d23/d60/dc4/f84 zero size 2023-12-05T09:57:40.618 INFO:tasks.workunit.client.1.smithi150.stdout:6/649: dread d2/d23/d3b/d64/d7a/d5d/d6b/fca [0,4194304] 0 2023-12-05T09:57:40.618 INFO:tasks.workunit.client.0.smithi100.stdout:4/674: creat de/d16/d23/d33/fdd x:0 0 0 2023-12-05T09:57:40.620 INFO:tasks.workunit.client.1.smithi150.stdout:0/771: dread d5/d11/f26 [0,4194304] 0 2023-12-05T09:57:40.621 INFO:tasks.workunit.client.1.smithi150.stdout:3/756: stat d6/d9/d3d/d56/d71/db0/cdd 0 2023-12-05T09:57:40.623 INFO:tasks.workunit.client.0.smithi100.stdout:9/735: creat d7/d35/d71/fff x:0 0 0 2023-12-05T09:57:40.625 INFO:tasks.workunit.client.1.smithi150.stdout:2/769: dread d0/d3/d21/d4d/deb/d86/fce [0,4194304] 0 2023-12-05T09:57:40.626 INFO:tasks.workunit.client.0.smithi100.stdout:3/817: mknod d0/d2/de/d11/c117 0 2023-12-05T09:57:40.630 INFO:tasks.workunit.client.1.smithi150.stdout:6/650: symlink d2/d23/d2e/d93/d97/lda 0 2023-12-05T09:57:40.631 INFO:tasks.workunit.client.0.smithi100.stdout:0/678: chown da/d1b/c1e 1 1 2023-12-05T09:57:40.633 INFO:tasks.workunit.client.1.smithi150.stdout:0/772: mknod d5/dbd/c10f 0 2023-12-05T09:57:40.637 INFO:tasks.workunit.client.1.smithi150.stdout:3/757: creat d6/d9/d3d/d56/d71/db6/dc1/d67/ff5 x:0 0 0 2023-12-05T09:57:40.638 INFO:tasks.workunit.client.0.smithi100.stdout:4/675: unlink de/d16/d23/d33/d51/faf 0 2023-12-05T09:57:40.642 INFO:tasks.workunit.client.1.smithi150.stdout:5/741: rename d1/d3/d92/dbf to d1/d7f/d65/de3/d10a 0 2023-12-05T09:57:40.642 INFO:tasks.workunit.client.1.smithi150.stdout:5/742: fdatasync d1/d7f/d65/d3b/d37/faf 0 2023-12-05T09:57:40.643 INFO:tasks.workunit.client.0.smithi100.stdout:3/818: mknod d0/d3d/dfc/d10d/c118 0 2023-12-05T09:57:40.643 INFO:tasks.workunit.client.0.smithi100.stdout:3/819: creat d0/d3d/d5c/d6f/d7f/d87/f119 x:0 0 0 2023-12-05T09:57:40.644 INFO:tasks.workunit.client.0.smithi100.stdout:9/736: dread d7/d1b/d22/f4a [0,4194304] 0 2023-12-05T09:57:40.646 INFO:tasks.workunit.client.1.smithi150.stdout:6/651: creat d2/d23/d2e/d5f/fdb x:0 0 0 2023-12-05T09:57:40.648 INFO:tasks.workunit.client.1.smithi150.stdout:3/758: rmdir d6/d22/d37/dcd 0 2023-12-05T09:57:40.649 INFO:tasks.workunit.client.0.smithi100.stdout:4/676: mknod de/d38/d5d/cde 0 2023-12-05T09:57:40.649 INFO:tasks.workunit.client.0.smithi100.stdout:4/677: fdatasync de/d16/f83 0 2023-12-05T09:57:40.649 INFO:tasks.workunit.client.0.smithi100.stdout:4/678: write de/d16/d23/d33/dae/fbc [621836,84097] 0 2023-12-05T09:57:40.652 INFO:tasks.workunit.client.1.smithi150.stdout:3/759: rename d6/f80 to d6/d9/d3d/d56/d30/ff6 0 2023-12-05T09:57:40.653 INFO:tasks.workunit.client.0.smithi100.stdout:3/820: unlink d0/d2/de/c54 0 2023-12-05T09:57:40.653 INFO:tasks.workunit.client.0.smithi100.stdout:3/821: write d0/d2/de/d11/ff0 [23086,78069] 0 2023-12-05T09:57:40.653 INFO:tasks.workunit.client.0.smithi100.stdout:9/737: symlink d7/d35/d71/d9a/dcd/l100 0 2023-12-05T09:57:40.654 INFO:tasks.workunit.client.1.smithi150.stdout:2/770: dread d0/d3/d5/d22/d52/d56/f73 [0,4194304] 0 2023-12-05T09:57:40.654 INFO:tasks.workunit.client.0.smithi100.stdout:0/679: mknod da/d22/cc4 0 2023-12-05T09:57:40.657 INFO:tasks.workunit.client.0.smithi100.stdout:4/679: rename de/d16/d23/d33/d51/c54 to de/d16/d1e/cdf 0 2023-12-05T09:57:40.657 INFO:tasks.workunit.client.0.smithi100.stdout:4/680: truncate de/d16/d1e/fb1 527947 0 2023-12-05T09:57:40.660 INFO:tasks.workunit.client.0.smithi100.stdout:0/680: creat da/d1b/dbe/fc5 x:0 0 0 2023-12-05T09:57:40.663 INFO:tasks.workunit.client.0.smithi100.stdout:4/681: rmdir de/d16/d23/d33/d3d/d44/d4e/d80 39 2023-12-05T09:57:40.663 INFO:tasks.workunit.client.0.smithi100.stdout:4/682: dread - de/d16/d23/fbf zero size 2023-12-05T09:57:40.663 INFO:tasks.workunit.client.0.smithi100.stdout:4/683: write de/d16/d1e/f2e [3635775,1089] 0 2023-12-05T09:57:40.668 INFO:tasks.workunit.client.1.smithi150.stdout:5/743: dread d1/f55 [0,4194304] 0 2023-12-05T09:57:40.668 INFO:tasks.workunit.client.1.smithi150.stdout:5/744: write d1/d7f/d65/d3b/d37/f48 [5239212,69963] 0 2023-12-05T09:57:40.670 INFO:tasks.workunit.client.0.smithi100.stdout:0/681: chown da/d1b/l2f 2 1 2023-12-05T09:57:40.670 INFO:tasks.workunit.client.0.smithi100.stdout:0/682: read - da/d22/d33/d7f/fb5 zero size 2023-12-05T09:57:40.670 INFO:tasks.workunit.client.0.smithi100.stdout:0/683: fdatasync da/d22/d33/d35/d3a/d8b/d8f/fae 0 2023-12-05T09:57:40.670 INFO:tasks.workunit.client.0.smithi100.stdout:7/674: dread d3/dc/d11/d33/f7b [0,4194304] 0 2023-12-05T09:57:40.670 INFO:tasks.workunit.client.0.smithi100.stdout:7/675: chown d3/dc/d11/d13/de/d18/d3b/d40/d4c/d7f/f98 600350 1 2023-12-05T09:57:40.670 INFO:tasks.workunit.client.0.smithi100.stdout:4/684: symlink de/d16/d1e/le0 0 2023-12-05T09:57:40.672 INFO:tasks.workunit.client.1.smithi150.stdout:6/652: dread d2/d23/d2e/f85 [0,4194304] 0 2023-12-05T09:57:40.673 INFO:tasks.workunit.client.0.smithi100.stdout:7/676: rename d3/dc/d11/d13/f43 to d3/dc/d11/d13/de/d18/d3b/d40/d4c/d7f/fff 0 2023-12-05T09:57:40.673 INFO:tasks.workunit.client.0.smithi100.stdout:9/738: dread d7/d1b/d22/d51/d32/f42 [0,4194304] 0 2023-12-05T09:57:40.674 INFO:tasks.workunit.client.0.smithi100.stdout:5/727: dwrite d0/d16/d2b/f64 [0,4194304] 0 2023-12-05T09:57:40.674 INFO:tasks.workunit.client.1.smithi150.stdout:3/760: read d6/d9/d3d/d52/f65 [79293,28834] 0 2023-12-05T09:57:40.674 INFO:tasks.workunit.client.1.smithi150.stdout:3/761: readlink d6/d9/d3d/d56/d30/ld2 0 2023-12-05T09:57:40.674 INFO:tasks.workunit.client.1.smithi150.stdout:3/762: creat d6/d9/d3d/d56/d71/ff7 x:0 0 0 2023-12-05T09:57:40.678 INFO:tasks.workunit.client.1.smithi150.stdout:5/745: link d1/d3/d6/l9b d1/d2e/l10b 0 2023-12-05T09:57:40.678 INFO:tasks.workunit.client.1.smithi150.stdout:5/746: dread - d1/d3/d6/d72/fc3 zero size 2023-12-05T09:57:40.680 INFO:tasks.workunit.client.0.smithi100.stdout:3/822: dread d0/d3d/d5c/d6f/d7f/d87/f9a [0,4194304] 0 2023-12-05T09:57:40.680 INFO:tasks.workunit.client.1.smithi150.stdout:2/771: rename d0/d3/d27/db6 to d0/d3/d5/d22/d52/d5a/d108 0 2023-12-05T09:57:40.680 INFO:tasks.workunit.client.1.smithi150.stdout:2/772: write d0/d3/d21/ff8 [196802,27078] 0 2023-12-05T09:57:40.681 INFO:tasks.workunit.client.0.smithi100.stdout:7/677: truncate d3/dc/d11/d13/fb 369583 0 2023-12-05T09:57:40.682 INFO:tasks.workunit.client.1.smithi150.stdout:6/653: creat d2/d23/d2e/fdc x:0 0 0 2023-12-05T09:57:40.682 INFO:tasks.workunit.client.1.smithi150.stdout:6/654: fsync d2/d23/d3b/d64/d7a/d5d/d6b/f10 0 2023-12-05T09:57:40.682 INFO:tasks.workunit.client.1.smithi150.stdout:6/655: write d2/d23/d3b/fc3 [269088,125772] 0 2023-12-05T09:57:40.683 INFO:tasks.workunit.client.0.smithi100.stdout:4/685: write de/d16/d1e/fda [1075620,38656] 0 2023-12-05T09:57:40.687 INFO:tasks.workunit.client.1.smithi150.stdout:9/667: dwrite d3/d9/f17 [0,4194304] 0 2023-12-05T09:57:40.687 INFO:tasks.workunit.client.1.smithi150.stdout:3/763: mknod d6/d9/d3d/d56/d71/db6/dc1/d67/cf8 0 2023-12-05T09:57:40.687 INFO:tasks.workunit.client.1.smithi150.stdout:1/738: dwrite d6/d38/fb7 [0,4194304] 0 2023-12-05T09:57:40.687 INFO:tasks.workunit.client.1.smithi150.stdout:1/739: chown d6/d47/d4c/dd9 805 1 2023-12-05T09:57:40.687 INFO:tasks.workunit.client.1.smithi150.stdout:0/773: dwrite d5/d11/d65/d82/fab [0,4194304] 0 2023-12-05T09:57:40.689 INFO:tasks.workunit.client.1.smithi150.stdout:4/682: dwrite d0/d5f/fd4 [0,4194304] 0 2023-12-05T09:57:40.690 INFO:tasks.workunit.client.0.smithi100.stdout:1/689: dwrite db/d12/d1e/f5d [0,4194304] 0 2023-12-05T09:57:40.690 INFO:tasks.workunit.client.0.smithi100.stdout:1/690: write db/d12/d1e/f38 [2763849,34731] 0 2023-12-05T09:57:40.690 INFO:tasks.workunit.client.0.smithi100.stdout:1/691: truncate db/d31/d3a/d4a/dad/fbf 468654 0 2023-12-05T09:57:40.690 INFO:tasks.workunit.client.0.smithi100.stdout:1/692: chown db/d12/d1e/d26/d30/d52/fcd 204142 1 2023-12-05T09:57:40.691 INFO:tasks.workunit.client.1.smithi150.stdout:2/773: rename d0/d3/d11/d1d/ca4 to d0/d3/d21/d77/c109 0 2023-12-05T09:57:40.692 INFO:tasks.workunit.client.1.smithi150.stdout:2/774: write d0/d3/d5/d10/f19 [7337261,94041] 0 2023-12-05T09:57:40.694 INFO:tasks.workunit.client.0.smithi100.stdout:9/739: write d7/d1b/d22/d51/f23 [2518493,13009] 0 2023-12-05T09:57:40.695 INFO:tasks.workunit.client.0.smithi100.stdout:0/684: dread da/d2a/f7b [0,4194304] 0 2023-12-05T09:57:40.709 INFO:tasks.workunit.client.1.smithi150.stdout:3/764: rmdir d6/d9/d3d/d8a 39 2023-12-05T09:57:40.710 INFO:tasks.workunit.client.1.smithi150.stdout:3/765: truncate d6/f6c 1664403 0 2023-12-05T09:57:40.710 INFO:tasks.workunit.client.0.smithi100.stdout:5/728: getdents d0/d1b/d4d/d8e/d96/dc1 0 2023-12-05T09:57:40.716 INFO:tasks.workunit.client.1.smithi150.stdout:0/774: mkdir d5/d11/d71/d99/d9c/d96/dd5/d67/da8/df1/d110 0 2023-12-05T09:57:40.718 INFO:tasks.workunit.client.0.smithi100.stdout:7/678: creat d3/dc/d11/d13/de/d18/d3b/d40/d4c/f100 x:0 0 0 2023-12-05T09:57:40.718 INFO:tasks.workunit.client.0.smithi100.stdout:7/679: readlink d3/dc/d11/d13/de/l89 0 2023-12-05T09:57:40.718 INFO:tasks.workunit.client.0.smithi100.stdout:7/680: fdatasync d3/dc/d11/d33/ffe 0 2023-12-05T09:57:40.722 INFO:tasks.workunit.client.1.smithi150.stdout:5/747: dwrite d1/d64/d31/fd5 [4194304,4194304] 0 2023-12-05T09:57:40.735 INFO:tasks.workunit.client.1.smithi150.stdout:6/656: dwrite d2/f1c [0,4194304] 0 2023-12-05T09:57:40.736 INFO:tasks.workunit.client.1.smithi150.stdout:2/775: dread d0/d3/d21/d4d/deb/d103/d15/d30/d54/d57/f91 [0,4194304] 0 2023-12-05T09:57:40.738 INFO:tasks.workunit.client.0.smithi100.stdout:1/693: creat db/d31/d3a/d4a/dad/d67/fde x:0 0 0 2023-12-05T09:57:40.739 INFO:tasks.workunit.client.0.smithi100.stdout:9/740: mknod d7/d1b/d22/d2a/d56/d2e/d50/ddd/c101 0 2023-12-05T09:57:40.739 INFO:tasks.workunit.client.0.smithi100.stdout:9/741: stat d7/d35/d71/f7a 0 2023-12-05T09:57:40.742 INFO:tasks.workunit.client.0.smithi100.stdout:0/685: mknod da/d60/dba/cc6 0 2023-12-05T09:57:40.748 INFO:tasks.workunit.client.1.smithi150.stdout:9/668: rename d3/d1b/d46/l7a to d3/lda 0 2023-12-05T09:57:40.750 INFO:tasks.workunit.client.1.smithi150.stdout:0/775: mknod d5/d11/d71/d74/c111 0 2023-12-05T09:57:40.750 INFO:tasks.workunit.client.1.smithi150.stdout:0/776: stat d5/d11/c53 0 2023-12-05T09:57:40.752 INFO:tasks.workunit.client.0.smithi100.stdout:5/729: creat d0/d1b/d4d/d8e/d96/dc1/dae/db9/f105 x:0 0 0 2023-12-05T09:57:40.752 INFO:tasks.workunit.client.0.smithi100.stdout:8/651: sync 2023-12-05T09:57:40.753 INFO:tasks.workunit.client.0.smithi100.stdout:8/652: chown d0/d12/d13/d16/d22/c57 715252 1 2023-12-05T09:57:40.753 INFO:tasks.workunit.client.0.smithi100.stdout:8/653: stat d0/lf 0 2023-12-05T09:57:40.753 INFO:tasks.workunit.client.0.smithi100.stdout:5/730: write d0/d1f/d25/d31/f3f [4251214,102758] 0 2023-12-05T09:57:40.753 INFO:tasks.workunit.client.1.smithi150.stdout:5/748: getdents d1/d7f/d65/d3b/d6b/dcb 0 2023-12-05T09:57:40.754 INFO:tasks.workunit.client.0.smithi100.stdout:7/681: creat d3/dc/d11/d13/de/d2d/d47/dbd/f101 x:0 0 0 2023-12-05T09:57:40.754 INFO:tasks.workunit.client.0.smithi100.stdout:7/682: read - d3/dc/ff3 zero size 2023-12-05T09:57:40.755 INFO:tasks.workunit.client.1.smithi150.stdout:0/777: dread d5/d11/d71/d99/d9c/d96/de3/f100 [0,4194304] 0 2023-12-05T09:57:40.755 INFO:tasks.workunit.client.1.smithi150.stdout:2/776: creat d0/d3/d27/dac/d81/f10a x:0 0 0 2023-12-05T09:57:40.756 INFO:tasks.workunit.client.0.smithi100.stdout:4/686: rmdir de/d38/d8b 39 2023-12-05T09:57:40.759 INFO:tasks.workunit.client.1.smithi150.stdout:6/657: rename d2/d23/cbf to d2/d23/d2e/d93/cdd 0 2023-12-05T09:57:40.760 INFO:tasks.workunit.client.1.smithi150.stdout:9/669: symlink d3/d1b/dca/ldb 0 2023-12-05T09:57:40.760 INFO:tasks.workunit.client.1.smithi150.stdout:9/670: getdents d3/d9/dc/d1f/d24/d75/d95/d9a/dcb 0 2023-12-05T09:57:40.760 INFO:tasks.workunit.client.1.smithi150.stdout:5/749: dread d1/d7f/d65/d3b/d37/faf [0,4194304] 0 2023-12-05T09:57:40.763 INFO:tasks.workunit.client.0.smithi100.stdout:0/686: mknod da/d2a/d4d/cc7 0 2023-12-05T09:57:40.766 INFO:tasks.workunit.client.0.smithi100.stdout:8/654: mkdir d0/db7 0 2023-12-05T09:57:40.770 INFO:tasks.workunit.client.0.smithi100.stdout:5/731: symlink d0/d1b/d4d/d8e/d96/dc1/l106 0 2023-12-05T09:57:40.770 INFO:tasks.workunit.client.1.smithi150.stdout:1/740: dwrite d6/d8/db/f5b [0,4194304] 0 2023-12-05T09:57:40.770 INFO:tasks.workunit.client.1.smithi150.stdout:0/778: dread d5/d11/d71/d99/d9c/d46/f89 [0,4194304] 0 2023-12-05T09:57:40.773 INFO:tasks.workunit.client.0.smithi100.stdout:1/694: mkdir db/ddf 0 2023-12-05T09:57:40.773 INFO:tasks.workunit.client.0.smithi100.stdout:1/695: fsync db/d31/d3a/f5b 0 2023-12-05T09:57:40.773 INFO:tasks.workunit.client.0.smithi100.stdout:1/696: chown db/d31/la8 874637958 1 2023-12-05T09:57:40.776 INFO:tasks.workunit.client.1.smithi150.stdout:3/766: dwrite d6/d9/f1d [0,4194304] 0 2023-12-05T09:57:40.777 INFO:tasks.workunit.client.1.smithi150.stdout:3/767: write d6/d25/fca [397430,82800] 0 2023-12-05T09:57:40.777 INFO:tasks.workunit.client.1.smithi150.stdout:3/768: chown d6/d9/fbd 0 1 2023-12-05T09:57:40.778 INFO:tasks.workunit.client.0.smithi100.stdout:9/742: getdents d7/d35/d71 0 2023-12-05T09:57:40.780 INFO:tasks.workunit.client.0.smithi100.stdout:3/823: dwrite d0/d3d/d5c/d5f/de9/f10b [0,4194304] 0 2023-12-05T09:57:40.780 INFO:tasks.workunit.client.1.smithi150.stdout:1/741: symlink d6/d3c/dc2/l107 0 2023-12-05T09:57:40.782 INFO:tasks.workunit.client.0.smithi100.stdout:9/743: write d7/f4d [792019,21970] 0 2023-12-05T09:57:40.794 INFO:tasks.workunit.client.0.smithi100.stdout:8/655: creat d0/d35/d64/d81/d9a/fb8 x:0 0 0 2023-12-05T09:57:40.794 INFO:tasks.workunit.client.0.smithi100.stdout:8/656: fdatasync d0/d12/d13/d16/f23 0 2023-12-05T09:57:40.794 INFO:tasks.workunit.client.0.smithi100.stdout:8/657: fsync d0/d12/d13/d16/d42/d43/f88 0 2023-12-05T09:57:40.794 INFO:tasks.workunit.client.0.smithi100.stdout:2/820: sync 2023-12-05T09:57:40.797 INFO:tasks.workunit.client.1.smithi150.stdout:0/779: unlink d5/d11/d71/d5f/d6a/c6d 0 2023-12-05T09:57:40.797 INFO:tasks.workunit.client.1.smithi150.stdout:1/742: creat d6/d3c/dc2/dde/df4/f108 x:0 0 0 2023-12-05T09:57:40.799 INFO:tasks.workunit.client.0.smithi100.stdout:3/824: rename d0/d2/f4f to d0/d2/de/db8/dee/df6/f11a 0 2023-12-05T09:57:40.799 INFO:tasks.workunit.client.0.smithi100.stdout:3/825: write d0/d3d/dfc/d10d/fe4 [1216852,109902] 0 2023-12-05T09:57:40.803 INFO:tasks.workunit.client.0.smithi100.stdout:9/744: mkdir d7/d1b/d22/d2a/d56/d9c/daa/d102 0 2023-12-05T09:57:40.805 INFO:tasks.workunit.client.1.smithi150.stdout:2/777: read d0/d3/f70 [2882314,79742] 0 2023-12-05T09:57:40.813 INFO:tasks.workunit.client.0.smithi100.stdout:3/826: rename d0/d2/de/d11/ff0 to d0/d3d/dfc/d10d/f11b 0 2023-12-05T09:57:40.813 INFO:tasks.workunit.client.1.smithi150.stdout:0/780: read d5/d11/d71/d99/d9c/d3b/dad/fc5 [1117954,3585] 0 2023-12-05T09:57:40.816 INFO:tasks.workunit.client.1.smithi150.stdout:0/781: read - d5/d11/d65/fd8 zero size 2023-12-05T09:57:40.817 INFO:tasks.workunit.client.1.smithi150.stdout:1/743: write d6/d47/d4c/dd9/f77 [3174401,38095] 0 2023-12-05T09:57:40.821 INFO:tasks.workunit.client.0.smithi100.stdout:9/745: truncate d7/d35/d71/f7a 909392 0 2023-12-05T09:57:40.821 INFO:tasks.workunit.client.0.smithi100.stdout:9/746: stat d7/d1b/d22/f4a 0 2023-12-05T09:57:40.821 INFO:tasks.workunit.client.0.smithi100.stdout:9/747: write d7/ff [4800270,88723] 0 2023-12-05T09:57:40.822 INFO:tasks.workunit.client.1.smithi150.stdout:2/778: dread d0/d3/d21/d4d/f84 [0,4194304] 0 2023-12-05T09:57:40.822 INFO:tasks.workunit.client.1.smithi150.stdout:2/779: chown d0/d3/d5/d10/d3d/da1/daa 1 1 2023-12-05T09:57:40.823 INFO:tasks.workunit.client.0.smithi100.stdout:2/821: rmdir d7/da/da7/dd6/de6 0 2023-12-05T09:57:40.825 INFO:tasks.workunit.client.1.smithi150.stdout:9/671: dread d3/d9/dc/d1f/d24/f6b [0,4194304] 0 2023-12-05T09:57:40.825 INFO:tasks.workunit.client.1.smithi150.stdout:9/672: chown d3/d1b/d46/f50 3859 1 2023-12-05T09:57:40.826 INFO:tasks.workunit.client.1.smithi150.stdout:0/782: dread d5/d11/d71/d99/d9c/d96/dd5/d67/f73 [0,4194304] 0 2023-12-05T09:57:40.827 INFO:tasks.workunit.client.1.smithi150.stdout:1/744: link d6/d8/d54/cf6 d6/d47/d4c/dd9/d75/da5/c109 0 2023-12-05T09:57:40.832 INFO:tasks.workunit.client.1.smithi150.stdout:2/780: read d0/f16 [58503,11229] 0 2023-12-05T09:57:40.833 INFO:tasks.workunit.client.1.smithi150.stdout:2/781: fdatasync d0/f8e 0 2023-12-05T09:57:40.836 INFO:tasks.workunit.client.1.smithi150.stdout:9/673: unlink d3/d1b/dca/ldb 0 2023-12-05T09:57:40.836 INFO:tasks.workunit.client.1.smithi150.stdout:6/658: dwrite d2/d23/d3b/d64/d7a/d5d/d6b/f1a [4194304,4194304] 0 2023-12-05T09:57:40.836 INFO:tasks.workunit.client.1.smithi150.stdout:6/659: stat d2/d23/d2e/fdc 0 2023-12-05T09:57:40.836 INFO:tasks.workunit.client.1.smithi150.stdout:9/674: write d3/d9/d26/f3f [1102372,53314] 0 2023-12-05T09:57:40.839 INFO:tasks.workunit.client.0.smithi100.stdout:2/822: symlink d7/da/d18/d21/d4d/l113 0 2023-12-05T09:57:40.840 INFO:tasks.workunit.client.1.smithi150.stdout:0/783: creat d5/d11/f112 x:0 0 0 2023-12-05T09:57:40.840 INFO:tasks.workunit.client.1.smithi150.stdout:0/784: write d5/d11/d71/f56 [8652,4736] 0 2023-12-05T09:57:40.840 INFO:tasks.workunit.client.1.smithi150.stdout:0/785: getdents d5/d11/d65/d82/deb 0 2023-12-05T09:57:40.841 INFO:tasks.workunit.client.1.smithi150.stdout:1/745: mkdir d6/d3c/dc2/dde/df4/d10a 0 2023-12-05T09:57:40.844 INFO:tasks.workunit.client.1.smithi150.stdout:2/782: creat d0/d3/d5/d3b/d4c/d71/f10b x:0 0 0 2023-12-05T09:57:40.844 INFO:tasks.workunit.client.0.smithi100.stdout:0/687: getdents da/d2a/d4d 0 2023-12-05T09:57:40.850 INFO:tasks.workunit.client.0.smithi100.stdout:8/658: dwrite d0/d12/f48 [0,4194304] 0 2023-12-05T09:57:40.850 INFO:tasks.workunit.client.0.smithi100.stdout:5/732: dwrite d0/d1f/d53/f9d [0,4194304] 0 2023-12-05T09:57:40.852 INFO:tasks.workunit.client.0.smithi100.stdout:4/687: dwrite de/d16/d23/f2c [0,4194304] 0 2023-12-05T09:57:40.858 INFO:tasks.workunit.client.1.smithi150.stdout:3/769: dwrite d6/d9/d8d/f44 [0,4194304] 0 2023-12-05T09:57:40.860 INFO:tasks.workunit.client.1.smithi150.stdout:6/660: unlink d2/d23/d3b/cd9 0 2023-12-05T09:57:40.870 INFO:tasks.workunit.client.1.smithi150.stdout:0/786: symlink d5/d11/d71/d74/l113 0 2023-12-05T09:57:40.870 INFO:tasks.workunit.client.1.smithi150.stdout:0/787: write d5/d11/d65/fd8 [395488,28035] 0 2023-12-05T09:57:40.870 INFO:tasks.workunit.client.1.smithi150.stdout:0/788: rename d5 to d5/d11/d71/d114 22 2023-12-05T09:57:40.873 INFO:tasks.workunit.client.1.smithi150.stdout:1/746: creat d6/d38/df9/f10b x:0 0 0 2023-12-05T09:57:40.878 INFO:tasks.workunit.client.1.smithi150.stdout:2/783: mknod d0/d3/d21/d4d/deb/d103/db9/c10c 0 2023-12-05T09:57:40.881 INFO:tasks.workunit.client.0.smithi100.stdout:8/659: symlink d0/d12/d13/d16/d22/d72/d9f/lb9 0 2023-12-05T09:57:40.881 INFO:tasks.workunit.client.0.smithi100.stdout:8/660: chown d0/l4 996381051 1 2023-12-05T09:57:40.882 INFO:tasks.workunit.client.1.smithi150.stdout:9/675: dwrite d3/d9/dc/d1f/fa1 [0,4194304] 0 2023-12-05T09:57:40.885 INFO:tasks.workunit.client.0.smithi100.stdout:5/733: mknod d0/d1b/d4d/d8e/c107 0 2023-12-05T09:57:40.888 INFO:tasks.workunit.client.0.smithi100.stdout:4/688: chown de/d16/d23/d33/d3d/d44/d4e 483795215 1 2023-12-05T09:57:40.894 INFO:tasks.workunit.client.1.smithi150.stdout:3/770: mknod d6/d22/d37/da1/cf9 0 2023-12-05T09:57:40.896 INFO:tasks.workunit.client.1.smithi150.stdout:6/661: getdents d2/d23/d3b/d64/d7a/d8c 0 2023-12-05T09:57:40.896 INFO:tasks.workunit.client.0.smithi100.stdout:4/689: chown de/d16/d23/d36 2 1 2023-12-05T09:57:40.897 INFO:tasks.workunit.client.1.smithi150.stdout:0/789: symlink d5/d11/d32/df2/d107/l115 0 2023-12-05T09:57:40.898 INFO:tasks.workunit.client.0.smithi100.stdout:8/661: dread d0/d12/d13/d16/d42/f75 [0,4194304] 0 2023-12-05T09:57:40.899 INFO:tasks.workunit.client.0.smithi100.stdout:5/734: rmdir d0/d4/d14/d35/d62 39 2023-12-05T09:57:40.907 INFO:tasks.workunit.client.1.smithi150.stdout:1/747: rename d6/d47/d4c/d7c/d89/cec to d6/d47/d4c/dd9/de2/c10c 0 2023-12-05T09:57:40.907 INFO:tasks.workunit.client.1.smithi150.stdout:1/748: dread - d6/d38/df9/f10b zero size 2023-12-05T09:57:40.913 INFO:tasks.workunit.client.1.smithi150.stdout:2/784: rmdir d0/d3/d27/dea 39 2023-12-05T09:57:40.915 INFO:tasks.workunit.client.0.smithi100.stdout:4/690: stat de/d16/d23/d60/dc4/cab 0 2023-12-05T09:57:40.919 INFO:tasks.workunit.client.0.smithi100.stdout:5/735: symlink d0/d1b/d4d/d8e/d96/dc1/dae/l108 0 2023-12-05T09:57:40.923 INFO:tasks.workunit.client.1.smithi150.stdout:3/771: mknod d6/d9/cfa 0 2023-12-05T09:57:40.923 INFO:tasks.workunit.client.1.smithi150.stdout:3/772: fsync d6/d25/f97 0 2023-12-05T09:57:40.927 INFO:tasks.workunit.client.1.smithi150.stdout:1/749: symlink d6/d8/db/d1b/d79/dca/l10d 0 2023-12-05T09:57:40.930 INFO:tasks.workunit.client.0.smithi100.stdout:7/683: dwrite d3/dc/d11/d13/fb [0,4194304] 0 2023-12-05T09:57:40.933 INFO:tasks.workunit.client.0.smithi100.stdout:4/691: creat de/d16/dc8/fe1 x:0 0 0 2023-12-05T09:57:40.933 INFO:tasks.workunit.client.0.smithi100.stdout:4/692: chown de/d16/d23/d33/d3d/d44/d4e/c61 130155692 1 2023-12-05T09:57:40.933 INFO:tasks.workunit.client.0.smithi100.stdout:4/693: chown de/d16/d23/d33/dae 19 1 2023-12-05T09:57:40.934 INFO:tasks.workunit.client.1.smithi150.stdout:2/785: rename d0/d3/d11/d1d/l7e to d0/d3/d5/d22/l10d 0 2023-12-05T09:57:40.944 INFO:tasks.workunit.client.1.smithi150.stdout:7/734: sync 2023-12-05T09:57:40.946 INFO:tasks.workunit.client.0.smithi100.stdout:0/688: dwrite da/d22/d33/d35/d3a/f47 [0,4194304] 0 2023-12-05T09:57:40.949 INFO:tasks.workunit.client.1.smithi150.stdout:1/750: mkdir d6/d8/d85/d10e 0 2023-12-05T09:57:40.949 INFO:tasks.workunit.client.1.smithi150.stdout:1/751: readlink d6/d47/d4c/dd9/lc9 0 2023-12-05T09:57:40.949 INFO:tasks.workunit.client.1.smithi150.stdout:1/752: readlink d6/d3c/lb8 0 2023-12-05T09:57:40.951 INFO:tasks.workunit.client.0.smithi100.stdout:7/684: link d3/dc/d11/f59 d3/dc/daa/f102 0 2023-12-05T09:57:40.953 INFO:tasks.workunit.client.1.smithi150.stdout:2/786: mkdir d0/d3/d5/d22/d52/d10e 0 2023-12-05T09:57:40.955 INFO:tasks.workunit.client.1.smithi150.stdout:7/735: creat d2/db/ff3 x:0 0 0 2023-12-05T09:57:40.957 INFO:tasks.workunit.client.1.smithi150.stdout:5/750: sync 2023-12-05T09:57:40.957 INFO:tasks.workunit.client.1.smithi150.stdout:8/780: sync 2023-12-05T09:57:40.957 INFO:tasks.workunit.client.1.smithi150.stdout:4/683: sync 2023-12-05T09:57:40.957 INFO:tasks.workunit.client.1.smithi150.stdout:4/684: write d0/d3e/d5b/d80/d44/f60 [927189,38186] 0 2023-12-05T09:57:40.958 INFO:tasks.workunit.client.1.smithi150.stdout:4/685: truncate d0/d3e/f78 937992 0 2023-12-05T09:57:40.958 INFO:tasks.workunit.client.1.smithi150.stdout:7/736: creat d2/db/d2e/d71/df2/ff4 x:0 0 0 2023-12-05T09:57:40.958 INFO:tasks.workunit.client.1.smithi150.stdout:7/737: write d2/db/d17/d88/fcf [129891,102822] 0 2023-12-05T09:57:40.959 INFO:tasks.workunit.client.1.smithi150.stdout:5/751: rmdir d1/d2e/dec 39 2023-12-05T09:57:40.959 INFO:tasks.workunit.client.1.smithi150.stdout:5/752: read - d1/d3/d6/d26/d9a/ff3 zero size 2023-12-05T09:57:40.959 INFO:tasks.workunit.client.1.smithi150.stdout:5/753: chown d1/d3/d6/d26/d9a/ff3 117 1 2023-12-05T09:57:40.964 INFO:tasks.workunit.client.1.smithi150.stdout:4/686: truncate d0/d3e/d5b/f94 2186821 0 2023-12-05T09:57:40.964 INFO:tasks.workunit.client.1.smithi150.stdout:8/781: creat d0/d41/d49/d1b/d24/d34/d56/d67/ff2 x:0 0 0 2023-12-05T09:57:40.964 INFO:tasks.workunit.client.1.smithi150.stdout:7/738: truncate d2/db/d30/f94 3779130 0 2023-12-05T09:57:40.964 INFO:tasks.workunit.client.1.smithi150.stdout:8/782: fsync d0/d41/d49/d1b/f1d 0 2023-12-05T09:57:40.964 INFO:tasks.workunit.client.1.smithi150.stdout:4/687: write d0/d3e/d48/d4d/f57 [4712674,85477] 0 2023-12-05T09:57:40.966 INFO:tasks.workunit.client.1.smithi150.stdout:1/753: dread d6/d8/d59/f65 [0,4194304] 0 2023-12-05T09:57:40.966 INFO:tasks.workunit.client.1.smithi150.stdout:1/754: dread - d6/d38/f41 zero size 2023-12-05T09:57:40.975 INFO:tasks.workunit.client.1.smithi150.stdout:6/662: dwrite d2/d23/d2e/d93/fc2 [0,4194304] 0 2023-12-05T09:57:40.977 INFO:tasks.workunit.client.1.smithi150.stdout:5/754: unlink d1/d64/d31/d5b/ddf/fba 0 2023-12-05T09:57:40.977 INFO:tasks.workunit.client.1.smithi150.stdout:7/739: creat d2/db/d17/d38/dc8/df0/ff5 x:0 0 0 2023-12-05T09:57:40.977 INFO:tasks.workunit.client.1.smithi150.stdout:7/740: dread - d2/db/d2e/d71/df2/ff4 zero size 2023-12-05T09:57:40.977 INFO:tasks.workunit.client.1.smithi150.stdout:5/755: write d1/d7f/fa5 [373404,23455] 0 2023-12-05T09:57:40.977 INFO:tasks.workunit.client.1.smithi150.stdout:2/787: dread d0/d3/d11/f18 [0,4194304] 0 2023-12-05T09:57:40.977 INFO:tasks.workunit.client.1.smithi150.stdout:2/788: chown d0/d3/d21/d4d/deb/d103/d15/l55 87621675 1 2023-12-05T09:57:40.977 INFO:tasks.workunit.client.1.smithi150.stdout:2/789: dread - d0/d3/d27/d95/ddf/ffb zero size 2023-12-05T09:57:40.982 INFO:tasks.workunit.client.1.smithi150.stdout:8/783: link d0/d41/d49/d1b/d24/d34/c7b d0/d41/d49/d1b/dea/cf3 0 2023-12-05T09:57:40.982 INFO:tasks.workunit.client.1.smithi150.stdout:4/688: creat d0/d3e/d5b/d80/d44/da2/fd6 x:0 0 0 2023-12-05T09:57:40.982 INFO:tasks.workunit.client.1.smithi150.stdout:4/689: fsync d0/f3c 0 2023-12-05T09:57:40.983 INFO:tasks.workunit.client.1.smithi150.stdout:1/755: rename d6/d8/d54/ff0 to d6/d47/d4c/d60/f10f 0 2023-12-05T09:57:40.983 INFO:tasks.workunit.client.1.smithi150.stdout:3/773: dwrite d6/d9/d8d/f68 [8388608,4194304] 0 2023-12-05T09:57:40.984 INFO:tasks.workunit.client.1.smithi150.stdout:3/774: write d6/d25/f97 [671004,74521] 0 2023-12-05T09:57:40.988 INFO:tasks.workunit.client.1.smithi150.stdout:6/663: getdents d2/d23/d3b/db4 0 2023-12-05T09:57:40.988 INFO:tasks.workunit.client.1.smithi150.stdout:6/664: fsync d2/d23/d2e/fad 0 2023-12-05T09:57:40.990 INFO:tasks.workunit.client.0.smithi100.stdout:8/662: dwrite d0/d35/d64/d81/d9a/fb8 [0,4194304] 0 2023-12-05T09:57:40.990 INFO:tasks.workunit.client.0.smithi100.stdout:8/663: dread - d0/d12/f78 zero size 2023-12-05T09:57:40.990 INFO:tasks.workunit.client.0.smithi100.stdout:8/664: chown d0/d35/c51 65 1 2023-12-05T09:57:40.990 INFO:tasks.workunit.client.0.smithi100.stdout:5/736: dwrite d0/d16/dc9/ffb [0,4194304] 0 2023-12-05T09:57:40.991 INFO:tasks.workunit.client.0.smithi100.stdout:8/665: write d0/d12/d13/f3e [4174709,106243] 0 2023-12-05T09:57:40.991 INFO:tasks.workunit.client.0.smithi100.stdout:5/737: write d0/d1b/d4d/d8e/d96/dc1/fce [4330670,113289] 0 2023-12-05T09:57:40.991 INFO:tasks.workunit.client.1.smithi150.stdout:5/756: rmdir d1/d2e/dec/dfb 0 2023-12-05T09:57:41.009 INFO:tasks.workunit.client.0.smithi100.stdout:5/738: mknod d0/d1f/d25/d31/c109 0 2023-12-05T09:57:41.012 INFO:tasks.workunit.client.1.smithi150.stdout:8/784: write d0/d41/d49/fcb [876339,86896] 0 2023-12-05T09:57:41.013 INFO:tasks.workunit.client.1.smithi150.stdout:7/741: rename d2/d72/le7 to d2/db/d2e/d9a/lf6 0 2023-12-05T09:57:41.014 INFO:tasks.workunit.client.1.smithi150.stdout:1/756: creat d6/d8/db/db1/f110 x:0 0 0 2023-12-05T09:57:41.017 INFO:tasks.workunit.client.1.smithi150.stdout:3/775: unlink d6/d9/d3d/d52/fc5 0 2023-12-05T09:57:41.018 INFO:tasks.workunit.client.1.smithi150.stdout:3/776: chown d6/d9/d3d/d8a/cbf 2140 1 2023-12-05T09:57:41.020 INFO:tasks.workunit.client.1.smithi150.stdout:8/785: unlink d0/d41/d49/d1b/d24/d5b/d87/ld9 0 2023-12-05T09:57:41.020 INFO:tasks.workunit.client.1.smithi150.stdout:8/786: creat d0/d41/d49/d1b/d24/d34/dbc/ff4 x:0 0 0 2023-12-05T09:57:41.024 INFO:tasks.workunit.client.1.smithi150.stdout:7/742: creat d2/d1b/ff7 x:0 0 0 2023-12-05T09:57:41.024 INFO:tasks.workunit.client.1.smithi150.stdout:1/757: creat d6/d47/db4/f111 x:0 0 0 2023-12-05T09:57:41.024 INFO:tasks.workunit.client.1.smithi150.stdout:1/758: fdatasync d6/d8/d59/fc0 0 2023-12-05T09:57:41.026 INFO:tasks.workunit.client.0.smithi100.stdout:8/666: dread d0/d35/d64/fa0 [0,4194304] 0 2023-12-05T09:57:41.028 INFO:tasks.workunit.client.1.smithi150.stdout:3/777: mknod d6/d9/d8d/cfb 0 2023-12-05T09:57:41.028 INFO:tasks.workunit.client.1.smithi150.stdout:3/778: write d6/d9/d3d/d87/f89 [4941758,92538] 0 2023-12-05T09:57:41.030 INFO:tasks.workunit.client.1.smithi150.stdout:7/743: creat d2/db/d17/ff8 x:0 0 0 2023-12-05T09:57:41.030 INFO:tasks.workunit.client.1.smithi150.stdout:7/744: stat d2/db/d30/daf/dd3/d2b/cca 0 2023-12-05T09:57:41.033 INFO:tasks.workunit.client.0.smithi100.stdout:8/667: mkdir d0/d12/d13/d45/dba 0 2023-12-05T09:57:41.037 INFO:tasks.workunit.client.0.smithi100.stdout:7/685: dwrite d3/dc/d11/d13/de/f48 [0,4194304] 0 2023-12-05T09:57:41.037 INFO:tasks.workunit.client.0.smithi100.stdout:7/686: chown d3/dc/d11/d13/de/d18/c8d 253984 1 2023-12-05T09:57:41.037 INFO:tasks.workunit.client.0.smithi100.stdout:7/687: chown d3/dc/d11/d13/de/d18/d3b/d40/d4c 118248 1 2023-12-05T09:57:41.037 INFO:tasks.workunit.client.0.smithi100.stdout:5/739: write d0/d1f/d25/f63 [3900362,105717] 0 2023-12-05T09:57:41.037 INFO:tasks.workunit.client.0.smithi100.stdout:5/740: readlink d0/d1f/d25/d31/lad 0 2023-12-05T09:57:41.037 INFO:tasks.workunit.client.1.smithi150.stdout:1/759: link f4 d6/d3c/dc2/dde/df4/d10a/f112 0 2023-12-05T09:57:41.037 INFO:tasks.workunit.client.1.smithi150.stdout:1/760: write d6/d3c/fd6 [586586,103360] 0 2023-12-05T09:57:41.037 INFO:tasks.workunit.client.1.smithi150.stdout:1/761: dread - d6/d47/d4c/dd9/f93 zero size 2023-12-05T09:57:41.037 INFO:tasks.workunit.client.1.smithi150.stdout:3/779: mkdir d6/d25/dfc 0 2023-12-05T09:57:41.038 INFO:tasks.workunit.client.1.smithi150.stdout:2/790: dwrite d0/d3/d21/d4d/deb/d103/d15/d30/fda [0,4194304] 0 2023-12-05T09:57:41.038 INFO:tasks.workunit.client.1.smithi150.stdout:3/780: write d6/d9/d3d/fd8 [751415,126166] 0 2023-12-05T09:57:41.038 INFO:tasks.workunit.client.0.smithi100.stdout:4/694: dwrite de/d16/d23/d60/d98/da6/fb5 [0,4194304] 0 2023-12-05T09:57:41.038 INFO:tasks.workunit.client.0.smithi100.stdout:8/668: creat d0/d12/d13/d16/da3/fbb x:0 0 0 2023-12-05T09:57:41.041 INFO:tasks.workunit.client.1.smithi150.stdout:8/787: dread d0/d8/fa9 [0,4194304] 0 2023-12-05T09:57:41.042 INFO:tasks.workunit.client.1.smithi150.stdout:8/788: chown d0/d41/d49 6263 1 2023-12-05T09:57:41.042 INFO:tasks.workunit.client.1.smithi150.stdout:8/789: write d0/d41/d49/d1b/d24/d2e/f53 [225020,45197] 0 2023-12-05T09:57:41.042 INFO:tasks.workunit.client.1.smithi150.stdout:5/757: dwrite d1/d7f/d65/d3b/d6b/fb0 [0,4194304] 0 2023-12-05T09:57:41.043 INFO:tasks.workunit.client.1.smithi150.stdout:7/745: dread d2/d1b/d31/f8d [0,4194304] 0 2023-12-05T09:57:41.043 INFO:tasks.workunit.client.1.smithi150.stdout:7/746: stat d2/db/d17/d88 0 2023-12-05T09:57:41.044 INFO:tasks.workunit.client.0.smithi100.stdout:7/688: link d3/dc/d11/d13/de/f2b d3/dc/d11/d13/d37/d97/dc1/dcd/f103 0 2023-12-05T09:57:41.048 INFO:tasks.workunit.client.1.smithi150.stdout:1/762: stat d6/d8/db/d1b/lbd 0 2023-12-05T09:57:41.048 INFO:tasks.workunit.client.1.smithi150.stdout:1/763: stat d6/d8/db/d1b/d79/f7a 0 2023-12-05T09:57:41.048 INFO:tasks.workunit.client.1.smithi150.stdout:1/764: fsync d6/d8/d59/f65 0 2023-12-05T09:57:41.048 INFO:tasks.workunit.client.1.smithi150.stdout:1/765: readlink d6/d8/db/d1b/lbd 0 2023-12-05T09:57:41.050 INFO:tasks.workunit.client.1.smithi150.stdout:1/766: chown d6/d47/d4c/d7c 159920354 1 2023-12-05T09:57:41.051 INFO:tasks.workunit.client.1.smithi150.stdout:2/791: unlink d0/d3/d21/d4d/ce8 0 2023-12-05T09:57:41.052 INFO:tasks.workunit.client.1.smithi150.stdout:3/781: mknod d6/d9/d43/d47/d94/df1/cfd 0 2023-12-05T09:57:41.052 INFO:tasks.workunit.client.1.smithi150.stdout:6/665: write d2/d23/d3b/d64/f88 [1569358,112479] 0 2023-12-05T09:57:41.055 INFO:tasks.workunit.client.0.smithi100.stdout:7/689: write d3/dc/d11/d33/f79 [281537,8780] 0 2023-12-05T09:57:41.055 INFO:tasks.workunit.client.0.smithi100.stdout:7/690: write d3/dc/d11/d13/de/d2d/d47/dbd/f101 [198638,87532] 0 2023-12-05T09:57:41.056 INFO:tasks.workunit.client.0.smithi100.stdout:7/691: chown d3/dc/d11/d33/fbf 791517548 1 2023-12-05T09:57:41.056 INFO:tasks.workunit.client.1.smithi150.stdout:0/790: sync 2023-12-05T09:57:41.059 INFO:tasks.workunit.client.0.smithi100.stdout:5/741: write d0/d4/d14/d35/f89 [2870796,80564] 0 2023-12-05T09:57:41.059 INFO:tasks.workunit.client.0.smithi100.stdout:5/742: stat d0/d1b/d4d/d8e/cb8 0 2023-12-05T09:57:41.060 INFO:tasks.workunit.client.1.smithi150.stdout:4/690: dwrite d0/d3e/d5b/d80/dc8/fce [0,4194304] 0 2023-12-05T09:57:41.060 INFO:tasks.workunit.client.1.smithi150.stdout:4/691: chown d0/d3e/d5b/d80/d44/da2/dbd/fcb 1 1 2023-12-05T09:57:41.060 INFO:tasks.workunit.client.1.smithi150.stdout:5/758: link d1/d7f/d65/d3b/d6b/cc0 d1/d64/d31/d5b/ddf/c10c 0 2023-12-05T09:57:41.060 INFO:tasks.workunit.client.1.smithi150.stdout:8/790: dread d0/d41/d49/d1b/fa4 [0,4194304] 0 2023-12-05T09:57:41.060 INFO:tasks.workunit.client.1.smithi150.stdout:8/791: chown d0/d41/d49/d1b/d24/d34/d56/l85 244319 1 2023-12-05T09:57:41.062 INFO:tasks.workunit.client.1.smithi150.stdout:1/767: rename d6/d47/d4c/dd9/d75/ddd/de3 to d6/d8/d85/d113 0 2023-12-05T09:57:41.063 INFO:tasks.workunit.client.0.smithi100.stdout:8/669: symlink d0/d35/d64/d81/d9a/lbc 0 2023-12-05T09:57:41.063 INFO:tasks.workunit.client.0.smithi100.stdout:8/670: chown d0/d12/d13/d16/d22/f33 1 1 2023-12-05T09:57:41.065 INFO:tasks.workunit.client.1.smithi150.stdout:2/792: mkdir d0/d3/d27/dac/d10f 0 2023-12-05T09:57:41.066 INFO:tasks.workunit.client.1.smithi150.stdout:9/676: sync 2023-12-05T09:57:41.068 INFO:tasks.workunit.client.1.smithi150.stdout:3/782: link d6/d9/d3d/d56/d53/fd0 d6/d9/d3d/d56/d79/ffe 0 2023-12-05T09:57:41.070 INFO:tasks.workunit.client.0.smithi100.stdout:7/692: write d3/dc/d11/d13/de/d18/d3b/d40/d4c/d7f/fb5 [4171755,61486] 0 2023-12-05T09:57:41.072 INFO:tasks.workunit.client.0.smithi100.stdout:8/671: truncate d0/f31 2562862 0 2023-12-05T09:57:41.080 INFO:tasks.workunit.client.0.smithi100.stdout:5/743: link d0/d16/d2b/d48/df/fe2 d0/d1f/f10a 0 2023-12-05T09:57:41.080 INFO:tasks.workunit.client.0.smithi100.stdout:8/672: rename d0/d12/d13/d16/d22 to d0/d12/d13/d45/dba/dbd 0 2023-12-05T09:57:41.083 INFO:tasks.workunit.client.1.smithi150.stdout:4/692: unlink d0/d3e/d6d/f37 0 2023-12-05T09:57:41.089 INFO:tasks.workunit.client.1.smithi150.stdout:5/759: creat d1/d7f/d65/d3b/d6b/dcb/f10d x:0 0 0 2023-12-05T09:57:41.090 INFO:tasks.workunit.client.1.smithi150.stdout:6/666: rename d2/d23/d3b/d64/d7a/f5e to d2/d23/d3b/d64/d7a/d5d/dcd/fde 0 2023-12-05T09:57:41.095 INFO:tasks.workunit.client.1.smithi150.stdout:1/768: mkdir d6/d47/d4c/dd9/d75/ddd/d114 0 2023-12-05T09:57:41.097 INFO:tasks.workunit.client.1.smithi150.stdout:2/793: mkdir d0/d3/d5/d3b/df2/d110 0 2023-12-05T09:57:41.098 INFO:tasks.workunit.client.1.smithi150.stdout:4/693: truncate d0/f24 4130879 0 2023-12-05T09:57:41.098 INFO:tasks.workunit.client.1.smithi150.stdout:4/694: write d0/d3e/d5b/fc6 [469312,26340] 0 2023-12-05T09:57:41.099 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:40 smithi150 ceph-mon[116142]: pgmap v36: 65 pgs: 65 active+clean; 2.4 GiB data, 8.7 GiB used, 528 GiB / 536 GiB avail; 168 MiB/s rd, 200 MiB/s wr, 304 op/s 2023-12-05T09:57:41.099 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:40 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:57:41.099 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:40 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:57:41.099 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:40 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-05T09:57:41.099 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:40 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-05T09:57:41.099 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:40 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-05T09:57:41.109 INFO:tasks.workunit.client.0.smithi100.stdout:8/673: rmdir d0/d35/d64/d81/d9a 39 2023-12-05T09:57:41.114 INFO:tasks.workunit.client.0.smithi100.stdout:5/744: dread d0/d1f/d53/f9d [0,4194304] 0 2023-12-05T09:57:41.114 INFO:tasks.workunit.client.0.smithi100.stdout:5/745: fsync d0/d1f/d53/f92 0 2023-12-05T09:57:41.116 INFO:tasks.workunit.client.0.smithi100.stdout:8/674: creat d0/d12/d13/d45/da6/d76/fbe x:0 0 0 2023-12-05T09:57:41.123 INFO:tasks.workunit.client.0.smithi100.stdout:5/746: creat d0/d1f/da1/f10b x:0 0 0 2023-12-05T09:57:41.123 INFO:tasks.workunit.client.0.smithi100.stdout:5/747: chown d0/d16 141616 1 2023-12-05T09:57:41.123 INFO:tasks.workunit.client.0.smithi100.stdout:5/748: stat d0/d16/d2b/f3a 0 2023-12-05T09:57:41.123 INFO:tasks.workunit.client.0.smithi100.stdout:8/675: rmdir d0/d12/d52 39 2023-12-05T09:57:41.124 INFO:tasks.workunit.client.1.smithi150.stdout:5/760: dread d1/d2e/da6/d86/f88 [0,4194304] 0 2023-12-05T09:57:41.127 INFO:tasks.workunit.client.1.smithi150.stdout:8/792: dwrite d0/d41/d49/d1b/d24/d38/d62/f6b [0,4194304] 0 2023-12-05T09:57:41.131 INFO:tasks.workunit.client.1.smithi150.stdout:4/695: rename d0/d3e/d48/d4d to d0/d3e/d5b/d80/d44/da2/da4/dd7 0 2023-12-05T09:57:41.135 INFO:tasks.workunit.client.1.smithi150.stdout:7/747: dwrite d2/db/d30/d13/f66 [0,4194304] 0 2023-12-05T09:57:41.140 INFO:tasks.workunit.client.1.smithi150.stdout:0/791: dwrite d5/d11/d71/d99/d9c/d46/d80/fef [0,4194304] 0 2023-12-05T09:57:41.144 INFO:tasks.workunit.client.1.smithi150.stdout:5/761: read d1/d7f/d65/d3b/d6b/fb5 [650951,22015] 0 2023-12-05T09:57:41.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:40 smithi100 ceph-mon[107145]: pgmap v36: 65 pgs: 65 active+clean; 2.4 GiB data, 8.7 GiB used, 528 GiB / 536 GiB avail; 168 MiB/s rd, 200 MiB/s wr, 304 op/s 2023-12-05T09:57:41.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:40 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:57:41.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:40 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:57:41.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:40 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-05T09:57:41.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:40 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-05T09:57:41.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:40 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-05T09:57:41.146 INFO:tasks.workunit.client.0.smithi100.stdout:8/676: write d0/d12/d13/d45/da6/d76/d91/faa [1251223,87325] 0 2023-12-05T09:57:41.147 INFO:tasks.workunit.client.0.smithi100.stdout:8/677: write d0/d12/d13/d16/f20 [2092875,18777] 0 2023-12-05T09:57:41.147 INFO:tasks.workunit.client.1.smithi150.stdout:7/748: getdents d2/db/d30/d18 0 2023-12-05T09:57:41.159 INFO:tasks.workunit.client.1.smithi150.stdout:0/792: rmdir d5/d11/d71 39 2023-12-05T09:57:41.159 INFO:tasks.workunit.client.1.smithi150.stdout:4/696: dread d0/d3e/f8d [0,4194304] 0 2023-12-05T09:57:41.159 INFO:tasks.workunit.client.1.smithi150.stdout:4/697: truncate d0/d3e/d5b/d80/f87 708910 0 2023-12-05T09:57:41.159 INFO:tasks.workunit.client.1.smithi150.stdout:5/762: mkdir d1/d3/d6/d26/d9a/d10e 0 2023-12-05T09:57:41.159 INFO:tasks.workunit.client.1.smithi150.stdout:9/677: dwrite d3/d42/fc7 [0,4194304] 0 2023-12-05T09:57:41.160 INFO:tasks.workunit.client.0.smithi100.stdout:8/678: dread d0/d12/d13/d16/d42/f75 [0,4194304] 0 2023-12-05T09:57:41.160 INFO:tasks.workunit.client.1.smithi150.stdout:0/793: getdents d5/d11/d71/d5f/d77 0 2023-12-05T09:57:41.160 INFO:tasks.workunit.client.1.smithi150.stdout:1/769: dread d6/d8/fc5 [0,4194304] 0 2023-12-05T09:57:41.161 INFO:tasks.workunit.client.1.smithi150.stdout:1/770: write d6/d3c/dc2/dde/df4/f108 [422780,58408] 0 2023-12-05T09:57:41.164 INFO:tasks.workunit.client.0.smithi100.stdout:8/679: creat d0/d12/d13/d45/fbf x:0 0 0 2023-12-05T09:57:41.165 INFO:tasks.workunit.client.1.smithi150.stdout:5/763: creat d1/d7f/d65/d3b/d6b/d109/f10f x:0 0 0 2023-12-05T09:57:41.166 INFO:tasks.workunit.client.0.smithi100.stdout:7/693: dwrite d3/dc/d11/d13/de/d2d/d47/f72 [4194304,4194304] 0 2023-12-05T09:57:41.166 INFO:tasks.workunit.client.0.smithi100.stdout:7/694: fsync d3/dc/d11/d13/de/d2d/d47/dbd/ff8 0 2023-12-05T09:57:41.167 INFO:tasks.workunit.client.0.smithi100.stdout:8/680: creat d0/d35/d64/d81/fc0 x:0 0 0 2023-12-05T09:57:41.167 INFO:tasks.workunit.client.0.smithi100.stdout:8/681: chown d0/d12/d52/f7e 5 1 2023-12-05T09:57:41.167 INFO:tasks.workunit.client.0.smithi100.stdout:8/682: read d0/d12/d13/d45/da6/f69 [619075,55457] 0 2023-12-05T09:57:41.167 INFO:tasks.workunit.client.0.smithi100.stdout:5/749: dwrite d0/d1f/f6a [4194304,4194304] 0 2023-12-05T09:57:41.167 INFO:tasks.workunit.client.0.smithi100.stdout:5/750: stat d0/d1f/da1/f10b 0 2023-12-05T09:57:41.169 INFO:tasks.workunit.client.0.smithi100.stdout:7/695: symlink d3/dc/l104 0 2023-12-05T09:57:41.170 INFO:tasks.workunit.client.1.smithi150.stdout:6/667: dwrite d2/d23/d2e/d44/fbc [0,4194304] 0 2023-12-05T09:57:41.171 INFO:tasks.workunit.client.1.smithi150.stdout:9/678: rename d3/d9/dc/d1f/f2b to d3/d1b/d46/d55/d64/fdc 0 2023-12-05T09:57:41.172 INFO:tasks.workunit.client.0.smithi100.stdout:7/696: write d3/dc/ff3 [63758,59274] 0 2023-12-05T09:57:41.172 INFO:tasks.workunit.client.1.smithi150.stdout:9/679: read d3/d1b/d46/f50 [888641,65761] 0 2023-12-05T09:57:41.175 INFO:tasks.workunit.client.0.smithi100.stdout:8/683: truncate d0/d35/d64/d81/d9a/fb8 605874 0 2023-12-05T09:57:41.175 INFO:tasks.workunit.client.1.smithi150.stdout:1/771: link d6/d38/f41 d6/d8/d85/f115 0 2023-12-05T09:57:41.175 INFO:tasks.workunit.client.1.smithi150.stdout:1/772: fsync d6/d47/d4c/dd9/f93 0 2023-12-05T09:57:41.180 INFO:tasks.workunit.client.1.smithi150.stdout:4/698: getdents d0/d3e/d48/dbb 0 2023-12-05T09:57:41.180 INFO:tasks.workunit.client.1.smithi150.stdout:4/699: dread - d0/d3e/d48/f9e zero size 2023-12-05T09:57:41.182 INFO:tasks.workunit.client.0.smithi100.stdout:5/751: symlink d0/d1b/d4d/d8e/d96/dea/l10c 0 2023-12-05T09:57:41.182 INFO:tasks.workunit.client.0.smithi100.stdout:7/697: dread d3/dc/d11/d13/de/d2d/ffd [0,4194304] 0 2023-12-05T09:57:41.196 INFO:tasks.workunit.client.1.smithi150.stdout:9/680: unlink d3/d9/d26/l28 0 2023-12-05T09:57:41.202 INFO:tasks.workunit.client.1.smithi150.stdout:1/773: symlink d6/d38/df9/l116 0 2023-12-05T09:57:41.202 INFO:tasks.workunit.client.1.smithi150.stdout:1/774: write d6/d3c/f40 [1816662,40920] 0 2023-12-05T09:57:41.205 INFO:tasks.workunit.client.0.smithi100.stdout:8/684: dread d0/d12/d13/d16/f23 [4194304,4194304] 0 2023-12-05T09:57:41.206 INFO:tasks.workunit.client.0.smithi100.stdout:8/685: unlink d0/d35/f6d 0 2023-12-05T09:57:41.207 INFO:tasks.workunit.client.1.smithi150.stdout:2/794: dwrite d0/d3/d11/d1d/f29 [0,4194304] 0 2023-12-05T09:57:41.212 INFO:tasks.workunit.client.1.smithi150.stdout:4/700: creat d0/d3e/d6d/d95/fd8 x:0 0 0 2023-12-05T09:57:41.213 INFO:tasks.workunit.client.1.smithi150.stdout:0/794: dwrite d5/d11/d65/d82/fab [4194304,4194304] 0 2023-12-05T09:57:41.213 INFO:tasks.workunit.client.1.smithi150.stdout:7/749: dwrite d2/db/d30/daf/dd3/fa8 [0,4194304] 0 2023-12-05T09:57:41.215 INFO:tasks.workunit.client.1.smithi150.stdout:6/668: dwrite d2/d23/d3b/d64/d7a/f40 [0,4194304] 0 2023-12-05T09:57:41.215 INFO:tasks.workunit.client.1.smithi150.stdout:6/669: write d2/f34 [2805753,94931] 0 2023-12-05T09:57:41.218 INFO:tasks.workunit.client.1.smithi150.stdout:1/775: symlink d6/l117 0 2023-12-05T09:57:41.218 INFO:tasks.workunit.client.1.smithi150.stdout:1/776: fsync d6/d8/db/f105 0 2023-12-05T09:57:41.225 INFO:tasks.workunit.client.0.smithi100.stdout:9/748: sync 2023-12-05T09:57:41.226 INFO:tasks.workunit.client.0.smithi100.stdout:2/823: sync 2023-12-05T09:57:41.226 INFO:tasks.workunit.client.0.smithi100.stdout:3/827: sync 2023-12-05T09:57:41.226 INFO:tasks.workunit.client.0.smithi100.stdout:0/689: sync 2023-12-05T09:57:41.226 INFO:tasks.workunit.client.0.smithi100.stdout:0/690: stat da/d22/d33/d35/d3a/f83 0 2023-12-05T09:57:41.226 INFO:tasks.workunit.client.0.smithi100.stdout:0/691: dread - da/d1b/d36/db4/fc0 zero size 2023-12-05T09:57:41.226 INFO:tasks.workunit.client.0.smithi100.stdout:0/692: chown da/d1b/dbe/fc5 4557 1 2023-12-05T09:57:41.227 INFO:tasks.workunit.client.0.smithi100.stdout:1/697: sync 2023-12-05T09:57:41.227 INFO:tasks.workunit.client.0.smithi100.stdout:1/698: readlink db/d12/d1e/d26/ld8 0 2023-12-05T09:57:41.229 INFO:tasks.workunit.client.0.smithi100.stdout:9/749: mkdir d7/d1b/d22/d51/d32/d96/d103 0 2023-12-05T09:57:41.229 INFO:tasks.workunit.client.0.smithi100.stdout:9/750: chown d7/d20/c98 957608227 1 2023-12-05T09:57:41.230 INFO:tasks.workunit.client.1.smithi150.stdout:4/701: read d0/d5f/f68 [4178111,79884] 0 2023-12-05T09:57:41.231 INFO:tasks.workunit.client.0.smithi100.stdout:2/824: mkdir d7/da/da7/dd2/d114 0 2023-12-05T09:57:41.231 INFO:tasks.workunit.client.1.smithi150.stdout:0/795: creat d5/d11/d71/d99/d9c/d96/dd5/d7f/f116 x:0 0 0 2023-12-05T09:57:41.231 INFO:tasks.workunit.client.1.smithi150.stdout:0/796: creat d5/d11/d71/d99/d9c/d3b/dad/f117 x:0 0 0 2023-12-05T09:57:41.234 INFO:tasks.workunit.client.0.smithi100.stdout:0/693: link da/d1b/d6b/d78/l99 da/d22/d33/d35/d3a/d8b/lc8 0 2023-12-05T09:57:41.235 INFO:tasks.workunit.client.1.smithi150.stdout:6/670: mkdir d2/d23/d2e/d5f/d99/dd8/ddf 0 2023-12-05T09:57:41.235 INFO:tasks.workunit.client.1.smithi150.stdout:6/671: write d2/d23/d3b/d64/d7a/d5d/d6b/f22 [4476528,1162] 0 2023-12-05T09:57:41.236 INFO:tasks.workunit.client.1.smithi150.stdout:9/681: dwrite d3/d1b/d46/d55/d64/fa6 [0,4194304] 0 2023-12-05T09:57:41.236 INFO:tasks.workunit.client.1.smithi150.stdout:7/750: dread d2/db/d30/d13/d4f/d5a/d5c/f43 [0,4194304] 0 2023-12-05T09:57:41.236 INFO:tasks.workunit.client.0.smithi100.stdout:3/828: truncate d0/fa7 1867161 0 2023-12-05T09:57:41.239 INFO:tasks.workunit.client.1.smithi150.stdout:1/777: dread d6/d3c/dc2/dde/df4/d10a/f112 [0,4194304] 0 2023-12-05T09:57:41.244 INFO:tasks.workunit.client.0.smithi100.stdout:9/751: creat d7/d1b/d22/d2a/d56/d2e/d50/f104 x:0 0 0 2023-12-05T09:57:41.249 INFO:tasks.workunit.client.0.smithi100.stdout:1/699: dread db/d12/f75 [0,4194304] 0 2023-12-05T09:57:41.250 INFO:tasks.workunit.client.0.smithi100.stdout:2/825: creat d7/da/d18/d1b/d2c/f115 x:0 0 0 2023-12-05T09:57:41.250 INFO:tasks.workunit.client.0.smithi100.stdout:2/826: truncate d7/da/ff2 485550 0 2023-12-05T09:57:41.251 INFO:tasks.workunit.client.1.smithi150.stdout:8/793: sync 2023-12-05T09:57:41.251 INFO:tasks.workunit.client.1.smithi150.stdout:3/783: sync 2023-12-05T09:57:41.255 INFO:tasks.workunit.client.1.smithi150.stdout:5/764: write d1/d3/d6/d26/f3e [1005400,99935] 0 2023-12-05T09:57:41.256 INFO:tasks.workunit.client.1.smithi150.stdout:5/765: read d1/d7f/fa5 [311881,45823] 0 2023-12-05T09:57:41.257 INFO:tasks.workunit.client.0.smithi100.stdout:2/827: write d7/da/d18/d1b/d2c/d3f/d46/f26 [4976729,33513] 0 2023-12-05T09:57:41.257 INFO:tasks.workunit.client.0.smithi100.stdout:0/694: unlink da/d1b/d73/d82/ca0 0 2023-12-05T09:57:41.257 INFO:tasks.workunit.client.0.smithi100.stdout:0/695: dread - da/d22/d33/d35/d3a/d8b/d8f/fae zero size 2023-12-05T09:57:41.259 INFO:tasks.workunit.client.1.smithi150.stdout:9/682: creat d3/d9/d58/fdd x:0 0 0 2023-12-05T09:57:41.259 INFO:tasks.workunit.client.1.smithi150.stdout:9/683: fsync d3/d9/d26/d34/f5b 0 2023-12-05T09:57:41.259 INFO:tasks.workunit.client.1.smithi150.stdout:2/795: dwrite d0/d3/d5/d10/f1b [0,4194304] 0 2023-12-05T09:57:41.259 INFO:tasks.workunit.client.1.smithi150.stdout:2/796: read - d0/d3/d21/d4d/deb/d103/db9/fd8 zero size 2023-12-05T09:57:41.260 INFO:tasks.workunit.client.1.smithi150.stdout:6/672: dread d2/d23/d2e/d5f/f87 [0,4194304] 0 2023-12-05T09:57:41.262 INFO:tasks.workunit.client.1.smithi150.stdout:7/751: mkdir d2/d9d/da0/df9 0 2023-12-05T09:57:41.263 INFO:tasks.workunit.client.1.smithi150.stdout:8/794: rename d0/d41/fb1 to d0/d41/d49/dd3/ff5 0 2023-12-05T09:57:41.264 INFO:tasks.workunit.client.0.smithi100.stdout:3/829: rmdir d0 39 2023-12-05T09:57:41.266 INFO:tasks.workunit.client.1.smithi150.stdout:5/766: mkdir d1/d64/dfc/d110 0 2023-12-05T09:57:41.267 INFO:tasks.workunit.client.1.smithi150.stdout:5/767: fdatasync d1/d2e/f90 0 2023-12-05T09:57:41.267 INFO:tasks.workunit.client.1.smithi150.stdout:5/768: getdents d1/d2e/da6/d24/d59/d104 0 2023-12-05T09:57:41.269 INFO:tasks.workunit.client.1.smithi150.stdout:2/797: unlink d0/d3/d5/f105 0 2023-12-05T09:57:41.272 INFO:tasks.workunit.client.0.smithi100.stdout:1/700: dread db/d12/d1e/dd3/db8/fd9 [0,4194304] 0 2023-12-05T09:57:41.272 INFO:tasks.workunit.client.0.smithi100.stdout:0/696: rmdir da/d1b/dbe 39 2023-12-05T09:57:41.272 INFO:tasks.workunit.client.1.smithi150.stdout:7/752: mkdir d2/db/d30/daf/dd3/d2b/dd2/dfa 0 2023-12-05T09:57:41.275 INFO:tasks.workunit.client.1.smithi150.stdout:8/795: dread d0/d41/d49/d1b/d24/d5b/fb4 [0,4194304] 0 2023-12-05T09:57:41.277 INFO:tasks.workunit.client.1.smithi150.stdout:2/798: rmdir d0/d3/d5/d3b/df2/d110 0 2023-12-05T09:57:41.280 INFO:tasks.workunit.client.1.smithi150.stdout:7/753: symlink d2/d39/lfb 0 2023-12-05T09:57:41.280 INFO:tasks.workunit.client.1.smithi150.stdout:7/754: write d2/db/d30/d18/d63/f7f [609802,81928] 0 2023-12-05T09:57:41.281 INFO:tasks.workunit.client.1.smithi150.stdout:9/684: dread d3/d9/dc/d1f/f5f [0,4194304] 0 2023-12-05T09:57:41.282 INFO:tasks.workunit.client.1.smithi150.stdout:3/784: dread d6/d9/d8d/f68 [8388608,4194304] 0 2023-12-05T09:57:41.282 INFO:tasks.workunit.client.1.smithi150.stdout:3/785: chown d6/d9/d43/d47/d94 57 1 2023-12-05T09:57:41.282 INFO:tasks.workunit.client.1.smithi150.stdout:6/673: dread d2/d23/d2e/d5f/f6d [0,4194304] 0 2023-12-05T09:57:41.282 INFO:tasks.workunit.client.1.smithi150.stdout:3/786: creat d6/d9/d3d/d56/d71/db6/dc1/d9a/fff x:0 0 0 2023-12-05T09:57:41.282 INFO:tasks.workunit.client.1.smithi150.stdout:8/796: symlink d0/d41/ddb/lf6 0 2023-12-05T09:57:41.286 INFO:tasks.workunit.client.1.smithi150.stdout:2/799: rename d0/d3/d27/l5b to d0/d3/d5/d22/d52/d56/l111 0 2023-12-05T09:57:41.289 INFO:tasks.workunit.client.0.smithi100.stdout:9/752: dwrite d7/d1b/d22/d51/d32/f8c [0,4194304] 0 2023-12-05T09:57:41.289 INFO:tasks.workunit.client.0.smithi100.stdout:9/753: creat d7/d1b/d22/d2a/d56/d9c/f105 x:0 0 0 2023-12-05T09:57:41.290 INFO:tasks.workunit.client.1.smithi150.stdout:1/778: dwrite d6/d3c/fa9 [0,4194304] 0 2023-12-05T09:57:41.295 INFO:tasks.workunit.client.0.smithi100.stdout:1/701: rename db/d12/d1e/d26/d30/d52/d84/d8c to db/d12/d1e/de0 0 2023-12-05T09:57:41.296 INFO:tasks.workunit.client.1.smithi150.stdout:9/685: mknod d3/d9/dc/d1f/d24/d75/d95/d9a/dcb/cde 0 2023-12-05T09:57:41.304 INFO:tasks.workunit.client.1.smithi150.stdout:5/769: dread d1/d3/d6/f10 [0,4194304] 0 2023-12-05T09:57:41.314 INFO:tasks.workunit.client.1.smithi150.stdout:8/797: unlink d0/d41/d49/d1b/d24/d34/d56/f8f 0 2023-12-05T09:57:41.317 INFO:tasks.workunit.client.0.smithi100.stdout:9/754: creat d7/d1b/d22/d93/f106 x:0 0 0 2023-12-05T09:57:41.319 INFO:tasks.workunit.client.1.smithi150.stdout:6/674: rename d2/d23/d3b/db4/dc0 to d2/d23/d3b/d64/d7a/d5d/de0 0 2023-12-05T09:57:41.319 INFO:tasks.workunit.client.0.smithi100.stdout:1/702: stat db/l49 0 2023-12-05T09:57:41.322 INFO:tasks.workunit.client.1.smithi150.stdout:2/800: mkdir d0/d3/d27/dea/d112 0 2023-12-05T09:57:41.326 INFO:tasks.workunit.client.0.smithi100.stdout:9/755: mkdir d7/d1b/d22/d2a/d56/d2e/d50/d107 0 2023-12-05T09:57:41.328 INFO:tasks.workunit.client.1.smithi150.stdout:7/755: dwrite d2/d4/f27 [0,4194304] 0 2023-12-05T09:57:41.332 INFO:tasks.workunit.client.1.smithi150.stdout:1/779: dwrite d6/d47/d4c/f102 [0,4194304] 0 2023-12-05T09:57:41.332 INFO:tasks.workunit.client.1.smithi150.stdout:1/780: write d6/d8/d54/dea/fff [1625980,31139] 0 2023-12-05T09:57:41.333 INFO:tasks.workunit.client.1.smithi150.stdout:9/686: rmdir d3/d9/d67 39 2023-12-05T09:57:41.334 INFO:tasks.workunit.client.0.smithi100.stdout:9/756: mkdir d7/d20/d69/d108 0 2023-12-05T09:57:41.334 INFO:tasks.workunit.client.0.smithi100.stdout:9/757: fsync d7/fb 0 2023-12-05T09:57:41.337 INFO:tasks.workunit.client.1.smithi150.stdout:3/787: rmdir d6/d9/d8d 39 2023-12-05T09:57:41.338 INFO:tasks.workunit.client.0.smithi100.stdout:9/758: mkdir d7/d1b/d22/d2a/d56/d9c/dfd/d109 0 2023-12-05T09:57:41.339 INFO:tasks.workunit.client.1.smithi150.stdout:6/675: write d2/d23/d3b/d64/d7a/d5d/d6b/fca [3874213,24028] 0 2023-12-05T09:57:41.340 INFO:tasks.workunit.client.0.smithi100.stdout:1/703: dread db/d12/d1e/f50 [0,4194304] 0 2023-12-05T09:57:41.341 INFO:tasks.workunit.client.1.smithi150.stdout:8/798: creat d0/ff7 x:0 0 0 2023-12-05T09:57:41.346 INFO:tasks.workunit.client.1.smithi150.stdout:5/770: dwrite d1/d7f/d65/d3b/d37/f48 [4194304,4194304] 0 2023-12-05T09:57:41.346 INFO:tasks.workunit.client.1.smithi150.stdout:5/771: chown d1/d2e/da6 8208 1 2023-12-05T09:57:41.346 INFO:tasks.workunit.client.1.smithi150.stdout:5/772: chown d1/d7f/d65/d3b/d8d/fd6 137095408 1 2023-12-05T09:57:41.346 INFO:tasks.workunit.client.0.smithi100.stdout:9/759: mkdir d7/d35/d10a 0 2023-12-05T09:57:41.346 INFO:tasks.workunit.client.0.smithi100.stdout:9/760: dread - d7/d1b/d22/d2a/d56/d2e/fd2 zero size 2023-12-05T09:57:41.347 INFO:tasks.workunit.client.1.smithi150.stdout:2/801: rename d0/d3/ca9 to d0/d3/d27/d51/c113 0 2023-12-05T09:57:41.348 INFO:tasks.workunit.client.1.smithi150.stdout:7/756: symlink d2/d39/lfc 0 2023-12-05T09:57:41.349 INFO:tasks.workunit.client.0.smithi100.stdout:9/761: creat d7/d1b/d22/d2a/d56/d2e/d50/d107/f10b x:0 0 0 2023-12-05T09:57:41.355 INFO:tasks.workunit.client.0.smithi100.stdout:2/828: dwrite d7/da/d18/d21/dae/fcd [0,4194304] 0 2023-12-05T09:57:41.355 INFO:tasks.workunit.client.0.smithi100.stdout:2/829: chown d7/da/d13/d69/c79 0 1 2023-12-05T09:57:41.360 INFO:tasks.workunit.client.1.smithi150.stdout:9/687: mknod d3/d9/d6e/d84/cdf 0 2023-12-05T09:57:41.361 INFO:tasks.workunit.client.1.smithi150.stdout:8/799: dread d0/d41/d49/d1b/d24/d2e/d4d/f7c [0,4194304] 0 2023-12-05T09:57:41.361 INFO:tasks.workunit.client.1.smithi150.stdout:8/800: chown d0/d41 475458 1 2023-12-05T09:57:41.363 INFO:tasks.workunit.client.1.smithi150.stdout:3/788: symlink d6/d22/l100 0 2023-12-05T09:57:41.363 INFO:tasks.workunit.client.1.smithi150.stdout:8/801: write d0/d41/d49/d1b/d24/d38/d84/f9e [358287,73323] 0 2023-12-05T09:57:41.365 INFO:tasks.workunit.client.1.smithi150.stdout:6/676: rename d2/d23/d3b/d46/fa2 to d2/d23/d2e/fe1 0 2023-12-05T09:57:41.366 INFO:tasks.workunit.client.0.smithi100.stdout:1/704: write db/d31/d3a/f3e [2461910,76071] 0 2023-12-05T09:57:41.367 INFO:tasks.workunit.client.1.smithi150.stdout:2/802: mkdir d0/d3/d5/d22/d52/d5a/d108/d114 0 2023-12-05T09:57:41.369 INFO:tasks.workunit.client.0.smithi100.stdout:2/830: creat d7/da/d18/d1b/d2c/d3f/d46/dc8/dfe/f116 x:0 0 0 2023-12-05T09:57:41.370 INFO:tasks.workunit.client.1.smithi150.stdout:7/757: link d2/db/d62/f92 d2/db/d2e/d9a/ffd 0 2023-12-05T09:57:41.372 INFO:tasks.workunit.client.0.smithi100.stdout:9/762: dread d7/d35/f86 [0,4194304] 0 2023-12-05T09:57:41.372 INFO:tasks.workunit.client.0.smithi100.stdout:9/763: readlink d7/d1b/d22/d2a/d56/l34 0 2023-12-05T09:57:41.373 INFO:tasks.workunit.client.0.smithi100.stdout:1/705: creat db/d31/fe1 x:0 0 0 2023-12-05T09:57:41.374 INFO:tasks.workunit.client.0.smithi100.stdout:2/831: unlink d7/da/d18/d21/da3/cfa 0 2023-12-05T09:57:41.376 INFO:tasks.workunit.client.0.smithi100.stdout:9/764: write d7/d20/f76 [1563482,85419] 0 2023-12-05T09:57:41.378 INFO:tasks.workunit.client.1.smithi150.stdout:1/781: getdents d6/d8/d59 0 2023-12-05T09:57:41.380 INFO:tasks.workunit.client.0.smithi100.stdout:1/706: symlink db/d31/d73/le2 0 2023-12-05T09:57:41.380 INFO:tasks.workunit.client.0.smithi100.stdout:1/707: readlink db/l49 0 2023-12-05T09:57:41.381 INFO:tasks.workunit.client.1.smithi150.stdout:9/688: mkdir d3/d42/dd2/de0 0 2023-12-05T09:57:41.384 INFO:tasks.workunit.client.0.smithi100.stdout:1/708: mknod db/d12/d1e/dd3/ce3 0 2023-12-05T09:57:41.386 INFO:tasks.workunit.client.1.smithi150.stdout:3/789: creat d6/d9/d3d/d56/d71/db0/f101 x:0 0 0 2023-12-05T09:57:41.388 INFO:tasks.workunit.client.1.smithi150.stdout:6/677: creat d2/d23/d3b/d64/d7a/d5d/d6b/d9c/dc6/fe2 x:0 0 0 2023-12-05T09:57:41.389 INFO:tasks.workunit.client.1.smithi150.stdout:2/803: rename d0/d3/d21/d4d/deb/d103/l9b to d0/d3/d5/d3b/l115 0 2023-12-05T09:57:41.390 INFO:tasks.workunit.client.1.smithi150.stdout:7/758: mkdir d2/db/d30/dfe 0 2023-12-05T09:57:41.392 INFO:tasks.workunit.client.0.smithi100.stdout:2/832: dread d7/da/d18/d21/f40 [0,4194304] 0 2023-12-05T09:57:41.392 INFO:tasks.workunit.client.1.smithi150.stdout:1/782: mknod d6/d47/d4c/c118 0 2023-12-05T09:57:41.392 INFO:tasks.workunit.client.1.smithi150.stdout:9/689: symlink d3/d9/dc/d1f/d24/d75/d95/dbc/le1 0 2023-12-05T09:57:41.393 INFO:tasks.workunit.client.1.smithi150.stdout:8/802: symlink d0/lf8 0 2023-12-05T09:57:41.393 INFO:tasks.workunit.client.0.smithi100.stdout:2/833: mkdir d7/da/d18/d1b/d2c/d3f/d72/d117 0 2023-12-05T09:57:41.394 INFO:tasks.workunit.client.1.smithi150.stdout:3/790: stat d6/d9/d3d/d56/d71/db0/ld5 0 2023-12-05T09:57:41.394 INFO:tasks.workunit.client.1.smithi150.stdout:6/678: truncate d2/d23/d2e/d93/fba 830809 0 2023-12-05T09:57:41.396 INFO:tasks.workunit.client.1.smithi150.stdout:7/759: dread d2/db/d30/d13/f1d [0,4194304] 0 2023-12-05T09:57:41.397 INFO:tasks.workunit.client.1.smithi150.stdout:2/804: creat d0/d3/d5/d22/d52/d10e/f116 x:0 0 0 2023-12-05T09:57:41.397 INFO:tasks.workunit.client.0.smithi100.stdout:4/695: sync 2023-12-05T09:57:41.397 INFO:tasks.workunit.client.0.smithi100.stdout:4/696: fdatasync de/d16/d1e/fda 0 2023-12-05T09:57:41.398 INFO:tasks.workunit.client.0.smithi100.stdout:9/765: dread d7/ff [0,4194304] 0 2023-12-05T09:57:41.398 INFO:tasks.workunit.client.0.smithi100.stdout:9/766: write d7/d1b/d22/d2a/f79 [4567515,11101] 0 2023-12-05T09:57:41.400 INFO:tasks.workunit.client.0.smithi100.stdout:2/834: link d7/da/d18/d21/dae/c111 d7/da/d18/c118 0 2023-12-05T09:57:41.401 INFO:tasks.workunit.client.1.smithi150.stdout:9/690: rmdir d3/d9/dc/d1f/d24/d75/d95/dbc 39 2023-12-05T09:57:41.403 INFO:tasks.workunit.client.0.smithi100.stdout:4/697: unlink de/d16/d23/d36/c43 0 2023-12-05T09:57:41.403 INFO:tasks.workunit.client.0.smithi100.stdout:4/698: write de/d16/d23/d36/f56 [969809,92085] 0 2023-12-05T09:57:41.403 INFO:tasks.workunit.client.0.smithi100.stdout:4/699: dread - de/d16/d23/d33/d51/fb3 zero size 2023-12-05T09:57:41.405 INFO:tasks.workunit.client.1.smithi150.stdout:8/803: mkdir d0/d41/d49/dd3/df9 0 2023-12-05T09:57:41.405 INFO:tasks.workunit.client.1.smithi150.stdout:8/804: chown d0/d41/c70 12 1 2023-12-05T09:57:41.405 INFO:tasks.workunit.client.1.smithi150.stdout:8/805: read d0/d8/f11 [1304168,88128] 0 2023-12-05T09:57:41.410 INFO:tasks.workunit.client.0.smithi100.stdout:2/835: creat d7/da/d18/d21/d4d/f119 x:0 0 0 2023-12-05T09:57:41.410 INFO:tasks.workunit.client.0.smithi100.stdout:2/836: chown d7/da/d18/d21/f7e 13 1 2023-12-05T09:57:41.412 INFO:tasks.workunit.client.1.smithi150.stdout:6/679: creat d2/d23/d3b/d64/d7a/d5d/de0/fe3 x:0 0 0 2023-12-05T09:57:41.412 INFO:tasks.workunit.client.1.smithi150.stdout:6/680: write d2/d23/d2e/d72/f75 [2710681,101624] 0 2023-12-05T09:57:41.417 INFO:tasks.workunit.client.0.smithi100.stdout:4/700: mkdir de/d16/d23/d33/d3d/d44/d4e/d80/de2 0 2023-12-05T09:57:41.420 INFO:tasks.workunit.client.1.smithi150.stdout:7/760: mkdir d2/db/d30/d13/d4f/dff 0 2023-12-05T09:57:41.420 INFO:tasks.workunit.client.1.smithi150.stdout:7/761: truncate d2/db/d17/d20/fdc 1133398 0 2023-12-05T09:57:41.421 INFO:tasks.workunit.client.0.smithi100.stdout:9/767: symlink d7/d1b/d22/d51/d32/l10c 0 2023-12-05T09:57:41.423 INFO:tasks.workunit.client.1.smithi150.stdout:0/797: sync 2023-12-05T09:57:41.423 INFO:tasks.workunit.client.1.smithi150.stdout:4/702: sync 2023-12-05T09:57:41.426 INFO:tasks.workunit.client.1.smithi150.stdout:4/703: read d0/f3a [267509,92911] 0 2023-12-05T09:57:41.433 INFO:tasks.workunit.client.1.smithi150.stdout:3/791: getdents d6/d9/d3d/d56/d71 0 2023-12-05T09:57:41.433 INFO:tasks.workunit.client.1.smithi150.stdout:3/792: creat d6/d9/d3d/d56/d53/f102 x:0 0 0 2023-12-05T09:57:41.435 INFO:tasks.workunit.client.1.smithi150.stdout:6/681: rmdir d2 39 2023-12-05T09:57:41.439 INFO:tasks.workunit.client.1.smithi150.stdout:9/691: dwrite d3/d42/fc7 [0,4194304] 0 2023-12-05T09:57:41.439 INFO:tasks.workunit.client.1.smithi150.stdout:9/692: chown d3/d9/d58/dbe/fd9 3 1 2023-12-05T09:57:41.439 INFO:tasks.workunit.client.1.smithi150.stdout:9/693: truncate d3/d9/dc/d1f/d24/d75/fc6 677942 0 2023-12-05T09:57:41.439 INFO:tasks.workunit.client.1.smithi150.stdout:2/805: symlink d0/d3/d21/d4d/deb/d103/d15/d30/d54/l117 0 2023-12-05T09:57:41.440 INFO:tasks.workunit.client.1.smithi150.stdout:1/783: write d6/d38/f81 [1141424,17987] 0 2023-12-05T09:57:41.440 INFO:tasks.workunit.client.1.smithi150.stdout:1/784: creat d6/d8/db/db1/f119 x:0 0 0 2023-12-05T09:57:41.443 INFO:tasks.workunit.client.0.smithi100.stdout:2/837: rename d7/db4/lc3 to d7/da/da7/dd2/l11a 0 2023-12-05T09:57:41.448 INFO:tasks.workunit.client.0.smithi100.stdout:2/838: creat d7/da/d18/d21/d86/f11b x:0 0 0 2023-12-05T09:57:41.448 INFO:tasks.workunit.client.0.smithi100.stdout:2/839: chown d7/da/d13/d4e/c68 1574442 1 2023-12-05T09:57:41.448 INFO:tasks.workunit.client.0.smithi100.stdout:2/840: fdatasync d7/da/d18/d1b/d2c/f70 0 2023-12-05T09:57:41.448 INFO:tasks.workunit.client.1.smithi150.stdout:3/793: link d6/d9/d3d/d56/l84 d6/d9/daf/l103 0 2023-12-05T09:57:41.448 INFO:tasks.workunit.client.1.smithi150.stdout:7/762: dread d2/d4/f6d [0,4194304] 0 2023-12-05T09:57:41.449 INFO:tasks.workunit.client.1.smithi150.stdout:9/694: mknod d3/d9/dc/d1f/d24/ce2 0 2023-12-05T09:57:41.452 INFO:tasks.workunit.client.1.smithi150.stdout:2/806: link d0/d3/d27/dac/dd0/f106 d0/d42/f118 0 2023-12-05T09:57:41.453 INFO:tasks.workunit.client.1.smithi150.stdout:2/807: fdatasync d0/d3/d27/dac/dd0/fe4 0 2023-12-05T09:57:41.454 INFO:tasks.workunit.client.1.smithi150.stdout:1/785: dread d6/d38/da1/fa6 [0,4194304] 0 2023-12-05T09:57:41.454 INFO:tasks.workunit.client.1.smithi150.stdout:1/786: stat d6/d3c/f49 0 2023-12-05T09:57:41.454 INFO:tasks.workunit.client.1.smithi150.stdout:1/787: dread - d6/d47/d4c/dd9/daf/fd8 zero size 2023-12-05T09:57:41.454 INFO:tasks.workunit.client.1.smithi150.stdout:1/788: readlink d6/d47/d4c/ld4 0 2023-12-05T09:57:41.455 INFO:tasks.workunit.client.1.smithi150.stdout:1/789: creat d6/d3c/dc2/dde/f11a x:0 0 0 2023-12-05T09:57:41.455 INFO:tasks.workunit.client.1.smithi150.stdout:1/790: chown d6/d8/d54/d94/cee 13373 1 2023-12-05T09:57:41.455 INFO:tasks.workunit.client.0.smithi100.stdout:2/841: rmdir d7/da/d18/d1b 39 2023-12-05T09:57:41.459 INFO:tasks.workunit.client.1.smithi150.stdout:4/704: rmdir d0/d3e/d5b/d80/d44/da2/dbd 39 2023-12-05T09:57:41.461 INFO:tasks.workunit.client.1.smithi150.stdout:5/773: sync 2023-12-05T09:57:41.463 INFO:tasks.workunit.client.1.smithi150.stdout:9/695: creat d3/d9/dc/d1f/d24/d75/d95/dbc/dad/db7/fe3 x:0 0 0 2023-12-05T09:57:41.467 INFO:tasks.workunit.client.1.smithi150.stdout:0/798: dwrite d5/d11/f66 [0,4194304] 0 2023-12-05T09:57:41.467 INFO:tasks.workunit.client.1.smithi150.stdout:0/799: getdents d5/d11/d65/d82/deb 0 2023-12-05T09:57:41.468 INFO:tasks.workunit.client.1.smithi150.stdout:9/696: mkdir d3/d9/dc/d1f/d24/d75/d95/d9a/dcb/de4 0 2023-12-05T09:57:41.469 INFO:tasks.workunit.client.1.smithi150.stdout:8/806: write d0/d41/d49/d1b/d24/d38/d62/f68 [136911,95076] 0 2023-12-05T09:57:41.471 INFO:tasks.workunit.client.0.smithi100.stdout:1/709: dwrite db/d31/fd1 [0,4194304] 0 2023-12-05T09:57:41.471 INFO:tasks.workunit.client.0.smithi100.stdout:2/842: read d7/da/ff2 [141771,107056] 0 2023-12-05T09:57:41.473 INFO:tasks.workunit.client.1.smithi150.stdout:8/807: dread - d0/d41/d49/d1b/d24/d34/f97 zero size 2023-12-05T09:57:41.473 INFO:tasks.workunit.client.1.smithi150.stdout:9/697: creat d3/d9/dc/d1f/d24/d75/d95/d9a/dcb/fe5 x:0 0 0 2023-12-05T09:57:41.475 INFO:tasks.workunit.client.1.smithi150.stdout:9/698: symlink d3/d9/d26/daf/le6 0 2023-12-05T09:57:41.476 INFO:tasks.workunit.client.0.smithi100.stdout:2/843: mkdir d7/da/ddc/d11c 0 2023-12-05T09:57:41.482 INFO:tasks.workunit.client.1.smithi150.stdout:1/791: dread d6/d47/d4c/dd9/f13 [4194304,4194304] 0 2023-12-05T09:57:41.482 INFO:tasks.workunit.client.1.smithi150.stdout:1/792: write d6/d8/d85/f115 [263192,69176] 0 2023-12-05T09:57:41.482 INFO:tasks.workunit.client.1.smithi150.stdout:1/793: getdents d6/d8/d59 0 2023-12-05T09:57:41.482 INFO:tasks.workunit.client.1.smithi150.stdout:1/794: readlink d6/d3c/l8b 0 2023-12-05T09:57:41.485 INFO:tasks.workunit.client.1.smithi150.stdout:1/795: rename d6/d47/d4c/d60/f63 to d6/d8/d85/d10e/f11b 0 2023-12-05T09:57:41.485 INFO:tasks.workunit.client.1.smithi150.stdout:1/796: chown d6/d3c/f49 110 1 2023-12-05T09:57:41.492 INFO:tasks.workunit.client.1.smithi150.stdout:4/705: dread d0/d3e/d5b/d80/dc8/fce [0,4194304] 0 2023-12-05T09:57:41.497 INFO:tasks.workunit.client.1.smithi150.stdout:0/800: write d5/fa [3893534,25096] 0 2023-12-05T09:57:41.499 INFO:tasks.workunit.client.0.smithi100.stdout:1/710: dread db/f1a [0,4194304] 0 2023-12-05T09:57:41.499 INFO:tasks.workunit.client.0.smithi100.stdout:2/844: dread d7/da/d18/d1b/d2c/d3f/d46/f76 [0,4194304] 0 2023-12-05T09:57:41.500 INFO:tasks.workunit.client.0.smithi100.stdout:2/845: creat d7/da/da7/f11d x:0 0 0 2023-12-05T09:57:41.500 INFO:tasks.workunit.client.0.smithi100.stdout:2/846: readlink d7/da/d18/d1b/d2c/d3f/d98/lb1 0 2023-12-05T09:57:41.500 INFO:tasks.workunit.client.0.smithi100.stdout:2/847: dread - d7/da/da7/ff1 zero size 2023-12-05T09:57:41.500 INFO:tasks.workunit.client.0.smithi100.stdout:2/848: write d7/da/d13/d4e/d87/fe5 [1346147,35237] 0 2023-12-05T09:57:41.505 INFO:tasks.workunit.client.1.smithi150.stdout:0/801: symlink d5/d11/d32/df2/d107/l118 0 2023-12-05T09:57:41.509 INFO:tasks.workunit.client.0.smithi100.stdout:4/701: dwrite de/d16/d23/d33/dae/fbc [0,4194304] 0 2023-12-05T09:57:41.509 INFO:tasks.workunit.client.0.smithi100.stdout:4/702: write de/f4a [59001,116568] 0 2023-12-05T09:57:41.510 INFO:tasks.workunit.client.1.smithi150.stdout:7/763: dread d2/db/f99 [0,4194304] 0 2023-12-05T09:57:41.515 INFO:tasks.workunit.client.1.smithi150.stdout:0/802: creat d5/d11/d16/f119 x:0 0 0 2023-12-05T09:57:41.518 INFO:tasks.workunit.client.1.smithi150.stdout:7/764: symlink d2/db/d2e/d71/df2/l100 0 2023-12-05T09:57:41.518 INFO:tasks.workunit.client.1.smithi150.stdout:2/808: write d0/d3/d5/d10/f1b [381165,81089] 0 2023-12-05T09:57:41.523 INFO:tasks.workunit.client.0.smithi100.stdout:1/711: read db/d31/f51 [3212623,80538] 0 2023-12-05T09:57:41.523 INFO:tasks.workunit.client.0.smithi100.stdout:1/712: write db/d31/d3a/d4a/dad/d67/fa4 [454918,20138] 0 2023-12-05T09:57:41.524 INFO:tasks.workunit.client.1.smithi150.stdout:0/803: creat d5/d11/d71/d99/d9c/d46/d80/f11a x:0 0 0 2023-12-05T09:57:41.525 INFO:tasks.workunit.client.1.smithi150.stdout:7/765: mkdir d2/d9d/d101 0 2023-12-05T09:57:41.525 INFO:tasks.workunit.client.1.smithi150.stdout:7/766: creat d2/db/d2e/d71/f102 x:0 0 0 2023-12-05T09:57:41.525 INFO:tasks.workunit.client.1.smithi150.stdout:7/767: chown d2/db/d30/d47/fd0 12962 1 2023-12-05T09:57:41.527 INFO:tasks.workunit.client.1.smithi150.stdout:1/797: dread d6/d47/d4c/dd9/f39 [0,4194304] 0 2023-12-05T09:57:41.527 INFO:tasks.workunit.client.0.smithi100.stdout:1/713: creat db/d12/fe4 x:0 0 0 2023-12-05T09:57:41.527 INFO:tasks.workunit.client.0.smithi100.stdout:1/714: read - db/d31/d3a/d4a/fa3 zero size 2023-12-05T09:57:41.527 INFO:tasks.workunit.client.0.smithi100.stdout:1/715: readlink db/d12/l2d 0 2023-12-05T09:57:41.529 INFO:tasks.workunit.client.1.smithi150.stdout:7/768: truncate d2/db/d2e/d71/f8f 57915 0 2023-12-05T09:57:41.530 INFO:tasks.workunit.client.1.smithi150.stdout:1/798: mknod d6/d8/d54/dea/c11c 0 2023-12-05T09:57:41.537 INFO:tasks.workunit.client.0.smithi100.stdout:4/703: dread de/d38/f42 [0,4194304] 0 2023-12-05T09:57:41.538 INFO:tasks.workunit.client.1.smithi150.stdout:2/809: dread d0/d3/d5/d10/f45 [0,4194304] 0 2023-12-05T09:57:41.544 INFO:tasks.workunit.client.1.smithi150.stdout:8/808: dwrite d0/d41/d49/d1b/d24/d2e/d4d/f7c [0,4194304] 0 2023-12-05T09:57:41.547 INFO:tasks.workunit.client.1.smithi150.stdout:3/794: dwrite d6/d22/fdc [0,4194304] 0 2023-12-05T09:57:41.547 INFO:tasks.workunit.client.1.smithi150.stdout:0/804: read d5/d11/d65/d82/fab [6463312,30960] 0 2023-12-05T09:57:41.548 INFO:tasks.workunit.client.1.smithi150.stdout:0/805: fsync d5/d11/d32/f39 0 2023-12-05T09:57:41.549 INFO:tasks.workunit.client.1.smithi150.stdout:0/806: dread - d5/d11/d71/d99/d9c/d3b/dad/f117 zero size 2023-12-05T09:57:41.549 INFO:tasks.workunit.client.1.smithi150.stdout:5/774: dwrite d1/d3/f85 [0,4194304] 0 2023-12-05T09:57:41.549 INFO:tasks.workunit.client.1.smithi150.stdout:4/706: dwrite d0/d3e/d5b/d80/f7b [0,4194304] 0 2023-12-05T09:57:41.549 INFO:tasks.workunit.client.1.smithi150.stdout:4/707: creat d0/d5f/fd9 x:0 0 0 2023-12-05T09:57:41.549 INFO:tasks.workunit.client.1.smithi150.stdout:4/708: dread - d0/d5f/fd9 zero size 2023-12-05T09:57:41.550 INFO:tasks.workunit.client.1.smithi150.stdout:0/807: mknod d5/d11/d71/d99/d9c/d96/dd5/c11b 0 2023-12-05T09:57:41.551 INFO:tasks.workunit.client.1.smithi150.stdout:9/699: dwrite d3/d9/dc/f1d [0,4194304] 0 2023-12-05T09:57:41.551 INFO:tasks.workunit.client.1.smithi150.stdout:9/700: readlink d3/d9/d26/l74 0 2023-12-05T09:57:41.551 INFO:tasks.workunit.client.1.smithi150.stdout:9/701: write d3/d1b/d46/d55/fc4 [825669,208] 0 2023-12-05T09:57:41.551 INFO:tasks.workunit.client.1.smithi150.stdout:9/702: fdatasync d3/f71 0 2023-12-05T09:57:41.557 INFO:tasks.workunit.client.1.smithi150.stdout:1/799: dread d6/f1a [4194304,4194304] 0 2023-12-05T09:57:41.557 INFO:tasks.workunit.client.1.smithi150.stdout:6/682: dwrite d2/d23/d2e/d5f/d99/fd4 [0,4194304] 0 2023-12-05T09:57:41.558 INFO:tasks.workunit.client.1.smithi150.stdout:5/775: unlink d1/d3/c54 0 2023-12-05T09:57:41.558 INFO:tasks.workunit.client.1.smithi150.stdout:5/776: chown d1/d2e/c66 200 1 2023-12-05T09:57:41.560 INFO:tasks.workunit.client.0.smithi100.stdout:9/768: dwrite d7/d20/d68/fe9 [0,4194304] 0 2023-12-05T09:57:41.561 INFO:tasks.workunit.client.0.smithi100.stdout:9/769: creat d7/d1b/d22/d51/d32/d96/f10d x:0 0 0 2023-12-05T09:57:41.561 INFO:tasks.workunit.client.0.smithi100.stdout:9/770: stat d7/d35/d71/d9a/dcd/l100 0 2023-12-05T09:57:41.561 INFO:tasks.workunit.client.0.smithi100.stdout:9/771: readlink l2 0 2023-12-05T09:57:41.561 INFO:tasks.workunit.client.1.smithi150.stdout:3/795: write d6/d9/d3d/d56/f3b [391256,10744] 0 2023-12-05T09:57:41.569 INFO:tasks.workunit.client.1.smithi150.stdout:0/808: truncate d5/d11/d71/d99/d9c/d46/d80/f86 1772431 0 2023-12-05T09:57:41.574 INFO:tasks.workunit.client.0.smithi100.stdout:2/849: write d7/da/d13/f4a [2264337,117328] 0 2023-12-05T09:57:41.574 INFO:tasks.workunit.client.1.smithi150.stdout:6/683: creat d2/d23/d2e/d5f/d99/dd8/fe4 x:0 0 0 2023-12-05T09:57:41.574 INFO:tasks.workunit.client.1.smithi150.stdout:6/684: readlink d2/d23/d2e/d93/d97/l96 0 2023-12-05T09:57:41.577 INFO:tasks.workunit.client.1.smithi150.stdout:1/800: creat d6/d8/d54/d94/df5/f11d x:0 0 0 2023-12-05T09:57:41.577 INFO:tasks.workunit.client.1.smithi150.stdout:1/801: truncate d6/d8/d54/f87 699915 0 2023-12-05T09:57:41.578 INFO:tasks.workunit.client.1.smithi150.stdout:1/802: readlink d6/d47/d4c/dd9/l62 0 2023-12-05T09:57:41.578 INFO:tasks.workunit.client.1.smithi150.stdout:1/803: dread - d6/d8/d54/d94/df5/f11d zero size 2023-12-05T09:57:41.581 INFO:tasks.workunit.client.0.smithi100.stdout:5/752: sync 2023-12-05T09:57:41.581 INFO:tasks.workunit.client.1.smithi150.stdout:5/777: creat d1/d3/d6/d72/f111 x:0 0 0 2023-12-05T09:57:41.582 INFO:tasks.workunit.client.0.smithi100.stdout:1/716: dwrite db/d12/d1e/d26/d30/d52/fcd [0,4194304] 0 2023-12-05T09:57:41.582 INFO:tasks.workunit.client.0.smithi100.stdout:1/717: write db/d31/f51 [4502516,110598] 0 2023-12-05T09:57:41.582 INFO:tasks.workunit.client.0.smithi100.stdout:1/718: creat db/d12/fe5 x:0 0 0 2023-12-05T09:57:41.583 INFO:tasks.workunit.client.1.smithi150.stdout:4/709: truncate d0/f61 1210143 0 2023-12-05T09:57:41.585 INFO:tasks.workunit.client.1.smithi150.stdout:8/809: read d0/d41/d49/d1b/f1c [2257069,42714] 0 2023-12-05T09:57:41.585 INFO:tasks.workunit.client.1.smithi150.stdout:7/769: dwrite d2/d39/f67 [0,4194304] 0 2023-12-05T09:57:41.588 INFO:tasks.workunit.client.1.smithi150.stdout:5/778: rmdir d1/d64 39 2023-12-05T09:57:41.594 INFO:tasks.workunit.client.1.smithi150.stdout:4/710: link d0/d3e/d6d/f3f d0/d3e/d5b/d80/d44/da2/dbd/fda 0 2023-12-05T09:57:41.594 INFO:tasks.workunit.client.0.smithi100.stdout:2/850: dread d7/da/d18/d1b/f59 [0,4194304] 0 2023-12-05T09:57:41.600 INFO:tasks.workunit.client.0.smithi100.stdout:5/753: dread d0/d1f/d25/f67 [0,4194304] 0 2023-12-05T09:57:41.605 INFO:tasks.workunit.client.1.smithi150.stdout:7/770: symlink d2/db/d30/d47/l103 0 2023-12-05T09:57:41.605 INFO:tasks.workunit.client.1.smithi150.stdout:7/771: chown d2/db/d17/d38/dc8/fa3 14 1 2023-12-05T09:57:41.608 INFO:tasks.workunit.client.0.smithi100.stdout:1/719: rmdir db/d31/d3a 39 2023-12-05T09:57:41.609 INFO:tasks.workunit.client.0.smithi100.stdout:8/686: sync 2023-12-05T09:57:41.609 INFO:tasks.workunit.client.0.smithi100.stdout:3/830: sync 2023-12-05T09:57:41.609 INFO:tasks.workunit.client.0.smithi100.stdout:3/831: fsync d0/d3d/d5c/d6f/ffd 0 2023-12-05T09:57:41.609 INFO:tasks.workunit.client.0.smithi100.stdout:8/687: write d0/d12/d13/d16/d42/f75 [774211,36158] 0 2023-12-05T09:57:41.609 INFO:tasks.workunit.client.0.smithi100.stdout:0/697: sync 2023-12-05T09:57:41.609 INFO:tasks.workunit.client.0.smithi100.stdout:8/688: write d0/d35/d64/d81/d9a/fb8 [842296,15781] 0 2023-12-05T09:57:41.609 INFO:tasks.workunit.client.0.smithi100.stdout:8/689: chown d0/d12/d13/d45/dba/dbd/f26 2888 1 2023-12-05T09:57:41.614 INFO:tasks.workunit.client.0.smithi100.stdout:9/772: getdents d7/d1b/d22/d2a/d56 0 2023-12-05T09:57:41.615 INFO:tasks.workunit.client.0.smithi100.stdout:2/851: symlink d7/da/d18/d21/d4d/d81/l11e 0 2023-12-05T09:57:41.615 INFO:tasks.workunit.client.0.smithi100.stdout:2/852: write d7/da/d18/d21/d86/d92/fbe [415018,89251] 0 2023-12-05T09:57:41.616 INFO:tasks.workunit.client.1.smithi150.stdout:5/779: creat d1/d3/d6/d26/d9a/d10e/f112 x:0 0 0 2023-12-05T09:57:41.616 INFO:tasks.workunit.client.1.smithi150.stdout:8/810: dread d0/d41/d49/d1b/d24/d5b/d87/f98 [0,4194304] 0 2023-12-05T09:57:41.617 INFO:tasks.workunit.client.1.smithi150.stdout:8/811: dread - d0/d41/d49/d1b/d24/d34/d56/fe7 zero size 2023-12-05T09:57:41.617 INFO:tasks.workunit.client.1.smithi150.stdout:7/772: mknod d2/db/d17/d38/dc8/df0/c104 0 2023-12-05T09:57:41.617 INFO:tasks.workunit.client.1.smithi150.stdout:3/796: write d6/d9/d3d/d56/d53/f69 [3663866,59361] 0 2023-12-05T09:57:41.617 INFO:tasks.workunit.client.1.smithi150.stdout:8/812: mkdir d0/d41/d49/d1b/d24/d5b/dfa 0 2023-12-05T09:57:41.617 INFO:tasks.workunit.client.1.smithi150.stdout:8/813: write d0/d41/d49/d1b/d24/d2e/f6e [2274643,122280] 0 2023-12-05T09:57:41.618 INFO:tasks.workunit.client.1.smithi150.stdout:2/810: dwrite d0/d3/d21/d4d/deb/ff6 [0,4194304] 0 2023-12-05T09:57:41.618 INFO:tasks.workunit.client.1.smithi150.stdout:1/804: dread d6/d47/d4c/dd9/f22 [4194304,4194304] 0 2023-12-05T09:57:41.619 INFO:tasks.workunit.client.0.smithi100.stdout:5/754: symlink d0/d1b/d4d/d8e/l10d 0 2023-12-05T09:57:41.620 INFO:tasks.workunit.client.0.smithi100.stdout:3/832: write d0/d10/d39/f41 [371104,40633] 0 2023-12-05T09:57:41.621 INFO:tasks.workunit.client.0.smithi100.stdout:3/833: readlink d0/d10/d39/l65 0 2023-12-05T09:57:41.621 INFO:tasks.workunit.client.0.smithi100.stdout:3/834: write d0/d10/f2a [294161,16364] 0 2023-12-05T09:57:41.622 INFO:tasks.workunit.client.0.smithi100.stdout:7/698: sync 2023-12-05T09:57:41.622 INFO:tasks.workunit.client.1.smithi150.stdout:9/703: dwrite d3/d9/f20 [4194304,4194304] 0 2023-12-05T09:57:41.624 INFO:tasks.workunit.client.1.smithi150.stdout:3/797: truncate d6/d9/f1c 819519 0 2023-12-05T09:57:41.629 INFO:tasks.workunit.client.0.smithi100.stdout:8/690: write d0/d12/d13/d45/da6/d76/f3f [3648198,53018] 0 2023-12-05T09:57:41.629 INFO:tasks.workunit.client.0.smithi100.stdout:8/691: readlink d0/d12/d13/d16/l83 0 2023-12-05T09:57:41.629 INFO:tasks.workunit.client.0.smithi100.stdout:8/692: chown d0/d12/d13/d45/dba/dbd/d72/da9 3 1 2023-12-05T09:57:41.629 INFO:tasks.workunit.client.0.smithi100.stdout:8/693: read - d0/d35/d64/f7c zero size 2023-12-05T09:57:41.631 INFO:tasks.workunit.client.1.smithi150.stdout:6/685: dread d2/d23/d2e/d93/f9e [0,4194304] 0 2023-12-05T09:57:41.631 INFO:tasks.workunit.client.1.smithi150.stdout:6/686: write d2/d23/d2e/d5f/d99/dd8/fe4 [651491,21962] 0 2023-12-05T09:57:41.631 INFO:tasks.workunit.client.0.smithi100.stdout:8/694: read d0/d35/f3b [390090,101402] 0 2023-12-05T09:57:41.631 INFO:tasks.workunit.client.0.smithi100.stdout:1/720: unlink db/d31/f60 0 2023-12-05T09:57:41.631 INFO:tasks.workunit.client.0.smithi100.stdout:1/721: dread - db/d12/d1e/d26/d30/d52/d84/fce zero size 2023-12-05T09:57:41.636 INFO:tasks.workunit.client.1.smithi150.stdout:0/809: dwrite d5/d11/d32/fbf [0,4194304] 0 2023-12-05T09:57:41.640 INFO:tasks.workunit.client.1.smithi150.stdout:7/773: write d2/db/d2e/f76 [2092712,66327] 0 2023-12-05T09:57:41.697 INFO:tasks.workunit.client.1.smithi150.stdout:8/814: rename d0/d41/d49/d1b/d24/d38/dad/deb to d0/da1/dfb 0 2023-12-05T09:57:41.700 INFO:tasks.workunit.client.0.smithi100.stdout:0/698: mknod da/d1b/d73/db3/cc9 0 2023-12-05T09:57:41.702 INFO:tasks.workunit.client.1.smithi150.stdout:2/811: creat d0/d3/d27/dea/d112/f119 x:0 0 0 2023-12-05T09:57:41.702 INFO:tasks.workunit.client.1.smithi150.stdout:2/812: fdatasync d0/d3/d11/d1d/f2f 0 2023-12-05T09:57:41.702 INFO:tasks.workunit.client.0.smithi100.stdout:9/773: symlink d7/d35/d71/d9a/dcd/df1/l10e 0 2023-12-05T09:57:41.708 INFO:tasks.workunit.client.0.smithi100.stdout:2/853: symlink d7/da/d18/d1b/d2c/d3f/l11f 0 2023-12-05T09:57:41.715 INFO:tasks.workunit.client.1.smithi150.stdout:9/704: mkdir d3/d42/d62/de7 0 2023-12-05T09:57:41.716 INFO:tasks.workunit.client.0.smithi100.stdout:5/755: mknod d0/d16/d2b/d48/df/d51/da8/c10e 0 2023-12-05T09:57:41.716 INFO:tasks.workunit.client.0.smithi100.stdout:5/756: dread - d0/d1b/d4d/d8e/d96/dc1/dae/ffa zero size 2023-12-05T09:57:41.716 INFO:tasks.workunit.client.0.smithi100.stdout:5/757: fdatasync d0/d4/fa 0 2023-12-05T09:57:41.716 INFO:tasks.workunit.client.0.smithi100.stdout:7/699: write d3/f1f [869651,10450] 0 2023-12-05T09:57:41.718 INFO:tasks.workunit.client.0.smithi100.stdout:3/835: rename d0/l6 to d0/d2/de/d8d/l11c 0 2023-12-05T09:57:41.722 INFO:tasks.workunit.client.1.smithi150.stdout:8/815: read d0/d41/d49/d1b/d24/d34/d56/d67/f6c [2571597,2717] 0 2023-12-05T09:57:41.723 INFO:tasks.workunit.client.1.smithi150.stdout:4/711: dwrite d0/d3e/d48/f53 [0,4194304] 0 2023-12-05T09:57:41.723 INFO:tasks.workunit.client.1.smithi150.stdout:3/798: dwrite d6/d9/d43/d47/d8c/fc9 [0,4194304] 0 2023-12-05T09:57:41.725 INFO:tasks.workunit.client.1.smithi150.stdout:6/687: creat d2/d23/d3b/d83/fe5 x:0 0 0 2023-12-05T09:57:41.726 INFO:tasks.workunit.client.0.smithi100.stdout:8/695: creat d0/d12/fc1 x:0 0 0 2023-12-05T09:57:41.729 INFO:tasks.workunit.client.0.smithi100.stdout:1/722: mkdir db/d12/d1e/dd3/db8/de6 0 2023-12-05T09:57:41.735 INFO:tasks.workunit.client.1.smithi150.stdout:4/712: dread d0/d3e/d5b/d80/d44/da2/da4/dd7/f86 [0,4194304] 0 2023-12-05T09:57:41.735 INFO:tasks.workunit.client.0.smithi100.stdout:5/758: truncate d0/d16/f68 2466471 0 2023-12-05T09:57:41.739 INFO:tasks.workunit.client.0.smithi100.stdout:7/700: unlink d3/dc/d11/d13/de/d18/d3b/d40/d46/f94 0 2023-12-05T09:57:41.745 INFO:tasks.workunit.client.1.smithi150.stdout:0/810: mknod d5/d11/d71/d99/d9c/d3b/de0/c11c 0 2023-12-05T09:57:41.752 INFO:tasks.workunit.client.0.smithi100.stdout:5/759: read d0/d16/d2b/d75/fc5 [2441816,33598] 0 2023-12-05T09:57:41.765 INFO:tasks.workunit.client.0.smithi100.stdout:1/723: rmdir db/d12/d1e/d26/d30/d52/dd0/dd6 39 2023-12-05T09:57:41.770 INFO:tasks.workunit.client.0.smithi100.stdout:0/699: rename da/d1b/d36 to da/d22/d33/d74/dca 0 2023-12-05T09:57:41.770 INFO:tasks.workunit.client.0.smithi100.stdout:0/700: write da/d60/fb9 [1098393,77353] 0 2023-12-05T09:57:41.775 INFO:tasks.workunit.client.1.smithi150.stdout:2/813: creat d0/d3/d5/d22/d52/d56/f11a x:0 0 0 2023-12-05T09:57:41.776 INFO:tasks.workunit.client.0.smithi100.stdout:1/724: mkdir db/d12/d1e/dd3/db8/de7 0 2023-12-05T09:57:41.780 INFO:tasks.workunit.client.1.smithi150.stdout:1/805: symlink d6/d47/d4c/d7c/l11e 0 2023-12-05T09:57:41.780 INFO:tasks.workunit.client.1.smithi150.stdout:1/806: readlink d6/d8/db/d1b/lb0 0 2023-12-05T09:57:41.784 INFO:tasks.workunit.client.0.smithi100.stdout:0/701: link da/d1b/f66 da/d22/d33/d74/dca/fcb 0 2023-12-05T09:57:41.796 INFO:tasks.workunit.client.0.smithi100.stdout:1/725: mknod db/d12/d1e/d26/d30/ce8 0 2023-12-05T09:57:41.797 INFO:tasks.workunit.client.0.smithi100.stdout:1/726: chown db/d12/d1e/c40 857 1 2023-12-05T09:57:41.797 INFO:tasks.workunit.client.0.smithi100.stdout:2/854: dread d7/da/d18/d21/f40 [0,4194304] 0 2023-12-05T09:57:41.798 INFO:tasks.workunit.client.0.smithi100.stdout:9/774: dwrite d7/f4d [0,4194304] 0 2023-12-05T09:57:41.803 INFO:tasks.workunit.client.0.smithi100.stdout:1/727: mkdir db/d12/d1e/d26/d39/de9 0 2023-12-05T09:57:41.809 INFO:tasks.workunit.client.0.smithi100.stdout:7/701: write d3/dc/d11/f25 [255853,84759] 0 2023-12-05T09:57:41.809 INFO:tasks.workunit.client.0.smithi100.stdout:9/775: link d7/d1b/d22/d2a/l52 d7/d35/d71/dda/l10f 0 2023-12-05T09:57:41.810 INFO:tasks.workunit.client.0.smithi100.stdout:0/702: mknod da/d1b/ccc 0 2023-12-05T09:57:41.810 INFO:tasks.workunit.client.0.smithi100.stdout:0/703: getdents da/d22/d33/d7f/d87 0 2023-12-05T09:57:41.813 INFO:tasks.workunit.client.0.smithi100.stdout:1/728: rename db/d12/f13 to db/d12/fea 0 2023-12-05T09:57:41.818 INFO:tasks.workunit.client.1.smithi150.stdout:9/705: mkdir d3/d9/d58/d90/de8 0 2023-12-05T09:57:41.819 INFO:tasks.workunit.client.0.smithi100.stdout:8/696: dwrite d0/d12/f36 [4194304,4194304] 0 2023-12-05T09:57:41.819 INFO:tasks.workunit.client.0.smithi100.stdout:8/697: fsync d0/f5b 0 2023-12-05T09:57:41.820 INFO:tasks.workunit.client.0.smithi100.stdout:9/776: link d7/d1b/d22/d2a/d56/fc4 d7/d1b/d22/d2a/d56/d2e/d50/d107/f110 0 2023-12-05T09:57:41.820 INFO:tasks.workunit.client.0.smithi100.stdout:5/760: dwrite d0/d1f/f10a [0,4194304] 0 2023-12-05T09:57:41.820 INFO:tasks.workunit.client.0.smithi100.stdout:9/777: write d7/d35/f85 [351801,121691] 0 2023-12-05T09:57:41.820 INFO:tasks.workunit.client.0.smithi100.stdout:5/761: fdatasync d0/d16/dc9/fa6 0 2023-12-05T09:57:41.822 INFO:tasks.workunit.client.0.smithi100.stdout:2/855: dread d7/da/d18/d1b/d2c/f49 [0,4194304] 0 2023-12-05T09:57:41.822 INFO:tasks.workunit.client.0.smithi100.stdout:2/856: chown d7/da/d18/d1b/d2c/d3f/d98/c110 7691833 1 2023-12-05T09:57:41.823 INFO:tasks.workunit.client.0.smithi100.stdout:3/836: dwrite d0/d2/f6e [0,4194304] 0 2023-12-05T09:57:41.824 INFO:tasks.workunit.client.0.smithi100.stdout:0/704: rename da/d1b/d6b/d78/c90 to da/d1b/d6b/d78/ccd 0 2023-12-05T09:57:41.828 INFO:tasks.workunit.client.0.smithi100.stdout:1/729: link db/d31/d73/fac db/d12/d1e/d26/d30/feb 0 2023-12-05T09:57:41.831 INFO:tasks.workunit.client.0.smithi100.stdout:7/702: rmdir d3/dc/d11/d33 39 2023-12-05T09:57:41.838 INFO:tasks.workunit.client.1.smithi150.stdout:8/816: rmdir d0/d41/d49/d1b/d24/d38/dad 39 2023-12-05T09:57:41.839 INFO:tasks.workunit.client.0.smithi100.stdout:8/698: creat d0/d12/d13/d45/dba/dbd/d82/fc2 x:0 0 0 2023-12-05T09:57:41.840 INFO:tasks.workunit.client.0.smithi100.stdout:5/762: dread d0/d16/d2b/fa4 [0,4194304] 0 2023-12-05T09:57:41.840 INFO:tasks.workunit.client.0.smithi100.stdout:5/763: stat d0/d1f/d25/d31/c109 0 2023-12-05T09:57:41.842 INFO:tasks.workunit.client.1.smithi150.stdout:3/799: mkdir d6/d9/d3d/d56/d30/d104 0 2023-12-05T09:57:41.844 INFO:tasks.workunit.client.1.smithi150.stdout:6/688: creat d2/d23/d3b/d64/d7a/d5d/dcd/fe6 x:0 0 0 2023-12-05T09:57:41.850 INFO:tasks.workunit.client.1.smithi150.stdout:4/713: rename d0/d3e/d6d/d95/f9a to d0/d3e/d48/fdb 0 2023-12-05T09:57:41.853 INFO:tasks.workunit.client.1.smithi150.stdout:0/811: unlink d5/d11/f8f 0 2023-12-05T09:57:41.854 INFO:tasks.workunit.client.1.smithi150.stdout:0/812: fdatasync d5/d11/d71/d99/d9c/d96/dd5/d67/ff0 0 2023-12-05T09:57:41.857 INFO:tasks.workunit.client.1.smithi150.stdout:7/774: getdents d2/db/d17/d3a 0 2023-12-05T09:57:41.857 INFO:tasks.workunit.client.1.smithi150.stdout:7/775: truncate d2/db/d17/d88/fd6 758013 0 2023-12-05T09:57:41.862 INFO:tasks.workunit.client.0.smithi100.stdout:1/730: dwrite db/d12/f18 [0,4194304] 0 2023-12-05T09:57:41.862 INFO:tasks.workunit.client.0.smithi100.stdout:1/731: write db/d31/d3a/d4a/f7d [643744,22910] 0 2023-12-05T09:57:41.862 INFO:tasks.workunit.client.1.smithi150.stdout:2/814: unlink d0/d3/d21/d4d/deb/d103/d15/d30/c3a 0 2023-12-05T09:57:41.866 INFO:tasks.workunit.client.1.smithi150.stdout:1/807: mkdir d6/d47/d4c/dd9/d11f 0 2023-12-05T09:57:41.866 INFO:tasks.workunit.client.1.smithi150.stdout:1/808: write d6/d47/db4/f111 [666305,87319] 0 2023-12-05T09:57:41.871 INFO:tasks.workunit.client.1.smithi150.stdout:3/800: creat d6/d9/d3d/d56/d53/d51/f105 x:0 0 0 2023-12-05T09:57:41.874 INFO:tasks.workunit.client.1.smithi150.stdout:4/714: rmdir d0/d3e/d5b/d6e/daa 39 2023-12-05T09:57:41.874 INFO:tasks.workunit.client.1.smithi150.stdout:4/715: chown d0/d3e/d5b/d80/d44/da2/da4 360104 1 2023-12-05T09:57:41.876 INFO:tasks.workunit.client.1.smithi150.stdout:7/776: symlink d2/d1b/l105 0 2023-12-05T09:57:41.876 INFO:tasks.workunit.client.1.smithi150.stdout:7/777: readlink d2/d72/l79 0 2023-12-05T09:57:41.879 INFO:tasks.workunit.client.1.smithi150.stdout:2/815: write d0/d3/d11/f23 [3471825,103213] 0 2023-12-05T09:57:41.880 INFO:tasks.workunit.client.1.smithi150.stdout:0/813: dread d5/d11/f24 [0,4194304] 0 2023-12-05T09:57:41.882 INFO:tasks.workunit.client.0.smithi100.stdout:2/857: creat d7/da/d13/d69/d6e/d71/f120 x:0 0 0 2023-12-05T09:57:41.885 INFO:tasks.workunit.client.1.smithi150.stdout:8/817: getdents d0/d8 0 2023-12-05T09:57:41.885 INFO:tasks.workunit.client.1.smithi150.stdout:8/818: readlink d0/d41/d49/d1b/d24/d5b/d87/lb7 0 2023-12-05T09:57:41.885 INFO:tasks.workunit.client.1.smithi150.stdout:5/780: sync 2023-12-05T09:57:41.886 INFO:tasks.workunit.client.0.smithi100.stdout:3/837: truncate d0/d3d/d5c/d6f/d7f/fd7 326034 0 2023-12-05T09:57:41.886 INFO:tasks.workunit.client.0.smithi100.stdout:3/838: write d0/d4/d3a/d45/fa6 [3845105,41873] 0 2023-12-05T09:57:41.887 INFO:tasks.workunit.client.1.smithi150.stdout:3/801: creat d6/d9/d3d/d8a/f106 x:0 0 0 2023-12-05T09:57:41.891 INFO:tasks.workunit.client.0.smithi100.stdout:0/705: creat da/d22/d33/d74/d77/fce x:0 0 0 2023-12-05T09:57:41.891 INFO:tasks.workunit.client.0.smithi100.stdout:0/706: getdents da/d2a/d4d 0 2023-12-05T09:57:41.893 INFO:tasks.workunit.client.1.smithi150.stdout:0/814: dread d5/d11/d16/f1e [0,4194304] 0 2023-12-05T09:57:41.893 INFO:tasks.workunit.client.1.smithi150.stdout:0/815: chown d5/d11/l6e 1 1 2023-12-05T09:57:41.893 INFO:tasks.workunit.client.1.smithi150.stdout:6/689: dwrite d2/d23/f67 [0,4194304] 0 2023-12-05T09:57:41.895 INFO:tasks.workunit.client.1.smithi150.stdout:7/778: rename d2/db/d30/daf/fba to d2/db/d30/daf/dd3/d2b/dd2/f106 0 2023-12-05T09:57:41.895 INFO:tasks.workunit.client.1.smithi150.stdout:7/779: truncate d2/db/d30/d18/d63/f7f 8808080 0 2023-12-05T09:57:41.896 INFO:tasks.workunit.client.1.smithi150.stdout:7/780: creat d2/db/d2e/d71/df2/f107 x:0 0 0 2023-12-05T09:57:41.897 INFO:tasks.workunit.client.0.smithi100.stdout:7/703: unlink d3/dc/f12 0 2023-12-05T09:57:41.897 INFO:tasks.workunit.client.0.smithi100.stdout:7/704: chown d3/dc/d11/d13/d1b/d60 7 1 2023-12-05T09:57:41.898 INFO:tasks.workunit.client.1.smithi150.stdout:2/816: creat d0/d3/d5/d22/d52/d56/d107/f11b x:0 0 0 2023-12-05T09:57:41.902 INFO:tasks.workunit.client.0.smithi100.stdout:8/699: link d0/d35/l60 d0/d12/d13/d45/dba/dbd/d82/lc3 0 2023-12-05T09:57:41.903 INFO:tasks.workunit.client.1.smithi150.stdout:5/781: creat d1/d64/ded/f113 x:0 0 0 2023-12-05T09:57:41.906 INFO:tasks.workunit.client.0.smithi100.stdout:5/764: rmdir d0/dbe 0 2023-12-05T09:57:41.906 INFO:tasks.workunit.client.0.smithi100.stdout:5/765: dread - d0/d1f/d25/fa9 zero size 2023-12-05T09:57:41.907 INFO:tasks.workunit.client.1.smithi150.stdout:1/809: dwrite d6/d47/d4c/dd9/f22 [0,4194304] 0 2023-12-05T09:57:41.907 INFO:tasks.workunit.client.1.smithi150.stdout:1/810: fdatasync d6/d8/db/db1/fba 0 2023-12-05T09:57:41.908 INFO:tasks.workunit.client.1.smithi150.stdout:0/816: dread d5/d11/d71/f30 [0,4194304] 0 2023-12-05T09:57:41.910 INFO:tasks.workunit.client.0.smithi100.stdout:9/778: unlink d7/d20/f2c 0 2023-12-05T09:57:41.916 INFO:tasks.workunit.client.0.smithi100.stdout:1/732: symlink db/d31/d3a/d3b/lec 0 2023-12-05T09:57:41.917 INFO:tasks.workunit.client.0.smithi100.stdout:2/858: symlink d7/da/d18/d1b/d2c/d3f/d46/dc8/l121 0 2023-12-05T09:57:41.919 INFO:tasks.workunit.client.0.smithi100.stdout:4/704: sync 2023-12-05T09:57:41.919 INFO:tasks.workunit.client.0.smithi100.stdout:4/705: readlink de/d16/d23/d33/l93 0 2023-12-05T09:57:41.919 INFO:tasks.workunit.client.0.smithi100.stdout:4/706: write de/d16/d23/d33/d3d/d44/d4e/d85/fa3 [51107,13106] 0 2023-12-05T09:57:41.919 INFO:tasks.workunit.client.0.smithi100.stdout:4/707: truncate de/d16/d23/d33/d3d/f6f 942193 0 2023-12-05T09:57:41.921 INFO:tasks.workunit.client.0.smithi100.stdout:0/707: rmdir da/d22/d33/d35/d3a 39 2023-12-05T09:57:41.926 INFO:tasks.workunit.client.1.smithi150.stdout:7/781: creat d2/d4/f108 x:0 0 0 2023-12-05T09:57:41.926 INFO:tasks.workunit.client.0.smithi100.stdout:7/705: unlink d3/dc/d11/d13/de/d18/f9b 0 2023-12-05T09:57:41.926 INFO:tasks.workunit.client.0.smithi100.stdout:7/706: dread - d3/dc/d11/d13/de/d18/d3b/de2/feb zero size 2023-12-05T09:57:41.926 INFO:tasks.workunit.client.0.smithi100.stdout:7/707: stat d3/dc/d11/d13/de/c8c 0 2023-12-05T09:57:41.926 INFO:tasks.workunit.client.0.smithi100.stdout:7/708: dread - d3/dc/d11/d13/de/d18/d3b/d40/d4c/fdf zero size 2023-12-05T09:57:41.928 INFO:tasks.workunit.client.1.smithi150.stdout:8/819: dwrite d0/d41/d49/d1b/d24/d5b/d9c/fc6 [0,4194304] 0 2023-12-05T09:57:41.928 INFO:tasks.workunit.client.1.smithi150.stdout:8/820: truncate d0/d41/d49/d1b/d24/d2e/d4d/d83/fca 833979 0 2023-12-05T09:57:41.931 INFO:tasks.workunit.client.1.smithi150.stdout:3/802: dwrite d6/d25/f97 [0,4194304] 0 2023-12-05T09:57:41.931 INFO:tasks.workunit.client.1.smithi150.stdout:5/782: mkdir d1/d3/d114 0 2023-12-05T09:57:41.937 INFO:tasks.workunit.client.0.smithi100.stdout:8/700: link d0/d12/d13/d16/d42/d43/f66 d0/d12/d13/d45/da6/d9c/fc4 0 2023-12-05T09:57:41.937 INFO:tasks.workunit.client.0.smithi100.stdout:8/701: chown d0/d12/d13/f90 24 1 2023-12-05T09:57:41.937 INFO:tasks.workunit.client.0.smithi100.stdout:5/766: symlink d0/d1b/d4d/d8e/d96/dc1/dae/db9/l10f 0 2023-12-05T09:57:41.937 INFO:tasks.workunit.client.0.smithi100.stdout:9/779: creat d7/d1b/d22/d2a/d56/d9c/dfd/d109/f111 x:0 0 0 2023-12-05T09:57:41.941 INFO:tasks.workunit.client.0.smithi100.stdout:1/733: link db/d12/d1e/dd3/ce3 db/d12/d1e/d26/d30/d52/dd0/ced 0 2023-12-05T09:57:41.942 INFO:tasks.workunit.client.1.smithi150.stdout:0/817: creat d5/d11/d71/d99/d9c/d96/dd5/f11d x:0 0 0 2023-12-05T09:57:41.942 INFO:tasks.workunit.client.1.smithi150.stdout:0/818: chown d5/d11/d32/d57/c64 111 1 2023-12-05T09:57:41.942 INFO:tasks.workunit.client.1.smithi150.stdout:0/819: write d5/dbd/ffd [368745,5096] 0 2023-12-05T09:57:41.944 INFO:tasks.workunit.client.0.smithi100.stdout:0/708: rename da/d22/d33/d74/dca/f48 to da/d1b/d73/db3/fcf 0 2023-12-05T09:57:41.947 INFO:tasks.workunit.client.1.smithi150.stdout:7/782: link d2/db/d2e/d71/df2/l100 d2/db/d30/d13/d4f/l109 0 2023-12-05T09:57:41.947 INFO:tasks.workunit.client.1.smithi150.stdout:7/783: readlink d2/db/d30/d47/lc6 0 2023-12-05T09:57:41.950 INFO:tasks.workunit.client.0.smithi100.stdout:3/839: dwrite d0/d3d/d5c/d5f/d67/df2/ff7 [0,4194304] 0 2023-12-05T09:57:41.950 INFO:tasks.workunit.client.0.smithi100.stdout:3/840: creat d0/d2/de/d11/db5/f11d x:0 0 0 2023-12-05T09:57:41.952 INFO:tasks.workunit.client.1.smithi150.stdout:2/817: link d0/d3/d21/d4d/deb/d103/db9/c10c d0/d3/d21/d4d/deb/d103/d15/d30/d54/c11c 0 2023-12-05T09:57:41.953 INFO:tasks.workunit.client.0.smithi100.stdout:7/709: symlink d3/dc/d11/d13/de/d18/dcb/l105 0 2023-12-05T09:57:41.955 INFO:tasks.workunit.client.1.smithi150.stdout:6/690: dwrite d2/d23/d3b/d64/d7a/d5d/fbd [0,4194304] 0 2023-12-05T09:57:41.955 INFO:tasks.workunit.client.1.smithi150.stdout:6/691: creat d2/d23/d2e/d72/fe7 x:0 0 0 2023-12-05T09:57:41.955 INFO:tasks.workunit.client.1.smithi150.stdout:6/692: readlink d2/d23/d2e/d93/d97/l96 0 2023-12-05T09:57:41.957 INFO:tasks.workunit.client.0.smithi100.stdout:8/702: mkdir d0/d12/d13/d45/da6/d9c/dc5 0 2023-12-05T09:57:41.959 INFO:tasks.workunit.client.0.smithi100.stdout:9/780: symlink d7/d1b/d22/d2a/d74/l112 0 2023-12-05T09:57:41.964 INFO:tasks.workunit.client.1.smithi150.stdout:9/706: sync 2023-12-05T09:57:41.964 INFO:tasks.workunit.client.1.smithi150.stdout:9/707: chown d3/d9/dc/d1f/f25 4388983 1 2023-12-05T09:57:41.964 INFO:tasks.workunit.client.0.smithi100.stdout:5/767: symlink d0/d16/d2b/d48/df/d51/da8/dee/l110 0 2023-12-05T09:57:41.965 INFO:tasks.workunit.client.0.smithi100.stdout:5/768: chown d0/d1b/f39 134036429 1 2023-12-05T09:57:41.966 INFO:tasks.workunit.client.1.smithi150.stdout:5/783: link d1/d7f/d65/d3b/d37/f48 d1/d3/d6/d26/dca/f115 0 2023-12-05T09:57:41.967 INFO:tasks.workunit.client.0.smithi100.stdout:2/859: mkdir d7/da/d18/d21/d122 0 2023-12-05T09:57:41.972 INFO:tasks.workunit.client.1.smithi150.stdout:0/820: truncate d5/d11/d71/d99/d9c/fcf 2890443 0 2023-12-05T09:57:41.972 INFO:tasks.workunit.client.1.smithi150.stdout:0/821: dread - d5/d11/f112 zero size 2023-12-05T09:57:41.973 INFO:tasks.workunit.client.0.smithi100.stdout:0/709: link da/f5a da/d2a/d45/fd0 0 2023-12-05T09:57:41.975 INFO:tasks.workunit.client.1.smithi150.stdout:7/784: rename d2/db/d30/d13/d4f/d5a/d5c/f89 to d2/db/d62/f10a 0 2023-12-05T09:57:41.975 INFO:tasks.workunit.client.1.smithi150.stdout:7/785: chown d2/db/d30/d53/fcc 19355106 1 2023-12-05T09:57:41.981 INFO:tasks.workunit.client.1.smithi150.stdout:2/818: unlink d0/d3/d5/d22/d52/d10e/f116 0 2023-12-05T09:57:41.988 INFO:tasks.workunit.client.1.smithi150.stdout:8/821: dwrite d0/d8/f11 [4194304,4194304] 0 2023-12-05T09:57:41.988 INFO:tasks.workunit.client.1.smithi150.stdout:6/693: mknod d2/d23/d3b/d64/d7a/d5d/d6b/ce8 0 2023-12-05T09:57:41.988 INFO:tasks.workunit.client.1.smithi150.stdout:6/694: chown d2/c8e 423828 1 2023-12-05T09:57:41.989 INFO:tasks.workunit.client.0.smithi100.stdout:3/841: mkdir d0/d2/de/d8d/d11e 0 2023-12-05T09:57:41.991 INFO:tasks.workunit.client.0.smithi100.stdout:7/710: getdents d3/dc/d11/d13/de/d2d/d42 0 2023-12-05T09:57:41.993 INFO:tasks.workunit.client.0.smithi100.stdout:8/703: mkdir d0/d35/d64/d81/d9a/dc6 0 2023-12-05T09:57:41.993 INFO:tasks.workunit.client.0.smithi100.stdout:8/704: chown d0/d12/d13/d45/dba/dbd/d72/d9f 892589 1 2023-12-05T09:57:41.998 INFO:tasks.workunit.client.0.smithi100.stdout:9/781: unlink d7/c73 0 2023-12-05T09:57:42.002 INFO:tasks.workunit.client.0.smithi100.stdout:5/769: mkdir d0/d1f/d25/d111 0 2023-12-05T09:57:42.003 INFO:tasks.workunit.client.1.smithi150.stdout:8/822: dread d0/d41/d49/f52 [0,4194304] 0 2023-12-05T09:57:42.010 INFO:tasks.workunit.client.0.smithi100.stdout:3/842: rename d0/d3d/d5c/d6f/ca3 to d0/d4/d3a/c11f 0 2023-12-05T09:57:42.013 INFO:tasks.workunit.client.1.smithi150.stdout:6/695: mknod d2/d23/d2e/d44/ce9 0 2023-12-05T09:57:42.015 INFO:tasks.workunit.client.0.smithi100.stdout:0/710: mknod da/d22/cd1 0 2023-12-05T09:57:42.021 INFO:tasks.workunit.client.1.smithi150.stdout:7/786: link d2/db/d30/d13/f1d d2/d4/f10b 0 2023-12-05T09:57:42.021 INFO:tasks.workunit.client.1.smithi150.stdout:7/787: dread - d2/db/ff3 zero size 2023-12-05T09:57:42.021 INFO:tasks.workunit.client.1.smithi150.stdout:7/788: dread - d2/db/d2e/d71/df2/f107 zero size 2023-12-05T09:57:42.022 INFO:tasks.workunit.client.1.smithi150.stdout:8/823: rename d0/d41/d49/f59 to d0/d41/d49/ffc 0 2023-12-05T09:57:42.026 INFO:tasks.workunit.client.0.smithi100.stdout:5/770: rename d0/d16/dc9/ca3 to d0/d1f/d25/d31/c112 0 2023-12-05T09:57:42.027 INFO:tasks.workunit.client.1.smithi150.stdout:3/803: dwrite d6/d9/d3d/d56/d71/db0/f101 [0,4194304] 0 2023-12-05T09:57:42.029 INFO:tasks.workunit.client.0.smithi100.stdout:5/771: mknod d0/d27/dc0/c113 0 2023-12-05T09:57:42.029 INFO:tasks.workunit.client.0.smithi100.stdout:5/772: write d0/d1b/d4d/d8e/d96/dea/f102 [66858,87586] 0 2023-12-05T09:57:42.029 INFO:tasks.workunit.client.0.smithi100.stdout:5/773: fsync d0/f2 0 2023-12-05T09:57:42.029 INFO:tasks.workunit.client.0.smithi100.stdout:5/774: fdatasync d0/d16/d2b/d48/f5d 0 2023-12-05T09:57:42.034 INFO:tasks.workunit.client.0.smithi100.stdout:5/775: symlink d0/d4/d14/l114 0 2023-12-05T09:57:42.034 INFO:tasks.workunit.client.0.smithi100.stdout:5/776: chown d0/d4/d14/ff9 34 1 2023-12-05T09:57:42.034 INFO:tasks.workunit.client.0.smithi100.stdout:5/777: chown d0/d16/d2b/d48/f95 18622 1 2023-12-05T09:57:42.034 INFO:tasks.workunit.client.0.smithi100.stdout:5/778: read - d0/d1b/d4d/d8e/d96/dc1/dae/ffa zero size 2023-12-05T09:57:42.038 INFO:tasks.workunit.client.0.smithi100.stdout:7/711: dread d3/dc/d11/d13/f91 [0,4194304] 0 2023-12-05T09:57:42.039 INFO:tasks.workunit.client.0.smithi100.stdout:5/779: creat d0/d16/d2b/d48/df/d51/da8/dee/f115 x:0 0 0 2023-12-05T09:57:42.044 INFO:tasks.workunit.client.1.smithi150.stdout:3/804: mknod d6/d25/dd9/df2/c107 0 2023-12-05T09:57:42.044 INFO:tasks.workunit.client.1.smithi150.stdout:2/819: rmdir d0/d3/d5/d3b/df2 0 2023-12-05T09:57:42.044 INFO:tasks.workunit.client.0.smithi100.stdout:7/712: creat d3/dc/d11/d13/de/d2d/d42/f106 x:0 0 0 2023-12-05T09:57:42.044 INFO:tasks.workunit.client.0.smithi100.stdout:7/713: chown d3/dc/l104 3 1 2023-12-05T09:57:42.044 INFO:tasks.workunit.client.0.smithi100.stdout:2/860: dwrite d7/da/d18/d21/f7e [0,4194304] 0 2023-12-05T09:57:42.046 INFO:tasks.workunit.client.1.smithi150.stdout:2/820: symlink d0/d3/d5/d22/l11d 0 2023-12-05T09:57:42.046 INFO:tasks.workunit.client.1.smithi150.stdout:2/821: truncate d0/d3/d27/dea/d112/f119 562897 0 2023-12-05T09:57:42.050 INFO:tasks.workunit.client.0.smithi100.stdout:7/714: creat d3/dc/d11/d13/de/d18/d3b/d40/d46/d9e/f107 x:0 0 0 2023-12-05T09:57:42.051 INFO:tasks.workunit.client.0.smithi100.stdout:7/715: write d3/dc/d11/d13/de/d2d/d47/dbd/fcc [951824,87516] 0 2023-12-05T09:57:42.052 INFO:tasks.workunit.client.0.smithi100.stdout:7/716: mkdir d3/dc/d11/d108 0 2023-12-05T09:57:42.057 INFO:tasks.workunit.client.1.smithi150.stdout:7/789: write d2/db/d30/d18/d1a/f3c [3654884,4019] 0 2023-12-05T09:57:42.057 INFO:tasks.workunit.client.1.smithi150.stdout:7/790: chown d2/db/d30/d13/f66 0 1 2023-12-05T09:57:42.061 INFO:tasks.workunit.client.0.smithi100.stdout:5/780: dread d0/d16/d2b/fa4 [0,4194304] 0 2023-12-05T09:57:42.062 INFO:tasks.workunit.client.1.smithi150.stdout:2/822: rename d0/d3/d11/d1d to d0/d3/d5/d10/d3d/da1/daa/d11e 0 2023-12-05T09:57:42.063 INFO:tasks.workunit.client.1.smithi150.stdout:2/823: truncate d0/d3/d5/d3b/d4c/d71/f10b 293856 0 2023-12-05T09:57:42.063 INFO:tasks.workunit.client.1.smithi150.stdout:2/824: chown d0/d3/d21/d4d/deb/d103/d15/d30/f89 538199 1 2023-12-05T09:57:42.063 INFO:tasks.workunit.client.0.smithi100.stdout:7/717: creat d3/dc/d11/d13/de/d18/d3b/f109 x:0 0 0 2023-12-05T09:57:42.063 INFO:tasks.workunit.client.0.smithi100.stdout:7/718: getdents d3/dc/d11/d13/de/d18/d3b/dd7 0 2023-12-05T09:57:42.063 INFO:tasks.workunit.client.0.smithi100.stdout:7/719: dread - d3/dc/d11/d13/de/d18/d3b/d40/fb8 zero size 2023-12-05T09:57:42.068 INFO:tasks.workunit.client.1.smithi150.stdout:9/708: dwrite d3/d9/dc/f92 [4194304,4194304] 0 2023-12-05T09:57:42.068 INFO:tasks.workunit.client.1.smithi150.stdout:9/709: getdents d3/d9/dc/d1f/d24/d75/d95/d9a/dcb/de4 0 2023-12-05T09:57:42.068 INFO:tasks.workunit.client.1.smithi150.stdout:3/805: dread d6/d9/d3d/d56/d71/db0/f101 [0,4194304] 0 2023-12-05T09:57:42.068 INFO:tasks.workunit.client.1.smithi150.stdout:3/806: chown d6/d22/l100 45192700 1 2023-12-05T09:57:42.068 INFO:tasks.workunit.client.1.smithi150.stdout:3/807: truncate d6/d9/d3d/d56/d53/f102 827068 0 2023-12-05T09:57:42.069 INFO:tasks.workunit.client.0.smithi100.stdout:1/734: dwrite db/d31/d3a/d4a/dad/d67/f6b [8388608,4194304] 0 2023-12-05T09:57:42.069 INFO:tasks.workunit.client.0.smithi100.stdout:4/708: dwrite de/d38/d5d/f71 [0,4194304] 0 2023-12-05T09:57:42.070 INFO:tasks.workunit.client.1.smithi150.stdout:0/822: dwrite d5/d11/d71/d5f/d6a/fe8 [0,4194304] 0 2023-12-05T09:57:42.070 INFO:tasks.workunit.client.1.smithi150.stdout:7/791: truncate d2/db/d62/f10a 112608 0 2023-12-05T09:57:42.070 INFO:tasks.workunit.client.1.smithi150.stdout:0/823: chown d5/d11/d71/l8e 55 1 2023-12-05T09:57:42.071 INFO:tasks.workunit.client.0.smithi100.stdout:9/782: dwrite d7/d20/d69/def/fbe [0,4194304] 0 2023-12-05T09:57:42.072 INFO:tasks.workunit.client.0.smithi100.stdout:9/783: creat d7/d1b/d22/d2a/d56/d9c/dfd/d109/f113 x:0 0 0 2023-12-05T09:57:42.072 INFO:tasks.workunit.client.0.smithi100.stdout:9/784: write d7/f29 [1583984,51562] 0 2023-12-05T09:57:42.073 INFO:tasks.workunit.client.0.smithi100.stdout:9/785: dread - d7/d20/d69/def/f67 zero size 2023-12-05T09:57:42.077 INFO:tasks.workunit.client.0.smithi100.stdout:5/781: mknod d0/d4/c116 0 2023-12-05T09:57:42.077 INFO:tasks.workunit.client.0.smithi100.stdout:5/782: chown d0/d4/d14/l83 6327 1 2023-12-05T09:57:42.081 INFO:tasks.workunit.client.0.smithi100.stdout:7/720: symlink d3/dc/d11/d13/de/d18/l10a 0 2023-12-05T09:57:42.082 INFO:tasks.workunit.client.1.smithi150.stdout:6/696: dwrite d2/d23/d2e/f85 [0,4194304] 0 2023-12-05T09:57:42.083 INFO:tasks.workunit.client.1.smithi150.stdout:3/808: unlink d6/d9/d8d/de6/c8e 0 2023-12-05T09:57:42.083 INFO:tasks.workunit.client.1.smithi150.stdout:3/809: write d6/d9/d3d/d56/d71/db6/db2/ff4 [405578,16397] 0 2023-12-05T09:57:42.083 INFO:tasks.workunit.client.1.smithi150.stdout:3/810: fsync d6/d9/d3d/d56/d71/db6/dc1/d67/ff5 0 2023-12-05T09:57:42.087 INFO:tasks.workunit.client.0.smithi100.stdout:4/709: mkdir de/d16/d23/d60/de3 0 2023-12-05T09:57:42.088 INFO:tasks.workunit.client.1.smithi150.stdout:3/811: write d6/f6c [1005084,42462] 0 2023-12-05T09:57:42.089 INFO:tasks.workunit.client.1.smithi150.stdout:3/812: read d6/d9/d3d/d56/f3f [686072,116575] 0 2023-12-05T09:57:42.092 INFO:tasks.workunit.client.0.smithi100.stdout:5/783: dread d0/d1f/fdb [0,4194304] 0 2023-12-05T09:57:42.092 INFO:tasks.workunit.client.0.smithi100.stdout:5/784: dread - d0/d1b/d4d/d8e/d96/dc1/dae/faf zero size 2023-12-05T09:57:42.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:41 smithi150 ceph-mon[116142]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-05T09:57:42.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:41 smithi150 ceph-mon[116142]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-05T09:57:42.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:41 smithi150 ceph-mon[116142]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-05T09:57:42.097 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:41 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:57:42.097 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:41 smithi150 ceph-mon[116142]: Upgrade: Need to upgrade myself (mgr.smithi150.zkskag) 2023-12-05T09:57:42.097 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:41 smithi150 ceph-mon[116142]: Upgrade: Need to upgrade myself (mgr.smithi150.zkskag) 2023-12-05T09:57:42.097 INFO:tasks.workunit.client.0.smithi100.stdout:7/721: dread d3/ff2 [0,4194304] 0 2023-12-05T09:57:42.099 INFO:tasks.workunit.client.0.smithi100.stdout:8/705: dwrite d0/f37 [0,4194304] 0 2023-12-05T09:57:42.099 INFO:tasks.workunit.client.0.smithi100.stdout:8/706: stat d0/ce 0 2023-12-05T09:57:42.100 INFO:tasks.workunit.client.0.smithi100.stdout:2/861: dwrite d7/da/d18/d1b/d2c/f115 [0,4194304] 0 2023-12-05T09:57:42.100 INFO:tasks.workunit.client.0.smithi100.stdout:2/862: readlink d7/da/d18/d1b/d2c/d3f/l11f 0 2023-12-05T09:57:42.100 INFO:tasks.workunit.client.0.smithi100.stdout:2/863: write d7/da/d13/d69/d6e/d71/f9a [4342149,10435] 0 2023-12-05T09:57:42.103 INFO:tasks.workunit.client.1.smithi150.stdout:0/824: link d5/d11/d71/d99/d9c/d96/dd5/d7f/cf9 d5/c11e 0 2023-12-05T09:57:42.103 INFO:tasks.workunit.client.1.smithi150.stdout:0/825: chown d5/d11/d71/d99/d9c/d3b/c5c 22819 1 2023-12-05T09:57:42.103 INFO:tasks.workunit.client.1.smithi150.stdout:0/826: write d5/d11/d32/d57/fa1 [409490,62049] 0 2023-12-05T09:57:42.103 INFO:tasks.workunit.client.1.smithi150.stdout:8/824: dwrite d0/ff7 [0,4194304] 0 2023-12-05T09:57:42.104 INFO:tasks.workunit.client.0.smithi100.stdout:9/786: getdents d7/d35/d71/d9a/dcd/df1 0 2023-12-05T09:57:42.104 INFO:tasks.workunit.client.0.smithi100.stdout:3/843: write d0/d4/f1e [4305676,100168] 0 2023-12-05T09:57:42.107 INFO:tasks.workunit.client.1.smithi150.stdout:6/697: truncate d2/d23/d2e/f94 2461094 0 2023-12-05T09:57:42.111 INFO:tasks.workunit.client.0.smithi100.stdout:5/785: mkdir d0/d16/d2b/d48/df/d51/da8/dee/d117 0 2023-12-05T09:57:42.115 INFO:tasks.workunit.client.0.smithi100.stdout:7/722: rename d3/dc/d11/d13/de/d18/cc9 to d3/dc/d11/d13/de/d18/d3b/c10b 0 2023-12-05T09:57:42.119 INFO:tasks.workunit.client.0.smithi100.stdout:5/786: fsync d0/d16/d2b/d48/df/d51/da8/dee/f115 0 2023-12-05T09:57:42.121 INFO:tasks.workunit.client.0.smithi100.stdout:8/707: symlink d0/d12/d13/d45/da6/lc7 0 2023-12-05T09:57:42.124 INFO:tasks.workunit.client.1.smithi150.stdout:2/825: dwrite d0/d3/d5/d3b/d4c/d71/fc2 [4194304,4194304] 0 2023-12-05T09:57:42.124 INFO:tasks.workunit.client.1.smithi150.stdout:1/811: sync 2023-12-05T09:57:42.124 INFO:tasks.workunit.client.1.smithi150.stdout:4/716: sync 2023-12-05T09:57:42.128 INFO:tasks.workunit.client.1.smithi150.stdout:6/698: link d2/d23/d3b/d64/d7a/d5d/d6b/f1a d2/d23/d3b/d64/fea 0 2023-12-05T09:57:42.137 INFO:tasks.workunit.client.1.smithi150.stdout:9/710: dwrite d3/d9/d6e/d84/fb1 [0,4194304] 0 2023-12-05T09:57:42.139 INFO:tasks.workunit.client.1.smithi150.stdout:2/826: unlink d0/d3/d21/d4d/f90 0 2023-12-05T09:57:42.141 INFO:tasks.workunit.client.0.smithi100.stdout:2/864: unlink d7/da/dc/c8d 0 2023-12-05T09:57:42.141 INFO:tasks.workunit.client.0.smithi100.stdout:7/723: dread d3/dc/d11/d13/de/d18/d3b/d40/d46/f50 [0,4194304] 0 2023-12-05T09:57:42.142 INFO:tasks.workunit.client.0.smithi100.stdout:7/724: truncate d3/dc/d11/d13/de/d18/d3b/d40/d4c/fdf 427657 0 2023-12-05T09:57:42.144 INFO:tasks.workunit.client.1.smithi150.stdout:6/699: link d2/d23/d3b/d64/d7a/d5d/d6b/ce8 d2/d23/d3b/d64/d7a/d5d/d6b/ceb 0 2023-12-05T09:57:42.144 INFO:tasks.workunit.client.1.smithi150.stdout:6/700: creat d2/d23/d2e/d72/fec x:0 0 0 2023-12-05T09:57:42.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:41 smithi100 ceph-mon[107145]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-05T09:57:42.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:41 smithi100 ceph-mon[107145]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-05T09:57:42.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:41 smithi100 ceph-mon[107145]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-05T09:57:42.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:41 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:57:42.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:41 smithi100 ceph-mon[107145]: Upgrade: Need to upgrade myself (mgr.smithi150.zkskag) 2023-12-05T09:57:42.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:41 smithi100 ceph-mon[107145]: Upgrade: Need to upgrade myself (mgr.smithi150.zkskag) 2023-12-05T09:57:42.146 INFO:tasks.workunit.client.1.smithi150.stdout:3/813: getdents d6/d9/d8d/de6 0 2023-12-05T09:57:42.147 INFO:tasks.workunit.client.1.smithi150.stdout:4/717: dread d0/d3e/d6d/f3f [4194304,4194304] 0 2023-12-05T09:57:42.148 INFO:tasks.workunit.client.1.smithi150.stdout:4/718: creat d0/d3e/d6d/fdc x:0 0 0 2023-12-05T09:57:42.149 INFO:tasks.workunit.client.0.smithi100.stdout:1/735: dwrite db/d12/d1e/d26/d30/f83 [0,4194304] 0 2023-12-05T09:57:42.149 INFO:tasks.workunit.client.0.smithi100.stdout:9/787: creat d7/d1b/d89/f114 x:0 0 0 2023-12-05T09:57:42.150 INFO:tasks.workunit.client.1.smithi150.stdout:7/792: dwrite d2/db/d30/f9 [0,4194304] 0 2023-12-05T09:57:42.150 INFO:tasks.workunit.client.1.smithi150.stdout:7/793: dread - d2/fee zero size 2023-12-05T09:57:42.150 INFO:tasks.workunit.client.1.smithi150.stdout:7/794: fdatasync d2/db/d30/d13/f66 0 2023-12-05T09:57:42.152 INFO:tasks.workunit.client.1.smithi150.stdout:7/795: creat d2/db/d17/d38/d85/f10c x:0 0 0 2023-12-05T09:57:42.158 INFO:tasks.workunit.client.0.smithi100.stdout:3/844: link d0/d3d/d5c/d6f/d7f/d87/f119 d0/d2/d33/f120 0 2023-12-05T09:57:42.161 INFO:tasks.workunit.client.1.smithi150.stdout:2/827: read d0/d3/d5/d3b/d4c/f64 [4112472,228] 0 2023-12-05T09:57:42.161 INFO:tasks.workunit.client.1.smithi150.stdout:0/827: dwrite d5/d11/d71/d99/d9c/d96/dd5/d7f/f116 [0,4194304] 0 2023-12-05T09:57:42.161 INFO:tasks.workunit.client.1.smithi150.stdout:0/828: readlink d5/d11/d32/l6b 0 2023-12-05T09:57:42.165 INFO:tasks.workunit.client.0.smithi100.stdout:4/710: symlink de/dc3/le4 0 2023-12-05T09:57:42.167 INFO:tasks.workunit.client.0.smithi100.stdout:7/725: rename d3/dc/d11/d13/d37/d97/cac to d3/dc/d11/d13/d37/c10c 0 2023-12-05T09:57:42.167 INFO:tasks.workunit.client.1.smithi150.stdout:9/711: symlink d3/d9/dc/d1f/d24/d75/d95/le9 0 2023-12-05T09:57:42.167 INFO:tasks.workunit.client.1.smithi150.stdout:9/712: readlink d3/d9/dc/d1f/d24/d75/d95/d9a/lbf 0 2023-12-05T09:57:42.167 INFO:tasks.workunit.client.1.smithi150.stdout:9/713: chown d3/d9/dc/d1f/d24/f78 1 1 2023-12-05T09:57:42.171 INFO:tasks.workunit.client.0.smithi100.stdout:1/736: link db/d31/d3a/d3b/c3d db/d12/d1e/dd3/db8/de6/cee 0 2023-12-05T09:57:42.171 INFO:tasks.workunit.client.0.smithi100.stdout:1/737: write db/d12/f8f [1037569,114714] 0 2023-12-05T09:57:42.173 INFO:tasks.workunit.client.1.smithi150.stdout:5/784: sync 2023-12-05T09:57:42.176 INFO:tasks.workunit.client.0.smithi100.stdout:4/711: dread de/d16/d23/d60/d98/da6/fc2 [0,4194304] 0 2023-12-05T09:57:42.176 INFO:tasks.workunit.client.0.smithi100.stdout:9/788: unlink d7/d35/d71/f7a 0 2023-12-05T09:57:42.176 INFO:tasks.workunit.client.0.smithi100.stdout:9/789: dread - d7/d35/d71/fff zero size 2023-12-05T09:57:42.176 INFO:tasks.workunit.client.0.smithi100.stdout:9/790: dread - d7/d1b/d22/d51/fbc zero size 2023-12-05T09:57:42.178 INFO:tasks.workunit.client.0.smithi100.stdout:3/845: creat d0/f121 x:0 0 0 2023-12-05T09:57:42.182 INFO:tasks.workunit.client.0.smithi100.stdout:7/726: creat d3/dc/d11/d33/f10d x:0 0 0 2023-12-05T09:57:42.189 INFO:tasks.workunit.client.1.smithi150.stdout:3/814: dread d6/d9/d43/f60 [0,4194304] 0 2023-12-05T09:57:42.191 INFO:tasks.workunit.client.0.smithi100.stdout:5/787: dwrite d0/d1f/f97 [0,4194304] 0 2023-12-05T09:57:42.191 INFO:tasks.workunit.client.1.smithi150.stdout:2/828: mknod d0/d3/d27/dac/c11f 0 2023-12-05T09:57:42.193 INFO:tasks.workunit.client.0.smithi100.stdout:8/708: dwrite d0/d35/d64/d81/f98 [0,4194304] 0 2023-12-05T09:57:42.193 INFO:tasks.workunit.client.0.smithi100.stdout:8/709: stat d0/d12/d13/d45/la8 0 2023-12-05T09:57:42.194 INFO:tasks.workunit.client.0.smithi100.stdout:1/738: mknod db/d12/d1e/dd3/db8/de6/cef 0 2023-12-05T09:57:42.195 INFO:tasks.workunit.client.0.smithi100.stdout:1/739: chown db/d31/d3a/l8b 125575 1 2023-12-05T09:57:42.195 INFO:tasks.workunit.client.1.smithi150.stdout:0/829: mknod d5/d11/d71/ddb/c11f 0 2023-12-05T09:57:42.196 INFO:tasks.workunit.client.1.smithi150.stdout:0/830: write d5/d11/d71/d5f/ff7 [651671,48900] 0 2023-12-05T09:57:42.196 INFO:tasks.workunit.client.1.smithi150.stdout:0/831: truncate d5/d11/d71/d99/d9c/fd3 169184 0 2023-12-05T09:57:42.197 INFO:tasks.workunit.client.1.smithi150.stdout:6/701: read d2/d23/d2e/f3c [748,17978] 0 2023-12-05T09:57:42.197 INFO:tasks.workunit.client.1.smithi150.stdout:6/702: chown d2/d23/d2e 77683 1 2023-12-05T09:57:42.197 INFO:tasks.workunit.client.1.smithi150.stdout:6/703: fdatasync d2/f34 0 2023-12-05T09:57:42.198 INFO:tasks.workunit.client.1.smithi150.stdout:5/785: unlink d1/d3/d6/d26/d9a/ff3 0 2023-12-05T09:57:42.202 INFO:tasks.workunit.client.0.smithi100.stdout:4/712: link f1 de/d16/d23/d33/dae/dd3/fe5 0 2023-12-05T09:57:42.204 INFO:tasks.workunit.client.0.smithi100.stdout:9/791: creat d7/d20/d69/def/ddf/f115 x:0 0 0 2023-12-05T09:57:42.204 INFO:tasks.workunit.client.0.smithi100.stdout:9/792: write d7/d1b/d22/d51/fbc [669014,112623] 0 2023-12-05T09:57:42.209 INFO:tasks.workunit.client.1.smithi150.stdout:0/832: write d5/fb3 [1775401,115105] 0 2023-12-05T09:57:42.210 INFO:tasks.workunit.client.0.smithi100.stdout:3/846: symlink d0/d10/d39/l122 0 2023-12-05T09:57:42.210 INFO:tasks.workunit.client.0.smithi100.stdout:3/847: stat d0/f3b 0 2023-12-05T09:57:42.212 INFO:tasks.workunit.client.0.smithi100.stdout:2/865: dwrite d7/da/da7/dd6/f104 [4194304,4194304] 0 2023-12-05T09:57:42.213 INFO:tasks.workunit.client.0.smithi100.stdout:7/727: symlink d3/dc/d11/d13/de/d18/d3b/l10e 0 2023-12-05T09:57:42.216 INFO:tasks.workunit.client.1.smithi150.stdout:8/825: dwrite d0/d41/d49/d1b/d24/d5b/d87/f98 [4194304,4194304] 0 2023-12-05T09:57:42.216 INFO:tasks.workunit.client.1.smithi150.stdout:5/786: write d1/d7f/d65/f63 [4781276,60765] 0 2023-12-05T09:57:42.217 INFO:tasks.workunit.client.1.smithi150.stdout:5/787: readlink d1/d2e/da6/la9 0 2023-12-05T09:57:42.217 INFO:tasks.workunit.client.1.smithi150.stdout:5/788: chown d1/d64/de7 261274 1 2023-12-05T09:57:42.217 INFO:tasks.workunit.client.1.smithi150.stdout:5/789: readlink d1/d7f/d65/de3/d10a/deb/lef 0 2023-12-05T09:57:42.217 INFO:tasks.workunit.client.1.smithi150.stdout:7/796: dwrite d2/db/d17/d20/fdc [0,4194304] 0 2023-12-05T09:57:42.218 INFO:tasks.workunit.client.0.smithi100.stdout:4/713: dread de/d16/d23/d36/f3a [0,4194304] 0 2023-12-05T09:57:42.218 INFO:tasks.workunit.client.1.smithi150.stdout:3/815: truncate d6/d9/d8d/fe3 800280 0 2023-12-05T09:57:42.219 INFO:tasks.workunit.client.1.smithi150.stdout:3/816: chown d6/d9/df0 43378 1 2023-12-05T09:57:42.219 INFO:tasks.workunit.client.1.smithi150.stdout:3/817: write d6/d9/d43/d47/f1a [4176891,50701] 0 2023-12-05T09:57:42.219 INFO:tasks.workunit.client.1.smithi150.stdout:9/714: dwrite d3/d9/d58/f7e [0,4194304] 0 2023-12-05T09:57:42.219 INFO:tasks.workunit.client.1.smithi150.stdout:2/829: link d0/d3/d5/d3b/d4c/d71/le3 d0/d3/d5/d22/l120 0 2023-12-05T09:57:42.220 INFO:tasks.workunit.client.0.smithi100.stdout:5/788: truncate d0/d1f/d25/d31/f3e 1277754 0 2023-12-05T09:57:42.225 INFO:tasks.workunit.client.1.smithi150.stdout:0/833: mknod d5/d11/d71/d99/d9c/d96/dd5/d7f/c120 0 2023-12-05T09:57:42.227 INFO:tasks.workunit.client.0.smithi100.stdout:8/710: symlink d0/d12/d13/d16/lc8 0 2023-12-05T09:57:42.227 INFO:tasks.workunit.client.0.smithi100.stdout:8/711: fdatasync d0/f5b 0 2023-12-05T09:57:42.230 INFO:tasks.workunit.client.1.smithi150.stdout:8/826: truncate d0/d41/d49/d1b/d24/d5b/f96 2070019 0 2023-12-05T09:57:42.232 INFO:tasks.workunit.client.0.smithi100.stdout:5/789: write d0/d4/d14/d35/fb3 [3276261,119748] 0 2023-12-05T09:57:42.234 INFO:tasks.workunit.client.0.smithi100.stdout:9/793: symlink d7/d1b/d22/d2a/d56/d2e/l116 0 2023-12-05T09:57:42.243 INFO:tasks.workunit.client.1.smithi150.stdout:5/790: mkdir d1/d3/d6/d116 0 2023-12-05T09:57:42.243 INFO:tasks.workunit.client.1.smithi150.stdout:5/791: fsync d1/d2e/f52 0 2023-12-05T09:57:42.243 INFO:tasks.workunit.client.1.smithi150.stdout:5/792: chown d1/d7f/l46 2612 1 2023-12-05T09:57:42.243 INFO:tasks.workunit.client.1.smithi150.stdout:5/793: chown d1/d3/d6/d72 29 1 2023-12-05T09:57:42.247 INFO:tasks.workunit.client.1.smithi150.stdout:0/834: write d5/d11/d71/d74/fd0 [868717,116156] 0 2023-12-05T09:57:42.254 INFO:tasks.workunit.client.1.smithi150.stdout:7/797: creat d2/d72/d82/f10d x:0 0 0 2023-12-05T09:57:42.254 INFO:tasks.workunit.client.1.smithi150.stdout:7/798: rename d2/db/d30/d13/d4f/d7e to d2/db/d30/d13/d4f/d7e/d10e 22 2023-12-05T09:57:42.255 INFO:tasks.workunit.client.1.smithi150.stdout:7/799: chown d2/d1b/d5b/d6a 844 1 2023-12-05T09:57:42.257 INFO:tasks.workunit.client.1.smithi150.stdout:3/818: dwrite d6/d9/d3d/f9f [0,4194304] 0 2023-12-05T09:57:42.257 INFO:tasks.workunit.client.1.smithi150.stdout:3/819: chown d6/d9/d3d/d8a/leb 29171187 1 2023-12-05T09:57:42.257 INFO:tasks.workunit.client.1.smithi150.stdout:3/820: fsync d6/d9/d3d/d56/f3b 0 2023-12-05T09:57:42.265 INFO:tasks.workunit.client.1.smithi150.stdout:3/821: dread d6/d25/f70 [0,4194304] 0 2023-12-05T09:57:42.281 INFO:tasks.workunit.client.0.smithi100.stdout:3/848: rename d0/d3d/d5c/cb3 to d0/d10/d39/dab/c123 0 2023-12-05T09:57:42.285 INFO:tasks.workunit.client.1.smithi150.stdout:9/715: creat d3/d9/d26/d34/dd5/fea x:0 0 0 2023-12-05T09:57:42.285 INFO:tasks.workunit.client.0.smithi100.stdout:2/866: mknod d7/da/d18/d1b/d2c/d3f/d72/c123 0 2023-12-05T09:57:42.286 INFO:tasks.workunit.client.0.smithi100.stdout:7/728: mkdir d3/dc/d11/d13/da8/d10f 0 2023-12-05T09:57:42.286 INFO:tasks.workunit.client.0.smithi100.stdout:7/729: dread - d3/dc/d11/d13/da8/fe3 zero size 2023-12-05T09:57:42.286 INFO:tasks.workunit.client.0.smithi100.stdout:7/730: creat d3/dc/d11/f110 x:0 0 0 2023-12-05T09:57:42.286 INFO:tasks.workunit.client.0.smithi100.stdout:7/731: dread - d3/dc/d11/d13/de/f99 zero size 2023-12-05T09:57:42.289 INFO:tasks.workunit.client.0.smithi100.stdout:4/714: creat de/d16/d23/d33/d3d/d44/fe6 x:0 0 0 2023-12-05T09:57:42.291 INFO:tasks.workunit.client.1.smithi150.stdout:5/794: dwrite d1/d64/d31/f49 [0,4194304] 0 2023-12-05T09:57:42.293 INFO:tasks.workunit.client.1.smithi150.stdout:6/704: getdents d2/d23/d2e/d5f/d99/dd8 0 2023-12-05T09:57:42.293 INFO:tasks.workunit.client.1.smithi150.stdout:8/827: rmdir d0/d41/d49/d1b/d24/d5b 39 2023-12-05T09:57:42.296 INFO:tasks.workunit.client.0.smithi100.stdout:8/712: mkdir d0/d12/d13/d45/dc9 0 2023-12-05T09:57:42.296 INFO:tasks.workunit.client.1.smithi150.stdout:0/835: dwrite d5/d11/d71/d99/d9c/fcf [0,4194304] 0 2023-12-05T09:57:42.297 INFO:tasks.workunit.client.1.smithi150.stdout:0/836: chown d5/d11/d32/c45 1821985982 1 2023-12-05T09:57:42.297 INFO:tasks.workunit.client.1.smithi150.stdout:0/837: write d5/d11/d71/d99/d9c/d46/d80/f11a [403265,76606] 0 2023-12-05T09:57:42.297 INFO:tasks.workunit.client.1.smithi150.stdout:7/800: symlink d2/d1b/l10f 0 2023-12-05T09:57:42.297 INFO:tasks.workunit.client.1.smithi150.stdout:7/801: chown d2/db/f45 122950 1 2023-12-05T09:57:42.297 INFO:tasks.workunit.client.0.smithi100.stdout:1/740: getdents db/d31/d3a/d4a/dad/d67 0 2023-12-05T09:57:42.299 INFO:tasks.workunit.client.0.smithi100.stdout:5/790: dwrite d0/d16/d2b/f3a [0,4194304] 0 2023-12-05T09:57:42.299 INFO:tasks.workunit.client.0.smithi100.stdout:5/791: chown d0/d4/d14/f8f 438720848 1 2023-12-05T09:57:42.301 INFO:tasks.workunit.client.1.smithi150.stdout:4/719: sync 2023-12-05T09:57:42.302 INFO:tasks.workunit.client.1.smithi150.stdout:3/822: creat d6/d25/dd7/f108 x:0 0 0 2023-12-05T09:57:42.304 INFO:tasks.workunit.client.0.smithi100.stdout:3/849: rename d0/d2/d62/fdd to d0/d2/de/f124 0 2023-12-05T09:57:42.304 INFO:tasks.workunit.client.0.smithi100.stdout:3/850: readlink d0/d3d/dfc/d10d/l7e 0 2023-12-05T09:57:42.305 INFO:tasks.workunit.client.1.smithi150.stdout:2/830: getdents d0/d3/d27/dac/dd0 0 2023-12-05T09:57:42.305 INFO:tasks.workunit.client.1.smithi150.stdout:1/812: sync 2023-12-05T09:57:42.305 INFO:tasks.workunit.client.1.smithi150.stdout:1/813: chown d6/d47/dcf/ff3 14085214 1 2023-12-05T09:57:42.305 INFO:tasks.workunit.client.1.smithi150.stdout:1/814: readlink d6/l45 0 2023-12-05T09:57:42.306 INFO:tasks.workunit.client.0.smithi100.stdout:2/867: getdents d7/da/da7/dd2 0 2023-12-05T09:57:42.306 INFO:tasks.workunit.client.0.smithi100.stdout:2/868: chown d7/da/f9c 1320216 1 2023-12-05T09:57:42.306 INFO:tasks.workunit.client.0.smithi100.stdout:2/869: write d7/da/d1a/fdb [120879,71527] 0 2023-12-05T09:57:42.309 INFO:tasks.workunit.client.1.smithi150.stdout:6/705: mkdir d2/d23/d3b/ded 0 2023-12-05T09:57:42.310 INFO:tasks.workunit.client.1.smithi150.stdout:4/720: dread d0/d3e/d5b/d80/d44/f7f [0,4194304] 0 2023-12-05T09:57:42.311 INFO:tasks.workunit.client.0.smithi100.stdout:7/732: creat d3/dc/d11/d13/de/d18/d3b/d40/d4c/d7f/f111 x:0 0 0 2023-12-05T09:57:42.311 INFO:tasks.workunit.client.0.smithi100.stdout:7/733: fsync d3/dc/d11/d13/da8/fe3 0 2023-12-05T09:57:42.311 INFO:tasks.workunit.client.0.smithi100.stdout:7/734: write d3/dc/d11/d33/f62 [3705394,80057] 0 2023-12-05T09:57:42.312 INFO:tasks.workunit.client.1.smithi150.stdout:8/828: symlink d0/da1/dfb/lfd 0 2023-12-05T09:57:42.312 INFO:tasks.workunit.client.0.smithi100.stdout:0/711: sync 2023-12-05T09:57:42.313 INFO:tasks.workunit.client.0.smithi100.stdout:4/715: creat de/d16/d23/d33/d3d/d44/d4e/fe7 x:0 0 0 2023-12-05T09:57:42.315 INFO:tasks.workunit.client.1.smithi150.stdout:7/802: link d2/d1b/ff7 d2/db/d30/daf/f110 0 2023-12-05T09:57:42.318 INFO:tasks.workunit.client.0.smithi100.stdout:1/741: creat db/d12/d1e/d26/d30/d52/dd0/ff0 x:0 0 0 2023-12-05T09:57:42.323 INFO:tasks.workunit.client.1.smithi150.stdout:2/831: creat d0/d3/d21/d4d/deb/d103/d15/d30/d54/d57/dee/f121 x:0 0 0 2023-12-05T09:57:42.325 INFO:tasks.workunit.client.0.smithi100.stdout:3/851: unlink d0/d2/f75 0 2023-12-05T09:57:42.325 INFO:tasks.workunit.client.0.smithi100.stdout:3/852: chown d0/d2/de/d11/d7c/dd0 14 1 2023-12-05T09:57:42.325 INFO:tasks.workunit.client.0.smithi100.stdout:3/853: truncate d0/d3d/d5c/d6f/f8c 1299889 0 2023-12-05T09:57:42.326 INFO:tasks.workunit.client.0.smithi100.stdout:3/854: write d0/d2/de/d11/fad [5108997,105677] 0 2023-12-05T09:57:42.326 INFO:tasks.workunit.client.1.smithi150.stdout:4/721: mkdir d0/d3e/d48/ddd 0 2023-12-05T09:57:42.327 INFO:tasks.workunit.client.1.smithi150.stdout:8/829: mknod d0/d41/d49/dd3/cfe 0 2023-12-05T09:57:42.328 INFO:tasks.workunit.client.1.smithi150.stdout:3/823: dread d6/d9/d43/d47/d8c/fc9 [0,4194304] 0 2023-12-05T09:57:42.329 INFO:tasks.workunit.client.1.smithi150.stdout:3/824: write d6/d9/d3d/d56/d71/ff7 [598805,124433] 0 2023-12-05T09:57:42.330 INFO:tasks.workunit.client.0.smithi100.stdout:2/870: getdents d7/da 0 2023-12-05T09:57:42.330 INFO:tasks.workunit.client.0.smithi100.stdout:7/735: dread d3/dc/d11/d13/d1b/d60/f75 [0,4194304] 0 2023-12-05T09:57:42.332 INFO:tasks.workunit.client.1.smithi150.stdout:4/722: truncate d0/d3e/d48/f4e 2662670 0 2023-12-05T09:57:42.333 INFO:tasks.workunit.client.0.smithi100.stdout:0/712: creat da/d22/d33/d35/d3a/fd2 x:0 0 0 2023-12-05T09:57:42.333 INFO:tasks.workunit.client.0.smithi100.stdout:0/713: chown da/d1b/d73 576770 1 2023-12-05T09:57:42.336 INFO:tasks.workunit.client.0.smithi100.stdout:8/713: getdents d0/d35/d64/d81 0 2023-12-05T09:57:42.340 INFO:tasks.workunit.client.0.smithi100.stdout:5/792: rename d0/d1f/c88 to d0/d1b/d4d/d8e/d96/dc1/dae/db9/ddc/c118 0 2023-12-05T09:57:42.341 INFO:tasks.workunit.client.1.smithi150.stdout:5/795: dwrite d1/d7f/d65/f57 [0,4194304] 0 2023-12-05T09:57:42.341 INFO:tasks.workunit.client.1.smithi150.stdout:5/796: fdatasync d1/d2e/ff7 0 2023-12-05T09:57:42.341 INFO:tasks.workunit.client.1.smithi150.stdout:5/797: write d1/d2e/da6/f106 [946914,116637] 0 2023-12-05T09:57:42.341 INFO:tasks.workunit.client.1.smithi150.stdout:5/798: chown d1/d64/d31/fb6 0 1 2023-12-05T09:57:42.345 INFO:tasks.workunit.client.1.smithi150.stdout:8/830: rename d0/d41/d49/d1b/d24/d38/d84 to d0/d41/d49/d1b/d24/d34/da2/dff 0 2023-12-05T09:57:42.345 INFO:tasks.workunit.client.1.smithi150.stdout:8/831: dread - d0/d41/d49/d1b/d24/d38/d62/fc1 zero size 2023-12-05T09:57:42.347 INFO:tasks.workunit.client.0.smithi100.stdout:1/742: write db/d31/d3a/d4a/dad/f89 [3291540,114015] 0 2023-12-05T09:57:42.348 INFO:tasks.workunit.client.0.smithi100.stdout:7/736: truncate d3/dc/d11/d33/f79 164537 0 2023-12-05T09:57:42.352 INFO:tasks.workunit.client.0.smithi100.stdout:4/716: mkdir de/de8 0 2023-12-05T09:57:42.352 INFO:tasks.workunit.client.0.smithi100.stdout:4/717: chown de/d16/d23/d36/f3a 916 1 2023-12-05T09:57:42.353 INFO:tasks.workunit.client.1.smithi150.stdout:8/832: creat d0/d41/d49/d1b/d24/d5b/ddc/f100 x:0 0 0 2023-12-05T09:57:42.353 INFO:tasks.workunit.client.1.smithi150.stdout:8/833: fdatasync d0/d41/d49/d1b/f1d 0 2023-12-05T09:57:42.356 INFO:tasks.workunit.client.1.smithi150.stdout:4/723: write d0/d3e/d5b/d80/d44/f60 [128723,22990] 0 2023-12-05T09:57:42.357 INFO:tasks.workunit.client.1.smithi150.stdout:4/724: write d0/d3e/d5b/d80/d44/da2/dbd/fda [2657505,127250] 0 2023-12-05T09:57:42.360 INFO:tasks.workunit.client.0.smithi100.stdout:5/793: truncate d0/d1f/d25/f50 567028 0 2023-12-05T09:57:42.360 INFO:tasks.workunit.client.0.smithi100.stdout:1/743: dread db/d12/f14 [0,4194304] 0 2023-12-05T09:57:42.360 INFO:tasks.workunit.client.0.smithi100.stdout:1/744: fsync db/d12/fea 0 2023-12-05T09:57:42.360 INFO:tasks.workunit.client.1.smithi150.stdout:3/825: dread d6/d9/d8d/de6/fbc [0,4194304] 0 2023-12-05T09:57:42.362 INFO:tasks.workunit.client.1.smithi150.stdout:4/725: mknod d0/d3e/d48/dbb/dca/cde 0 2023-12-05T09:57:42.363 INFO:tasks.workunit.client.0.smithi100.stdout:7/737: link d3/dc/d11/d13/de/d2d/d42/fe9 d3/dc/d11/d13/de/d18/d3b/d40/f112 0 2023-12-05T09:57:42.363 INFO:tasks.workunit.client.0.smithi100.stdout:4/718: symlink de/d16/d23/d60/d88/le9 0 2023-12-05T09:57:42.364 INFO:tasks.workunit.client.0.smithi100.stdout:4/719: write de/d16/d23/f2c [4677543,60932] 0 2023-12-05T09:57:42.364 INFO:tasks.workunit.client.0.smithi100.stdout:4/720: write de/d16/d1e/f2e [1860859,304] 0 2023-12-05T09:57:42.364 INFO:tasks.workunit.client.0.smithi100.stdout:4/721: creat de/d16/d1e/fea x:0 0 0 2023-12-05T09:57:42.368 INFO:tasks.workunit.client.0.smithi100.stdout:8/714: rmdir d0/d12 39 2023-12-05T09:57:42.374 INFO:tasks.workunit.client.1.smithi150.stdout:3/826: dread d6/d25/fca [0,4194304] 0 2023-12-05T09:57:42.374 INFO:tasks.workunit.client.0.smithi100.stdout:1/745: readlink db/le 0 2023-12-05T09:57:42.374 INFO:tasks.workunit.client.0.smithi100.stdout:1/746: stat db/d12/d1e/dd3/db8/de7 0 2023-12-05T09:57:42.374 INFO:tasks.workunit.client.0.smithi100.stdout:1/747: truncate db/d12/d1e/d26/d30/d6e/fcc 665184 0 2023-12-05T09:57:42.375 INFO:tasks.workunit.client.0.smithi100.stdout:2/871: link d7/da/da7/dd6/cf4 d7/da/d18/d1b/d2c/d3f/d72/d9d/c124 0 2023-12-05T09:57:42.375 INFO:tasks.workunit.client.0.smithi100.stdout:2/872: write d7/da/d1a/f1c [2700479,18772] 0 2023-12-05T09:57:42.378 INFO:tasks.workunit.client.1.smithi150.stdout:4/726: rename d0/d3e/d5b/d80/d44/da2 to d0/d3e/d6d/ddf 0 2023-12-05T09:57:42.378 INFO:tasks.workunit.client.1.smithi150.stdout:4/727: write d0/d3e/d6d/fc3 [1013229,42097] 0 2023-12-05T09:57:42.384 INFO:tasks.workunit.client.1.smithi150.stdout:3/827: rename d6/d9/d8d/de6 to d6/d9/d3d/d52/d109 0 2023-12-05T09:57:42.384 INFO:tasks.workunit.client.1.smithi150.stdout:3/828: write d6/d9/d3d/d56/d53/f69 [189475,73072] 0 2023-12-05T09:57:42.385 INFO:tasks.workunit.client.0.smithi100.stdout:4/722: rename de/d16/d23/d33/d3d/d44/d4e/d80/de2 to de/d16/d23/d60/de3/deb 0 2023-12-05T09:57:42.385 INFO:tasks.workunit.client.0.smithi100.stdout:8/715: creat d0/d12/d13/d45/da6/d9c/fca x:0 0 0 2023-12-05T09:57:42.385 INFO:tasks.workunit.client.0.smithi100.stdout:1/748: truncate db/d31/d3a/f9a 579772 0 2023-12-05T09:57:42.386 INFO:tasks.workunit.client.1.smithi150.stdout:8/834: dread d0/d41/d49/dd3/ff5 [0,4194304] 0 2023-12-05T09:57:42.386 INFO:tasks.workunit.client.1.smithi150.stdout:8/835: chown d0/d8/fa9 27 1 2023-12-05T09:57:42.386 INFO:tasks.workunit.client.1.smithi150.stdout:4/728: creat d0/d3e/d5b/d80/d44/fe0 x:0 0 0 2023-12-05T09:57:42.388 INFO:tasks.workunit.client.1.smithi150.stdout:3/829: creat d6/d9/d43/d47/d94/f10a x:0 0 0 2023-12-05T09:57:42.389 INFO:tasks.workunit.client.1.smithi150.stdout:8/836: stat d0/d41/d49/d1b/cc0 0 2023-12-05T09:57:42.392 INFO:tasks.workunit.client.1.smithi150.stdout:4/729: symlink d0/d3e/d6d/ddf/le1 0 2023-12-05T09:57:42.392 INFO:tasks.workunit.client.0.smithi100.stdout:0/714: dwrite da/d2a/f62 [0,4194304] 0 2023-12-05T09:57:42.392 INFO:tasks.workunit.client.0.smithi100.stdout:0/715: chown da/d1b/dbe 63 1 2023-12-05T09:57:42.394 INFO:tasks.workunit.client.1.smithi150.stdout:0/838: dwrite d5/d11/d71/d5f/f70 [0,4194304] 0 2023-12-05T09:57:42.396 INFO:tasks.workunit.client.0.smithi100.stdout:8/716: mknod d0/d12/d13/d45/dba/dbd/d82/ccb 0 2023-12-05T09:57:42.396 INFO:tasks.workunit.client.0.smithi100.stdout:1/749: unlink db/d31/d3a/d3b/lec 0 2023-12-05T09:57:42.397 INFO:tasks.workunit.client.0.smithi100.stdout:1/750: read db/d31/d3a/d3b/f4b [151646,7196] 0 2023-12-05T09:57:42.397 INFO:tasks.workunit.client.0.smithi100.stdout:1/751: chown db/d12/d1e/d26/d30/d6e/c74 287647289 1 2023-12-05T09:57:42.400 INFO:tasks.workunit.client.0.smithi100.stdout:1/752: chown db/d12/d1e/d26/d30/d52/d84/faf 102920 1 2023-12-05T09:57:42.400 INFO:tasks.workunit.client.0.smithi100.stdout:2/873: symlink d7/db4/l125 0 2023-12-05T09:57:42.400 INFO:tasks.workunit.client.0.smithi100.stdout:2/874: chown d7/da/d18/d21/l54 17 1 2023-12-05T09:57:42.400 INFO:tasks.workunit.client.0.smithi100.stdout:3/855: dwrite d0/d10/d39/f51 [0,4194304] 0 2023-12-05T09:57:42.400 INFO:tasks.workunit.client.1.smithi150.stdout:3/830: truncate d6/d9/d8d/f68 4874289 0 2023-12-05T09:57:42.401 INFO:tasks.workunit.client.1.smithi150.stdout:8/837: mkdir d0/d41/d49/d1b/d24/d38/d101 0 2023-12-05T09:57:42.401 INFO:tasks.workunit.client.1.smithi150.stdout:2/832: dwrite d0/d3/d27/dac/d81/f10a [0,4194304] 0 2023-12-05T09:57:42.401 INFO:tasks.workunit.client.1.smithi150.stdout:6/706: dwrite d2/d23/d2e/f94 [0,4194304] 0 2023-12-05T09:57:42.403 INFO:tasks.workunit.client.0.smithi100.stdout:0/716: mknod da/d22/d33/d7f/d87/cd3 0 2023-12-05T09:57:42.403 INFO:tasks.workunit.client.0.smithi100.stdout:0/717: chown da/d22/d33/d74/dca 1169565 1 2023-12-05T09:57:42.404 INFO:tasks.workunit.client.1.smithi150.stdout:8/838: creat d0/d41/d49/d1b/d24/d38/d101/f102 x:0 0 0 2023-12-05T09:57:42.404 INFO:tasks.workunit.client.1.smithi150.stdout:8/839: chown d0/d41/d49/d1b/d24/d34/da2/lba 138917387 1 2023-12-05T09:57:42.404 INFO:tasks.workunit.client.0.smithi100.stdout:2/875: chown d7/db4/cbf 168158 1 2023-12-05T09:57:42.413 INFO:tasks.workunit.client.1.smithi150.stdout:0/839: dread d5/d11/d71/f30 [0,4194304] 0 2023-12-05T09:57:42.418 INFO:tasks.workunit.client.0.smithi100.stdout:8/717: read d0/d12/d13/d16/f2e [2239803,90015] 0 2023-12-05T09:57:42.419 INFO:tasks.workunit.client.0.smithi100.stdout:2/876: link d7/da/d13/d69/fde d7/da/d18/d1b/d2c/d3f/dc5/f126 0 2023-12-05T09:57:42.423 INFO:tasks.workunit.client.0.smithi100.stdout:5/794: dwrite d0/d1f/d53/f9d [4194304,4194304] 0 2023-12-05T09:57:42.423 INFO:tasks.workunit.client.0.smithi100.stdout:5/795: fsync d0/d4/d14/d35/d62/fd4 0 2023-12-05T09:57:42.423 INFO:tasks.workunit.client.0.smithi100.stdout:7/738: dwrite d3/dc/d11/d13/de/f87 [0,4194304] 0 2023-12-05T09:57:42.423 INFO:tasks.workunit.client.0.smithi100.stdout:5/796: write d0/d16/f1e [1058466,10129] 0 2023-12-05T09:57:42.423 INFO:tasks.workunit.client.0.smithi100.stdout:5/797: chown d0/d1b/d4d/d8e/d96/fc7 16644947 1 2023-12-05T09:57:42.424 INFO:tasks.workunit.client.0.smithi100.stdout:3/856: rename d0/d4/d3a to d0/d2/de/d11/d7c/dd0/d125 0 2023-12-05T09:57:42.432 INFO:tasks.workunit.client.1.smithi150.stdout:2/833: rmdir d0/d3/d21/d4d/deb/d103/d15 39 2023-12-05T09:57:42.432 INFO:tasks.workunit.client.1.smithi150.stdout:3/831: dread d6/d9/d3d/d56/d71/db0/f101 [0,4194304] 0 2023-12-05T09:57:42.432 INFO:tasks.workunit.client.1.smithi150.stdout:2/834: write d0/d3/d21/d4d/deb/f9a [442266,41710] 0 2023-12-05T09:57:42.432 INFO:tasks.workunit.client.1.smithi150.stdout:2/835: write d0/d3/d21/d4d/deb/d103/d15/d30/d54/d57/dee/f121 [224928,69478] 0 2023-12-05T09:57:42.432 INFO:tasks.workunit.client.1.smithi150.stdout:2/836: truncate d0/d3/f99 3136992 0 2023-12-05T09:57:42.437 INFO:tasks.workunit.client.1.smithi150.stdout:6/707: symlink d2/d23/d3b/d64/d7a/d8c/lee 0 2023-12-05T09:57:42.437 INFO:tasks.workunit.client.1.smithi150.stdout:1/815: dwrite d6/d38/d4a/f8e [4194304,4194304] 0 2023-12-05T09:57:42.447 INFO:tasks.workunit.client.0.smithi100.stdout:1/753: write db/f35 [2705921,127558] 0 2023-12-05T09:57:42.447 INFO:tasks.workunit.client.0.smithi100.stdout:1/754: truncate db/d12/d1e/fa0 470591 0 2023-12-05T09:57:42.447 INFO:tasks.workunit.client.0.smithi100.stdout:4/723: dwrite de/d16/d1e/f2e [4194304,4194304] 0 2023-12-05T09:57:42.457 INFO:tasks.workunit.client.1.smithi150.stdout:6/708: write d2/f13 [3743214,107233] 0 2023-12-05T09:57:42.466 INFO:tasks.workunit.client.0.smithi100.stdout:7/739: creat d3/dc/d11/d13/da8/f113 x:0 0 0 2023-12-05T09:57:42.470 INFO:tasks.workunit.client.1.smithi150.stdout:4/730: dwrite d0/d3e/d48/fbc [0,4194304] 0 2023-12-05T09:57:42.471 INFO:tasks.workunit.client.0.smithi100.stdout:0/718: rename da/d2a/lb7 to da/d1b/d73/db3/ld4 0 2023-12-05T09:57:42.471 INFO:tasks.workunit.client.0.smithi100.stdout:0/719: truncate da/d2a/d45/f49 4228430 0 2023-12-05T09:57:42.479 INFO:tasks.workunit.client.0.smithi100.stdout:1/755: truncate db/d12/fae 56409 0 2023-12-05T09:57:42.487 INFO:tasks.workunit.client.0.smithi100.stdout:5/798: rename d0/d4/fbc to d0/d1f/d25/d31/f119 0 2023-12-05T09:57:42.488 INFO:tasks.workunit.client.0.smithi100.stdout:0/720: dread da/f30 [0,4194304] 0 2023-12-05T09:57:42.488 INFO:tasks.workunit.client.1.smithi150.stdout:8/840: symlink d0/l103 0 2023-12-05T09:57:42.490 INFO:tasks.workunit.client.0.smithi100.stdout:1/756: symlink db/d31/d3a/lf1 0 2023-12-05T09:57:42.491 INFO:tasks.workunit.client.1.smithi150.stdout:0/840: getdents d5/dbd 0 2023-12-05T09:57:42.494 INFO:tasks.workunit.client.0.smithi100.stdout:4/724: rename de/d16/d23/d33/l93 to de/d16/d23/d33/d3d/d44/d4e/d80/lec 0 2023-12-05T09:57:42.495 INFO:tasks.workunit.client.0.smithi100.stdout:4/725: truncate de/d66/fa7 764113 0 2023-12-05T09:57:42.495 INFO:tasks.workunit.client.0.smithi100.stdout:4/726: dread - de/d38/fb9 zero size 2023-12-05T09:57:42.495 INFO:tasks.workunit.client.0.smithi100.stdout:5/799: rmdir d0/d16/d2b/d48 39 2023-12-05T09:57:42.497 INFO:tasks.workunit.client.0.smithi100.stdout:5/800: chown d0/d16/d2b/d48/df/l101 26986 1 2023-12-05T09:57:42.500 INFO:tasks.workunit.client.0.smithi100.stdout:1/757: rename db/d12/d1e/dd3/db8/de6/cef to db/d12/cf2 0 2023-12-05T09:57:42.502 INFO:tasks.workunit.client.1.smithi150.stdout:4/731: mknod d0/d3e/d5b/d6e/ce2 0 2023-12-05T09:57:42.505 INFO:tasks.workunit.client.0.smithi100.stdout:3/857: dwrite d0/d10/d39/fa8 [0,4194304] 0 2023-12-05T09:57:42.506 INFO:tasks.workunit.client.1.smithi150.stdout:8/841: getdents d0/d41/d49/d1b/d24 0 2023-12-05T09:57:42.511 INFO:tasks.workunit.client.1.smithi150.stdout:4/732: symlink d0/d3e/d48/le3 0 2023-12-05T09:57:42.514 INFO:tasks.workunit.client.0.smithi100.stdout:0/721: write da/d1b/d6b/d78/f88 [882628,25561] 0 2023-12-05T09:57:42.514 INFO:tasks.workunit.client.0.smithi100.stdout:0/722: write da/d22/f3b [3396176,89148] 0 2023-12-05T09:57:42.514 INFO:tasks.workunit.client.1.smithi150.stdout:8/842: mknod d0/d41/d49/d1b/d24/d2e/d4d/d83/c104 0 2023-12-05T09:57:42.515 INFO:tasks.workunit.client.1.smithi150.stdout:8/843: truncate d0/d41/d49/dd3/fd6 705064 0 2023-12-05T09:57:42.515 INFO:tasks.workunit.client.0.smithi100.stdout:2/877: dwrite d7/da/d1a/f73 [0,4194304] 0 2023-12-05T09:57:42.516 INFO:tasks.workunit.client.1.smithi150.stdout:3/832: dwrite d6/f6c [0,4194304] 0 2023-12-05T09:57:42.516 INFO:tasks.workunit.client.1.smithi150.stdout:0/841: dread d5/d11/d71/d99/d9c/d3b/de0/f102 [0,4194304] 0 2023-12-05T09:57:42.516 INFO:tasks.workunit.client.1.smithi150.stdout:0/842: write d5/d11/d71/d99/d9c/d96/dd5/d67/fea [1022728,94464] 0 2023-12-05T09:57:42.516 INFO:tasks.workunit.client.1.smithi150.stdout:0/843: readlink d5/d11/d71/d99/d9c/d46/l4c 0 2023-12-05T09:57:42.518 INFO:tasks.workunit.client.1.smithi150.stdout:4/733: unlink d0/d3e/d5b/d80/da1/fbf 0 2023-12-05T09:57:42.522 INFO:tasks.workunit.client.1.smithi150.stdout:8/844: mkdir d0/d41/d49/d1b/d24/d2e/d105 0 2023-12-05T09:57:42.522 INFO:tasks.workunit.client.1.smithi150.stdout:8/845: fsync d0/d41/d49/fcb 0 2023-12-05T09:57:42.523 INFO:tasks.workunit.client.1.smithi150.stdout:8/846: write d0/d41/d49/d1b/d24/d2e/f6e [64465,69173] 0 2023-12-05T09:57:42.524 INFO:tasks.workunit.client.1.smithi150.stdout:3/833: mkdir d6/d9/d43/d47/d94/df1/d10b 0 2023-12-05T09:57:42.525 INFO:tasks.workunit.client.1.smithi150.stdout:1/816: dwrite d6/d47/d4c/d60/f69 [0,4194304] 0 2023-12-05T09:57:42.525 INFO:tasks.workunit.client.1.smithi150.stdout:1/817: stat d6/d8/d54/dea 0 2023-12-05T09:57:42.525 INFO:tasks.workunit.client.1.smithi150.stdout:1/818: write d6/d8/d59/fc0 [1961369,31267] 0 2023-12-05T09:57:42.526 INFO:tasks.workunit.client.0.smithi100.stdout:7/740: dwrite d3/dc/d11/d13/de/d18/d3b/d40/d46/f5c [4194304,4194304] 0 2023-12-05T09:57:42.526 INFO:tasks.workunit.client.0.smithi100.stdout:7/741: fsync d3/dc/d11/d33/f10d 0 2023-12-05T09:57:42.526 INFO:tasks.workunit.client.1.smithi150.stdout:0/844: creat d5/d11/d71/d99/d9c/d96/dd5/d7f/db4/dfb/f121 x:0 0 0 2023-12-05T09:57:42.529 INFO:tasks.workunit.client.1.smithi150.stdout:4/734: rename d0/d3e/d6d/ddf/dbd to d0/d3e/d5b/de4 0 2023-12-05T09:57:42.531 INFO:tasks.workunit.client.0.smithi100.stdout:5/801: dread d0/d1f/f2e [0,4194304] 0 2023-12-05T09:57:42.534 INFO:tasks.workunit.client.1.smithi150.stdout:9/716: sync 2023-12-05T09:57:42.534 INFO:tasks.workunit.client.1.smithi150.stdout:9/717: stat d3/d9/d26 0 2023-12-05T09:57:42.535 INFO:tasks.workunit.client.0.smithi100.stdout:0/723: mknod da/d1b/d73/d82/cd5 0 2023-12-05T09:57:42.537 INFO:tasks.workunit.client.1.smithi150.stdout:0/845: dread d5/d11/d71/f56 [0,4194304] 0 2023-12-05T09:57:42.537 INFO:tasks.workunit.client.0.smithi100.stdout:1/758: rename db/d12/d1e/de0/cc0 to db/d31/d3a/cf3 0 2023-12-05T09:57:42.537 INFO:tasks.workunit.client.0.smithi100.stdout:1/759: getdents db/d31/d3a/d4a/dad 0 2023-12-05T09:57:42.537 INFO:tasks.workunit.client.0.smithi100.stdout:1/760: fdatasync db/d12/d1e/d26/d30/f8e 0 2023-12-05T09:57:42.537 INFO:tasks.workunit.client.0.smithi100.stdout:1/761: write db/d12/d1e/d26/d30/d52/d84/fce [367470,2670] 0 2023-12-05T09:57:42.543 INFO:tasks.workunit.client.1.smithi150.stdout:7/803: sync 2023-12-05T09:57:42.543 INFO:tasks.workunit.client.1.smithi150.stdout:7/804: read d2/db/d17/d38/dc8/fa3 [371372,72632] 0 2023-12-05T09:57:42.543 INFO:tasks.workunit.client.1.smithi150.stdout:7/805: chown d2/db/d30/d13/d4f/fd7 9 1 2023-12-05T09:57:42.546 INFO:tasks.workunit.client.0.smithi100.stdout:0/724: dread da/d22/d33/fa9 [0,4194304] 0 2023-12-05T09:57:42.547 INFO:tasks.workunit.client.0.smithi100.stdout:4/727: rmdir de/d16/d23/d33 39 2023-12-05T09:57:42.547 INFO:tasks.workunit.client.0.smithi100.stdout:4/728: dread - de/d16/d23/d60/d98/fa8 zero size 2023-12-05T09:57:42.547 INFO:tasks.workunit.client.0.smithi100.stdout:4/729: stat de/d16/dc8 0 2023-12-05T09:57:42.548 INFO:tasks.workunit.client.1.smithi150.stdout:8/847: rename d0/d41/d49/d1b/d24/d5b/ddc/lee to d0/d41/d49/dda/l106 0 2023-12-05T09:57:42.551 INFO:tasks.workunit.client.1.smithi150.stdout:4/735: mknod d0/d3e/d6d/ddf/da4/dd7/ce5 0 2023-12-05T09:57:42.551 INFO:tasks.workunit.client.1.smithi150.stdout:9/718: truncate d3/d1b/d46/d55/d64/fa6 732536 0 2023-12-05T09:57:42.551 INFO:tasks.workunit.client.1.smithi150.stdout:9/719: stat d3/d9/dc/d1f/d24/d75/d95/dd0 0 2023-12-05T09:57:42.556 INFO:tasks.workunit.client.1.smithi150.stdout:0/846: mkdir d5/d11/d71/d99/d9c/d96/dd5/d67/da8/df1/d110/d122 0 2023-12-05T09:57:42.556 INFO:tasks.workunit.client.1.smithi150.stdout:0/847: readlink d5/d11/d71/d5f/le9 0 2023-12-05T09:57:42.561 INFO:tasks.workunit.client.1.smithi150.stdout:7/806: rename d2/db/d30/d47/lc6 to d2/db/d30/d13/d4f/l111 0 2023-12-05T09:57:42.562 INFO:tasks.workunit.client.1.smithi150.stdout:7/807: chown d2/d72/d82/fb7 314460 1 2023-12-05T09:57:42.562 INFO:tasks.workunit.client.1.smithi150.stdout:7/808: chown d2/db/d30/d18/d63 2 1 2023-12-05T09:57:42.562 INFO:tasks.workunit.client.1.smithi150.stdout:4/736: read d0/d3e/d6d/ddf/da4/dd7/f67 [313615,107827] 0 2023-12-05T09:57:42.564 INFO:tasks.workunit.client.1.smithi150.stdout:9/720: mknod d3/d1b/d46/d55/ceb 0 2023-12-05T09:57:42.564 INFO:tasks.workunit.client.1.smithi150.stdout:9/721: dread - d3/d9/dc/fce zero size 2023-12-05T09:57:42.564 INFO:tasks.workunit.client.1.smithi150.stdout:9/722: chown d3/d9/dc/d1f/f5f 60516373 1 2023-12-05T09:57:42.565 INFO:tasks.workunit.client.0.smithi100.stdout:5/802: dread d0/d27/fbb [4194304,4194304] 0 2023-12-05T09:57:42.568 INFO:tasks.workunit.client.1.smithi150.stdout:7/809: read d2/d39/f60 [5552641,26320] 0 2023-12-05T09:57:42.568 INFO:tasks.workunit.client.1.smithi150.stdout:7/810: chown d2 178261 1 2023-12-05T09:57:42.570 INFO:tasks.workunit.client.1.smithi150.stdout:0/848: truncate d5/f23 3613716 0 2023-12-05T09:57:42.570 INFO:tasks.workunit.client.1.smithi150.stdout:0/849: fsync d5/d11/d16/fd9 0 2023-12-05T09:57:42.572 INFO:tasks.workunit.client.1.smithi150.stdout:4/737: dread d0/d3e/d5b/fc6 [0,4194304] 0 2023-12-05T09:57:42.574 INFO:tasks.workunit.client.1.smithi150.stdout:7/811: truncate d2/db/d30/d13/d4f/f59 3295541 0 2023-12-05T09:57:42.574 INFO:tasks.workunit.client.1.smithi150.stdout:7/812: read - d2/fee zero size 2023-12-05T09:57:42.574 INFO:tasks.workunit.client.1.smithi150.stdout:8/848: dread d0/d41/d49/d1b/fa4 [0,4194304] 0 2023-12-05T09:57:42.579 INFO:tasks.workunit.client.0.smithi100.stdout:8/718: dwrite d0/d12/d13/d16/d42/fac [0,4194304] 0 2023-12-05T09:57:42.584 INFO:tasks.workunit.client.1.smithi150.stdout:7/813: symlink d2/db/d2e/l112 0 2023-12-05T09:57:42.584 INFO:tasks.workunit.client.1.smithi150.stdout:7/814: write d2/db/d17/d88/fd6 [1453387,6121] 0 2023-12-05T09:57:42.585 INFO:tasks.workunit.client.1.smithi150.stdout:8/849: mknod d0/d41/d49/d1b/d24/d34/dbc/c107 0 2023-12-05T09:57:42.590 INFO:tasks.workunit.client.1.smithi150.stdout:0/850: getdents d5/d11/d71/d99/d9c/d46/d80 0 2023-12-05T09:57:42.590 INFO:tasks.workunit.client.1.smithi150.stdout:0/851: read d5/d11/d71/d99/d9c/d3b/f55 [132708,53483] 0 2023-12-05T09:57:42.590 INFO:tasks.workunit.client.1.smithi150.stdout:5/799: sync 2023-12-05T09:57:42.593 INFO:tasks.workunit.client.1.smithi150.stdout:7/815: symlink d2/db/d17/d3a/l113 0 2023-12-05T09:57:42.593 INFO:tasks.workunit.client.1.smithi150.stdout:7/816: read - d2/db/d30/d13/d4f/fd7 zero size 2023-12-05T09:57:42.595 INFO:tasks.workunit.client.0.smithi100.stdout:8/719: dread d0/f9 [0,4194304] 0 2023-12-05T09:57:42.597 INFO:tasks.workunit.client.0.smithi100.stdout:2/878: creat d7/da/d18/d21/dae/f127 x:0 0 0 2023-12-05T09:57:42.597 INFO:tasks.workunit.client.0.smithi100.stdout:2/879: write d7/f43 [1248881,51250] 0 2023-12-05T09:57:42.597 INFO:tasks.workunit.client.0.smithi100.stdout:2/880: readlink d7/da/da7/dd2/l11a 0 2023-12-05T09:57:42.597 INFO:tasks.workunit.client.0.smithi100.stdout:2/881: fsync d7/da/d65/f77 0 2023-12-05T09:57:42.597 INFO:tasks.workunit.client.0.smithi100.stdout:2/882: creat d7/da/d18/d1b/d2c/d3f/d46/dc8/dfe/f128 x:0 0 0 2023-12-05T09:57:42.598 INFO:tasks.workunit.client.1.smithi150.stdout:3/834: dwrite d6/d25/dd7/f108 [0,4194304] 0 2023-12-05T09:57:42.598 INFO:tasks.workunit.client.1.smithi150.stdout:3/835: stat d6/d9/d8d 0 2023-12-05T09:57:42.598 INFO:tasks.workunit.client.1.smithi150.stdout:3/836: readlink d6/d9/d3d/d87/la6 0 2023-12-05T09:57:42.598 INFO:tasks.workunit.client.1.smithi150.stdout:3/837: creat d6/d9/d3d/d56/d53/d51/f10c x:0 0 0 2023-12-05T09:57:42.599 INFO:tasks.workunit.client.0.smithi100.stdout:2/883: creat d7/da/d18/d21/d86/f129 x:0 0 0 2023-12-05T09:57:42.599 INFO:tasks.workunit.client.0.smithi100.stdout:2/884: write d7/da/d18/f62 [8988287,122344] 0 2023-12-05T09:57:42.602 INFO:tasks.workunit.client.1.smithi150.stdout:8/850: creat d0/d41/d49/d1b/d24/d34/dd0/ddf/f108 x:0 0 0 2023-12-05T09:57:42.605 INFO:tasks.workunit.client.1.smithi150.stdout:0/852: write d5/d11/d32/d57/f9d [561283,28709] 0 2023-12-05T09:57:42.611 INFO:tasks.workunit.client.0.smithi100.stdout:7/742: mknod d3/dc/d11/d13/de/d18/d3b/de2/c114 0 2023-12-05T09:57:42.623 INFO:tasks.workunit.client.1.smithi150.stdout:5/800: unlink d1/d7f/d65/de3/d10a/lfa 0 2023-12-05T09:57:42.623 INFO:tasks.workunit.client.1.smithi150.stdout:5/801: read - d1/d3/d6/d26/fd7 zero size 2023-12-05T09:57:42.629 INFO:tasks.workunit.client.0.smithi100.stdout:3/858: rename d0/d4/cb1 to d0/d3d/d5c/d5f/d73/c126 0 2023-12-05T09:57:42.633 INFO:tasks.workunit.client.0.smithi100.stdout:1/762: dwrite f9 [0,4194304] 0 2023-12-05T09:57:42.634 INFO:tasks.workunit.client.0.smithi100.stdout:1/763: write db/d31/d3a/d3b/f9b [481498,11817] 0 2023-12-05T09:57:42.634 INFO:tasks.workunit.client.0.smithi100.stdout:1/764: chown db/d31/d3a/d3b/f9b 242 1 2023-12-05T09:57:42.635 INFO:tasks.workunit.client.0.smithi100.stdout:1/765: write db/d31/d3a/d3b/f4b [737392,81887] 0 2023-12-05T09:57:42.636 INFO:tasks.workunit.client.1.smithi150.stdout:4/738: dwrite d0/f3a [0,4194304] 0 2023-12-05T09:57:42.636 INFO:tasks.workunit.client.1.smithi150.stdout:4/739: getdents d0/d3e/d6d/d4b/d8c 0 2023-12-05T09:57:42.636 INFO:tasks.workunit.client.1.smithi150.stdout:4/740: fsync d0/f30 0 2023-12-05T09:57:42.638 INFO:tasks.workunit.client.0.smithi100.stdout:7/743: dread d3/dc/d11/d13/de/f2b [0,4194304] 0 2023-12-05T09:57:42.641 INFO:tasks.workunit.client.1.smithi150.stdout:7/817: dread d2/db/d30/d13/d4f/d5a/d5c/f43 [0,4194304] 0 2023-12-05T09:57:42.641 INFO:tasks.workunit.client.1.smithi150.stdout:7/818: getdents d2/db/d30/dfe 0 2023-12-05T09:57:42.641 INFO:tasks.workunit.client.1.smithi150.stdout:7/819: rename d2/db to d2/db/d17/d3a/d114 22 2023-12-05T09:57:42.646 INFO:tasks.workunit.client.0.smithi100.stdout:8/720: mknod d0/d12/d13/d16/ccc 0 2023-12-05T09:57:42.646 INFO:tasks.workunit.client.0.smithi100.stdout:8/721: write d0/d12/d13/d16/f79 [4760741,9948] 0 2023-12-05T09:57:42.646 INFO:tasks.workunit.client.0.smithi100.stdout:8/722: truncate d0/d12/d13/f90 1746619 0 2023-12-05T09:57:42.648 INFO:tasks.workunit.client.1.smithi150.stdout:0/853: mknod d5/d11/d32/df2/c123 0 2023-12-05T09:57:42.649 INFO:tasks.workunit.client.1.smithi150.stdout:5/802: symlink d1/d3/d6/d26/d9a/dc7/l117 0 2023-12-05T09:57:42.650 INFO:tasks.workunit.client.1.smithi150.stdout:5/803: chown d1/d3/d6/d72/fad 120235 1 2023-12-05T09:57:42.651 INFO:tasks.workunit.client.1.smithi150.stdout:9/723: dwrite d3/d42/fc7 [0,4194304] 0 2023-12-05T09:57:42.653 INFO:tasks.workunit.client.0.smithi100.stdout:3/859: mkdir d0/d2/de/d11/d7c/dd0/d125/d127 0 2023-12-05T09:57:42.653 INFO:tasks.workunit.client.0.smithi100.stdout:9/794: sync 2023-12-05T09:57:42.653 INFO:tasks.workunit.client.0.smithi100.stdout:9/795: truncate d7/d20/f9b 823224 0 2023-12-05T09:57:42.653 INFO:tasks.workunit.client.0.smithi100.stdout:9/796: truncate d7/d1b/d22/d93/f106 525206 0 2023-12-05T09:57:42.662 INFO:tasks.workunit.client.0.smithi100.stdout:5/803: dwrite d0/fb7 [0,4194304] 0 2023-12-05T09:57:42.662 INFO:tasks.workunit.client.0.smithi100.stdout:5/804: read d0/d16/d2b/d48/f65 [669350,54013] 0 2023-12-05T09:57:42.663 INFO:tasks.workunit.client.0.smithi100.stdout:0/725: dread da/d1b/f3c [0,4194304] 0 2023-12-05T09:57:42.665 INFO:tasks.workunit.client.1.smithi150.stdout:4/741: rmdir d0/d3e/d48/ddd 0 2023-12-05T09:57:42.666 INFO:tasks.workunit.client.0.smithi100.stdout:9/797: dread d7/d20/d69/def/fb0 [0,4194304] 0 2023-12-05T09:57:42.668 INFO:tasks.workunit.client.1.smithi150.stdout:5/804: creat d1/d2e/da6/d24/d59/f118 x:0 0 0 2023-12-05T09:57:42.671 INFO:tasks.workunit.client.1.smithi150.stdout:9/724: creat d3/d9/dc/fec x:0 0 0 2023-12-05T09:57:42.671 INFO:tasks.workunit.client.1.smithi150.stdout:9/725: chown d3/d9/ce 99145675 1 2023-12-05T09:57:42.671 INFO:tasks.workunit.client.0.smithi100.stdout:1/766: mknod db/d31/d3a/d4a/cf4 0 2023-12-05T09:57:42.671 INFO:tasks.workunit.client.0.smithi100.stdout:1/767: stat db/d12/d1e/d72/fc6 0 2023-12-05T09:57:42.671 INFO:tasks.workunit.client.0.smithi100.stdout:7/744: truncate d3/dc/d11/d13/de/d2d/d47/fca 1388853 0 2023-12-05T09:57:42.671 INFO:tasks.workunit.client.0.smithi100.stdout:7/745: stat d3/dc/d11/d13/de/d18/d3b/de2 0 2023-12-05T09:57:42.672 INFO:tasks.workunit.client.0.smithi100.stdout:2/885: dwrite d7/da/d18/d1b/d2c/d3f/fd1 [0,4194304] 0 2023-12-05T09:57:42.672 INFO:tasks.workunit.client.0.smithi100.stdout:8/723: mknod d0/d12/d13/d45/dba/dbd/d72/da9/ccd 0 2023-12-05T09:57:42.674 INFO:tasks.workunit.client.1.smithi150.stdout:8/851: dwrite d0/d41/d49/d1b/d24/d2e/fa5 [0,4194304] 0 2023-12-05T09:57:42.674 INFO:tasks.workunit.client.1.smithi150.stdout:4/742: truncate d0/d5f/f68 2054365 0 2023-12-05T09:57:42.675 INFO:tasks.workunit.client.0.smithi100.stdout:9/798: unlink d7/d1b/f1e 0 2023-12-05T09:57:42.675 INFO:tasks.workunit.client.1.smithi150.stdout:0/854: write d5/d11/d16/fd9 [3745094,77003] 0 2023-12-05T09:57:42.677 INFO:tasks.workunit.client.1.smithi150.stdout:5/805: creat d1/d3/d6/d1b/dfe/f119 x:0 0 0 2023-12-05T09:57:42.679 INFO:tasks.workunit.client.0.smithi100.stdout:7/746: unlink d3/dc/d11/d13/de/d2d/d47/dbd/ld0 0 2023-12-05T09:57:42.681 INFO:tasks.workunit.client.1.smithi150.stdout:9/726: mkdir d3/d9/d26/d34/ded 0 2023-12-05T09:57:42.681 INFO:tasks.workunit.client.1.smithi150.stdout:9/727: fsync d3/d1b/f59 0 2023-12-05T09:57:42.684 INFO:tasks.workunit.client.0.smithi100.stdout:2/886: mkdir d7/d61/d12a 0 2023-12-05T09:57:42.688 INFO:tasks.workunit.client.0.smithi100.stdout:8/724: symlink d0/d12/d13/d45/lce 0 2023-12-05T09:57:42.688 INFO:tasks.workunit.client.0.smithi100.stdout:8/725: chown d0/f37 129705 1 2023-12-05T09:57:42.688 INFO:tasks.workunit.client.0.smithi100.stdout:8/726: truncate d0/d12/d13/d16/d42/d43/f88 414605 0 2023-12-05T09:57:42.688 INFO:tasks.workunit.client.0.smithi100.stdout:8/727: chown d0/d12/d52 470066672 1 2023-12-05T09:57:42.689 INFO:tasks.workunit.client.1.smithi150.stdout:0/855: dread d5/d11/d71/d99/d9c/d3b/de0/f102 [0,4194304] 0 2023-12-05T09:57:42.689 INFO:tasks.workunit.client.1.smithi150.stdout:2/837: sync 2023-12-05T09:57:42.692 INFO:tasks.workunit.client.0.smithi100.stdout:7/747: rename d3/dc/d11/d13/d37/cfb to d3/dc/d11/d33/c115 0 2023-12-05T09:57:42.693 INFO:tasks.workunit.client.0.smithi100.stdout:9/799: write d7/d1b/d22/d93/f9f [3790839,58908] 0 2023-12-05T09:57:42.693 INFO:tasks.workunit.client.0.smithi100.stdout:9/800: readlink d7/d1b/d22/d2a/d74/dec/lfb 0 2023-12-05T09:57:42.698 INFO:tasks.workunit.client.0.smithi100.stdout:9/801: dread - d7/d1b/d22/d2a/d56/d9c/dfd/d109/f113 zero size 2023-12-05T09:57:42.698 INFO:tasks.workunit.client.0.smithi100.stdout:8/728: rmdir d0/d12/d13/d16/da3 39 2023-12-05T09:57:42.698 INFO:tasks.workunit.client.0.smithi100.stdout:8/729: stat d0/d12/d13/d45/da6/d76/l59 0 2023-12-05T09:57:42.698 INFO:tasks.workunit.client.0.smithi100.stdout:8/730: write d0/f31 [2441283,12224] 0 2023-12-05T09:57:42.698 INFO:tasks.workunit.client.0.smithi100.stdout:8/731: chown d0/d12/d13/d45/l77 2 1 2023-12-05T09:57:42.698 INFO:tasks.workunit.client.0.smithi100.stdout:7/748: truncate d3/dc/d11/d13/de/d2d/ffd 182782 0 2023-12-05T09:57:42.698 INFO:tasks.workunit.client.0.smithi100.stdout:3/860: dread d0/d10/d39/f98 [0,4194304] 0 2023-12-05T09:57:42.702 INFO:tasks.workunit.client.0.smithi100.stdout:2/887: rename d7/da/d18/d1b/d2c/d3f/d46/dc8/ce7 to d7/da/d1a/c12b 0 2023-12-05T09:57:42.703 INFO:tasks.workunit.client.0.smithi100.stdout:1/768: write db/ff [1448123,97683] 0 2023-12-05T09:57:42.706 INFO:tasks.workunit.client.1.smithi150.stdout:8/852: unlink d0/d41/d49/d1b/d24/d34/d56/d67/c89 0 2023-12-05T09:57:42.706 INFO:tasks.workunit.client.1.smithi150.stdout:8/853: fdatasync d0/d41/d49/d1b/d24/d2e/d4d/d83/fca 0 2023-12-05T09:57:42.706 INFO:tasks.workunit.client.1.smithi150.stdout:8/854: write d0/d8/f1f [4703587,20335] 0 2023-12-05T09:57:42.709 INFO:tasks.workunit.client.0.smithi100.stdout:5/805: write d0/d16/d2b/d75/f85 [4422075,89173] 0 2023-12-05T09:57:42.709 INFO:tasks.workunit.client.1.smithi150.stdout:5/806: rename d1/d64/d31/d5b/ddf to d1/d64/dfd/d11a 0 2023-12-05T09:57:42.710 INFO:tasks.workunit.client.0.smithi100.stdout:8/732: rmdir d0/d12/d13/d16/da3 39 2023-12-05T09:57:42.710 INFO:tasks.workunit.client.0.smithi100.stdout:8/733: dread - d0/d12/d13/f4d zero size 2023-12-05T09:57:42.711 INFO:tasks.workunit.client.1.smithi150.stdout:0/856: symlink d5/dbd/l124 0 2023-12-05T09:57:42.714 INFO:tasks.workunit.client.1.smithi150.stdout:2/838: creat d0/d3/d5/d3b/f122 x:0 0 0 2023-12-05T09:57:42.714 INFO:tasks.workunit.client.1.smithi150.stdout:2/839: stat d0/da3/dae/lc1 0 2023-12-05T09:57:42.714 INFO:tasks.workunit.client.1.smithi150.stdout:2/840: getdents d0/d3/d5/d22/d52/d5a/d108/d114 0 2023-12-05T09:57:42.718 INFO:tasks.workunit.client.1.smithi150.stdout:4/743: getdents d0/d3e/d6d 0 2023-12-05T09:57:42.719 INFO:tasks.workunit.client.0.smithi100.stdout:3/861: mkdir d0/d3d/dfc/d128 0 2023-12-05T09:57:42.721 INFO:tasks.workunit.client.0.smithi100.stdout:1/769: symlink db/d12/d1e/d72/dc4/lf5 0 2023-12-05T09:57:42.724 INFO:tasks.workunit.client.0.smithi100.stdout:3/862: dread d0/d2/de/d11/d7c/dd0/d125/f64 [0,4194304] 0 2023-12-05T09:57:42.725 INFO:tasks.workunit.client.1.smithi150.stdout:8/855: rename d0/d41/d49/d1b/d24/d38/dad/lec to d0/d41/d49/d1b/d24/d34/da2/dd7/l109 0 2023-12-05T09:57:42.726 INFO:tasks.workunit.client.0.smithi100.stdout:5/806: mknod d0/d1f/d53/c11a 0 2023-12-05T09:57:42.726 INFO:tasks.workunit.client.1.smithi150.stdout:5/807: symlink d1/d3/d6/d26/d9a/dc7/l11b 0 2023-12-05T09:57:42.727 INFO:tasks.workunit.client.0.smithi100.stdout:7/749: truncate d3/dc/d11/f58 1045966 0 2023-12-05T09:57:42.727 INFO:tasks.workunit.client.1.smithi150.stdout:4/744: mknod d0/d3e/d48/dbb/dca/ce6 0 2023-12-05T09:57:42.728 INFO:tasks.workunit.client.0.smithi100.stdout:1/770: creat db/d12/d1e/d26/ff6 x:0 0 0 2023-12-05T09:57:42.728 INFO:tasks.workunit.client.0.smithi100.stdout:1/771: write db/d12/d1e/d72/dc4/fd7 [1000030,45226] 0 2023-12-05T09:57:42.729 INFO:tasks.workunit.client.0.smithi100.stdout:1/772: write db/d31/d3a/d4a/dad/fbf [364640,84147] 0 2023-12-05T09:57:42.729 INFO:tasks.workunit.client.0.smithi100.stdout:1/773: write db/d12/fae [958673,36270] 0 2023-12-05T09:57:42.730 INFO:tasks.workunit.client.1.smithi150.stdout:0/857: rename d5/d11/d16/c36 to d5/d11/d71/d99/d9c/d96/dd5/d67/da8/c125 0 2023-12-05T09:57:42.730 INFO:tasks.workunit.client.1.smithi150.stdout:0/858: stat d5/d11/d32/d57/cb8 0 2023-12-05T09:57:42.733 INFO:tasks.workunit.client.1.smithi150.stdout:8/856: truncate d0/d41/d49/dd3/ff5 3739784 0 2023-12-05T09:57:42.736 INFO:tasks.workunit.client.1.smithi150.stdout:0/859: creat d5/d11/d71/d99/d9c/d3b/de0/d106/f126 x:0 0 0 2023-12-05T09:57:42.736 INFO:tasks.workunit.client.1.smithi150.stdout:0/860: write d5/d11/d71/d99/d9c/d3b/de0/ffc [3460167,65818] 0 2023-12-05T09:57:42.736 INFO:tasks.workunit.client.1.smithi150.stdout:0/861: stat d5/d11/d71/d99/d9c/d3b/de0/f102 0 2023-12-05T09:57:42.736 INFO:tasks.workunit.client.0.smithi100.stdout:7/750: creat d3/dc/d11/d13/de/d18/d3b/d40/d46/f116 x:0 0 0 2023-12-05T09:57:42.736 INFO:tasks.workunit.client.0.smithi100.stdout:1/774: truncate db/d12/f8f 436952 0 2023-12-05T09:57:42.737 INFO:tasks.workunit.client.0.smithi100.stdout:1/775: read db/d31/d3a/d3b/f9b [1258,19107] 0 2023-12-05T09:57:42.741 INFO:tasks.workunit.client.0.smithi100.stdout:2/888: fdatasync d7/f43 0 2023-12-05T09:57:42.741 INFO:tasks.workunit.client.0.smithi100.stdout:5/807: rename d0/d16/d2b/d48 to d0/d1f/da1/d11b 0 2023-12-05T09:57:42.742 INFO:tasks.workunit.client.1.smithi150.stdout:9/728: dwrite d3/d9/d26/d34/f72 [0,4194304] 0 2023-12-05T09:57:42.742 INFO:tasks.workunit.client.1.smithi150.stdout:9/729: chown d3/d1b/d46/d55/d64/lab 1085310 1 2023-12-05T09:57:42.742 INFO:tasks.workunit.client.1.smithi150.stdout:7/820: dwrite d2/db/d2e/d71/df2/ff4 [0,4194304] 0 2023-12-05T09:57:42.744 INFO:tasks.workunit.client.0.smithi100.stdout:2/889: creat d7/da/d18/d21/d122/f12c x:0 0 0 2023-12-05T09:57:42.744 INFO:tasks.workunit.client.0.smithi100.stdout:2/890: dread - d7/d61/f95 zero size 2023-12-05T09:57:42.746 INFO:tasks.workunit.client.0.smithi100.stdout:5/808: creat d0/d1b/d4d/d8e/d96/dc1/dae/db9/dd2/f11c x:0 0 0 2023-12-05T09:57:42.746 INFO:tasks.workunit.client.0.smithi100.stdout:5/809: chown d0/d1f/f6a 489 1 2023-12-05T09:57:42.746 INFO:tasks.workunit.client.0.smithi100.stdout:5/810: rename d0/d1b/d4d/d8e/d96/dc1/dae/db9 to d0/d1b/d4d/d8e/d96/dc1/dae/db9/ddc/d11d 22 2023-12-05T09:57:42.747 INFO:tasks.workunit.client.0.smithi100.stdout:7/751: dread d3/dc/d11/d13/d37/f4b [0,4194304] 0 2023-12-05T09:57:42.747 INFO:tasks.workunit.client.0.smithi100.stdout:4/730: dwrite de/d16/d23/f26 [0,4194304] 0 2023-12-05T09:57:42.748 INFO:tasks.workunit.client.0.smithi100.stdout:0/726: dwrite da/d22/d33/d35/d3a/d8b/d8f/fc2 [0,4194304] 0 2023-12-05T09:57:42.748 INFO:tasks.workunit.client.0.smithi100.stdout:2/891: unlink d7/da/d18/d1b/d2c/d3f/d98/c110 0 2023-12-05T09:57:42.754 INFO:tasks.workunit.client.0.smithi100.stdout:7/752: unlink d3/db3/lb6 0 2023-12-05T09:57:42.754 INFO:tasks.workunit.client.0.smithi100.stdout:7/753: chown d3/dc/d11/d13/f91 6436849 1 2023-12-05T09:57:42.754 INFO:tasks.workunit.client.0.smithi100.stdout:5/811: symlink d0/d4/d14/l11e 0 2023-12-05T09:57:42.755 INFO:tasks.workunit.client.0.smithi100.stdout:0/727: mkdir da/d22/d33/d74/d77/dd6 0 2023-12-05T09:57:42.757 INFO:tasks.workunit.client.0.smithi100.stdout:7/754: creat d3/dc/d11/d13/de/d18/d3b/d40/f117 x:0 0 0 2023-12-05T09:57:42.758 INFO:tasks.workunit.client.0.smithi100.stdout:7/755: write d3/dc/d11/d13/de/f73 [1138530,245] 0 2023-12-05T09:57:42.758 INFO:tasks.workunit.client.0.smithi100.stdout:7/756: creat d3/dc/d11/d13/de/d2d/d47/dbd/f118 x:0 0 0 2023-12-05T09:57:42.762 INFO:tasks.workunit.client.0.smithi100.stdout:0/728: symlink da/d22/d33/d74/dca/db4/ld7 0 2023-12-05T09:57:42.762 INFO:tasks.workunit.client.0.smithi100.stdout:0/729: readlink da/d22/d33/d35/l6e 0 2023-12-05T09:57:42.763 INFO:tasks.workunit.client.1.smithi150.stdout:6/709: sync 2023-12-05T09:57:42.763 INFO:tasks.workunit.client.1.smithi150.stdout:6/710: stat d2/d23/d3b/ded 0 2023-12-05T09:57:42.769 INFO:tasks.workunit.client.1.smithi150.stdout:7/821: dread d2/db/d17/d38/dc8/fa3 [0,4194304] 0 2023-12-05T09:57:42.775 INFO:tasks.workunit.client.1.smithi150.stdout:9/730: dread d3/d1b/f36 [0,4194304] 0 2023-12-05T09:57:42.776 INFO:tasks.workunit.client.0.smithi100.stdout:0/730: symlink da/ld8 0 2023-12-05T09:57:42.776 INFO:tasks.workunit.client.0.smithi100.stdout:4/731: write de/f1b [1248200,110039] 0 2023-12-05T09:57:42.778 INFO:tasks.workunit.client.0.smithi100.stdout:3/863: read d0/d4/f14 [251035,48826] 0 2023-12-05T09:57:42.782 INFO:tasks.workunit.client.1.smithi150.stdout:1/819: sync 2023-12-05T09:57:42.784 INFO:tasks.workunit.client.0.smithi100.stdout:5/812: dread d0/d4/d14/d35/f89 [0,4194304] 0 2023-12-05T09:57:42.784 INFO:tasks.workunit.client.0.smithi100.stdout:2/892: dread d7/da/d18/d21/dae/fcd [0,4194304] 0 2023-12-05T09:57:42.784 INFO:tasks.workunit.client.1.smithi150.stdout:4/745: dread d0/d5f/f68 [0,4194304] 0 2023-12-05T09:57:42.784 INFO:tasks.workunit.client.1.smithi150.stdout:4/746: stat d0/d3e/d48/d8a/lc2 0 2023-12-05T09:57:42.784 INFO:tasks.workunit.client.1.smithi150.stdout:4/747: fdatasync d0/d3e/d6d/f18 0 2023-12-05T09:57:42.785 INFO:tasks.workunit.client.0.smithi100.stdout:7/757: mkdir d3/dc/d11/d13/d119 0 2023-12-05T09:57:42.789 INFO:tasks.workunit.client.1.smithi150.stdout:9/731: dread d3/d1b/d46/f50 [0,4194304] 0 2023-12-05T09:57:42.790 INFO:tasks.workunit.client.0.smithi100.stdout:4/732: creat de/d16/d23/d33/dae/dd3/fed x:0 0 0 2023-12-05T09:57:42.793 INFO:tasks.workunit.client.0.smithi100.stdout:3/864: link d0/d10/f49 d0/d48/f129 0 2023-12-05T09:57:42.794 INFO:tasks.workunit.client.0.smithi100.stdout:3/865: creat d0/d10/f12a x:0 0 0 2023-12-05T09:57:42.795 INFO:tasks.workunit.client.0.smithi100.stdout:3/866: getdents d0/d3d/d5c/d6f/d7f 0 2023-12-05T09:57:42.795 INFO:tasks.workunit.client.1.smithi150.stdout:5/808: write d1/d3/d6/d26/dca/f115 [2991572,100807] 0 2023-12-05T09:57:42.804 INFO:tasks.workunit.client.1.smithi150.stdout:1/820: mknod d6/d38/d4a/c120 0 2023-12-05T09:57:42.808 INFO:tasks.workunit.client.0.smithi100.stdout:5/813: unlink d0/d1f/d25/f63 0 2023-12-05T09:57:42.811 INFO:tasks.workunit.client.0.smithi100.stdout:2/893: creat d7/db4/f12d x:0 0 0 2023-12-05T09:57:42.813 INFO:tasks.workunit.client.1.smithi150.stdout:1/821: rename d6/d47/d4c/d7c to d6/d47/d4c/dd9/daf/d121 0 2023-12-05T09:57:42.816 INFO:tasks.workunit.client.1.smithi150.stdout:4/748: getdents d0/d3e/d6d/d95 0 2023-12-05T09:57:42.818 INFO:tasks.workunit.client.1.smithi150.stdout:2/841: dwrite d0/d42/f118 [0,4194304] 0 2023-12-05T09:57:42.819 INFO:tasks.workunit.client.0.smithi100.stdout:4/733: creat de/d16/d23/d33/d3d/d44/d4e/fee x:0 0 0 2023-12-05T09:57:42.821 INFO:tasks.workunit.client.1.smithi150.stdout:1/822: creat d6/d47/d4c/dd9/daf/d121/f122 x:0 0 0 2023-12-05T09:57:42.821 INFO:tasks.workunit.client.1.smithi150.stdout:1/823: chown d6/d8/d54/l74 2121936 1 2023-12-05T09:57:42.821 INFO:tasks.workunit.client.1.smithi150.stdout:0/862: dwrite d5/d11/d71/d5f/f70 [0,4194304] 0 2023-12-05T09:57:42.821 INFO:tasks.workunit.client.1.smithi150.stdout:0/863: chown d5/d11/ff5 1 1 2023-12-05T09:57:42.827 INFO:tasks.workunit.client.0.smithi100.stdout:9/802: dwrite d7/d20/d69/fa0 [0,4194304] 0 2023-12-05T09:57:42.827 INFO:tasks.workunit.client.0.smithi100.stdout:9/803: chown d7 2193 1 2023-12-05T09:57:42.830 INFO:tasks.workunit.client.1.smithi150.stdout:4/749: symlink d0/d3e/d5b/d6e/le7 0 2023-12-05T09:57:42.832 INFO:tasks.workunit.client.0.smithi100.stdout:3/867: mknod d0/d48/c12b 0 2023-12-05T09:57:42.832 INFO:tasks.workunit.client.1.smithi150.stdout:5/809: dread d1/d3/d6/f3f [4194304,4194304] 0 2023-12-05T09:57:42.839 INFO:tasks.workunit.client.1.smithi150.stdout:1/824: mknod d6/d8/db/d1b/d79/c123 0 2023-12-05T09:57:42.839 INFO:tasks.workunit.client.1.smithi150.stdout:6/711: dwrite d2/d23/f3f [0,4194304] 0 2023-12-05T09:57:42.844 INFO:tasks.workunit.client.1.smithi150.stdout:0/864: getdents d5/dbd 0 2023-12-05T09:57:42.846 INFO:tasks.workunit.client.0.smithi100.stdout:1/776: dwrite db/d12/fae [0,4194304] 0 2023-12-05T09:57:42.849 INFO:tasks.workunit.client.1.smithi150.stdout:5/810: symlink d1/d64/d31/d5b/l11c 0 2023-12-05T09:57:42.852 INFO:tasks.workunit.client.1.smithi150.stdout:1/825: creat d6/d8/d54/d94/f124 x:0 0 0 2023-12-05T09:57:42.852 INFO:tasks.workunit.client.1.smithi150.stdout:1/826: fsync d6/d8/d54/fdf 0 2023-12-05T09:57:42.853 INFO:tasks.workunit.client.0.smithi100.stdout:0/731: dwrite da/d22/d33/d35/d3a/f67 [0,4194304] 0 2023-12-05T09:57:42.854 INFO:tasks.workunit.client.0.smithi100.stdout:5/814: mknod d0/d16/d2b/c11f 0 2023-12-05T09:57:42.855 INFO:tasks.workunit.client.1.smithi150.stdout:0/865: symlink d5/d11/d32/d57/l127 0 2023-12-05T09:57:42.857 INFO:tasks.workunit.client.1.smithi150.stdout:1/827: mknod d6/d38/d4a/c125 0 2023-12-05T09:57:42.858 INFO:tasks.workunit.client.1.smithi150.stdout:1/828: write d6/d8/d54/f82 [92551,80302] 0 2023-12-05T09:57:42.859 INFO:tasks.workunit.client.1.smithi150.stdout:6/712: write d2/d23/d2e/d44/fbc [2748114,52945] 0 2023-12-05T09:57:42.859 INFO:tasks.workunit.client.1.smithi150.stdout:8/857: dwrite d0/d41/d49/d1b/d24/d2e/d30/f36 [0,4194304] 0 2023-12-05T09:57:42.860 INFO:tasks.workunit.client.1.smithi150.stdout:8/858: dread - d0/d41/d49/d1b/d24/d5b/ddc/f100 zero size 2023-12-05T09:57:42.860 INFO:tasks.workunit.client.0.smithi100.stdout:4/734: unlink de/d38/c3c 0 2023-12-05T09:57:42.861 INFO:tasks.workunit.client.1.smithi150.stdout:5/811: dread d1/d7f/d65/d3b/d37/f70 [0,4194304] 0 2023-12-05T09:57:42.863 INFO:tasks.workunit.client.1.smithi150.stdout:6/713: link d2/d23/d3b/d64/d7a/d5d/d6b/c81 d2/d23/d2e/d44/da0/cef 0 2023-12-05T09:57:42.863 INFO:tasks.workunit.client.0.smithi100.stdout:9/804: symlink d7/d1b/l117 0 2023-12-05T09:57:42.867 INFO:tasks.workunit.client.1.smithi150.stdout:5/812: mknod d1/d7f/d65/de3/d10a/deb/c11d 0 2023-12-05T09:57:42.867 INFO:tasks.workunit.client.1.smithi150.stdout:5/813: chown d1/d3/d6/d26/dca/f108 16220569 1 2023-12-05T09:57:42.868 INFO:tasks.workunit.client.1.smithi150.stdout:3/838: sync 2023-12-05T09:57:42.868 INFO:tasks.workunit.client.1.smithi150.stdout:3/839: dread - d6/d9/d3d/d87/fad zero size 2023-12-05T09:57:42.868 INFO:tasks.workunit.client.1.smithi150.stdout:1/829: dread d6/d8/db/db1/fba [0,4194304] 0 2023-12-05T09:57:42.875 INFO:tasks.workunit.client.0.smithi100.stdout:2/894: link d7/da/dc/d88/fd0 d7/da/d18/f12e 0 2023-12-05T09:57:42.875 INFO:tasks.workunit.client.0.smithi100.stdout:2/895: chown d7/da/d18/d21/d4d/f58 7251 1 2023-12-05T09:57:42.875 INFO:tasks.workunit.client.1.smithi150.stdout:6/714: rename d2/d23/d2e/d93 to d2/d23/d3b/df0 0 2023-12-05T09:57:42.875 INFO:tasks.workunit.client.1.smithi150.stdout:0/866: dread d5/d11/d71/d99/d9c/d96/dd5/f44 [0,4194304] 0 2023-12-05T09:57:42.875 INFO:tasks.workunit.client.1.smithi150.stdout:0/867: chown d5/d11/d71/d99/d9c/c97 411 1 2023-12-05T09:57:42.876 INFO:tasks.workunit.client.1.smithi150.stdout:2/842: dwrite d0/d3/d5/d22/d52/d5a/d108/fba [4194304,4194304] 0 2023-12-05T09:57:42.879 INFO:tasks.workunit.client.0.smithi100.stdout:9/805: rename d7/d35/d71/d9a/dcd/df1 to d7/d1b/d89/d118 0 2023-12-05T09:57:42.879 INFO:tasks.workunit.client.0.smithi100.stdout:9/806: write d7/f29 [2283907,24508] 0 2023-12-05T09:57:42.883 INFO:tasks.workunit.client.0.smithi100.stdout:1/777: dread db/d12/d1e/f38 [0,4194304] 0 2023-12-05T09:57:42.883 INFO:tasks.workunit.client.0.smithi100.stdout:1/778: write db/d12/d1e/f5d [4205214,20008] 0 2023-12-05T09:57:42.883 INFO:tasks.workunit.client.0.smithi100.stdout:1/779: write db/d12/d1e/d26/d30/d6e/fcc [862513,107468] 0 2023-12-05T09:57:42.883 INFO:tasks.workunit.client.1.smithi150.stdout:8/859: write d0/d41/d49/d1b/d24/d2e/f44 [3596405,42347] 0 2023-12-05T09:57:42.884 INFO:tasks.workunit.client.1.smithi150.stdout:3/840: link d6/d9/d3d/d56/d71/db6/dc1/d67/c6e d6/d9/d3d/d56/d30/c10d 0 2023-12-05T09:57:42.884 INFO:tasks.workunit.client.0.smithi100.stdout:5/815: getdents d0/d16/d2b/d75 0 2023-12-05T09:57:42.884 INFO:tasks.workunit.client.0.smithi100.stdout:5/816: write d0/d1f/d25/d31/f119 [746809,69500] 0 2023-12-05T09:57:42.887 INFO:tasks.workunit.client.1.smithi150.stdout:0/868: creat d5/dbd/df4/f128 x:0 0 0 2023-12-05T09:57:42.887 INFO:tasks.workunit.client.1.smithi150.stdout:0/869: chown d5/d11/d71/ddb 832 1 2023-12-05T09:57:42.889 INFO:tasks.workunit.client.0.smithi100.stdout:2/896: symlink d7/da/d13/d69/d6e/d71/l12f 0 2023-12-05T09:57:42.892 INFO:tasks.workunit.client.0.smithi100.stdout:9/807: creat d7/d1b/f119 x:0 0 0 2023-12-05T09:57:42.892 INFO:tasks.workunit.client.0.smithi100.stdout:9/808: fdatasync d7/d1b/d22/f4a 0 2023-12-05T09:57:42.892 INFO:tasks.workunit.client.0.smithi100.stdout:9/809: creat d7/d1b/d22/d51/d32/d96/f11a x:0 0 0 2023-12-05T09:57:42.895 INFO:tasks.workunit.client.0.smithi100.stdout:3/868: dwrite d0/d2/fe0 [8388608,4194304] 0 2023-12-05T09:57:42.898 INFO:tasks.workunit.client.0.smithi100.stdout:1/780: creat db/d12/d1e/ff7 x:0 0 0 2023-12-05T09:57:42.898 INFO:tasks.workunit.client.0.smithi100.stdout:1/781: readlink db/d12/l6c 0 2023-12-05T09:57:42.901 INFO:tasks.workunit.client.1.smithi150.stdout:1/830: write d6/d8/f27 [2474740,86795] 0 2023-12-05T09:57:42.901 INFO:tasks.workunit.client.1.smithi150.stdout:1/831: read - d6/d8/db/d1b/d79/dca/feb zero size 2023-12-05T09:57:42.901 INFO:tasks.workunit.client.1.smithi150.stdout:1/832: creat d6/d47/dcf/f126 x:0 0 0 2023-12-05T09:57:42.902 INFO:tasks.workunit.client.0.smithi100.stdout:5/817: symlink d0/d1b/d4d/d8e/l120 0 2023-12-05T09:57:42.902 INFO:tasks.workunit.client.0.smithi100.stdout:5/818: truncate d0/d1f/da1/d11b/f65 983365 0 2023-12-05T09:57:42.906 INFO:tasks.workunit.client.1.smithi150.stdout:8/860: creat d0/d41/d49/d1b/d24/d38/d62/dac/f10a x:0 0 0 2023-12-05T09:57:42.908 INFO:tasks.workunit.client.0.smithi100.stdout:2/897: rename d7/da/d18/c118 to d7/da/ddc/c130 0 2023-12-05T09:57:42.915 INFO:tasks.workunit.client.0.smithi100.stdout:0/732: dwrite da/d22/d33/d35/d3a/f67 [4194304,4194304] 0 2023-12-05T09:57:42.916 INFO:tasks.workunit.client.1.smithi150.stdout:5/814: rename d1/d3/d6/d26 to d1/d7f/d65/d3b/d6b/d11e 0 2023-12-05T09:57:42.916 INFO:tasks.workunit.client.1.smithi150.stdout:5/815: chown d1/d64/dfd/d11a/c10c 522 1 2023-12-05T09:57:42.917 INFO:tasks.workunit.client.0.smithi100.stdout:3/869: rmdir d0/d3d/d5c/d6f/d7f 39 2023-12-05T09:57:42.921 INFO:tasks.workunit.client.1.smithi150.stdout:8/861: mkdir d0/d8/d10b 0 2023-12-05T09:57:42.925 INFO:tasks.workunit.client.1.smithi150.stdout:1/833: write d6/d8/db/f5b [2347370,33121] 0 2023-12-05T09:57:42.925 INFO:tasks.workunit.client.0.smithi100.stdout:1/782: mknod db/d31/d73/cf8 0 2023-12-05T09:57:42.925 INFO:tasks.workunit.client.0.smithi100.stdout:1/783: chown db/d12/d1e/d26/ld8 117109150 1 2023-12-05T09:57:42.926 INFO:tasks.workunit.client.0.smithi100.stdout:5/819: creat d0/d1f/d53/f121 x:0 0 0 2023-12-05T09:57:42.926 INFO:tasks.workunit.client.0.smithi100.stdout:5/820: readlink d0/d1f/da1/d11b/df/d51/da8/dee/l110 0 2023-12-05T09:57:42.926 INFO:tasks.workunit.client.0.smithi100.stdout:5/821: write d0/d1b/d4d/d8e/d96/dea/f102 [655799,113535] 0 2023-12-05T09:57:42.929 INFO:tasks.workunit.client.0.smithi100.stdout:0/733: chown da/d1b/l1d 1269447 1 2023-12-05T09:57:42.929 INFO:tasks.workunit.client.0.smithi100.stdout:0/734: fdatasync da/d2a/f56 0 2023-12-05T09:57:42.930 INFO:tasks.workunit.client.1.smithi150.stdout:5/816: dread d1/f8c [0,4194304] 0 2023-12-05T09:57:42.930 INFO:tasks.workunit.client.1.smithi150.stdout:5/817: read - d1/d3/d6/d72/f111 zero size 2023-12-05T09:57:42.931 INFO:tasks.workunit.client.0.smithi100.stdout:5/822: creat d0/d4/d14/d35/f122 x:0 0 0 2023-12-05T09:57:42.931 INFO:tasks.workunit.client.0.smithi100.stdout:5/823: creat d0/d4/d14/f123 x:0 0 0 2023-12-05T09:57:42.932 INFO:tasks.workunit.client.1.smithi150.stdout:1/834: mknod d6/d38/c127 0 2023-12-05T09:57:42.934 INFO:tasks.workunit.client.0.smithi100.stdout:9/810: rename d7/d1b/d22/d51/d32/d96/f11a to d7/d1b/d22/d2a/d56/d2e/f11b 0 2023-12-05T09:57:42.938 INFO:tasks.workunit.client.0.smithi100.stdout:0/735: link da/c63 da/d2a/d4d/cd9 0 2023-12-05T09:57:42.938 INFO:tasks.workunit.client.0.smithi100.stdout:0/736: readlink da/d22/d33/d35/l6e 0 2023-12-05T09:57:42.938 INFO:tasks.workunit.client.0.smithi100.stdout:0/737: chown da/d22/d33/d35/d3a/fa1 33782 1 2023-12-05T09:57:42.940 INFO:tasks.workunit.client.1.smithi150.stdout:5/818: mkdir d1/d7f/d65/d3b/d6b/d109/d11f 0 2023-12-05T09:57:42.946 INFO:tasks.workunit.client.1.smithi150.stdout:5/819: mknod d1/d2e/da6/d24/d59/c120 0 2023-12-05T09:57:42.947 INFO:tasks.workunit.client.0.smithi100.stdout:5/824: mkdir d0/d1b/d4d/d6c/d104/d124 0 2023-12-05T09:57:42.948 INFO:tasks.workunit.client.0.smithi100.stdout:9/811: write d7/d20/fe0 [268342,6271] 0 2023-12-05T09:57:42.948 INFO:tasks.workunit.client.0.smithi100.stdout:9/812: creat d7/d35/d97/f11c x:0 0 0 2023-12-05T09:57:42.951 INFO:tasks.workunit.client.0.smithi100.stdout:1/784: write db/d12/d1e/d26/d30/f83 [801535,4508] 0 2023-12-05T09:57:42.951 INFO:tasks.workunit.client.0.smithi100.stdout:3/870: rename d0/d3d/d5c/d5f/d73/lf8 to d0/d3d/d5c/d6f/l12c 0 2023-12-05T09:57:42.951 INFO:tasks.workunit.client.0.smithi100.stdout:3/871: creat d0/d2/de/d11/d7c/dd0/f12d x:0 0 0 2023-12-05T09:57:42.951 INFO:tasks.workunit.client.0.smithi100.stdout:3/872: write d0/d2/de/db8/dee/ff3 [252410,26160] 0 2023-12-05T09:57:42.952 INFO:tasks.workunit.client.1.smithi150.stdout:5/820: link d1/d3/d6/d1b/lc9 d1/d7f/d65/de3/d10a/l121 0 2023-12-05T09:57:42.952 INFO:tasks.workunit.client.1.smithi150.stdout:8/862: dread d0/d41/d49/d1b/d24/d2e/f6e [0,4194304] 0 2023-12-05T09:57:42.953 INFO:tasks.workunit.client.0.smithi100.stdout:5/825: unlink d0/d4/d14/d35/f122 0 2023-12-05T09:57:42.958 INFO:tasks.workunit.client.1.smithi150.stdout:1/835: dread d6/f8d [0,4194304] 0 2023-12-05T09:57:42.958 INFO:tasks.workunit.client.0.smithi100.stdout:9/813: symlink d7/d1b/d22/d51/d32/d96/l11d 0 2023-12-05T09:57:42.959 INFO:tasks.workunit.client.1.smithi150.stdout:6/715: dwrite d2/d23/d2e/d5f/d99/fac [0,4194304] 0 2023-12-05T09:57:42.960 INFO:tasks.workunit.client.1.smithi150.stdout:5/821: creat d1/d64/d31/d5b/f122 x:0 0 0 2023-12-05T09:57:42.963 INFO:tasks.workunit.client.1.smithi150.stdout:1/836: mkdir d6/d38/d128 0 2023-12-05T09:57:42.963 INFO:tasks.workunit.client.1.smithi150.stdout:1/837: read d6/d8/d54/f82 [30603,64563] 0 2023-12-05T09:57:42.966 INFO:tasks.workunit.client.0.smithi100.stdout:5/826: truncate d0/d1f/f10a 198058 0 2023-12-05T09:57:42.967 INFO:tasks.workunit.client.0.smithi100.stdout:9/814: creat d7/d1b/d22/d93/dd9/f11e x:0 0 0 2023-12-05T09:57:42.971 INFO:tasks.workunit.client.0.smithi100.stdout:3/873: getdents d0/d4 0 2023-12-05T09:57:42.973 INFO:tasks.workunit.client.1.smithi150.stdout:6/716: getdents d2/d23/d3b/d64 0 2023-12-05T09:57:42.973 INFO:tasks.workunit.client.1.smithi150.stdout:8/863: dread d0/d41/d49/d1b/d24/d2e/f5e [0,4194304] 0 2023-12-05T09:57:42.973 INFO:tasks.workunit.client.1.smithi150.stdout:1/838: mkdir d6/d47/d4c/dd9/d75/d106/d129 0 2023-12-05T09:57:42.974 INFO:tasks.workunit.client.0.smithi100.stdout:4/735: dwrite de/d16/d23/d60/f9f [0,4194304] 0 2023-12-05T09:57:42.974 INFO:tasks.workunit.client.0.smithi100.stdout:9/815: symlink d7/d1b/d22/d2a/d56/d9c/dfd/d109/l11f 0 2023-12-05T09:57:42.975 INFO:tasks.workunit.client.1.smithi150.stdout:6/717: chown d2/d23/d3b/d64/f88 33877901 1 2023-12-05T09:57:42.977 INFO:tasks.workunit.client.0.smithi100.stdout:4/736: creat de/d16/d23/d33/d3d/d44/d4e/d80/fef x:0 0 0 2023-12-05T09:57:42.979 INFO:tasks.workunit.client.0.smithi100.stdout:2/898: dwrite d7/da/d18/d21/f7e [4194304,4194304] 0 2023-12-05T09:57:42.981 INFO:tasks.workunit.client.1.smithi150.stdout:2/843: dwrite d0/d3/d21/d4d/deb/d103/d15/d30/fda [0,4194304] 0 2023-12-05T09:57:42.982 INFO:tasks.workunit.client.1.smithi150.stdout:2/844: stat d0/da3 0 2023-12-05T09:57:42.982 INFO:tasks.workunit.client.1.smithi150.stdout:8/864: symlink d0/d41/d49/d1b/d24/d5b/dfa/l10c 0 2023-12-05T09:57:42.982 INFO:tasks.workunit.client.1.smithi150.stdout:5/822: dread d1/d7f/d65/d3b/d6b/d11e/dca/f115 [0,4194304] 0 2023-12-05T09:57:42.982 INFO:tasks.workunit.client.1.smithi150.stdout:5/823: truncate d1/d3/d6/d1b/f6a 2669736 0 2023-12-05T09:57:42.982 INFO:tasks.workunit.client.1.smithi150.stdout:5/824: write d1/d7f/fde [332800,82797] 0 2023-12-05T09:57:42.982 INFO:tasks.workunit.client.1.smithi150.stdout:0/870: dwrite d5/d11/d71/d99/d9c/d96/dd5/d67/da8/fa9 [0,4194304] 0 2023-12-05T09:57:42.982 INFO:tasks.workunit.client.0.smithi100.stdout:4/737: unlink de/d16/d23/d60/dc4/f84 0 2023-12-05T09:57:42.982 INFO:tasks.workunit.client.1.smithi150.stdout:3/841: dwrite d6/d9/f1d [0,4194304] 0 2023-12-05T09:57:42.986 INFO:tasks.workunit.client.0.smithi100.stdout:2/899: creat d7/da/d18/d21/d4d/d81/f131 x:0 0 0 2023-12-05T09:57:43.020 INFO:tasks.workunit.client.1.smithi150.stdout:3/842: write d6/d9/d8d/f44 [2541715,123845] 0 2023-12-05T09:57:43.021 INFO:tasks.workunit.client.1.smithi150.stdout:3/843: write d6/d9/d3d/d87/fe4 [53534,49425] 0 2023-12-05T09:57:43.036 INFO:tasks.workunit.client.1.smithi150.stdout:8/865: mknod d0/d41/d49/d1b/d24/d2e/d4d/d83/c10d 0 2023-12-05T09:57:43.036 INFO:tasks.workunit.client.1.smithi150.stdout:8/866: chown d0/d41/d49/d1b/d24/d2e/d30/f36 18406672 1 2023-12-05T09:57:43.039 INFO:tasks.workunit.client.1.smithi150.stdout:5/825: creat d1/d64/d31/f123 x:0 0 0 2023-12-05T09:57:43.039 INFO:tasks.workunit.client.0.smithi100.stdout:0/738: dwrite da/d1b/d6b/d78/f88 [0,4194304] 0 2023-12-05T09:57:43.042 INFO:tasks.workunit.client.1.smithi150.stdout:0/871: symlink d5/d11/d71/d99/d9c/d3b/dad/l129 0 2023-12-05T09:57:43.042 INFO:tasks.workunit.client.1.smithi150.stdout:0/872: chown d5/d11/d71/d99/d9c/fc0 13366020 1 2023-12-05T09:57:43.042 INFO:tasks.workunit.client.1.smithi150.stdout:0/873: chown d5/dbd/ffd 1896 1 2023-12-05T09:57:43.043 INFO:tasks.workunit.client.1.smithi150.stdout:2/845: dwrite d0/d3/d27/d51/fd5 [0,4194304] 0 2023-12-05T09:57:43.047 INFO:tasks.workunit.client.1.smithi150.stdout:3/844: mknod d6/d9/d43/c10e 0 2023-12-05T09:57:43.051 INFO:tasks.workunit.client.1.smithi150.stdout:8/867: creat d0/d41/d49/d1b/d24/f10e x:0 0 0 2023-12-05T09:57:43.053 INFO:tasks.workunit.client.0.smithi100.stdout:3/874: dwrite d0/f88 [0,4194304] 0 2023-12-05T09:57:43.060 INFO:tasks.workunit.client.1.smithi150.stdout:1/839: dwrite d6/d8/d85/f115 [0,4194304] 0 2023-12-05T09:57:43.063 INFO:tasks.workunit.client.1.smithi150.stdout:5/826: creat d1/d7f/d65/de3/f124 x:0 0 0 2023-12-05T09:57:43.063 INFO:tasks.workunit.client.1.smithi150.stdout:0/874: link d5/c15 d5/d11/d71/ddb/d10b/c12a 0 2023-12-05T09:57:43.063 INFO:tasks.workunit.client.1.smithi150.stdout:5/827: creat d1/d64/ded/f125 x:0 0 0 2023-12-05T09:57:43.063 INFO:tasks.workunit.client.1.smithi150.stdout:2/846: creat d0/d3/d5/d3b/d4c/f123 x:0 0 0 2023-12-05T09:57:43.069 INFO:tasks.workunit.client.0.smithi100.stdout:5/827: rename d0/d4 to d0/d1b/d4d/d8e/d125 0 2023-12-05T09:57:43.069 INFO:tasks.workunit.client.0.smithi100.stdout:5/828: fdatasync d0/d16/d2b/f7f 0 2023-12-05T09:57:43.069 INFO:tasks.workunit.client.0.smithi100.stdout:5/829: creat d0/d1b/d4d/d8e/d96/dc1/dae/db9/f126 x:0 0 0 2023-12-05T09:57:43.069 INFO:tasks.workunit.client.1.smithi150.stdout:8/868: creat d0/da1/dfb/f10f x:0 0 0 2023-12-05T09:57:43.076 INFO:tasks.workunit.client.0.smithi100.stdout:4/738: creat de/d16/ff0 x:0 0 0 2023-12-05T09:57:43.076 INFO:tasks.workunit.client.0.smithi100.stdout:4/739: write de/d16/d23/d33/d51/fba [433403,38928] 0 2023-12-05T09:57:43.076 INFO:tasks.workunit.client.0.smithi100.stdout:4/740: chown de/d16/d23/d60/d88/f8f 77045 1 2023-12-05T09:57:43.076 INFO:tasks.workunit.client.0.smithi100.stdout:4/741: write de/d16/d1e/fea [450996,64309] 0 2023-12-05T09:57:43.076 INFO:tasks.workunit.client.0.smithi100.stdout:2/900: dwrite d7/da/d18/d1b/d2c/d3f/d98/fc7 [0,4194304] 0 2023-12-05T09:57:43.077 INFO:tasks.workunit.client.0.smithi100.stdout:2/901: chown d7/da/da7/dd6/cf4 2573426 1 2023-12-05T09:57:43.079 INFO:tasks.workunit.client.0.smithi100.stdout:0/739: creat da/d1b/d73/fda x:0 0 0 2023-12-05T09:57:43.079 INFO:tasks.workunit.client.0.smithi100.stdout:0/740: creat da/d22/d33/d74/fdb x:0 0 0 2023-12-05T09:57:43.080 INFO:tasks.workunit.client.1.smithi150.stdout:9/732: sync 2023-12-05T09:57:43.081 INFO:tasks.workunit.client.1.smithi150.stdout:7/822: sync 2023-12-05T09:57:43.081 INFO:tasks.workunit.client.1.smithi150.stdout:9/733: chown d3/d1b/dca/cd1 296958 1 2023-12-05T09:57:43.081 INFO:tasks.workunit.client.1.smithi150.stdout:9/734: chown d3/f29 3 1 2023-12-05T09:57:43.081 INFO:tasks.workunit.client.1.smithi150.stdout:7/823: chown d2/db/d17/d88/fd6 4669057 1 2023-12-05T09:57:43.081 INFO:tasks.workunit.client.1.smithi150.stdout:7/824: chown d2/db/d2e/l112 72509 1 2023-12-05T09:57:43.093 INFO:tasks.workunit.client.0.smithi100.stdout:9/816: rename d7/d1b/d22/d2a/d56/f6e to d7/d1b/d89/f120 0 2023-12-05T09:57:43.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:42 smithi150 ceph-mon[116142]: pgmap v37: 65 pgs: 65 active+clean; 3.0 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 249 MiB/s rd, 303 MiB/s wr, 441 op/s 2023-12-05T09:57:43.100 INFO:tasks.workunit.client.1.smithi150.stdout:5/828: symlink d1/d64/d31/d5b/l126 0 2023-12-05T09:57:43.102 INFO:tasks.workunit.client.1.smithi150.stdout:2/847: creat d0/d3/d27/dac/dd0/f124 x:0 0 0 2023-12-05T09:57:43.102 INFO:tasks.workunit.client.1.smithi150.stdout:2/848: truncate d0/d3/d21/d4d/deb/f9a 652273 0 2023-12-05T09:57:43.105 INFO:tasks.workunit.client.1.smithi150.stdout:3/845: dwrite d6/d9/d43/f72 [4194304,4194304] 0 2023-12-05T09:57:43.107 INFO:tasks.workunit.client.0.smithi100.stdout:4/742: dread de/d16/d23/d33/d3d/f9e [0,4194304] 0 2023-12-05T09:57:43.107 INFO:tasks.workunit.client.1.smithi150.stdout:9/735: rmdir d3/d9/d26/d34 39 2023-12-05T09:57:43.107 INFO:tasks.workunit.client.1.smithi150.stdout:5/829: mkdir d1/d7f/d65/d3b/d127 0 2023-12-05T09:57:43.109 INFO:tasks.workunit.client.0.smithi100.stdout:0/741: symlink da/d22/d33/d35/ldc 0 2023-12-05T09:57:43.110 INFO:tasks.workunit.client.1.smithi150.stdout:7/825: write d2/d1b/d5b/f9c [3416949,97678] 0 2023-12-05T09:57:43.110 INFO:tasks.workunit.client.1.smithi150.stdout:7/826: dread - d2/fee zero size 2023-12-05T09:57:43.110 INFO:tasks.workunit.client.1.smithi150.stdout:7/827: truncate d2/db/d2e/d71/df2/f107 752770 0 2023-12-05T09:57:43.110 INFO:tasks.workunit.client.1.smithi150.stdout:7/828: truncate d2/d4/f10b 1741648 0 2023-12-05T09:57:43.110 INFO:tasks.workunit.client.1.smithi150.stdout:7/829: dread - d2/db/d30/d18/d1a/faa zero size 2023-12-05T09:57:43.110 INFO:tasks.workunit.client.1.smithi150.stdout:7/830: read d2/d4/f6d [2062529,27819] 0 2023-12-05T09:57:43.114 INFO:tasks.workunit.client.0.smithi100.stdout:9/817: link d7/d1b/d22/d51/d32/le6 d7/d1b/d22/d51/d32/dc2/l121 0 2023-12-05T09:57:43.119 INFO:tasks.workunit.client.0.smithi100.stdout:3/875: dwrite d0/d3d/f108 [0,4194304] 0 2023-12-05T09:57:43.119 INFO:tasks.workunit.client.1.smithi150.stdout:1/840: dwrite d6/d47/d4c/dd9/fe7 [0,4194304] 0 2023-12-05T09:57:43.119 INFO:tasks.workunit.client.1.smithi150.stdout:3/846: creat d6/d9/f10f x:0 0 0 2023-12-05T09:57:43.121 INFO:tasks.workunit.client.0.smithi100.stdout:5/830: rmdir d0/d27 39 2023-12-05T09:57:43.121 INFO:tasks.workunit.client.0.smithi100.stdout:5/831: dread - d0/d1b/d4d/d8e/d96/dc1/dae/faf zero size 2023-12-05T09:57:43.122 INFO:tasks.workunit.client.0.smithi100.stdout:5/832: creat d0/d1b/d4d/d8e/d96/dc1/dae/f127 x:0 0 0 2023-12-05T09:57:43.123 INFO:tasks.workunit.client.0.smithi100.stdout:4/743: mkdir de/d16/df1 0 2023-12-05T09:57:43.126 INFO:tasks.workunit.client.1.smithi150.stdout:9/736: write d3/d9/dc/d1f/fa1 [2531137,66012] 0 2023-12-05T09:57:43.128 INFO:tasks.workunit.client.1.smithi150.stdout:5/830: dread d1/d3/d6/d1b/fa7 [0,4194304] 0 2023-12-05T09:57:43.135 INFO:tasks.workunit.client.1.smithi150.stdout:3/847: mkdir d6/d9/d3d/d56/d71/db6/dc1/d110 0 2023-12-05T09:57:43.135 INFO:tasks.workunit.client.0.smithi100.stdout:4/744: symlink de/d16/d1e/lf2 0 2023-12-05T09:57:43.137 INFO:tasks.workunit.client.1.smithi150.stdout:9/737: mknod d3/d9/d6e/cee 0 2023-12-05T09:57:43.138 INFO:tasks.workunit.client.1.smithi150.stdout:1/841: dread d6/d8/db/f5b [0,4194304] 0 2023-12-05T09:57:43.138 INFO:tasks.workunit.client.1.smithi150.stdout:1/842: chown d6/c4d 17523736 1 2023-12-05T09:57:43.138 INFO:tasks.workunit.client.1.smithi150.stdout:7/831: rmdir d2/db/d30/d18/d63 39 2023-12-05T09:57:43.140 INFO:tasks.workunit.client.0.smithi100.stdout:3/876: dread d0/d2/f23 [0,4194304] 0 2023-12-05T09:57:43.140 INFO:tasks.workunit.client.0.smithi100.stdout:3/877: write d0/d2/de/d11/d7c/dd0/d125/f64 [1370640,96338] 0 2023-12-05T09:57:43.140 INFO:tasks.workunit.client.0.smithi100.stdout:3/878: readlink d0/d48/le1 0 2023-12-05T09:57:43.142 INFO:tasks.workunit.client.1.smithi150.stdout:5/831: mkdir d1/d7f/d65/d3b/d6b/d128 0 2023-12-05T09:57:43.142 INFO:tasks.workunit.client.1.smithi150.stdout:5/832: write d1/d7f/d65/d3b/d37/faf [2092314,100366] 0 2023-12-05T09:57:43.145 INFO:tasks.workunit.client.1.smithi150.stdout:9/738: getdents d3/d1b/d46 0 2023-12-05T09:57:43.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:42 smithi100 ceph-mon[107145]: pgmap v37: 65 pgs: 65 active+clean; 3.0 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 249 MiB/s rd, 303 MiB/s wr, 441 op/s 2023-12-05T09:57:43.147 INFO:tasks.workunit.client.0.smithi100.stdout:9/818: rename d7/d1b/d22/d2a/d56/d2e/d50 to d7/d35/d71/d9a/dcd/d122 0 2023-12-05T09:57:43.147 INFO:tasks.workunit.client.0.smithi100.stdout:9/819: chown d7/cdc 40813 1 2023-12-05T09:57:43.147 INFO:tasks.workunit.client.0.smithi100.stdout:9/820: write d7/d1b/f119 [550184,49656] 0 2023-12-05T09:57:43.148 INFO:tasks.workunit.client.1.smithi150.stdout:7/832: getdents d2/d9d 0 2023-12-05T09:57:43.149 INFO:tasks.workunit.client.1.smithi150.stdout:7/833: fdatasync d2/db/d2e/d71/df2/f107 0 2023-12-05T09:57:43.150 INFO:tasks.workunit.client.0.smithi100.stdout:3/879: mknod d0/d3d/d5c/d5f/c12e 0 2023-12-05T09:57:43.151 INFO:tasks.workunit.client.1.smithi150.stdout:5/833: mknod d1/d7f/d65/d3b/d8d/c129 0 2023-12-05T09:57:43.153 INFO:tasks.workunit.client.0.smithi100.stdout:4/745: dread de/d16/d23/f58 [0,4194304] 0 2023-12-05T09:57:43.153 INFO:tasks.workunit.client.0.smithi100.stdout:5/833: rename d0/d1b/d4d/d6c/f7d to d0/d1f/d25/f128 0 2023-12-05T09:57:43.154 INFO:tasks.workunit.client.1.smithi150.stdout:7/834: symlink d2/db/d17/l115 0 2023-12-05T09:57:43.155 INFO:tasks.workunit.client.0.smithi100.stdout:9/821: symlink d7/d1b/d22/d51/d32/d96/d103/l123 0 2023-12-05T09:57:43.155 INFO:tasks.workunit.client.1.smithi150.stdout:3/848: dread d6/d9/d3d/d56/d71/db6/dc1/f96 [0,4194304] 0 2023-12-05T09:57:43.156 INFO:tasks.workunit.client.0.smithi100.stdout:3/880: mkdir d0/d2/de/db8/d12f 0 2023-12-05T09:57:43.156 INFO:tasks.workunit.client.1.smithi150.stdout:1/843: read d6/d8/d85/f9b [201250,73297] 0 2023-12-05T09:57:43.156 INFO:tasks.workunit.client.1.smithi150.stdout:1/844: creat d6/d47/f12a x:0 0 0 2023-12-05T09:57:43.157 INFO:tasks.workunit.client.1.smithi150.stdout:3/849: mknod d6/d9/d3d/d8a/c111 0 2023-12-05T09:57:43.159 INFO:tasks.workunit.client.1.smithi150.stdout:3/850: write d6/d25/dcf/fda [239713,6846] 0 2023-12-05T09:57:43.159 INFO:tasks.workunit.client.1.smithi150.stdout:3/851: write d6/d9/d43/f72 [974865,50237] 0 2023-12-05T09:57:43.160 INFO:tasks.workunit.client.0.smithi100.stdout:4/746: link de/d16/d23/d33/l72 de/d16/d23/d60/d88/lf3 0 2023-12-05T09:57:43.161 INFO:tasks.workunit.client.1.smithi150.stdout:4/750: sync 2023-12-05T09:57:43.161 INFO:tasks.workunit.client.1.smithi150.stdout:1/845: mkdir d6/d8/d54/d12b 0 2023-12-05T09:57:43.163 INFO:tasks.workunit.client.0.smithi100.stdout:5/834: mknod d0/d1b/d4d/d8e/d96/dea/dff/c129 0 2023-12-05T09:57:43.166 INFO:tasks.workunit.client.0.smithi100.stdout:0/742: dwrite da/d22/d33/d74/dca/db4/fc1 [0,4194304] 0 2023-12-05T09:57:43.167 INFO:tasks.workunit.client.1.smithi150.stdout:4/751: creat d0/d3e/d6d/d4b/d8c/fe8 x:0 0 0 2023-12-05T09:57:43.167 INFO:tasks.workunit.client.1.smithi150.stdout:8/869: dwrite d0/d41/f50 [0,4194304] 0 2023-12-05T09:57:43.167 INFO:tasks.workunit.client.1.smithi150.stdout:4/752: fsync d0/d3e/f6b 0 2023-12-05T09:57:43.167 INFO:tasks.workunit.client.1.smithi150.stdout:8/870: truncate d0/d41/d49/d1b/d24/d38/d62/fc1 158904 0 2023-12-05T09:57:43.167 INFO:tasks.workunit.client.1.smithi150.stdout:8/871: chown d0/da1/dfb/lfd 265 1 2023-12-05T09:57:43.167 INFO:tasks.workunit.client.1.smithi150.stdout:8/872: fdatasync d0/d41/d49/d1b/d24/d5b/d9c/fc6 0 2023-12-05T09:57:43.167 INFO:tasks.workunit.client.1.smithi150.stdout:8/873: write d0/d41/d49/d1b/d24/d38/d62/dac/f10a [696605,40242] 0 2023-12-05T09:57:43.167 INFO:tasks.workunit.client.1.smithi150.stdout:9/739: dread d3/d9/d26/d34/f72 [0,4194304] 0 2023-12-05T09:57:43.168 INFO:tasks.workunit.client.1.smithi150.stdout:9/740: write d3/d9/d26/f3f [1178056,5638] 0 2023-12-05T09:57:43.168 INFO:tasks.workunit.client.1.smithi150.stdout:9/741: fdatasync d3/f29 0 2023-12-05T09:57:43.168 INFO:tasks.workunit.client.0.smithi100.stdout:2/902: dwrite d7/da/d18/d21/d4d/f58 [0,4194304] 0 2023-12-05T09:57:43.168 INFO:tasks.workunit.client.0.smithi100.stdout:2/903: chown d7/da/da7/dd6/f104 6002026 1 2023-12-05T09:57:43.169 INFO:tasks.workunit.client.0.smithi100.stdout:9/822: rename d7/d1b/f30 to d7/d20/d69/d108/f124 0 2023-12-05T09:57:43.182 INFO:tasks.workunit.client.1.smithi150.stdout:3/852: dread d6/d9/d3d/d52/f76 [0,4194304] 0 2023-12-05T09:57:43.183 INFO:tasks.workunit.client.1.smithi150.stdout:1/846: write d6/d47/d4c/f102 [3047644,37103] 0 2023-12-05T09:57:43.185 INFO:tasks.workunit.client.0.smithi100.stdout:2/904: dread d7/da/d1a/f1c [0,4194304] 0 2023-12-05T09:57:43.199 INFO:tasks.workunit.client.0.smithi100.stdout:0/743: dread da/d22/f23 [0,4194304] 0 2023-12-05T09:57:43.204 INFO:tasks.workunit.client.1.smithi150.stdout:8/874: mkdir d0/da1/dfb/d110 0 2023-12-05T09:57:43.206 INFO:tasks.workunit.client.0.smithi100.stdout:2/905: dread d7/da/d18/f62 [4194304,4194304] 0 2023-12-05T09:57:43.206 INFO:tasks.workunit.client.0.smithi100.stdout:3/881: rename d0/d10/f10c to d0/d2/de/d8d/de3/f130 0 2023-12-05T09:57:43.206 INFO:tasks.workunit.client.0.smithi100.stdout:2/906: stat d7/da/da7/dd6 0 2023-12-05T09:57:43.206 INFO:tasks.workunit.client.0.smithi100.stdout:3/882: creat d0/d2/de/d8d/f131 x:0 0 0 2023-12-05T09:57:43.209 INFO:tasks.workunit.client.1.smithi150.stdout:4/753: dwrite d0/d5f/fd9 [0,4194304] 0 2023-12-05T09:57:43.212 INFO:tasks.workunit.client.0.smithi100.stdout:5/835: dwrite d0/d1b/d4d/d8e/d125/fd [0,4194304] 0 2023-12-05T09:57:43.212 INFO:tasks.workunit.client.0.smithi100.stdout:5/836: write d0/d1f/da1/d11b/df/fe2 [563867,42450] 0 2023-12-05T09:57:43.213 INFO:tasks.workunit.client.1.smithi150.stdout:9/742: mkdir d3/d9/dc/d1f/d24/d75/d95/d9a/dcb/de4/def 0 2023-12-05T09:57:43.214 INFO:tasks.workunit.client.1.smithi150.stdout:2/849: rename d0/d3/d27/dac/dd0 to d0/d3/d27/d51/d125 0 2023-12-05T09:57:43.214 INFO:tasks.workunit.client.1.smithi150.stdout:9/743: write d3/d9/d26/f89 [9047497,25862] 0 2023-12-05T09:57:43.214 INFO:tasks.workunit.client.1.smithi150.stdout:2/850: creat d0/d3/d27/dac/d81/f126 x:0 0 0 2023-12-05T09:57:43.214 INFO:tasks.workunit.client.1.smithi150.stdout:9/744: chown d3/d9/dc/d1f/d24/d75/d95/le9 115552 1 2023-12-05T09:57:43.214 INFO:tasks.workunit.client.0.smithi100.stdout:0/744: creat da/d22/d33/d74/dca/fdd x:0 0 0 2023-12-05T09:57:43.214 INFO:tasks.workunit.client.0.smithi100.stdout:0/745: chown da/d2a/d4d/l53 409747 1 2023-12-05T09:57:43.215 INFO:tasks.workunit.client.0.smithi100.stdout:0/746: chown da/d2a/d4d/l92 14019 1 2023-12-05T09:57:43.216 INFO:tasks.workunit.client.0.smithi100.stdout:9/823: mknod d7/d1b/d22/d51/c125 0 2023-12-05T09:57:43.219 INFO:tasks.workunit.client.1.smithi150.stdout:3/853: symlink d6/d9/d43/d47/d94/l112 0 2023-12-05T09:57:43.219 INFO:tasks.workunit.client.1.smithi150.stdout:3/854: fsync d6/d9/f1c 0 2023-12-05T09:57:43.226 INFO:tasks.workunit.client.0.smithi100.stdout:5/837: unlink d0/d1f/ff3 0 2023-12-05T09:57:43.233 INFO:tasks.workunit.client.0.smithi100.stdout:0/747: mknod da/d22/d33/d74/dca/db4/cde 0 2023-12-05T09:57:43.233 INFO:tasks.workunit.client.0.smithi100.stdout:0/748: creat da/d22/d33/d74/dca/fdf x:0 0 0 2023-12-05T09:57:43.233 INFO:tasks.workunit.client.1.smithi150.stdout:2/851: link d0/d3/d27/dac/d81/c93 d0/d3/d27/d95/ddf/c127 0 2023-12-05T09:57:43.233 INFO:tasks.workunit.client.1.smithi150.stdout:2/852: truncate d0/d3/d21/d4d/fdd 819734 0 2023-12-05T09:57:43.234 INFO:tasks.workunit.client.0.smithi100.stdout:9/824: link d7/d35/l3b d7/d20/d69/def/ddf/l126 0 2023-12-05T09:57:43.236 INFO:tasks.workunit.client.0.smithi100.stdout:4/747: dwrite de/d16/d23/f24 [0,4194304] 0 2023-12-05T09:57:43.236 INFO:tasks.workunit.client.0.smithi100.stdout:4/748: chown de/dc3/le4 3 1 2023-12-05T09:57:43.237 INFO:tasks.workunit.client.1.smithi150.stdout:5/834: rename d1/d7f/d65/d3b/d8d/c129 to d1/d3/d6/d116/c12a 0 2023-12-05T09:57:43.237 INFO:tasks.workunit.client.1.smithi150.stdout:5/835: readlink d1/d3/d6/d1b/l36 0 2023-12-05T09:57:43.237 INFO:tasks.workunit.client.1.smithi150.stdout:5/836: readlink d1/d3/d6/lcc 0 2023-12-05T09:57:43.237 INFO:tasks.workunit.client.1.smithi150.stdout:5/837: write d1/d2e/da6/f103 [482702,80267] 0 2023-12-05T09:57:43.238 INFO:tasks.workunit.client.0.smithi100.stdout:5/838: mkdir d0/d1f/da1/d11b/df/d51/da8/d12a 0 2023-12-05T09:57:43.245 INFO:tasks.workunit.client.1.smithi150.stdout:3/855: mkdir d6/d113 0 2023-12-05T09:57:43.247 INFO:tasks.workunit.client.0.smithi100.stdout:0/749: symlink da/d22/d33/d35/d3a/d8b/le0 0 2023-12-05T09:57:43.248 INFO:tasks.workunit.client.1.smithi150.stdout:2/853: mkdir d0/d3/d128 0 2023-12-05T09:57:43.252 INFO:tasks.workunit.client.0.smithi100.stdout:9/825: truncate d7/d20/d69/def/fed 152878 0 2023-12-05T09:57:43.253 INFO:tasks.workunit.client.1.smithi150.stdout:4/754: dwrite d0/d3e/d5b/d80/f7c [4194304,4194304] 0 2023-12-05T09:57:43.254 INFO:tasks.workunit.client.1.smithi150.stdout:9/745: symlink d3/d9/d9c/lf0 0 2023-12-05T09:57:43.257 INFO:tasks.workunit.client.0.smithi100.stdout:8/734: sync 2023-12-05T09:57:43.257 INFO:tasks.workunit.client.0.smithi100.stdout:5/839: dread d0/d1b/d4d/d8e/d96/dc1/fd1 [0,4194304] 0 2023-12-05T09:57:43.257 INFO:tasks.workunit.client.0.smithi100.stdout:5/840: readlink d0/d1b/d4d/d8e/l10d 0 2023-12-05T09:57:43.268 INFO:tasks.workunit.client.0.smithi100.stdout:3/883: dwrite d0/d4/f20 [4194304,4194304] 0 2023-12-05T09:57:43.268 INFO:tasks.workunit.client.1.smithi150.stdout:7/835: rename d2/d9d/da0/fb9 to d2/db/d30/f116 0 2023-12-05T09:57:43.268 INFO:tasks.workunit.client.1.smithi150.stdout:7/836: truncate d2/d1b/ff7 165603 0 2023-12-05T09:57:43.275 INFO:tasks.workunit.client.1.smithi150.stdout:6/718: sync 2023-12-05T09:57:43.275 INFO:tasks.workunit.client.1.smithi150.stdout:0/875: sync 2023-12-05T09:57:43.275 INFO:tasks.workunit.client.1.smithi150.stdout:6/719: dread - d2/d23/d2e/d72/fe7 zero size 2023-12-05T09:57:43.275 INFO:tasks.workunit.client.1.smithi150.stdout:6/720: write d2/d23/d2e/fad [771082,120873] 0 2023-12-05T09:57:43.275 INFO:tasks.workunit.client.1.smithi150.stdout:3/856: rmdir d6/d9/d8d 39 2023-12-05T09:57:43.282 INFO:tasks.workunit.client.0.smithi100.stdout:4/749: mknod de/d16/d23/d33/dae/dd3/cf4 0 2023-12-05T09:57:43.282 INFO:tasks.workunit.client.0.smithi100.stdout:4/750: creat de/d16/d23/d60/dc4/ff5 x:0 0 0 2023-12-05T09:57:43.282 INFO:tasks.workunit.client.0.smithi100.stdout:0/750: mkdir da/de1 0 2023-12-05T09:57:43.282 INFO:tasks.workunit.client.0.smithi100.stdout:0/751: chown da/d22/d33/fa9 8 1 2023-12-05T09:57:43.288 INFO:tasks.workunit.client.1.smithi150.stdout:9/746: symlink d3/d42/dd2/lf1 0 2023-12-05T09:57:43.290 INFO:tasks.workunit.client.0.smithi100.stdout:7/758: sync 2023-12-05T09:57:43.290 INFO:tasks.workunit.client.0.smithi100.stdout:7/759: write d3/dc/d11/d13/de/d18/d3b/f5d [2110971,3914] 0 2023-12-05T09:57:43.290 INFO:tasks.workunit.client.0.smithi100.stdout:7/760: chown d3/dc/d11/d13/de/d2d/d47/l6e 809369 1 2023-12-05T09:57:43.290 INFO:tasks.workunit.client.1.smithi150.stdout:8/875: dwrite d0/d41/d49/d1b/f1d [0,4194304] 0 2023-12-05T09:57:43.294 INFO:tasks.workunit.client.0.smithi100.stdout:9/826: truncate d7/d20/d68/fe9 1128879 0 2023-12-05T09:57:43.294 INFO:tasks.workunit.client.0.smithi100.stdout:2/907: dwrite d7/da/d18/d1b/d2c/d3f/d46/f26 [0,4194304] 0 2023-12-05T09:57:43.294 INFO:tasks.workunit.client.1.smithi150.stdout:1/847: rename d6/d47/d4c/c6c to d6/d38/d128/c12c 0 2023-12-05T09:57:43.295 INFO:tasks.workunit.client.1.smithi150.stdout:1/848: chown d6/d38/c127 745 1 2023-12-05T09:57:43.295 INFO:tasks.workunit.client.1.smithi150.stdout:1/849: chown d6/d8/db/f6e 478168 1 2023-12-05T09:57:43.295 INFO:tasks.workunit.client.1.smithi150.stdout:1/850: chown d6/d8/d54/d94/cee 6523550 1 2023-12-05T09:57:43.297 INFO:tasks.workunit.client.1.smithi150.stdout:5/838: dwrite d1/d7f/d65/d3b/d8d/fa8 [0,4194304] 0 2023-12-05T09:57:43.298 INFO:tasks.workunit.client.1.smithi150.stdout:0/876: mkdir d5/d11/db6/d12b 0 2023-12-05T09:57:43.301 INFO:tasks.workunit.client.0.smithi100.stdout:5/841: rmdir d0/d1b/d4d/d8e/d96/dea/dff 39 2023-12-05T09:57:43.305 INFO:tasks.workunit.client.0.smithi100.stdout:8/735: dread d0/d35/f70 [0,4194304] 0 2023-12-05T09:57:43.310 INFO:tasks.workunit.client.1.smithi150.stdout:9/747: write d3/d9/dc/f4b [4005955,21094] 0 2023-12-05T09:57:43.311 INFO:tasks.workunit.client.0.smithi100.stdout:7/761: symlink d3/dc/d11/d13/d37/d97/l11a 0 2023-12-05T09:57:43.318 INFO:tasks.workunit.client.1.smithi150.stdout:2/854: dwrite d0/d3/d21/d4d/deb/d103/fd4 [0,4194304] 0 2023-12-05T09:57:43.319 INFO:tasks.workunit.client.0.smithi100.stdout:1/785: sync 2023-12-05T09:57:43.323 INFO:tasks.workunit.client.0.smithi100.stdout:9/827: mkdir d7/d1b/d127 0 2023-12-05T09:57:43.324 INFO:tasks.workunit.client.1.smithi150.stdout:8/876: link d0/d41/d49/d1b/l32 d0/d41/d49/d1b/d24/d34/da2/dff/l111 0 2023-12-05T09:57:43.324 INFO:tasks.workunit.client.1.smithi150.stdout:8/877: chown d0/d41/d49/d1b/d24/d38/f78 7225 1 2023-12-05T09:57:43.324 INFO:tasks.workunit.client.0.smithi100.stdout:2/908: creat d7/da/d13/d4e/f132 x:0 0 0 2023-12-05T09:57:43.324 INFO:tasks.workunit.client.0.smithi100.stdout:2/909: dread - d7/da/d18/d1b/d2c/d3f/d46/dc8/dfe/f116 zero size 2023-12-05T09:57:43.324 INFO:tasks.workunit.client.0.smithi100.stdout:2/910: readlink d7/da/lcf 0 2023-12-05T09:57:43.326 INFO:tasks.workunit.client.1.smithi150.stdout:1/851: mkdir d6/d3c/dc2/dde/df4/d10a/d12d 0 2023-12-05T09:57:43.326 INFO:tasks.workunit.client.1.smithi150.stdout:1/852: fsync d6/d38/da1/dc6/fcb 0 2023-12-05T09:57:43.330 INFO:tasks.workunit.client.0.smithi100.stdout:5/842: rename d0/d16/f68 to d0/d1f/da1/d11b/df/d51/da8/dee/f12b 0 2023-12-05T09:57:43.333 INFO:tasks.workunit.client.0.smithi100.stdout:8/736: mkdir d0/db7/dcf 0 2023-12-05T09:57:43.339 INFO:tasks.workunit.client.1.smithi150.stdout:5/839: truncate d1/d2e/da6/d24/f41 3051668 0 2023-12-05T09:57:43.341 INFO:tasks.workunit.client.0.smithi100.stdout:1/786: rmdir db/d12/d1e/d26/d30/d52/d84 39 2023-12-05T09:57:43.343 INFO:tasks.workunit.client.1.smithi150.stdout:0/877: symlink d5/d11/d71/d99/d9c/d96/dd5/d7f/l12c 0 2023-12-05T09:57:43.352 INFO:tasks.workunit.client.0.smithi100.stdout:2/911: symlink d7/da/ddc/d11c/l133 0 2023-12-05T09:57:43.352 INFO:tasks.workunit.client.0.smithi100.stdout:4/751: write de/d16/d23/d36/f3e [3988654,70559] 0 2023-12-05T09:57:43.352 INFO:tasks.workunit.client.0.smithi100.stdout:4/752: stat de/d38/cd4 0 2023-12-05T09:57:43.352 INFO:tasks.workunit.client.0.smithi100.stdout:8/737: mknod d0/d12/d13/d45/dba/dbd/d72/da9/cd0 0 2023-12-05T09:57:43.352 INFO:tasks.workunit.client.0.smithi100.stdout:3/884: dwrite d0/d3d/d5c/d6f/d7f/d87/f9a [0,4194304] 0 2023-12-05T09:57:43.355 INFO:tasks.workunit.client.1.smithi150.stdout:9/748: creat d3/d9/d9c/ff2 x:0 0 0 2023-12-05T09:57:43.355 INFO:tasks.workunit.client.1.smithi150.stdout:9/749: fdatasync d3/d1b/d46/d55/fc4 0 2023-12-05T09:57:43.357 INFO:tasks.workunit.client.0.smithi100.stdout:4/753: symlink de/d16/d23/d60/d98/lf6 0 2023-12-05T09:57:43.358 INFO:tasks.workunit.client.1.smithi150.stdout:6/721: dwrite d2/d23/d3b/d64/d7a/d5d/d6b/f4b [0,4194304] 0 2023-12-05T09:57:43.359 INFO:tasks.workunit.client.1.smithi150.stdout:3/857: dwrite d6/d22/f31 [0,4194304] 0 2023-12-05T09:57:43.361 INFO:tasks.workunit.client.0.smithi100.stdout:8/738: write d0/d35/d64/f85 [457686,9388] 0 2023-12-05T09:57:43.364 INFO:tasks.workunit.client.0.smithi100.stdout:0/752: dwrite da/d2a/d4d/fa2 [0,4194304] 0 2023-12-05T09:57:43.365 INFO:tasks.workunit.client.0.smithi100.stdout:0/753: write da/d2a/fc3 [396964,90313] 0 2023-12-05T09:57:43.365 INFO:tasks.workunit.client.0.smithi100.stdout:0/754: readlink da/d60/l7a 0 2023-12-05T09:57:43.369 INFO:tasks.workunit.client.0.smithi100.stdout:3/885: rename d0/f36 to d0/d3d/d5c/d6f/d7f/f132 0 2023-12-05T09:57:43.375 INFO:tasks.workunit.client.1.smithi150.stdout:8/878: symlink d0/d41/d49/d1b/d24/d34/da2/dff/l112 0 2023-12-05T09:57:43.380 INFO:tasks.workunit.client.1.smithi150.stdout:9/750: dread d3/d1b/d46/d55/fc4 [0,4194304] 0 2023-12-05T09:57:43.381 INFO:tasks.workunit.client.1.smithi150.stdout:1/853: creat d6/d8/f12e x:0 0 0 2023-12-05T09:57:43.386 INFO:tasks.workunit.client.1.smithi150.stdout:1/854: write d6/d38/f81 [879212,104717] 0 2023-12-05T09:57:43.387 INFO:tasks.workunit.client.1.smithi150.stdout:1/855: chown f4 1561 1 2023-12-05T09:57:43.387 INFO:tasks.workunit.client.1.smithi150.stdout:8/879: dread d0/d41/d49/d1b/d24/d38/d62/dac/f10a [0,4194304] 0 2023-12-05T09:57:43.388 INFO:tasks.workunit.client.0.smithi100.stdout:3/886: link d0/d3d/d5c/fd8 d0/d10/d39/f133 0 2023-12-05T09:57:43.390 INFO:tasks.workunit.client.0.smithi100.stdout:3/887: mkdir d0/d2/de/d8d/dc9/d134 0 2023-12-05T09:57:43.390 INFO:tasks.workunit.client.0.smithi100.stdout:8/739: rename d0/f31 to d0/d12/d13/d45/fd1 0 2023-12-05T09:57:43.390 INFO:tasks.workunit.client.0.smithi100.stdout:8/740: chown d0/d12/l15 6 1 2023-12-05T09:57:43.393 INFO:tasks.workunit.client.1.smithi150.stdout:5/840: creat d1/d7f/d65/d3b/d6b/d11e/d9a/dc7/f12b x:0 0 0 2023-12-05T09:57:43.397 INFO:tasks.workunit.client.1.smithi150.stdout:0/878: mkdir d5/d11/d71/d99/d9c/d3b/de0/d106/d12d 0 2023-12-05T09:57:43.397 INFO:tasks.workunit.client.1.smithi150.stdout:6/722: mkdir d2/d23/d3b/db4/df1 0 2023-12-05T09:57:43.397 INFO:tasks.workunit.client.1.smithi150.stdout:3/858: mkdir d6/d9/d114 0 2023-12-05T09:57:43.398 INFO:tasks.workunit.client.1.smithi150.stdout:2/855: dwrite d0/d3/d27/d51/d125/f106 [0,4194304] 0 2023-12-05T09:57:43.400 INFO:tasks.workunit.client.1.smithi150.stdout:1/856: unlink d6/d8/d54/d94/df5/f11d 0 2023-12-05T09:57:43.405 INFO:tasks.workunit.client.1.smithi150.stdout:0/879: mkdir d5/d11/db6/d12e 0 2023-12-05T09:57:43.405 INFO:tasks.workunit.client.1.smithi150.stdout:6/723: creat d2/d23/d2e/d5f/d99/dd8/ff2 x:0 0 0 2023-12-05T09:57:43.406 INFO:tasks.workunit.client.0.smithi100.stdout:9/828: dwrite d7/f9 [0,4194304] 0 2023-12-05T09:57:43.407 INFO:tasks.workunit.client.0.smithi100.stdout:4/754: write de/d16/d23/f26 [3751862,108011] 0 2023-12-05T09:57:43.407 INFO:tasks.workunit.client.0.smithi100.stdout:4/755: readlink de/d16/d1e/lf2 0 2023-12-05T09:57:43.408 INFO:tasks.workunit.client.1.smithi150.stdout:5/841: dread d1/f8c [0,4194304] 0 2023-12-05T09:57:43.409 INFO:tasks.workunit.client.0.smithi100.stdout:5/843: dwrite d0/d1b/d4d/d8e/d96/dc1/fce [0,4194304] 0 2023-12-05T09:57:43.410 INFO:tasks.workunit.client.0.smithi100.stdout:8/741: dread d0/d12/f48 [0,4194304] 0 2023-12-05T09:57:43.410 INFO:tasks.workunit.client.0.smithi100.stdout:7/762: dwrite d3/dc/d11/f1e [0,4194304] 0 2023-12-05T09:57:43.410 INFO:tasks.workunit.client.0.smithi100.stdout:7/763: creat d3/dc/d11/d13/de/d18/d3b/f11b x:0 0 0 2023-12-05T09:57:43.410 INFO:tasks.workunit.client.0.smithi100.stdout:7/764: chown d3/dc/d11/f110 196243 1 2023-12-05T09:57:43.410 INFO:tasks.workunit.client.0.smithi100.stdout:5/844: creat d0/d1b/d4d/f12c x:0 0 0 2023-12-05T09:57:43.410 INFO:tasks.workunit.client.0.smithi100.stdout:2/912: dwrite d7/da/d18/f62 [0,4194304] 0 2023-12-05T09:57:43.413 INFO:tasks.workunit.client.0.smithi100.stdout:9/829: mkdir d7/d20/d69/def/d128 0 2023-12-05T09:57:43.413 INFO:tasks.workunit.client.0.smithi100.stdout:9/830: chown d7/d35/d71/d9a/dcd/d122/f104 1833659 1 2023-12-05T09:57:43.430 INFO:tasks.workunit.client.1.smithi150.stdout:2/856: creat d0/d3/d21/d77/dd2/f129 x:0 0 0 2023-12-05T09:57:43.430 INFO:tasks.workunit.client.1.smithi150.stdout:2/857: write d0/d3/d5/d22/fbf [770167,77017] 0 2023-12-05T09:57:43.430 INFO:tasks.workunit.client.1.smithi150.stdout:2/858: write d0/d3/d5/d3b/f122 [658780,33093] 0 2023-12-05T09:57:43.433 INFO:tasks.workunit.client.1.smithi150.stdout:1/857: mknod d6/d8/d85/d113/c12f 0 2023-12-05T09:57:43.433 INFO:tasks.workunit.client.1.smithi150.stdout:1/858: fdatasync d6/d3c/f7e 0 2023-12-05T09:57:43.434 INFO:tasks.workunit.client.0.smithi100.stdout:8/742: chown d0/d12/d13/d45/da6/d76/d91/d99 6810 1 2023-12-05T09:57:43.443 INFO:tasks.workunit.client.0.smithi100.stdout:7/765: rename d3/dc/d11/d13/de/d18/dcb/fe8 to d3/dc/f11c 0 2023-12-05T09:57:43.443 INFO:tasks.workunit.client.0.smithi100.stdout:2/913: creat d7/f134 x:0 0 0 2023-12-05T09:57:43.457 INFO:tasks.workunit.client.1.smithi150.stdout:3/859: dwrite d6/d25/f70 [0,4194304] 0 2023-12-05T09:57:43.462 INFO:tasks.workunit.client.0.smithi100.stdout:8/743: rmdir d0/d12/d13/d45/da6/d9c/dc5 0 2023-12-05T09:57:43.462 INFO:tasks.workunit.client.0.smithi100.stdout:7/766: link d3/dc/d11/d13/de/f28 d3/dc/d11/d13/de/d18/f11d 0 2023-12-05T09:57:43.464 INFO:tasks.workunit.client.0.smithi100.stdout:2/914: unlink d7/da/d18/d21/d86/f129 0 2023-12-05T09:57:43.464 INFO:tasks.workunit.client.0.smithi100.stdout:2/915: truncate d7/f43 1914692 0 2023-12-05T09:57:43.465 INFO:tasks.workunit.client.0.smithi100.stdout:0/755: dwrite da/d22/d33/d74/dca/db4/fc0 [0,4194304] 0 2023-12-05T09:57:43.468 INFO:tasks.workunit.client.0.smithi100.stdout:5/845: symlink d0/d1f/l12d 0 2023-12-05T09:57:43.471 INFO:tasks.workunit.client.1.smithi150.stdout:2/859: dwrite d0/d3/d21/d4d/deb/d103/db9/fcb [0,4194304] 0 2023-12-05T09:57:43.472 INFO:tasks.workunit.client.1.smithi150.stdout:9/751: dwrite d3/d9/dc/d1f/f5f [0,4194304] 0 2023-12-05T09:57:43.472 INFO:tasks.workunit.client.1.smithi150.stdout:5/842: dwrite d1/f51 [0,4194304] 0 2023-12-05T09:57:43.479 INFO:tasks.workunit.client.0.smithi100.stdout:8/744: rmdir d0/d12/d13/d45/dba/dbd/d72 39 2023-12-05T09:57:43.485 INFO:tasks.workunit.client.0.smithi100.stdout:7/767: write d3/dc/d11/f1e [4089460,112590] 0 2023-12-05T09:57:43.486 INFO:tasks.workunit.client.0.smithi100.stdout:2/916: dread d7/da/d18/d1b/d2c/d3f/d46/f76 [0,4194304] 0 2023-12-05T09:57:43.486 INFO:tasks.workunit.client.0.smithi100.stdout:2/917: fsync d7/da/d18/d21/d4d/d81/f131 0 2023-12-05T09:57:43.489 INFO:tasks.workunit.client.0.smithi100.stdout:5/846: getdents d0/d27/dc0 0 2023-12-05T09:57:43.492 INFO:tasks.workunit.client.0.smithi100.stdout:0/756: write da/d2a/d4d/fa2 [4083364,127700] 0 2023-12-05T09:57:43.492 INFO:tasks.workunit.client.0.smithi100.stdout:9/831: dwrite d7/d1b/d22/d51/f5f [4194304,4194304] 0 2023-12-05T09:57:43.492 INFO:tasks.workunit.client.0.smithi100.stdout:9/832: stat d7/d1b/d22/lc7 0 2023-12-05T09:57:43.493 INFO:tasks.workunit.client.0.smithi100.stdout:4/756: dwrite de/d16/d23/d33/dae/fbc [0,4194304] 0 2023-12-05T09:57:43.493 INFO:tasks.workunit.client.0.smithi100.stdout:4/757: stat de/d16/d23/d33/d3d/fce 0 2023-12-05T09:57:43.493 INFO:tasks.workunit.client.0.smithi100.stdout:2/918: rmdir d7/da/d13/d69 39 2023-12-05T09:57:43.494 INFO:tasks.workunit.client.0.smithi100.stdout:5/847: rmdir d0/d1b/d4d/d6c/d104/d124 0 2023-12-05T09:57:43.496 INFO:tasks.workunit.client.0.smithi100.stdout:7/768: mknod d3/dc/d11/d13/de/d18/d3b/d40/d4c/c11e 0 2023-12-05T09:57:43.499 INFO:tasks.workunit.client.1.smithi150.stdout:8/880: rmdir d0 39 2023-12-05T09:57:43.500 INFO:tasks.workunit.client.1.smithi150.stdout:4/755: sync 2023-12-05T09:57:43.500 INFO:tasks.workunit.client.1.smithi150.stdout:7/837: sync 2023-12-05T09:57:43.511 INFO:tasks.workunit.client.1.smithi150.stdout:0/880: rmdir d5/d11/d71/ddb 39 2023-12-05T09:57:43.511 INFO:tasks.workunit.client.1.smithi150.stdout:0/881: chown d5/d11/d71/d99 182 1 2023-12-05T09:57:43.511 INFO:tasks.workunit.client.1.smithi150.stdout:6/724: mkdir d2/d23/d2e/dd6/df3 0 2023-12-05T09:57:43.511 INFO:tasks.workunit.client.1.smithi150.stdout:0/882: chown d5/d11/d71/d5f/lcb 11 1 2023-12-05T09:57:43.519 INFO:tasks.workunit.client.1.smithi150.stdout:1/859: link d6/d8/db/c29 d6/d47/dcf/c130 0 2023-12-05T09:57:43.520 INFO:tasks.workunit.client.1.smithi150.stdout:1/860: chown d6/d8/d59 116058280 1 2023-12-05T09:57:43.530 INFO:tasks.workunit.client.1.smithi150.stdout:9/752: dwrite d3/d9/dc/d1f/fa1 [4194304,4194304] 0 2023-12-05T09:57:43.530 INFO:tasks.workunit.client.1.smithi150.stdout:9/753: creat d3/d9/dc/ff3 x:0 0 0 2023-12-05T09:57:43.531 INFO:tasks.workunit.client.1.smithi150.stdout:3/860: creat d6/d9/d3d/d56/f115 x:0 0 0 2023-12-05T09:57:43.531 INFO:tasks.workunit.client.1.smithi150.stdout:2/860: mkdir d0/d3/d27/dac/d12a 0 2023-12-05T09:57:43.533 INFO:tasks.workunit.client.1.smithi150.stdout:8/881: mkdir d0/d41/d49/d1b/d24/d34/d56/d67/d64/d113 0 2023-12-05T09:57:43.533 INFO:tasks.workunit.client.1.smithi150.stdout:5/843: creat d1/d7f/d65/d3b/d6b/d11e/dca/dcd/f12c x:0 0 0 2023-12-05T09:57:43.533 INFO:tasks.workunit.client.1.smithi150.stdout:4/756: mknod d0/d3e/d6d/ddf/da4/dd7/ce9 0 2023-12-05T09:57:43.533 INFO:tasks.workunit.client.1.smithi150.stdout:8/882: write d0/fc4 [4263803,54107] 0 2023-12-05T09:57:43.533 INFO:tasks.workunit.client.1.smithi150.stdout:8/883: write d0/d41/d49/d1b/d24/d38/d62/f68 [1321146,129536] 0 2023-12-05T09:57:43.534 INFO:tasks.workunit.client.1.smithi150.stdout:6/725: creat d2/d23/d3b/d64/d7a/ff4 x:0 0 0 2023-12-05T09:57:43.540 INFO:tasks.workunit.client.1.smithi150.stdout:0/883: mknod d5/d11/d65/d82/c12f 0 2023-12-05T09:57:43.540 INFO:tasks.workunit.client.1.smithi150.stdout:0/884: dread - d5/d11/d71/d99/d9c/d96/dd5/f11d zero size 2023-12-05T09:57:43.540 INFO:tasks.workunit.client.1.smithi150.stdout:1/861: mkdir d6/d3c/d131 0 2023-12-05T09:57:43.541 INFO:tasks.workunit.client.0.smithi100.stdout:2/919: creat d7/da/d18/d21/f135 x:0 0 0 2023-12-05T09:57:43.541 INFO:tasks.workunit.client.0.smithi100.stdout:2/920: chown d7/da/d13/d69/ffc 131841 1 2023-12-05T09:57:43.541 INFO:tasks.workunit.client.0.smithi100.stdout:5/848: mkdir d0/d1b/d4d/d8e/d96/dc1/d12e 0 2023-12-05T09:57:43.541 INFO:tasks.workunit.client.0.smithi100.stdout:5/849: dread - d0/d1b/fa5 zero size 2023-12-05T09:57:43.542 INFO:tasks.workunit.client.1.smithi150.stdout:1/862: write d6/d8/fc5 [458722,112721] 0 2023-12-05T09:57:43.542 INFO:tasks.workunit.client.1.smithi150.stdout:1/863: dread - d6/d47/dcf/f126 zero size 2023-12-05T09:57:43.547 INFO:tasks.workunit.client.1.smithi150.stdout:5/844: dread d1/d7f/fde [0,4194304] 0 2023-12-05T09:57:43.547 INFO:tasks.workunit.client.1.smithi150.stdout:5/845: chown d1/d7f/d65/d3b/d6b/c78 84416 1 2023-12-05T09:57:43.547 INFO:tasks.workunit.client.1.smithi150.stdout:5/846: truncate d1/d7f/d65/d3b/d6b/d11e/d9a/dc7/f12b 1036407 0 2023-12-05T09:57:43.547 INFO:tasks.workunit.client.1.smithi150.stdout:5/847: truncate d1/d3/d6/ff0 982972 0 2023-12-05T09:57:43.548 INFO:tasks.workunit.client.0.smithi100.stdout:9/833: rmdir d7/d1b/d22/d93/dd9 39 2023-12-05T09:57:43.548 INFO:tasks.workunit.client.0.smithi100.stdout:9/834: chown d7/d35/d71/d9a/dcd 4265161 1 2023-12-05T09:57:43.549 INFO:tasks.workunit.client.0.smithi100.stdout:5/850: mknod d0/d16/d2b/de3/c12f 0 2023-12-05T09:57:43.551 INFO:tasks.workunit.client.0.smithi100.stdout:9/835: link d7/d20/d69/def/l6c d7/d20/d69/d108/l129 0 2023-12-05T09:57:43.551 INFO:tasks.workunit.client.0.smithi100.stdout:9/836: chown d7/d35/f65 63 1 2023-12-05T09:57:43.552 INFO:tasks.workunit.client.1.smithi150.stdout:9/754: creat d3/d42/dd2/ff4 x:0 0 0 2023-12-05T09:57:43.552 INFO:tasks.workunit.client.1.smithi150.stdout:3/861: mkdir d6/d9/d116 0 2023-12-05T09:57:43.552 INFO:tasks.workunit.client.1.smithi150.stdout:2/861: getdents d0/d3/d5/d10 0 2023-12-05T09:57:43.554 INFO:tasks.workunit.client.0.smithi100.stdout:5/851: unlink d0/d27/l40 0 2023-12-05T09:57:43.555 INFO:tasks.workunit.client.0.smithi100.stdout:5/852: truncate d0/d1f/da1/d11b/df/fe4 729857 0 2023-12-05T09:57:43.555 INFO:tasks.workunit.client.1.smithi150.stdout:8/884: link d0/f13 d0/d41/d49/d1b/d24/d2e/d105/f114 0 2023-12-05T09:57:43.558 INFO:tasks.workunit.client.1.smithi150.stdout:7/838: dwrite d2/f12 [0,4194304] 0 2023-12-05T09:57:43.561 INFO:tasks.workunit.client.0.smithi100.stdout:9/837: link d7/d1b/d22/d51/d32/le6 d7/d35/d71/d9a/dcd/d122/l12a 0 2023-12-05T09:57:43.561 INFO:tasks.workunit.client.0.smithi100.stdout:9/838: chown d7/d1b/l39 1 1 2023-12-05T09:57:43.561 INFO:tasks.workunit.client.0.smithi100.stdout:5/853: unlink d0/d1f/d53/f8a 0 2023-12-05T09:57:43.568 INFO:tasks.workunit.client.1.smithi150.stdout:1/864: rename d6/d47/d4c/d60/f69 to d6/d3c/dc2/dde/df4/d10a/f132 0 2023-12-05T09:57:43.568 INFO:tasks.workunit.client.1.smithi150.stdout:5/848: creat d1/d7f/d65/d3b/f12d x:0 0 0 2023-12-05T09:57:43.568 INFO:tasks.workunit.client.1.smithi150.stdout:3/862: creat d6/d9/d114/f117 x:0 0 0 2023-12-05T09:57:43.569 INFO:tasks.workunit.client.1.smithi150.stdout:8/885: mknod d0/d41/d49/d1b/d24/d5b/ddc/c115 0 2023-12-05T09:57:43.570 INFO:tasks.workunit.client.1.smithi150.stdout:0/885: getdents d5/d11/d16 0 2023-12-05T09:57:43.573 INFO:tasks.workunit.client.1.smithi150.stdout:0/886: write d5/d11/d71/f10e [467618,53034] 0 2023-12-05T09:57:43.573 INFO:tasks.workunit.client.1.smithi150.stdout:0/887: chown d5/d11/d71/d99/d9c/d3b/c94 47804530 1 2023-12-05T09:57:43.573 INFO:tasks.workunit.client.1.smithi150.stdout:0/888: fdatasync d5/d11/d71/d99/d9c/d96/dd5/f11d 0 2023-12-05T09:57:43.574 INFO:tasks.workunit.client.1.smithi150.stdout:0/889: write d5/d11/d32/f39 [7605619,4601] 0 2023-12-05T09:57:43.575 INFO:tasks.workunit.client.1.smithi150.stdout:2/862: rename d0/d3/c4b to d0/d3/d5/c12b 0 2023-12-05T09:57:43.579 INFO:tasks.workunit.client.1.smithi150.stdout:1/865: mknod d6/d38/da1/dc6/c133 0 2023-12-05T09:57:43.582 INFO:tasks.workunit.client.1.smithi150.stdout:5/849: symlink d1/d2e/da6/d24/d59/d104/l12e 0 2023-12-05T09:57:43.586 INFO:tasks.workunit.client.1.smithi150.stdout:5/850: fsync d1/f51 0 2023-12-05T09:57:43.586 INFO:tasks.workunit.client.0.smithi100.stdout:4/758: dwrite de/d38/d8b/fc7 [0,4194304] 0 2023-12-05T09:57:43.590 INFO:tasks.workunit.client.0.smithi100.stdout:4/759: truncate de/d16/d23/d33/d3d/d44/f4d 4060029 0 2023-12-05T09:57:43.593 INFO:tasks.workunit.client.0.smithi100.stdout:4/760: dread - de/d16/d23/fbf zero size 2023-12-05T09:57:43.593 INFO:tasks.workunit.client.0.smithi100.stdout:4/761: write f2 [5203145,59095] 0 2023-12-05T09:57:43.598 INFO:tasks.workunit.client.1.smithi150.stdout:0/890: write d5/f23 [3222092,119223] 0 2023-12-05T09:57:43.615 INFO:tasks.workunit.client.1.smithi150.stdout:1/866: truncate d6/d8/fc5 1480275 0 2023-12-05T09:57:43.619 INFO:tasks.workunit.client.1.smithi150.stdout:6/726: write d2/d23/f67 [1896124,81127] 0 2023-12-05T09:57:43.620 INFO:tasks.workunit.client.1.smithi150.stdout:8/886: rename d0/d41/d49/d1b/d24/d5b/ddc to d0/da1/dfb/d110/d116 0 2023-12-05T09:57:43.621 INFO:tasks.workunit.client.1.smithi150.stdout:9/755: dread d3/d1b/d46/d55/d64/f7c [0,4194304] 0 2023-12-05T09:57:43.627 INFO:tasks.workunit.client.1.smithi150.stdout:0/891: dread d5/d11/d71/d99/d9c/d96/dd5/d67/da8/fa9 [0,4194304] 0 2023-12-05T09:57:43.629 INFO:tasks.workunit.client.1.smithi150.stdout:0/892: mknod d5/d11/d71/d99/d9c/d3b/dad/c130 0 2023-12-05T09:57:43.631 INFO:tasks.workunit.client.1.smithi150.stdout:0/893: getdents d5/d11/d71/d5f/d77/d87 0 2023-12-05T09:57:43.631 INFO:tasks.workunit.client.1.smithi150.stdout:0/894: fdatasync d5/d11/d71/d99/d9c/d96/dd5/d7f/f116 0 2023-12-05T09:57:43.634 INFO:tasks.workunit.client.0.smithi100.stdout:8/745: dwrite d0/d35/d64/f7c [0,4194304] 0 2023-12-05T09:57:43.634 INFO:tasks.workunit.client.0.smithi100.stdout:8/746: truncate d0/d12/fc1 262738 0 2023-12-05T09:57:43.634 INFO:tasks.workunit.client.0.smithi100.stdout:8/747: write d0/d12/fc1 [661642,79849] 0 2023-12-05T09:57:43.640 INFO:tasks.workunit.client.0.smithi100.stdout:8/748: creat d0/d35/fd2 x:0 0 0 2023-12-05T09:57:43.642 INFO:tasks.workunit.client.0.smithi100.stdout:0/757: dwrite da/d22/d33/d7f/d94/f9c [0,4194304] 0 2023-12-05T09:57:43.642 INFO:tasks.workunit.client.0.smithi100.stdout:0/758: fdatasync da/d1b/f54 0 2023-12-05T09:57:43.643 INFO:tasks.workunit.client.0.smithi100.stdout:4/762: rename de/d16/d23/d33/d3d/d44 to de/d16/d23/d60/df7 0 2023-12-05T09:57:43.648 INFO:tasks.workunit.client.0.smithi100.stdout:4/763: creat de/d16/d23/d60/de3/ff8 x:0 0 0 2023-12-05T09:57:43.650 INFO:tasks.workunit.client.1.smithi150.stdout:9/756: write d3/f71 [3918287,82440] 0 2023-12-05T09:57:43.653 INFO:tasks.workunit.client.0.smithi100.stdout:2/921: dwrite d7/da/d18/d1b/d2c/d3f/fd1 [0,4194304] 0 2023-12-05T09:57:43.653 INFO:tasks.workunit.client.0.smithi100.stdout:7/769: dwrite d3/dc/f1d [0,4194304] 0 2023-12-05T09:57:43.653 INFO:tasks.workunit.client.0.smithi100.stdout:7/770: truncate d3/dc/daa/f102 1489689 0 2023-12-05T09:57:43.653 INFO:tasks.workunit.client.0.smithi100.stdout:7/771: read - d3/dc/d11/d13/de/d2d/d42/fc8 zero size 2023-12-05T09:57:43.656 INFO:tasks.workunit.client.0.smithi100.stdout:4/764: mkdir de/d66/df9 0 2023-12-05T09:57:43.661 INFO:tasks.workunit.client.1.smithi150.stdout:5/851: dread d1/d2e/f52 [0,4194304] 0 2023-12-05T09:57:43.661 INFO:tasks.workunit.client.1.smithi150.stdout:5/852: chown d1/d3/ce 2140 1 2023-12-05T09:57:43.667 INFO:tasks.workunit.client.1.smithi150.stdout:7/839: dwrite d2/db/d30/daf/dd3/fa8 [0,4194304] 0 2023-12-05T09:57:43.667 INFO:tasks.workunit.client.1.smithi150.stdout:7/840: read - d2/db/d30/d53/d90/fb8 zero size 2023-12-05T09:57:43.667 INFO:tasks.workunit.client.1.smithi150.stdout:7/841: creat d2/db/d30/d13/d4f/d5a/d5c/f117 x:0 0 0 2023-12-05T09:57:43.668 INFO:tasks.workunit.client.1.smithi150.stdout:0/895: read d5/d11/d71/d99/d9c/fcf [2058825,37800] 0 2023-12-05T09:57:43.668 INFO:tasks.workunit.client.1.smithi150.stdout:2/863: dwrite d0/d3/d11/fbe [0,4194304] 0 2023-12-05T09:57:43.668 INFO:tasks.workunit.client.1.smithi150.stdout:2/864: readlink d0/d3/d21/d4d/l87 0 2023-12-05T09:57:43.678 INFO:tasks.workunit.client.1.smithi150.stdout:3/863: dwrite d6/d9/d3d/d52/f65 [0,4194304] 0 2023-12-05T09:57:43.679 INFO:tasks.workunit.client.0.smithi100.stdout:5/854: dwrite d0/d1b/d4d/d8e/fef [0,4194304] 0 2023-12-05T09:57:43.679 INFO:tasks.workunit.client.0.smithi100.stdout:5/855: truncate d0/d1f/da1/d11b/df/fe2 698271 0 2023-12-05T09:57:43.679 INFO:tasks.workunit.client.1.smithi150.stdout:0/896: mknod d5/d11/d71/d99/d9c/d96/dd5/d7f/db4/dfb/c131 0 2023-12-05T09:57:43.685 INFO:tasks.workunit.client.1.smithi150.stdout:9/757: dread d3/d9/dc/d1f/f25 [0,4194304] 0 2023-12-05T09:57:43.686 INFO:tasks.workunit.client.1.smithi150.stdout:0/897: write d5/d11/d65/fd8 [181399,97970] 0 2023-12-05T09:57:43.695 INFO:tasks.workunit.client.1.smithi150.stdout:9/758: link d3/d9/d26/d34/f5b d3/d1b/d46/d55/ff5 0 2023-12-05T09:57:43.695 INFO:tasks.workunit.client.1.smithi150.stdout:6/727: dwrite d2/d23/d3b/df0/fd7 [0,4194304] 0 2023-12-05T09:57:43.697 INFO:tasks.workunit.client.0.smithi100.stdout:8/749: dwrite d0/d12/f32 [0,4194304] 0 2023-12-05T09:57:43.699 INFO:tasks.workunit.client.1.smithi150.stdout:0/898: truncate d5/d11/d32/f50 3861698 0 2023-12-05T09:57:43.699 INFO:tasks.workunit.client.1.smithi150.stdout:0/899: fdatasync d5/d11/d16/f63 0 2023-12-05T09:57:43.705 INFO:tasks.workunit.client.1.smithi150.stdout:9/759: mkdir d3/d9/d26/d9b/df6 0 2023-12-05T09:57:43.705 INFO:tasks.workunit.client.1.smithi150.stdout:9/760: readlink d3/d9/d26/l74 0 2023-12-05T09:57:43.705 INFO:tasks.workunit.client.1.smithi150.stdout:9/761: read - d3/d9/dc/d1f/d24/d75/d95/dbc/dad/db7/fe3 zero size 2023-12-05T09:57:43.708 INFO:tasks.workunit.client.0.smithi100.stdout:5/856: rename d0/d1b/d4d/f58 to d0/d1f/d25/d31/f130 0 2023-12-05T09:57:43.716 INFO:tasks.workunit.client.1.smithi150.stdout:0/900: mknod d5/d11/d32/c132 0 2023-12-05T09:57:43.718 INFO:tasks.workunit.client.0.smithi100.stdout:8/750: mknod d0/d35/d64/d81/d9a/dc6/cd3 0 2023-12-05T09:57:43.718 INFO:tasks.workunit.client.0.smithi100.stdout:8/751: fdatasync d0/d12/d13/d45/dba/dbd/d82/fb5 0 2023-12-05T09:57:43.719 INFO:tasks.workunit.client.1.smithi150.stdout:6/728: write d2/d23/d3b/df0/d97/f98 [1839556,86530] 0 2023-12-05T09:57:43.719 INFO:tasks.workunit.client.1.smithi150.stdout:9/762: creat d3/d82/ff7 x:0 0 0 2023-12-05T09:57:43.720 INFO:tasks.workunit.client.1.smithi150.stdout:1/867: dwrite d6/d3c/fd6 [0,4194304] 0 2023-12-05T09:57:43.722 INFO:tasks.workunit.client.0.smithi100.stdout:5/857: symlink d0/d1f/d25/d31/l131 0 2023-12-05T09:57:43.723 INFO:tasks.workunit.client.1.smithi150.stdout:6/729: mkdir d2/d23/d2e/d5f/df5 0 2023-12-05T09:57:43.724 INFO:tasks.workunit.client.1.smithi150.stdout:0/901: creat d5/d11/d71/d5f/d77/f133 x:0 0 0 2023-12-05T09:57:43.724 INFO:tasks.workunit.client.1.smithi150.stdout:9/763: rename d3/d1b/d46/d55/ceb to d3/d9/dc/d1f/d24/d75/cf8 0 2023-12-05T09:57:43.724 INFO:tasks.workunit.client.1.smithi150.stdout:0/902: write d5/d11/f24 [911192,14048] 0 2023-12-05T09:57:43.724 INFO:tasks.workunit.client.0.smithi100.stdout:8/752: creat d0/d12/d13/d45/da6/fd4 x:0 0 0 2023-12-05T09:57:43.726 INFO:tasks.workunit.client.0.smithi100.stdout:5/858: mkdir d0/d16/d2b/d132 0 2023-12-05T09:57:43.729 INFO:tasks.workunit.client.1.smithi150.stdout:1/868: link d6/d47/d4c/f102 d6/d47/d4c/dd9/d75/dc4/f134 0 2023-12-05T09:57:43.729 INFO:tasks.workunit.client.1.smithi150.stdout:1/869: dread - d6/d47/d4c/dd9/ffd zero size 2023-12-05T09:57:43.729 INFO:tasks.workunit.client.0.smithi100.stdout:5/859: creat d0/d1b/f133 x:0 0 0 2023-12-05T09:57:43.730 INFO:tasks.workunit.client.1.smithi150.stdout:0/903: creat d5/d11/d32/d57/f134 x:0 0 0 2023-12-05T09:57:43.732 INFO:tasks.workunit.client.0.smithi100.stdout:5/860: rename d0/d1b/d4d/d8e/d125/c2c to d0/d1b/d4d/d8e/d125/c134 0 2023-12-05T09:57:43.732 INFO:tasks.workunit.client.0.smithi100.stdout:5/861: truncate d0/d1b/d4d/d8e/d96/dc1/dae/ffa 459921 0 2023-12-05T09:57:43.732 INFO:tasks.workunit.client.0.smithi100.stdout:5/862: write d0/d1b/d4d/d8e/fda [4708394,104479] 0 2023-12-05T09:57:43.732 INFO:tasks.workunit.client.0.smithi100.stdout:5/863: chown d0/d1b/d4d/d8e/d96/dea/f102 12543 1 2023-12-05T09:57:43.738 INFO:tasks.workunit.client.1.smithi150.stdout:0/904: dread d5/d11/d71/d99/d9c/d96/dd5/d7f/fac [0,4194304] 0 2023-12-05T09:57:43.738 INFO:tasks.workunit.client.1.smithi150.stdout:0/905: dread - d5/d11/d71/d99/d9c/d3b/dad/f117 zero size 2023-12-05T09:57:43.739 INFO:tasks.workunit.client.1.smithi150.stdout:0/906: getdents d5/d11/d71/d99/d9c/d96/dd5/d67 0 2023-12-05T09:57:43.742 INFO:tasks.workunit.client.1.smithi150.stdout:8/887: dwrite d0/d41/d49/d1b/d24/d34/d56/d67/d64/f7e [0,4194304] 0 2023-12-05T09:57:43.742 INFO:tasks.workunit.client.1.smithi150.stdout:0/907: rename d5/d11/d71/d99/d9c/d3b/fbc to d5/d11/db6/d12e/f135 0 2023-12-05T09:57:43.742 INFO:tasks.workunit.client.1.smithi150.stdout:0/908: dread - d5/d11/d71/d99/d9c/f10c zero size 2023-12-05T09:57:43.742 INFO:tasks.workunit.client.1.smithi150.stdout:0/909: write d5/dbd/df4/f128 [587565,23067] 0 2023-12-05T09:57:43.744 INFO:tasks.workunit.client.0.smithi100.stdout:7/772: dwrite d3/dc/d11/d13/de/d18/d3b/d40/f112 [0,4194304] 0 2023-12-05T09:57:43.744 INFO:tasks.workunit.client.0.smithi100.stdout:7/773: write d3/dc/d11/d13/d1b/f7e [304282,16049] 0 2023-12-05T09:57:43.744 INFO:tasks.workunit.client.0.smithi100.stdout:7/774: fsync d3/dc/d11/d13/de/d2d/ffd 0 2023-12-05T09:57:43.744 INFO:tasks.workunit.client.1.smithi150.stdout:7/842: dwrite d2/d4/f6d [0,4194304] 0 2023-12-05T09:57:43.744 INFO:tasks.workunit.client.1.smithi150.stdout:5/853: dwrite d1/d7f/d65/d3b/d6b/fb0 [4194304,4194304] 0 2023-12-05T09:57:43.745 INFO:tasks.workunit.client.1.smithi150.stdout:7/843: truncate d2/db/f99 4826255 0 2023-12-05T09:57:43.745 INFO:tasks.workunit.client.0.smithi100.stdout:0/759: dwrite da/d1b/d6b/d78/f88 [0,4194304] 0 2023-12-05T09:57:43.745 INFO:tasks.workunit.client.0.smithi100.stdout:0/760: chown da/d22/d33/d74/dca/db4/ld7 61526378 1 2023-12-05T09:57:43.745 INFO:tasks.workunit.client.0.smithi100.stdout:2/922: dwrite d7/da/d18/d1b/f28 [4194304,4194304] 0 2023-12-05T09:57:43.746 INFO:tasks.workunit.client.0.smithi100.stdout:2/923: chown d7/da/d18/d21/d86/fd7 95059 1 2023-12-05T09:57:43.752 INFO:tasks.workunit.client.1.smithi150.stdout:6/730: dread d2/d23/d2e/f43 [0,4194304] 0 2023-12-05T09:57:43.752 INFO:tasks.workunit.client.1.smithi150.stdout:6/731: fsync d2/d23/d2e/f43 0 2023-12-05T09:57:43.752 INFO:tasks.workunit.client.1.smithi150.stdout:6/732: creat d2/d23/d3b/d64/d7a/d5d/de0/ff6 x:0 0 0 2023-12-05T09:57:43.754 INFO:tasks.workunit.client.0.smithi100.stdout:7/775: getdents d3/dc/d11/d13/de/d18/dcb 0 2023-12-05T09:57:43.756 INFO:tasks.workunit.client.1.smithi150.stdout:5/854: dread d1/d2e/f52 [0,4194304] 0 2023-12-05T09:57:43.759 INFO:tasks.workunit.client.0.smithi100.stdout:0/761: mkdir da/d1b/d6b/d78/de2 0 2023-12-05T09:57:43.759 INFO:tasks.workunit.client.0.smithi100.stdout:0/762: write da/d22/d33/d35/d3a/fd2 [776542,49749] 0 2023-12-05T09:57:43.767 INFO:tasks.workunit.client.0.smithi100.stdout:2/924: rename d7/da/d18/d1b/c3a to d7/da/ddc/d11c/c136 0 2023-12-05T09:57:43.768 INFO:tasks.workunit.client.1.smithi150.stdout:0/910: creat d5/d11/d32/df2/f136 x:0 0 0 2023-12-05T09:57:43.770 INFO:tasks.workunit.client.0.smithi100.stdout:7/776: mkdir d3/dc/d11/d13/d37/d11f 0 2023-12-05T09:57:43.772 INFO:tasks.workunit.client.0.smithi100.stdout:0/763: mkdir da/d2a/d45/de3 0 2023-12-05T09:57:43.774 INFO:tasks.workunit.client.1.smithi150.stdout:1/870: dwrite d6/f8d [0,4194304] 0 2023-12-05T09:57:43.775 INFO:tasks.workunit.client.1.smithi150.stdout:7/844: symlink d2/d72/d82/l118 0 2023-12-05T09:57:43.776 INFO:tasks.workunit.client.0.smithi100.stdout:7/777: symlink d3/dc/d11/d13/de/d2d/d47/ddd/l120 0 2023-12-05T09:57:43.777 INFO:tasks.workunit.client.0.smithi100.stdout:5/864: dwrite d0/d1f/f6a [4194304,4194304] 0 2023-12-05T09:57:43.779 INFO:tasks.workunit.client.0.smithi100.stdout:0/764: mknod da/d22/d33/d74/d77/ce4 0 2023-12-05T09:57:43.780 INFO:tasks.workunit.client.0.smithi100.stdout:3/888: sync 2023-12-05T09:57:43.781 INFO:tasks.workunit.client.0.smithi100.stdout:7/778: unlink d3/dc/d11/d13/de/d2d/d47/dbd/ff8 0 2023-12-05T09:57:43.782 INFO:tasks.workunit.client.0.smithi100.stdout:7/779: stat d3/dc/d11/d13/de/d2d/d42/fcf 0 2023-12-05T09:57:43.785 INFO:tasks.workunit.client.0.smithi100.stdout:1/787: sync 2023-12-05T09:57:43.786 INFO:tasks.workunit.client.0.smithi100.stdout:2/925: dread d7/da/da7/dd6/f104 [0,4194304] 0 2023-12-05T09:57:43.789 INFO:tasks.workunit.client.0.smithi100.stdout:0/765: link da/f5a da/d1b/d6b/d78/fe5 0 2023-12-05T09:57:43.790 INFO:tasks.workunit.client.1.smithi150.stdout:6/733: mknod d2/d23/d3b/db4/cf7 0 2023-12-05T09:57:43.791 INFO:tasks.workunit.client.1.smithi150.stdout:6/734: readlink d2/d23/l4c 0 2023-12-05T09:57:43.791 INFO:tasks.workunit.client.1.smithi150.stdout:6/735: chown d2/d23/d3b/f74 6154 1 2023-12-05T09:57:43.792 INFO:tasks.workunit.client.0.smithi100.stdout:8/753: rename d0/d35/d64/d81/d9a/dc6 to d0/d35/d64/d81/d9a/dd5 0 2023-12-05T09:57:43.792 INFO:tasks.workunit.client.0.smithi100.stdout:8/754: truncate d0/d12/d13/d16/da3/fbb 425081 0 2023-12-05T09:57:43.792 INFO:tasks.workunit.client.0.smithi100.stdout:8/755: stat d0/d35/f93 0 2023-12-05T09:57:43.792 INFO:tasks.workunit.client.0.smithi100.stdout:8/756: stat d0/ca 0 2023-12-05T09:57:43.793 INFO:tasks.workunit.client.0.smithi100.stdout:3/889: write d0/d2/de/d12/d9b/fca [5025692,17278] 0 2023-12-05T09:57:43.793 INFO:tasks.workunit.client.1.smithi150.stdout:6/736: write d2/d23/d3b/df0/fba [677422,57701] 0 2023-12-05T09:57:43.799 INFO:tasks.workunit.client.0.smithi100.stdout:7/780: creat d3/dc/d11/d13/de/d18/d3b/de2/f121 x:0 0 0 2023-12-05T09:57:43.802 INFO:tasks.workunit.client.1.smithi150.stdout:0/911: mknod d5/d11/d71/d99/d9c/d96/c137 0 2023-12-05T09:57:43.803 INFO:tasks.workunit.client.0.smithi100.stdout:5/865: getdents d0/d1b/d4d/d8e/d96/dea 0 2023-12-05T09:57:43.807 INFO:tasks.workunit.client.0.smithi100.stdout:5/866: creat d0/d1b/d4d/d8e/d96/dc1/dae/db9/dd2/f135 x:0 0 0 2023-12-05T09:57:43.807 INFO:tasks.workunit.client.0.smithi100.stdout:5/867: write d0/d16/d2b/d75/fd5 [85250,77708] 0 2023-12-05T09:57:43.807 INFO:tasks.workunit.client.0.smithi100.stdout:5/868: write d0/d1b/d4d/d8e/d125/d14/d35/f69 [696703,80290] 0 2023-12-05T09:57:43.812 INFO:tasks.workunit.client.0.smithi100.stdout:8/757: creat d0/d35/d64/d81/d9a/d9d/fd6 x:0 0 0 2023-12-05T09:57:43.813 INFO:tasks.workunit.client.1.smithi150.stdout:1/871: mkdir d6/d38/d135 0 2023-12-05T09:57:43.813 INFO:tasks.workunit.client.1.smithi150.stdout:1/872: fsync d6/d47/d4c/dd9/fd2 0 2023-12-05T09:57:43.820 INFO:tasks.workunit.client.0.smithi100.stdout:0/766: read da/d22/d33/d74/dca/db4/fc0 [2498498,21480] 0 2023-12-05T09:57:43.820 INFO:tasks.workunit.client.0.smithi100.stdout:0/767: truncate da/d1b/d6b/f6c 4567152 0 2023-12-05T09:57:43.820 INFO:tasks.workunit.client.1.smithi150.stdout:7/845: symlink d2/d72/d82/l119 0 2023-12-05T09:57:43.826 INFO:tasks.workunit.client.1.smithi150.stdout:4/757: sync 2023-12-05T09:57:43.826 INFO:tasks.workunit.client.1.smithi150.stdout:4/758: fsync d0/d3e/d6d/d4b/f50 0 2023-12-05T09:57:43.827 INFO:tasks.workunit.client.0.smithi100.stdout:7/781: symlink d3/db3/l122 0 2023-12-05T09:57:43.828 INFO:tasks.workunit.client.1.smithi150.stdout:8/888: write d0/d41/d49/d1b/d24/d5b/f96 [1588060,21816] 0 2023-12-05T09:57:43.830 INFO:tasks.workunit.client.0.smithi100.stdout:3/890: rmdir d0/d3d/dfc/d10d/db0/d100 39 2023-12-05T09:57:43.830 INFO:tasks.workunit.client.0.smithi100.stdout:3/891: chown d0/d3d/d5c/fd4 19 1 2023-12-05T09:57:43.830 INFO:tasks.workunit.client.0.smithi100.stdout:3/892: truncate d0/d10/d39/f133 642191 0 2023-12-05T09:57:43.830 INFO:tasks.workunit.client.0.smithi100.stdout:3/893: dread - d0/d3d/dfc/d10d/db0/d100/f111 zero size 2023-12-05T09:57:43.831 INFO:tasks.workunit.client.0.smithi100.stdout:5/869: read d0/d16/d2b/d75/f78 [2255930,24741] 0 2023-12-05T09:57:43.832 INFO:tasks.workunit.client.0.smithi100.stdout:5/870: chown d0/d1b/d4d/d8e/d125/d14/d35/d62/ldd 14284994 1 2023-12-05T09:57:43.832 INFO:tasks.workunit.client.0.smithi100.stdout:5/871: fsync d0/d27/f29 0 2023-12-05T09:57:43.832 INFO:tasks.workunit.client.1.smithi150.stdout:0/912: mkdir d5/d11/d71/d99/d9c/d138 0 2023-12-05T09:57:43.833 INFO:tasks.workunit.client.0.smithi100.stdout:3/894: mkdir d0/d3d/d5c/d6f/d7f/d135 0 2023-12-05T09:57:43.834 INFO:tasks.workunit.client.1.smithi150.stdout:7/846: dread d2/d39/f60 [0,4194304] 0 2023-12-05T09:57:43.835 INFO:tasks.workunit.client.1.smithi150.stdout:1/873: dread d6/d8/db/db1/fbc [0,4194304] 0 2023-12-05T09:57:43.835 INFO:tasks.workunit.client.1.smithi150.stdout:1/874: fsync d6/d3c/f7e 0 2023-12-05T09:57:43.836 INFO:tasks.workunit.client.1.smithi150.stdout:1/875: chown d6/d47/d4c/dd9/d75/da5/fc3 0 1 2023-12-05T09:57:43.836 INFO:tasks.workunit.client.1.smithi150.stdout:1/876: truncate d6/d47/d4c/dd9/f77 4778665 0 2023-12-05T09:57:43.849 INFO:tasks.workunit.client.1.smithi150.stdout:4/759: creat d0/d3e/d5b/d6e/daa/fea x:0 0 0 2023-12-05T09:57:43.849 INFO:tasks.workunit.client.1.smithi150.stdout:0/913: creat d5/d11/d71/d5f/d6a/f139 x:0 0 0 2023-12-05T09:57:43.849 INFO:tasks.workunit.client.1.smithi150.stdout:0/914: stat d5/f31 0 2023-12-05T09:57:43.849 INFO:tasks.workunit.client.0.smithi100.stdout:5/872: creat d0/d27/dc0/f136 x:0 0 0 2023-12-05T09:57:43.849 INFO:tasks.workunit.client.0.smithi100.stdout:3/895: mknod d0/d2/de/d8d/d11e/c136 0 2023-12-05T09:57:43.849 INFO:tasks.workunit.client.0.smithi100.stdout:3/896: chown d0/d2/de/d11/f21 46250 1 2023-12-05T09:57:43.854 INFO:tasks.workunit.client.0.smithi100.stdout:3/897: mknod d0/d3d/d5c/d5f/d73/c137 0 2023-12-05T09:57:43.856 INFO:tasks.workunit.client.1.smithi150.stdout:4/760: rmdir d0/d3e/d6d/d95 39 2023-12-05T09:57:43.856 INFO:tasks.workunit.client.0.smithi100.stdout:3/898: symlink d0/d3d/d5c/d5f/l138 0 2023-12-05T09:57:43.877 INFO:tasks.workunit.client.0.smithi100.stdout:2/926: dwrite d7/da/da7/f11d [0,4194304] 0 2023-12-05T09:57:43.877 INFO:tasks.workunit.client.0.smithi100.stdout:2/927: dread - d7/da/d13/d4e/d87/f102 zero size 2023-12-05T09:57:43.899 INFO:tasks.workunit.client.0.smithi100.stdout:2/928: read d7/da/d18/d1b/d2c/f49 [3571495,12813] 0 2023-12-05T09:57:43.899 INFO:tasks.workunit.client.0.smithi100.stdout:2/929: write d7/da/d18/d1b/f6c [103706,88306] 0 2023-12-05T09:57:43.899 INFO:tasks.workunit.client.0.smithi100.stdout:2/930: fdatasync d7/da/da7/ff1 0 2023-12-05T09:57:43.899 INFO:tasks.workunit.client.0.smithi100.stdout:2/931: write d7/da/d18/d21/d4d/d81/f50 [3638755,101975] 0 2023-12-05T09:57:43.912 INFO:tasks.workunit.client.1.smithi150.stdout:5/855: write d1/d3/d6/d1b/f6a [129771,95984] 0 2023-12-05T09:57:43.912 INFO:tasks.workunit.client.1.smithi150.stdout:5/856: creat d1/d7f/d65/d3b/f12f x:0 0 0 2023-12-05T09:57:43.916 INFO:tasks.workunit.client.1.smithi150.stdout:2/865: sync 2023-12-05T09:57:43.916 INFO:tasks.workunit.client.1.smithi150.stdout:9/764: sync 2023-12-05T09:57:43.916 INFO:tasks.workunit.client.1.smithi150.stdout:3/864: sync 2023-12-05T09:57:43.916 INFO:tasks.workunit.client.1.smithi150.stdout:3/865: fsync d6/d9/d3d/d56/d71/db6/dc1/d67/f86 0 2023-12-05T09:57:43.920 INFO:tasks.workunit.client.0.smithi100.stdout:1/788: dwrite db/d12/d1e/dd3/db8/fd9 [4194304,4194304] 0 2023-12-05T09:57:43.924 INFO:tasks.workunit.client.0.smithi100.stdout:7/782: dwrite d3/dc/d11/d33/f62 [0,4194304] 0 2023-12-05T09:57:43.925 INFO:tasks.workunit.client.0.smithi100.stdout:7/783: write d3/dc/d11/d13/de/d2d/ffd [78916,8662] 0 2023-12-05T09:57:43.926 INFO:tasks.workunit.client.0.smithi100.stdout:7/784: chown d3/dc/d11/d13/de/d2d/d42/c9a 133 1 2023-12-05T09:57:43.931 INFO:tasks.workunit.client.1.smithi150.stdout:5/857: write d1/d64/f58 [2917902,110337] 0 2023-12-05T09:57:43.931 INFO:tasks.workunit.client.1.smithi150.stdout:6/737: dwrite d2/d23/d2e/d5f/d99/fd4 [0,4194304] 0 2023-12-05T09:57:43.932 INFO:tasks.workunit.client.1.smithi150.stdout:2/866: getdents d0/d3/d21/d77 0 2023-12-05T09:57:43.933 INFO:tasks.workunit.client.1.smithi150.stdout:3/866: mkdir d6/d9/d3d/d56/d71/db6/dc1/d110/d118 0 2023-12-05T09:57:43.940 INFO:tasks.workunit.client.1.smithi150.stdout:5/858: symlink d1/d7f/d65/d3b/d37/l130 0 2023-12-05T09:57:43.940 INFO:tasks.workunit.client.1.smithi150.stdout:3/867: getdents d6/d9/d3d/d56/d30 0 2023-12-05T09:57:43.943 INFO:tasks.workunit.client.0.smithi100.stdout:7/785: getdents d3/dc/d11/d13/d1b/d60 0 2023-12-05T09:57:43.947 INFO:tasks.workunit.client.0.smithi100.stdout:7/786: truncate d3/dc/d11/d33/f53 557816 0 2023-12-05T09:57:43.947 INFO:tasks.workunit.client.0.smithi100.stdout:7/787: fsync d3/dc/d11/d13/de/d18/d3b/d40/d46/f95 0 2023-12-05T09:57:43.947 INFO:tasks.workunit.client.0.smithi100.stdout:7/788: write d3/dc/d11/d13/de/d2d/d47/fca [1711813,67141] 0 2023-12-05T09:57:43.948 INFO:tasks.workunit.client.0.smithi100.stdout:7/789: chown d3/dc/d11/d13/de/d2d/ld8 1760298 1 2023-12-05T09:57:43.948 INFO:tasks.workunit.client.1.smithi150.stdout:8/889: dwrite d0/d8/f1f [0,4194304] 0 2023-12-05T09:57:43.956 INFO:tasks.workunit.client.0.smithi100.stdout:1/789: dread db/d12/d1e/fa0 [0,4194304] 0 2023-12-05T09:57:43.956 INFO:tasks.workunit.client.0.smithi100.stdout:1/790: write db/d31/d3a/d4a/dad/f89 [609794,18465] 0 2023-12-05T09:57:43.956 INFO:tasks.workunit.client.0.smithi100.stdout:1/791: write db/d31/d3a/d4a/dad/d67/fde [985300,70982] 0 2023-12-05T09:57:43.956 INFO:tasks.workunit.client.0.smithi100.stdout:1/792: fdatasync db/d12/d1e/d26/d30/feb 0 2023-12-05T09:57:43.956 INFO:tasks.workunit.client.0.smithi100.stdout:7/790: symlink d3/dc/d11/d13/da8/l123 0 2023-12-05T09:57:43.959 INFO:tasks.workunit.client.0.smithi100.stdout:3/899: rename d0/d2 to d0/d3d/d5c/d139 0 2023-12-05T09:57:43.964 INFO:tasks.workunit.client.1.smithi150.stdout:3/868: dread d6/d9/d3d/d52/f65 [0,4194304] 0 2023-12-05T09:57:43.965 INFO:tasks.workunit.client.1.smithi150.stdout:3/869: write d6/d9/d3d/d56/d53/f9e [1950041,64473] 0 2023-12-05T09:57:43.965 INFO:tasks.workunit.client.1.smithi150.stdout:3/870: write d6/d9/fbd [4215563,47125] 0 2023-12-05T09:57:43.968 INFO:tasks.workunit.client.0.smithi100.stdout:3/900: mknod d0/d3d/d5c/d5f/de9/c13a 0 2023-12-05T09:57:43.968 INFO:tasks.workunit.client.0.smithi100.stdout:3/901: write d0/d3d/d5c/d139/de/ff9 [880083,7065] 0 2023-12-05T09:57:43.968 INFO:tasks.workunit.client.1.smithi150.stdout:6/738: write d2/d23/d2e/d5f/d99/fd4 [1117958,120257] 0 2023-12-05T09:57:43.970 INFO:tasks.workunit.client.0.smithi100.stdout:3/902: creat d0/d3d/d5c/d139/de/d11/db5/f13b x:0 0 0 2023-12-05T09:57:43.970 INFO:tasks.workunit.client.0.smithi100.stdout:3/903: chown d0/d3d/d5c/d139/fe0 1 1 2023-12-05T09:57:43.972 INFO:tasks.workunit.client.1.smithi150.stdout:2/867: dread d0/fc5 [0,4194304] 0 2023-12-05T09:57:43.972 INFO:tasks.workunit.client.1.smithi150.stdout:2/868: readlink d0/d3/d5/d3b/l115 0 2023-12-05T09:57:43.973 INFO:tasks.workunit.client.1.smithi150.stdout:0/915: dwrite d5/d11/d71/d99/d9c/d46/d80/f86 [0,4194304] 0 2023-12-05T09:57:43.974 INFO:tasks.workunit.client.1.smithi150.stdout:6/739: truncate d2/d23/d2e/d5f/f6d 1979729 0 2023-12-05T09:57:43.974 INFO:tasks.workunit.client.1.smithi150.stdout:6/740: getdents d2/d23/d2e/d5f/df5 0 2023-12-05T09:57:43.976 INFO:tasks.workunit.client.0.smithi100.stdout:0/768: dwrite da/d1b/d6b/d78/f88 [0,4194304] 0 2023-12-05T09:57:43.979 INFO:tasks.workunit.client.0.smithi100.stdout:5/873: dwrite d0/d16/f1e [0,4194304] 0 2023-12-05T09:57:43.980 INFO:tasks.workunit.client.1.smithi150.stdout:4/761: dwrite d0/d3e/d48/f9e [0,4194304] 0 2023-12-05T09:57:43.983 INFO:tasks.workunit.client.0.smithi100.stdout:0/769: rename da/d22/d33/d74/d77/dd6 to da/d2a/d45/de3/de6 0 2023-12-05T09:57:43.986 INFO:tasks.workunit.client.1.smithi150.stdout:1/877: dwrite d6/d8/d54/fdf [0,4194304] 0 2023-12-05T09:57:43.986 INFO:tasks.workunit.client.0.smithi100.stdout:2/932: dwrite d7/da/d18/d1b/d2c/d3f/d46/f76 [0,4194304] 0 2023-12-05T09:57:43.986 INFO:tasks.workunit.client.1.smithi150.stdout:7/847: dwrite d2/db/d30/d13/d4f/fbc [0,4194304] 0 2023-12-05T09:57:43.987 INFO:tasks.workunit.client.0.smithi100.stdout:8/758: dwrite d0/d12/d52/f8e [0,4194304] 0 2023-12-05T09:57:43.993 INFO:tasks.workunit.client.0.smithi100.stdout:5/874: mkdir d0/d1f/d25/d111/d137 0 2023-12-05T09:57:43.994 INFO:tasks.workunit.client.1.smithi150.stdout:4/762: rename d0/d3e/d6d/ddf/la7 to d0/d3e/d5b/leb 0 2023-12-05T09:57:43.998 INFO:tasks.workunit.client.0.smithi100.stdout:0/770: creat da/de1/fe7 x:0 0 0 2023-12-05T09:57:44.001 INFO:tasks.workunit.client.1.smithi150.stdout:1/878: creat d6/d38/d128/f136 x:0 0 0 2023-12-05T09:57:44.002 INFO:tasks.workunit.client.1.smithi150.stdout:1/879: write d6/d47/f12a [68243,101149] 0 2023-12-05T09:57:44.002 INFO:tasks.workunit.client.1.smithi150.stdout:1/880: write d6/d3c/dc2/ffa [655765,32152] 0 2023-12-05T09:57:44.002 INFO:tasks.workunit.client.1.smithi150.stdout:1/881: chown d6/d47/d4c/dd9/c6d 18898 1 2023-12-05T09:57:44.002 INFO:tasks.workunit.client.0.smithi100.stdout:2/933: mkdir d7/da/d65/d137 0 2023-12-05T09:57:44.004 INFO:tasks.workunit.client.1.smithi150.stdout:7/848: symlink d2/db/d2e/d71/l11a 0 2023-12-05T09:57:44.008 INFO:tasks.workunit.client.0.smithi100.stdout:8/759: link d0/d12/d13/d45/dba/dbd/l74 d0/d12/d13/d16/d42/ld7 0 2023-12-05T09:57:44.008 INFO:tasks.workunit.client.0.smithi100.stdout:8/760: chown d0/c5e 415 1 2023-12-05T09:57:44.009 INFO:tasks.workunit.client.1.smithi150.stdout:1/882: symlink d6/d8/d59/l137 0 2023-12-05T09:57:44.013 INFO:tasks.workunit.client.0.smithi100.stdout:5/875: read d0/d16/d2b/f3a [3341015,125039] 0 2023-12-05T09:57:44.016 INFO:tasks.workunit.client.1.smithi150.stdout:9/765: dwrite d3/d9/dc/f92 [4194304,4194304] 0 2023-12-05T09:57:44.016 INFO:tasks.workunit.client.1.smithi150.stdout:1/883: symlink d6/d47/d4c/dd9/d75/d106/l138 0 2023-12-05T09:57:44.021 INFO:tasks.workunit.client.1.smithi150.stdout:5/859: dwrite d1/d7f/d65/d3b/d6b/d109/f10f [0,4194304] 0 2023-12-05T09:57:44.023 INFO:tasks.workunit.client.1.smithi150.stdout:6/741: dread d2/d23/d3b/d64/d7a/d5d/d6b/f10 [0,4194304] 0 2023-12-05T09:57:44.024 INFO:tasks.workunit.client.1.smithi150.stdout:4/763: write d0/d5f/fd4 [3806069,62070] 0 2023-12-05T09:57:44.026 INFO:tasks.workunit.client.0.smithi100.stdout:9/839: sync 2023-12-05T09:57:44.026 INFO:tasks.workunit.client.0.smithi100.stdout:9/840: read - d7/d1b/d22/d51/fdb zero size 2023-12-05T09:57:44.026 INFO:tasks.workunit.client.0.smithi100.stdout:9/841: chown d7/d1b/d22/lc7 119028645 1 2023-12-05T09:57:44.026 INFO:tasks.workunit.client.0.smithi100.stdout:9/842: stat d7/d20/d69/def/f67 0 2023-12-05T09:57:44.034 INFO:tasks.workunit.client.0.smithi100.stdout:1/793: dwrite db/d12/d1e/f41 [4194304,4194304] 0 2023-12-05T09:57:44.034 INFO:tasks.workunit.client.0.smithi100.stdout:1/794: fdatasync db/d31/d3a/f5b 0 2023-12-05T09:57:44.034 INFO:tasks.workunit.client.1.smithi150.stdout:4/764: write d0/d3e/d5b/d80/d44/f7f [305770,47886] 0 2023-12-05T09:57:44.034 INFO:tasks.workunit.client.1.smithi150.stdout:3/871: dwrite d6/f5d [0,4194304] 0 2023-12-05T09:57:44.034 INFO:tasks.workunit.client.1.smithi150.stdout:3/872: fdatasync d6/d25/dd9/df2/fae 0 2023-12-05T09:57:44.034 INFO:tasks.workunit.client.1.smithi150.stdout:3/873: readlink d6/d9/d3d/d56/d79/le2 0 2023-12-05T09:57:44.034 INFO:tasks.workunit.client.1.smithi150.stdout:4/765: write d0/d3e/d6d/ddf/da4/dd7/f97 [764927,76035] 0 2023-12-05T09:57:44.035 INFO:tasks.workunit.client.0.smithi100.stdout:0/771: symlink da/d22/d33/d74/le8 0 2023-12-05T09:57:44.035 INFO:tasks.workunit.client.0.smithi100.stdout:0/772: stat da/ld8 0 2023-12-05T09:57:44.035 INFO:tasks.workunit.client.0.smithi100.stdout:0/773: stat da/f2c 0 2023-12-05T09:57:44.035 INFO:tasks.workunit.client.0.smithi100.stdout:0/774: write da/f5a [171504,8932] 0 2023-12-05T09:57:44.040 INFO:tasks.workunit.client.0.smithi100.stdout:2/934: truncate d7/da/d18/f62 2420735 0 2023-12-05T09:57:44.041 INFO:tasks.workunit.client.0.smithi100.stdout:8/761: creat d0/d12/fd8 x:0 0 0 2023-12-05T09:57:44.048 INFO:tasks.workunit.client.1.smithi150.stdout:0/916: dwrite d5/d11/d71/d99/d9c/d3b/f9f [0,4194304] 0 2023-12-05T09:57:44.048 INFO:tasks.workunit.client.1.smithi150.stdout:0/917: readlink d5/d11/d16/l68 0 2023-12-05T09:57:44.052 INFO:tasks.workunit.client.1.smithi150.stdout:7/849: dwrite d2/d4/f42 [0,4194304] 0 2023-12-05T09:57:44.052 INFO:tasks.workunit.client.1.smithi150.stdout:7/850: write d2/db/d30/d53/d90/fc9 [1366790,46955] 0 2023-12-05T09:57:44.052 INFO:tasks.workunit.client.1.smithi150.stdout:2/869: dwrite d0/d3/d5/d10/f45 [0,4194304] 0 2023-12-05T09:57:44.053 INFO:tasks.workunit.client.1.smithi150.stdout:2/870: write d0/d3/d21/d4d/deb/d103/db9/ff9 [416895,37075] 0 2023-12-05T09:57:44.053 INFO:tasks.workunit.client.1.smithi150.stdout:2/871: fdatasync d0/f16 0 2023-12-05T09:57:44.061 INFO:tasks.workunit.client.0.smithi100.stdout:5/876: unlink d0/d1b/d4d/d8e/d125/d14/d35/f89 0 2023-12-05T09:57:44.062 INFO:tasks.workunit.client.1.smithi150.stdout:9/766: unlink d3/d82/lb3 0 2023-12-05T09:57:44.062 INFO:tasks.workunit.client.1.smithi150.stdout:9/767: fsync d3/d9/dc/d1f/d24/f63 0 2023-12-05T09:57:44.063 INFO:tasks.workunit.client.1.smithi150.stdout:1/884: dwrite d6/d8/db/f73 [0,4194304] 0 2023-12-05T09:57:44.071 INFO:tasks.workunit.client.0.smithi100.stdout:1/795: link db/d31/f36 db/d12/d1e/dd3/db8/de7/ff9 0 2023-12-05T09:57:44.073 INFO:tasks.workunit.client.1.smithi150.stdout:7/851: dread d2/f12 [0,4194304] 0 2023-12-05T09:57:44.073 INFO:tasks.workunit.client.1.smithi150.stdout:5/860: stat d1/lf4 0 2023-12-05T09:57:44.073 INFO:tasks.workunit.client.1.smithi150.stdout:5/861: chown d1/d3/d6/l9b 197047 1 2023-12-05T09:57:44.073 INFO:tasks.workunit.client.1.smithi150.stdout:5/862: dread - d1/d64/ded/f125 zero size 2023-12-05T09:57:44.074 INFO:tasks.workunit.client.0.smithi100.stdout:8/762: symlink d0/d12/d13/d45/da6/ld9 0 2023-12-05T09:57:44.075 INFO:tasks.workunit.client.0.smithi100.stdout:8/763: fsync d0/f37 0 2023-12-05T09:57:44.076 INFO:tasks.workunit.client.1.smithi150.stdout:4/766: dwrite d0/d3e/d6d/d95/fd8 [0,4194304] 0 2023-12-05T09:57:44.076 INFO:tasks.workunit.client.1.smithi150.stdout:4/767: chown d0/d3e/f6b 127 1 2023-12-05T09:57:44.077 INFO:tasks.workunit.client.1.smithi150.stdout:6/742: mkdir d2/d23/d2e/dd6/df3/df8 0 2023-12-05T09:57:44.079 INFO:tasks.workunit.client.0.smithi100.stdout:9/843: read d7/d20/f3c [2044013,91812] 0 2023-12-05T09:57:44.084 INFO:tasks.workunit.client.0.smithi100.stdout:1/796: mkdir db/d12/d1e/d72/dc4/dd2/dfa 0 2023-12-05T09:57:44.084 INFO:tasks.workunit.client.0.smithi100.stdout:1/797: creat db/d12/d1e/d26/d30/d6e/ffb x:0 0 0 2023-12-05T09:57:44.086 INFO:tasks.workunit.client.0.smithi100.stdout:8/764: rmdir d0/d12/d13/d45/dba/dbd/d72/da9 39 2023-12-05T09:57:44.087 INFO:tasks.workunit.client.0.smithi100.stdout:8/765: chown d0/d12/l21 166988484 1 2023-12-05T09:57:44.089 INFO:tasks.workunit.client.1.smithi150.stdout:3/874: rename d6/d9/d3d/d52/f65 to d6/d9/d3d/d56/d30/f119 0 2023-12-05T09:57:44.089 INFO:tasks.workunit.client.1.smithi150.stdout:3/875: creat d6/d25/dcf/f11a x:0 0 0 2023-12-05T09:57:44.092 INFO:tasks.workunit.client.0.smithi100.stdout:1/798: mknod db/d31/d3a/d4a/cfc 0 2023-12-05T09:57:44.095 INFO:tasks.workunit.client.0.smithi100.stdout:4/765: sync 2023-12-05T09:57:44.095 INFO:tasks.workunit.client.0.smithi100.stdout:4/766: fsync de/d16/d23/f2c 0 2023-12-05T09:57:44.095 INFO:tasks.workunit.client.1.smithi150.stdout:0/918: rmdir d5/d11/d71/d5f/d77/d87 39 2023-12-05T09:57:44.095 INFO:tasks.workunit.client.1.smithi150.stdout:0/919: fdatasync d5/d11/d32/f50 0 2023-12-05T09:57:44.096 INFO:tasks.workunit.client.0.smithi100.stdout:2/935: dread d7/da/d18/d21/d4d/d81/f8f [0,4194304] 0 2023-12-05T09:57:44.096 INFO:tasks.workunit.client.0.smithi100.stdout:8/766: creat d0/d12/d52/fda x:0 0 0 2023-12-05T09:57:44.102 INFO:tasks.workunit.client.0.smithi100.stdout:4/767: mknod de/d16/d23/d33/dae/cfa 0 2023-12-05T09:57:44.102 INFO:tasks.workunit.client.0.smithi100.stdout:1/799: truncate db/d12/d1e/d26/d30/d52/f77 1952461 0 2023-12-05T09:57:44.102 INFO:tasks.workunit.client.0.smithi100.stdout:1/800: dread - db/d31/d3a/d4a/fa3 zero size 2023-12-05T09:57:44.103 INFO:tasks.workunit.client.0.smithi100.stdout:8/767: unlink d0/d12/d13/d16/f20 0 2023-12-05T09:57:44.107 INFO:tasks.workunit.client.0.smithi100.stdout:4/768: readlink de/d16/d23/l35 0 2023-12-05T09:57:44.111 INFO:tasks.workunit.client.1.smithi150.stdout:2/872: unlink d0/d3/d27/dac/d81/f10a 0 2023-12-05T09:57:44.112 INFO:tasks.workunit.client.0.smithi100.stdout:8/768: dread d0/d12/d13/d16/d42/d43/fad [0,4194304] 0 2023-12-05T09:57:44.116 INFO:tasks.workunit.client.1.smithi150.stdout:9/768: link d3/d9/d9c/fcd d3/d9/d26/d34/ff9 0 2023-12-05T09:57:44.118 INFO:tasks.workunit.client.0.smithi100.stdout:4/769: rmdir de/d16/d23 39 2023-12-05T09:57:44.118 INFO:tasks.workunit.client.0.smithi100.stdout:4/770: write de/d16/d1e/f30 [139071,38651] 0 2023-12-05T09:57:44.123 INFO:tasks.workunit.client.0.smithi100.stdout:0/775: dwrite da/d1b/dbe/fc5 [0,4194304] 0 2023-12-05T09:57:44.123 INFO:tasks.workunit.client.0.smithi100.stdout:0/776: readlink da/d1b/l2f 0 2023-12-05T09:57:44.128 INFO:tasks.workunit.client.1.smithi150.stdout:1/885: symlink d6/d47/db4/l139 0 2023-12-05T09:57:44.128 INFO:tasks.workunit.client.1.smithi150.stdout:1/886: fdatasync d6/d8/fc5 0 2023-12-05T09:57:44.128 INFO:tasks.workunit.client.0.smithi100.stdout:8/769: creat d0/d35/d64/d81/fdb x:0 0 0 2023-12-05T09:57:44.134 INFO:tasks.workunit.client.1.smithi150.stdout:5/863: creat d1/d7f/d65/d3b/d6b/d11e/d9a/d10e/f131 x:0 0 0 2023-12-05T09:57:44.138 INFO:tasks.workunit.client.0.smithi100.stdout:4/771: mkdir de/d16/d23/d60/dfb 0 2023-12-05T09:57:44.140 INFO:tasks.workunit.client.0.smithi100.stdout:4/772: chown de/d16/d1e/le0 6616 1 2023-12-05T09:57:44.140 INFO:tasks.workunit.client.1.smithi150.stdout:1/887: dread d6/d8/d54/f55 [0,4194304] 0 2023-12-05T09:57:44.140 INFO:tasks.workunit.client.0.smithi100.stdout:4/773: creat de/d38/d86/ffc x:0 0 0 2023-12-05T09:57:44.151 INFO:tasks.workunit.client.0.smithi100.stdout:9/844: dwrite d7/d1b/d22/d2a/d56/daf/fd0 [0,4194304] 0 2023-12-05T09:57:44.151 INFO:tasks.workunit.client.0.smithi100.stdout:0/777: mkdir da/d22/d33/d35/d3a/de9 0 2023-12-05T09:57:44.161 INFO:tasks.workunit.client.0.smithi100.stdout:8/770: truncate d0/d12/d13/d16/f2e 842470 0 2023-12-05T09:57:44.167 INFO:tasks.workunit.client.1.smithi150.stdout:4/768: mkdir d0/d3e/d48/d8a/dec 0 2023-12-05T09:57:44.168 INFO:tasks.workunit.client.1.smithi150.stdout:5/864: write d1/d64/d31/f49 [801915,66676] 0 2023-12-05T09:57:44.168 INFO:tasks.workunit.client.1.smithi150.stdout:5/865: chown d1/d7f/d65/dab 125 1 2023-12-05T09:57:44.170 INFO:tasks.workunit.client.1.smithi150.stdout:6/743: mknod d2/d23/d3b/d64/d7a/d5d/d6b/cf9 0 2023-12-05T09:57:44.172 INFO:tasks.workunit.client.0.smithi100.stdout:5/877: dwrite d0/f2 [0,4194304] 0 2023-12-05T09:57:44.172 INFO:tasks.workunit.client.1.smithi150.stdout:3/876: dwrite d6/d25/fca [0,4194304] 0 2023-12-05T09:57:44.172 INFO:tasks.workunit.client.1.smithi150.stdout:3/877: write d6/d9/d3d/d52/f76 [2533915,36056] 0 2023-12-05T09:57:44.173 INFO:tasks.workunit.client.1.smithi150.stdout:6/744: write d2/d23/d2e/d5f/d99/dd8/fe4 [261450,87998] 0 2023-12-05T09:57:44.178 INFO:tasks.workunit.client.0.smithi100.stdout:2/936: dwrite d7/db4/f12d [0,4194304] 0 2023-12-05T09:57:44.179 INFO:tasks.workunit.client.0.smithi100.stdout:5/878: unlink d0/d1b/d4d/d8e/d96/dc1/dae/db9/dd2/f11c 0 2023-12-05T09:57:44.184 INFO:tasks.workunit.client.0.smithi100.stdout:9/845: rename d7/d20/d69/d108 to d7/d20/d12b 0 2023-12-05T09:57:44.186 INFO:tasks.workunit.client.1.smithi150.stdout:4/769: dread d0/d3e/d48/fbc [0,4194304] 0 2023-12-05T09:57:44.189 INFO:tasks.workunit.client.1.smithi150.stdout:2/873: unlink d0/d3/d27/d95/cca 0 2023-12-05T09:57:44.192 INFO:tasks.workunit.client.0.smithi100.stdout:2/937: write d7/da/d13/d69/f109 [3756982,3597] 0 2023-12-05T09:57:44.192 INFO:tasks.workunit.client.1.smithi150.stdout:9/769: mknod d3/d9/d67/cfa 0 2023-12-05T09:57:44.193 INFO:tasks.workunit.client.1.smithi150.stdout:9/770: chown d3/d9/dc/fa2 375 1 2023-12-05T09:57:44.193 INFO:tasks.workunit.client.1.smithi150.stdout:9/771: write d3/d9/dc/d1f/d24/d75/fc6 [1157585,128713] 0 2023-12-05T09:57:44.193 INFO:tasks.workunit.client.1.smithi150.stdout:9/772: chown d3/d1b/d46 23 1 2023-12-05T09:57:44.194 INFO:tasks.workunit.client.1.smithi150.stdout:7/852: rmdir d2/db/d2e/d71/df2 39 2023-12-05T09:57:44.194 INFO:tasks.workunit.client.1.smithi150.stdout:7/853: read - d2/db/d30/d47/fea zero size 2023-12-05T09:57:44.211 INFO:tasks.workunit.client.1.smithi150.stdout:2/874: dread d0/d3/d5/d22/f35 [0,4194304] 0 2023-12-05T09:57:44.218 INFO:tasks.workunit.client.0.smithi100.stdout:0/778: dwrite da/d22/d33/d74/dca/fdd [0,4194304] 0 2023-12-05T09:57:44.222 INFO:tasks.workunit.client.0.smithi100.stdout:1/801: dwrite db/d12/d1e/dd3/db8/fd9 [4194304,4194304] 0 2023-12-05T09:57:44.226 INFO:tasks.workunit.client.1.smithi150.stdout:7/854: dread d2/db/d30/d13/d4f/d5a/d5c/fa5 [0,4194304] 0 2023-12-05T09:57:44.233 INFO:tasks.workunit.client.1.smithi150.stdout:5/866: dwrite d1/d7f/d65/d3b/d6b/fb0 [0,4194304] 0 2023-12-05T09:57:44.236 INFO:tasks.workunit.client.0.smithi100.stdout:8/771: dwrite d0/d12/d13/d16/d42/d43/f66 [4194304,4194304] 0 2023-12-05T09:57:44.236 INFO:tasks.workunit.client.0.smithi100.stdout:8/772: stat d0/db7 0 2023-12-05T09:57:44.245 INFO:tasks.workunit.client.1.smithi150.stdout:4/770: dwrite d0/d3e/f8d [4194304,4194304] 0 2023-12-05T09:57:44.260 INFO:tasks.workunit.client.0.smithi100.stdout:5/879: dwrite d0/d16/f1e [0,4194304] 0 2023-12-05T09:57:44.260 INFO:tasks.workunit.client.0.smithi100.stdout:5/880: readlink d0/d16/d37/l56 0 2023-12-05T09:57:44.260 INFO:tasks.workunit.client.0.smithi100.stdout:5/881: fsync d0/d1b/d4d/d8e/d125/d14/f9a 0 2023-12-05T09:57:44.264 INFO:tasks.workunit.client.1.smithi150.stdout:2/875: dwrite d0/d3/d21/d4d/deb/d86/fa0 [0,4194304] 0 2023-12-05T09:57:44.275 INFO:tasks.workunit.client.1.smithi150.stdout:8/890: sync 2023-12-05T09:57:44.275 INFO:tasks.workunit.client.1.smithi150.stdout:8/891: chown d0/d41/d49/d1b/d24/d34/c58 4620299 1 2023-12-05T09:57:44.275 INFO:tasks.workunit.client.1.smithi150.stdout:8/892: readlink d0/d41/d49/d1b/d24/d38/dad/le6 0 2023-12-05T09:57:44.275 INFO:tasks.workunit.client.1.smithi150.stdout:8/893: chown d0/d41/d49/d1b/d24/d2e/d4d/d83/c92 51768 1 2023-12-05T09:57:44.276 INFO:tasks.workunit.client.0.smithi100.stdout:9/846: mkdir d7/d20/d69/def/da2/d12c 0 2023-12-05T09:57:44.276 INFO:tasks.workunit.client.0.smithi100.stdout:9/847: readlink d7/d35/d71/d9a/dcd/l100 0 2023-12-05T09:57:44.278 INFO:tasks.workunit.client.1.smithi150.stdout:6/745: rmdir d2/d23/d2e/dd6/df3/df8 0 2023-12-05T09:57:44.285 INFO:tasks.workunit.client.1.smithi150.stdout:0/920: rename d5/dbd to d5/d11/d71/d99/d9c/d13a 0 2023-12-05T09:57:44.285 INFO:tasks.workunit.client.1.smithi150.stdout:0/921: fdatasync d5/d11/d16/fa3 0 2023-12-05T09:57:44.311 INFO:tasks.workunit.client.0.smithi100.stdout:0/779: creat da/d1b/d6b/fea x:0 0 0 2023-12-05T09:57:44.335 INFO:tasks.workunit.client.1.smithi150.stdout:0/922: dwrite d5/d11/d65/fd8 [0,4194304] 0 2023-12-05T09:57:44.335 INFO:tasks.workunit.client.1.smithi150.stdout:0/923: write d5/d11/d71/d99/d9c/d3b/dad/fdf [785235,119681] 0 2023-12-05T09:57:44.336 INFO:tasks.workunit.client.1.smithi150.stdout:0/924: write d5/d11/d71/d99/d9c/fc0 [682941,85737] 0 2023-12-05T09:57:44.336 INFO:tasks.workunit.client.1.smithi150.stdout:0/925: truncate d5/d11/d32/df2/f136 365533 0 2023-12-05T09:57:44.345 INFO:tasks.workunit.client.0.smithi100.stdout:8/773: getdents d0/d12/d13/d45/dba/dbd/d72/da9 0 2023-12-05T09:57:44.355 INFO:tasks.workunit.client.1.smithi150.stdout:0/926: dread d5/d11/d32/f91 [0,4194304] 0 2023-12-05T09:57:44.376 INFO:tasks.workunit.client.0.smithi100.stdout:2/938: creat d7/da/d13/d69/d6e/f138 x:0 0 0 2023-12-05T09:57:44.376 INFO:tasks.workunit.client.0.smithi100.stdout:2/939: chown d7/da/d18/d1b/d2c/d3f/d46/dc8/dfe 1 1 2023-12-05T09:57:44.412 INFO:tasks.workunit.client.0.smithi100.stdout:9/848: symlink d7/d1b/d22/d2a/d74/l12d 0 2023-12-05T09:57:44.414 INFO:tasks.workunit.client.0.smithi100.stdout:2/940: dwrite d7/da/d18/d21/f135 [0,4194304] 0 2023-12-05T09:57:44.414 INFO:tasks.workunit.client.0.smithi100.stdout:0/780: creat da/d60/dba/feb x:0 0 0 2023-12-05T09:57:44.414 INFO:tasks.workunit.client.0.smithi100.stdout:0/781: readlink da/l34 0 2023-12-05T09:57:44.418 INFO:tasks.workunit.client.1.smithi150.stdout:2/876: mkdir d0/d42/d12c 0 2023-12-05T09:57:44.421 INFO:tasks.workunit.client.0.smithi100.stdout:8/774: rmdir d0/d12/d13/d45/da6 39 2023-12-05T09:57:44.421 INFO:tasks.workunit.client.0.smithi100.stdout:8/775: fdatasync d0/d35/d64/d81/fa1 0 2023-12-05T09:57:44.423 INFO:tasks.workunit.client.1.smithi150.stdout:8/894: mknod d0/d41/d49/d1b/d24/d2e/d105/c117 0 2023-12-05T09:57:44.426 INFO:tasks.workunit.client.1.smithi150.stdout:6/746: mkdir d2/d23/d2e/d5f/d99/dd8/ddf/dfa 0 2023-12-05T09:57:44.426 INFO:tasks.workunit.client.1.smithi150.stdout:6/747: chown d2/d23/d3b/df0/d97/f8a 78845 1 2023-12-05T09:57:44.427 INFO:tasks.workunit.client.0.smithi100.stdout:5/882: rmdir d0/d1f/da1 39 2023-12-05T09:57:44.427 INFO:tasks.workunit.client.0.smithi100.stdout:5/883: chown d0/d1b/d4d/d8e/d96/fed 150974598 1 2023-12-05T09:57:44.436 INFO:tasks.workunit.client.1.smithi150.stdout:0/927: creat d5/d11/db6/d12e/f13b x:0 0 0 2023-12-05T09:57:44.437 INFO:tasks.workunit.client.1.smithi150.stdout:0/928: chown d5/d11/d71/d99/d9c/d13a/l124 29044 1 2023-12-05T09:57:44.437 INFO:tasks.workunit.client.1.smithi150.stdout:0/929: fsync d5/d11/d71/d99/d9c/d3b/f6c 0 2023-12-05T09:57:44.437 INFO:tasks.workunit.client.1.smithi150.stdout:0/930: read d5/d11/d71/d99/d9c/d3b/dad/fc5 [219613,37940] 0 2023-12-05T09:57:44.437 INFO:tasks.workunit.client.0.smithi100.stdout:2/941: creat d7/da/d65/d137/f139 x:0 0 0 2023-12-05T09:57:44.437 INFO:tasks.workunit.client.0.smithi100.stdout:2/942: fsync d7/da/d18/d1b/d2c/d3f/d46/f26 0 2023-12-05T09:57:44.439 INFO:tasks.workunit.client.1.smithi150.stdout:2/877: rmdir d0/d3/d5/d22/d52/d5a 39 2023-12-05T09:57:44.439 INFO:tasks.workunit.client.1.smithi150.stdout:6/748: write d2/d23/f3f [3277872,5037] 0 2023-12-05T09:57:44.442 INFO:tasks.workunit.client.0.smithi100.stdout:1/802: rename db/d12/d1e/d26/d30/d52/dd0 to db/d12/d1e/d72/ddd/dfd 0 2023-12-05T09:57:44.442 INFO:tasks.workunit.client.1.smithi150.stdout:8/895: symlink d0/da1/dfb/d110/l118 0 2023-12-05T09:57:44.442 INFO:tasks.workunit.client.1.smithi150.stdout:8/896: chown d0/d41/d49/d1b/d24/d38/d62/fc1 3817 1 2023-12-05T09:57:44.442 INFO:tasks.workunit.client.1.smithi150.stdout:8/897: fdatasync d0/d41/d49/d1b/d24/d2e/f95 0 2023-12-05T09:57:44.445 INFO:tasks.workunit.client.0.smithi100.stdout:8/776: mknod d0/db7/dcf/cdc 0 2023-12-05T09:57:44.447 INFO:tasks.workunit.client.0.smithi100.stdout:5/884: mkdir d0/d16/d37/d138 0 2023-12-05T09:57:44.447 INFO:tasks.workunit.client.0.smithi100.stdout:5/885: stat d0/l8c 0 2023-12-05T09:57:44.447 INFO:tasks.workunit.client.0.smithi100.stdout:5/886: readlink d0/d1b/d4d/d8e/d125/d14/l11e 0 2023-12-05T09:57:44.448 INFO:tasks.workunit.client.1.smithi150.stdout:0/931: symlink d5/d11/d71/d99/d9c/d96/dc1/l13c 0 2023-12-05T09:57:44.454 INFO:tasks.workunit.client.0.smithi100.stdout:1/803: mknod db/d12/d1e/d26/d30/cfe 0 2023-12-05T09:57:44.454 INFO:tasks.workunit.client.0.smithi100.stdout:1/804: fdatasync db/d12/d1e/d72/fc6 0 2023-12-05T09:57:44.454 INFO:tasks.workunit.client.0.smithi100.stdout:1/805: chown db/d12/ca5 1165 1 2023-12-05T09:57:44.456 INFO:tasks.workunit.client.0.smithi100.stdout:8/777: truncate d0/d12/fc1 529952 0 2023-12-05T09:57:44.456 INFO:tasks.workunit.client.0.smithi100.stdout:8/778: dread - d0/d12/d13/d45/da6/d76/fbe zero size 2023-12-05T09:57:44.457 INFO:tasks.workunit.client.0.smithi100.stdout:0/782: rename da/d2a/d4d/fa2 to da/d22/fec 0 2023-12-05T09:57:44.460 INFO:tasks.workunit.client.1.smithi150.stdout:8/898: dread d0/d41/d49/d1b/d24/d2e/d4d/fed [0,4194304] 0 2023-12-05T09:57:44.461 INFO:tasks.workunit.client.0.smithi100.stdout:1/806: mknod db/d12/d1e/d26/d30/cff 0 2023-12-05T09:57:44.461 INFO:tasks.workunit.client.0.smithi100.stdout:1/807: fsync db/d12/d1e/f50 0 2023-12-05T09:57:44.462 INFO:tasks.workunit.client.0.smithi100.stdout:8/779: mknod d0/d12/d13/d45/dba/dbd/d72/cdd 0 2023-12-05T09:57:44.462 INFO:tasks.workunit.client.0.smithi100.stdout:8/780: chown d0/d35/d64/d81/d9a/d9d/fb2 2785453 1 2023-12-05T09:57:44.464 INFO:tasks.workunit.client.1.smithi150.stdout:8/899: creat d0/d41/d49/dda/f119 x:0 0 0 2023-12-05T09:57:44.464 INFO:tasks.workunit.client.1.smithi150.stdout:8/900: fdatasync d0/d41/d49/d1b/d24/d34/da2/dff/f9e 0 2023-12-05T09:57:44.466 INFO:tasks.workunit.client.0.smithi100.stdout:5/887: rename d0/d16/d2b/de3/fec to d0/d1b/d4d/d8e/d96/dc1/f139 0 2023-12-05T09:57:44.466 INFO:tasks.workunit.client.0.smithi100.stdout:5/888: write d0/d1f/da1/d11b/df/d51/da8/dee/f12b [2589697,9687] 0 2023-12-05T09:57:44.467 INFO:tasks.workunit.client.0.smithi100.stdout:5/889: creat d0/d16/d37/f13a x:0 0 0 2023-12-05T09:57:44.469 INFO:tasks.workunit.client.1.smithi150.stdout:8/901: dread d0/d41/d49/d1b/d24/d2e/f95 [0,4194304] 0 2023-12-05T09:57:44.469 INFO:tasks.workunit.client.1.smithi150.stdout:8/902: dread - d0/d41/d49/d1b/d24/d34/dbc/ff4 zero size 2023-12-05T09:57:44.469 INFO:tasks.workunit.client.0.smithi100.stdout:0/783: creat da/d1b/d6b/d78/de2/fed x:0 0 0 2023-12-05T09:57:44.471 INFO:tasks.workunit.client.0.smithi100.stdout:1/808: symlink db/d31/l100 0 2023-12-05T09:57:44.471 INFO:tasks.workunit.client.0.smithi100.stdout:8/781: mkdir d0/d12/d13/d45/dba/dbd/d72/d9f/dde 0 2023-12-05T09:57:44.472 INFO:tasks.workunit.client.0.smithi100.stdout:8/782: fsync d0/d12/d13/d16/f46 0 2023-12-05T09:57:44.472 INFO:tasks.workunit.client.0.smithi100.stdout:8/783: stat d0/c5e 0 2023-12-05T09:57:44.473 INFO:tasks.workunit.client.1.smithi150.stdout:8/903: symlink d0/d41/d49/d1b/d24/d5b/d9c/l11a 0 2023-12-05T09:57:44.475 INFO:tasks.workunit.client.1.smithi150.stdout:3/878: rename d6/d9/d3d/d56/d53/lc0 to d6/d9/d8d/l11b 0 2023-12-05T09:57:44.482 INFO:tasks.workunit.client.1.smithi150.stdout:8/904: symlink d0/d41/d49/l11b 0 2023-12-05T09:57:44.486 INFO:tasks.workunit.client.0.smithi100.stdout:5/890: mknod d0/d1b/d4d/d8e/c13b 0 2023-12-05T09:57:44.487 INFO:tasks.workunit.client.1.smithi150.stdout:8/905: mknod d0/d41/d49/d1b/d24/d34/d56/d67/d64/c11c 0 2023-12-05T09:57:44.488 INFO:tasks.workunit.client.0.smithi100.stdout:0/784: unlink da/d22/d33/d74/dca/db4/cde 0 2023-12-05T09:57:44.490 INFO:tasks.workunit.client.0.smithi100.stdout:8/784: creat d0/d12/d13/d45/dba/fdf x:0 0 0 2023-12-05T09:57:44.491 INFO:tasks.workunit.client.1.smithi150.stdout:8/906: unlink d0/da1/dfb/d110/d116/f100 0 2023-12-05T09:57:44.494 INFO:tasks.workunit.client.1.smithi150.stdout:8/907: mknod d0/d41/d49/d1b/d24/c11d 0 2023-12-05T09:57:44.494 INFO:tasks.workunit.client.1.smithi150.stdout:8/908: stat d0/d41/d49/d1b/d24/d34/d56/f76 0 2023-12-05T09:57:44.498 INFO:tasks.workunit.client.0.smithi100.stdout:0/785: unlink da/d1b/c6d 0 2023-12-05T09:57:44.498 INFO:tasks.workunit.client.1.smithi150.stdout:5/867: truncate d1/d7f/d65/d3b/d6b/d11e/dca/dcd/ff5 4535698 0 2023-12-05T09:57:44.499 INFO:tasks.workunit.client.1.smithi150.stdout:5/868: fdatasync d1/d3/d6/d1b/f6a 0 2023-12-05T09:57:44.502 INFO:tasks.workunit.client.1.smithi150.stdout:9/773: rename d3/d9/la7 to d3/d9/dc/d1f/d24/d75/d95/lfb 0 2023-12-05T09:57:44.508 INFO:tasks.workunit.client.0.smithi100.stdout:0/786: creat da/d22/d33/d7f/fee x:0 0 0 2023-12-05T09:57:44.508 INFO:tasks.workunit.client.0.smithi100.stdout:0/787: write da/d22/d33/d74/dca/fdd [4948904,31887] 0 2023-12-05T09:57:44.508 INFO:tasks.workunit.client.1.smithi150.stdout:2/878: dwrite d0/d3/d27/d51/d125/f106 [0,4194304] 0 2023-12-05T09:57:44.510 INFO:tasks.workunit.client.1.smithi150.stdout:7/855: rename d2/d72/d82/l119 to d2/db/d2e/l11b 0 2023-12-05T09:57:44.511 INFO:tasks.workunit.client.1.smithi150.stdout:9/774: creat d3/d9/d9c/ffc x:0 0 0 2023-12-05T09:57:44.518 INFO:tasks.workunit.client.1.smithi150.stdout:5/869: truncate d1/d2e/da6/d24/f41 3278369 0 2023-12-05T09:57:44.519 INFO:tasks.workunit.client.0.smithi100.stdout:0/788: mknod da/d22/d33/d35/d3a/d8b/cef 0 2023-12-05T09:57:44.521 INFO:tasks.workunit.client.0.smithi100.stdout:1/809: dwrite db/d12/d1e/d72/ddd/dfd/dd6/fdc [0,4194304] 0 2023-12-05T09:57:44.521 INFO:tasks.workunit.client.0.smithi100.stdout:1/810: write db/d31/fe1 [55615,37922] 0 2023-12-05T09:57:44.527 INFO:tasks.workunit.client.0.smithi100.stdout:0/789: symlink da/d22/d33/d35/d3a/d8b/d8f/lf0 0 2023-12-05T09:57:44.528 INFO:tasks.workunit.client.0.smithi100.stdout:1/811: dread db/d31/d3a/d3b/f9b [0,4194304] 0 2023-12-05T09:57:44.530 INFO:tasks.workunit.client.1.smithi150.stdout:2/879: link d0/d3/d27/d51/d125/f106 d0/d3/d5/d22/d52/d5a/d108/d114/f12d 0 2023-12-05T09:57:44.535 INFO:tasks.workunit.client.1.smithi150.stdout:7/856: rename d2/db/d17/d20/l33 to d2/db/d30/d13/d4f/d7e/l11c 0 2023-12-05T09:57:44.535 INFO:tasks.workunit.client.1.smithi150.stdout:5/870: dread d1/d3/fd1 [0,4194304] 0 2023-12-05T09:57:44.535 INFO:tasks.workunit.client.1.smithi150.stdout:5/871: write d1/d64/ded/f125 [545693,57772] 0 2023-12-05T09:57:44.535 INFO:tasks.workunit.client.1.smithi150.stdout:5/872: truncate d1/d3/d6/d72/fc3 655399 0 2023-12-05T09:57:44.536 INFO:tasks.workunit.client.0.smithi100.stdout:5/891: dread d0/d1b/ffe [0,4194304] 0 2023-12-05T09:57:44.538 INFO:tasks.workunit.client.0.smithi100.stdout:7/791: sync 2023-12-05T09:57:44.538 INFO:tasks.workunit.client.0.smithi100.stdout:3/904: sync 2023-12-05T09:57:44.538 INFO:tasks.workunit.client.0.smithi100.stdout:7/792: stat d3/dc/d11/f31 0 2023-12-05T09:57:44.538 INFO:tasks.workunit.client.0.smithi100.stdout:7/793: fdatasync d3/dc/d11/f110 0 2023-12-05T09:57:44.538 INFO:tasks.workunit.client.0.smithi100.stdout:7/794: fdatasync d3/dc/d11/d13/de/d18/d3b/d40/d46/f116 0 2023-12-05T09:57:44.549 INFO:tasks.workunit.client.0.smithi100.stdout:5/892: symlink d0/d1b/d4d/d8e/d96/dea/l13c 0 2023-12-05T09:57:44.549 INFO:tasks.workunit.client.1.smithi150.stdout:2/880: creat d0/d3/d21/d4d/deb/d103/d15/d30/d54/d57/f12e x:0 0 0 2023-12-05T09:57:44.550 INFO:tasks.workunit.client.1.smithi150.stdout:7/857: mkdir d2/db/d30/daf/d11d 0 2023-12-05T09:57:44.553 INFO:tasks.workunit.client.1.smithi150.stdout:5/873: creat d1/d7f/d65/d3b/d6b/d128/f132 x:0 0 0 2023-12-05T09:57:44.555 INFO:tasks.workunit.client.1.smithi150.stdout:8/909: dwrite d0/f99 [0,4194304] 0 2023-12-05T09:57:44.559 INFO:tasks.workunit.client.0.smithi100.stdout:7/795: mknod d3/dc/d11/d13/de/d18/c124 0 2023-12-05T09:57:44.562 INFO:tasks.workunit.client.1.smithi150.stdout:2/881: truncate d0/d3/d5/d3b/d4c/f64 771501 0 2023-12-05T09:57:44.565 INFO:tasks.workunit.client.1.smithi150.stdout:7/858: mkdir d2/db/d2e/d9a/d11e 0 2023-12-05T09:57:44.565 INFO:tasks.workunit.client.1.smithi150.stdout:7/859: readlink d2/db/d2e/d9a/lce 0 2023-12-05T09:57:44.565 INFO:tasks.workunit.client.1.smithi150.stdout:7/860: chown d2/db/d30/daf/dd3/d2b 6055 1 2023-12-05T09:57:44.566 INFO:tasks.workunit.client.0.smithi100.stdout:5/893: dread d0/d1f/d25/d31/f3f [0,4194304] 0 2023-12-05T09:57:44.568 INFO:tasks.workunit.client.0.smithi100.stdout:7/796: truncate d3/dc/d11/d13/de/d18/f11d 1372713 0 2023-12-05T09:57:44.568 INFO:tasks.workunit.client.1.smithi150.stdout:8/910: getdents d0/d41/d49/d1b/d24/d34/da2/dff 0 2023-12-05T09:57:44.571 INFO:tasks.workunit.client.0.smithi100.stdout:1/812: dwrite db/d12/d61/fbc [0,4194304] 0 2023-12-05T09:57:44.571 INFO:tasks.workunit.client.0.smithi100.stdout:1/813: chown db/l49 1646613 1 2023-12-05T09:57:44.574 INFO:tasks.workunit.client.0.smithi100.stdout:5/894: dread d0/d1f/d25/d31/f119 [0,4194304] 0 2023-12-05T09:57:44.574 INFO:tasks.workunit.client.0.smithi100.stdout:7/797: rename d3/dc/d11/d13/da8/fe3 to d3/dc/d11/d13/da8/d10f/f125 0 2023-12-05T09:57:44.580 INFO:tasks.workunit.client.1.smithi150.stdout:8/911: mknod d0/d41/d49/d1b/d24/d34/d56/d67/d64/d113/c11e 0 2023-12-05T09:57:44.586 INFO:tasks.workunit.client.0.smithi100.stdout:1/814: symlink db/d12/d1e/d72/ddd/dfd/dd6/l101 0 2023-12-05T09:57:44.586 INFO:tasks.workunit.client.0.smithi100.stdout:1/815: truncate db/d31/f36 1452777 0 2023-12-05T09:57:44.586 INFO:tasks.workunit.client.0.smithi100.stdout:1/816: chown db/d12/d1e/d26/d39 3 1 2023-12-05T09:57:44.587 INFO:tasks.workunit.client.1.smithi150.stdout:7/861: truncate d2/db/f45 4916868 0 2023-12-05T09:57:44.587 INFO:tasks.workunit.client.1.smithi150.stdout:7/862: write d2/db/d30/d47/fd0 [750840,80873] 0 2023-12-05T09:57:44.589 INFO:tasks.workunit.client.1.smithi150.stdout:8/912: creat d0/d41/d49/d1b/d24/d38/d62/dac/f11f x:0 0 0 2023-12-05T09:57:44.590 INFO:tasks.workunit.client.0.smithi100.stdout:5/895: dread d0/d1b/d4d/d8e/fda [0,4194304] 0 2023-12-05T09:57:44.591 INFO:tasks.workunit.client.1.smithi150.stdout:7/863: mkdir d2/d9d/d101/d11f 0 2023-12-05T09:57:44.591 INFO:tasks.workunit.client.1.smithi150.stdout:7/864: read d2/db/d30/d53/fcc [4357375,92654] 0 2023-12-05T09:57:44.591 INFO:tasks.workunit.client.1.smithi150.stdout:7/865: fdatasync d2/db/d30/daf/dd3/d2b/fe0 0 2023-12-05T09:57:44.593 INFO:tasks.workunit.client.0.smithi100.stdout:1/817: creat db/d12/d1e/d26/d30/d52/f102 x:0 0 0 2023-12-05T09:57:44.593 INFO:tasks.workunit.client.0.smithi100.stdout:9/849: write d7/fc [3005597,16002] 0 2023-12-05T09:57:44.594 INFO:tasks.workunit.client.1.smithi150.stdout:2/882: dwrite d0/d3/d21/d4d/deb/d103/db9/fcb [0,4194304] 0 2023-12-05T09:57:44.596 INFO:tasks.workunit.client.1.smithi150.stdout:7/866: link d2/db/d30/d13/fe9 d2/d72/d82/f120 0 2023-12-05T09:57:44.597 INFO:tasks.workunit.client.0.smithi100.stdout:1/818: truncate db/d31/d3a/d4a/dad/fbf 190761 0 2023-12-05T09:57:44.599 INFO:tasks.workunit.client.0.smithi100.stdout:9/850: creat d7/d1b/d22/d2a/d56/f12e x:0 0 0 2023-12-05T09:57:44.599 INFO:tasks.workunit.client.0.smithi100.stdout:9/851: creat d7/d1b/d22/d2a/d56/d9c/f12f x:0 0 0 2023-12-05T09:57:44.601 INFO:tasks.workunit.client.1.smithi150.stdout:8/913: dread d0/d41/d49/d1b/d24/d5b/f96 [0,4194304] 0 2023-12-05T09:57:44.603 INFO:tasks.workunit.client.0.smithi100.stdout:5/896: rmdir d0/d1f/d53 39 2023-12-05T09:57:44.604 INFO:tasks.workunit.client.0.smithi100.stdout:5/897: fdatasync d0/d1f/da1/d11b/df/fdf 0 2023-12-05T09:57:44.607 INFO:tasks.workunit.client.0.smithi100.stdout:4/774: sync 2023-12-05T09:57:44.609 INFO:tasks.workunit.client.1.smithi150.stdout:4/771: rename d0/d3e/f71 to d0/d3e/d5b/d80/dc8/fed 0 2023-12-05T09:57:44.614 INFO:tasks.workunit.client.1.smithi150.stdout:8/914: symlink d0/d41/d49/d1b/d24/d34/da2/l120 0 2023-12-05T09:57:44.615 INFO:tasks.workunit.client.0.smithi100.stdout:9/852: dread d7/d60/fcc [0,4194304] 0 2023-12-05T09:57:44.616 INFO:tasks.workunit.client.1.smithi150.stdout:9/775: rename d3/d9/dc/c10 to d3/d9/d26/d34/ded/cfd 0 2023-12-05T09:57:44.616 INFO:tasks.workunit.client.1.smithi150.stdout:9/776: dread - d3/d9/d58/fc5 zero size 2023-12-05T09:57:44.617 INFO:tasks.workunit.client.1.smithi150.stdout:9/777: fdatasync d3/d42/f8e 0 2023-12-05T09:57:44.617 INFO:tasks.workunit.client.0.smithi100.stdout:1/819: unlink db/d12/d1e/ff7 0 2023-12-05T09:57:44.619 INFO:tasks.workunit.client.1.smithi150.stdout:4/772: mkdir d0/d3e/d48/dbb/dca/dee 0 2023-12-05T09:57:44.619 INFO:tasks.workunit.client.1.smithi150.stdout:4/773: chown d0/d3e/l77 223980603 1 2023-12-05T09:57:44.621 INFO:tasks.workunit.client.0.smithi100.stdout:5/898: dread d0/d1b/f39 [0,4194304] 0 2023-12-05T09:57:44.621 INFO:tasks.workunit.client.0.smithi100.stdout:5/899: chown d0/d1b/d4d/d8e/d96/dc1/dae/db9/l10f 83891817 1 2023-12-05T09:57:44.622 INFO:tasks.workunit.client.0.smithi100.stdout:1/820: link db/d12/d1e/d26/d30/cfe db/d12/d1e/d72/ddd/c103 0 2023-12-05T09:57:44.623 INFO:tasks.workunit.client.0.smithi100.stdout:5/900: symlink d0/d1b/d4d/d8e/d96/dc1/dae/db9/ddc/l13d 0 2023-12-05T09:57:44.624 INFO:tasks.workunit.client.1.smithi150.stdout:0/932: write d5/d11/d71/d99/d9c/fd3 [819046,71620] 0 2023-12-05T09:57:44.624 INFO:tasks.workunit.client.1.smithi150.stdout:0/933: chown d5/d11/d71/d5f/d6a/fe8 63911365 1 2023-12-05T09:57:44.624 INFO:tasks.workunit.client.1.smithi150.stdout:0/934: stat d5/d11/f24 0 2023-12-05T09:57:44.627 INFO:tasks.workunit.client.0.smithi100.stdout:1/821: link db/d12/d1e/d72/dc4/fd7 db/d12/d1e/d72/dc4/f104 0 2023-12-05T09:57:44.628 INFO:tasks.workunit.client.1.smithi150.stdout:9/778: unlink d3/d9/dc/d1f/d24/f9d 0 2023-12-05T09:57:44.628 INFO:tasks.workunit.client.1.smithi150.stdout:9/779: chown d3/d9/dc/d1f/d24/l60 115 1 2023-12-05T09:57:44.631 INFO:tasks.workunit.client.1.smithi150.stdout:7/867: rmdir d2/db/d30/dfe 0 2023-12-05T09:57:44.631 INFO:tasks.workunit.client.1.smithi150.stdout:7/868: truncate d2/db/d30/d47/fd8 773275 0 2023-12-05T09:57:44.631 INFO:tasks.workunit.client.1.smithi150.stdout:7/869: truncate d2/db/ff3 817811 0 2023-12-05T09:57:44.631 INFO:tasks.workunit.client.1.smithi150.stdout:7/870: readlink d2/db/d30/d13/d4f/d7e/lef 0 2023-12-05T09:57:44.634 INFO:tasks.workunit.client.0.smithi100.stdout:1/822: unlink db/d12/d1e/d26/d30/d6e/c74 0 2023-12-05T09:57:44.634 INFO:tasks.workunit.client.0.smithi100.stdout:1/823: dread - db/d31/d3a/d3b/f70 zero size 2023-12-05T09:57:44.635 INFO:tasks.workunit.client.0.smithi100.stdout:1/824: symlink db/d12/d1e/dd3/db8/de7/l105 0 2023-12-05T09:57:44.636 INFO:tasks.workunit.client.1.smithi150.stdout:4/774: read d0/d5f/fd9 [2302903,102165] 0 2023-12-05T09:57:44.636 INFO:tasks.workunit.client.1.smithi150.stdout:0/935: creat d5/d11/d71/d99/d9c/d3b/de0/d106/d12d/f13d x:0 0 0 2023-12-05T09:57:44.639 INFO:tasks.workunit.client.1.smithi150.stdout:4/775: rename d0/d3e/d48/l62 to d0/d3e/d5b/lef 0 2023-12-05T09:57:44.643 INFO:tasks.workunit.client.0.smithi100.stdout:5/901: write d0/d1b/f66 [898713,2983] 0 2023-12-05T09:57:44.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:44 smithi100 ceph-mon[107145]: pgmap v38: 65 pgs: 65 active+clean; 3.0 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 162 MiB/s rd, 205 MiB/s wr, 291 op/s 2023-12-05T09:57:44.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:44 smithi100 ceph-mon[107145]: Upgrade: Updating mgr.smithi100.ehmuhg 2023-12-05T09:57:44.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:44 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:57:44.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:44 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi100.ehmuhg", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-05T09:57:44.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:44 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-05T09:57:44.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:44 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:57:44.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:44 smithi100 ceph-mon[107145]: Deploying daemon mgr.smithi100.ehmuhg on smithi100 2023-12-05T09:57:44.646 INFO:tasks.workunit.client.1.smithi150.stdout:4/776: symlink d0/d3e/d5b/d80/lf0 0 2023-12-05T09:57:44.647 INFO:tasks.workunit.client.0.smithi100.stdout:5/902: mknod d0/d1f/da1/d11b/c13e 0 2023-12-05T09:57:44.654 INFO:tasks.workunit.client.1.smithi150.stdout:4/777: link d0/f30 d0/d3e/d48/ff1 0 2023-12-05T09:57:44.655 INFO:tasks.workunit.client.1.smithi150.stdout:4/778: truncate d0/d3e/d48/f9e 5150872 0 2023-12-05T09:57:44.656 INFO:tasks.workunit.client.0.smithi100.stdout:5/903: symlink d0/d1b/d4d/d8e/d96/dc1/d12e/l13f 0 2023-12-05T09:57:44.660 INFO:tasks.workunit.client.1.smithi150.stdout:4/779: rename d0/d3e/d5b/d80/da1/cb0 to d0/d3e/d5b/de4/cf2 0 2023-12-05T09:57:44.662 INFO:tasks.workunit.client.0.smithi100.stdout:7/798: creat d3/dc/d11/d13/f126 x:0 0 0 2023-12-05T09:57:44.662 INFO:tasks.workunit.client.0.smithi100.stdout:7/799: fsync d3/dc/daa/fe1 0 2023-12-05T09:57:44.662 INFO:tasks.workunit.client.0.smithi100.stdout:7/800: chown d3/dc/d11/d13/de/d18/d3b/d40 59784690 1 2023-12-05T09:57:44.663 INFO:tasks.workunit.client.1.smithi150.stdout:4/780: symlink d0/d3e/d5b/lf3 0 2023-12-05T09:57:44.666 INFO:tasks.workunit.client.1.smithi150.stdout:0/936: dread d5/d11/d71/d99/d9c/d96/dd5/d7f/f116 [0,4194304] 0 2023-12-05T09:57:44.668 INFO:tasks.workunit.client.1.smithi150.stdout:4/781: unlink d0/d3e/d5b/c8b 0 2023-12-05T09:57:44.668 INFO:tasks.workunit.client.1.smithi150.stdout:4/782: creat d0/d3e/d5b/d80/dc8/ff4 x:0 0 0 2023-12-05T09:57:44.672 INFO:tasks.workunit.client.0.smithi100.stdout:5/904: write d0/d16/d2b/f7f [78806,19067] 0 2023-12-05T09:57:44.672 INFO:tasks.workunit.client.0.smithi100.stdout:5/905: creat d0/d27/dc0/f140 x:0 0 0 2023-12-05T09:57:44.672 INFO:tasks.workunit.client.0.smithi100.stdout:5/906: stat d0/d1f/da1/d11b/df/fe2 0 2023-12-05T09:57:44.672 INFO:tasks.workunit.client.0.smithi100.stdout:5/907: chown d0/d1f/f2e 49 1 2023-12-05T09:57:44.673 INFO:tasks.workunit.client.1.smithi150.stdout:6/749: dwrite d2/d23/d2e/f3c [0,4194304] 0 2023-12-05T09:57:44.674 INFO:tasks.workunit.client.1.smithi150.stdout:0/937: mknod d5/d11/d71/d99/d9c/d13a/df4/c13e 0 2023-12-05T09:57:44.674 INFO:tasks.workunit.client.1.smithi150.stdout:0/938: chown d5/d11/d71/d99/d9c/fd3 0 1 2023-12-05T09:57:44.674 INFO:tasks.workunit.client.1.smithi150.stdout:0/939: read d5/d11/d71/d99/d9c/d96/dd5/d7f/fac [1000313,64661] 0 2023-12-05T09:57:44.674 INFO:tasks.workunit.client.1.smithi150.stdout:0/940: write d5/d11/d16/fa3 [873473,46297] 0 2023-12-05T09:57:44.674 INFO:tasks.workunit.client.1.smithi150.stdout:0/941: read d5/d11/d71/f56 [498218,106891] 0 2023-12-05T09:57:44.674 INFO:tasks.workunit.client.1.smithi150.stdout:0/942: dread - d5/d11/d71/d5f/d6a/f139 zero size 2023-12-05T09:57:44.676 INFO:tasks.workunit.client.1.smithi150.stdout:1/888: sync 2023-12-05T09:57:44.678 INFO:tasks.workunit.client.0.smithi100.stdout:9/853: dwrite d7/d1b/d89/f120 [0,4194304] 0 2023-12-05T09:57:44.684 INFO:tasks.workunit.client.1.smithi150.stdout:2/883: dwrite d0/d3/d21/d4d/deb/ff6 [0,4194304] 0 2023-12-05T09:57:44.684 INFO:tasks.workunit.client.1.smithi150.stdout:2/884: chown d0/d3/d5/d22/d52/d56/l111 0 1 2023-12-05T09:57:44.690 INFO:tasks.workunit.client.0.smithi100.stdout:4/775: dwrite de/d16/d23/d60/df7/d4e/fee [0,4194304] 0 2023-12-05T09:57:44.703 INFO:tasks.workunit.client.1.smithi150.stdout:6/750: write d2/d23/d3b/d64/fea [7366410,75510] 0 2023-12-05T09:57:44.704 INFO:tasks.workunit.client.1.smithi150.stdout:2/885: symlink d0/d3/d27/dac/l12f 0 2023-12-05T09:57:44.705 INFO:tasks.workunit.client.1.smithi150.stdout:2/886: creat d0/d3/d27/d51/f130 x:0 0 0 2023-12-05T09:57:44.709 INFO:tasks.workunit.client.0.smithi100.stdout:0/790: mkdir da/d22/d33/d74/dca/df1 0 2023-12-05T09:57:44.717 INFO:tasks.workunit.client.1.smithi150.stdout:9/780: dwrite d3/d9/d58/fcf [0,4194304] 0 2023-12-05T09:57:44.718 INFO:tasks.workunit.client.1.smithi150.stdout:6/751: creat d2/d23/d3b/db4/df1/ffb x:0 0 0 2023-12-05T09:57:44.718 INFO:tasks.workunit.client.1.smithi150.stdout:6/752: fdatasync d2/d23/d2e/d5f/d99/fd4 0 2023-12-05T09:57:44.718 INFO:tasks.workunit.client.1.smithi150.stdout:6/753: stat d2/d23/d2e/d5f/d99/lae 0 2023-12-05T09:57:44.725 INFO:tasks.workunit.client.0.smithi100.stdout:9/854: unlink d7/ca6 0 2023-12-05T09:57:44.731 INFO:tasks.workunit.client.1.smithi150.stdout:7/871: dwrite d2/db/d17/d20/f3f [4194304,4194304] 0 2023-12-05T09:57:44.732 INFO:tasks.workunit.client.1.smithi150.stdout:7/872: read d2/d1b/ff7 [154830,25687] 0 2023-12-05T09:57:44.732 INFO:tasks.workunit.client.1.smithi150.stdout:7/873: creat d2/db/d30/d47/f121 x:0 0 0 2023-12-05T09:57:44.735 INFO:tasks.workunit.client.1.smithi150.stdout:0/943: dwrite d5/f31 [4194304,4194304] 0 2023-12-05T09:57:44.735 INFO:tasks.workunit.client.1.smithi150.stdout:0/944: fsync d5/d11/d32/f91 0 2023-12-05T09:57:44.735 INFO:tasks.workunit.client.1.smithi150.stdout:0/945: stat d5/d11/d71/d99/d9c/d96/dd5/d7f/f116 0 2023-12-05T09:57:44.736 INFO:tasks.workunit.client.0.smithi100.stdout:4/776: dwrite f9 [0,4194304] 0 2023-12-05T09:57:44.737 INFO:tasks.workunit.client.0.smithi100.stdout:8/785: dwrite d0/d12/d13/f90 [0,4194304] 0 2023-12-05T09:57:44.737 INFO:tasks.workunit.client.0.smithi100.stdout:8/786: truncate d0/d12/d13/d45/dba/dbd/d82/fb5 4493613 0 2023-12-05T09:57:44.738 INFO:tasks.workunit.client.0.smithi100.stdout:9/855: dread d7/d1b/d22/d51/dc0/fee [0,4194304] 0 2023-12-05T09:57:44.738 INFO:tasks.workunit.client.0.smithi100.stdout:9/856: chown d7/d35/d71/d9a/dcd/d122/f7c 1763200 1 2023-12-05T09:57:44.739 INFO:tasks.workunit.client.0.smithi100.stdout:3/905: write d0/fa7 [2572207,13065] 0 2023-12-05T09:57:44.741 INFO:tasks.workunit.client.1.smithi150.stdout:9/781: link d3/d1b/l45 d3/d42/d62/d97/lfe 0 2023-12-05T09:57:44.741 INFO:tasks.workunit.client.1.smithi150.stdout:9/782: chown d3/d1b 52027 1 2023-12-05T09:57:44.742 INFO:tasks.workunit.client.0.smithi100.stdout:4/777: creat de/d16/d23/d33/dae/dd1/ffd x:0 0 0 2023-12-05T09:57:44.744 INFO:tasks.workunit.client.1.smithi150.stdout:6/754: mknod d2/d23/d2e/d44/da0/cfc 0 2023-12-05T09:57:44.744 INFO:tasks.workunit.client.1.smithi150.stdout:6/755: dread - d2/d23/d3b/d83/fe5 zero size 2023-12-05T09:57:44.745 INFO:tasks.workunit.client.1.smithi150.stdout:6/756: dread - d2/d23/d3b/d64/d7a/d5d/dcd/fe6 zero size 2023-12-05T09:57:44.745 INFO:tasks.workunit.client.0.smithi100.stdout:5/908: dwrite d0/d1b/d4d/d8e/d96/dc1/dae/fcd [0,4194304] 0 2023-12-05T09:57:44.747 INFO:tasks.workunit.client.1.smithi150.stdout:2/887: rename d0/d3/d27/d51/f130 to d0/d3/d5/f131 0 2023-12-05T09:57:44.751 INFO:tasks.workunit.client.0.smithi100.stdout:7/801: rmdir d3/dc/d11/d13/de 39 2023-12-05T09:57:44.752 INFO:tasks.workunit.client.0.smithi100.stdout:7/802: readlink d3/dc/d11/d13/de/d2d/ld8 0 2023-12-05T09:57:44.754 INFO:tasks.workunit.client.0.smithi100.stdout:8/787: unlink d0/d12/d13/d45/dba/dbd/d82/lc3 0 2023-12-05T09:57:44.754 INFO:tasks.workunit.client.1.smithi150.stdout:5/874: write d1/d3/d6/d1b/fa7 [1067889,108716] 0 2023-12-05T09:57:44.755 INFO:tasks.workunit.client.1.smithi150.stdout:5/875: write d1/d7f/f94 [740272,114223] 0 2023-12-05T09:57:44.756 INFO:tasks.workunit.client.1.smithi150.stdout:4/783: dwrite d0/d3e/d48/f53 [0,4194304] 0 2023-12-05T09:57:44.757 INFO:tasks.workunit.client.1.smithi150.stdout:4/784: fdatasync d0/d3e/fc1 0 2023-12-05T09:57:44.757 INFO:tasks.workunit.client.1.smithi150.stdout:4/785: dread - d0/d3e/d6d/ddf/fd6 zero size 2023-12-05T09:57:44.757 INFO:tasks.workunit.client.1.smithi150.stdout:4/786: truncate d0/d3e/d5b/d6e/f88 882577 0 2023-12-05T09:57:44.757 INFO:tasks.workunit.client.1.smithi150.stdout:4/787: readlink d0/d3e/d6d/d95/l9d 0 2023-12-05T09:57:44.757 INFO:tasks.workunit.client.1.smithi150.stdout:4/788: chown d0/d3e/d6d/d4b/d8c/f8e 8224900 1 2023-12-05T09:57:44.762 INFO:tasks.workunit.client.1.smithi150.stdout:6/757: creat d2/d23/ffd x:0 0 0 2023-12-05T09:57:44.762 INFO:tasks.workunit.client.0.smithi100.stdout:0/791: dwrite da/d2a/f3f [0,4194304] 0 2023-12-05T09:57:44.763 INFO:tasks.workunit.client.0.smithi100.stdout:4/778: rename de/d16/d23/d33/d3d to de/d16/d23/d36/dfe 0 2023-12-05T09:57:44.767 INFO:tasks.workunit.client.1.smithi150.stdout:7/874: rename d2/d39/f67 to d2/db/d30/d13/d4f/f122 0 2023-12-05T09:57:44.767 INFO:tasks.workunit.client.1.smithi150.stdout:7/875: chown d2/db/d17/d3a/l113 1 1 2023-12-05T09:57:44.772 INFO:tasks.workunit.client.1.smithi150.stdout:2/888: truncate d0/d3/d21/d4d/deb/d103/d15/d30/d54/d57/f75 2900060 0 2023-12-05T09:57:44.781 INFO:tasks.workunit.client.1.smithi150.stdout:1/889: dwrite d6/d8/d85/d10e/f11b [0,4194304] 0 2023-12-05T09:57:44.782 INFO:tasks.workunit.client.1.smithi150.stdout:1/890: write d6/d47/dcf/ff3 [594233,28416] 0 2023-12-05T09:57:44.788 INFO:tasks.workunit.client.1.smithi150.stdout:4/789: mknod d0/d3e/d6d/ddf/da4/cf5 0 2023-12-05T09:57:44.788 INFO:tasks.workunit.client.1.smithi150.stdout:4/790: chown d0/d3e/d5b/d6e/daa/cc0 861139 1 2023-12-05T09:57:44.788 INFO:tasks.workunit.client.1.smithi150.stdout:4/791: chown d0/d5f/cb5 117 1 2023-12-05T09:57:44.788 INFO:tasks.workunit.client.1.smithi150.stdout:6/758: dread d2/d23/d3b/d64/d7a/f40 [0,4194304] 0 2023-12-05T09:57:44.788 INFO:tasks.workunit.client.1.smithi150.stdout:6/759: read - d2/d23/d2e/d5f/d99/dd8/ff2 zero size 2023-12-05T09:57:44.788 INFO:tasks.workunit.client.1.smithi150.stdout:6/760: write d2/d23/d2e/d5f/d99/dd8/ff2 [531748,119511] 0 2023-12-05T09:57:44.789 INFO:tasks.workunit.client.0.smithi100.stdout:3/906: dread d0/d3d/d5c/fd4 [0,4194304] 0 2023-12-05T09:57:44.789 INFO:tasks.workunit.client.0.smithi100.stdout:3/907: stat d0/d3d/d5c/d139/de/d11/c117 0 2023-12-05T09:57:44.789 INFO:tasks.workunit.client.0.smithi100.stdout:3/908: write d0/d3d/d5c/d139/de/d11/f30 [830955,51056] 0 2023-12-05T09:57:44.789 INFO:tasks.workunit.client.0.smithi100.stdout:3/909: chown d0/d10/d39/c66 84669 1 2023-12-05T09:57:44.791 INFO:tasks.workunit.client.1.smithi150.stdout:3/879: sync 2023-12-05T09:57:44.794 INFO:tasks.workunit.client.1.smithi150.stdout:9/783: mknod d3/d9/cff 0 2023-12-05T09:57:44.796 INFO:tasks.workunit.client.1.smithi150.stdout:7/876: creat d2/db/d17/d38/dc8/f123 x:0 0 0 2023-12-05T09:57:44.798 INFO:tasks.workunit.client.0.smithi100.stdout:8/788: creat d0/d12/d13/d16/da3/fe0 x:0 0 0 2023-12-05T09:57:44.799 INFO:tasks.workunit.client.0.smithi100.stdout:8/789: fsync d0/d12/d13/d45/fbf 0 2023-12-05T09:57:44.799 INFO:tasks.workunit.client.0.smithi100.stdout:8/790: dread - d0/d12/fd8 zero size 2023-12-05T09:57:44.802 INFO:tasks.workunit.client.0.smithi100.stdout:0/792: unlink da/d22/d33/d7f/d94/f9e 0 2023-12-05T09:57:44.802 INFO:tasks.workunit.client.0.smithi100.stdout:0/793: readlink da/d1b/l1d 0 2023-12-05T09:57:44.802 INFO:tasks.workunit.client.0.smithi100.stdout:0/794: fsync da/d22/d33/d74/dca/fdd 0 2023-12-05T09:57:44.807 INFO:tasks.workunit.client.0.smithi100.stdout:3/910: mkdir d0/d4/d13c 0 2023-12-05T09:57:44.807 INFO:tasks.workunit.client.0.smithi100.stdout:3/911: chown d0/d3d/d5c/d5f/l85 1128 1 2023-12-05T09:57:44.810 INFO:tasks.workunit.client.0.smithi100.stdout:8/791: mkdir d0/d12/d13/d45/dba/dbd/d72/d9f/de1 0 2023-12-05T09:57:44.814 INFO:tasks.workunit.client.0.smithi100.stdout:3/912: mkdir d0/d3d/d5c/d139/de/d8d/d11e/d13d 0 2023-12-05T09:57:44.821 INFO:tasks.workunit.client.0.smithi100.stdout:3/913: creat d0/d3d/d5c/d139/de/d8d/d11e/d13d/f13e x:0 0 0 2023-12-05T09:57:44.822 INFO:tasks.workunit.client.1.smithi150.stdout:4/792: dread d0/d3e/d6d/ddf/da4/dd7/f97 [0,4194304] 0 2023-12-05T09:57:44.822 INFO:tasks.workunit.client.1.smithi150.stdout:5/876: dwrite d1/d64/d31/fb6 [4194304,4194304] 0 2023-12-05T09:57:44.823 INFO:tasks.workunit.client.0.smithi100.stdout:9/857: dwrite d7/d1b/d22/d51/f2d [0,4194304] 0 2023-12-05T09:57:44.823 INFO:tasks.workunit.client.0.smithi100.stdout:9/858: chown d7/d1b/d22/d51/c125 112615667 1 2023-12-05T09:57:44.823 INFO:tasks.workunit.client.0.smithi100.stdout:9/859: chown d7/d20/d69/def/da2/fc3 30528 1 2023-12-05T09:57:44.823 INFO:tasks.workunit.client.0.smithi100.stdout:9/860: chown d7/d20/d69/def/fb0 58725298 1 2023-12-05T09:57:44.823 INFO:tasks.workunit.client.0.smithi100.stdout:9/861: truncate d7/d1b/d22/d2a/d56/d9c/dfd/d109/f113 108435 0 2023-12-05T09:57:44.824 INFO:tasks.workunit.client.1.smithi150.stdout:0/946: dwrite d5/d11/d71/d99/d9c/d46/d80/f11a [0,4194304] 0 2023-12-05T09:57:44.824 INFO:tasks.workunit.client.0.smithi100.stdout:5/909: dwrite d0/d27/f29 [0,4194304] 0 2023-12-05T09:57:44.827 INFO:tasks.workunit.client.1.smithi150.stdout:6/761: write d2/d23/f29 [3232594,42524] 0 2023-12-05T09:57:44.827 INFO:tasks.workunit.client.1.smithi150.stdout:6/762: fdatasync d2/d23/d2e/d72/fe7 0 2023-12-05T09:57:44.827 INFO:tasks.workunit.client.1.smithi150.stdout:6/763: truncate d2/d23/d3b/d46/f68 5201903 0 2023-12-05T09:57:44.828 INFO:tasks.workunit.client.1.smithi150.stdout:1/891: mkdir d6/d47/dcf/d13a 0 2023-12-05T09:57:44.832 INFO:tasks.workunit.client.1.smithi150.stdout:3/880: write d6/f6c [3426870,9038] 0 2023-12-05T09:57:44.833 INFO:tasks.workunit.client.1.smithi150.stdout:7/877: creat d2/db/d30/daf/dd3/d2b/dd2/dfa/f124 x:0 0 0 2023-12-05T09:57:44.833 INFO:tasks.workunit.client.1.smithi150.stdout:7/878: dread - d2/db/d17/d38/dc8/f123 zero size 2023-12-05T09:57:44.834 INFO:tasks.workunit.client.1.smithi150.stdout:9/784: write d3/d9/d58/fcf [1286514,35417] 0 2023-12-05T09:57:44.834 INFO:tasks.workunit.client.0.smithi100.stdout:3/914: rmdir d0/d3d/d5c/d139/de/d8d 39 2023-12-05T09:57:44.834 INFO:tasks.workunit.client.0.smithi100.stdout:3/915: chown d0/d48/c12b 13217 1 2023-12-05T09:57:44.835 INFO:tasks.workunit.client.0.smithi100.stdout:3/916: truncate d0/d4/f4a 2537668 0 2023-12-05T09:57:44.837 INFO:tasks.workunit.client.1.smithi150.stdout:2/889: dwrite d0/d3/f70 [0,4194304] 0 2023-12-05T09:57:44.837 INFO:tasks.workunit.client.1.smithi150.stdout:2/890: read - d0/d3/d21/d4d/deb/d103/f101 zero size 2023-12-05T09:57:44.838 INFO:tasks.workunit.client.0.smithi100.stdout:8/792: rename d0/d35/d64/d81/d9a/d9d to d0/db7/de2 0 2023-12-05T09:57:44.839 INFO:tasks.workunit.client.1.smithi150.stdout:4/793: symlink d0/d3e/d6d/lf6 0 2023-12-05T09:57:44.841 INFO:tasks.workunit.client.1.smithi150.stdout:5/877: creat d1/d64/dfc/f133 x:0 0 0 2023-12-05T09:57:44.841 INFO:tasks.workunit.client.1.smithi150.stdout:5/878: stat d1/d3/f7e 0 2023-12-05T09:57:44.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:44 smithi150 ceph-mon[116142]: pgmap v38: 65 pgs: 65 active+clean; 3.0 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 162 MiB/s rd, 205 MiB/s wr, 291 op/s 2023-12-05T09:57:44.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:44 smithi150 ceph-mon[116142]: Upgrade: Updating mgr.smithi100.ehmuhg 2023-12-05T09:57:44.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:44 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:57:44.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:44 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi100.ehmuhg", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-05T09:57:44.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:44 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-05T09:57:44.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:44 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:57:44.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:44 smithi150 ceph-mon[116142]: Deploying daemon mgr.smithi100.ehmuhg on smithi100 2023-12-05T09:57:44.846 INFO:tasks.workunit.client.1.smithi150.stdout:2/891: dread d0/d3/d5/d3b/d4c/f64 [0,4194304] 0 2023-12-05T09:57:44.846 INFO:tasks.workunit.client.0.smithi100.stdout:3/917: symlink d0/d10/l13f 0 2023-12-05T09:57:44.847 INFO:tasks.workunit.client.1.smithi150.stdout:2/892: write d0/d3/d21/d4d/deb/d103/d15/f8d [1706934,29987] 0 2023-12-05T09:57:44.847 INFO:tasks.workunit.client.1.smithi150.stdout:2/893: write d0/d3/d27/d51/d125/f124 [172031,72224] 0 2023-12-05T09:57:44.847 INFO:tasks.workunit.client.1.smithi150.stdout:2/894: write d0/d3/d5/d3b/d4c/f123 [380346,79184] 0 2023-12-05T09:57:44.848 INFO:tasks.workunit.client.1.smithi150.stdout:5/879: dread d1/d3/d6/d72/fad [0,4194304] 0 2023-12-05T09:57:44.850 INFO:tasks.workunit.client.0.smithi100.stdout:8/793: creat d0/d12/d13/d45/dba/dbd/d72/d9f/fe3 x:0 0 0 2023-12-05T09:57:44.850 INFO:tasks.workunit.client.0.smithi100.stdout:8/794: read - d0/d12/d13/d45/da6/d9c/fca zero size 2023-12-05T09:57:44.853 INFO:tasks.workunit.client.1.smithi150.stdout:0/947: rename d5/d11/d71/d5f/d77/d87/ce2 to d5/c13f 0 2023-12-05T09:57:44.853 INFO:tasks.workunit.client.0.smithi100.stdout:4/779: dread de/d16/d23/f29 [0,4194304] 0 2023-12-05T09:57:44.854 INFO:tasks.workunit.client.1.smithi150.stdout:7/879: dread d2/db/d2e/d9a/ffd [0,4194304] 0 2023-12-05T09:57:44.854 INFO:tasks.workunit.client.0.smithi100.stdout:3/918: unlink d0/d3d/d5c/d139/de/d11/d7c/dd0/ff4 0 2023-12-05T09:57:44.854 INFO:tasks.workunit.client.0.smithi100.stdout:3/919: fdatasync d0/fce 0 2023-12-05T09:57:44.860 INFO:tasks.workunit.client.1.smithi150.stdout:6/764: getdents d2/d23/d3b/d64/d7a 0 2023-12-05T09:57:44.860 INFO:tasks.workunit.client.1.smithi150.stdout:6/765: read - d2/d23/d3b/d64/d7a/d5d/dcd/fe6 zero size 2023-12-05T09:57:44.862 INFO:tasks.workunit.client.1.smithi150.stdout:1/892: truncate d6/d8/d54/fdf 1911552 0 2023-12-05T09:57:44.870 INFO:tasks.workunit.client.1.smithi150.stdout:3/881: mknod d6/d25/dd7/c11c 0 2023-12-05T09:57:44.870 INFO:tasks.workunit.client.1.smithi150.stdout:3/882: stat d6/d9/d3d/d56/d53/fd0 0 2023-12-05T09:57:44.870 INFO:tasks.workunit.client.1.smithi150.stdout:3/883: write d6/d9/d3d/d56/d79/f7f [917322,21977] 0 2023-12-05T09:57:44.870 INFO:tasks.workunit.client.1.smithi150.stdout:9/785: symlink d3/d9/dc/d1f/d24/l100 0 2023-12-05T09:57:44.870 INFO:tasks.workunit.client.1.smithi150.stdout:9/786: stat d3/d9/d6e/d76 0 2023-12-05T09:57:44.871 INFO:tasks.workunit.client.0.smithi100.stdout:8/795: symlink d0/db7/le4 0 2023-12-05T09:57:44.871 INFO:tasks.workunit.client.1.smithi150.stdout:3/884: write d6/d9/d3d/d52/f6f [1395527,4992] 0 2023-12-05T09:57:44.872 INFO:tasks.workunit.client.1.smithi150.stdout:4/794: symlink d0/d3e/d48/dbb/lf7 0 2023-12-05T09:57:44.873 INFO:tasks.workunit.client.1.smithi150.stdout:0/948: read d5/d11/d71/d99/d9c/d3b/f9f [2934053,18962] 0 2023-12-05T09:57:44.873 INFO:tasks.workunit.client.1.smithi150.stdout:0/949: chown d5/d11/d32/df2/d107/l118 2 1 2023-12-05T09:57:44.873 INFO:tasks.workunit.client.1.smithi150.stdout:0/950: chown d5/d11/d32/c45 1074829 1 2023-12-05T09:57:44.873 INFO:tasks.workunit.client.1.smithi150.stdout:0/951: write d5/d11/d71/d99/d9c/d96/dd5/d7f/db4/fed [521416,18603] 0 2023-12-05T09:57:44.873 INFO:tasks.workunit.client.1.smithi150.stdout:0/952: fsync d5/d11/d71/d99/d9c/d3b/f9f 0 2023-12-05T09:57:44.873 INFO:tasks.workunit.client.0.smithi100.stdout:4/780: creat de/d16/d23/d60/df7/d4e/d85/fff x:0 0 0 2023-12-05T09:57:44.874 INFO:tasks.workunit.client.0.smithi100.stdout:0/795: dwrite da/d22/d33/fa9 [0,4194304] 0 2023-12-05T09:57:44.875 INFO:tasks.workunit.client.1.smithi150.stdout:2/895: truncate d0/d3/d21/f44 792316 0 2023-12-05T09:57:44.875 INFO:tasks.workunit.client.1.smithi150.stdout:2/896: truncate d0/d3/d5/d22/fbf 1063924 0 2023-12-05T09:57:44.875 INFO:tasks.workunit.client.1.smithi150.stdout:2/897: fdatasync d0/d3/d11/fb3 0 2023-12-05T09:57:44.875 INFO:tasks.workunit.client.1.smithi150.stdout:2/898: fdatasync d0/d3/d5/d10/d3d/da1/daa/fc7 0 2023-12-05T09:57:44.875 INFO:tasks.workunit.client.0.smithi100.stdout:3/920: creat d0/d48/f140 x:0 0 0 2023-12-05T09:57:44.876 INFO:tasks.workunit.client.1.smithi150.stdout:5/880: link d1/d7f/d65/d3b/d6b/d11e/f28 d1/d7f/d65/d3b/f134 0 2023-12-05T09:57:44.877 INFO:tasks.workunit.client.0.smithi100.stdout:8/796: truncate d0/d12/d13/d45/dba/dbd/f55 49172 0 2023-12-05T09:57:44.878 INFO:tasks.workunit.client.0.smithi100.stdout:8/797: creat d0/d12/d13/d45/dba/fe5 x:0 0 0 2023-12-05T09:57:44.879 INFO:tasks.workunit.client.0.smithi100.stdout:9/862: dwrite d7/d1b/d22/d51/d32/f42 [0,4194304] 0 2023-12-05T09:57:44.879 INFO:tasks.workunit.client.1.smithi150.stdout:6/766: symlink d2/d23/d2e/d5f/d99/dd8/ddf/lfe 0 2023-12-05T09:57:44.880 INFO:tasks.workunit.client.0.smithi100.stdout:4/781: creat de/d16/d23/d60/de3/deb/f100 x:0 0 0 2023-12-05T09:57:44.880 INFO:tasks.workunit.client.0.smithi100.stdout:4/782: getdents de/d16/d23/d60/d88/dc5 0 2023-12-05T09:57:44.880 INFO:tasks.workunit.client.0.smithi100.stdout:4/783: readlink de/d16/d23/d60/df7/lad 0 2023-12-05T09:57:44.882 INFO:tasks.workunit.client.1.smithi150.stdout:1/893: mkdir d6/d8/d85/d10e/d13b 0 2023-12-05T09:57:44.883 INFO:tasks.workunit.client.0.smithi100.stdout:3/921: dread d0/d3d/d5c/d139/de/d11/d7c/dd0/d125/f64 [0,4194304] 0 2023-12-05T09:57:44.884 INFO:tasks.workunit.client.1.smithi150.stdout:9/787: symlink d3/d1b/dca/l101 0 2023-12-05T09:57:44.889 INFO:tasks.workunit.client.1.smithi150.stdout:3/885: rename d6/d9/d3d/d56/d71/fa3 to d6/d9/d43/d47/d94/df1/d10b/f11d 0 2023-12-05T09:57:44.889 INFO:tasks.workunit.client.1.smithi150.stdout:3/886: write d6/d9/d3d/d56/d53/fd0 [161040,85094] 0 2023-12-05T09:57:44.894 INFO:tasks.workunit.client.1.smithi150.stdout:2/899: symlink d0/d3/d21/l132 0 2023-12-05T09:57:44.894 INFO:tasks.workunit.client.1.smithi150.stdout:2/900: creat d0/d3/d21/d4d/deb/d86/f133 x:0 0 0 2023-12-05T09:57:44.894 INFO:tasks.workunit.client.1.smithi150.stdout:2/901: write d0/d3/d5/d22/ffe [2546424,38369] 0 2023-12-05T09:57:44.897 INFO:tasks.workunit.client.0.smithi100.stdout:8/798: mkdir d0/d12/d13/d45/da6/d76/d91/d99/de6 0 2023-12-05T09:57:44.897 INFO:tasks.workunit.client.1.smithi150.stdout:0/953: dread d5/fb3 [0,4194304] 0 2023-12-05T09:57:44.897 INFO:tasks.workunit.client.1.smithi150.stdout:0/954: write d5/d11/d71/d99/d9c/d96/dd5/f11d [35019,23352] 0 2023-12-05T09:57:44.900 INFO:tasks.workunit.client.1.smithi150.stdout:5/881: unlink d1/d3/d6/l9b 0 2023-12-05T09:57:44.901 INFO:tasks.workunit.client.0.smithi100.stdout:9/863: symlink d7/d20/d69/def/l130 0 2023-12-05T09:57:44.901 INFO:tasks.workunit.client.0.smithi100.stdout:9/864: chown d7/d1b/d22/d2a/d56/d2e 387566453 1 2023-12-05T09:57:44.902 INFO:tasks.workunit.client.1.smithi150.stdout:9/788: symlink d3/d9/dc/d1f/d24/d75/d95/d9a/dcb/l102 0 2023-12-05T09:57:44.903 INFO:tasks.workunit.client.0.smithi100.stdout:4/784: mknod de/d16/d23/d60/d98/c101 0 2023-12-05T09:57:44.903 INFO:tasks.workunit.client.0.smithi100.stdout:4/785: fdatasync de/d16/d23/f26 0 2023-12-05T09:57:44.904 INFO:tasks.workunit.client.1.smithi150.stdout:7/880: dwrite d2/db/d30/d13/f14 [0,4194304] 0 2023-12-05T09:57:44.904 INFO:tasks.workunit.client.0.smithi100.stdout:0/796: getdents da/de1 0 2023-12-05T09:57:44.907 INFO:tasks.workunit.client.0.smithi100.stdout:9/865: mkdir d7/d20/d69/def/da2/d12c/d131 0 2023-12-05T09:57:44.907 INFO:tasks.workunit.client.0.smithi100.stdout:9/866: dread - d7/d20/d68/fd3 zero size 2023-12-05T09:57:44.909 INFO:tasks.workunit.client.0.smithi100.stdout:0/797: getdents da/d2a/d4d 0 2023-12-05T09:57:44.910 INFO:tasks.workunit.client.1.smithi150.stdout:6/767: dread d2/d23/f45 [0,4194304] 0 2023-12-05T09:57:44.911 INFO:tasks.workunit.client.0.smithi100.stdout:9/867: getdents d7/d35/d71/d9a/dcd/d122 0 2023-12-05T09:57:44.915 INFO:tasks.workunit.client.1.smithi150.stdout:8/915: sync 2023-12-05T09:57:44.915 INFO:tasks.workunit.client.0.smithi100.stdout:0/798: link da/d22/d33/d35/d3a/d8b/le0 da/d1b/d6b/d78/de2/lf2 0 2023-12-05T09:57:44.915 INFO:tasks.workunit.client.1.smithi150.stdout:2/902: symlink d0/d3/d128/l134 0 2023-12-05T09:57:44.916 INFO:tasks.workunit.client.1.smithi150.stdout:2/903: chown d0/d3/d21/d4d/deb/d103/d15/d30/d54/d57/fb4 446860 1 2023-12-05T09:57:44.916 INFO:tasks.workunit.client.1.smithi150.stdout:2/904: fdatasync d0/d3/d5/d22/d52/d5a/d108/fc6 0 2023-12-05T09:57:44.917 INFO:tasks.workunit.client.1.smithi150.stdout:7/881: dread d2/db/d30/d13/d4f/d5a/d5c/f7c [0,4194304] 0 2023-12-05T09:57:44.917 INFO:tasks.workunit.client.0.smithi100.stdout:9/868: creat d7/d20/d12b/f132 x:0 0 0 2023-12-05T09:57:44.921 INFO:tasks.workunit.client.0.smithi100.stdout:0/799: rename da/d1b/d6b/d78/l96 to da/d22/d33/lf3 0 2023-12-05T09:57:44.921 INFO:tasks.workunit.client.0.smithi100.stdout:0/800: fsync da/f5a 0 2023-12-05T09:57:44.923 INFO:tasks.workunit.client.1.smithi150.stdout:6/768: dread d2/d23/f3f [0,4194304] 0 2023-12-05T09:57:44.936 INFO:tasks.workunit.client.1.smithi150.stdout:9/789: link d3/d9/d26/f89 d3/d9/d6e/d84/f103 0 2023-12-05T09:57:44.936 INFO:tasks.workunit.client.1.smithi150.stdout:9/790: fdatasync d3/d9/dc/d1f/f5f 0 2023-12-05T09:57:44.936 INFO:tasks.workunit.client.1.smithi150.stdout:9/791: chown d3/d9/dc/d1f/f6c 7 1 2023-12-05T09:57:44.936 INFO:tasks.workunit.client.1.smithi150.stdout:6/769: dread d2/d23/d3b/d64/d7a/d5d/d6b/f10 [0,4194304] 0 2023-12-05T09:57:44.939 INFO:tasks.workunit.client.1.smithi150.stdout:8/916: symlink d0/d41/d49/d1b/dea/l121 0 2023-12-05T09:57:44.939 INFO:tasks.workunit.client.1.smithi150.stdout:7/882: mkdir d2/d9d/da0/df9/d125 0 2023-12-05T09:57:44.940 INFO:tasks.workunit.client.1.smithi150.stdout:3/887: rename d6/d9/d3d/d52 to d6/d9/d3d/d11e 0 2023-12-05T09:57:44.940 INFO:tasks.workunit.client.1.smithi150.stdout:3/888: write d6/d9/d43/d47/f1a [5174914,53184] 0 2023-12-05T09:57:44.944 INFO:tasks.workunit.client.1.smithi150.stdout:8/917: unlink d0/d41/d49/f52 0 2023-12-05T09:57:44.945 INFO:tasks.workunit.client.1.smithi150.stdout:7/883: creat d2/db/d17/d3a/f126 x:0 0 0 2023-12-05T09:57:44.950 INFO:tasks.workunit.client.0.smithi100.stdout:2/943: sync 2023-12-05T09:57:44.950 INFO:tasks.workunit.client.0.smithi100.stdout:2/944: fsync d7/da/d18/d1b/d2c/d3f/fd1 0 2023-12-05T09:57:44.950 INFO:tasks.workunit.client.1.smithi150.stdout:7/884: mkdir d2/d9d/da0/df9/d125/d127 0 2023-12-05T09:57:44.962 INFO:tasks.workunit.client.1.smithi150.stdout:9/792: read d3/d9/d26/d34/f72 [297273,111893] 0 2023-12-05T09:57:44.962 INFO:tasks.workunit.client.1.smithi150.stdout:9/793: chown d3/d1b/d79/ld4 12141798 1 2023-12-05T09:57:44.967 INFO:tasks.workunit.client.1.smithi150.stdout:0/955: dwrite d5/d11/d71/d99/fb2 [0,4194304] 0 2023-12-05T09:57:44.979 INFO:tasks.workunit.client.1.smithi150.stdout:6/770: dwrite d2/d23/d2e/d5f/d99/dd8/ff2 [0,4194304] 0 2023-12-05T09:57:44.984 INFO:tasks.workunit.client.1.smithi150.stdout:2/905: dwrite d0/d3/d5/d22/fbf [0,4194304] 0 2023-12-05T09:57:44.999 INFO:tasks.workunit.client.1.smithi150.stdout:2/906: write d0/d3/d21/d4d/deb/d103/d15/d30/fda [2651981,103087] 0 2023-12-05T09:57:44.999 INFO:tasks.workunit.client.1.smithi150.stdout:2/907: dread - d0/d3/d5/d22/d52/d56/d107/f11b zero size 2023-12-05T09:57:44.999 INFO:tasks.workunit.client.1.smithi150.stdout:2/908: readlink d0/d3/d21/l32 0 2023-12-05T09:57:45.010 INFO:tasks.workunit.client.1.smithi150.stdout:0/956: dwrite d5/d11/d71/d99/d9c/d96/dd5/f2e [0,4194304] 0 2023-12-05T09:57:45.014 INFO:tasks.workunit.client.1.smithi150.stdout:0/957: rename d5/d11/d71/d99/d9c/d3b/c5c to d5/c140 0 2023-12-05T09:57:45.017 INFO:tasks.workunit.client.1.smithi150.stdout:7/885: write d2/db/d30/d13/d4f/d7e/fb5 [573762,118923] 0 2023-12-05T09:57:45.020 INFO:tasks.workunit.client.1.smithi150.stdout:7/886: mknod d2/c128 0 2023-12-05T09:57:45.020 INFO:tasks.workunit.client.1.smithi150.stdout:7/887: creat d2/db/d30/d53/f129 x:0 0 0 2023-12-05T09:57:45.020 INFO:tasks.workunit.client.1.smithi150.stdout:7/888: read d2/db/d30/d13/d4f/d5a/d5c/f43 [3957351,12660] 0 2023-12-05T09:57:45.025 INFO:tasks.workunit.client.1.smithi150.stdout:4/795: dwrite d0/d3e/d6d/d4b/d8c/f8e [0,4194304] 0 2023-12-05T09:57:45.030 INFO:tasks.workunit.client.1.smithi150.stdout:4/796: link d0/c2d d0/d3e/d5b/d80/da1/db2/cf8 0 2023-12-05T09:57:45.030 INFO:tasks.workunit.client.1.smithi150.stdout:4/797: stat d0/d5f/fd4 0 2023-12-05T09:57:45.030 INFO:tasks.workunit.client.1.smithi150.stdout:4/798: fsync d0/d3e/d6d/ddf/da4/dd7/f97 0 2023-12-05T09:57:45.031 INFO:tasks.workunit.client.1.smithi150.stdout:4/799: rename d0/d3e/d5b/d80/c9f to d0/d3e/d6d/d95/cf9 0 2023-12-05T09:57:45.032 INFO:tasks.workunit.client.1.smithi150.stdout:9/794: dread d3/d9/dc/fa2 [0,4194304] 0 2023-12-05T09:57:45.038 INFO:tasks.workunit.client.1.smithi150.stdout:9/795: rename d3/d9/dc/f4b to d3/d9/d67/f104 0 2023-12-05T09:57:45.038 INFO:tasks.workunit.client.1.smithi150.stdout:9/796: write d3/d9/d9c/ff2 [520014,124714] 0 2023-12-05T09:57:45.045 INFO:tasks.workunit.client.0.smithi100.stdout:8/799: dwrite d0/d12/d13/d45/dba/fe5 [0,4194304] 0 2023-12-05T09:57:45.045 INFO:tasks.workunit.client.0.smithi100.stdout:8/800: write d0/d35/d64/d81/fdb [539314,18982] 0 2023-12-05T09:57:45.045 INFO:tasks.workunit.client.0.smithi100.stdout:8/801: write d0/d35/d64/d81/fa1 [1035818,51540] 0 2023-12-05T09:57:45.046 INFO:tasks.workunit.client.1.smithi150.stdout:4/800: dread d0/f3c [4194304,4194304] 0 2023-12-05T09:57:45.047 INFO:tasks.workunit.client.0.smithi100.stdout:4/786: dread de/d38/f42 [4194304,4194304] 0 2023-12-05T09:57:45.049 INFO:tasks.workunit.client.0.smithi100.stdout:8/802: symlink d0/d12/d13/d16/d42/le7 0 2023-12-05T09:57:45.050 INFO:tasks.workunit.client.1.smithi150.stdout:0/958: write d5/d11/d71/f30 [3766543,99267] 0 2023-12-05T09:57:45.051 INFO:tasks.workunit.client.1.smithi150.stdout:4/801: mknod d0/d5f/cfa 0 2023-12-05T09:57:45.051 INFO:tasks.workunit.client.1.smithi150.stdout:4/802: write d0/d5f/fa3 [101989,54071] 0 2023-12-05T09:57:45.051 INFO:tasks.workunit.client.1.smithi150.stdout:4/803: fdatasync d0/f24 0 2023-12-05T09:57:45.051 INFO:tasks.workunit.client.1.smithi150.stdout:4/804: chown d0/d3e/d6d/c56 463716533 1 2023-12-05T09:57:45.051 INFO:tasks.workunit.client.0.smithi100.stdout:8/803: creat d0/d12/d13/d45/dba/dbd/d72/fe8 x:0 0 0 2023-12-05T09:57:45.052 INFO:tasks.workunit.client.0.smithi100.stdout:8/804: chown d0/c10 13 1 2023-12-05T09:57:45.052 INFO:tasks.workunit.client.1.smithi150.stdout:0/959: mknod d5/d11/d71/d99/d9c/c141 0 2023-12-05T09:57:45.052 INFO:tasks.workunit.client.1.smithi150.stdout:0/960: write d5/d11/d71/d99/d9c/f10c [442325,35319] 0 2023-12-05T09:57:45.053 INFO:tasks.workunit.client.0.smithi100.stdout:8/805: creat d0/d12/d13/d45/da6/fe9 x:0 0 0 2023-12-05T09:57:45.054 INFO:tasks.workunit.client.1.smithi150.stdout:9/797: dread d3/d9/dc/d1f/d24/f6b [0,4194304] 0 2023-12-05T09:57:45.056 INFO:tasks.workunit.client.1.smithi150.stdout:4/805: rename d0/d3e/d6d/f2e to d0/d3e/d6d/ddf/da4/ffb 0 2023-12-05T09:57:45.058 INFO:tasks.workunit.client.0.smithi100.stdout:8/806: rmdir d0/d12/d13/d16/d42/d43 39 2023-12-05T09:57:45.058 INFO:tasks.workunit.client.1.smithi150.stdout:2/909: dwrite d0/d3/d5/d22/d52/d56/d107/f11b [0,4194304] 0 2023-12-05T09:57:45.059 INFO:tasks.workunit.client.0.smithi100.stdout:9/869: dwrite d7/d20/d69/f72 [0,4194304] 0 2023-12-05T09:57:45.059 INFO:tasks.workunit.client.0.smithi100.stdout:9/870: creat d7/d20/d12b/f133 x:0 0 0 2023-12-05T09:57:45.060 INFO:tasks.workunit.client.1.smithi150.stdout:5/882: dwrite d1/d2e/da6/d24/f41 [0,4194304] 0 2023-12-05T09:57:45.060 INFO:tasks.workunit.client.0.smithi100.stdout:0/801: dwrite da/d22/d33/d7f/d94/f9c [4194304,4194304] 0 2023-12-05T09:57:45.060 INFO:tasks.workunit.client.0.smithi100.stdout:0/802: write da/d22/d33/d35/d3a/d8b/d8f/fae [164928,109178] 0 2023-12-05T09:57:45.060 INFO:tasks.workunit.client.0.smithi100.stdout:0/803: truncate da/f37 2304169 0 2023-12-05T09:57:45.060 INFO:tasks.workunit.client.0.smithi100.stdout:8/807: symlink d0/d35/d64/d81/d9a/lea 0 2023-12-05T09:57:45.064 INFO:tasks.workunit.client.0.smithi100.stdout:4/787: dread de/f55 [0,4194304] 0 2023-12-05T09:57:45.070 INFO:tasks.workunit.client.0.smithi100.stdout:0/804: creat da/d22/d33/d74/dca/df1/ff4 x:0 0 0 2023-12-05T09:57:45.070 INFO:tasks.workunit.client.0.smithi100.stdout:0/805: fdatasync da/d22/d33/d35/d3a/fbc 0 2023-12-05T09:57:45.070 INFO:tasks.workunit.client.0.smithi100.stdout:0/806: chown da/d1b/f3c 301796659 1 2023-12-05T09:57:45.070 INFO:tasks.workunit.client.0.smithi100.stdout:0/807: creat da/d22/d33/d74/dca/df1/ff5 x:0 0 0 2023-12-05T09:57:45.071 INFO:tasks.workunit.client.1.smithi150.stdout:9/798: dread d3/d9/dc/f92 [4194304,4194304] 0 2023-12-05T09:57:45.073 INFO:tasks.workunit.client.0.smithi100.stdout:8/808: creat d0/db7/feb x:0 0 0 2023-12-05T09:57:45.073 INFO:tasks.workunit.client.0.smithi100.stdout:9/871: mknod d7/d1b/d22/d51/c134 0 2023-12-05T09:57:45.075 INFO:tasks.workunit.client.1.smithi150.stdout:4/806: creat d0/d3e/d6d/d95/ffc x:0 0 0 2023-12-05T09:57:45.082 INFO:tasks.workunit.client.1.smithi150.stdout:2/910: rename d0/d3/d5/d22/f82 to d0/d3/d5/d10/d3d/da1/daa/f135 0 2023-12-05T09:57:45.084 INFO:tasks.workunit.client.1.smithi150.stdout:5/883: mkdir d1/d64/d31/d135 0 2023-12-05T09:57:45.084 INFO:tasks.workunit.client.1.smithi150.stdout:5/884: fdatasync d1/d64/ded/f113 0 2023-12-05T09:57:45.088 INFO:tasks.workunit.client.1.smithi150.stdout:2/911: link d0/d3/d21/d4d/deb/d103/d15/d30/d54/d57/fab d0/d3/d5/d22/d52/d5a/d108/f136 0 2023-12-05T09:57:45.088 INFO:tasks.workunit.client.0.smithi100.stdout:9/872: dread d7/d1b/d22/d93/fd7 [0,4194304] 0 2023-12-05T09:57:45.088 INFO:tasks.workunit.client.0.smithi100.stdout:9/873: chown d7/d1b/d22/d2a/d56/daf/fd0 62710 1 2023-12-05T09:57:45.088 INFO:tasks.workunit.client.0.smithi100.stdout:9/874: write d7/d1b/d22/d2a/d56/f12e [912123,40] 0 2023-12-05T09:57:45.090 INFO:tasks.workunit.client.1.smithi150.stdout:9/799: rename d3/d9/d26/c35 to d3/d9/dc/d1f/c105 0 2023-12-05T09:57:45.090 INFO:tasks.workunit.client.0.smithi100.stdout:1/825: sync 2023-12-05T09:57:45.092 INFO:tasks.workunit.client.0.smithi100.stdout:9/875: link d7/d35/d97/f11c d7/d35/d71/f135 0 2023-12-05T09:57:45.092 INFO:tasks.workunit.client.0.smithi100.stdout:9/876: stat d7/d1b/d22/d2a/d56/d9c/fae 0 2023-12-05T09:57:45.092 INFO:tasks.workunit.client.0.smithi100.stdout:9/877: fsync d7/d20/d68/fe9 0 2023-12-05T09:57:45.093 INFO:tasks.workunit.client.1.smithi150.stdout:9/800: symlink d3/d82/l106 0 2023-12-05T09:57:45.093 INFO:tasks.workunit.client.1.smithi150.stdout:9/801: chown d3/d9/dc/d1f/d24/d75/d95/cb9 381706 1 2023-12-05T09:57:45.095 INFO:tasks.workunit.client.1.smithi150.stdout:9/802: creat d3/d9/d9c/f107 x:0 0 0 2023-12-05T09:57:45.096 INFO:tasks.workunit.client.1.smithi150.stdout:0/961: dwrite d5/d11/d32/fbf [0,4194304] 0 2023-12-05T09:57:45.096 INFO:tasks.workunit.client.1.smithi150.stdout:0/962: readlink d5/d11/d71/d5f/lcb 0 2023-12-05T09:57:45.096 INFO:tasks.workunit.client.1.smithi150.stdout:5/885: dread d1/d7f/d65/d3b/d8d/fbe [0,4194304] 0 2023-12-05T09:57:45.096 INFO:tasks.workunit.client.0.smithi100.stdout:9/878: mknod d7/d1b/d22/d51/c136 0 2023-12-05T09:57:45.101 INFO:tasks.workunit.client.0.smithi100.stdout:9/879: getdents d7/d1b/d22/d2a/d56/daf 0 2023-12-05T09:57:45.104 INFO:tasks.workunit.client.0.smithi100.stdout:9/880: symlink d7/d1b/d127/l137 0 2023-12-05T09:57:45.104 INFO:tasks.workunit.client.0.smithi100.stdout:9/881: truncate d7/d20/d68/fd3 840604 0 2023-12-05T09:57:45.106 INFO:tasks.workunit.client.0.smithi100.stdout:9/882: rename d7/d1b/d22/d2a/d74/l12d to d7/d1b/d22/d2a/d56/d9c/dfd/l138 0 2023-12-05T09:57:45.107 INFO:tasks.workunit.client.0.smithi100.stdout:9/883: write d7/d20/d69/def/fa7 [662911,77871] 0 2023-12-05T09:57:45.109 INFO:tasks.workunit.client.1.smithi150.stdout:0/963: unlink d5/d11/d71/d74/c84 0 2023-12-05T09:57:45.111 INFO:tasks.workunit.client.0.smithi100.stdout:9/884: symlink d7/d20/d68/l139 0 2023-12-05T09:57:45.111 INFO:tasks.workunit.client.0.smithi100.stdout:9/885: creat d7/d1b/d22/d51/d32/d96/f13a x:0 0 0 2023-12-05T09:57:45.112 INFO:tasks.workunit.client.1.smithi150.stdout:9/803: dread d3/d9/f2f [0,4194304] 0 2023-12-05T09:57:45.113 INFO:tasks.workunit.client.1.smithi150.stdout:9/804: write d3/d9/d67/f104 [1273619,95465] 0 2023-12-05T09:57:45.113 INFO:tasks.workunit.client.1.smithi150.stdout:2/912: dread d0/d3/d21/d4d/deb/ff6 [0,4194304] 0 2023-12-05T09:57:45.113 INFO:tasks.workunit.client.1.smithi150.stdout:9/805: write d3/d9/dc/fce [653369,75521] 0 2023-12-05T09:57:45.113 INFO:tasks.workunit.client.1.smithi150.stdout:9/806: dread - d3/d42/dd2/ff4 zero size 2023-12-05T09:57:45.113 INFO:tasks.workunit.client.1.smithi150.stdout:0/964: mkdir d5/d11/d71/d99/d9c/d46/d142 0 2023-12-05T09:57:45.114 INFO:tasks.workunit.client.1.smithi150.stdout:4/807: write d0/d3e/d5b/d6e/f88 [957654,123165] 0 2023-12-05T09:57:45.118 INFO:tasks.workunit.client.0.smithi100.stdout:9/886: rename d7/d60/l95 to d7/d1b/d22/d2a/d56/d9c/daa/d102/l13b 0 2023-12-05T09:57:45.124 INFO:tasks.workunit.client.1.smithi150.stdout:2/913: creat d0/d42/f137 x:0 0 0 2023-12-05T09:57:45.126 INFO:tasks.workunit.client.0.smithi100.stdout:9/887: creat d7/d35/d71/dda/f13c x:0 0 0 2023-12-05T09:57:45.126 INFO:tasks.workunit.client.0.smithi100.stdout:9/888: dread - d7/d35/d71/fff zero size 2023-12-05T09:57:45.126 INFO:tasks.workunit.client.0.smithi100.stdout:9/889: truncate d7/d35/d71/dda/f13c 75266 0 2023-12-05T09:57:45.130 INFO:tasks.workunit.client.1.smithi150.stdout:9/807: unlink d3/d9/dc/d1f/d24/d75/d95/dbc/le1 0 2023-12-05T09:57:45.130 INFO:tasks.workunit.client.1.smithi150.stdout:9/808: fdatasync d3/d1b/f59 0 2023-12-05T09:57:45.130 INFO:tasks.workunit.client.1.smithi150.stdout:2/914: mknod d0/d3/d5/d3b/d4c/c138 0 2023-12-05T09:57:45.131 INFO:tasks.workunit.client.0.smithi100.stdout:9/890: creat d7/f13d x:0 0 0 2023-12-05T09:57:45.132 INFO:tasks.workunit.client.1.smithi150.stdout:2/915: creat d0/da3/dae/dc3/f139 x:0 0 0 2023-12-05T09:57:45.132 INFO:tasks.workunit.client.1.smithi150.stdout:8/918: sync 2023-12-05T09:57:45.132 INFO:tasks.workunit.client.1.smithi150.stdout:8/919: write d0/d8/f82 [3204939,12551] 0 2023-12-05T09:57:45.133 INFO:tasks.workunit.client.1.smithi150.stdout:1/894: sync 2023-12-05T09:57:45.133 INFO:tasks.workunit.client.0.smithi100.stdout:0/808: dwrite da/d22/d33/d74/dca/fdd [4194304,4194304] 0 2023-12-05T09:57:45.133 INFO:tasks.workunit.client.0.smithi100.stdout:9/891: unlink d7/d1b/d22/d51/f28 0 2023-12-05T09:57:45.134 INFO:tasks.workunit.client.1.smithi150.stdout:1/895: write d6/d8/fc5 [806027,71590] 0 2023-12-05T09:57:45.134 INFO:tasks.workunit.client.1.smithi150.stdout:8/920: readlink d0/d41/d49/d1b/d24/d2e/d30/l5d 0 2023-12-05T09:57:45.134 INFO:tasks.workunit.client.1.smithi150.stdout:3/889: sync 2023-12-05T09:57:45.135 INFO:tasks.workunit.client.0.smithi100.stdout:9/892: read d7/d20/fe0 [117403,107610] 0 2023-12-05T09:57:45.135 INFO:tasks.workunit.client.0.smithi100.stdout:9/893: creat d7/d20/d69/def/ddf/f13e x:0 0 0 2023-12-05T09:57:45.137 INFO:tasks.workunit.client.1.smithi150.stdout:8/921: dread - d0/d41/d49/d1b/d24/f10e zero size 2023-12-05T09:57:45.138 INFO:tasks.workunit.client.0.smithi100.stdout:9/894: rename d7/fb to d7/d35/f13f 0 2023-12-05T09:57:45.138 INFO:tasks.workunit.client.0.smithi100.stdout:8/809: dwrite d0/db7/de2/fd6 [0,4194304] 0 2023-12-05T09:57:45.138 INFO:tasks.workunit.client.0.smithi100.stdout:9/895: creat d7/d1b/d89/f140 x:0 0 0 2023-12-05T09:57:45.139 INFO:tasks.workunit.client.1.smithi150.stdout:6/771: sync 2023-12-05T09:57:45.140 INFO:tasks.workunit.client.1.smithi150.stdout:6/772: read - d2/d23/d3b/d64/d7a/d5d/de0/ff6 zero size 2023-12-05T09:57:45.140 INFO:tasks.workunit.client.1.smithi150.stdout:6/773: chown d2/d23/d2e/d5f/f87 21 1 2023-12-05T09:57:45.140 INFO:tasks.workunit.client.1.smithi150.stdout:8/922: rename d0/d41/d49/d1b/d24/d34/d56/lb0 to d0/da1/dfb/d110/l122 0 2023-12-05T09:57:45.142 INFO:tasks.workunit.client.1.smithi150.stdout:1/896: creat d6/d8/d85/d10e/d13b/f13c x:0 0 0 2023-12-05T09:57:45.144 INFO:tasks.workunit.client.1.smithi150.stdout:7/889: sync 2023-12-05T09:57:45.144 INFO:tasks.workunit.client.1.smithi150.stdout:7/890: read - d2/d72/d82/f10d zero size 2023-12-05T09:57:45.144 INFO:tasks.workunit.client.0.smithi100.stdout:9/896: creat d7/db5/f141 x:0 0 0 2023-12-05T09:57:45.146 INFO:tasks.workunit.client.1.smithi150.stdout:8/923: truncate d0/d41/d49/d1b/d24/d34/d56/d67/f6c 148794 0 2023-12-05T09:57:45.146 INFO:tasks.workunit.client.0.smithi100.stdout:8/810: symlink d0/d12/d13/d45/dba/dbd/d82/lec 0 2023-12-05T09:57:45.146 INFO:tasks.workunit.client.0.smithi100.stdout:8/811: fdatasync d0/d12/d13/f25 0 2023-12-05T09:57:45.146 INFO:tasks.workunit.client.0.smithi100.stdout:9/897: mkdir d7/d20/d12b/d142 0 2023-12-05T09:57:45.146 INFO:tasks.workunit.client.0.smithi100.stdout:9/898: stat d7/d35/f63 0 2023-12-05T09:57:45.147 INFO:tasks.workunit.client.0.smithi100.stdout:9/899: fdatasync d7/d1b/d22/d2a/d56/d9c/fae 0 2023-12-05T09:57:45.150 INFO:tasks.workunit.client.1.smithi150.stdout:8/924: unlink d0/d41/d49/d1b/d24/d38/d62/f9b 0 2023-12-05T09:57:45.150 INFO:tasks.workunit.client.1.smithi150.stdout:7/891: rmdir d2/db/d17/d38/dc8 39 2023-12-05T09:57:45.151 INFO:tasks.workunit.client.1.smithi150.stdout:0/965: dread d5/d11/f59 [0,4194304] 0 2023-12-05T09:57:45.154 INFO:tasks.workunit.client.1.smithi150.stdout:0/966: chown d5/d11/d32/d57/l127 159 1 2023-12-05T09:57:45.154 INFO:tasks.workunit.client.1.smithi150.stdout:7/892: mkdir d2/d9d/da0/df9/d125/d12a 0 2023-12-05T09:57:45.156 INFO:tasks.workunit.client.1.smithi150.stdout:0/967: truncate d5/d11/d71/d5f/ff7 127413 0 2023-12-05T09:57:45.158 INFO:tasks.workunit.client.0.smithi100.stdout:1/826: dwrite db/d12/fae [0,4194304] 0 2023-12-05T09:57:45.158 INFO:tasks.workunit.client.0.smithi100.stdout:1/827: fdatasync db/d12/d1e/d26/d30/f8e 0 2023-12-05T09:57:45.158 INFO:tasks.workunit.client.0.smithi100.stdout:1/828: chown db/d12/d1e/d26/d30/d6e/f91 24 1 2023-12-05T09:57:45.158 INFO:tasks.workunit.client.0.smithi100.stdout:1/829: fsync db/f1a 0 2023-12-05T09:57:45.158 INFO:tasks.workunit.client.0.smithi100.stdout:1/830: chown db/d12/f14 61815367 1 2023-12-05T09:57:45.160 INFO:tasks.workunit.client.1.smithi150.stdout:9/809: write d3/d9/d26/d34/f5b [522896,7472] 0 2023-12-05T09:57:45.161 INFO:tasks.workunit.client.1.smithi150.stdout:9/810: truncate d3/d9/d6e/f8a 3124562 0 2023-12-05T09:57:45.180 INFO:tasks.workunit.client.1.smithi150.stdout:3/890: write d6/d9/d3d/d56/d30/f119 [1152062,9436] 0 2023-12-05T09:57:45.180 INFO:tasks.workunit.client.1.smithi150.stdout:4/808: dwrite d0/d3e/d48/f4e [0,4194304] 0 2023-12-05T09:57:45.180 INFO:tasks.workunit.client.1.smithi150.stdout:4/809: chown d0/f61 27296 1 2023-12-05T09:57:45.182 INFO:tasks.workunit.client.0.smithi100.stdout:8/812: dread d0/f5b [0,4194304] 0 2023-12-05T09:57:45.183 INFO:tasks.workunit.client.0.smithi100.stdout:8/813: write d0/d35/f68 [837888,115165] 0 2023-12-05T09:57:45.184 INFO:tasks.workunit.client.1.smithi150.stdout:3/891: rmdir d6/d9/d3d/d56/d71/db6/dc1/d67/de1 0 2023-12-05T09:57:45.184 INFO:tasks.workunit.client.1.smithi150.stdout:3/892: chown d6/d9/d3d/d56/f7d 9511 1 2023-12-05T09:57:45.187 INFO:tasks.workunit.client.1.smithi150.stdout:3/893: rename d6/d9/d3d/d8a/cbf to d6/d9/d3d/d56/c11f 0 2023-12-05T09:57:45.190 INFO:tasks.workunit.client.1.smithi150.stdout:3/894: symlink d6/d9/d3d/d56/d71/db6/l120 0 2023-12-05T09:57:45.191 INFO:tasks.workunit.client.0.smithi100.stdout:1/831: dread db/d31/d3a/d3b/fa1 [0,4194304] 0 2023-12-05T09:57:45.195 INFO:tasks.workunit.client.0.smithi100.stdout:1/832: mknod db/d12/d1e/d72/ddd/c106 0 2023-12-05T09:57:45.195 INFO:tasks.workunit.client.0.smithi100.stdout:1/833: chown db/d12/d1e/d26/d30/c9c 1651485 1 2023-12-05T09:57:45.196 INFO:tasks.workunit.client.0.smithi100.stdout:8/814: dread d0/d35/d64/d81/fa1 [0,4194304] 0 2023-12-05T09:57:45.199 INFO:tasks.workunit.client.0.smithi100.stdout:1/834: getdents db/d12/d1e/d72/ddd/dfd/dd6 0 2023-12-05T09:57:45.201 INFO:tasks.workunit.client.1.smithi150.stdout:3/895: unlink d6/d22/f31 0 2023-12-05T09:57:45.201 INFO:tasks.workunit.client.1.smithi150.stdout:3/896: dread - d6/d9/d3d/d87/fed zero size 2023-12-05T09:57:45.201 INFO:tasks.workunit.client.0.smithi100.stdout:8/815: rename d0/db7/feb to d0/d12/d13/d45/da6/d76/d91/d99/fed 0 2023-12-05T09:57:45.202 INFO:tasks.workunit.client.1.smithi150.stdout:6/774: read d2/d23/d2e/fe1 [1675130,43463] 0 2023-12-05T09:57:45.202 INFO:tasks.workunit.client.1.smithi150.stdout:6/775: write d2/f34 [4437527,11722] 0 2023-12-05T09:57:45.202 INFO:tasks.workunit.client.1.smithi150.stdout:6/776: stat d2/f1c 0 2023-12-05T09:57:45.204 INFO:tasks.workunit.client.0.smithi100.stdout:8/816: creat d0/db7/de2/fee x:0 0 0 2023-12-05T09:57:45.207 INFO:tasks.workunit.client.0.smithi100.stdout:8/817: creat d0/d35/d64/fef x:0 0 0 2023-12-05T09:57:45.208 INFO:tasks.workunit.client.0.smithi100.stdout:8/818: mknod d0/d12/d13/d45/da6/d76/d91/d99/de6/cf0 0 2023-12-05T09:57:45.210 INFO:tasks.workunit.client.1.smithi150.stdout:1/897: write d6/d47/d4c/dd9/fe7 [606792,4681] 0 2023-12-05T09:57:45.210 INFO:tasks.workunit.client.1.smithi150.stdout:1/898: chown d6/d3c/dc2/dde/fe9 130524 1 2023-12-05T09:57:45.211 INFO:tasks.workunit.client.1.smithi150.stdout:1/899: write d6/d38/da1/ff1 [212941,41537] 0 2023-12-05T09:57:45.211 INFO:tasks.workunit.client.1.smithi150.stdout:1/900: fdatasync d6/d47/d4c/dd9/d75/dc4/fc1 0 2023-12-05T09:57:45.211 INFO:tasks.workunit.client.0.smithi100.stdout:8/819: mkdir d0/d12/d13/d45/dba/df1 0 2023-12-05T09:57:45.211 INFO:tasks.workunit.client.0.smithi100.stdout:8/820: fsync d0/d12/d13/d16/d42/d43/f71 0 2023-12-05T09:57:45.212 INFO:tasks.workunit.client.1.smithi150.stdout:2/916: dwrite d0/d3/d21/d4d/deb/d103/d15/d30/d54/d57/dee/f121 [0,4194304] 0 2023-12-05T09:57:45.212 INFO:tasks.workunit.client.1.smithi150.stdout:2/917: readlink d0/d3/d21/d4d/deb/d103/d15/d30/d54/d57/l59 0 2023-12-05T09:57:45.212 INFO:tasks.workunit.client.1.smithi150.stdout:2/918: chown d0/d3/d21/d4d/deb/d103/d15/d30/d54/d57/dee 14447 1 2023-12-05T09:57:45.217 INFO:tasks.workunit.client.1.smithi150.stdout:8/925: dread d0/d41/d49/d1b/d24/d5b/fb4 [0,4194304] 0 2023-12-05T09:57:45.219 INFO:tasks.workunit.client.1.smithi150.stdout:5/886: dwrite d1/d2e/ff7 [0,4194304] 0 2023-12-05T09:57:45.221 INFO:tasks.workunit.client.1.smithi150.stdout:1/901: unlink d6/d38/d4a/f8e 0 2023-12-05T09:57:45.222 INFO:tasks.workunit.client.0.smithi100.stdout:1/835: write db/d12/d1e/f41 [4164904,4008] 0 2023-12-05T09:57:45.224 INFO:tasks.workunit.client.1.smithi150.stdout:7/893: dwrite d2/db/d30/d13/d4f/d5a/d5c/f117 [0,4194304] 0 2023-12-05T09:57:45.227 INFO:tasks.workunit.client.1.smithi150.stdout:4/810: dwrite d0/d3e/d5b/d80/d44/f98 [0,4194304] 0 2023-12-05T09:57:45.230 INFO:tasks.workunit.client.1.smithi150.stdout:9/811: dwrite d3/d9/d58/fcf [4194304,4194304] 0 2023-12-05T09:57:45.233 INFO:tasks.workunit.client.1.smithi150.stdout:2/919: symlink d0/d3/d21/d4d/deb/d103/d15/d30/d54/d57/dee/l13a 0 2023-12-05T09:57:45.233 INFO:tasks.workunit.client.0.smithi100.stdout:1/836: unlink db/d12/d1e/d26/c32 0 2023-12-05T09:57:45.234 INFO:tasks.workunit.client.0.smithi100.stdout:8/821: read d0/d12/d13/d16/f46 [1754260,19661] 0 2023-12-05T09:57:45.237 INFO:tasks.workunit.client.1.smithi150.stdout:7/894: dread d2/db/d2e/d71/df2/f107 [0,4194304] 0 2023-12-05T09:57:45.240 INFO:tasks.workunit.client.1.smithi150.stdout:9/812: dread d3/d1b/d46/d55/fc4 [0,4194304] 0 2023-12-05T09:57:45.242 INFO:tasks.workunit.client.0.smithi100.stdout:1/837: write db/d12/d1e/d26/d30/d52/f77 [1689360,2660] 0 2023-12-05T09:57:45.245 INFO:tasks.workunit.client.1.smithi150.stdout:8/926: creat d0/da1/dfb/d110/d116/f123 x:0 0 0 2023-12-05T09:57:45.250 INFO:tasks.workunit.client.1.smithi150.stdout:1/902: rename d6/d8/d85/d113 to d6/d8/d13d 0 2023-12-05T09:57:45.251 INFO:tasks.workunit.client.1.smithi150.stdout:0/968: dwrite d5/d11/d71/d5f/f70 [4194304,4194304] 0 2023-12-05T09:57:45.251 INFO:tasks.workunit.client.1.smithi150.stdout:0/969: fdatasync d5/d11/ff5 0 2023-12-05T09:57:45.251 INFO:tasks.workunit.client.1.smithi150.stdout:3/897: dread d6/d9/d3d/d87/f89 [0,4194304] 0 2023-12-05T09:57:45.255 INFO:tasks.workunit.client.0.smithi100.stdout:1/838: rename db/d12/d61/l69 to db/d31/d3a/d3b/l107 0 2023-12-05T09:57:45.255 INFO:tasks.workunit.client.0.smithi100.stdout:1/839: fsync db/d12/d1e/d26/fbd 0 2023-12-05T09:57:45.255 INFO:tasks.workunit.client.0.smithi100.stdout:8/822: write d0/d12/d13/d45/da6/d76/d91/faa [4435867,76108] 0 2023-12-05T09:57:45.259 INFO:tasks.workunit.client.1.smithi150.stdout:2/920: creat d0/d3/d27/dea/f13b x:0 0 0 2023-12-05T09:57:45.260 INFO:tasks.workunit.client.1.smithi150.stdout:6/777: dwrite d2/d23/d2e/d72/fe7 [0,4194304] 0 2023-12-05T09:57:45.262 INFO:tasks.workunit.client.1.smithi150.stdout:7/895: truncate d2/db/d2e/d71/df2/ff4 1978467 0 2023-12-05T09:57:45.264 INFO:tasks.workunit.client.1.smithi150.stdout:9/813: unlink d3/d9/d58/fcf 0 2023-12-05T09:57:45.264 INFO:tasks.workunit.client.1.smithi150.stdout:9/814: chown d3/d9/dc/d1f/d24/d75/d95/d9a/dcb/l102 1012557 1 2023-12-05T09:57:45.264 INFO:tasks.workunit.client.1.smithi150.stdout:9/815: chown d3/d9/dc/d1f/cbb 85 1 2023-12-05T09:57:45.265 INFO:tasks.workunit.client.1.smithi150.stdout:5/887: creat d1/d2e/da6/d24/d59/d104/f136 x:0 0 0 2023-12-05T09:57:45.265 INFO:tasks.workunit.client.1.smithi150.stdout:5/888: chown d1/d7f/d65/d3b/d6b/c78 5698 1 2023-12-05T09:57:45.266 INFO:tasks.workunit.client.0.smithi100.stdout:8/823: rmdir d0/d12/d13/d45/dba 39 2023-12-05T09:57:45.268 INFO:tasks.workunit.client.1.smithi150.stdout:8/927: link d0/d41/d49/d1b/f1c d0/d41/d49/dd3/f124 0 2023-12-05T09:57:45.268 INFO:tasks.workunit.client.1.smithi150.stdout:2/921: dread d0/d3/d27/dea/d112/f119 [0,4194304] 0 2023-12-05T09:57:45.270 INFO:tasks.workunit.client.0.smithi100.stdout:8/824: rmdir d0/d12/d13/d45/dba/dbd/d72/d9f/de1 0 2023-12-05T09:57:45.271 INFO:tasks.workunit.client.1.smithi150.stdout:8/928: write d0/d41/d49/d1b/d24/d34/dd0/ddf/f108 [666689,127420] 0 2023-12-05T09:57:45.271 INFO:tasks.workunit.client.1.smithi150.stdout:8/929: fdatasync d0/d41/d49/d1b/d24/d2e/d4d/d83/fca 0 2023-12-05T09:57:45.271 INFO:tasks.workunit.client.1.smithi150.stdout:4/811: dwrite d0/d3e/d6d/f12 [0,4194304] 0 2023-12-05T09:57:45.272 INFO:tasks.workunit.client.1.smithi150.stdout:1/903: rename d6/d8/lfc to d6/d47/d4c/dd9/d75/l13e 0 2023-12-05T09:57:45.272 INFO:tasks.workunit.client.1.smithi150.stdout:1/904: fdatasync d6/d47/d4c/dd9/f22 0 2023-12-05T09:57:45.272 INFO:tasks.workunit.client.1.smithi150.stdout:1/905: fsync d6/d8/db/f6e 0 2023-12-05T09:57:45.274 INFO:tasks.workunit.client.1.smithi150.stdout:0/970: creat d5/d11/d71/d99/d9c/d13a/df4/f143 x:0 0 0 2023-12-05T09:57:45.274 INFO:tasks.workunit.client.1.smithi150.stdout:0/971: fdatasync d5/d11/d71/d99/d9c/d46/d80/f11a 0 2023-12-05T09:57:45.275 INFO:tasks.workunit.client.0.smithi100.stdout:8/825: symlink d0/d12/d13/d45/lf2 0 2023-12-05T09:57:45.277 INFO:tasks.workunit.client.1.smithi150.stdout:3/898: creat d6/d25/f121 x:0 0 0 2023-12-05T09:57:45.279 INFO:tasks.workunit.client.0.smithi100.stdout:8/826: mknod d0/d12/d13/d45/dba/df1/cf3 0 2023-12-05T09:57:45.281 INFO:tasks.workunit.client.0.smithi100.stdout:8/827: stat d0/lf 0 2023-12-05T09:57:45.281 INFO:tasks.workunit.client.1.smithi150.stdout:9/816: truncate d3/d9/d9c/ff2 632527 0 2023-12-05T09:57:45.284 INFO:tasks.workunit.client.1.smithi150.stdout:5/889: truncate d1/d2e/da6/f32 2941186 0 2023-12-05T09:57:45.284 INFO:tasks.workunit.client.1.smithi150.stdout:2/922: mknod d0/d3/d11/c13c 0 2023-12-05T09:57:45.287 INFO:tasks.workunit.client.1.smithi150.stdout:4/812: symlink d0/d3e/d5b/d80/d44/lfd 0 2023-12-05T09:57:45.293 INFO:tasks.workunit.client.1.smithi150.stdout:1/906: rename d6/d8/fc5 to d6/d8/db/db1/f13f 0 2023-12-05T09:57:45.293 INFO:tasks.workunit.client.1.smithi150.stdout:3/899: dread d6/d22/fdc [0,4194304] 0 2023-12-05T09:57:45.297 INFO:tasks.workunit.client.1.smithi150.stdout:0/972: mkdir d5/d11/d71/d99/d9c/d96/dd5/d67/da8/df1/d144 0 2023-12-05T09:57:45.297 INFO:tasks.workunit.client.1.smithi150.stdout:0/973: fsync d5/d11/d71/d5f/d77/f133 0 2023-12-05T09:57:45.297 INFO:tasks.workunit.client.1.smithi150.stdout:0/974: write d5/d11/d32/d57/f134 [160970,18307] 0 2023-12-05T09:57:45.297 INFO:tasks.workunit.client.1.smithi150.stdout:0/975: chown d5/d11/d71/d5f/d6a 894814 1 2023-12-05T09:57:45.300 INFO:tasks.workunit.client.1.smithi150.stdout:5/890: mknod d1/d3/d92/dea/c137 0 2023-12-05T09:57:45.301 INFO:tasks.workunit.client.1.smithi150.stdout:2/923: mknod d0/d3/d21/d4d/deb/d103/d15/d30/c13d 0 2023-12-05T09:57:45.306 INFO:tasks.workunit.client.1.smithi150.stdout:0/976: unlink d5/d11/d32/fdd 0 2023-12-05T09:57:45.311 INFO:tasks.workunit.client.1.smithi150.stdout:4/813: mkdir d0/d3e/d5b/d80/dc8/dfe 0 2023-12-05T09:57:45.311 INFO:tasks.workunit.client.1.smithi150.stdout:4/814: fdatasync d0/d5f/fd4 0 2023-12-05T09:57:45.311 INFO:tasks.workunit.client.1.smithi150.stdout:3/900: creat d6/d9/d43/d47/d94/df1/f122 x:0 0 0 2023-12-05T09:57:45.312 INFO:tasks.workunit.client.1.smithi150.stdout:9/817: dread d3/d9/d26/f41 [0,4194304] 0 2023-12-05T09:57:45.312 INFO:tasks.workunit.client.1.smithi150.stdout:9/818: truncate d3/d9/d26/d34/f6d 1363453 0 2023-12-05T09:57:45.312 INFO:tasks.workunit.client.1.smithi150.stdout:2/924: unlink d0/d3/d21/d4d/deb/d103/db9/fd8 0 2023-12-05T09:57:45.312 INFO:tasks.workunit.client.1.smithi150.stdout:0/977: link d5/d11/db6/cf6 d5/d11/d71/d99/d9c/d96/dc1/c145 0 2023-12-05T09:57:45.314 INFO:tasks.workunit.client.1.smithi150.stdout:4/815: unlink d0/d3e/d48/f52 0 2023-12-05T09:57:45.315 INFO:tasks.workunit.client.1.smithi150.stdout:9/819: mknod d3/d42/d62/c108 0 2023-12-05T09:57:45.319 INFO:tasks.workunit.client.1.smithi150.stdout:0/978: creat d5/d11/d71/f146 x:0 0 0 2023-12-05T09:57:45.323 INFO:tasks.workunit.client.1.smithi150.stdout:4/816: unlink d0/f26 0 2023-12-05T09:57:45.324 INFO:tasks.workunit.client.0.smithi100.stdout:7/803: sync 2023-12-05T09:57:45.324 INFO:tasks.workunit.client.0.smithi100.stdout:7/804: write d3/dc/d11/d13/de/d18/d3b/d40/d46/f95 [388294,26854] 0 2023-12-05T09:57:45.325 INFO:tasks.workunit.client.1.smithi150.stdout:9/820: link d3/d9/d26/d34/ded/cfd d3/d1b/d79/c109 0 2023-12-05T09:57:45.325 INFO:tasks.workunit.client.1.smithi150.stdout:9/821: chown d3/d9/dc/d1f/lb6 109 1 2023-12-05T09:57:45.326 INFO:tasks.workunit.client.1.smithi150.stdout:9/822: write d3/d9/dc/d1f/d24/d75/d95/d9a/dcb/fe5 [89945,129878] 0 2023-12-05T09:57:45.326 INFO:tasks.workunit.client.0.smithi100.stdout:8/828: dwrite d0/d12/d13/d16/f46 [4194304,4194304] 0 2023-12-05T09:57:45.326 INFO:tasks.workunit.client.0.smithi100.stdout:8/829: creat d0/db7/de2/ff4 x:0 0 0 2023-12-05T09:57:45.327 INFO:tasks.workunit.client.1.smithi150.stdout:2/925: rmdir d0/d42 39 2023-12-05T09:57:45.327 INFO:tasks.workunit.client.1.smithi150.stdout:2/926: fdatasync d0/d3/d5/d10/f45 0 2023-12-05T09:57:45.327 INFO:tasks.workunit.client.1.smithi150.stdout:2/927: truncate d0/d3/d5/d3b/d4c/d71/f10b 862839 0 2023-12-05T09:57:45.330 INFO:tasks.workunit.client.1.smithi150.stdout:0/979: symlink d5/d11/d71/d99/d9c/l147 0 2023-12-05T09:57:45.330 INFO:tasks.workunit.client.1.smithi150.stdout:0/980: read d5/d11/d71/d99/d9c/d3b/de0/f102 [2205103,55233] 0 2023-12-05T09:57:45.330 INFO:tasks.workunit.client.1.smithi150.stdout:0/981: write d5/d11/d71/d99/d9c/fcf [3482321,122904] 0 2023-12-05T09:57:45.330 INFO:tasks.workunit.client.1.smithi150.stdout:0/982: write d5/d11/f24 [93969,18172] 0 2023-12-05T09:57:45.334 INFO:tasks.workunit.client.1.smithi150.stdout:7/896: dwrite d2/d72/d82/fb7 [0,4194304] 0 2023-12-05T09:57:45.334 INFO:tasks.workunit.client.1.smithi150.stdout:7/897: truncate d2/db/d30/d18/d1a/faa 737537 0 2023-12-05T09:57:45.341 INFO:tasks.workunit.client.0.smithi100.stdout:8/830: mkdir d0/d12/d13/d16/df5 0 2023-12-05T09:57:45.341 INFO:tasks.workunit.client.0.smithi100.stdout:8/831: write d0/d12/d13/d16/da3/fbb [1002295,119327] 0 2023-12-05T09:57:45.344 INFO:tasks.workunit.client.1.smithi150.stdout:0/983: creat d5/d11/d71/d99/d9c/d96/dd5/d67/da8/df1/d110/d122/f148 x:0 0 0 2023-12-05T09:57:45.345 INFO:tasks.workunit.client.0.smithi100.stdout:7/805: getdents d3/db3 0 2023-12-05T09:57:45.346 INFO:tasks.workunit.client.0.smithi100.stdout:7/806: write d3/dc/d11/d13/de/d2d/d42/f83 [1981680,60065] 0 2023-12-05T09:57:45.346 INFO:tasks.workunit.client.0.smithi100.stdout:7/807: fdatasync d3/dc/d11/d13/d37/fa9 0 2023-12-05T09:57:45.348 INFO:tasks.workunit.client.1.smithi150.stdout:9/823: mknod d3/d9/c10a 0 2023-12-05T09:57:45.352 INFO:tasks.workunit.client.0.smithi100.stdout:8/832: mknod d0/d12/d13/d16/da3/cf6 0 2023-12-05T09:57:45.358 INFO:tasks.workunit.client.0.smithi100.stdout:7/808: creat d3/dc/d11/d13/da8/d10f/f127 x:0 0 0 2023-12-05T09:57:45.358 INFO:tasks.workunit.client.0.smithi100.stdout:7/809: chown d3/dc/d11/d13/de/d2d/d42/fcf 0 1 2023-12-05T09:57:45.358 INFO:tasks.workunit.client.0.smithi100.stdout:7/810: readlink d3/dc/d11/d13/l10 0 2023-12-05T09:57:45.358 INFO:tasks.workunit.client.1.smithi150.stdout:1/907: dwrite d6/f95 [0,4194304] 0 2023-12-05T09:57:45.362 INFO:tasks.workunit.client.0.smithi100.stdout:7/811: link d3/dc/d11/d13/de/d18/d3b/d40/d4c/f100 d3/dc/d11/d13/de/d2d/d47/ddd/f128 0 2023-12-05T09:57:45.362 INFO:tasks.workunit.client.0.smithi100.stdout:7/812: dread - d3/dc/d11/d33/ffe zero size 2023-12-05T09:57:45.366 INFO:tasks.workunit.client.1.smithi150.stdout:5/891: dwrite d1/d3/d6/ff0 [0,4194304] 0 2023-12-05T09:57:45.377 INFO:tasks.workunit.client.1.smithi150.stdout:1/908: creat d6/d47/d4c/dd9/d75/ddd/d114/f140 x:0 0 0 2023-12-05T09:57:45.387 INFO:tasks.workunit.client.0.smithi100.stdout:7/813: symlink d3/dc/d11/d13/l129 0 2023-12-05T09:57:45.387 INFO:tasks.workunit.client.0.smithi100.stdout:7/814: write d3/dc/d11/d13/de/d18/d3b/de2/feb [999469,40334] 0 2023-12-05T09:57:45.387 INFO:tasks.workunit.client.0.smithi100.stdout:7/815: write d3/dc/d11/d13/d1b/d60/f75 [2934,84857] 0 2023-12-05T09:57:45.394 INFO:tasks.workunit.client.0.smithi100.stdout:7/816: mknod d3/dc/daa/c12a 0 2023-12-05T09:57:45.396 INFO:tasks.workunit.client.1.smithi150.stdout:8/930: dwrite d0/f99 [0,4194304] 0 2023-12-05T09:57:45.401 INFO:tasks.workunit.client.1.smithi150.stdout:5/892: mknod d1/d7f/d65/d3b/d6b/dcb/c138 0 2023-12-05T09:57:45.401 INFO:tasks.workunit.client.1.smithi150.stdout:6/778: dwrite d2/d23/d3b/d64/d7a/fb9 [0,4194304] 0 2023-12-05T09:57:45.401 INFO:tasks.workunit.client.1.smithi150.stdout:6/779: chown d2/d23/d3b/df0/d97/ld5 34738479 1 2023-12-05T09:57:45.401 INFO:tasks.workunit.client.1.smithi150.stdout:9/824: write d3/d9/dc/fa2 [700328,119289] 0 2023-12-05T09:57:45.403 INFO:tasks.workunit.client.0.smithi100.stdout:7/817: creat d3/dc/d11/d13/de/d18/f12b x:0 0 0 2023-12-05T09:57:45.409 INFO:tasks.workunit.client.1.smithi150.stdout:8/931: rename d0/d41/d49/d1b/d24/d34/d56/d67/l91 to d0/d41/d49/d1b/d24/d5b/d9c/l125 0 2023-12-05T09:57:45.409 INFO:tasks.workunit.client.1.smithi150.stdout:8/932: dread - d0/d41/d49/d1b/d24/f10e zero size 2023-12-05T09:57:45.409 INFO:tasks.workunit.client.1.smithi150.stdout:8/933: write d0/d41/d49/d1b/d24/d34/dbc/fe5 [876921,29010] 0 2023-12-05T09:57:45.411 INFO:tasks.workunit.client.1.smithi150.stdout:1/909: rmdir d6/d47/d4c/dd9 39 2023-12-05T09:57:45.411 INFO:tasks.workunit.client.1.smithi150.stdout:1/910: chown d6/d47/d4c/dd9/l1e 673032749 1 2023-12-05T09:57:45.412 INFO:tasks.workunit.client.1.smithi150.stdout:1/911: dread - d6/d38/df9/f10b zero size 2023-12-05T09:57:45.412 INFO:tasks.workunit.client.1.smithi150.stdout:8/934: symlink d0/d41/d49/d1b/d24/d5b/d87/l126 0 2023-12-05T09:57:45.418 INFO:tasks.workunit.client.1.smithi150.stdout:9/825: dread d3/d9/d58/fa9 [0,4194304] 0 2023-12-05T09:57:45.419 INFO:tasks.workunit.client.1.smithi150.stdout:9/826: creat d3/d1b/d46/f10b x:0 0 0 2023-12-05T09:57:45.419 INFO:tasks.workunit.client.1.smithi150.stdout:9/827: chown d3/d9/d9c/ffc 497 1 2023-12-05T09:57:45.422 INFO:tasks.workunit.client.1.smithi150.stdout:9/828: getdents d3/d1b/d46/d55/d64/d94 0 2023-12-05T09:57:45.427 INFO:tasks.workunit.client.1.smithi150.stdout:4/817: dwrite d0/d3e/d5b/d80/f7c [8388608,4194304] 0 2023-12-05T09:57:45.427 INFO:tasks.workunit.client.1.smithi150.stdout:4/818: read d0/d3e/d6d/ddf/da4/dd7/f67 [311483,74541] 0 2023-12-05T09:57:45.428 INFO:tasks.workunit.client.1.smithi150.stdout:0/984: dwrite d5/d11/d71/d5f/f70 [0,4194304] 0 2023-12-05T09:57:45.433 INFO:tasks.workunit.client.1.smithi150.stdout:8/935: read d0/d41/d49/d1b/fa4 [1894242,64573] 0 2023-12-05T09:57:45.435 INFO:tasks.workunit.client.1.smithi150.stdout:8/936: symlink d0/d41/d49/dd3/df9/l127 0 2023-12-05T09:57:45.437 INFO:tasks.workunit.client.1.smithi150.stdout:8/937: creat d0/da1/dfb/d110/f128 x:0 0 0 2023-12-05T09:57:45.441 INFO:tasks.workunit.client.0.smithi100.stdout:7/818: dwrite d3/dc/ff3 [0,4194304] 0 2023-12-05T09:57:45.441 INFO:tasks.workunit.client.0.smithi100.stdout:8/833: dwrite d0/db7/de2/fb2 [0,4194304] 0 2023-12-05T09:57:45.441 INFO:tasks.workunit.client.0.smithi100.stdout:8/834: write d0/fc [1827251,9762] 0 2023-12-05T09:57:45.445 INFO:tasks.workunit.client.1.smithi150.stdout:8/938: mkdir d0/d41/d49/d1b/d24/d5b/d9c/d129 0 2023-12-05T09:57:45.446 INFO:tasks.workunit.client.0.smithi100.stdout:7/819: rmdir d3/dc/d11/d13/de/d2d/d47/ddd 39 2023-12-05T09:57:45.447 INFO:tasks.workunit.client.1.smithi150.stdout:8/939: write d0/d41/d49/d1b/d24/d2e/f44 [2229393,3225] 0 2023-12-05T09:57:45.448 INFO:tasks.workunit.client.0.smithi100.stdout:7/820: mkdir d3/dc/d11/d13/de/d18/d3b/d12c 0 2023-12-05T09:57:45.448 INFO:tasks.workunit.client.1.smithi150.stdout:3/901: dwrite d6/d9/d3d/d87/f89 [0,4194304] 0 2023-12-05T09:57:45.449 INFO:tasks.workunit.client.1.smithi150.stdout:8/940: mkdir d0/d41/d49/d1b/d24/d34/da2/dd7/d12a 0 2023-12-05T09:57:45.449 INFO:tasks.workunit.client.1.smithi150.stdout:8/941: readlink d0/d8/l4a 0 2023-12-05T09:57:45.451 INFO:tasks.workunit.client.0.smithi100.stdout:7/821: rename d3/dc/d11/d13/d37/d97/dc1/dcd/cee to d3/c12d 0 2023-12-05T09:57:45.453 INFO:tasks.workunit.client.1.smithi150.stdout:3/902: link d6/d9/d3d/d56/d53/f69 d6/d9/f123 0 2023-12-05T09:57:45.456 INFO:tasks.workunit.client.0.smithi100.stdout:7/822: mknod d3/dc/d11/d13/de/d2d/c12e 0 2023-12-05T09:57:45.464 INFO:tasks.workunit.client.1.smithi150.stdout:9/829: read d3/d42/fc7 [415464,122990] 0 2023-12-05T09:57:45.467 INFO:tasks.workunit.client.1.smithi150.stdout:8/942: mknod d0/da1/dfb/d110/c12b 0 2023-12-05T09:57:45.467 INFO:tasks.workunit.client.1.smithi150.stdout:8/943: write d0/d41/d49/d1b/d24/d2e/d4d/fed [3878955,125288] 0 2023-12-05T09:57:45.469 INFO:tasks.workunit.client.1.smithi150.stdout:2/928: dwrite d0/d3/d5/d22/fbf [0,4194304] 0 2023-12-05T09:57:45.470 INFO:tasks.workunit.client.1.smithi150.stdout:5/893: dwrite d1/d7f/d65/d3b/d6b/d11e/dca/f115 [0,4194304] 0 2023-12-05T09:57:45.470 INFO:tasks.workunit.client.1.smithi150.stdout:5/894: fdatasync d1/d2e/da6/d24/f41 0 2023-12-05T09:57:45.470 INFO:tasks.workunit.client.1.smithi150.stdout:5/895: chown d1/d7f/f79 1793 1 2023-12-05T09:57:45.476 INFO:tasks.workunit.client.1.smithi150.stdout:3/903: read d6/f5d [2706795,130130] 0 2023-12-05T09:57:45.477 INFO:tasks.workunit.client.1.smithi150.stdout:3/904: stat d6/d22/l100 0 2023-12-05T09:57:45.478 INFO:tasks.workunit.client.1.smithi150.stdout:3/905: fsync d6/d9/d3d/d56/d53/f9e 0 2023-12-05T09:57:45.478 INFO:tasks.workunit.client.1.smithi150.stdout:3/906: creat d6/d25/dcf/f124 x:0 0 0 2023-12-05T09:57:45.484 INFO:tasks.workunit.client.1.smithi150.stdout:5/896: dread d1/d7f/f79 [0,4194304] 0 2023-12-05T09:57:45.486 INFO:tasks.workunit.client.0.smithi100.stdout:8/835: write d0/db7/de2/fb2 [5021402,67022] 0 2023-12-05T09:57:45.486 INFO:tasks.workunit.client.0.smithi100.stdout:8/836: chown d0/d12/d13/d16 642504 1 2023-12-05T09:57:45.487 INFO:tasks.workunit.client.0.smithi100.stdout:8/837: chown d0/d12/d13/d45/dba/dbd/d72/fe8 2094546 1 2023-12-05T09:57:45.489 INFO:tasks.workunit.client.1.smithi150.stdout:2/929: link d0/d3/d27/d51/c6b d0/d3/d5/d22/d52/d56/c13e 0 2023-12-05T09:57:45.496 INFO:tasks.workunit.client.0.smithi100.stdout:3/922: sync 2023-12-05T09:57:45.496 INFO:tasks.workunit.client.0.smithi100.stdout:2/945: sync 2023-12-05T09:57:45.496 INFO:tasks.workunit.client.0.smithi100.stdout:4/788: sync 2023-12-05T09:57:45.496 INFO:tasks.workunit.client.0.smithi100.stdout:4/789: dread - de/d16/d23/d60/de3/ff8 zero size 2023-12-05T09:57:45.496 INFO:tasks.workunit.client.0.smithi100.stdout:4/790: dread - de/d16/dc8/fe1 zero size 2023-12-05T09:57:45.496 INFO:tasks.workunit.client.0.smithi100.stdout:4/791: dread - de/d38/d5d/f6e zero size 2023-12-05T09:57:45.496 INFO:tasks.workunit.client.0.smithi100.stdout:9/900: sync 2023-12-05T09:57:45.496 INFO:tasks.workunit.client.0.smithi100.stdout:5/910: sync 2023-12-05T09:57:45.496 INFO:tasks.workunit.client.0.smithi100.stdout:0/809: sync 2023-12-05T09:57:45.496 INFO:tasks.workunit.client.0.smithi100.stdout:1/840: sync 2023-12-05T09:57:45.497 INFO:tasks.workunit.client.1.smithi150.stdout:3/907: rmdir d6/d9/d114 39 2023-12-05T09:57:45.506 INFO:tasks.workunit.client.0.smithi100.stdout:3/923: getdents d0/d3d/d5c/d5f 0 2023-12-05T09:57:45.508 INFO:tasks.workunit.client.0.smithi100.stdout:5/911: dread d0/d1b/d4d/d8e/d125/d14/f8f [0,4194304] 0 2023-12-05T09:57:45.508 INFO:tasks.workunit.client.0.smithi100.stdout:4/792: rename de/d66/f75 to de/d16/d1e/f102 0 2023-12-05T09:57:45.510 INFO:tasks.workunit.client.1.smithi150.stdout:6/780: dwrite d2/d23/d3b/d64/f88 [0,4194304] 0 2023-12-05T09:57:45.513 INFO:tasks.workunit.client.1.smithi150.stdout:0/985: dwrite d5/f5d [8388608,4194304] 0 2023-12-05T09:57:45.514 INFO:tasks.workunit.client.1.smithi150.stdout:1/912: dwrite d6/d8/db/f5b [0,4194304] 0 2023-12-05T09:57:45.514 INFO:tasks.workunit.client.1.smithi150.stdout:1/913: write f1 [3379559,119949] 0 2023-12-05T09:57:45.514 INFO:tasks.workunit.client.1.smithi150.stdout:1/914: write f1 [1928827,116854] 0 2023-12-05T09:57:45.514 INFO:tasks.workunit.client.1.smithi150.stdout:1/915: read f1 [831383,33678] 0 2023-12-05T09:57:45.514 INFO:tasks.workunit.client.0.smithi100.stdout:1/841: rmdir db/d12/d1e/d26/d39 39 2023-12-05T09:57:45.515 INFO:tasks.workunit.client.0.smithi100.stdout:1/842: chown db/d12/d61 0 1 2023-12-05T09:57:45.515 INFO:tasks.workunit.client.0.smithi100.stdout:0/810: mknod da/d22/d33/d35/cf6 0 2023-12-05T09:57:45.515 INFO:tasks.workunit.client.0.smithi100.stdout:0/811: dread - da/d1b/d6b/fea zero size 2023-12-05T09:57:45.515 INFO:tasks.workunit.client.0.smithi100.stdout:0/812: write da/d1b/d6b/d78/f88 [4810494,15749] 0 2023-12-05T09:57:45.517 INFO:tasks.workunit.client.0.smithi100.stdout:2/946: dread d7/da/d18/d1b/f6c [0,4194304] 0 2023-12-05T09:57:45.519 INFO:tasks.workunit.client.1.smithi150.stdout:6/781: symlink d2/d23/d3b/d64/d7a/d5d/dcd/lff 0 2023-12-05T09:57:45.519 INFO:tasks.workunit.client.1.smithi150.stdout:6/782: chown d2/d23/d2e/dd6 40 1 2023-12-05T09:57:45.521 INFO:tasks.workunit.client.1.smithi150.stdout:4/819: dwrite d0/d3e/d5b/d80/f7c [8388608,4194304] 0 2023-12-05T09:57:45.522 INFO:tasks.workunit.client.0.smithi100.stdout:3/924: creat d0/d3d/d5c/d139/de/d8d/f141 x:0 0 0 2023-12-05T09:57:45.532 INFO:tasks.workunit.client.0.smithi100.stdout:5/912: mknod d0/d1b/d4d/d8e/d96/dc1/dae/db9/dd2/c141 0 2023-12-05T09:57:45.533 INFO:tasks.workunit.client.0.smithi100.stdout:4/793: truncate de/d16/d1e/f41 779444 0 2023-12-05T09:57:45.537 INFO:tasks.workunit.client.0.smithi100.stdout:1/843: dread db/d12/f16 [0,4194304] 0 2023-12-05T09:57:45.537 INFO:tasks.workunit.client.0.smithi100.stdout:1/844: write db/d12/d1e/d26/d30/d52/f5f [1373764,21139] 0 2023-12-05T09:57:45.537 INFO:tasks.workunit.client.0.smithi100.stdout:1/845: stat db/d12/f16 0 2023-12-05T09:57:45.539 INFO:tasks.workunit.client.1.smithi150.stdout:0/986: mknod d5/d11/d65/d82/c149 0 2023-12-05T09:57:45.539 INFO:tasks.workunit.client.1.smithi150.stdout:0/987: fsync d5/d11/d71/d99/d9c/fa5 0 2023-12-05T09:57:45.541 INFO:tasks.workunit.client.1.smithi150.stdout:6/783: rmdir d2/d23/d3b/db4 39 2023-12-05T09:57:45.543 INFO:tasks.workunit.client.0.smithi100.stdout:2/947: creat d7/da/da7/dd6/f13a x:0 0 0 2023-12-05T09:57:45.543 INFO:tasks.workunit.client.0.smithi100.stdout:2/948: chown d7/da/d13/d69/d6e/d71/le9 6582165 1 2023-12-05T09:57:45.545 INFO:tasks.workunit.client.0.smithi100.stdout:7/823: dwrite d3/dc/d11/d13/de/d18/d3b/d40/d4c/d7f/fb5 [0,4194304] 0 2023-12-05T09:57:45.545 INFO:tasks.workunit.client.0.smithi100.stdout:7/824: fsync d3/dc/d11/d13/d37/d97/dc1/dcd/f103 0 2023-12-05T09:57:45.545 INFO:tasks.workunit.client.1.smithi150.stdout:0/988: creat d5/d11/d71/d5f/d77/f14a x:0 0 0 2023-12-05T09:57:45.547 INFO:tasks.workunit.client.0.smithi100.stdout:5/913: rename d0/d1b/d4d/l61 to d0/d1f/d25/d111/l142 0 2023-12-05T09:57:45.547 INFO:tasks.workunit.client.0.smithi100.stdout:5/914: chown d0/d1b/d4d/d8e/d125/d14/l8d 19757875 1 2023-12-05T09:57:45.547 INFO:tasks.workunit.client.0.smithi100.stdout:5/915: fsync d0/d1f/d25/d31/f119 0 2023-12-05T09:57:45.548 INFO:tasks.workunit.client.1.smithi150.stdout:6/784: creat d2/d23/d3b/f100 x:0 0 0 2023-12-05T09:57:45.548 INFO:tasks.workunit.client.1.smithi150.stdout:6/785: write d2/d23/d2e/d72/f75 [2115005,91753] 0 2023-12-05T09:57:45.551 INFO:tasks.workunit.client.1.smithi150.stdout:0/989: creat d5/d11/d71/d99/d9c/d96/f14b x:0 0 0 2023-12-05T09:57:45.552 INFO:tasks.workunit.client.0.smithi100.stdout:4/794: symlink de/d16/d23/d60/de3/deb/l103 0 2023-12-05T09:57:45.552 INFO:tasks.workunit.client.0.smithi100.stdout:4/795: write de/d38/d5d/f6e [693167,65456] 0 2023-12-05T09:57:45.556 INFO:tasks.workunit.client.0.smithi100.stdout:1/846: creat db/d12/d1e/d72/ddd/dfd/f108 x:0 0 0 2023-12-05T09:57:45.556 INFO:tasks.workunit.client.0.smithi100.stdout:1/847: chown db/d12/d1e/c4e 101867916 1 2023-12-05T09:57:45.556 INFO:tasks.workunit.client.0.smithi100.stdout:1/848: chown db/d12/l88 7 1 2023-12-05T09:57:45.556 INFO:tasks.workunit.client.0.smithi100.stdout:9/901: write d7/d1b/d22/d2a/d56/fc4 [2019138,63478] 0 2023-12-05T09:57:45.563 INFO:tasks.workunit.client.0.smithi100.stdout:2/949: stat d7/da/d18/d1b/d2c/d3f/d46/c27 0 2023-12-05T09:57:45.565 INFO:tasks.workunit.client.0.smithi100.stdout:5/916: rmdir d0/d1b/d4d/d8e/d96/dea/dff 39 2023-12-05T09:57:45.565 INFO:tasks.workunit.client.0.smithi100.stdout:5/917: fsync d0/d1f/fdb 0 2023-12-05T09:57:45.565 INFO:tasks.workunit.client.0.smithi100.stdout:5/918: chown d0/d1b/d4d/d8e/d96/dc1 8191975 1 2023-12-05T09:57:45.566 INFO:tasks.workunit.client.0.smithi100.stdout:4/796: creat de/d16/d23/d36/dfe/f104 x:0 0 0 2023-12-05T09:57:45.566 INFO:tasks.workunit.client.0.smithi100.stdout:4/797: write de/d16/d23/d60/dc4/fcb [106673,59903] 0 2023-12-05T09:57:45.569 INFO:tasks.workunit.client.0.smithi100.stdout:2/950: creat d7/da/d18/d1b/d2c/d3f/d10b/f13b x:0 0 0 2023-12-05T09:57:45.570 INFO:tasks.workunit.client.0.smithi100.stdout:7/825: mknod d3/dc/d11/d13/c12f 0 2023-12-05T09:57:45.570 INFO:tasks.workunit.client.0.smithi100.stdout:7/826: readlink d3/dc/d11/d13/de/d18/l10a 0 2023-12-05T09:57:45.572 INFO:tasks.workunit.client.0.smithi100.stdout:4/798: truncate de/d16/d23/d36/f21 2891184 0 2023-12-05T09:57:45.575 INFO:tasks.workunit.client.0.smithi100.stdout:2/951: rename d7/da/d18/d1b/d2c/d3f/d46/f76 to d7/da/d18/d21/d4d/f13c 0 2023-12-05T09:57:45.575 INFO:tasks.workunit.client.0.smithi100.stdout:2/952: write d7/da/d18/d1b/d2c/d3f/fc0 [1565136,91580] 0 2023-12-05T09:57:45.575 INFO:tasks.workunit.client.0.smithi100.stdout:2/953: creat d7/da/d18/d1b/d2c/d3f/d46/dc8/dfe/f13d x:0 0 0 2023-12-05T09:57:45.577 INFO:tasks.workunit.client.0.smithi100.stdout:7/827: mknod d3/dc/d11/d13/de/d18/d3b/d40/d4c/d7f/c130 0 2023-12-05T09:57:45.578 INFO:tasks.workunit.client.0.smithi100.stdout:4/799: mkdir de/d16/d23/d60/d88/d105 0 2023-12-05T09:57:45.578 INFO:tasks.workunit.client.1.smithi150.stdout:9/830: dwrite d3/f29 [0,4194304] 0 2023-12-05T09:57:45.580 INFO:tasks.workunit.client.0.smithi100.stdout:7/828: rmdir d3/dc/d11/d13/de/d18/d3b/d40/d4c 39 2023-12-05T09:57:45.586 INFO:tasks.workunit.client.0.smithi100.stdout:4/800: unlink de/d16/d23/f24 0 2023-12-05T09:57:45.587 INFO:tasks.workunit.client.1.smithi150.stdout:9/831: symlink d3/d9/d6e/d76/l10c 0 2023-12-05T09:57:45.587 INFO:tasks.workunit.client.1.smithi150.stdout:9/832: fdatasync d3/d9/dc/d1f/d24/d75/fc6 0 2023-12-05T09:57:45.587 INFO:tasks.workunit.client.1.smithi150.stdout:9/833: write d3/d9/d58/fdd [449719,145] 0 2023-12-05T09:57:45.588 INFO:tasks.workunit.client.0.smithi100.stdout:5/919: dread d0/d1f/d25/f50 [0,4194304] 0 2023-12-05T09:57:45.589 INFO:tasks.workunit.client.1.smithi150.stdout:6/786: write d2/d23/d2e/d72/fe7 [1340718,112023] 0 2023-12-05T09:57:45.589 INFO:tasks.workunit.client.1.smithi150.stdout:6/787: write d2/f34 [2643990,24751] 0 2023-12-05T09:57:45.589 INFO:tasks.workunit.client.1.smithi150.stdout:9/834: mknod d3/d1b/d79/c10d 0 2023-12-05T09:57:45.589 INFO:tasks.workunit.client.1.smithi150.stdout:9/835: creat d3/d9/d26/d9b/f10e x:0 0 0 2023-12-05T09:57:45.589 INFO:tasks.workunit.client.1.smithi150.stdout:9/836: fdatasync d3/d42/fc7 0 2023-12-05T09:57:45.589 INFO:tasks.workunit.client.1.smithi150.stdout:9/837: chown d3/d9/d6e/d76/f9f 0 1 2023-12-05T09:57:45.590 INFO:tasks.workunit.client.1.smithi150.stdout:9/838: chown d3/d1b/f59 0 1 2023-12-05T09:57:45.590 INFO:tasks.workunit.client.1.smithi150.stdout:9/839: read - d3/d9/d58/fc5 zero size 2023-12-05T09:57:45.590 INFO:tasks.workunit.client.1.smithi150.stdout:6/788: mknod d2/d23/d2e/d72/c101 0 2023-12-05T09:57:45.590 INFO:tasks.workunit.client.0.smithi100.stdout:4/801: symlink de/d66/df9/l106 0 2023-12-05T09:57:45.595 INFO:tasks.workunit.client.0.smithi100.stdout:9/902: dread d7/f8 [0,4194304] 0 2023-12-05T09:57:45.595 INFO:tasks.workunit.client.0.smithi100.stdout:5/920: link d0/d1b/d4d/d8e/d125/d14/l11e d0/d16/d2b/d75/l143 0 2023-12-05T09:57:45.597 INFO:tasks.workunit.client.1.smithi150.stdout:9/840: rmdir d3/d9/d58/d90/de8 0 2023-12-05T09:57:45.597 INFO:tasks.workunit.client.1.smithi150.stdout:6/789: creat d2/d23/d3b/d64/d7a/d5d/f102 x:0 0 0 2023-12-05T09:57:45.598 INFO:tasks.workunit.client.1.smithi150.stdout:8/944: dwrite d0/d41/d49/d1b/d24/d5b/d87/f98 [0,4194304] 0 2023-12-05T09:57:45.599 INFO:tasks.workunit.client.0.smithi100.stdout:9/903: mknod d7/d1b/d89/d118/c143 0 2023-12-05T09:57:45.599 INFO:tasks.workunit.client.0.smithi100.stdout:9/904: write d7/f9 [5056318,12721] 0 2023-12-05T09:57:45.599 INFO:tasks.workunit.client.0.smithi100.stdout:9/905: truncate d7/d1b/d22/d2a/d56/d2e/fd2 82864 0 2023-12-05T09:57:45.599 INFO:tasks.workunit.client.0.smithi100.stdout:9/906: stat d7/d1b/d89/d118 0 2023-12-05T09:57:45.600 INFO:tasks.workunit.client.0.smithi100.stdout:5/921: mknod d0/d1f/da1/d11b/df/d51/da8/dee/c144 0 2023-12-05T09:57:45.601 INFO:tasks.workunit.client.0.smithi100.stdout:3/925: dwrite d0/d3d/d5c/d139/de/d12/d9b/fca [0,4194304] 0 2023-12-05T09:57:45.602 INFO:tasks.workunit.client.1.smithi150.stdout:9/841: rename d3/l48 to d3/d9/d58/d90/l10f 0 2023-12-05T09:57:45.603 INFO:tasks.workunit.client.0.smithi100.stdout:9/907: symlink d7/d1b/d127/l144 0 2023-12-05T09:57:45.603 INFO:tasks.workunit.client.1.smithi150.stdout:6/790: mknod d2/d23/d3b/df0/d97/c103 0 2023-12-05T09:57:45.603 INFO:tasks.workunit.client.1.smithi150.stdout:6/791: stat d2/d23/d2e/d72 0 2023-12-05T09:57:45.604 INFO:tasks.workunit.client.0.smithi100.stdout:5/922: symlink d0/d1f/da1/d11b/df/d51/da8/l145 0 2023-12-05T09:57:45.605 INFO:tasks.workunit.client.0.smithi100.stdout:5/923: creat d0/d16/d37/f146 x:0 0 0 2023-12-05T09:57:45.608 INFO:tasks.workunit.client.0.smithi100.stdout:5/924: link d0/d1b/d4d/d8e/d125/d14/d35/d62/ldd d0/d1b/l147 0 2023-12-05T09:57:45.608 INFO:tasks.workunit.client.1.smithi150.stdout:5/897: dwrite d1/d3/d6/f3f [4194304,4194304] 0 2023-12-05T09:57:45.613 INFO:tasks.workunit.client.1.smithi150.stdout:9/842: creat d3/d9/d26/daf/f110 x:0 0 0 2023-12-05T09:57:45.615 INFO:tasks.workunit.client.1.smithi150.stdout:1/916: dwrite d6/d8/db/f35 [4194304,4194304] 0 2023-12-05T09:57:45.616 INFO:tasks.workunit.client.0.smithi100.stdout:2/954: dread d7/da/d18/d1b/f6c [0,4194304] 0 2023-12-05T09:57:45.616 INFO:tasks.workunit.client.0.smithi100.stdout:2/955: dread - d7/da/d18/d21/d4d/d81/f131 zero size 2023-12-05T09:57:45.616 INFO:tasks.workunit.client.0.smithi100.stdout:2/956: fsync d7/da/d18/d21/fa4 0 2023-12-05T09:57:45.616 INFO:tasks.workunit.client.0.smithi100.stdout:2/957: fdatasync d7/da/f17 0 2023-12-05T09:57:45.619 INFO:tasks.workunit.client.1.smithi150.stdout:4/820: dwrite d0/d3e/d5b/d80/f7b [4194304,4194304] 0 2023-12-05T09:57:45.620 INFO:tasks.workunit.client.1.smithi150.stdout:0/990: dwrite d5/d11/d71/d99/d9c/d96/dd5/d67/fea [0,4194304] 0 2023-12-05T09:57:45.620 INFO:tasks.workunit.client.0.smithi100.stdout:0/813: rmdir da 39 2023-12-05T09:57:45.620 INFO:tasks.workunit.client.1.smithi150.stdout:6/792: write d2/d23/d2e/f94 [2524623,64410] 0 2023-12-05T09:57:45.621 INFO:tasks.workunit.client.1.smithi150.stdout:1/917: write d6/d8/db/db1/fba [79160,73383] 0 2023-12-05T09:57:45.622 INFO:tasks.workunit.client.1.smithi150.stdout:2/930: dwrite d0/d3/d21/d4d/deb/d103/d15/d30/d54/d57/f75 [0,4194304] 0 2023-12-05T09:57:45.623 INFO:tasks.workunit.client.0.smithi100.stdout:8/838: dwrite d0/d12/d13/d45/f58 [0,4194304] 0 2023-12-05T09:57:45.624 INFO:tasks.workunit.client.0.smithi100.stdout:0/814: creat da/d2a/d45/de3/ff7 x:0 0 0 2023-12-05T09:57:45.624 INFO:tasks.workunit.client.0.smithi100.stdout:0/815: readlink da/lf 0 2023-12-05T09:57:45.627 INFO:tasks.workunit.client.0.smithi100.stdout:8/839: symlink d0/d12/d13/d45/dba/dbd/d72/d9f/dde/lf7 0 2023-12-05T09:57:45.628 INFO:tasks.workunit.client.1.smithi150.stdout:3/908: dwrite d6/d9/d43/d47/f1a [0,4194304] 0 2023-12-05T09:57:45.630 INFO:tasks.workunit.client.0.smithi100.stdout:0/816: link da/d22/d33/d35/c44 da/d22/d33/d74/cf8 0 2023-12-05T09:57:45.631 INFO:tasks.workunit.client.0.smithi100.stdout:8/840: symlink d0/d12/d13/d45/dba/dbd/lf8 0 2023-12-05T09:57:45.634 INFO:tasks.workunit.client.0.smithi100.stdout:4/802: dread de/f14 [0,4194304] 0 2023-12-05T09:57:45.639 INFO:tasks.workunit.client.1.smithi150.stdout:4/821: read d0/d3e/f8d [6860630,120264] 0 2023-12-05T09:57:45.642 INFO:tasks.workunit.client.1.smithi150.stdout:6/793: symlink d2/d23/d3b/d64/d7a/d5d/d6b/d9c/l104 0 2023-12-05T09:57:45.642 INFO:tasks.workunit.client.1.smithi150.stdout:9/843: rmdir d3/d9/dc/d1f/d24/d75/d95/d9a/dcb 39 2023-12-05T09:57:45.643 INFO:tasks.workunit.client.1.smithi150.stdout:1/918: rename d6/d47/f100 to d6/d47/db4/f141 0 2023-12-05T09:57:45.643 INFO:tasks.workunit.client.1.smithi150.stdout:1/919: write d6/d8/f12e [862965,89113] 0 2023-12-05T09:57:45.654 INFO:tasks.workunit.client.1.smithi150.stdout:6/794: link d2/d23/d3b/d64/lcf d2/d23/d3b/d64/d7a/d5d/d6b/d9c/l105 0 2023-12-05T09:57:45.655 INFO:tasks.workunit.client.1.smithi150.stdout:9/844: symlink d3/d9/d58/l111 0 2023-12-05T09:57:45.656 INFO:tasks.workunit.client.1.smithi150.stdout:2/931: dread d0/d3/d21/f2c [4194304,4194304] 0 2023-12-05T09:57:45.656 INFO:tasks.workunit.client.1.smithi150.stdout:2/932: stat d0/d3/d27/dac/d81 0 2023-12-05T09:57:45.660 INFO:tasks.workunit.client.1.smithi150.stdout:1/920: link d6/d3c/dc2/dde/df4/d10a/f132 d6/d38/d135/f142 0 2023-12-05T09:57:45.661 INFO:tasks.workunit.client.0.smithi100.stdout:0/817: mkdir da/d22/d33/d35/d3a/de9/df9 0 2023-12-05T09:57:45.668 INFO:tasks.workunit.client.1.smithi150.stdout:2/933: symlink d0/d3/d5/l13f 0 2023-12-05T09:57:45.672 INFO:tasks.workunit.client.0.smithi100.stdout:8/841: dread d0/d12/d13/d45/da6/d76/f6f [0,4194304] 0 2023-12-05T09:57:45.672 INFO:tasks.workunit.client.1.smithi150.stdout:0/991: dread d5/d11/d65/d82/fab [4194304,4194304] 0 2023-12-05T09:57:45.673 INFO:tasks.workunit.client.1.smithi150.stdout:4/822: dread d0/d3e/d6d/d4b/f50 [0,4194304] 0 2023-12-05T09:57:45.680 INFO:tasks.workunit.client.0.smithi100.stdout:3/926: dread d0/d3d/f53 [4194304,4194304] 0 2023-12-05T09:57:45.681 INFO:tasks.workunit.client.0.smithi100.stdout:0/818: symlink da/d1b/d73/lfa 0 2023-12-05T09:57:45.685 INFO:tasks.workunit.client.0.smithi100.stdout:1/849: dwrite db/d12/d1e/d72/ddd/dfd/f108 [0,4194304] 0 2023-12-05T09:57:45.687 INFO:tasks.workunit.client.0.smithi100.stdout:8/842: mkdir d0/d12/d13/d45/da6/d76/df9 0 2023-12-05T09:57:45.687 INFO:tasks.workunit.client.0.smithi100.stdout:8/843: readlink d0/d12/d13/d45/da6/d76/l59 0 2023-12-05T09:57:45.689 INFO:tasks.workunit.client.1.smithi150.stdout:1/921: getdents d6/d47/d4c/dd9/daf 0 2023-12-05T09:57:45.689 INFO:tasks.workunit.client.1.smithi150.stdout:2/934: getdents d0/d3/d5/d3b 0 2023-12-05T09:57:45.690 INFO:tasks.workunit.client.1.smithi150.stdout:9/845: rmdir d3/d1b/dca 39 2023-12-05T09:57:45.690 INFO:tasks.workunit.client.1.smithi150.stdout:9/846: readlink d3/d9/d58/l5d 0 2023-12-05T09:57:45.690 INFO:tasks.workunit.client.1.smithi150.stdout:6/795: dread d2/d23/d3b/d64/d7a/f40 [0,4194304] 0 2023-12-05T09:57:45.691 INFO:tasks.workunit.client.0.smithi100.stdout:0/819: link da/d1b/d6b/d78/ccd da/d22/d33/d7f/cfb 0 2023-12-05T09:57:45.696 INFO:tasks.workunit.client.1.smithi150.stdout:2/935: stat d0/d3/d27/d51/c113 0 2023-12-05T09:57:45.699 INFO:tasks.workunit.client.1.smithi150.stdout:6/796: mkdir d2/d23/d3b/d64/d7a/d5d/d106 0 2023-12-05T09:57:45.702 INFO:tasks.workunit.client.0.smithi100.stdout:1/850: truncate db/d12/f8f 153428 0 2023-12-05T09:57:45.705 INFO:tasks.workunit.client.1.smithi150.stdout:7/898: sync 2023-12-05T09:57:45.706 INFO:tasks.workunit.client.1.smithi150.stdout:7/899: read - d2/db/d30/daf/dd3/d2b/fe0 zero size 2023-12-05T09:57:45.706 INFO:tasks.workunit.client.1.smithi150.stdout:7/900: stat d2/db/d62/l95 0 2023-12-05T09:57:45.706 INFO:tasks.workunit.client.1.smithi150.stdout:0/992: rmdir d5/d11/d71/d99/d9c/d96 39 2023-12-05T09:57:45.707 INFO:tasks.workunit.client.1.smithi150.stdout:2/936: getdents d0/d3/d21/d4d 0 2023-12-05T09:57:45.708 INFO:tasks.workunit.client.1.smithi150.stdout:7/901: mknod d2/db/d30/d13/d4f/d5a/d5c/c12b 0 2023-12-05T09:57:45.709 INFO:tasks.workunit.client.0.smithi100.stdout:0/820: truncate da/d22/d33/d74/dca/fdd 4031708 0 2023-12-05T09:57:45.709 INFO:tasks.workunit.client.1.smithi150.stdout:0/993: mknod d5/d11/d71/d99/d9c/d96/dd5/d67/da8/c14c 0 2023-12-05T09:57:45.710 INFO:tasks.workunit.client.0.smithi100.stdout:8/844: dread d0/d12/d13/d16/f2e [0,4194304] 0 2023-12-05T09:57:45.710 INFO:tasks.workunit.client.0.smithi100.stdout:0/821: creat da/d1b/d73/d82/ffc x:0 0 0 2023-12-05T09:57:45.712 INFO:tasks.workunit.client.1.smithi150.stdout:7/902: link d2/d1b/d31/da4/ca9 d2/c12c 0 2023-12-05T09:57:45.713 INFO:tasks.workunit.client.1.smithi150.stdout:8/945: dwrite d0/d41/d49/d1b/d24/f10e [0,4194304] 0 2023-12-05T09:57:45.713 INFO:tasks.workunit.client.1.smithi150.stdout:7/903: write d2/db/d17/d20/f3f [2943727,15119] 0 2023-12-05T09:57:45.714 INFO:tasks.workunit.client.0.smithi100.stdout:0/822: creat da/d1b/ffd x:0 0 0 2023-12-05T09:57:45.715 INFO:tasks.workunit.client.1.smithi150.stdout:3/909: dwrite d6/d9/f1d [4194304,4194304] 0 2023-12-05T09:57:45.715 INFO:tasks.workunit.client.0.smithi100.stdout:8/845: getdents d0/d12/d52 0 2023-12-05T09:57:45.716 INFO:tasks.workunit.client.0.smithi100.stdout:8/846: stat d0/d12/d13/d45/dba/dbd 0 2023-12-05T09:57:45.716 INFO:tasks.workunit.client.0.smithi100.stdout:8/847: write d0/d12/d52/f7e [1973458,69027] 0 2023-12-05T09:57:45.725 INFO:tasks.workunit.client.1.smithi150.stdout:8/946: creat d0/d41/d49/d1b/d24/d2e/d105/f12c x:0 0 0 2023-12-05T09:57:45.725 INFO:tasks.workunit.client.1.smithi150.stdout:2/937: dread d0/d3/d21/d4d/f84 [0,4194304] 0 2023-12-05T09:57:45.725 INFO:tasks.workunit.client.1.smithi150.stdout:7/904: mkdir d2/db/d30/daf/d12d 0 2023-12-05T09:57:45.725 INFO:tasks.workunit.client.1.smithi150.stdout:7/905: creat d2/db/d30/d47/f12e x:0 0 0 2023-12-05T09:57:45.725 INFO:tasks.workunit.client.1.smithi150.stdout:2/938: symlink d0/d3/d21/d4d/l140 0 2023-12-05T09:57:45.726 INFO:tasks.workunit.client.1.smithi150.stdout:2/939: creat d0/d3/d27/d95/ddf/f141 x:0 0 0 2023-12-05T09:57:45.726 INFO:tasks.workunit.client.1.smithi150.stdout:2/940: readlink d0/d3/d27/la8 0 2023-12-05T09:57:45.726 INFO:tasks.workunit.client.1.smithi150.stdout:2/941: readlink d0/d3/d5/d22/d52/d56/l111 0 2023-12-05T09:57:45.727 INFO:tasks.workunit.client.0.smithi100.stdout:3/927: write d0/d10/d39/f51 [427992,20506] 0 2023-12-05T09:57:45.727 INFO:tasks.workunit.client.0.smithi100.stdout:3/928: chown d0/d3d/dfc/d10d/l60 225272 1 2023-12-05T09:57:45.729 INFO:tasks.workunit.client.1.smithi150.stdout:0/994: dread d5/d11/d32/d57/f9d [0,4194304] 0 2023-12-05T09:57:45.729 INFO:tasks.workunit.client.0.smithi100.stdout:3/929: mknod d0/d3d/d5c/d6f/c142 0 2023-12-05T09:57:45.730 INFO:tasks.workunit.client.0.smithi100.stdout:3/930: dread - d0/d3d/d5c/d139/de/db8/fe7 zero size 2023-12-05T09:57:45.732 INFO:tasks.workunit.client.0.smithi100.stdout:3/931: mknod d0/d3d/dfc/c143 0 2023-12-05T09:57:45.732 INFO:tasks.workunit.client.0.smithi100.stdout:3/932: stat d0/d3d/dfc/d10d/db0/d100/f111 0 2023-12-05T09:57:45.732 INFO:tasks.workunit.client.0.smithi100.stdout:4/803: dwrite de/d16/d1e/f7c [0,4194304] 0 2023-12-05T09:57:45.733 INFO:tasks.workunit.client.1.smithi150.stdout:2/942: dread d0/d3/d21/d4d/fdd [0,4194304] 0 2023-12-05T09:57:45.736 INFO:tasks.workunit.client.0.smithi100.stdout:5/925: dwrite d0/d1b/d4d/d8e/d96/dc1/fce [0,4194304] 0 2023-12-05T09:57:45.736 INFO:tasks.workunit.client.0.smithi100.stdout:5/926: write d0/d1f/da1/d11b/f65 [1046622,14044] 0 2023-12-05T09:57:45.736 INFO:tasks.workunit.client.0.smithi100.stdout:5/927: readlink d0/d1b/d4d/d8e/d96/dc1/lc8 0 2023-12-05T09:57:45.736 INFO:tasks.workunit.client.1.smithi150.stdout:4/823: dwrite d0/d3e/d5b/d80/da1/fb8 [0,4194304] 0 2023-12-05T09:57:45.736 INFO:tasks.workunit.client.1.smithi150.stdout:3/910: dread d6/f17 [0,4194304] 0 2023-12-05T09:57:45.737 INFO:tasks.workunit.client.1.smithi150.stdout:8/947: dread d0/d41/d49/dda/fe0 [0,4194304] 0 2023-12-05T09:57:45.738 INFO:tasks.workunit.client.0.smithi100.stdout:4/804: mkdir de/d16/d23/d60/df7/d4e/d85/d107 0 2023-12-05T09:57:45.739 INFO:tasks.workunit.client.0.smithi100.stdout:4/805: dread - de/d16/d1e/f62 zero size 2023-12-05T09:57:45.739 INFO:tasks.workunit.client.0.smithi100.stdout:4/806: stat de/d16/d23/d60/d98/c101 0 2023-12-05T09:57:45.739 INFO:tasks.workunit.client.0.smithi100.stdout:4/807: dread - de/d16/d23/d36/dfe/f104 zero size 2023-12-05T09:57:45.741 INFO:tasks.workunit.client.1.smithi150.stdout:4/824: rmdir d0/d3e/d5b/d80/d44 39 2023-12-05T09:57:45.742 INFO:tasks.workunit.client.0.smithi100.stdout:0/823: write da/d22/d33/fa9 [3868522,32186] 0 2023-12-05T09:57:45.742 INFO:tasks.workunit.client.0.smithi100.stdout:0/824: write da/d1b/d6b/d78/fe5 [1366190,74757] 0 2023-12-05T09:57:45.742 INFO:tasks.workunit.client.0.smithi100.stdout:9/908: dwrite d7/f9 [0,4194304] 0 2023-12-05T09:57:45.743 INFO:tasks.workunit.client.0.smithi100.stdout:0/825: fdatasync da/f30 0 2023-12-05T09:57:45.743 INFO:tasks.workunit.client.0.smithi100.stdout:2/958: dwrite d7/db4/f12d [0,4194304] 0 2023-12-05T09:57:45.743 INFO:tasks.workunit.client.0.smithi100.stdout:0/826: chown da/d22/d33/d35/d3a/d8b 81 1 2023-12-05T09:57:45.743 INFO:tasks.workunit.client.0.smithi100.stdout:0/827: fdatasync da/d1b/d73/d82/f8a 0 2023-12-05T09:57:45.743 INFO:tasks.workunit.client.0.smithi100.stdout:0/828: stat da/d22/f2b 0 2023-12-05T09:57:45.743 INFO:tasks.workunit.client.0.smithi100.stdout:8/848: write d0/d12/d13/d16/f23 [4962068,92380] 0 2023-12-05T09:57:45.743 INFO:tasks.workunit.client.0.smithi100.stdout:8/849: dread - d0/d12/d13/d16/da3/fe0 zero size 2023-12-05T09:57:45.743 INFO:tasks.workunit.client.1.smithi150.stdout:0/995: dread d5/d11/d71/d99/d9c/fa5 [0,4194304] 0 2023-12-05T09:57:45.744 INFO:tasks.workunit.client.1.smithi150.stdout:0/996: fsync d5/d11/d71/d99/d9c/d96/dd5/d67/fea 0 2023-12-05T09:57:45.746 INFO:tasks.workunit.client.0.smithi100.stdout:5/928: rename d0/d1b/d4d/d8e/c107 to d0/c148 0 2023-12-05T09:57:45.746 INFO:tasks.workunit.client.0.smithi100.stdout:5/929: chown d0/d16/d37/d138 85782841 1 2023-12-05T09:57:45.747 INFO:tasks.workunit.client.1.smithi150.stdout:3/911: symlink d6/d9/d3d/l125 0 2023-12-05T09:57:45.748 INFO:tasks.workunit.client.0.smithi100.stdout:4/808: symlink de/d16/d23/d60/de3/l108 0 2023-12-05T09:57:45.758 INFO:tasks.workunit.client.0.smithi100.stdout:9/909: mkdir d7/d1b/d22/d2a/d74/dec/d145 0 2023-12-05T09:57:45.759 INFO:tasks.workunit.client.1.smithi150.stdout:0/997: mkdir d5/d11/d71/d99/d9c/d96/dd5/d67/da8/df1/d14d 0 2023-12-05T09:57:45.760 INFO:tasks.workunit.client.0.smithi100.stdout:2/959: creat d7/da/d18/d21/d4d/f13e x:0 0 0 2023-12-05T09:57:45.760 INFO:tasks.workunit.client.0.smithi100.stdout:2/960: truncate d7/da/d18/d21/f40 4761079 0 2023-12-05T09:57:45.760 INFO:tasks.workunit.client.0.smithi100.stdout:2/961: fsync d7/da/d1a/f73 0 2023-12-05T09:57:45.760 INFO:tasks.workunit.client.1.smithi150.stdout:7/906: write d2/db/d2e/d9a/fda [3582011,108758] 0 2023-12-05T09:57:45.761 INFO:tasks.workunit.client.1.smithi150.stdout:7/907: truncate d2/db/d30/d53/d90/fb8 980644 0 2023-12-05T09:57:45.762 INFO:tasks.workunit.client.0.smithi100.stdout:0/829: symlink da/d60/dba/lfe 0 2023-12-05T09:57:45.763 INFO:tasks.workunit.client.0.smithi100.stdout:3/933: write d0/d3d/fb2 [2070367,116040] 0 2023-12-05T09:57:45.763 INFO:tasks.workunit.client.0.smithi100.stdout:5/930: rename d0/d1f/fdb to d0/d1f/da1/d11b/df/d51/f149 0 2023-12-05T09:57:45.766 INFO:tasks.workunit.client.0.smithi100.stdout:4/809: getdents de/d38 0 2023-12-05T09:57:45.767 INFO:tasks.workunit.client.0.smithi100.stdout:9/910: mkdir d7/d20/d69/def/da2/d12c/d146 0 2023-12-05T09:57:45.769 INFO:tasks.workunit.client.1.smithi150.stdout:6/797: dread d2/d23/d2e/d5f/d99/fac [0,4194304] 0 2023-12-05T09:57:45.770 INFO:tasks.workunit.client.0.smithi100.stdout:2/962: creat d7/da/d18/f13f x:0 0 0 2023-12-05T09:57:45.770 INFO:tasks.workunit.client.0.smithi100.stdout:2/963: fsync d7/da/d18/d1b/d2c/d3f/fd1 0 2023-12-05T09:57:45.773 INFO:tasks.workunit.client.0.smithi100.stdout:0/830: mknod da/d22/d33/d74/d77/cff 0 2023-12-05T09:57:45.773 INFO:tasks.workunit.client.0.smithi100.stdout:0/831: write da/d22/d33/f75 [2929882,55127] 0 2023-12-05T09:57:45.773 INFO:tasks.workunit.client.0.smithi100.stdout:0/832: write da/d22/d33/d74/fa8 [338311,118214] 0 2023-12-05T09:57:45.773 INFO:tasks.workunit.client.0.smithi100.stdout:0/833: chown da/d22/d33/d7f/d94 0 1 2023-12-05T09:57:45.773 INFO:tasks.workunit.client.0.smithi100.stdout:0/834: chown da/f5a 1706045 1 2023-12-05T09:57:45.773 INFO:tasks.workunit.client.0.smithi100.stdout:0/835: readlink da/d22/d33/d35/ldc 0 2023-12-05T09:57:45.773 INFO:tasks.workunit.client.0.smithi100.stdout:0/836: fdatasync da/d2a/f56 0 2023-12-05T09:57:45.774 INFO:tasks.workunit.client.1.smithi150.stdout:8/948: getdents d0/d41/d49 0 2023-12-05T09:57:45.775 INFO:tasks.workunit.client.1.smithi150.stdout:1/922: dwrite d6/d8/db/f30 [0,4194304] 0 2023-12-05T09:57:45.775 INFO:tasks.workunit.client.1.smithi150.stdout:1/923: stat d6/d38/df9/f10b 0 2023-12-05T09:57:45.778 INFO:tasks.workunit.client.0.smithi100.stdout:3/934: link d0/d10/f12a d0/d3d/d5c/f144 0 2023-12-05T09:57:45.778 INFO:tasks.workunit.client.0.smithi100.stdout:3/935: write d0/d3d/d5c/d5f/d73/fcd [188808,29658] 0 2023-12-05T09:57:45.778 INFO:tasks.workunit.client.0.smithi100.stdout:3/936: fdatasync d0/d3d/d5c/d139/de/db8/fe7 0 2023-12-05T09:57:45.781 INFO:tasks.workunit.client.0.smithi100.stdout:5/931: mknod d0/d1b/d4d/d60/c14a 0 2023-12-05T09:57:45.781 INFO:tasks.workunit.client.0.smithi100.stdout:5/932: write d0/d27/f57 [602811,75183] 0 2023-12-05T09:57:45.782 INFO:tasks.workunit.client.1.smithi150.stdout:8/949: symlink d0/d41/d49/d1b/d24/d34/da2/dd7/l12d 0 2023-12-05T09:57:45.782 INFO:tasks.workunit.client.1.smithi150.stdout:8/950: fdatasync d0/d41/d49/d1b/d24/d34/d56/d67/ff2 0 2023-12-05T09:57:45.784 INFO:tasks.workunit.client.0.smithi100.stdout:4/810: creat de/d16/d23/d60/d88/f109 x:0 0 0 2023-12-05T09:57:45.785 INFO:tasks.workunit.client.1.smithi150.stdout:1/924: mknod d6/d8/c143 0 2023-12-05T09:57:45.790 INFO:tasks.workunit.client.0.smithi100.stdout:9/911: getdents d7/d1b/d22 0 2023-12-05T09:57:45.790 INFO:tasks.workunit.client.0.smithi100.stdout:2/964: mkdir d7/da/d13/d69/d140 0 2023-12-05T09:57:45.790 INFO:tasks.workunit.client.0.smithi100.stdout:2/965: dread - d7/da/d65/d137/f139 zero size 2023-12-05T09:57:45.790 INFO:tasks.workunit.client.0.smithi100.stdout:2/966: stat d7/da/d65/d137/f139 0 2023-12-05T09:57:45.790 INFO:tasks.workunit.client.0.smithi100.stdout:2/967: write d7/da/d1a/fdb [1865756,42089] 0 2023-12-05T09:57:45.791 INFO:tasks.workunit.client.1.smithi150.stdout:8/951: mknod d0/d41/d49/dd3/df9/c12e 0 2023-12-05T09:57:45.795 INFO:tasks.workunit.client.1.smithi150.stdout:6/798: read d2/d23/d3b/d64/d7a/d5d/fbd [3614348,111526] 0 2023-12-05T09:57:45.799 INFO:tasks.workunit.client.0.smithi100.stdout:0/837: creat da/d22/d33/d74/dca/f100 x:0 0 0 2023-12-05T09:57:45.803 INFO:tasks.workunit.client.1.smithi150.stdout:8/952: link d0/d41/d49/d1b/d24/d2e/d4d/d83/cf1 d0/d41/d49/d1b/d24/d34/dbc/c12f 0 2023-12-05T09:57:45.804 INFO:tasks.workunit.client.1.smithi150.stdout:8/953: creat d0/d41/d49/d1b/d24/d38/d62/dac/f130 x:0 0 0 2023-12-05T09:57:45.804 INFO:tasks.workunit.client.1.smithi150.stdout:8/954: fdatasync d0/d41/d49/d1b/d24/d2e/d105/f114 0 2023-12-05T09:57:45.808 INFO:tasks.workunit.client.1.smithi150.stdout:7/908: write d2/db/d30/f94 [1062855,14279] 0 2023-12-05T09:57:45.808 INFO:tasks.workunit.client.1.smithi150.stdout:7/909: fsync d2/db/d30/d47/fed 0 2023-12-05T09:57:45.808 INFO:tasks.workunit.client.1.smithi150.stdout:4/825: dwrite d0/d3e/d48/f9e [4194304,4194304] 0 2023-12-05T09:57:45.810 INFO:tasks.workunit.client.0.smithi100.stdout:3/937: creat d0/d3d/d5c/d139/de/d11/d7c/f145 x:0 0 0 2023-12-05T09:57:45.810 INFO:tasks.workunit.client.0.smithi100.stdout:3/938: dread - d0/d3d/d5c/d6f/d7f/d87/f119 zero size 2023-12-05T09:57:45.810 INFO:tasks.workunit.client.1.smithi150.stdout:1/925: getdents d6/d8/db/d1b/d79/dca 0 2023-12-05T09:57:45.812 INFO:tasks.workunit.client.0.smithi100.stdout:2/968: creat d7/da/d13/d69/d140/f141 x:0 0 0 2023-12-05T09:57:45.812 INFO:tasks.workunit.client.0.smithi100.stdout:2/969: chown d7/da/d18/d1b/l101 6859557 1 2023-12-05T09:57:45.816 INFO:tasks.workunit.client.0.smithi100.stdout:0/838: rename da/d22/d33/d74/fa8 to da/d22/d33/d74/dca/d9f/f101 0 2023-12-05T09:57:45.816 INFO:tasks.workunit.client.0.smithi100.stdout:0/839: truncate da/d22/d33/d74/dca/fdf 693767 0 2023-12-05T09:57:45.816 INFO:tasks.workunit.client.0.smithi100.stdout:0/840: dread - da/d1b/d6b/fea zero size 2023-12-05T09:57:45.821 INFO:tasks.workunit.client.1.smithi150.stdout:0/998: dwrite d5/d11/d16/fd9 [4194304,4194304] 0 2023-12-05T09:57:45.821 INFO:tasks.workunit.client.1.smithi150.stdout:0/999: write d5/d11/d71/d99/d9c/d96/dd5/f2e [5717620,98273] 0 2023-12-05T09:57:45.825 INFO:tasks.workunit.client.1.smithi150.stdout:1/926: link d6/d8/d59/f65 d6/d47/d4c/dd9/d11f/f144 0 2023-12-05T09:57:45.825 INFO:tasks.workunit.client.1.smithi150.stdout:5/898: sync 2023-12-05T09:57:45.825 INFO:tasks.workunit.client.0.smithi100.stdout:2/970: creat d7/da/d18/d1b/d2c/d3f/d72/f142 x:0 0 0 2023-12-05T09:57:45.825 INFO:tasks.workunit.client.0.smithi100.stdout:8/850: dwrite d0/f1d [0,4194304] 0 2023-12-05T09:57:45.825 INFO:tasks.workunit.client.0.smithi100.stdout:8/851: stat d0/d12/d13/d45/da6/d76/l2c 0 2023-12-05T09:57:45.830 INFO:tasks.workunit.client.1.smithi150.stdout:7/910: rmdir d2/db/d30/d13/d4f/d5a/d5c 39 2023-12-05T09:57:45.830 INFO:tasks.workunit.client.1.smithi150.stdout:7/911: chown d2/db/d17/d38/d85/f8b 0 1 2023-12-05T09:57:45.836 INFO:tasks.workunit.client.1.smithi150.stdout:4/826: creat d0/d3e/d48/dbb/dca/dee/fff x:0 0 0 2023-12-05T09:57:45.836 INFO:tasks.workunit.client.1.smithi150.stdout:4/827: chown d0/d3e/d48/dbb 60 1 2023-12-05T09:57:45.841 INFO:tasks.workunit.client.1.smithi150.stdout:5/899: link d1/d64/d31/ld3 d1/d7f/d65/de3/d10a/l139 0 2023-12-05T09:57:45.845 INFO:tasks.workunit.client.0.smithi100.stdout:0/841: mknod da/d2a/c102 0 2023-12-05T09:57:45.846 INFO:tasks.workunit.client.1.smithi150.stdout:7/912: unlink d2/db/d30/daf/dd3/d2b/fc1 0 2023-12-05T09:57:45.846 INFO:tasks.workunit.client.1.smithi150.stdout:7/913: chown d2/db/d30/d13/f37 47019 1 2023-12-05T09:57:45.846 INFO:tasks.workunit.client.1.smithi150.stdout:7/914: write d2/db/d30/d18/f6c [3186392,7646] 0 2023-12-05T09:57:45.846 INFO:tasks.workunit.client.1.smithi150.stdout:7/915: chown d2/db/lc0 43108018 1 2023-12-05T09:57:45.846 INFO:tasks.workunit.client.1.smithi150.stdout:6/799: write d2/d23/d2e/d44/f50 [2194870,70294] 0 2023-12-05T09:57:45.847 INFO:tasks.workunit.client.1.smithi150.stdout:3/912: dwrite d6/d9/d43/d47/d94/df1/f122 [0,4194304] 0 2023-12-05T09:57:45.848 INFO:tasks.workunit.client.1.smithi150.stdout:3/913: creat d6/d9/d3d/d56/d71/db6/dc1/d67/f126 x:0 0 0 2023-12-05T09:57:45.848 INFO:tasks.workunit.client.1.smithi150.stdout:3/914: read - d6/d22/d37/da1/fa7 zero size 2023-12-05T09:57:45.852 INFO:tasks.workunit.client.1.smithi150.stdout:5/900: mkdir d1/d7f/d65/d3b/d8d/d13a 0 2023-12-05T09:57:45.858 INFO:tasks.workunit.client.1.smithi150.stdout:7/916: unlink d2/db/d30/ca 0 2023-12-05T09:57:45.858 INFO:tasks.workunit.client.1.smithi150.stdout:7/917: stat d2/db/lc0 0 2023-12-05T09:57:45.868 INFO:tasks.workunit.client.0.smithi100.stdout:2/971: dread d7/da/d18/d1b/d2c/d3f/d98/fc7 [0,4194304] 0 2023-12-05T09:57:45.869 INFO:tasks.workunit.client.0.smithi100.stdout:8/852: write d0/db7/de2/fb2 [2280735,46007] 0 2023-12-05T09:57:45.873 INFO:tasks.workunit.client.0.smithi100.stdout:2/972: mkdir d7/da/ddc/d143 0 2023-12-05T09:57:45.876 INFO:tasks.workunit.client.0.smithi100.stdout:8/853: mknod d0/d12/d13/d45/cfa 0 2023-12-05T09:57:45.878 INFO:tasks.workunit.client.0.smithi100.stdout:2/973: fdatasync d7/da/d18/d1b/d2c/d3f/d72/d9d/f107 0 2023-12-05T09:57:45.881 INFO:tasks.workunit.client.0.smithi100.stdout:4/811: dwrite de/d16/fc0 [0,4194304] 0 2023-12-05T09:57:45.881 INFO:tasks.workunit.client.0.smithi100.stdout:4/812: dread - de/d16/d23/d60/df7/d4e/d80/f8a zero size 2023-12-05T09:57:45.881 INFO:tasks.workunit.client.0.smithi100.stdout:8/854: symlink d0/d12/d13/d45/dba/dbd/d72/d9f/dde/lfb 0 2023-12-05T09:57:45.881 INFO:tasks.workunit.client.0.smithi100.stdout:4/813: write de/d38/f42 [1921851,63050] 0 2023-12-05T09:57:45.881 INFO:tasks.workunit.client.0.smithi100.stdout:8/855: dread - d0/d12/f78 zero size 2023-12-05T09:57:45.881 INFO:tasks.workunit.client.0.smithi100.stdout:8/856: chown d0/d12/d13/d16/d42/c67 2056315 1 2023-12-05T09:57:45.881 INFO:tasks.workunit.client.0.smithi100.stdout:8/857: dread - d0/d12/d13/d45/da6/fe9 zero size 2023-12-05T09:57:45.883 INFO:tasks.workunit.client.1.smithi150.stdout:6/800: creat d2/d23/d2e/d44/f107 x:0 0 0 2023-12-05T09:57:45.886 INFO:tasks.workunit.client.1.smithi150.stdout:3/915: link d6/d9/d3d/d56/d53/d51/f105 d6/d9/d43/d47/d94/f127 0 2023-12-05T09:57:45.889 INFO:tasks.workunit.client.0.smithi100.stdout:4/814: mkdir de/d16/d23/d60/df7/d4e/d85/d107/d10a 0 2023-12-05T09:57:45.890 INFO:tasks.workunit.client.1.smithi150.stdout:5/901: creat d1/d7f/d65/d3b/d6b/d11e/dca/f13b x:0 0 0 2023-12-05T09:57:45.893 INFO:tasks.workunit.client.0.smithi100.stdout:8/858: mknod d0/db7/cfc 0 2023-12-05T09:57:45.895 INFO:tasks.workunit.client.1.smithi150.stdout:6/801: rename d2/d23/f45 to d2/d23/d2e/d44/f108 0 2023-12-05T09:57:45.901 INFO:tasks.workunit.client.1.smithi150.stdout:8/955: dwrite d0/d41/d49/dd3/fd6 [0,4194304] 0 2023-12-05T09:57:45.901 INFO:tasks.workunit.client.1.smithi150.stdout:8/956: readlink d0/d41/d49/d1b/d24/d34/d56/d67/l80 0 2023-12-05T09:57:45.901 INFO:tasks.workunit.client.1.smithi150.stdout:8/957: chown d0/da1/dfb/d110 10325 1 2023-12-05T09:57:45.901 INFO:tasks.workunit.client.1.smithi150.stdout:8/958: creat d0/da1/dfb/d110/f131 x:0 0 0 2023-12-05T09:57:45.901 INFO:tasks.workunit.client.1.smithi150.stdout:8/959: write d0/d41/d49/d1b/d24/d34/d56/d67/f6c [866977,46898] 0 2023-12-05T09:57:45.901 INFO:tasks.workunit.client.1.smithi150.stdout:8/960: readlink d0/d41/d49/d1b/d24/d5b/d87/lb7 0 2023-12-05T09:57:45.904 INFO:tasks.workunit.client.1.smithi150.stdout:3/916: link d6/d9/c10 d6/d25/c128 0 2023-12-05T09:57:45.905 INFO:tasks.workunit.client.0.smithi100.stdout:3/939: dwrite d0/d3d/d5c/d6f/d7f/d87/f9a [4194304,4194304] 0 2023-12-05T09:57:45.905 INFO:tasks.workunit.client.0.smithi100.stdout:5/933: dwrite d0/fcf [0,4194304] 0 2023-12-05T09:57:45.905 INFO:tasks.workunit.client.0.smithi100.stdout:4/815: rmdir de/d66/df9 39 2023-12-05T09:57:45.908 INFO:tasks.workunit.client.0.smithi100.stdout:9/912: dwrite d7/d20/d69/def/da2/fa8 [0,4194304] 0 2023-12-05T09:57:45.909 INFO:tasks.workunit.client.1.smithi150.stdout:5/902: symlink d1/d2e/da6/d24/d59/d104/l13c 0 2023-12-05T09:57:45.910 INFO:tasks.workunit.client.1.smithi150.stdout:5/903: truncate d1/d7f/d65/d3b/d37/f70 1366488 0 2023-12-05T09:57:45.914 INFO:tasks.workunit.client.1.smithi150.stdout:6/802: symlink d2/d23/d3b/d64/d7a/d5d/dcd/l109 0 2023-12-05T09:57:45.914 INFO:tasks.workunit.client.1.smithi150.stdout:6/803: fdatasync d2/d23/d2e/d5f/d99/fac 0 2023-12-05T09:57:45.914 INFO:tasks.workunit.client.1.smithi150.stdout:6/804: creat d2/d23/d2e/f10a x:0 0 0 2023-12-05T09:57:45.915 INFO:tasks.workunit.client.1.smithi150.stdout:6/805: dread - d2/d23/d3b/d64/d7a/d5d/de0/fe3 zero size 2023-12-05T09:57:45.915 INFO:tasks.workunit.client.1.smithi150.stdout:6/806: write d2/d23/d2e/f3c [5066071,126856] 0 2023-12-05T09:57:45.915 INFO:tasks.workunit.client.1.smithi150.stdout:6/807: read - d2/d23/d2e/d5f/fdb zero size 2023-12-05T09:57:45.915 INFO:tasks.workunit.client.1.smithi150.stdout:6/808: fsync d2/d23/d2e/d44/f50 0 2023-12-05T09:57:45.915 INFO:tasks.workunit.client.1.smithi150.stdout:6/809: stat d2/d23/d2e/f10a 0 2023-12-05T09:57:45.917 INFO:tasks.workunit.client.1.smithi150.stdout:4/828: getdents d0/d3e/d48/dbb/dca/dee 0 2023-12-05T09:57:45.917 INFO:tasks.workunit.client.1.smithi150.stdout:4/829: dread - d0/d3e/d6d/ddf/fd6 zero size 2023-12-05T09:57:45.924 INFO:tasks.workunit.client.1.smithi150.stdout:8/961: rmdir d0/d41/d49/d1b/d24/d34 39 2023-12-05T09:57:45.926 INFO:tasks.workunit.client.1.smithi150.stdout:3/917: mkdir d6/d9/d3d/d56/d129 0 2023-12-05T09:57:45.929 INFO:tasks.workunit.client.0.smithi100.stdout:0/842: dwrite da/d1b/d6b/f6c [0,4194304] 0 2023-12-05T09:57:45.929 INFO:tasks.workunit.client.1.smithi150.stdout:7/918: dwrite d2/db/d30/d13/f37 [8388608,4194304] 0 2023-12-05T09:57:45.930 INFO:tasks.workunit.client.1.smithi150.stdout:5/904: truncate d1/d64/d31/f49 1202860 0 2023-12-05T09:57:45.932 INFO:tasks.workunit.client.0.smithi100.stdout:2/974: dwrite d7/da/d13/f4a [0,4194304] 0 2023-12-05T09:57:45.933 INFO:tasks.workunit.client.1.smithi150.stdout:6/810: getdents d2/d23/d3b/d64/d7a/d8c 0 2023-12-05T09:57:45.933 INFO:tasks.workunit.client.1.smithi150.stdout:6/811: write d2/d23/d2e/d5f/d99/fac [5130531,36552] 0 2023-12-05T09:57:45.933 INFO:tasks.workunit.client.1.smithi150.stdout:6/812: write d2/d23/d3b/df0/fc2 [2980016,114858] 0 2023-12-05T09:57:45.937 INFO:tasks.workunit.client.1.smithi150.stdout:8/962: creat d0/f132 x:0 0 0 2023-12-05T09:57:45.939 INFO:tasks.workunit.client.1.smithi150.stdout:4/830: dread d0/d3e/d48/f9e [4194304,4194304] 0 2023-12-05T09:57:45.939 INFO:tasks.workunit.client.1.smithi150.stdout:4/831: readlink d0/d3e/d6d/d4b/l7e 0 2023-12-05T09:57:45.939 INFO:tasks.workunit.client.1.smithi150.stdout:4/832: chown d0/d3e/d6d/ddf/da4/cf5 31579430 1 2023-12-05T09:57:45.940 INFO:tasks.workunit.client.1.smithi150.stdout:3/918: rename d6/d9/d3d/f9f to d6/d9/d43/d47/d94/df1/d10b/f12a 0 2023-12-05T09:57:45.940 INFO:tasks.workunit.client.1.smithi150.stdout:3/919: read d6/d9/d3d/d56/d79/ffe [176245,23099] 0 2023-12-05T09:57:45.940 INFO:tasks.workunit.client.1.smithi150.stdout:3/920: readlink d6/d9/d43/d47/d94/l112 0 2023-12-05T09:57:45.944 INFO:tasks.workunit.client.0.smithi100.stdout:8/859: creat d0/d12/d13/d45/da6/d76/d91/ffd x:0 0 0 2023-12-05T09:57:45.962 INFO:tasks.workunit.client.1.smithi150.stdout:7/919: creat d2/db/d30/daf/dd3/d2b/dd2/f12f x:0 0 0 2023-12-05T09:57:45.963 INFO:tasks.workunit.client.1.smithi150.stdout:7/920: write d2/db/d30/d18/f6c [870598,27464] 0 2023-12-05T09:57:45.967 INFO:tasks.workunit.client.0.smithi100.stdout:5/934: link d0/d1b/d4d/d8e/c13b d0/d1f/da1/d11b/df/d51/c14b 0 2023-12-05T09:57:45.967 INFO:tasks.workunit.client.0.smithi100.stdout:5/935: truncate d0/d1b/d4d/ff7 111007 0 2023-12-05T09:57:45.967 INFO:tasks.workunit.client.0.smithi100.stdout:5/936: write d0/d27/dc0/f140 [464027,103777] 0 2023-12-05T09:57:45.967 INFO:tasks.workunit.client.0.smithi100.stdout:5/937: chown d0/d1f/d25/c71 86804121 1 2023-12-05T09:57:45.967 INFO:tasks.workunit.client.0.smithi100.stdout:5/938: chown d0/d16/l3d 10 1 2023-12-05T09:57:45.969 INFO:tasks.workunit.client.1.smithi150.stdout:4/833: dread d0/d3e/d5b/f9b [0,4194304] 0 2023-12-05T09:57:45.969 INFO:tasks.workunit.client.1.smithi150.stdout:4/834: truncate d0/d3e/d5b/fb4 425638 0 2023-12-05T09:57:45.972 INFO:tasks.workunit.client.0.smithi100.stdout:3/940: rename d0/d3d/dfc/d10d/c118 to d0/d3d/d5c/d139/de/db8/dee/c146 0 2023-12-05T09:57:45.974 INFO:tasks.workunit.client.1.smithi150.stdout:9/847: sync 2023-12-05T09:57:45.974 INFO:tasks.workunit.client.1.smithi150.stdout:9/848: read d3/d9/d6e/f8a [125697,40290] 0 2023-12-05T09:57:45.976 INFO:tasks.workunit.client.1.smithi150.stdout:9/849: write d3/fc2 [274263,100498] 0 2023-12-05T09:57:45.976 INFO:tasks.workunit.client.1.smithi150.stdout:9/850: truncate d3/d9/d6e/d76/f9f 766254 0 2023-12-05T09:57:45.980 INFO:tasks.workunit.client.1.smithi150.stdout:6/813: creat d2/d23/d3b/ded/f10b x:0 0 0 2023-12-05T09:57:45.985 INFO:tasks.workunit.client.1.smithi150.stdout:8/963: mknod d0/d41/d49/c133 0 2023-12-05T09:57:45.985 INFO:tasks.workunit.client.1.smithi150.stdout:8/964: chown d0/d41/d49/d1b/fc5 502167 1 2023-12-05T09:57:45.985 INFO:tasks.workunit.client.1.smithi150.stdout:8/965: write d0/d41/d49/d1b/d24/d34/d56/fe7 [795528,129789] 0 2023-12-05T09:57:45.990 INFO:tasks.workunit.client.0.smithi100.stdout:2/975: mknod d7/da/d18/d1b/c144 0 2023-12-05T09:57:45.990 INFO:tasks.workunit.client.0.smithi100.stdout:4/816: dwrite de/d16/d23/d33/d51/fb3 [0,4194304] 0 2023-12-05T09:57:45.994 INFO:tasks.workunit.client.0.smithi100.stdout:5/939: mkdir d0/d1b/d4d/d8e/d96/d14c 0 2023-12-05T09:57:46.000 INFO:tasks.workunit.client.1.smithi150.stdout:6/814: truncate d2/d23/d3b/df0/d97/f98 671197 0 2023-12-05T09:57:46.000 INFO:tasks.workunit.client.0.smithi100.stdout:2/976: truncate d7/da/d18/d21/d4d/d81/f50 2655469 0 2023-12-05T09:57:46.005 INFO:tasks.workunit.client.0.smithi100.stdout:3/941: dread d0/d10/d39/f133 [0,4194304] 0 2023-12-05T09:57:46.006 INFO:tasks.workunit.client.0.smithi100.stdout:4/817: rename de/d16/d23/d36/f6a to de/d16/d23/d60/d98/da6/f10b 0 2023-12-05T09:57:46.009 INFO:tasks.workunit.client.0.smithi100.stdout:0/843: dwrite da/d22/f23 [0,4194304] 0 2023-12-05T09:57:46.013 INFO:tasks.workunit.client.1.smithi150.stdout:3/921: dwrite d6/d9/f57 [0,4194304] 0 2023-12-05T09:57:46.024 INFO:tasks.workunit.client.1.smithi150.stdout:2/943: sync 2023-12-05T09:57:46.025 INFO:tasks.workunit.client.0.smithi100.stdout:4/818: fsync de/f12 0 2023-12-05T09:57:46.026 INFO:tasks.workunit.client.0.smithi100.stdout:8/860: dwrite d0/d12/d13/d45/da6/d9c/fc4 [0,4194304] 0 2023-12-05T09:57:46.027 INFO:tasks.workunit.client.1.smithi150.stdout:3/922: mkdir d6/d9/d3d/d56/d30/d12b 0 2023-12-05T09:57:46.028 INFO:tasks.workunit.client.0.smithi100.stdout:2/977: dread d7/da/d18/d1b/f28 [4194304,4194304] 0 2023-12-05T09:57:46.028 INFO:tasks.workunit.client.0.smithi100.stdout:2/978: fsync d7/da/d18/fce 0 2023-12-05T09:57:46.029 INFO:tasks.workunit.client.0.smithi100.stdout:3/942: rename d0/d3d/d5c/d139/de/d8d/l11c to d0/d3d/d5c/d6f/d7f/d135/l147 0 2023-12-05T09:57:46.029 INFO:tasks.workunit.client.0.smithi100.stdout:3/943: write d0/d3d/d5c/d139/de/d11/db5/f11d [870837,120040] 0 2023-12-05T09:57:46.031 INFO:tasks.workunit.client.1.smithi150.stdout:2/944: truncate d0/d3/f70 914829 0 2023-12-05T09:57:46.033 INFO:tasks.workunit.client.0.smithi100.stdout:0/844: creat da/d22/d33/d74/dca/db4/f103 x:0 0 0 2023-12-05T09:57:46.035 INFO:tasks.workunit.client.1.smithi150.stdout:4/835: dwrite d0/f30 [0,4194304] 0 2023-12-05T09:57:46.039 INFO:tasks.workunit.client.0.smithi100.stdout:8/861: mkdir d0/d35/d64/d81/d9a/dfe 0 2023-12-05T09:57:46.040 INFO:tasks.workunit.client.0.smithi100.stdout:2/979: creat d7/da/ddc/d143/f145 x:0 0 0 2023-12-05T09:57:46.040 INFO:tasks.workunit.client.0.smithi100.stdout:2/980: readlink d7/da/d18/d1b/l2f 0 2023-12-05T09:57:46.042 INFO:tasks.workunit.client.1.smithi150.stdout:2/945: rmdir d0/d3/d27/dea/d112 39 2023-12-05T09:57:46.044 INFO:tasks.workunit.client.1.smithi150.stdout:8/966: dwrite d0/d41/d49/d1b/fa4 [4194304,4194304] 0 2023-12-05T09:57:46.044 INFO:tasks.workunit.client.0.smithi100.stdout:4/819: rename de/d16/f83 to de/d16/dc8/f10c 0 2023-12-05T09:57:46.046 INFO:tasks.workunit.client.0.smithi100.stdout:3/944: link d0/d3d/d5c/f144 d0/d48/f148 0 2023-12-05T09:57:46.048 INFO:tasks.workunit.client.1.smithi150.stdout:2/946: unlink d0/d3/d21/d4d/deb/d103/d15/cd1 0 2023-12-05T09:57:46.048 INFO:tasks.workunit.client.1.smithi150.stdout:2/947: readlink d0/d3/d27/dac/l12f 0 2023-12-05T09:57:46.048 INFO:tasks.workunit.client.1.smithi150.stdout:2/948: write d0/d3/d21/d4d/deb/d103/d15/d30/f89 [786860,113048] 0 2023-12-05T09:57:46.049 INFO:tasks.workunit.client.1.smithi150.stdout:2/949: stat d0/d3/d21/d4d/deb/l78 0 2023-12-05T09:57:46.051 INFO:tasks.workunit.client.0.smithi100.stdout:8/862: rename d0/d12/d13/d45/dba/dbd/d72/da9 to d0/d12/d13/d16/da3/dff 0 2023-12-05T09:57:46.053 INFO:tasks.workunit.client.1.smithi150.stdout:3/923: dread d6/d9/f1b [0,4194304] 0 2023-12-05T09:57:46.053 INFO:tasks.workunit.client.1.smithi150.stdout:8/967: mkdir d0/d41/d49/d1b/d24/d38/d134 0 2023-12-05T09:57:46.054 INFO:tasks.workunit.client.1.smithi150.stdout:9/851: dwrite d3/d9/d58/f7e [0,4194304] 0 2023-12-05T09:57:46.054 INFO:tasks.workunit.client.0.smithi100.stdout:4/820: symlink de/d16/d23/d60/d98/da6/l10d 0 2023-12-05T09:57:46.058 INFO:tasks.workunit.client.0.smithi100.stdout:8/863: symlink d0/d12/d13/d45/dba/l100 0 2023-12-05T09:57:46.058 INFO:tasks.workunit.client.0.smithi100.stdout:8/864: truncate d0/d35/fd2 614996 0 2023-12-05T09:57:46.059 INFO:tasks.workunit.client.1.smithi150.stdout:2/950: symlink d0/d3/d27/d51/l142 0 2023-12-05T09:57:46.060 INFO:tasks.workunit.client.1.smithi150.stdout:8/968: creat d0/d41/d49/dd3/f135 x:0 0 0 2023-12-05T09:57:46.061 INFO:tasks.workunit.client.0.smithi100.stdout:9/913: dwrite d7/d1b/d22/d51/f2d [4194304,4194304] 0 2023-12-05T09:57:46.066 INFO:tasks.workunit.client.0.smithi100.stdout:4/821: link de/d16/d23/f29 de/d16/d23/d60/df7/f10e 0 2023-12-05T09:57:46.067 INFO:tasks.workunit.client.0.smithi100.stdout:4/822: stat de/d16/d23/d60/df7/fe6 0 2023-12-05T09:57:46.067 INFO:tasks.workunit.client.0.smithi100.stdout:4/823: creat de/d16/d23/d33/dae/dd1/f10f x:0 0 0 2023-12-05T09:57:46.067 INFO:tasks.workunit.client.1.smithi150.stdout:9/852: creat d3/d9/dc/d1f/d24/d75/d95/d9a/dcb/de4/f112 x:0 0 0 2023-12-05T09:57:46.077 INFO:tasks.workunit.client.1.smithi150.stdout:3/924: read d6/d9/d3d/d11e/d109/f4d [5350790,39335] 0 2023-12-05T09:57:46.077 INFO:tasks.workunit.client.1.smithi150.stdout:1/927: sync 2023-12-05T09:57:46.077 INFO:tasks.workunit.client.1.smithi150.stdout:9/853: mknod d3/d9/d6e/d76/c113 0 2023-12-05T09:57:46.077 INFO:tasks.workunit.client.1.smithi150.stdout:1/928: write d6/d47/d4c/dd9/ffd [80961,48378] 0 2023-12-05T09:57:46.077 INFO:tasks.workunit.client.1.smithi150.stdout:9/854: fsync d3/d1b/d46/d55/d64/fa6 0 2023-12-05T09:57:46.077 INFO:tasks.workunit.client.1.smithi150.stdout:1/929: truncate d6/d47/f12a 848305 0 2023-12-05T09:57:46.077 INFO:tasks.workunit.client.1.smithi150.stdout:7/921: dwrite d2/d72/d82/f10d [0,4194304] 0 2023-12-05T09:57:46.081 INFO:tasks.workunit.client.1.smithi150.stdout:6/815: dwrite d2/f13 [0,4194304] 0 2023-12-05T09:57:46.083 INFO:tasks.workunit.client.0.smithi100.stdout:4/824: rmdir de 39 2023-12-05T09:57:46.083 INFO:tasks.workunit.client.0.smithi100.stdout:4/825: truncate de/f12 8730726 0 2023-12-05T09:57:46.086 INFO:tasks.workunit.client.0.smithi100.stdout:5/940: dwrite d0/d1f/f86 [0,4194304] 0 2023-12-05T09:57:46.086 INFO:tasks.workunit.client.0.smithi100.stdout:8/865: dread d0/d12/d13/d45/da6/d76/d91/faa [0,4194304] 0 2023-12-05T09:57:46.087 INFO:tasks.workunit.client.0.smithi100.stdout:9/914: mkdir d7/d1b/d22/d51/d147 0 2023-12-05T09:57:46.087 INFO:tasks.workunit.client.0.smithi100.stdout:9/915: dread - d7/d1b/d22/d2a/d56/d9c/f12f zero size 2023-12-05T09:57:46.087 INFO:tasks.workunit.client.0.smithi100.stdout:9/916: stat d7/d35/d71/d9a/dcd/d122 0 2023-12-05T09:57:46.088 INFO:tasks.workunit.client.0.smithi100.stdout:9/917: fdatasync d7/d20/f3a 0 2023-12-05T09:57:46.091 INFO:tasks.workunit.client.0.smithi100.stdout:5/941: creat d0/d1f/da1/d11b/df/d51/da8/dee/f14d x:0 0 0 2023-12-05T09:57:46.092 INFO:tasks.workunit.client.1.smithi150.stdout:3/925: stat d6/d9/d3d/d56/l84 0 2023-12-05T09:57:46.092 INFO:tasks.workunit.client.1.smithi150.stdout:3/926: chown d6/d9/f57 2605 1 2023-12-05T09:57:46.094 INFO:tasks.workunit.client.1.smithi150.stdout:9/855: mknod d3/d9/dc/d1f/d24/d75/d95/d9a/dcb/de4/def/c114 0 2023-12-05T09:57:46.094 INFO:tasks.workunit.client.1.smithi150.stdout:1/930: creat d6/d3c/d131/f145 x:0 0 0 2023-12-05T09:57:46.096 INFO:tasks.workunit.client.1.smithi150.stdout:6/816: rmdir d2/d23/d2e/d44/da0 39 2023-12-05T09:57:46.097 INFO:tasks.workunit.client.1.smithi150.stdout:6/817: dread - d2/d23/d3b/d64/d7a/d5d/f82 zero size 2023-12-05T09:57:46.099 INFO:tasks.workunit.client.0.smithi100.stdout:2/981: rename d7/da/d18/d1b to d7/d61/d12a/d146 0 2023-12-05T09:57:46.099 INFO:tasks.workunit.client.0.smithi100.stdout:4/826: dread de/d16/d23/d36/dfe/f9e [0,4194304] 0 2023-12-05T09:57:46.099 INFO:tasks.workunit.client.0.smithi100.stdout:4/827: read - de/d16/d23/d60/dc4/ff5 zero size 2023-12-05T09:57:46.100 INFO:tasks.workunit.client.1.smithi150.stdout:4/836: dwrite d0/d3e/d6d/ddf/da4/dd7/f97 [4194304,4194304] 0 2023-12-05T09:57:46.102 INFO:tasks.workunit.client.0.smithi100.stdout:2/982: truncate d7/d61/d12a/d146/d2c/d3f/d72/d9d/f107 612744 0 2023-12-05T09:57:46.102 INFO:tasks.workunit.client.1.smithi150.stdout:1/931: rmdir d6/d47/d4c/dd9/d75/ddd 39 2023-12-05T09:57:46.102 INFO:tasks.workunit.client.1.smithi150.stdout:9/856: dread d3/d9/d58/fa9 [0,4194304] 0 2023-12-05T09:57:46.105 INFO:tasks.workunit.client.0.smithi100.stdout:0/845: dwrite da/d22/d33/d74/dca/db4/f103 [0,4194304] 0 2023-12-05T09:57:46.105 INFO:tasks.workunit.client.0.smithi100.stdout:0/846: chown da/d22/d33/d7f/d87/cd3 17412981 1 2023-12-05T09:57:46.105 INFO:tasks.workunit.client.0.smithi100.stdout:8/866: rename d0/d12/d13/d45/dba/dbd/d72/l9e to d0/d12/d13/d45/dc9/l101 0 2023-12-05T09:57:46.106 INFO:tasks.workunit.client.1.smithi150.stdout:7/922: dread d2/db/d30/d18/d1a/faa [0,4194304] 0 2023-12-05T09:57:46.113 INFO:tasks.workunit.client.0.smithi100.stdout:9/918: read d7/d1b/d22/d2a/d56/f5c [3278510,124333] 0 2023-12-05T09:57:46.115 INFO:tasks.workunit.client.0.smithi100.stdout:2/983: unlink d7/da/da7/dd6/cf4 0 2023-12-05T09:57:46.123 INFO:tasks.workunit.client.1.smithi150.stdout:9/857: creat d3/d42/f115 x:0 0 0 2023-12-05T09:57:46.123 INFO:tasks.workunit.client.1.smithi150.stdout:4/837: write d0/d3e/d48/fdb [646926,6402] 0 2023-12-05T09:57:46.127 INFO:tasks.workunit.client.0.smithi100.stdout:8/867: read d0/d12/d13/d45/f58 [2802213,124186] 0 2023-12-05T09:57:46.127 INFO:tasks.workunit.client.0.smithi100.stdout:8/868: dread - d0/d12/d13/d45/dba/dbd/d72/fe8 zero size 2023-12-05T09:57:46.128 INFO:tasks.workunit.client.0.smithi100.stdout:8/869: write d0/d35/f8a [1009149,57666] 0 2023-12-05T09:57:46.128 INFO:tasks.workunit.client.0.smithi100.stdout:8/870: stat d0/db7/dcf/cdc 0 2023-12-05T09:57:46.128 INFO:tasks.workunit.client.0.smithi100.stdout:8/871: write d0/d12/d13/d16/d42/d43/fad [823960,37725] 0 2023-12-05T09:57:46.129 INFO:tasks.workunit.client.1.smithi150.stdout:3/927: dread d6/d9/d3d/d56/d71/db6/dc1/f96 [0,4194304] 0 2023-12-05T09:57:46.129 INFO:tasks.workunit.client.0.smithi100.stdout:7/829: sync 2023-12-05T09:57:46.129 INFO:tasks.workunit.client.0.smithi100.stdout:1/851: sync 2023-12-05T09:57:46.129 INFO:tasks.workunit.client.0.smithi100.stdout:7/830: write d3/dc/fa6 [997503,116757] 0 2023-12-05T09:57:46.130 INFO:tasks.workunit.client.0.smithi100.stdout:1/852: write db/d12/d1e/fa2 [629808,85413] 0 2023-12-05T09:57:46.130 INFO:tasks.workunit.client.0.smithi100.stdout:1/853: chown db/d12/d1e/lb0 2 1 2023-12-05T09:57:46.133 INFO:tasks.workunit.client.0.smithi100.stdout:5/942: rename d0/d16/d37/f146 to d0/d1b/d4d/d8e/d96/dc1/dae/db9/dcb/f14e 0 2023-12-05T09:57:46.133 INFO:tasks.workunit.client.0.smithi100.stdout:5/943: read - d0/d1f/da1/d11b/df/d51/da8/dee/f14d zero size 2023-12-05T09:57:46.138 INFO:tasks.workunit.client.0.smithi100.stdout:9/919: chown d7/d1b/d22/d51/d32/le6 453267 1 2023-12-05T09:57:46.138 INFO:tasks.workunit.client.0.smithi100.stdout:9/920: read d7/d20/fe0 [14669,68337] 0 2023-12-05T09:57:46.138 INFO:tasks.workunit.client.0.smithi100.stdout:9/921: write d7/d60/fcc [2246369,53172] 0 2023-12-05T09:57:46.142 INFO:tasks.workunit.client.0.smithi100.stdout:0/847: write da/d2a/d45/f97 [2476983,110874] 0 2023-12-05T09:57:46.145 INFO:tasks.workunit.client.1.smithi150.stdout:2/951: dwrite d0/d3/d21/d4d/deb/d103/d15/d30/d54/d57/fab [0,4194304] 0 2023-12-05T09:57:46.145 INFO:tasks.workunit.client.1.smithi150.stdout:2/952: stat d0/d3/d21/d4d/deb/d103/l9c 0 2023-12-05T09:57:46.145 INFO:tasks.workunit.client.1.smithi150.stdout:7/923: rename d2/db/d30/daf/dd3/d2b/dd2/f12f to d2/db/d2e/d71/df2/f130 0 2023-12-05T09:57:46.148 INFO:tasks.workunit.client.0.smithi100.stdout:2/984: symlink d7/da/d18/d21/d4d/d81/l147 0 2023-12-05T09:57:46.153 INFO:tasks.workunit.client.0.smithi100.stdout:1/854: dread db/d12/fb1 [0,4194304] 0 2023-12-05T09:57:46.153 INFO:tasks.workunit.client.0.smithi100.stdout:1/855: stat db/d12/d1e/dd3/db8/de7/l105 0 2023-12-05T09:57:46.154 INFO:tasks.workunit.client.1.smithi150.stdout:6/818: dwrite d2/d23/d2e/d5f/d99/dd8/ff2 [0,4194304] 0 2023-12-05T09:57:46.154 INFO:tasks.workunit.client.0.smithi100.stdout:8/872: unlink d0/d12/d13/d45/la8 0 2023-12-05T09:57:46.156 INFO:tasks.workunit.client.0.smithi100.stdout:1/856: fsync db/d31/d3a/f9a 0 2023-12-05T09:57:46.164 INFO:tasks.workunit.client.1.smithi150.stdout:9/858: dread d3/d1b/d46/d55/ff5 [0,4194304] 0 2023-12-05T09:57:46.168 INFO:tasks.workunit.client.0.smithi100.stdout:9/922: unlink d7/d1b/d22/l82 0 2023-12-05T09:57:46.170 INFO:tasks.workunit.client.0.smithi100.stdout:3/945: write d0/d4/f4a [3122052,64059] 0 2023-12-05T09:57:46.172 INFO:tasks.workunit.client.1.smithi150.stdout:2/953: rmdir d0/d3/d5/d22/d52/d5a/d108/d114 39 2023-12-05T09:57:46.172 INFO:tasks.workunit.client.1.smithi150.stdout:2/954: dread - d0/d3/d21/d4d/deb/d103/f101 zero size 2023-12-05T09:57:46.172 INFO:tasks.workunit.client.1.smithi150.stdout:2/955: readlink d0/d3/d5/l74 0 2023-12-05T09:57:46.176 INFO:tasks.workunit.client.0.smithi100.stdout:5/944: dread d0/d16/d2b/fa4 [0,4194304] 0 2023-12-05T09:57:46.179 INFO:tasks.workunit.client.0.smithi100.stdout:0/848: mknod da/d2a/d45/de3/c104 0 2023-12-05T09:57:46.179 INFO:tasks.workunit.client.0.smithi100.stdout:0/849: stat da/d22/d33/d35/d3a/f83 0 2023-12-05T09:57:46.180 INFO:tasks.workunit.client.1.smithi150.stdout:1/932: dwrite f4 [0,4194304] 0 2023-12-05T09:57:46.181 INFO:tasks.workunit.client.1.smithi150.stdout:7/924: mknod d2/d72/db2/c131 0 2023-12-05T09:57:46.187 INFO:tasks.workunit.client.0.smithi100.stdout:8/873: mknod d0/d12/d52/c102 0 2023-12-05T09:57:46.187 INFO:tasks.workunit.client.0.smithi100.stdout:8/874: readlink d0/d12/d13/d45/l95 0 2023-12-05T09:57:46.195 INFO:tasks.workunit.client.0.smithi100.stdout:9/923: getdents d7/d1b/d22/d51/d32 0 2023-12-05T09:57:46.195 INFO:tasks.workunit.client.0.smithi100.stdout:9/924: creat d7/d1b/d22/d93/dc9/f148 x:0 0 0 2023-12-05T09:57:46.196 INFO:tasks.workunit.client.1.smithi150.stdout:6/819: mkdir d2/d23/d2e/d5f/d99/dd8/d10c 0 2023-12-05T09:57:46.202 INFO:tasks.workunit.client.0.smithi100.stdout:3/946: getdents d0/d10/d39/dab 0 2023-12-05T09:57:46.202 INFO:tasks.workunit.client.0.smithi100.stdout:3/947: fsync d0/d3d/d5c/d139/de/d11/d7c/dd0/d125/d45/fdf 0 2023-12-05T09:57:46.202 INFO:tasks.workunit.client.0.smithi100.stdout:3/948: write d0/d3d/d5c/d5f/f104 [514950,88485] 0 2023-12-05T09:57:46.202 INFO:tasks.workunit.client.0.smithi100.stdout:4/828: dwrite de/d16/d23/f29 [0,4194304] 0 2023-12-05T09:57:46.202 INFO:tasks.workunit.client.0.smithi100.stdout:4/829: write de/d16/d23/d33/f6b [399637,41298] 0 2023-12-05T09:57:46.202 INFO:tasks.workunit.client.0.smithi100.stdout:7/831: dread d3/dc/d11/d13/de/d18/f11d [0,4194304] 0 2023-12-05T09:57:46.205 INFO:tasks.workunit.client.1.smithi150.stdout:4/838: link d0/f3a d0/d3e/d48/d8a/f100 0 2023-12-05T09:57:46.205 INFO:tasks.workunit.client.1.smithi150.stdout:7/925: write d2/db/d30/d13/f14 [3834336,43968] 0 2023-12-05T09:57:46.206 INFO:tasks.workunit.client.1.smithi150.stdout:4/839: dread - d0/f45 zero size 2023-12-05T09:57:46.206 INFO:tasks.workunit.client.1.smithi150.stdout:4/840: dread - d0/d3e/d6d/ddf/fd6 zero size 2023-12-05T09:57:46.206 INFO:tasks.workunit.client.0.smithi100.stdout:5/945: symlink d0/d1b/d4d/d8e/d96/dea/dff/l14f 0 2023-12-05T09:57:46.206 INFO:tasks.workunit.client.0.smithi100.stdout:5/946: fsync d0/d1f/f86 0 2023-12-05T09:57:46.206 INFO:tasks.workunit.client.0.smithi100.stdout:5/947: chown d0/d1b/d4d/d8e/d125/d14/d35/d62/le1 868897189 1 2023-12-05T09:57:46.208 INFO:tasks.workunit.client.0.smithi100.stdout:1/857: dread db/d12/d61/f64 [0,4194304] 0 2023-12-05T09:57:46.213 INFO:tasks.workunit.client.0.smithi100.stdout:0/850: unlink da/d2a/d4d/c3e 0 2023-12-05T09:57:46.215 INFO:tasks.workunit.client.1.smithi150.stdout:5/905: sync 2023-12-05T09:57:46.224 INFO:tasks.workunit.client.0.smithi100.stdout:3/949: write d0/d3d/d5c/d139/f23 [1530576,57290] 0 2023-12-05T09:57:46.229 INFO:tasks.workunit.client.1.smithi150.stdout:2/956: dwrite d0/d3/d5/d10/d3d/da1/daa/f135 [0,4194304] 0 2023-12-05T09:57:46.230 INFO:tasks.workunit.client.1.smithi150.stdout:2/957: write d0/d3/d21/d4d/deb/f9a [482040,68249] 0 2023-12-05T09:57:46.234 INFO:tasks.workunit.client.0.smithi100.stdout:8/875: rmdir d0/d12/d13/d45/da6/d76/df9 0 2023-12-05T09:57:46.236 INFO:tasks.workunit.client.0.smithi100.stdout:2/985: dwrite d7/da/d18/d21/d4d/f119 [0,4194304] 0 2023-12-05T09:57:46.252 INFO:tasks.workunit.client.1.smithi150.stdout:1/933: rename d6/d47/d4c/d60/f10f to d6/d47/d4c/dd9/d75/d106/f146 0 2023-12-05T09:57:46.252 INFO:tasks.workunit.client.1.smithi150.stdout:1/934: readlink d6/d8/db/d1b/l3a 0 2023-12-05T09:57:46.252 INFO:tasks.workunit.client.1.smithi150.stdout:1/935: fsync d6/d8/d59/fc0 0 2023-12-05T09:57:46.252 INFO:tasks.workunit.client.1.smithi150.stdout:1/936: chown d6/d47/d4c/dd9/d75/ddd/c103 639 1 2023-12-05T09:57:46.252 INFO:tasks.workunit.client.1.smithi150.stdout:1/937: fsync d6/d47/d4c/dd9/daf/fd8 0 2023-12-05T09:57:46.253 INFO:tasks.workunit.client.1.smithi150.stdout:1/938: stat d6/d47/d4c/dd9/f22 0 2023-12-05T09:57:46.253 INFO:tasks.workunit.client.1.smithi150.stdout:6/820: mknod d2/d23/d2e/d5f/d99/dd8/ddf/dfa/c10d 0 2023-12-05T09:57:46.263 INFO:tasks.workunit.client.0.smithi100.stdout:4/830: link f9 de/d16/d23/d60/d88/dc5/f110 0 2023-12-05T09:57:46.263 INFO:tasks.workunit.client.0.smithi100.stdout:4/831: read de/d16/d23/d33/f6b [163522,108548] 0 2023-12-05T09:57:46.264 INFO:tasks.workunit.client.1.smithi150.stdout:4/841: symlink d0/d3e/d5b/d80/da1/l101 0 2023-12-05T09:57:46.265 INFO:tasks.workunit.client.1.smithi150.stdout:4/842: readlink d0/d3e/d5b/d6e/le7 0 2023-12-05T09:57:46.267 INFO:tasks.workunit.client.0.smithi100.stdout:7/832: unlink d3/dc/d11/d13/de/d18/d3b/d40/fde 0 2023-12-05T09:57:46.269 INFO:tasks.workunit.client.1.smithi150.stdout:7/926: creat d2/d9d/da0/f132 x:0 0 0 2023-12-05T09:57:46.271 INFO:tasks.workunit.client.0.smithi100.stdout:5/948: creat d0/d1f/da1/d11b/df/d51/f150 x:0 0 0 2023-12-05T09:57:46.272 INFO:tasks.workunit.client.0.smithi100.stdout:5/949: fsync d0/d1b/d4d/d8e/d125/d14/f123 0 2023-12-05T09:57:46.272 INFO:tasks.workunit.client.0.smithi100.stdout:5/950: fdatasync d0/d1b/d4d/d60/f6d 0 2023-12-05T09:57:46.272 INFO:tasks.workunit.client.0.smithi100.stdout:5/951: chown d0/d16/d2b/f82 3836257 1 2023-12-05T09:57:46.273 INFO:tasks.workunit.client.1.smithi150.stdout:2/958: dwrite d0/d3/d5/d10/d3d/da1/daa/f135 [0,4194304] 0 2023-12-05T09:57:46.273 INFO:tasks.workunit.client.1.smithi150.stdout:9/859: rmdir d3/d9/d26/d9b 39 2023-12-05T09:57:46.277 INFO:tasks.workunit.client.1.smithi150.stdout:5/906: truncate d1/f96 839605 0 2023-12-05T09:57:46.278 INFO:tasks.workunit.client.1.smithi150.stdout:1/939: read d6/d47/d4c/dd9/fd2 [737855,126209] 0 2023-12-05T09:57:46.278 INFO:tasks.workunit.client.1.smithi150.stdout:1/940: dread - d6/d47/d4c/d60/fc8 zero size 2023-12-05T09:57:46.282 INFO:tasks.workunit.client.0.smithi100.stdout:0/851: dwrite da/d22/d33/d35/d3a/fd2 [0,4194304] 0 2023-12-05T09:57:46.282 INFO:tasks.workunit.client.1.smithi150.stdout:9/860: write d3/d1b/f59 [709051,80425] 0 2023-12-05T09:57:46.283 INFO:tasks.workunit.client.0.smithi100.stdout:3/950: creat d0/d3d/d5c/d5f/d67/f149 x:0 0 0 2023-12-05T09:57:46.284 INFO:tasks.workunit.client.0.smithi100.stdout:8/876: mkdir d0/d12/d13/d45/dba/df1/d103 0 2023-12-05T09:57:46.285 INFO:tasks.workunit.client.1.smithi150.stdout:4/843: write d0/d3e/d5b/de4/fda [8140823,31960] 0 2023-12-05T09:57:46.286 INFO:tasks.workunit.client.1.smithi150.stdout:4/844: truncate d0/d3e/d5b/d6e/f88 1392910 0 2023-12-05T09:57:46.286 INFO:tasks.workunit.client.1.smithi150.stdout:4/845: chown d0/d3e/d6d/ddf/da4/dd7/ce9 101 1 2023-12-05T09:57:46.292 INFO:tasks.workunit.client.0.smithi100.stdout:2/986: dwrite d7/da/ddc/d143/f145 [0,4194304] 0 2023-12-05T09:57:46.292 INFO:tasks.workunit.client.0.smithi100.stdout:2/987: readlink d7/da/d13/l1d 0 2023-12-05T09:57:46.292 INFO:tasks.workunit.client.0.smithi100.stdout:7/833: dread d3/dc/d11/d13/de/f74 [0,4194304] 0 2023-12-05T09:57:46.302 INFO:tasks.workunit.client.1.smithi150.stdout:8/969: sync 2023-12-05T09:57:46.302 INFO:tasks.workunit.client.1.smithi150.stdout:8/970: stat d0/d41/d49/d1b/d24/d2e/l3f 0 2023-12-05T09:57:46.302 INFO:tasks.workunit.client.1.smithi150.stdout:9/861: dread d3/d9/dc/d1f/f5f [0,4194304] 0 2023-12-05T09:57:46.306 INFO:tasks.workunit.client.0.smithi100.stdout:8/877: dread d0/d35/f3b [0,4194304] 0 2023-12-05T09:57:46.306 INFO:tasks.workunit.client.0.smithi100.stdout:8/878: fdatasync d0/d35/d64/fa0 0 2023-12-05T09:57:46.309 INFO:tasks.workunit.client.1.smithi150.stdout:6/821: symlink d2/d23/d3b/d64/d7a/d8c/l10e 0 2023-12-05T09:57:46.309 INFO:tasks.workunit.client.1.smithi150.stdout:6/822: stat d2/d23/d2e/d44/da0/ca6 0 2023-12-05T09:57:46.311 INFO:tasks.workunit.client.0.smithi100.stdout:9/925: rmdir d7/d1b/d22/d93/dc9 39 2023-12-05T09:57:46.313 INFO:tasks.workunit.client.0.smithi100.stdout:5/952: symlink d0/d1b/d4d/d8e/d96/dc1/d12e/l151 0 2023-12-05T09:57:46.316 INFO:tasks.workunit.client.1.smithi150.stdout:2/959: symlink d0/d3/d27/dac/d81/l143 0 2023-12-05T09:57:46.322 INFO:tasks.workunit.client.1.smithi150.stdout:5/907: symlink d1/d7f/d65/d3b/l13d 0 2023-12-05T09:57:46.322 INFO:tasks.workunit.client.1.smithi150.stdout:5/908: truncate d1/d3/d6/f1c 4251414 0 2023-12-05T09:57:46.322 INFO:tasks.workunit.client.1.smithi150.stdout:5/909: chown d1/d2e/da6/d24/cc5 744612672 1 2023-12-05T09:57:46.322 INFO:tasks.workunit.client.1.smithi150.stdout:5/910: dread - d1/d7f/d65/d3b/d6b/d11e/fd7 zero size 2023-12-05T09:57:46.324 INFO:tasks.workunit.client.0.smithi100.stdout:0/852: mkdir da/d22/d33/d74/d77/d105 0 2023-12-05T09:57:46.326 INFO:tasks.workunit.client.1.smithi150.stdout:7/927: dwrite d2/db/d30/daf/dd3/d2b/f34 [8388608,4194304] 0 2023-12-05T09:57:46.327 INFO:tasks.workunit.client.1.smithi150.stdout:1/941: rename d6/d38/f43 to d6/d8/d54/d94/df5/f147 0 2023-12-05T09:57:46.328 INFO:tasks.workunit.client.0.smithi100.stdout:4/832: dwrite de/f12 [4194304,4194304] 0 2023-12-05T09:57:46.329 INFO:tasks.workunit.client.0.smithi100.stdout:3/951: creat d0/d3d/dfc/d10d/f14a x:0 0 0 2023-12-05T09:57:46.330 INFO:tasks.workunit.client.0.smithi100.stdout:3/952: write d0/d3d/d5c/d139/de/d8d/fbe [413575,79439] 0 2023-12-05T09:57:46.330 INFO:tasks.workunit.client.1.smithi150.stdout:4/846: creat d0/d3e/d5b/d6e/f102 x:0 0 0 2023-12-05T09:57:46.331 INFO:tasks.workunit.client.0.smithi100.stdout:5/953: read d0/d16/d2b/d75/f85 [6170572,48821] 0 2023-12-05T09:57:46.332 INFO:tasks.workunit.client.1.smithi150.stdout:8/971: mknod d0/d41/d49/d1b/d24/d34/d56/d67/d64/d113/c136 0 2023-12-05T09:57:46.333 INFO:tasks.workunit.client.1.smithi150.stdout:1/942: dread d6/d8/d54/f82 [0,4194304] 0 2023-12-05T09:57:46.338 INFO:tasks.workunit.client.1.smithi150.stdout:9/862: creat d3/d9/dc/d1f/d24/d75/d95/dbc/f116 x:0 0 0 2023-12-05T09:57:46.339 INFO:tasks.workunit.client.0.smithi100.stdout:7/834: mknod d3/dc/d11/c131 0 2023-12-05T09:57:46.340 INFO:tasks.workunit.client.1.smithi150.stdout:3/928: sync 2023-12-05T09:57:46.343 INFO:tasks.workunit.client.0.smithi100.stdout:8/879: mkdir d0/d12/d13/d16/d42/d104 0 2023-12-05T09:57:46.343 INFO:tasks.workunit.client.0.smithi100.stdout:8/880: readlink d0/d12/d13/d16/l83 0 2023-12-05T09:57:46.343 INFO:tasks.workunit.client.0.smithi100.stdout:8/881: write d0/d12/d13/d45/fd1 [2901368,9875] 0 2023-12-05T09:57:46.344 INFO:tasks.workunit.client.1.smithi150.stdout:2/960: creat d0/d3/d27/d95/f144 x:0 0 0 2023-12-05T09:57:46.345 INFO:tasks.workunit.client.1.smithi150.stdout:1/943: dread d6/f95 [0,4194304] 0 2023-12-05T09:57:46.346 INFO:tasks.workunit.client.1.smithi150.stdout:5/911: mkdir d1/d7f/d65/d3b/d6b/d109/d13e 0 2023-12-05T09:57:46.353 INFO:tasks.workunit.client.1.smithi150.stdout:4/847: mknod d0/d3e/d6d/ddf/da4/c103 0 2023-12-05T09:57:46.353 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:46 smithi100 ceph-mon[107145]: pgmap v39: 65 pgs: 65 active+clean; 3.6 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 246 MiB/s rd, 311 MiB/s wr, 447 op/s 2023-12-05T09:57:46.361 INFO:tasks.workunit.client.1.smithi150.stdout:8/972: rmdir d0/d41/d49/d1b/d24 39 2023-12-05T09:57:46.362 INFO:tasks.workunit.client.0.smithi100.stdout:8/882: dread d0/f37 [0,4194304] 0 2023-12-05T09:57:46.364 INFO:tasks.workunit.client.0.smithi100.stdout:5/954: write d0/d16/dc9/fa6 [541467,92946] 0 2023-12-05T09:57:46.365 INFO:tasks.workunit.client.1.smithi150.stdout:9/863: creat d3/d9/d67/f117 x:0 0 0 2023-12-05T09:57:46.376 INFO:tasks.workunit.client.0.smithi100.stdout:0/853: creat da/d22/d33/d35/d3a/de9/f106 x:0 0 0 2023-12-05T09:57:46.378 INFO:tasks.workunit.client.1.smithi150.stdout:3/929: mkdir d6/d25/dcf/d12c 0 2023-12-05T09:57:46.381 INFO:tasks.workunit.client.1.smithi150.stdout:2/961: creat d0/d3/d5/d22/d52/d5a/d108/d114/f145 x:0 0 0 2023-12-05T09:57:46.382 INFO:tasks.workunit.client.1.smithi150.stdout:1/944: rmdir d6/d47/d4c/d60/dc7 39 2023-12-05T09:57:46.384 INFO:tasks.workunit.client.1.smithi150.stdout:5/912: truncate d1/d3/d6/d1b/fa7 1005285 0 2023-12-05T09:57:46.385 INFO:tasks.workunit.client.1.smithi150.stdout:7/928: dwrite d2/db/d30/d18/f6c [0,4194304] 0 2023-12-05T09:57:46.385 INFO:tasks.workunit.client.1.smithi150.stdout:7/929: write d2/db/d30/d13/f14 [3399729,73126] 0 2023-12-05T09:57:46.386 INFO:tasks.workunit.client.0.smithi100.stdout:1/858: dwrite db/d12/d1e/dd3/db8/de7/ff9 [0,4194304] 0 2023-12-05T09:57:46.389 INFO:tasks.workunit.client.1.smithi150.stdout:8/973: unlink d0/d41/d49/d1b/d24/lc7 0 2023-12-05T09:57:46.389 INFO:tasks.workunit.client.1.smithi150.stdout:8/974: write d0/d41/d49/fcb [4753166,58331] 0 2023-12-05T09:57:46.389 INFO:tasks.workunit.client.1.smithi150.stdout:6/823: write d2/d23/d3b/d64/d7a/d5d/dcd/fde [722,85106] 0 2023-12-05T09:57:46.396 INFO:tasks.workunit.client.0.smithi100.stdout:3/953: link d0/d3d/d5c/d139/de/d8d/f141 d0/d10/d39/dab/f14b 0 2023-12-05T09:57:46.396 INFO:tasks.workunit.client.0.smithi100.stdout:4/833: creat de/d16/d23/d60/de3/deb/f111 x:0 0 0 2023-12-05T09:57:46.396 INFO:tasks.workunit.client.0.smithi100.stdout:1/859: dread db/d12/d1e/f9f [0,4194304] 0 2023-12-05T09:57:46.396 INFO:tasks.workunit.client.0.smithi100.stdout:1/860: write db/d31/d3a/d4a/dad/fbf [248870,77027] 0 2023-12-05T09:57:46.398 INFO:tasks.workunit.client.0.smithi100.stdout:7/835: truncate d3/dc/d11/d13/d37/fef 1264634 0 2023-12-05T09:57:46.400 INFO:tasks.workunit.client.0.smithi100.stdout:8/883: mkdir d0/d35/d105 0 2023-12-05T09:57:46.402 INFO:tasks.workunit.client.0.smithi100.stdout:9/926: dwrite d7/d1b/d22/d51/fca [0,4194304] 0 2023-12-05T09:57:46.403 INFO:tasks.workunit.client.0.smithi100.stdout:5/955: creat d0/d1f/da1/d11b/df/f152 x:0 0 0 2023-12-05T09:57:46.404 INFO:tasks.workunit.client.0.smithi100.stdout:0/854: mknod da/d22/d33/d74/c107 0 2023-12-05T09:57:46.409 INFO:tasks.workunit.client.0.smithi100.stdout:3/954: fdatasync d0/d3d/d5c/d139/de/d12/f29 0 2023-12-05T09:57:46.409 INFO:tasks.workunit.client.1.smithi150.stdout:8/975: write d0/d41/d49/d1b/d24/d34/da2/fc9 [3197459,50387] 0 2023-12-05T09:57:46.410 INFO:tasks.workunit.client.1.smithi150.stdout:2/962: getdents d0/d3/d5/d10/d3d/da1 0 2023-12-05T09:57:46.412 INFO:tasks.workunit.client.1.smithi150.stdout:1/945: mkdir d6/d8/d85/d148 0 2023-12-05T09:57:46.413 INFO:tasks.workunit.client.1.smithi150.stdout:1/946: fdatasync d6/d47/d4c/dd9/fe7 0 2023-12-05T09:57:46.419 INFO:tasks.workunit.client.1.smithi150.stdout:5/913: creat d1/d64/d31/f13f x:0 0 0 2023-12-05T09:57:46.419 INFO:tasks.workunit.client.0.smithi100.stdout:1/861: creat db/d12/d1e/d26/d39/de9/f109 x:0 0 0 2023-12-05T09:57:46.419 INFO:tasks.workunit.client.0.smithi100.stdout:4/834: dread de/d66/fa7 [0,4194304] 0 2023-12-05T09:57:46.419 INFO:tasks.workunit.client.0.smithi100.stdout:1/862: readlink db/d12/d1e/dd3/db8/lc5 0 2023-12-05T09:57:46.422 INFO:tasks.workunit.client.1.smithi150.stdout:7/930: symlink d2/db/d17/d3a/l133 0 2023-12-05T09:57:46.422 INFO:tasks.workunit.client.1.smithi150.stdout:7/931: creat d2/db/d62/f134 x:0 0 0 2023-12-05T09:57:46.426 INFO:tasks.workunit.client.0.smithi100.stdout:9/927: mkdir d7/d1b/d22/d2a/d74/dec/d149 0 2023-12-05T09:57:46.426 INFO:tasks.workunit.client.0.smithi100.stdout:9/928: readlink d7/d1b/d22/d2a/ld4 0 2023-12-05T09:57:46.426 INFO:tasks.workunit.client.0.smithi100.stdout:9/929: creat d7/d1b/d22/d51/d32/d96/f14a x:0 0 0 2023-12-05T09:57:46.428 INFO:tasks.workunit.client.0.smithi100.stdout:5/956: rmdir d0/d1b/d4d/d8e/d96/dc1/dae/db9/ddc 39 2023-12-05T09:57:46.429 INFO:tasks.workunit.client.1.smithi150.stdout:9/864: getdents d3/d9/dc/d1f/d24/d75/d95/dbc/dad/db7 0 2023-12-05T09:57:46.429 INFO:tasks.workunit.client.1.smithi150.stdout:9/865: dread - d3/d9/d67/f117 zero size 2023-12-05T09:57:46.430 INFO:tasks.workunit.client.1.smithi150.stdout:9/866: write d3/fc2 [688634,52992] 0 2023-12-05T09:57:46.432 INFO:tasks.workunit.client.0.smithi100.stdout:0/855: creat da/f108 x:0 0 0 2023-12-05T09:57:46.432 INFO:tasks.workunit.client.1.smithi150.stdout:2/963: truncate d0/d3/d5/d22/fbf 29044 0 2023-12-05T09:57:46.433 INFO:tasks.workunit.client.1.smithi150.stdout:5/914: symlink d1/d64/d31/l140 0 2023-12-05T09:57:46.435 INFO:tasks.workunit.client.0.smithi100.stdout:3/955: link d0/d3d/d5c/d139/de/d11/fad d0/f14c 0 2023-12-05T09:57:46.440 INFO:tasks.workunit.client.1.smithi150.stdout:3/930: dwrite d6/f17 [4194304,4194304] 0 2023-12-05T09:57:46.441 INFO:tasks.workunit.client.1.smithi150.stdout:3/931: chown d6/d9/d8d/f44 46523508 1 2023-12-05T09:57:46.441 INFO:tasks.workunit.client.1.smithi150.stdout:1/947: dread d6/d3c/fd6 [0,4194304] 0 2023-12-05T09:57:46.442 INFO:tasks.workunit.client.0.smithi100.stdout:9/930: mkdir d7/d1b/d22/d2a/d74/d14b 0 2023-12-05T09:57:46.443 INFO:tasks.workunit.client.1.smithi150.stdout:2/964: read d0/d3/f99 [1492123,34092] 0 2023-12-05T09:57:46.445 INFO:tasks.workunit.client.0.smithi100.stdout:5/957: creat d0/d1f/da1/d11b/df/d51/da8/dee/d117/f153 x:0 0 0 2023-12-05T09:57:46.446 INFO:tasks.workunit.client.1.smithi150.stdout:5/915: write d1/d2e/fac [91436,96998] 0 2023-12-05T09:57:46.446 INFO:tasks.workunit.client.1.smithi150.stdout:5/916: write d1/d64/d31/f123 [641953,75538] 0 2023-12-05T09:57:46.447 INFO:tasks.workunit.client.0.smithi100.stdout:0/856: mkdir da/d22/d33/d109 0 2023-12-05T09:57:46.448 INFO:tasks.workunit.client.0.smithi100.stdout:0/857: creat da/d22/d33/d74/dca/f10a x:0 0 0 2023-12-05T09:57:46.448 INFO:tasks.workunit.client.0.smithi100.stdout:0/858: fdatasync da/d22/d33/d74/dca/df1/ff5 0 2023-12-05T09:57:46.448 INFO:tasks.workunit.client.0.smithi100.stdout:0/859: fsync da/d2a/fc3 0 2023-12-05T09:57:46.451 INFO:tasks.workunit.client.1.smithi150.stdout:3/932: mkdir d6/d9/d3d/d56/d71/db6/dc1/d110/d12d 0 2023-12-05T09:57:46.452 INFO:tasks.workunit.client.1.smithi150.stdout:3/933: chown d6/d22/l100 20 1 2023-12-05T09:57:46.452 INFO:tasks.workunit.client.0.smithi100.stdout:5/958: creat d0/d1b/d4d/d8e/d96/dc1/f154 x:0 0 0 2023-12-05T09:57:46.455 INFO:tasks.workunit.client.1.smithi150.stdout:1/948: link d6/d8/d54/d94/ce4 d6/d47/d4c/dd9/daf/d121/d89/c149 0 2023-12-05T09:57:46.458 INFO:tasks.workunit.client.1.smithi150.stdout:2/965: symlink d0/d3/d5/d3b/l146 0 2023-12-05T09:57:46.458 INFO:tasks.workunit.client.1.smithi150.stdout:5/917: mknod d1/d7f/c141 0 2023-12-05T09:57:46.459 INFO:tasks.workunit.client.1.smithi150.stdout:2/966: fdatasync d0/d3/d5/d22/d52/d5a/d108/fba 0 2023-12-05T09:57:46.466 INFO:tasks.workunit.client.1.smithi150.stdout:7/932: dread d2/db/d30/d13/d4f/d5a/d5c/fa5 [0,4194304] 0 2023-12-05T09:57:46.466 INFO:tasks.workunit.client.1.smithi150.stdout:1/949: unlink d6/d8/d54/f82 0 2023-12-05T09:57:46.466 INFO:tasks.workunit.client.1.smithi150.stdout:1/950: getdents d6/d47 0 2023-12-05T09:57:46.470 INFO:tasks.workunit.client.1.smithi150.stdout:1/951: rename d6/d8/db/cd1 to d6/d8/d54/d12b/c14a 0 2023-12-05T09:57:46.470 INFO:tasks.workunit.client.1.smithi150.stdout:1/952: truncate d6/d3c/dc2/fcc 1046390 0 2023-12-05T09:57:46.470 INFO:tasks.workunit.client.1.smithi150.stdout:1/953: stat d6/d8/db/d1b/d79/dca/feb 0 2023-12-05T09:57:46.475 INFO:tasks.workunit.client.1.smithi150.stdout:1/954: unlink d6/d8/db/db1/lbf 0 2023-12-05T09:57:46.475 INFO:tasks.workunit.client.0.smithi100.stdout:3/956: write d0/d3d/d5c/d6f/d7f/f132 [954310,71518] 0 2023-12-05T09:57:46.475 INFO:tasks.workunit.client.0.smithi100.stdout:3/957: read - d0/d3d/d5c/f144 zero size 2023-12-05T09:57:46.476 INFO:tasks.workunit.client.1.smithi150.stdout:1/955: write d6/d3c/dc2/fcc [1569922,16764] 0 2023-12-05T09:57:46.476 INFO:tasks.workunit.client.1.smithi150.stdout:1/956: creat d6/d8/d54/d94/f14b x:0 0 0 2023-12-05T09:57:46.476 INFO:tasks.workunit.client.0.smithi100.stdout:5/959: dread d0/d27/fbb [4194304,4194304] 0 2023-12-05T09:57:46.478 INFO:tasks.workunit.client.0.smithi100.stdout:3/958: truncate d0/d10/f2a 3001232 0 2023-12-05T09:57:46.478 INFO:tasks.workunit.client.0.smithi100.stdout:3/959: fdatasync d0/d4/f20 0 2023-12-05T09:57:46.479 INFO:tasks.workunit.client.0.smithi100.stdout:5/960: mknod d0/d1b/d4d/d8e/d96/dc1/c155 0 2023-12-05T09:57:46.479 INFO:tasks.workunit.client.0.smithi100.stdout:5/961: chown d0/d1b/d4d/d8e/d125/d14/d35/d62/fd4 97 1 2023-12-05T09:57:46.480 INFO:tasks.workunit.client.0.smithi100.stdout:0/860: dread da/d22/d33/d74/dca/f4f [4194304,4194304] 0 2023-12-05T09:57:46.480 INFO:tasks.workunit.client.0.smithi100.stdout:0/861: write da/d22/d33/d7f/fee [978275,103867] 0 2023-12-05T09:57:46.481 INFO:tasks.workunit.client.0.smithi100.stdout:7/836: dwrite d3/dc/d11/d13/d37/fa9 [0,4194304] 0 2023-12-05T09:57:46.487 INFO:tasks.workunit.client.0.smithi100.stdout:3/960: getdents d0/d3d/d5c/d139/de/d11/db5 0 2023-12-05T09:57:46.488 INFO:tasks.workunit.client.1.smithi150.stdout:2/967: write d0/d3/d5/d10/d3d/da1/daa/d11e/f29 [2281943,25934] 0 2023-12-05T09:57:46.489 INFO:tasks.workunit.client.0.smithi100.stdout:8/884: dwrite d0/d35/f93 [0,4194304] 0 2023-12-05T09:57:46.497 INFO:tasks.workunit.client.0.smithi100.stdout:4/835: dwrite de/d16/d1e/f30 [0,4194304] 0 2023-12-05T09:57:46.497 INFO:tasks.workunit.client.1.smithi150.stdout:2/968: rename d0/d3/d21/d4d/deb/d103/cb8 to d0/d3/d21/d4d/deb/d103/c147 0 2023-12-05T09:57:46.497 INFO:tasks.workunit.client.1.smithi150.stdout:8/976: dwrite d0/d41/d49/d1b/d24/d38/d62/fb9 [4194304,4194304] 0 2023-12-05T09:57:46.498 INFO:tasks.workunit.client.0.smithi100.stdout:4/836: readlink de/d16/d23/d33/d51/l74 0 2023-12-05T09:57:46.500 INFO:tasks.workunit.client.0.smithi100.stdout:1/863: dwrite db/d12/d61/f64 [0,4194304] 0 2023-12-05T09:57:46.500 INFO:tasks.workunit.client.1.smithi150.stdout:6/824: dwrite d2/d23/d2e/d44/fbc [0,4194304] 0 2023-12-05T09:57:46.500 INFO:tasks.workunit.client.1.smithi150.stdout:6/825: readlink d2/d23/d2e/d44/l58 0 2023-12-05T09:57:46.500 INFO:tasks.workunit.client.1.smithi150.stdout:6/826: write d2/d23/d2e/fdc [594587,6584] 0 2023-12-05T09:57:46.502 INFO:tasks.workunit.client.1.smithi150.stdout:3/934: dwrite d6/d9/d43/d47/f1a [0,4194304] 0 2023-12-05T09:57:46.503 INFO:tasks.workunit.client.0.smithi100.stdout:5/962: creat d0/d1b/d4d/d8e/d96/dc1/dae/f156 x:0 0 0 2023-12-05T09:57:46.503 INFO:tasks.workunit.client.0.smithi100.stdout:0/862: creat da/d22/d33/d74/d77/d105/f10b x:0 0 0 2023-12-05T09:57:46.504 INFO:tasks.workunit.client.0.smithi100.stdout:0/863: fdatasync da/d2a/d45/f97 0 2023-12-05T09:57:46.504 INFO:tasks.workunit.client.0.smithi100.stdout:7/837: creat d3/dc/d11/d13/de/d18/d3b/d40/d46/d9e/f132 x:0 0 0 2023-12-05T09:57:46.504 INFO:tasks.workunit.client.1.smithi150.stdout:2/969: link d0/d3/d5/d22/ffe d0/d3/d5/d22/f148 0 2023-12-05T09:57:46.504 INFO:tasks.workunit.client.1.smithi150.stdout:1/957: dread d6/d8/d85/d10e/f11b [0,4194304] 0 2023-12-05T09:57:46.505 INFO:tasks.workunit.client.1.smithi150.stdout:1/958: chown d6/d47/d4c/d60 111 1 2023-12-05T09:57:46.505 INFO:tasks.workunit.client.0.smithi100.stdout:7/838: stat d3/dc/d11/d13/de/d2d/ff4 0 2023-12-05T09:57:46.517 INFO:tasks.workunit.client.1.smithi150.stdout:8/977: mkdir d0/d41/d49/d1b/d24/d5b/d9c/d129/d137 0 2023-12-05T09:57:46.523 INFO:tasks.workunit.client.1.smithi150.stdout:7/933: dwrite d2/db/d2e/d71/df2/ff4 [0,4194304] 0 2023-12-05T09:57:46.523 INFO:tasks.workunit.client.1.smithi150.stdout:7/934: readlink d2/d72/d82/l118 0 2023-12-05T09:57:46.532 INFO:tasks.workunit.client.0.smithi100.stdout:3/961: dwrite d0/d3d/dfc/d10d/f11b [0,4194304] 0 2023-12-05T09:57:46.532 INFO:tasks.workunit.client.0.smithi100.stdout:1/864: read db/d12/d1e/d72/ddd/dfd/f108 [1165808,16852] 0 2023-12-05T09:57:46.532 INFO:tasks.workunit.client.0.smithi100.stdout:1/865: write db/d12/d1e/d72/ddd/dfd/f108 [1667148,32049] 0 2023-12-05T09:57:46.532 INFO:tasks.workunit.client.0.smithi100.stdout:1/866: chown db/d12/d1e/d26/f62 54878774 1 2023-12-05T09:57:46.532 INFO:tasks.workunit.client.0.smithi100.stdout:1/867: readlink db/d12/d1e/d72/dc4/lf5 0 2023-12-05T09:57:46.533 INFO:tasks.workunit.client.0.smithi100.stdout:8/885: creat d0/d12/d13/d16/df5/f106 x:0 0 0 2023-12-05T09:57:46.535 INFO:tasks.workunit.client.0.smithi100.stdout:9/931: dwrite d7/d35/d71/d9a/fa3 [0,4194304] 0 2023-12-05T09:57:46.548 INFO:tasks.workunit.client.1.smithi150.stdout:6/827: symlink d2/d23/d2e/d5f/d99/dd8/l10f 0 2023-12-05T09:57:46.556 INFO:tasks.workunit.client.0.smithi100.stdout:5/963: unlink d0/d1b/d4d/d8e/d96/dc1/dae/db9/f105 0 2023-12-05T09:57:46.556 INFO:tasks.workunit.client.0.smithi100.stdout:0/864: unlink da/d2a/d4d/cd9 0 2023-12-05T09:57:46.559 INFO:tasks.workunit.client.1.smithi150.stdout:3/935: creat d6/d25/dfc/f12e x:0 0 0 2023-12-05T09:57:46.563 INFO:tasks.workunit.client.1.smithi150.stdout:8/978: mkdir d0/d41/d49/dd3/df9/d138 0 2023-12-05T09:57:46.566 INFO:tasks.workunit.client.0.smithi100.stdout:4/837: dwrite de/d16/d1e/f7c [0,4194304] 0 2023-12-05T09:57:46.566 INFO:tasks.workunit.client.0.smithi100.stdout:4/838: chown de/d16/d23/d36/f56 57 1 2023-12-05T09:57:46.566 INFO:tasks.workunit.client.0.smithi100.stdout:4/839: truncate f9 4277181 0 2023-12-05T09:57:46.567 INFO:tasks.workunit.client.0.smithi100.stdout:4/840: readlink de/d16/d23/d60/l64 0 2023-12-05T09:57:46.567 INFO:tasks.workunit.client.0.smithi100.stdout:4/841: stat de/d16/d1e/lf2 0 2023-12-05T09:57:46.567 INFO:tasks.workunit.client.1.smithi150.stdout:7/935: mknod d2/d9d/d101/c135 0 2023-12-05T09:57:46.568 INFO:tasks.workunit.client.1.smithi150.stdout:6/828: read d2/d23/d3b/df0/d97/f8a [585059,119025] 0 2023-12-05T09:57:46.568 INFO:tasks.workunit.client.1.smithi150.stdout:1/959: dread d6/d3c/dc2/dde/df4/d10a/f132 [0,4194304] 0 2023-12-05T09:57:46.568 INFO:tasks.workunit.client.1.smithi150.stdout:1/960: chown d6/d47/d4c/dd9/d75/ddd/cf8 12399 1 2023-12-05T09:57:46.568 INFO:tasks.workunit.client.1.smithi150.stdout:2/970: dwrite d0/d3/d21/d4d/deb/ff6 [0,4194304] 0 2023-12-05T09:57:46.568 INFO:tasks.workunit.client.1.smithi150.stdout:3/936: mkdir d6/d9/d3d/d56/d71/db6/db2/d12f 0 2023-12-05T09:57:46.573 INFO:tasks.workunit.client.0.smithi100.stdout:1/868: mkdir db/d12/d1e/d72/dc4/dd2/dfa/d10a 0 2023-12-05T09:57:46.573 INFO:tasks.workunit.client.0.smithi100.stdout:1/869: chown db/d12/d1e/dd3/db8/de7/ff9 0 1 2023-12-05T09:57:46.573 INFO:tasks.workunit.client.0.smithi100.stdout:1/870: stat db/d12/d61/fbc 0 2023-12-05T09:57:46.573 INFO:tasks.workunit.client.0.smithi100.stdout:1/871: chown db/d12/d1e/l2f 2 1 2023-12-05T09:57:46.578 INFO:tasks.workunit.client.0.smithi100.stdout:8/886: unlink d0/d12/d13/d16/d42/d43/fad 0 2023-12-05T09:57:46.580 INFO:tasks.workunit.client.1.smithi150.stdout:1/961: mknod d6/d47/dcf/d13a/c14c 0 2023-12-05T09:57:46.580 INFO:tasks.workunit.client.1.smithi150.stdout:1/962: fsync d6/d47/d4c/dd9/d11f/f144 0 2023-12-05T09:57:46.580 INFO:tasks.workunit.client.1.smithi150.stdout:1/963: chown d6/d38/l8a 60 1 2023-12-05T09:57:46.580 INFO:tasks.workunit.client.1.smithi150.stdout:1/964: fdatasync d6/d8/db/f105 0 2023-12-05T09:57:46.581 INFO:tasks.workunit.client.0.smithi100.stdout:5/964: dread d0/d1b/d4d/d6c/fe9 [0,4194304] 0 2023-12-05T09:57:46.581 INFO:tasks.workunit.client.0.smithi100.stdout:3/962: write d0/d3d/d5c/d5f/d67/df2/ff7 [1835926,68227] 0 2023-12-05T09:57:46.582 INFO:tasks.workunit.client.0.smithi100.stdout:9/932: truncate d7/d20/d69/fa0 2513754 0 2023-12-05T09:57:46.585 INFO:tasks.workunit.client.1.smithi150.stdout:7/936: dread d2/db/d30/daf/dd3/d2b/f34 [0,4194304] 0 2023-12-05T09:57:46.585 INFO:tasks.workunit.client.1.smithi150.stdout:2/971: rename d0/d3/d5/d22/l10d to d0/d3/d27/d95/ddf/l149 0 2023-12-05T09:57:46.588 INFO:tasks.workunit.client.0.smithi100.stdout:7/839: dwrite d3/f24 [0,4194304] 0 2023-12-05T09:57:46.588 INFO:tasks.workunit.client.0.smithi100.stdout:7/840: truncate d3/dc/fa6 1116535 0 2023-12-05T09:57:46.590 INFO:tasks.workunit.client.1.smithi150.stdout:3/937: unlink d6/d25/ca2 0 2023-12-05T09:57:46.593 INFO:tasks.workunit.client.1.smithi150.stdout:1/965: getdents d6/d47/d4c/dd9/daf/d121 0 2023-12-05T09:57:46.595 INFO:tasks.workunit.client.0.smithi100.stdout:4/842: write de/d16/d23/d60/f9f [2201499,112073] 0 2023-12-05T09:57:46.595 INFO:tasks.workunit.client.0.smithi100.stdout:0/865: symlink da/d22/d33/d74/l10c 0 2023-12-05T09:57:46.595 INFO:tasks.workunit.client.0.smithi100.stdout:0/866: chown da/c63 1028 1 2023-12-05T09:57:46.596 INFO:tasks.workunit.client.1.smithi150.stdout:7/937: mkdir d2/d1b/d31/d136 0 2023-12-05T09:57:46.596 INFO:tasks.workunit.client.1.smithi150.stdout:7/938: fsync d2/db/d30/d13/f14 0 2023-12-05T09:57:46.598 INFO:tasks.workunit.client.0.smithi100.stdout:5/965: truncate d0/fcf 3080741 0 2023-12-05T09:57:46.601 INFO:tasks.workunit.client.1.smithi150.stdout:2/972: symlink d0/d3/d21/d4d/deb/d103/d15/d30/d54/d57/dee/l14a 0 2023-12-05T09:57:46.601 INFO:tasks.workunit.client.1.smithi150.stdout:4/848: sync 2023-12-05T09:57:46.601 INFO:tasks.workunit.client.1.smithi150.stdout:4/849: read - d0/d3e/d5b/fd5 zero size 2023-12-05T09:57:46.602 INFO:tasks.workunit.client.1.smithi150.stdout:4/850: write d0/d3e/d6d/d95/fd8 [5230139,90118] 0 2023-12-05T09:57:46.605 INFO:tasks.workunit.client.1.smithi150.stdout:1/966: write f4 [3318774,130649] 0 2023-12-05T09:57:46.611 INFO:tasks.workunit.client.1.smithi150.stdout:7/939: link d2/db/d30/d13/d4f/d5a/d5c/f117 d2/db/d17/f137 0 2023-12-05T09:57:46.619 INFO:tasks.workunit.client.1.smithi150.stdout:7/940: write d2/db/d30/d47/fd0 [296939,79755] 0 2023-12-05T09:57:46.620 INFO:tasks.workunit.client.1.smithi150.stdout:2/973: link d0/d3/d27/dac/l12f d0/d3/d27/dac/l14b 0 2023-12-05T09:57:46.624 INFO:tasks.workunit.client.1.smithi150.stdout:4/851: chown d0/d3e/d48/ff1 14 1 2023-12-05T09:57:46.625 INFO:tasks.workunit.client.1.smithi150.stdout:3/938: getdents d6/d9/d3d/d56/d71/db6/dc1/d9a 0 2023-12-05T09:57:46.625 INFO:tasks.workunit.client.1.smithi150.stdout:3/939: chown d6/d25/le8 102206 1 2023-12-05T09:57:46.629 INFO:tasks.workunit.client.0.smithi100.stdout:3/963: unlink d0/d10/d39/l101 0 2023-12-05T09:57:46.632 INFO:tasks.workunit.client.1.smithi150.stdout:1/967: truncate d6/d8/db/db1/f13f 930099 0 2023-12-05T09:57:46.632 INFO:tasks.workunit.client.1.smithi150.stdout:1/968: readlink d6/d38/d4a/l4f 0 2023-12-05T09:57:46.632 INFO:tasks.workunit.client.1.smithi150.stdout:1/969: stat d6/d47/d4c/dd9/fe7 0 2023-12-05T09:57:46.637 INFO:tasks.workunit.client.0.smithi100.stdout:7/841: creat d3/dc/d11/d13/de/d18/dcb/f133 x:0 0 0 2023-12-05T09:57:46.637 INFO:tasks.workunit.client.1.smithi150.stdout:9/867: sync 2023-12-05T09:57:46.637 INFO:tasks.workunit.client.1.smithi150.stdout:9/868: chown d3/d1b/d46/d55/d64/fdc 4365480 1 2023-12-05T09:57:46.640 INFO:tasks.workunit.client.1.smithi150.stdout:5/918: sync 2023-12-05T09:57:46.640 INFO:tasks.workunit.client.1.smithi150.stdout:7/941: write d2/db/d30/d53/fcc [4075269,53998] 0 2023-12-05T09:57:46.643 INFO:tasks.workunit.client.0.smithi100.stdout:4/843: mkdir de/d16/d23/d60/df7/d4e/d80/d112 0 2023-12-05T09:57:46.643 INFO:tasks.workunit.client.0.smithi100.stdout:0/867: dwrite da/d22/d33/d35/d3a/f83 [0,4194304] 0 2023-12-05T09:57:46.648 INFO:tasks.workunit.client.0.smithi100.stdout:5/966: rmdir d0/d16/d2b/d75 39 2023-12-05T09:57:46.648 INFO:tasks.workunit.client.0.smithi100.stdout:5/967: chown d0/d1f/d25/f50 15988257 1 2023-12-05T09:57:46.651 INFO:tasks.workunit.client.1.smithi150.stdout:2/974: rename d0/d3/d27/d95/ddf/l149 to d0/d3/d128/l14c 0 2023-12-05T09:57:46.651 INFO:tasks.workunit.client.1.smithi150.stdout:2/975: chown d0/da3/dae/dc3/fe9 14907566 1 2023-12-05T09:57:46.652 INFO:tasks.workunit.client.1.smithi150.stdout:2/976: dread - d0/d3/d5/d22/d52/d56/f11a zero size 2023-12-05T09:57:46.652 INFO:tasks.workunit.client.0.smithi100.stdout:9/933: dwrite d7/d1b/d22/d2a/d56/f12e [0,4194304] 0 2023-12-05T09:57:46.652 INFO:tasks.workunit.client.0.smithi100.stdout:9/934: fsync d7/d20/d69/fa0 0 2023-12-05T09:57:46.652 INFO:tasks.workunit.client.0.smithi100.stdout:1/872: dwrite db/d31/d3a/f3e [4194304,4194304] 0 2023-12-05T09:57:46.652 INFO:tasks.workunit.client.0.smithi100.stdout:9/935: creat d7/d1b/d22/d51/d32/d96/f14c x:0 0 0 2023-12-05T09:57:46.653 INFO:tasks.workunit.client.0.smithi100.stdout:3/964: mknod d0/c14d 0 2023-12-05T09:57:46.653 INFO:tasks.workunit.client.0.smithi100.stdout:3/965: fsync d0/d10/d39/dab/f14b 0 2023-12-05T09:57:46.653 INFO:tasks.workunit.client.0.smithi100.stdout:3/966: write d0/d3d/dfc/d10d/fe4 [2042887,40749] 0 2023-12-05T09:57:46.653 INFO:tasks.workunit.client.0.smithi100.stdout:3/967: chown d0/l4d 15 1 2023-12-05T09:57:46.659 INFO:tasks.workunit.client.0.smithi100.stdout:7/842: creat d3/dc/f134 x:0 0 0 2023-12-05T09:57:46.659 INFO:tasks.workunit.client.0.smithi100.stdout:7/843: chown d3/dc/d11/d13/de/cfc 0 1 2023-12-05T09:57:46.661 INFO:tasks.workunit.client.0.smithi100.stdout:8/887: dwrite d0/d12/d13/d45/da6/fe9 [0,4194304] 0 2023-12-05T09:57:46.662 INFO:tasks.workunit.client.0.smithi100.stdout:8/888: dread - d0/d12/d13/d45/dba/dbd/d72/d9f/fe3 zero size 2023-12-05T09:57:46.664 INFO:tasks.workunit.client.0.smithi100.stdout:4/844: creat de/d38/f113 x:0 0 0 2023-12-05T09:57:46.664 INFO:tasks.workunit.client.0.smithi100.stdout:4/845: fsync de/f1b 0 2023-12-05T09:57:46.665 INFO:tasks.workunit.client.1.smithi150.stdout:5/919: dread d1/d7f/d65/f63 [4194304,4194304] 0 2023-12-05T09:57:46.667 INFO:tasks.workunit.client.1.smithi150.stdout:3/940: symlink d6/d113/l130 0 2023-12-05T09:57:46.667 INFO:tasks.workunit.client.1.smithi150.stdout:1/970: truncate d6/d8/d59/f76 769340 0 2023-12-05T09:57:46.667 INFO:tasks.workunit.client.1.smithi150.stdout:3/941: chown d6/d9/d3d/l4b 5082 1 2023-12-05T09:57:46.667 INFO:tasks.workunit.client.1.smithi150.stdout:9/869: mknod d3/d42/dd2/de0/c118 0 2023-12-05T09:57:46.667 INFO:tasks.workunit.client.1.smithi150.stdout:7/942: mknod d2/db/d30/d13/d4f/dff/c138 0 2023-12-05T09:57:46.669 INFO:tasks.workunit.client.0.smithi100.stdout:0/868: mkdir da/d22/d33/d74/dca/d10d 0 2023-12-05T09:57:46.669 INFO:tasks.workunit.client.0.smithi100.stdout:0/869: truncate da/d22/d33/d35/d3a/d8b/d8f/fae 799778 0 2023-12-05T09:57:46.669 INFO:tasks.workunit.client.0.smithi100.stdout:0/870: chown da/d1b/d73/db3/fcf 8 1 2023-12-05T09:57:46.670 INFO:tasks.workunit.client.0.smithi100.stdout:5/968: symlink d0/d16/dc9/l157 0 2023-12-05T09:57:46.671 INFO:tasks.workunit.client.1.smithi150.stdout:5/920: symlink d1/d64/dfc/l142 0 2023-12-05T09:57:46.671 INFO:tasks.workunit.client.1.smithi150.stdout:5/921: read - d1/d64/dfc/f133 zero size 2023-12-05T09:57:46.674 INFO:tasks.workunit.client.1.smithi150.stdout:4/852: dwrite d0/d3e/d6d/f18 [0,4194304] 0 2023-12-05T09:57:46.674 INFO:tasks.workunit.client.1.smithi150.stdout:4/853: chown d0/d3e 1514890 1 2023-12-05T09:57:46.681 INFO:tasks.workunit.client.1.smithi150.stdout:1/971: unlink d6/d8/db/c44 0 2023-12-05T09:57:46.683 INFO:tasks.workunit.client.0.smithi100.stdout:1/873: mknod db/d12/d1e/d26/d39/de9/c10b 0 2023-12-05T09:57:46.684 INFO:tasks.workunit.client.0.smithi100.stdout:1/874: chown db/d12/d1e/d72/dc4/dd2/ld4 25 1 2023-12-05T09:57:46.684 INFO:tasks.workunit.client.1.smithi150.stdout:3/942: mknod d6/d22/c131 0 2023-12-05T09:57:46.685 INFO:tasks.workunit.client.0.smithi100.stdout:9/936: mkdir d7/d1b/d22/d51/d147/d14d 0 2023-12-05T09:57:46.686 INFO:tasks.workunit.client.1.smithi150.stdout:9/870: chown d3/d9/l30 13359107 1 2023-12-05T09:57:46.686 INFO:tasks.workunit.client.1.smithi150.stdout:9/871: fsync d3/d9/d6e/d76/f9f 0 2023-12-05T09:57:46.686 INFO:tasks.workunit.client.1.smithi150.stdout:9/872: fdatasync d3/d9/dc/d1f/d24/d75/d95/d9a/dcb/de4/f112 0 2023-12-05T09:57:46.686 INFO:tasks.workunit.client.1.smithi150.stdout:9/873: write d3/d9/dc/d1f/d24/f78 [3498245,113635] 0 2023-12-05T09:57:46.686 INFO:tasks.workunit.client.1.smithi150.stdout:9/874: read - d3/d9/d9c/f107 zero size 2023-12-05T09:57:46.687 INFO:tasks.workunit.client.0.smithi100.stdout:3/968: mkdir d0/d3d/d90/d14e 0 2023-12-05T09:57:46.687 INFO:tasks.workunit.client.0.smithi100.stdout:3/969: chown d0/d10/l13f 99971596 1 2023-12-05T09:57:46.687 INFO:tasks.workunit.client.1.smithi150.stdout:4/854: dread d0/d3e/d48/fdb [0,4194304] 0 2023-12-05T09:57:46.687 INFO:tasks.workunit.client.0.smithi100.stdout:0/871: dread da/d2a/f62 [0,4194304] 0 2023-12-05T09:57:46.689 INFO:tasks.workunit.client.0.smithi100.stdout:3/970: write d0/d3d/d5c/d139/de/d11/d7c/dd0/d125/f64 [1083320,33408] 0 2023-12-05T09:57:46.690 INFO:tasks.workunit.client.1.smithi150.stdout:3/943: creat d6/d9/d8d/f132 x:0 0 0 2023-12-05T09:57:46.693 INFO:tasks.workunit.client.1.smithi150.stdout:8/979: sync 2023-12-05T09:57:46.693 INFO:tasks.workunit.client.1.smithi150.stdout:6/829: sync 2023-12-05T09:57:46.693 INFO:tasks.workunit.client.1.smithi150.stdout:8/980: truncate d0/d41/d49/d1b/d24/d34/dbc/ff4 479791 0 2023-12-05T09:57:46.693 INFO:tasks.workunit.client.1.smithi150.stdout:8/981: chown d0/d41/d49/d1b/l32 461260 1 2023-12-05T09:57:46.694 INFO:tasks.workunit.client.1.smithi150.stdout:9/875: creat d3/d1b/f119 x:0 0 0 2023-12-05T09:57:46.697 INFO:tasks.workunit.client.1.smithi150.stdout:9/876: read d3/d1b/d46/d55/d64/fc3 [259263,2025] 0 2023-12-05T09:57:46.697 INFO:tasks.workunit.client.1.smithi150.stdout:9/877: chown d3/d9/d26/d9b/f10e 3 1 2023-12-05T09:57:46.697 INFO:tasks.workunit.client.1.smithi150.stdout:9/878: chown d3/d1b/d46/d55/d64/d94 129855 1 2023-12-05T09:57:46.697 INFO:tasks.workunit.client.1.smithi150.stdout:9/879: dread - d3/d9/dc/d1f/d24/d75/d95/dbc/dad/db7/fe3 zero size 2023-12-05T09:57:46.698 INFO:tasks.workunit.client.0.smithi100.stdout:7/844: dread d3/dc/d11/d33/f53 [0,4194304] 0 2023-12-05T09:57:46.700 INFO:tasks.workunit.client.0.smithi100.stdout:8/889: mknod d0/d35/d64/d81/d9a/dfe/c107 0 2023-12-05T09:57:46.700 INFO:tasks.workunit.client.1.smithi150.stdout:4/855: truncate d0/d3e/d5b/d6e/daa/fb3 3311158 0 2023-12-05T09:57:46.700 INFO:tasks.workunit.client.1.smithi150.stdout:3/944: truncate d6/d25/f62 3988541 0 2023-12-05T09:57:46.705 INFO:tasks.workunit.client.1.smithi150.stdout:6/830: rename d2/d23/d3b/d64/d7a/d5d/d6b/ce8 to d2/d23/d2e/d5f/d99/dd8/d10c/c110 0 2023-12-05T09:57:46.705 INFO:tasks.workunit.client.1.smithi150.stdout:6/831: stat d2/d23/l4c 0 2023-12-05T09:57:46.705 INFO:tasks.workunit.client.1.smithi150.stdout:2/977: dwrite d0/d3/d5/d10/fed [0,4194304] 0 2023-12-05T09:57:46.705 INFO:tasks.workunit.client.1.smithi150.stdout:1/972: dread d6/d3c/dc2/dde/df4/f108 [0,4194304] 0 2023-12-05T09:57:46.705 INFO:tasks.workunit.client.1.smithi150.stdout:1/973: fsync d6/fa0 0 2023-12-05T09:57:46.706 INFO:tasks.workunit.client.0.smithi100.stdout:4/846: mkdir de/de8/d114 0 2023-12-05T09:57:46.706 INFO:tasks.workunit.client.0.smithi100.stdout:4/847: fsync de/d38/fb6 0 2023-12-05T09:57:46.706 INFO:tasks.workunit.client.0.smithi100.stdout:5/969: truncate d0/d27/f57 5202700 0 2023-12-05T09:57:46.707 INFO:tasks.workunit.client.1.smithi150.stdout:9/880: mkdir d3/d9/d26/d34/ded/d11a 0 2023-12-05T09:57:46.710 INFO:tasks.workunit.client.0.smithi100.stdout:1/875: unlink db/d31/d3a/d4a/fa3 0 2023-12-05T09:57:46.713 INFO:tasks.workunit.client.0.smithi100.stdout:9/937: creat d7/d1b/d22/d2a/d74/f14e x:0 0 0 2023-12-05T09:57:46.717 INFO:tasks.workunit.client.1.smithi150.stdout:4/856: mkdir d0/d3e/d5b/d80/da1/db2/dbe/d104 0 2023-12-05T09:57:46.721 INFO:tasks.workunit.client.0.smithi100.stdout:7/845: rename d3/dc/d11/d13/de/d18/d3b/d40/f41 to d3/dc/d11/d13/de/d2d/d42/f135 0 2023-12-05T09:57:46.721 INFO:tasks.workunit.client.0.smithi100.stdout:7/846: fdatasync d3/dc/d11/d13/de/d18/d3b/d40/d4c/d7f/f98 0 2023-12-05T09:57:46.722 INFO:tasks.workunit.client.1.smithi150.stdout:5/922: dwrite d1/d7f/d65/d3b/f12d [0,4194304] 0 2023-12-05T09:57:46.723 INFO:tasks.workunit.client.1.smithi150.stdout:5/923: stat d1/l6e 0 2023-12-05T09:57:46.723 INFO:tasks.workunit.client.1.smithi150.stdout:1/974: dread d6/d38/d135/f142 [0,4194304] 0 2023-12-05T09:57:46.723 INFO:tasks.workunit.client.1.smithi150.stdout:1/975: dread - d6/d8/db/db1/ff7 zero size 2023-12-05T09:57:46.723 INFO:tasks.workunit.client.1.smithi150.stdout:1/976: write d6/d3c/dc2/dde/f11a [651265,123002] 0 2023-12-05T09:57:46.724 INFO:tasks.workunit.client.1.smithi150.stdout:3/945: mkdir d6/d25/dd9/df2/d133 0 2023-12-05T09:57:46.725 INFO:tasks.workunit.client.1.smithi150.stdout:3/946: write d6/d9/d3d/d87/fad [138397,2993] 0 2023-12-05T09:57:46.730 INFO:tasks.workunit.client.0.smithi100.stdout:9/938: dread d7/fc [0,4194304] 0 2023-12-05T09:57:46.735 INFO:tasks.workunit.client.0.smithi100.stdout:1/876: mknod db/d12/d1e/dd3/db8/de7/c10c 0 2023-12-05T09:57:46.737 INFO:tasks.workunit.client.1.smithi150.stdout:6/832: creat d2/d23/d3b/d64/d7a/d5d/d6b/f111 x:0 0 0 2023-12-05T09:57:46.739 INFO:tasks.workunit.client.1.smithi150.stdout:8/982: rename d0/d41/d49/d1b/d24/d34/d56/c74 to d0/d41/d49/d1b/d24/d34/dbc/c139 0 2023-12-05T09:57:46.745 INFO:tasks.workunit.client.0.smithi100.stdout:0/872: dwrite da/d22/d33/d35/d3a/f67 [0,4194304] 0 2023-12-05T09:57:46.745 INFO:tasks.workunit.client.0.smithi100.stdout:0/873: write da/d2a/fc3 [573398,92131] 0 2023-12-05T09:57:46.745 INFO:tasks.workunit.client.0.smithi100.stdout:0/874: chown da/d22/f3b 1998 1 2023-12-05T09:57:46.746 INFO:tasks.workunit.client.0.smithi100.stdout:7/847: rmdir d3/dc/d11/d108 0 2023-12-05T09:57:46.746 INFO:tasks.workunit.client.0.smithi100.stdout:7/848: write d3/dc/d11/d13/de/d18/d3b/d40/d46/d9e/f107 [988616,46618] 0 2023-12-05T09:57:46.748 INFO:tasks.workunit.client.0.smithi100.stdout:8/890: rename d0/d12/f32 to d0/d12/d13/d16/da3/dff/f108 0 2023-12-05T09:57:46.750 INFO:tasks.workunit.client.1.smithi150.stdout:1/977: dread d6/d8/db/f5b [0,4194304] 0 2023-12-05T09:57:46.750 INFO:tasks.workunit.client.1.smithi150.stdout:1/978: readlink d6/d38/l5c 0 2023-12-05T09:57:46.750 INFO:tasks.workunit.client.1.smithi150.stdout:5/924: write d1/d7f/d65/d3b/f12d [1974324,107910] 0 2023-12-05T09:57:46.751 INFO:tasks.workunit.client.0.smithi100.stdout:5/970: rmdir d0/d16/d2b/de3 39 2023-12-05T09:57:46.752 INFO:tasks.workunit.client.0.smithi100.stdout:7/849: write d3/dc/fa6 [582533,108713] 0 2023-12-05T09:57:46.753 INFO:tasks.workunit.client.1.smithi150.stdout:2/978: mknod d0/c14d 0 2023-12-05T09:57:46.753 INFO:tasks.workunit.client.1.smithi150.stdout:2/979: readlink d0/d3/d5/d22/l120 0 2023-12-05T09:57:46.758 INFO:tasks.workunit.client.0.smithi100.stdout:1/877: unlink db/d31/d3a/d4a/dad/d67/l79 0 2023-12-05T09:57:46.758 INFO:tasks.workunit.client.1.smithi150.stdout:6/833: write d2/d23/d2e/d44/fbc [1660241,127942] 0 2023-12-05T09:57:46.760 INFO:tasks.workunit.client.1.smithi150.stdout:9/881: dwrite d3/d9/d58/fa9 [0,4194304] 0 2023-12-05T09:57:46.762 INFO:tasks.workunit.client.1.smithi150.stdout:4/857: truncate d0/d3e/d48/d8a/f100 1786962 0 2023-12-05T09:57:46.764 INFO:tasks.workunit.client.0.smithi100.stdout:5/971: creat d0/d1b/d4d/d8e/d96/d14c/f158 x:0 0 0 2023-12-05T09:57:46.764 INFO:tasks.workunit.client.0.smithi100.stdout:5/972: readlink d0/d1f/l12d 0 2023-12-05T09:57:46.765 INFO:tasks.workunit.client.0.smithi100.stdout:5/973: write d0/d27/f29 [4265279,100268] 0 2023-12-05T09:57:46.765 INFO:tasks.workunit.client.0.smithi100.stdout:5/974: dread - d0/d16/d37/fe8 zero size 2023-12-05T09:57:46.765 INFO:tasks.workunit.client.0.smithi100.stdout:2/988: sync 2023-12-05T09:57:46.765 INFO:tasks.workunit.client.0.smithi100.stdout:2/989: dread - d7/d61/d12a/d146/d2c/d3f/d46/dc8/dfe/f13d zero size 2023-12-05T09:57:46.765 INFO:tasks.workunit.client.0.smithi100.stdout:2/990: dread - d7/da/d18/d21/d4d/f13e zero size 2023-12-05T09:57:46.765 INFO:tasks.workunit.client.0.smithi100.stdout:2/991: dread - d7/da/d13/d69/fde zero size 2023-12-05T09:57:46.766 INFO:tasks.workunit.client.0.smithi100.stdout:2/992: write d7/da/d18/d21/d122/f12c [303258,23996] 0 2023-12-05T09:57:46.766 INFO:tasks.workunit.client.0.smithi100.stdout:9/939: dwrite d7/f9 [0,4194304] 0 2023-12-05T09:57:46.768 INFO:tasks.workunit.client.0.smithi100.stdout:7/850: unlink d3/dc/d11/d13/de/d2d/d42/fc8 0 2023-12-05T09:57:46.771 INFO:tasks.workunit.client.0.smithi100.stdout:8/891: dread d0/f9 [0,4194304] 0 2023-12-05T09:57:46.771 INFO:tasks.workunit.client.0.smithi100.stdout:8/892: write d0/d35/f9b [866890,54811] 0 2023-12-05T09:57:46.774 INFO:tasks.workunit.client.0.smithi100.stdout:0/875: rmdir da/d1b/d73/d82 39 2023-12-05T09:57:46.774 INFO:tasks.workunit.client.0.smithi100.stdout:0/876: fdatasync da/d22/d33/d35/d3a/f47 0 2023-12-05T09:57:46.774 INFO:tasks.workunit.client.0.smithi100.stdout:0/877: creat da/d22/d33/d74/dca/db4/f10e x:0 0 0 2023-12-05T09:57:46.775 INFO:tasks.workunit.client.0.smithi100.stdout:0/878: write da/f2c [2513650,56863] 0 2023-12-05T09:57:46.777 INFO:tasks.workunit.client.1.smithi150.stdout:3/947: creat d6/d9/d3d/d56/d71/f134 x:0 0 0 2023-12-05T09:57:46.781 INFO:tasks.workunit.client.1.smithi150.stdout:4/858: dread d0/d3e/d6d/ddf/da4/dd7/f86 [0,4194304] 0 2023-12-05T09:57:46.781 INFO:tasks.workunit.client.1.smithi150.stdout:8/983: mknod d0/d41/d49/d1b/d24/d34/dd0/c13a 0 2023-12-05T09:57:46.781 INFO:tasks.workunit.client.1.smithi150.stdout:8/984: readlink d0/l103 0 2023-12-05T09:57:46.783 INFO:tasks.workunit.client.0.smithi100.stdout:1/878: dread db/d12/d1e/f38 [0,4194304] 0 2023-12-05T09:57:46.783 INFO:tasks.workunit.client.0.smithi100.stdout:2/993: mkdir d7/d61/d12a/d146/d2c/d3f/dc5/d148 0 2023-12-05T09:57:46.786 INFO:tasks.workunit.client.0.smithi100.stdout:9/940: mkdir d7/d1b/d14f 0 2023-12-05T09:57:46.788 INFO:tasks.workunit.client.1.smithi150.stdout:1/979: creat d6/d38/d135/f14d x:0 0 0 2023-12-05T09:57:46.788 INFO:tasks.workunit.client.1.smithi150.stdout:1/980: chown d6/d47/d4c/dd9/daf/fd8 522350007 1 2023-12-05T09:57:46.788 INFO:tasks.workunit.client.0.smithi100.stdout:3/971: write d0/d3d/d5c/d6f/f8c [1576299,52618] 0 2023-12-05T09:57:46.791 INFO:tasks.workunit.client.0.smithi100.stdout:8/893: symlink d0/d12/d13/d45/dba/dbd/d72/d9f/dde/l109 0 2023-12-05T09:57:46.798 INFO:tasks.workunit.client.1.smithi150.stdout:5/925: symlink d1/d2e/da6/d24/l143 0 2023-12-05T09:57:46.799 INFO:tasks.workunit.client.0.smithi100.stdout:2/994: dread d7/da/d18/f12e [0,4194304] 0 2023-12-05T09:57:46.799 INFO:tasks.workunit.client.0.smithi100.stdout:2/995: readlink d7/da/d13/d4e/l10c 0 2023-12-05T09:57:46.799 INFO:tasks.workunit.client.0.smithi100.stdout:2/996: dread - d7/da/d13/d69/d6e/fd4 zero size 2023-12-05T09:57:46.806 INFO:tasks.workunit.client.0.smithi100.stdout:0/879: rmdir da/d22/d33/d74/dca/d10d 0 2023-12-05T09:57:46.811 INFO:tasks.workunit.client.1.smithi150.stdout:6/834: rename d2/d23/d3b/df0/d97/c103 to d2/d23/c112 0 2023-12-05T09:57:46.812 INFO:tasks.workunit.client.1.smithi150.stdout:8/985: dread d0/d41/d49/fcb [0,4194304] 0 2023-12-05T09:57:46.820 INFO:tasks.workunit.client.0.smithi100.stdout:8/894: creat d0/d12/d13/d45/dba/f10a x:0 0 0 2023-12-05T09:57:46.820 INFO:tasks.workunit.client.0.smithi100.stdout:8/895: write d0/d12/d13/d45/fd1 [405494,29994] 0 2023-12-05T09:57:46.820 INFO:tasks.workunit.client.0.smithi100.stdout:8/896: write d0/d12/d13/d45/da6/f69 [18547,59981] 0 2023-12-05T09:57:46.820 INFO:tasks.workunit.client.0.smithi100.stdout:8/897: write d0/d12/d13/d45/da6/d9c/fca [191625,1124] 0 2023-12-05T09:57:46.820 INFO:tasks.workunit.client.0.smithi100.stdout:8/898: chown d0/f19 22 1 2023-12-05T09:57:46.820 INFO:tasks.workunit.client.0.smithi100.stdout:8/899: read d0/d35/d64/f85 [482119,21659] 0 2023-12-05T09:57:46.822 INFO:tasks.workunit.client.1.smithi150.stdout:2/980: dwrite d0/d3/d21/d4d/deb/fb5 [0,4194304] 0 2023-12-05T09:57:46.823 INFO:tasks.workunit.client.0.smithi100.stdout:9/941: rename d7/d1b/d22/d51/d32/d96/f10d to d7/d1b/d22/d93/dc9/f150 0 2023-12-05T09:57:46.824 INFO:tasks.workunit.client.0.smithi100.stdout:1/879: read db/d31/d3a/f3e [7737901,66] 0 2023-12-05T09:57:46.829 INFO:tasks.workunit.client.0.smithi100.stdout:5/975: dwrite d0/d1f/da1/d11b/df/fe2 [0,4194304] 0 2023-12-05T09:57:46.830 INFO:tasks.workunit.client.0.smithi100.stdout:8/900: mknod d0/d12/d13/d45/dba/df1/d103/c10b 0 2023-12-05T09:57:46.830 INFO:tasks.workunit.client.0.smithi100.stdout:5/976: write d0/d1b/d4d/d8e/d96/dc1/f139 [947890,104604] 0 2023-12-05T09:57:46.830 INFO:tasks.workunit.client.0.smithi100.stdout:5/977: write d0/f36 [4381013,17630] 0 2023-12-05T09:57:46.832 INFO:tasks.workunit.client.1.smithi150.stdout:9/882: dwrite d3/d9/dc/d1f/fa1 [0,4194304] 0 2023-12-05T09:57:46.832 INFO:tasks.workunit.client.1.smithi150.stdout:9/883: truncate d3/d1b/d46/f10b 935169 0 2023-12-05T09:57:46.833 INFO:tasks.workunit.client.0.smithi100.stdout:7/851: dwrite d3/dc/d11/d13/de/d2d/ff4 [0,4194304] 0 2023-12-05T09:57:46.833 INFO:tasks.workunit.client.0.smithi100.stdout:7/852: chown d3/dc/d11/d13/de/d18/d3b/d40/f112 10890858 1 2023-12-05T09:57:46.838 INFO:tasks.workunit.client.0.smithi100.stdout:9/942: creat d7/d35/d71/d9a/dcd/d122/f151 x:0 0 0 2023-12-05T09:57:46.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:46 smithi150 ceph-mon[116142]: pgmap v39: 65 pgs: 65 active+clean; 3.6 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 246 MiB/s rd, 311 MiB/s wr, 447 op/s 2023-12-05T09:57:46.846 INFO:tasks.workunit.client.0.smithi100.stdout:3/972: rename d0/d3d/d5c/d139/de/d8d/d11e/c136 to d0/d3d/d5c/d139/de/d11/d7c/dd0/c14f 0 2023-12-05T09:57:46.846 INFO:tasks.workunit.client.0.smithi100.stdout:7/853: rename d3/dc/d11/d13/d1b to d3/dc/d11/d13/d1b/d60/d136 22 2023-12-05T09:57:46.846 INFO:tasks.workunit.client.0.smithi100.stdout:7/854: chown d3/dc/d11/d13/d1b/c69 33 1 2023-12-05T09:57:46.848 INFO:tasks.workunit.client.0.smithi100.stdout:4/848: write de/d16/d23/d60/df7/f4d [2519194,112926] 0 2023-12-05T09:57:46.850 INFO:tasks.workunit.client.1.smithi150.stdout:8/986: dwrite d0/d41/d49/d1b/d24/d34/d56/f60 [0,4194304] 0 2023-12-05T09:57:46.859 INFO:tasks.workunit.client.0.smithi100.stdout:1/880: mknod db/d12/d1e/d26/d39/de9/c10d 0 2023-12-05T09:57:46.860 INFO:tasks.workunit.client.1.smithi150.stdout:3/948: symlink d6/d9/d3d/d56/d129/l135 0 2023-12-05T09:57:46.864 INFO:tasks.workunit.client.1.smithi150.stdout:4/859: mknod d0/d3e/d5b/d80/da1/db2/dbe/c105 0 2023-12-05T09:57:46.869 INFO:tasks.workunit.client.1.smithi150.stdout:5/926: creat d1/d7f/d65/d3b/d6b/d109/d13e/f144 x:0 0 0 2023-12-05T09:57:46.869 INFO:tasks.workunit.client.1.smithi150.stdout:5/927: read - d1/d7f/fd2 zero size 2023-12-05T09:57:46.874 INFO:tasks.workunit.client.1.smithi150.stdout:6/835: creat d2/d23/d3b/d64/f113 x:0 0 0 2023-12-05T09:57:46.883 INFO:tasks.workunit.client.1.smithi150.stdout:2/981: mknod d0/d3/d21/c14e 0 2023-12-05T09:57:46.884 INFO:tasks.workunit.client.0.smithi100.stdout:1/881: dread db/d12/d1e/dd3/db8/fd9 [0,4194304] 0 2023-12-05T09:57:46.885 INFO:tasks.workunit.client.1.smithi150.stdout:5/928: dread d1/d7f/d65/d3b/d37/faf [0,4194304] 0 2023-12-05T09:57:46.886 INFO:tasks.workunit.client.0.smithi100.stdout:9/943: dwrite d7/d20/d69/def/da2/fa8 [0,4194304] 0 2023-12-05T09:57:46.886 INFO:tasks.workunit.client.0.smithi100.stdout:9/944: truncate d7/d35/d71/f135 846112 0 2023-12-05T09:57:46.887 INFO:tasks.workunit.client.1.smithi150.stdout:9/884: dwrite d3/d1b/d46/d55/d64/fc3 [0,4194304] 0 2023-12-05T09:57:46.887 INFO:tasks.workunit.client.1.smithi150.stdout:9/885: readlink d3/d9/dc/d1f/lb6 0 2023-12-05T09:57:46.887 INFO:tasks.workunit.client.1.smithi150.stdout:8/987: symlink d0/d41/d49/l13b 0 2023-12-05T09:57:46.889 INFO:tasks.workunit.client.0.smithi100.stdout:8/901: link d0/d12/fc1 d0/d35/f10c 0 2023-12-05T09:57:46.891 INFO:tasks.workunit.client.1.smithi150.stdout:3/949: truncate d6/d9/d43/d47/d94/df1/d10b/f12a 192811 0 2023-12-05T09:57:46.891 INFO:tasks.workunit.client.1.smithi150.stdout:3/950: chown d6/d9/d3d/d56/d71/db0/f101 29 1 2023-12-05T09:57:46.894 INFO:tasks.workunit.client.1.smithi150.stdout:4/860: mknod d0/d3e/d6d/ddf/da4/c106 0 2023-12-05T09:57:46.898 INFO:tasks.workunit.client.1.smithi150.stdout:6/836: rmdir d2/d23/d2e/d5f/d99/dd8/ddf/dfa 39 2023-12-05T09:57:46.898 INFO:tasks.workunit.client.1.smithi150.stdout:6/837: creat d2/d23/d2e/d44/f114 x:0 0 0 2023-12-05T09:57:46.898 INFO:tasks.workunit.client.1.smithi150.stdout:6/838: readlink d2/d23/d2e/l5b 0 2023-12-05T09:57:46.900 INFO:tasks.workunit.client.0.smithi100.stdout:5/978: truncate d0/d1b/d4d/d8e/d96/fed 321196 0 2023-12-05T09:57:46.901 INFO:tasks.workunit.client.1.smithi150.stdout:2/982: mkdir d0/d3/d27/d51/d14f 0 2023-12-05T09:57:46.904 INFO:tasks.workunit.client.1.smithi150.stdout:5/929: symlink d1/d64/dfd/l145 0 2023-12-05T09:57:46.909 INFO:tasks.workunit.client.1.smithi150.stdout:7/943: sync 2023-12-05T09:57:46.909 INFO:tasks.workunit.client.1.smithi150.stdout:7/944: creat d2/db/d2e/d71/f139 x:0 0 0 2023-12-05T09:57:46.909 INFO:tasks.workunit.client.1.smithi150.stdout:7/945: write d2/d4/f108 [36685,1859] 0 2023-12-05T09:57:46.909 INFO:tasks.workunit.client.1.smithi150.stdout:7/946: dread - d2/db/d2e/d71/f102 zero size 2023-12-05T09:57:46.913 INFO:tasks.workunit.client.0.smithi100.stdout:7/855: link d3/dc/d11/d13/de/d18/d3b/d40/fb8 d3/dc/d11/d13/de/d2d/f137 0 2023-12-05T09:57:46.914 INFO:tasks.workunit.client.0.smithi100.stdout:3/973: rmdir d0/d3d/d5c/d139/de/d8d/dc9/d110 39 2023-12-05T09:57:46.923 INFO:tasks.workunit.client.0.smithi100.stdout:4/849: dwrite de/d16/d23/d33/fa0 [0,4194304] 0 2023-12-05T09:57:46.923 INFO:tasks.workunit.client.0.smithi100.stdout:4/850: chown de/d38/d5d/ld8 888 1 2023-12-05T09:57:46.932 INFO:tasks.workunit.client.1.smithi150.stdout:9/886: getdents d3/d9/dc/d1f 0 2023-12-05T09:57:46.935 INFO:tasks.workunit.client.1.smithi150.stdout:8/988: truncate d0/d41/d49/d1b/d24/d38/f3d 2011007 0 2023-12-05T09:57:46.938 INFO:tasks.workunit.client.0.smithi100.stdout:9/945: mkdir d7/d1b/d22/d2a/d56/d9c/daa/d152 0 2023-12-05T09:57:46.938 INFO:tasks.workunit.client.0.smithi100.stdout:9/946: write d7/d1b/d22/d51/d32/d96/f14a [163340,73288] 0 2023-12-05T09:57:46.941 INFO:tasks.workunit.client.0.smithi100.stdout:4/851: dread de/d16/d23/d36/f3e [0,4194304] 0 2023-12-05T09:57:46.942 INFO:tasks.workunit.client.0.smithi100.stdout:4/852: chown de/d16/f52 2691048 1 2023-12-05T09:57:46.943 INFO:tasks.workunit.client.1.smithi150.stdout:3/951: mkdir d6/d9/d43/d47/d94/d136 0 2023-12-05T09:57:46.945 INFO:tasks.workunit.client.1.smithi150.stdout:4/861: dwrite d0/d3e/d5b/f9b [0,4194304] 0 2023-12-05T09:57:46.948 INFO:tasks.workunit.client.0.smithi100.stdout:5/979: creat d0/d1b/d4d/d8e/d125/f159 x:0 0 0 2023-12-05T09:57:46.948 INFO:tasks.workunit.client.0.smithi100.stdout:5/980: stat d0/d1f/da1/d11b/df/d51/f149 0 2023-12-05T09:57:46.949 INFO:tasks.workunit.client.0.smithi100.stdout:8/902: dwrite d0/d12/d13/d45/da6/f69 [0,4194304] 0 2023-12-05T09:57:46.950 INFO:tasks.workunit.client.1.smithi150.stdout:6/839: creat d2/d23/d2e/d5f/df5/f115 x:0 0 0 2023-12-05T09:57:46.950 INFO:tasks.workunit.client.1.smithi150.stdout:6/840: chown d2/d23/d2e/d44/fbc 4859942 1 2023-12-05T09:57:46.950 INFO:tasks.workunit.client.1.smithi150.stdout:6/841: creat d2/d23/d3b/d83/f116 x:0 0 0 2023-12-05T09:57:46.950 INFO:tasks.workunit.client.1.smithi150.stdout:6/842: creat d2/d23/d3b/f117 x:0 0 0 2023-12-05T09:57:46.953 INFO:tasks.workunit.client.1.smithi150.stdout:2/983: symlink d0/d3/d21/d4d/l150 0 2023-12-05T09:57:46.954 INFO:tasks.workunit.client.1.smithi150.stdout:4/862: dread d0/d3e/d6d/fc3 [0,4194304] 0 2023-12-05T09:57:46.954 INFO:tasks.workunit.client.1.smithi150.stdout:4/863: readlink d0/d3e/d6d/l38 0 2023-12-05T09:57:46.955 INFO:tasks.workunit.client.0.smithi100.stdout:5/981: write d0/d1f/d25/d31/f119 [483341,85873] 0 2023-12-05T09:57:46.955 INFO:tasks.workunit.client.0.smithi100.stdout:5/982: chown d0/d1b/d4d/d8e/d96/dc1/d12e/l151 269989377 1 2023-12-05T09:57:46.957 INFO:tasks.workunit.client.0.smithi100.stdout:7/856: creat d3/dc/d11/d13/de/d2d/d42/f138 x:0 0 0 2023-12-05T09:57:46.959 INFO:tasks.workunit.client.1.smithi150.stdout:5/930: link d1/d64/ded/f125 d1/d7f/d65/d3b/d6b/d109/d11f/f146 0 2023-12-05T09:57:46.970 INFO:tasks.workunit.client.1.smithi150.stdout:6/843: dread d2/d23/d3b/d64/d7a/d5d/d6b/f22 [0,4194304] 0 2023-12-05T09:57:46.972 INFO:tasks.workunit.client.1.smithi150.stdout:2/984: write d0/d3/d27/d51/fd5 [1447724,15144] 0 2023-12-05T09:57:46.976 INFO:tasks.workunit.client.1.smithi150.stdout:1/981: sync 2023-12-05T09:57:46.976 INFO:tasks.workunit.client.1.smithi150.stdout:1/982: creat d6/d47/d4c/d60/f14e x:0 0 0 2023-12-05T09:57:46.976 INFO:tasks.workunit.client.1.smithi150.stdout:1/983: fsync d6/d47/d4c/dd9/f22 0 2023-12-05T09:57:46.977 INFO:tasks.workunit.client.1.smithi150.stdout:9/887: rename d3/d1b/d46/d55/d64/c65 to d3/d9/dc/d1f/d24/d75/d95/d9a/dcb/de4/def/c11b 0 2023-12-05T09:57:46.977 INFO:tasks.workunit.client.1.smithi150.stdout:9/888: write d3/d1b/f119 [707860,72648] 0 2023-12-05T09:57:46.977 INFO:tasks.workunit.client.1.smithi150.stdout:9/889: fdatasync d3/d9/d26/d9b/faa 0 2023-12-05T09:57:46.985 INFO:tasks.workunit.client.0.smithi100.stdout:1/882: symlink db/d12/d1e/de0/l10e 0 2023-12-05T09:57:46.989 INFO:tasks.workunit.client.1.smithi150.stdout:8/989: creat d0/d41/d49/dd3/df9/f13c x:0 0 0 2023-12-05T09:57:46.991 INFO:tasks.workunit.client.1.smithi150.stdout:3/952: mkdir d6/d25/dd9/df2/d133/d137 0 2023-12-05T09:57:47.008 INFO:tasks.workunit.client.1.smithi150.stdout:4/864: mknod d0/d3e/d48/dbb/dca/dee/c107 0 2023-12-05T09:57:47.009 INFO:tasks.workunit.client.0.smithi100.stdout:4/853: mknod de/d16/d23/d60/df7/d4e/d85/d107/c115 0 2023-12-05T09:57:47.009 INFO:tasks.workunit.client.0.smithi100.stdout:4/854: stat de/d38/d86/lc6 0 2023-12-05T09:57:47.009 INFO:tasks.workunit.client.0.smithi100.stdout:4/855: fdatasync de/d16/d23/d60/df7/f4d 0 2023-12-05T09:57:47.009 INFO:tasks.workunit.client.0.smithi100.stdout:4/856: truncate de/f1b 4388049 0 2023-12-05T09:57:47.010 INFO:tasks.workunit.client.0.smithi100.stdout:1/883: dread db/d12/d61/f85 [0,4194304] 0 2023-12-05T09:57:47.010 INFO:tasks.workunit.client.0.smithi100.stdout:8/903: getdents d0/d12/d13/d45/dc9 0 2023-12-05T09:57:47.012 INFO:tasks.workunit.client.1.smithi150.stdout:6/844: creat d2/d23/d2e/dd6/df3/f118 x:0 0 0 2023-12-05T09:57:47.013 INFO:tasks.workunit.client.0.smithi100.stdout:3/974: dwrite d0/d3d/d5c/d139/de/d11/d7c/dd0/d125/f99 [0,4194304] 0 2023-12-05T09:57:47.013 INFO:tasks.workunit.client.0.smithi100.stdout:9/947: dwrite d7/d20/d69/f72 [0,4194304] 0 2023-12-05T09:57:47.016 INFO:tasks.workunit.client.1.smithi150.stdout:5/931: dwrite d1/f8c [0,4194304] 0 2023-12-05T09:57:47.016 INFO:tasks.workunit.client.0.smithi100.stdout:5/983: creat d0/d16/d2b/d75/f15a x:0 0 0 2023-12-05T09:57:47.020 INFO:tasks.workunit.client.0.smithi100.stdout:1/884: dread db/d12/f45 [0,4194304] 0 2023-12-05T09:57:47.020 INFO:tasks.workunit.client.0.smithi100.stdout:7/857: rename d3/dc/d11/d13/de/f28 to d3/dc/d11/d13/de/d18/d3b/d40/d46/f139 0 2023-12-05T09:57:47.021 INFO:tasks.workunit.client.0.smithi100.stdout:7/858: readlink d3/l2c 0 2023-12-05T09:57:47.021 INFO:tasks.workunit.client.0.smithi100.stdout:7/859: dread - d3/dc/d11/d33/fb4 zero size 2023-12-05T09:57:47.027 INFO:tasks.workunit.client.0.smithi100.stdout:8/904: truncate d0/d12/d52/f8e 4497769 0 2023-12-05T09:57:47.027 INFO:tasks.workunit.client.0.smithi100.stdout:8/905: rename d0/d12/d13/d45/da6 to d0/d12/d13/d45/da6/d10d 22 2023-12-05T09:57:47.027 INFO:tasks.workunit.client.0.smithi100.stdout:8/906: write d0/d12/d13/d16/d42/f8c [1937462,74080] 0 2023-12-05T09:57:47.028 INFO:tasks.workunit.client.1.smithi150.stdout:2/985: dwrite d0/d3/d5/d10/f45 [0,4194304] 0 2023-12-05T09:57:47.029 INFO:tasks.workunit.client.1.smithi150.stdout:1/984: mkdir d6/d47/dcf/d14f 0 2023-12-05T09:57:47.029 INFO:tasks.workunit.client.1.smithi150.stdout:1/985: write d6/d3c/dc2/fef [474591,33834] 0 2023-12-05T09:57:47.029 INFO:tasks.workunit.client.1.smithi150.stdout:1/986: readlink d6/d38/d4a/lb2 0 2023-12-05T09:57:47.031 INFO:tasks.workunit.client.1.smithi150.stdout:9/890: creat d3/d9/d26/d9b/df6/f11c x:0 0 0 2023-12-05T09:57:47.031 INFO:tasks.workunit.client.1.smithi150.stdout:9/891: stat d3/d9/dc 0 2023-12-05T09:57:47.037 INFO:tasks.workunit.client.1.smithi150.stdout:1/987: dread d6/d8/db/d1b/d79/f86 [0,4194304] 0 2023-12-05T09:57:47.037 INFO:tasks.workunit.client.1.smithi150.stdout:1/988: write d6/d8/f11 [1534284,23076] 0 2023-12-05T09:57:47.037 INFO:tasks.workunit.client.1.smithi150.stdout:1/989: chown d6/d8/d54/d12b 5733338 1 2023-12-05T09:57:47.040 INFO:tasks.workunit.client.1.smithi150.stdout:8/990: creat d0/d41/d49/d1b/d24/d38/dad/f13d x:0 0 0 2023-12-05T09:57:47.040 INFO:tasks.workunit.client.1.smithi150.stdout:8/991: chown d0/d41/d49/d1b/d24/d5b/d9c/d129/d137 32940 1 2023-12-05T09:57:47.043 INFO:tasks.workunit.client.1.smithi150.stdout:3/953: mknod d6/d25/dcf/c138 0 2023-12-05T09:57:47.045 INFO:tasks.workunit.client.1.smithi150.stdout:4/865: mkdir d0/d3e/d5b/de4/d108 0 2023-12-05T09:57:47.047 INFO:tasks.workunit.client.1.smithi150.stdout:6/845: unlink c1 0 2023-12-05T09:57:47.054 INFO:tasks.workunit.client.0.smithi100.stdout:4/857: dread de/d16/d23/d36/dfe/f6f [0,4194304] 0 2023-12-05T09:57:47.054 INFO:tasks.workunit.client.0.smithi100.stdout:4/858: write de/d16/d23/fbf [860509,81375] 0 2023-12-05T09:57:47.054 INFO:tasks.workunit.client.0.smithi100.stdout:4/859: chown de/d38/d5d/cde 1 1 2023-12-05T09:57:47.054 INFO:tasks.workunit.client.0.smithi100.stdout:9/948: link d7/d1b/d22/d2a/d56/d9c/daa/d102/l13b d7/db5/l153 0 2023-12-05T09:57:47.054 INFO:tasks.workunit.client.0.smithi100.stdout:9/949: stat d7/f9 0 2023-12-05T09:57:47.057 INFO:tasks.workunit.client.0.smithi100.stdout:9/950: write d7/d20/d68/fd3 [785799,19099] 0 2023-12-05T09:57:47.058 INFO:tasks.workunit.client.1.smithi150.stdout:5/932: dwrite d1/d2e/da6/d86/fee [0,4194304] 0 2023-12-05T09:57:47.058 INFO:tasks.workunit.client.1.smithi150.stdout:5/933: fsync d1/d64/ded/f125 0 2023-12-05T09:57:47.058 INFO:tasks.workunit.client.1.smithi150.stdout:5/934: write d1/d7f/d65/ff9 [886755,63386] 0 2023-12-05T09:57:47.058 INFO:tasks.workunit.client.1.smithi150.stdout:5/935: write d1/d7f/d65/d3b/d6b/d11e/fd7 [28069,36793] 0 2023-12-05T09:57:47.058 INFO:tasks.workunit.client.1.smithi150.stdout:7/947: rmdir d2/d1b/d5b/d6a 0 2023-12-05T09:57:47.059 INFO:tasks.workunit.client.0.smithi100.stdout:5/984: symlink d0/d16/d37/d138/l15b 0 2023-12-05T09:57:47.059 INFO:tasks.workunit.client.0.smithi100.stdout:5/985: creat d0/d1b/f15c x:0 0 0 2023-12-05T09:57:47.063 INFO:tasks.workunit.client.0.smithi100.stdout:1/885: link db/d31/d73/le2 db/d12/d1e/d26/d30/d52/d84/l10f 0 2023-12-05T09:57:47.063 INFO:tasks.workunit.client.0.smithi100.stdout:1/886: fsync db/d12/d1e/d26/d30/d6e/ffb 0 2023-12-05T09:57:47.063 INFO:tasks.workunit.client.0.smithi100.stdout:1/887: stat db/d31/d3a/d3b/fa1 0 2023-12-05T09:57:47.064 INFO:tasks.workunit.client.1.smithi150.stdout:2/986: mkdir d0/d3/d21/d4d/deb/d103/d15/d151 0 2023-12-05T09:57:47.064 INFO:tasks.workunit.client.1.smithi150.stdout:2/987: read - d0/d3/d5/d22/d52/d5a/d108/d114/f145 zero size 2023-12-05T09:57:47.066 INFO:tasks.workunit.client.0.smithi100.stdout:7/860: creat d3/dc/d11/d13/de/d2d/d47/ddd/f13a x:0 0 0 2023-12-05T09:57:47.069 INFO:tasks.workunit.client.1.smithi150.stdout:9/892: rename d3/d9/dc/d1f/f25 to d3/d9/dc/d1f/d24/d75/d95/d9a/f11d 0 2023-12-05T09:57:47.069 INFO:tasks.workunit.client.1.smithi150.stdout:9/893: write d3/d9/dc/f92 [8752393,116803] 0 2023-12-05T09:57:47.070 INFO:tasks.workunit.client.0.smithi100.stdout:3/975: dwrite d0/d3d/d5c/d139/de/d11/db5/f11d [0,4194304] 0 2023-12-05T09:57:47.073 INFO:tasks.workunit.client.0.smithi100.stdout:0/880: sync 2023-12-05T09:57:47.074 INFO:tasks.workunit.client.0.smithi100.stdout:0/881: truncate da/f2d 109961 0 2023-12-05T09:57:47.076 INFO:tasks.workunit.client.0.smithi100.stdout:4/860: read de/d16/d23/d60/d98/da6/fb5 [1047240,90364] 0 2023-12-05T09:57:47.076 INFO:tasks.workunit.client.0.smithi100.stdout:4/861: write de/d38/d5d/f6e [1120687,14687] 0 2023-12-05T09:57:47.076 INFO:tasks.workunit.client.1.smithi150.stdout:1/990: symlink d6/d3c/l150 0 2023-12-05T09:57:47.080 INFO:tasks.workunit.client.0.smithi100.stdout:2/997: sync 2023-12-05T09:57:47.081 INFO:tasks.workunit.client.1.smithi150.stdout:2/988: dread d0/d42/f118 [0,4194304] 0 2023-12-05T09:57:47.081 INFO:tasks.workunit.client.1.smithi150.stdout:8/992: symlink d0/d41/d49/d1b/d24/d34/da2/dff/l13e 0 2023-12-05T09:57:47.084 INFO:tasks.workunit.client.1.smithi150.stdout:3/954: creat d6/d9/d3d/d11e/f139 x:0 0 0 2023-12-05T09:57:47.086 INFO:tasks.workunit.client.0.smithi100.stdout:5/986: rename d0/d1b/d4d/d6c/l8b to d0/d1b/d4d/d8e/d96/dc1/dae/db9/l15d 0 2023-12-05T09:57:47.087 INFO:tasks.workunit.client.1.smithi150.stdout:4/866: mknod d0/d3e/d48/dbb/c109 0 2023-12-05T09:57:47.095 INFO:tasks.workunit.client.0.smithi100.stdout:4/862: dread de/d16/d1e/f30 [0,4194304] 0 2023-12-05T09:57:47.095 INFO:tasks.workunit.client.0.smithi100.stdout:4/863: chown de/d16/cb8 98806421 1 2023-12-05T09:57:47.167 INFO:tasks.workunit.client.1.smithi150.stdout:6/846: symlink d2/d23/d2e/d5f/d99/dd8/l119 0 2023-12-05T09:57:47.168 INFO:tasks.workunit.client.1.smithi150.stdout:3/955: write d6/d9/d43/d47/d8c/fc9 [2645338,10908] 0 2023-12-05T09:57:47.169 INFO:tasks.workunit.client.0.smithi100.stdout:7/861: creat d3/dc/d11/d13/de/d18/d3b/dd7/f13b x:0 0 0 2023-12-05T09:57:47.173 INFO:tasks.workunit.client.1.smithi150.stdout:5/936: mkdir d1/d64/dfd/d11a/d147 0 2023-12-05T09:57:47.174 INFO:tasks.workunit.client.1.smithi150.stdout:5/937: dread - d1/d7f/d65/d3b/d6b/d11e/dca/f108 zero size 2023-12-05T09:57:47.174 INFO:tasks.workunit.client.1.smithi150.stdout:5/938: fdatasync d1/d7f/d65/f57 0 2023-12-05T09:57:47.174 INFO:tasks.workunit.client.0.smithi100.stdout:3/976: dwrite d0/d48/f148 [0,4194304] 0 2023-12-05T09:57:47.175 INFO:tasks.workunit.client.1.smithi150.stdout:7/948: getdents d2/d1b/d31 0 2023-12-05T09:57:47.175 INFO:tasks.workunit.client.1.smithi150.stdout:7/949: creat d2/db/d30/d53/f13a x:0 0 0 2023-12-05T09:57:47.177 INFO:tasks.workunit.client.0.smithi100.stdout:0/882: symlink da/d22/d33/l10f 0 2023-12-05T09:57:47.177 INFO:tasks.workunit.client.0.smithi100.stdout:0/883: fdatasync da/d22/d33/d74/f79 0 2023-12-05T09:57:47.177 INFO:tasks.workunit.client.0.smithi100.stdout:1/888: dwrite db/d12/d1e/dd3/dc7/fca [0,4194304] 0 2023-12-05T09:57:47.181 INFO:tasks.workunit.client.1.smithi150.stdout:9/894: unlink d3/d9/d58/fa9 0 2023-12-05T09:57:47.181 INFO:tasks.workunit.client.1.smithi150.stdout:9/895: write d3/d9/dc/d1f/d24/d75/d95/d9a/dcb/fe5 [1241195,58014] 0 2023-12-05T09:57:47.181 INFO:tasks.workunit.client.1.smithi150.stdout:9/896: truncate d3/d9/d26/daf/f110 256490 0 2023-12-05T09:57:47.181 INFO:tasks.workunit.client.1.smithi150.stdout:9/897: fdatasync d3/d9/d58/fc5 0 2023-12-05T09:57:47.182 INFO:tasks.workunit.client.1.smithi150.stdout:3/956: dread d6/d9/d3d/d56/d30/f5e [0,4194304] 0 2023-12-05T09:57:47.183 INFO:tasks.workunit.client.1.smithi150.stdout:1/991: symlink d6/d47/d4c/d60/l151 0 2023-12-05T09:57:47.183 INFO:tasks.workunit.client.1.smithi150.stdout:1/992: write d6/d3c/f40 [1747390,62392] 0 2023-12-05T09:57:47.189 INFO:tasks.workunit.client.1.smithi150.stdout:8/993: symlink d0/d41/d49/dda/l13f 0 2023-12-05T09:57:47.191 INFO:tasks.workunit.client.1.smithi150.stdout:5/939: dread d1/f51 [4194304,4194304] 0 2023-12-05T09:57:47.192 INFO:tasks.workunit.client.0.smithi100.stdout:1/889: dread db/d31/d3a/f5b [4194304,4194304] 0 2023-12-05T09:57:47.192 INFO:tasks.workunit.client.0.smithi100.stdout:1/890: stat db/d31/d73/cf8 0 2023-12-05T09:57:47.194 INFO:tasks.workunit.client.1.smithi150.stdout:4/867: creat d0/d3e/d6d/d4b/f10a x:0 0 0 2023-12-05T09:57:47.194 INFO:tasks.workunit.client.1.smithi150.stdout:4/868: fsync d0/f3c 0 2023-12-05T09:57:47.194 INFO:tasks.workunit.client.1.smithi150.stdout:1/993: dread d6/d47/d4c/dd9/d75/dc4/fc1 [0,4194304] 0 2023-12-05T09:57:47.195 INFO:tasks.workunit.client.0.smithi100.stdout:2/998: rename d7/da/d13/l1d to d7/da/d18/d21/d4d/l149 0 2023-12-05T09:57:47.196 INFO:tasks.workunit.client.0.smithi100.stdout:2/999: dread - d7/da/d1a/fea zero size 2023-12-05T09:57:47.197 INFO:tasks.workunit.client.1.smithi150.stdout:6/847: creat d2/f11a x:0 0 0 2023-12-05T09:57:47.198 INFO:tasks.workunit.client.0.smithi100.stdout:7/862: creat d3/dc/d11/d13/d37/d97/f13c x:0 0 0 2023-12-05T09:57:47.203 INFO:tasks.workunit.client.1.smithi150.stdout:7/950: unlink d2/db/d30/d18/d1a/f68 0 2023-12-05T09:57:47.205 INFO:tasks.workunit.client.0.smithi100.stdout:3/977: link d0/d3d/f108 d0/d3d/d5c/d139/de/d12/d9b/f150 0 2023-12-05T09:57:47.207 INFO:tasks.workunit.client.1.smithi150.stdout:3/957: symlink d6/d9/d3d/d56/d53/d51/l13a 0 2023-12-05T09:57:47.207 INFO:tasks.workunit.client.1.smithi150.stdout:3/958: creat d6/d25/dcf/f13b x:0 0 0 2023-12-05T09:57:47.213 INFO:tasks.workunit.client.1.smithi150.stdout:5/940: symlink d1/d3/d6/d72/l148 0 2023-12-05T09:57:47.213 INFO:tasks.workunit.client.1.smithi150.stdout:5/941: chown d1/d7f/d65/d3b/d6b/d11e/dca/de2 7628 1 2023-12-05T09:57:47.213 INFO:tasks.workunit.client.1.smithi150.stdout:2/989: truncate d0/d3/d5/d10/f45 3547004 0 2023-12-05T09:57:47.214 INFO:tasks.workunit.client.0.smithi100.stdout:1/891: creat db/d12/d1e/d26/d39/f110 x:0 0 0 2023-12-05T09:57:47.216 INFO:tasks.workunit.client.0.smithi100.stdout:5/987: rename d0/d1f/d53 to d0/d1b/d4d/d8e/d15e 0 2023-12-05T09:57:47.216 INFO:tasks.workunit.client.1.smithi150.stdout:3/959: dread d6/fd4 [0,4194304] 0 2023-12-05T09:57:47.217 INFO:tasks.workunit.client.1.smithi150.stdout:1/994: mknod d6/d47/d4c/dd9/daf/d121/c152 0 2023-12-05T09:57:47.217 INFO:tasks.workunit.client.1.smithi150.stdout:1/995: dread - d6/d8/d85/d10e/d13b/f13c zero size 2023-12-05T09:57:47.217 INFO:tasks.workunit.client.1.smithi150.stdout:1/996: chown d6/d47/d4c/dd9/c6d 855998 1 2023-12-05T09:57:47.218 INFO:tasks.workunit.client.0.smithi100.stdout:7/863: creat d3/dc/d11/d13/de/d2d/d47/dbd/f13d x:0 0 0 2023-12-05T09:57:47.218 INFO:tasks.workunit.client.0.smithi100.stdout:7/864: readlink d3/dc/d11/d13/de/d2d/d47/lb0 0 2023-12-05T09:57:47.219 INFO:tasks.workunit.client.1.smithi150.stdout:7/951: mknod d2/db/d2e/d9a/c13b 0 2023-12-05T09:57:47.220 INFO:tasks.workunit.client.0.smithi100.stdout:3/978: link d0/d3d/d5c/d139/de/db8/dee/df6/f11a d0/d4/f151 0 2023-12-05T09:57:47.223 INFO:tasks.workunit.client.0.smithi100.stdout:5/988: dread d0/d1b/d4d/d8e/d96/dea/f100 [0,4194304] 0 2023-12-05T09:57:47.228 INFO:tasks.workunit.client.0.smithi100.stdout:9/951: write d7/d1b/d22/d51/f7f [1001260,113792] 0 2023-12-05T09:57:47.234 INFO:tasks.workunit.client.0.smithi100.stdout:4/864: rename de/d16/d1e/f2e to de/d38/d86/f116 0 2023-12-05T09:57:47.236 INFO:tasks.workunit.client.1.smithi150.stdout:8/994: rmdir d0/d41/d49/d1b/d24/d2e/d105 39 2023-12-05T09:57:47.236 INFO:tasks.workunit.client.1.smithi150.stdout:8/995: stat d0/d41/d49/d1b/d24/f63 0 2023-12-05T09:57:47.238 INFO:tasks.workunit.client.0.smithi100.stdout:9/952: mknod d7/d35/c154 0 2023-12-05T09:57:47.239 INFO:tasks.workunit.client.1.smithi150.stdout:2/990: rmdir d0/d3/d5/d10/d3d/da1/daa/d11e 39 2023-12-05T09:57:47.241 INFO:tasks.workunit.client.1.smithi150.stdout:4/869: getdents d0/d3e/d6d/d95 0 2023-12-05T09:57:47.242 INFO:tasks.workunit.client.0.smithi100.stdout:3/979: dread d0/d3d/d5c/d5f/f104 [0,4194304] 0 2023-12-05T09:57:47.243 INFO:tasks.workunit.client.1.smithi150.stdout:3/960: symlink d6/d9/d3d/d56/d30/d104/l13c 0 2023-12-05T09:57:47.246 INFO:tasks.workunit.client.0.smithi100.stdout:4/865: read de/d38/d5d/f6e [595742,46873] 0 2023-12-05T09:57:47.257 INFO:tasks.workunit.client.1.smithi150.stdout:8/996: mknod d0/d41/d49/d1b/d24/d38/d134/c140 0 2023-12-05T09:57:47.257 INFO:tasks.workunit.client.1.smithi150.stdout:1/997: creat d6/d3c/dc2/dde/df4/d10a/d12d/f153 x:0 0 0 2023-12-05T09:57:47.257 INFO:tasks.workunit.client.1.smithi150.stdout:8/997: dread - d0/d41/d49/d1b/f93 zero size 2023-12-05T09:57:47.260 INFO:tasks.workunit.client.0.smithi100.stdout:9/953: write d7/d1b/d22/d2a/d56/daf/fd0 [30413,41933] 0 2023-12-05T09:57:47.261 INFO:tasks.workunit.client.0.smithi100.stdout:4/866: dread de/d16/d23/d60/df7/f82 [0,4194304] 0 2023-12-05T09:57:47.261 INFO:tasks.workunit.client.0.smithi100.stdout:0/884: dwrite da/d1b/d6b/f6c [4194304,4194304] 0 2023-12-05T09:57:47.261 INFO:tasks.workunit.client.0.smithi100.stdout:0/885: dread - da/d1b/d73/d82/ffc zero size 2023-12-05T09:57:47.262 INFO:tasks.workunit.client.0.smithi100.stdout:0/886: readlink da/d22/d33/d35/ldc 0 2023-12-05T09:57:47.262 INFO:tasks.workunit.client.0.smithi100.stdout:0/887: creat da/f110 x:0 0 0 2023-12-05T09:57:47.262 INFO:tasks.workunit.client.0.smithi100.stdout:0/888: readlink da/d60/l7a 0 2023-12-05T09:57:47.262 INFO:tasks.workunit.client.1.smithi150.stdout:7/952: rmdir d2/db/d30/d18 39 2023-12-05T09:57:47.262 INFO:tasks.workunit.client.1.smithi150.stdout:7/953: dread - d2/d1b/fe5 zero size 2023-12-05T09:57:47.263 INFO:tasks.workunit.client.1.smithi150.stdout:2/991: link d0/d3/d21/d4d/deb/d103/d15/f8d d0/d3/d21/d4d/deb/d103/d15/d30/d54/d57/f152 0 2023-12-05T09:57:47.263 INFO:tasks.workunit.client.1.smithi150.stdout:2/992: write d0/d3/d21/d4d/deb/d86/fff [257937,121791] 0 2023-12-05T09:57:47.263 INFO:tasks.workunit.client.1.smithi150.stdout:2/993: write d0/d3/d5/d10/d3d/da1/daa/d11e/f2f [3381477,104088] 0 2023-12-05T09:57:47.263 INFO:tasks.workunit.client.1.smithi150.stdout:5/942: dread d1/d2e/f52 [0,4194304] 0 2023-12-05T09:57:47.264 INFO:tasks.workunit.client.1.smithi150.stdout:8/998: link d0/d41/d49/d1b/d24/d34/dbc/c139 d0/d41/d49/d1b/d24/d5b/dfa/c141 0 2023-12-05T09:57:47.264 INFO:tasks.workunit.client.1.smithi150.stdout:8/999: chown d0/d41/d49/d1b/d24/d34/dbc/lc8 254 1 2023-12-05T09:57:47.266 INFO:tasks.workunit.client.1.smithi150.stdout:7/954: mkdir d2/db/d17/d3a/d13c 0 2023-12-05T09:57:47.266 INFO:tasks.workunit.client.1.smithi150.stdout:7/955: chown d2/db/d30/d13/d4f/d7e/lef 187858 1 2023-12-05T09:57:47.268 INFO:tasks.workunit.client.1.smithi150.stdout:3/961: write d6/d25/dd7/f108 [264390,89244] 0 2023-12-05T09:57:47.268 INFO:tasks.workunit.client.1.smithi150.stdout:9/898: dwrite d3/d9/d9c/ffc [0,4194304] 0 2023-12-05T09:57:47.268 INFO:tasks.workunit.client.1.smithi150.stdout:9/899: chown d3/d1b/d46/f50 488361551 1 2023-12-05T09:57:47.268 INFO:tasks.workunit.client.0.smithi100.stdout:9/954: mkdir d7/d1b/d22/d2a/d74/dec/d145/d155 0 2023-12-05T09:57:47.268 INFO:tasks.workunit.client.0.smithi100.stdout:9/955: truncate d7/d20/f3c 4691094 0 2023-12-05T09:57:47.272 INFO:tasks.workunit.client.0.smithi100.stdout:4/867: mknod de/d16/d23/d33/d51/c117 0 2023-12-05T09:57:47.277 INFO:tasks.workunit.client.1.smithi150.stdout:2/994: unlink d0/d3/f99 0 2023-12-05T09:57:47.277 INFO:tasks.workunit.client.1.smithi150.stdout:2/995: creat d0/d3/d27/dac/d81/f153 x:0 0 0 2023-12-05T09:57:47.277 INFO:tasks.workunit.client.1.smithi150.stdout:2/996: write d0/da3/dae/fb1 [710847,70782] 0 2023-12-05T09:57:47.279 INFO:tasks.workunit.client.1.smithi150.stdout:4/870: dread d0/d3e/f78 [0,4194304] 0 2023-12-05T09:57:47.279 INFO:tasks.workunit.client.1.smithi150.stdout:4/871: readlink d0/d3e/l96 0 2023-12-05T09:57:47.280 INFO:tasks.workunit.client.0.smithi100.stdout:0/889: link da/d22/d33/f75 da/d1b/d73/d82/f111 0 2023-12-05T09:57:47.280 INFO:tasks.workunit.client.0.smithi100.stdout:0/890: write da/d22/d33/d35/d3a/f67 [8732192,51613] 0 2023-12-05T09:57:47.280 INFO:tasks.workunit.client.0.smithi100.stdout:0/891: fdatasync da/d22/d33/d74/dca/d9f/f101 0 2023-12-05T09:57:47.281 INFO:tasks.workunit.client.0.smithi100.stdout:9/956: mknod d7/d1b/d22/d2a/d56/d9c/daa/d152/c156 0 2023-12-05T09:57:47.281 INFO:tasks.workunit.client.0.smithi100.stdout:7/865: dwrite d3/dc/d11/d13/d1b/d60/fe0 [0,4194304] 0 2023-12-05T09:57:47.283 INFO:tasks.workunit.client.0.smithi100.stdout:7/866: write d3/dc/d11/d13/de/d18/d3b/d40/d4c/f100 [132029,101024] 0 2023-12-05T09:57:47.283 INFO:tasks.workunit.client.0.smithi100.stdout:7/867: stat d3/dc/d11/d13/d1b/l29 0 2023-12-05T09:57:47.283 INFO:tasks.workunit.client.0.smithi100.stdout:7/868: truncate d3/dc/d11/f110 356389 0 2023-12-05T09:57:47.283 INFO:tasks.workunit.client.0.smithi100.stdout:7/869: read - d3/dc/d11/d13/de/d18/d3b/d40/d4c/d7f/f92 zero size 2023-12-05T09:57:47.284 INFO:tasks.workunit.client.1.smithi150.stdout:3/962: truncate d6/d9/d3d/d56/d53/f102 519817 0 2023-12-05T09:57:47.284 INFO:tasks.workunit.client.1.smithi150.stdout:3/963: chown d6/d9/d114/f117 24075599 1 2023-12-05T09:57:47.284 INFO:tasks.workunit.client.1.smithi150.stdout:3/964: getdents d6/d9/d3d/d11e/d109 0 2023-12-05T09:57:47.285 INFO:tasks.workunit.client.1.smithi150.stdout:9/900: symlink d3/d1b/l11e 0 2023-12-05T09:57:47.286 INFO:tasks.workunit.client.0.smithi100.stdout:0/892: mkdir da/d22/d33/d35/d3a/de9/d112 0 2023-12-05T09:57:47.286 INFO:tasks.workunit.client.0.smithi100.stdout:0/893: fdatasync da/f2d 0 2023-12-05T09:57:47.287 INFO:tasks.workunit.client.0.smithi100.stdout:0/894: write da/d2a/d45/fd0 [512316,105246] 0 2023-12-05T09:57:47.288 INFO:tasks.workunit.client.1.smithi150.stdout:2/997: creat d0/d3/d21/d4d/f154 x:0 0 0 2023-12-05T09:57:47.290 INFO:tasks.workunit.client.1.smithi150.stdout:6/848: dwrite d2/d23/d3b/d64/d7a/ff4 [0,4194304] 0 2023-12-05T09:57:47.290 INFO:tasks.workunit.client.1.smithi150.stdout:4/872: mknod d0/d3e/d5b/d80/da1/c10b 0 2023-12-05T09:57:47.291 INFO:tasks.workunit.client.1.smithi150.stdout:6/849: read d2/d23/d3b/df0/d97/f84 [19804,127603] 0 2023-12-05T09:57:47.297 INFO:tasks.workunit.client.0.smithi100.stdout:7/870: creat d3/dc/d11/d13/f13e x:0 0 0 2023-12-05T09:57:47.297 INFO:tasks.workunit.client.0.smithi100.stdout:7/871: read - d3/dc/d11/d13/de/ff9 zero size 2023-12-05T09:57:47.298 INFO:tasks.workunit.client.0.smithi100.stdout:5/989: dwrite d0/d1f/da1/d11b/df/d51/da8/dee/d117/f153 [0,4194304] 0 2023-12-05T09:57:47.300 INFO:tasks.workunit.client.0.smithi100.stdout:4/868: rmdir de/d16/d23/d33/dae/dd1 39 2023-12-05T09:57:47.301 INFO:tasks.workunit.client.0.smithi100.stdout:4/869: write de/d16/dc8/f10c [932154,88055] 0 2023-12-05T09:57:47.303 INFO:tasks.workunit.client.1.smithi150.stdout:3/965: creat d6/d9/d3d/d56/d30/d104/f13d x:0 0 0 2023-12-05T09:57:47.305 INFO:tasks.workunit.client.0.smithi100.stdout:3/980: dwrite d0/d3d/f6c [0,4194304] 0 2023-12-05T09:57:47.305 INFO:tasks.workunit.client.0.smithi100.stdout:3/981: creat d0/d3d/dfc/d10d/f152 x:0 0 0 2023-12-05T09:57:47.305 INFO:tasks.workunit.client.0.smithi100.stdout:3/982: write d0/d3d/d5c/d5f/d67/f149 [660374,15863] 0 2023-12-05T09:57:47.306 INFO:tasks.workunit.client.0.smithi100.stdout:8/907: sync 2023-12-05T09:57:47.306 INFO:tasks.workunit.client.0.smithi100.stdout:8/908: write d0/d12/d13/d16/da3/fe0 [72990,48981] 0 2023-12-05T09:57:47.306 INFO:tasks.workunit.client.0.smithi100.stdout:8/909: chown d0/db7/de2/fd6 2689502 1 2023-12-05T09:57:47.306 INFO:tasks.workunit.client.0.smithi100.stdout:8/910: write d0/d12/d13/f3e [1909952,126030] 0 2023-12-05T09:57:47.306 INFO:tasks.workunit.client.0.smithi100.stdout:8/911: stat d0/f5a 0 2023-12-05T09:57:47.308 INFO:tasks.workunit.client.1.smithi150.stdout:1/998: dwrite d6/d8/d54/dea/f101 [0,4194304] 0 2023-12-05T09:57:47.308 INFO:tasks.workunit.client.1.smithi150.stdout:9/901: rename d3/d42/fc7 to d3/d9/d26/d34/dd5/f11f 0 2023-12-05T09:57:47.311 INFO:tasks.workunit.client.1.smithi150.stdout:2/998: symlink d0/d3/d5/l155 0 2023-12-05T09:57:47.312 INFO:tasks.workunit.client.1.smithi150.stdout:1/999: read d6/d3c/dc2/fcc [453510,8561] 0 2023-12-05T09:57:47.316 INFO:tasks.workunit.client.1.smithi150.stdout:3/966: dread d6/d25/dd9/df2/fae [0,4194304] 0 2023-12-05T09:57:47.316 INFO:tasks.workunit.client.1.smithi150.stdout:3/967: write d6/d9/f1b [2322779,80102] 0 2023-12-05T09:57:47.317 INFO:tasks.workunit.client.0.smithi100.stdout:9/957: dread d7/d1b/d22/d51/f23 [0,4194304] 0 2023-12-05T09:57:47.317 INFO:tasks.workunit.client.0.smithi100.stdout:0/895: mknod da/d22/d33/d35/d3a/d8b/d8f/c113 0 2023-12-05T09:57:47.317 INFO:tasks.workunit.client.0.smithi100.stdout:0/896: stat da/d1b/d6b 0 2023-12-05T09:57:47.321 INFO:tasks.workunit.client.1.smithi150.stdout:4/873: mkdir d0/d3e/d5b/d80/dc8/dfe/d10c 0 2023-12-05T09:57:47.322 INFO:tasks.workunit.client.1.smithi150.stdout:9/902: dread d3/f71 [0,4194304] 0 2023-12-05T09:57:47.323 INFO:tasks.workunit.client.0.smithi100.stdout:8/912: write d0/d12/d13/f25 [3914369,79576] 0 2023-12-05T09:57:47.324 INFO:tasks.workunit.client.1.smithi150.stdout:6/850: mkdir d2/d23/d3b/d11b 0 2023-12-05T09:57:47.329 INFO:tasks.workunit.client.0.smithi100.stdout:5/990: getdents d0/d1b/d4d/d8e/d96/dea/dff 0 2023-12-05T09:57:47.329 INFO:tasks.workunit.client.0.smithi100.stdout:5/991: dread - d0/d1b/d4d/d8e/d96/fc7 zero size 2023-12-05T09:57:47.332 INFO:tasks.workunit.client.0.smithi100.stdout:9/958: dread d7/d1b/d22/d51/f23 [0,4194304] 0 2023-12-05T09:57:47.332 INFO:tasks.workunit.client.0.smithi100.stdout:9/959: chown d7/db5/f141 4715 1 2023-12-05T09:57:47.332 INFO:tasks.workunit.client.0.smithi100.stdout:9/960: chown d7/d35/f86 2662516 1 2023-12-05T09:57:47.334 INFO:tasks.workunit.client.1.smithi150.stdout:3/968: dread d6/d9/d3d/d56/d30/f119 [0,4194304] 0 2023-12-05T09:57:47.335 INFO:tasks.workunit.client.1.smithi150.stdout:3/969: fsync d6/d25/f97 0 2023-12-05T09:57:47.335 INFO:tasks.workunit.client.1.smithi150.stdout:3/970: fsync d6/d9/d8d/f44 0 2023-12-05T09:57:47.337 INFO:tasks.workunit.client.0.smithi100.stdout:4/870: truncate de/f14 1210567 0 2023-12-05T09:57:47.339 INFO:tasks.workunit.client.1.smithi150.stdout:4/874: read d0/f51 [474139,15609] 0 2023-12-05T09:57:47.341 INFO:tasks.workunit.client.0.smithi100.stdout:3/983: mkdir d0/d10/d39/d153 0 2023-12-05T09:57:47.348 INFO:tasks.workunit.client.0.smithi100.stdout:8/913: mkdir d0/d12/d13/d10e 0 2023-12-05T09:57:47.349 INFO:tasks.workunit.client.0.smithi100.stdout:5/992: rmdir d0/d16/d2b/de3 39 2023-12-05T09:57:47.349 INFO:tasks.workunit.client.0.smithi100.stdout:5/993: truncate d0/d16/d2b/d75/f15a 600368 0 2023-12-05T09:57:47.353 INFO:tasks.workunit.client.1.smithi150.stdout:2/999: creat d0/d3/d27/f156 x:0 0 0 2023-12-05T09:57:47.362 INFO:tasks.workunit.client.0.smithi100.stdout:7/872: rename d3/dc/d11/d13/de/d2d/d47/ddd to d3/dc/d11/d13/d37/d97/dc1/dcd/d13f 0 2023-12-05T09:57:47.364 INFO:tasks.workunit.client.1.smithi150.stdout:3/971: mkdir d6/d25/dcf/d12c/d13e 0 2023-12-05T09:57:47.368 INFO:tasks.workunit.client.0.smithi100.stdout:8/914: mknod d0/d35/d64/d81/c10f 0 2023-12-05T09:57:47.372 INFO:tasks.workunit.client.0.smithi100.stdout:5/994: mkdir d0/d1b/d4d/d8e/d125/d14/d35/d62/d15f 0 2023-12-05T09:57:47.372 INFO:tasks.workunit.client.0.smithi100.stdout:9/961: rmdir d7/d1b/d22/d2a/d74 39 2023-12-05T09:57:47.372 INFO:tasks.workunit.client.0.smithi100.stdout:9/962: fdatasync d7/d1b/d22/d2a/d56/d2e/fb8 0 2023-12-05T09:57:47.379 INFO:tasks.workunit.client.0.smithi100.stdout:3/984: rename d0/d3d/d5c/d139/de/d12 to d0/d3d/d5c/d5f/d154 0 2023-12-05T09:57:47.379 INFO:tasks.workunit.client.0.smithi100.stdout:4/871: write de/d16/d23/d60/df7/f81 [1634618,67569] 0 2023-12-05T09:57:47.380 INFO:tasks.workunit.client.0.smithi100.stdout:0/897: dwrite da/d22/d33/f75 [0,4194304] 0 2023-12-05T09:57:47.381 INFO:tasks.workunit.client.0.smithi100.stdout:9/963: symlink d7/d35/d71/d9a/dcd/d122/l157 0 2023-12-05T09:57:47.381 INFO:tasks.workunit.client.0.smithi100.stdout:9/964: read d7/d1b/d22/d2a/f79 [2559517,23814] 0 2023-12-05T09:57:47.383 INFO:tasks.workunit.client.1.smithi150.stdout:3/972: rename d6/d9/d43/d47 to d6/d9/d43/d13f 0 2023-12-05T09:57:47.383 INFO:tasks.workunit.client.1.smithi150.stdout:3/973: truncate d6/d9/d3d/d56/d71/f134 674427 0 2023-12-05T09:57:47.385 INFO:tasks.workunit.client.0.smithi100.stdout:7/873: getdents d3/dc/d11/d13/de/d18/d3b/d40 0 2023-12-05T09:57:47.386 INFO:tasks.workunit.client.0.smithi100.stdout:3/985: truncate d0/d3d/d90/fda 522108 0 2023-12-05T09:57:47.388 INFO:tasks.workunit.client.0.smithi100.stdout:5/995: dread d0/d1f/da1/d11b/f65 [0,4194304] 0 2023-12-05T09:57:47.388 INFO:tasks.workunit.client.0.smithi100.stdout:5/996: chown d0/d27/f57 3573785 1 2023-12-05T09:57:47.388 INFO:tasks.workunit.client.1.smithi150.stdout:9/903: dwrite d3/d9/dc/f1d [0,4194304] 0 2023-12-05T09:57:47.389 INFO:tasks.workunit.client.1.smithi150.stdout:3/974: symlink d6/d9/d43/d13f/d8c/l140 0 2023-12-05T09:57:47.389 INFO:tasks.workunit.client.1.smithi150.stdout:4/875: dwrite d0/d3e/d6d/d4b/f50 [0,4194304] 0 2023-12-05T09:57:47.390 INFO:tasks.workunit.client.0.smithi100.stdout:4/872: mkdir de/d16/d23/d60/d98/da6/d118 0 2023-12-05T09:57:47.391 INFO:tasks.workunit.client.1.smithi150.stdout:9/904: rmdir d3/d9/d58/d90 39 2023-12-05T09:57:47.393 INFO:tasks.workunit.client.0.smithi100.stdout:0/898: unlink da/d22/cc4 0 2023-12-05T09:57:47.394 INFO:tasks.workunit.client.0.smithi100.stdout:9/965: truncate d7/d35/d97/f11c 257909 0 2023-12-05T09:57:47.396 INFO:tasks.workunit.client.0.smithi100.stdout:5/997: dread d0/d27/dc0/f140 [0,4194304] 0 2023-12-05T09:57:47.401 INFO:tasks.workunit.client.0.smithi100.stdout:7/874: unlink d3/dc/d11/d13/de/d18/d3b/de2/f121 0 2023-12-05T09:57:47.406 INFO:tasks.workunit.client.0.smithi100.stdout:5/998: read d0/d27/f5e [118799,47868] 0 2023-12-05T09:57:47.409 INFO:tasks.workunit.client.0.smithi100.stdout:3/986: rmdir d0/d3d/d5c/d139/de/d11/db5 39 2023-12-05T09:57:47.413 INFO:tasks.workunit.client.0.smithi100.stdout:8/915: dwrite d0/f37 [0,4194304] 0 2023-12-05T09:57:47.413 INFO:tasks.workunit.client.0.smithi100.stdout:4/873: creat de/d16/d23/d60/df7/d4e/d85/d107/f119 x:0 0 0 2023-12-05T09:57:47.417 INFO:tasks.workunit.client.0.smithi100.stdout:7/875: rename d3/dc/d11/d13/de/d18/dcb/f133 to d3/dc/d11/d13/d37/d97/dc1/dcd/f140 0 2023-12-05T09:57:47.419 INFO:tasks.workunit.client.1.smithi150.stdout:4/876: symlink d0/d3e/d5b/d80/da1/db2/dbe/d104/l10d 0 2023-12-05T09:57:47.423 INFO:tasks.workunit.client.1.smithi150.stdout:9/905: mknod d3/d42/d62/c120 0 2023-12-05T09:57:47.425 INFO:tasks.workunit.client.1.smithi150.stdout:5/943: sync 2023-12-05T09:57:47.427 INFO:tasks.workunit.client.0.smithi100.stdout:3/987: symlink d0/d3d/d5c/d5f/d67/da4/l155 0 2023-12-05T09:57:47.427 INFO:tasks.workunit.client.0.smithi100.stdout:3/988: write d0/d3d/d5c/d139/d33/f78 [164732,1633] 0 2023-12-05T09:57:47.428 INFO:tasks.workunit.client.1.smithi150.stdout:7/956: sync 2023-12-05T09:57:47.428 INFO:tasks.workunit.client.1.smithi150.stdout:7/957: chown d2/d4/ff 5339 1 2023-12-05T09:57:47.428 INFO:tasks.workunit.client.1.smithi150.stdout:7/958: truncate d2/d9d/fdd 880654 0 2023-12-05T09:57:47.430 INFO:tasks.workunit.client.1.smithi150.stdout:4/877: symlink d0/d3e/d48/d8a/dec/l10e 0 2023-12-05T09:57:47.430 INFO:tasks.workunit.client.1.smithi150.stdout:4/878: dread - d0/f45 zero size 2023-12-05T09:57:47.430 INFO:tasks.workunit.client.1.smithi150.stdout:4/879: chown d0/d5f/fd9 205 1 2023-12-05T09:57:47.431 INFO:tasks.workunit.client.1.smithi150.stdout:9/906: symlink d3/d9/dc/d1f/d24/d75/d95/dbc/dad/db7/l121 0 2023-12-05T09:57:47.432 INFO:tasks.workunit.client.1.smithi150.stdout:3/975: rename d6/d9/d3d/d8a to d6/d9/d3d/d11e/d141 0 2023-12-05T09:57:47.432 INFO:tasks.workunit.client.1.smithi150.stdout:3/976: chown d6/d9/d3d/d56/d79/f7f 17548 1 2023-12-05T09:57:47.436 INFO:tasks.workunit.client.1.smithi150.stdout:4/880: symlink d0/d3e/d5b/d80/da1/db2/l10f 0 2023-12-05T09:57:47.439 INFO:tasks.workunit.client.1.smithi150.stdout:9/907: mkdir d3/d42/d62/d97/d122 0 2023-12-05T09:57:47.439 INFO:tasks.workunit.client.1.smithi150.stdout:9/908: write d3/d9/dc/fec [206623,3139] 0 2023-12-05T09:57:47.439 INFO:tasks.workunit.client.1.smithi150.stdout:9/909: chown d3/d1b/d46/d55/d64/d94 521594 1 2023-12-05T09:57:47.439 INFO:tasks.workunit.client.1.smithi150.stdout:9/910: stat d3/d9/dc/c2c 0 2023-12-05T09:57:47.439 INFO:tasks.workunit.client.1.smithi150.stdout:9/911: fsync d3/d9/d26/d34/dd5/f11f 0 2023-12-05T09:57:47.439 INFO:tasks.workunit.client.1.smithi150.stdout:9/912: stat d3/d9/d26/d34/f5b 0 2023-12-05T09:57:47.440 INFO:tasks.workunit.client.0.smithi100.stdout:0/899: dwrite da/d22/d33/d74/fdb [0,4194304] 0 2023-12-05T09:57:47.440 INFO:tasks.workunit.client.0.smithi100.stdout:0/900: chown da/d22/d33/d74/d77/d105 7874 1 2023-12-05T09:57:47.441 INFO:tasks.workunit.client.1.smithi150.stdout:5/944: rename d1/f96 to d1/d3/f149 0 2023-12-05T09:57:47.444 INFO:tasks.workunit.client.0.smithi100.stdout:8/916: mknod d0/d12/d13/d45/dba/df1/c110 0 2023-12-05T09:57:47.444 INFO:tasks.workunit.client.0.smithi100.stdout:8/917: fdatasync d0/d12/d13/d16/d42/d43/f66 0 2023-12-05T09:57:47.448 INFO:tasks.workunit.client.1.smithi150.stdout:3/977: write d6/d9/d3d/d11e/d109/fbc [1068367,115354] 0 2023-12-05T09:57:47.449 INFO:tasks.workunit.client.1.smithi150.stdout:3/978: write d6/d25/dcf/f13b [673538,37094] 0 2023-12-05T09:57:47.505 INFO:tasks.workunit.client.0.smithi100.stdout:4/874: mkdir de/d16/d23/d60/df7/d4e/dbe/d11a 0 2023-12-05T09:57:47.505 INFO:tasks.workunit.client.1.smithi150.stdout:6/851: sync 2023-12-05T09:57:47.506 INFO:tasks.workunit.client.1.smithi150.stdout:7/959: rmdir d2/db/d30/daf/dd3/d2b 39 2023-12-05T09:57:47.508 INFO:tasks.workunit.client.1.smithi150.stdout:4/881: creat d0/d3e/d48/dbb/dca/dee/f110 x:0 0 0 2023-12-05T09:57:47.508 INFO:tasks.workunit.client.1.smithi150.stdout:4/882: readlink d0/d3e/d6d/d95/l9d 0 2023-12-05T09:57:47.508 INFO:tasks.workunit.client.1.smithi150.stdout:4/883: dread - d0/d3e/fc1 zero size 2023-12-05T09:57:47.508 INFO:tasks.workunit.client.1.smithi150.stdout:9/913: dwrite d3/d9/dc/d1f/d24/f6b [0,4194304] 0 2023-12-05T09:57:47.508 INFO:tasks.workunit.client.1.smithi150.stdout:9/914: chown d3/d9/d67 8524 1 2023-12-05T09:57:47.508 INFO:tasks.workunit.client.1.smithi150.stdout:9/915: stat d3/d1b/d46/d55/ff5 0 2023-12-05T09:57:47.509 INFO:tasks.workunit.client.0.smithi100.stdout:7/876: link d3/dc/d11/d13/de/d18/d3b/d40/d4c/f100 d3/dc/d11/d13/d37/d97/dc1/f141 0 2023-12-05T09:57:47.509 INFO:tasks.workunit.client.0.smithi100.stdout:7/877: getdents d3/dc/d11/d13/de/d18/d3b/d40 0 2023-12-05T09:57:47.509 INFO:tasks.workunit.client.0.smithi100.stdout:7/878: chown d3/dc/d11/d13/de/c8c 137430812 1 2023-12-05T09:57:47.510 INFO:tasks.workunit.client.0.smithi100.stdout:1/892: sync 2023-12-05T09:57:47.512 INFO:tasks.workunit.client.0.smithi100.stdout:3/989: creat d0/d3d/d5c/d139/de/d8d/dc9/d110/f156 x:0 0 0 2023-12-05T09:57:47.512 INFO:tasks.workunit.client.0.smithi100.stdout:3/990: chown d0/d4/l4e 120588341 1 2023-12-05T09:57:47.513 INFO:tasks.workunit.client.1.smithi150.stdout:3/979: rmdir d6/d9/d3d/d56/d30 39 2023-12-05T09:57:47.516 INFO:tasks.workunit.client.1.smithi150.stdout:6/852: symlink d2/d23/d2e/d5f/l11c 0 2023-12-05T09:57:47.516 INFO:tasks.workunit.client.1.smithi150.stdout:6/853: chown d2/d23/d3b/fa4 11865 1 2023-12-05T09:57:47.519 INFO:tasks.workunit.client.0.smithi100.stdout:0/901: symlink da/d22/d33/d74/d77/l114 0 2023-12-05T09:57:47.520 INFO:tasks.workunit.client.0.smithi100.stdout:0/902: truncate da/d22/d33/d7f/fb5 236585 0 2023-12-05T09:57:47.521 INFO:tasks.workunit.client.0.smithi100.stdout:8/918: creat d0/d12/d13/d10e/f111 x:0 0 0 2023-12-05T09:57:47.525 INFO:tasks.workunit.client.1.smithi150.stdout:7/960: mkdir d2/db/d2e/d9a/d11e/d13d 0 2023-12-05T09:57:47.526 INFO:tasks.workunit.client.0.smithi100.stdout:1/893: dread db/d31/d3a/d4a/dad/d67/f6d [0,4194304] 0 2023-12-05T09:57:47.527 INFO:tasks.workunit.client.1.smithi150.stdout:3/980: truncate d6/d9/d3d/d56/d53/d51/f6b 3668647 0 2023-12-05T09:57:47.528 INFO:tasks.workunit.client.1.smithi150.stdout:3/981: fsync d6/d9/f123 0 2023-12-05T09:57:47.529 INFO:tasks.workunit.client.1.smithi150.stdout:7/961: creat d2/d9d/f13e x:0 0 0 2023-12-05T09:57:47.531 INFO:tasks.workunit.client.0.smithi100.stdout:7/879: mkdir d3/dc/d11/d13/d37/d97/dc1/dcd/d13f/d142 0 2023-12-05T09:57:47.534 INFO:tasks.workunit.client.1.smithi150.stdout:9/916: dread d3/f71 [0,4194304] 0 2023-12-05T09:57:47.535 INFO:tasks.workunit.client.0.smithi100.stdout:0/903: unlink da/ld8 0 2023-12-05T09:57:47.537 INFO:tasks.workunit.client.1.smithi150.stdout:3/982: rename d6/d9/d8d/lce to d6/d25/dcf/d12c/d13e/l142 0 2023-12-05T09:57:47.539 INFO:tasks.workunit.client.1.smithi150.stdout:5/945: sync 2023-12-05T09:57:47.539 INFO:tasks.workunit.client.1.smithi150.stdout:5/946: readlink d1/d64/dfd/l145 0 2023-12-05T09:57:47.539 INFO:tasks.workunit.client.0.smithi100.stdout:8/919: truncate d0/d35/d64/f7c 1053210 0 2023-12-05T09:57:47.539 INFO:tasks.workunit.client.0.smithi100.stdout:8/920: creat d0/d12/d13/d45/da6/d9c/f112 x:0 0 0 2023-12-05T09:57:47.540 INFO:tasks.workunit.client.1.smithi150.stdout:7/962: link d2/db/d17/d88/ldb d2/l13f 0 2023-12-05T09:57:47.540 INFO:tasks.workunit.client.1.smithi150.stdout:7/963: chown d2/d9d/d101/d11f 2844 1 2023-12-05T09:57:47.545 INFO:tasks.workunit.client.0.smithi100.stdout:1/894: truncate db/d12/d61/f85 1909165 0 2023-12-05T09:57:47.545 INFO:tasks.workunit.client.0.smithi100.stdout:5/999: rename d0/d1f/da1/d11b/df to d0/d1b/d4d/d6c/d104/d160 0 2023-12-05T09:57:47.546 INFO:tasks.workunit.client.1.smithi150.stdout:3/983: creat d6/d9/d3d/d56/d71/db6/db2/d12f/f143 x:0 0 0 2023-12-05T09:57:47.546 INFO:tasks.workunit.client.1.smithi150.stdout:3/984: fdatasync d6/d9/d43/f72 0 2023-12-05T09:57:47.547 INFO:tasks.workunit.client.1.smithi150.stdout:5/947: mkdir d1/d7f/d65/d3b/d6b/d11e/dca/d14a 0 2023-12-05T09:57:47.547 INFO:tasks.workunit.client.1.smithi150.stdout:5/948: chown d1/d7f/d65/d3b/d6b/c71 2530040 1 2023-12-05T09:57:47.548 INFO:tasks.workunit.client.1.smithi150.stdout:7/964: mknod d2/d1b/d31/c140 0 2023-12-05T09:57:47.549 INFO:tasks.workunit.client.1.smithi150.stdout:4/884: dwrite d0/d3e/d5b/de4/fda [4194304,4194304] 0 2023-12-05T09:57:47.549 INFO:tasks.workunit.client.1.smithi150.stdout:4/885: write d0/f3a [2075210,100464] 0 2023-12-05T09:57:47.549 INFO:tasks.workunit.client.1.smithi150.stdout:4/886: write d0/d3e/d6d/fac [649492,42170] 0 2023-12-05T09:57:47.549 INFO:tasks.workunit.client.1.smithi150.stdout:4/887: creat d0/d3e/d6d/d4b/f111 x:0 0 0 2023-12-05T09:57:47.551 INFO:tasks.workunit.client.1.smithi150.stdout:7/965: mknod d2/d9d/da0/dd4/c141 0 2023-12-05T09:57:47.559 INFO:tasks.workunit.client.1.smithi150.stdout:4/888: creat d0/d3e/d6d/ddf/da4/dd7/f112 x:0 0 0 2023-12-05T09:57:47.559 INFO:tasks.workunit.client.1.smithi150.stdout:4/889: chown d0/d3e/d5b/d80/da1/l101 23 1 2023-12-05T09:57:47.559 INFO:tasks.workunit.client.0.smithi100.stdout:3/991: rename d0/d48/f129 to d0/d3d/d5c/d139/de/d11/d7c/f157 0 2023-12-05T09:57:47.564 INFO:tasks.workunit.client.1.smithi150.stdout:3/985: getdents d6/d9/d3d/d56/d71 0 2023-12-05T09:57:47.575 INFO:tasks.workunit.client.1.smithi150.stdout:5/949: rmdir d1/d64/dfc 39 2023-12-05T09:57:47.575 INFO:tasks.workunit.client.1.smithi150.stdout:5/950: dread - d1/d3/d6/d1b/dfe/f119 zero size 2023-12-05T09:57:47.575 INFO:tasks.workunit.client.1.smithi150.stdout:7/966: creat d2/db/d2e/d9a/df1/f142 x:0 0 0 2023-12-05T09:57:47.576 INFO:tasks.workunit.client.1.smithi150.stdout:5/951: dread - d1/d7f/d65/d3b/d6b/dcb/fd8 zero size 2023-12-05T09:57:47.577 INFO:tasks.workunit.client.1.smithi150.stdout:9/917: dread d3/d1b/d46/d55/d64/f88 [0,4194304] 0 2023-12-05T09:57:47.579 INFO:tasks.workunit.client.1.smithi150.stdout:3/986: mkdir d6/d9/d3d/d56/d71/db6/db2/d144 0 2023-12-05T09:57:47.580 INFO:tasks.workunit.client.1.smithi150.stdout:5/952: symlink d1/d7f/d65/d3b/l14b 0 2023-12-05T09:57:47.580 INFO:tasks.workunit.client.1.smithi150.stdout:5/953: chown d1/d2e/f52 1850707 1 2023-12-05T09:57:47.580 INFO:tasks.workunit.client.1.smithi150.stdout:5/954: chown d1/d64/dfc/l142 6 1 2023-12-05T09:57:47.580 INFO:tasks.workunit.client.1.smithi150.stdout:5/955: stat d1/d3/d6/d1b 0 2023-12-05T09:57:47.580 INFO:tasks.workunit.client.1.smithi150.stdout:5/956: write d1/d7f/d65/de3/d10a/f105 [44440,107702] 0 2023-12-05T09:57:47.583 INFO:tasks.workunit.client.1.smithi150.stdout:9/918: link d3/l18 d3/d9/dc/d1f/d24/d75/d95/dbc/dad/l123 0 2023-12-05T09:57:47.585 INFO:tasks.workunit.client.1.smithi150.stdout:3/987: symlink d6/d9/d3d/d11e/l145 0 2023-12-05T09:57:47.585 INFO:tasks.workunit.client.1.smithi150.stdout:3/988: stat d6/d9/d43/d13f/d94/df1/d10b/f11d 0 2023-12-05T09:57:47.585 INFO:tasks.workunit.client.1.smithi150.stdout:3/989: chown d6/d9/d43/d13f/l11 447487469 1 2023-12-05T09:57:47.588 INFO:tasks.workunit.client.1.smithi150.stdout:5/957: mknod d1/d3/d6/d116/c14c 0 2023-12-05T09:57:47.593 INFO:tasks.workunit.client.1.smithi150.stdout:9/919: rename d3/d1b/l2d to d3/d9/dc/d1f/d24/d75/d95/d9a/dcb/de4/def/l124 0 2023-12-05T09:57:47.593 INFO:tasks.workunit.client.1.smithi150.stdout:9/920: chown d3/d9/dc/l3e 80 1 2023-12-05T09:57:47.598 INFO:tasks.workunit.client.1.smithi150.stdout:9/921: rmdir d3/d9/d67 39 2023-12-05T09:57:47.601 INFO:tasks.workunit.client.1.smithi150.stdout:9/922: rename d3/d9/d6e/d84/fb1 to d3/d9/d6e/d84/f125 0 2023-12-05T09:57:47.601 INFO:tasks.workunit.client.1.smithi150.stdout:9/923: stat d3/d9/dc/d1f/d24/d75/d95/d9a/dcb/de4/f112 0 2023-12-05T09:57:47.603 INFO:tasks.workunit.client.1.smithi150.stdout:9/924: symlink d3/d9/dc/d1f/d24/d75/d95/l126 0 2023-12-05T09:57:47.603 INFO:tasks.workunit.client.1.smithi150.stdout:9/925: readlink d3/d1b/d46/d55/d64/d94/lb8 0 2023-12-05T09:57:47.603 INFO:tasks.workunit.client.1.smithi150.stdout:9/926: write d3/d9/dc/ff3 [374459,95861] 0 2023-12-05T09:57:47.606 INFO:tasks.workunit.client.1.smithi150.stdout:9/927: getdents d3/d9/dc/d1f/d24/d75/d95/d9a/dcb/de4 0 2023-12-05T09:57:47.608 INFO:tasks.workunit.client.1.smithi150.stdout:9/928: mknod d3/d9/dc/d1f/d24/d75/d95/dbc/dad/db7/c127 0 2023-12-05T09:57:47.608 INFO:tasks.workunit.client.1.smithi150.stdout:9/929: chown d3/d1b/dca 22 1 2023-12-05T09:57:47.610 INFO:tasks.workunit.client.1.smithi150.stdout:7/967: dread d2/d72/d82/f10d [0,4194304] 0 2023-12-05T09:57:47.610 INFO:tasks.workunit.client.1.smithi150.stdout:9/930: creat d3/d9/dc/d1f/d24/d75/d95/dd0/f128 x:0 0 0 2023-12-05T09:57:47.612 INFO:tasks.workunit.client.1.smithi150.stdout:9/931: mkdir d3/d9/d26/d34/ded/d129 0 2023-12-05T09:57:47.612 INFO:tasks.workunit.client.1.smithi150.stdout:9/932: fdatasync d3/d9/d26/f3f 0 2023-12-05T09:57:47.612 INFO:tasks.workunit.client.1.smithi150.stdout:9/933: write d3/d9/d58/dbe/fd9 [112751,43128] 0 2023-12-05T09:57:47.615 INFO:tasks.workunit.client.1.smithi150.stdout:9/934: creat d3/d1b/dca/f12a x:0 0 0 2023-12-05T09:57:47.617 INFO:tasks.workunit.client.1.smithi150.stdout:3/990: read d6/d9/d3d/d56/d71/db0/f101 [3874354,105916] 0 2023-12-05T09:57:47.618 INFO:tasks.workunit.client.1.smithi150.stdout:6/854: dwrite d2/d23/d2e/f3e [0,4194304] 0 2023-12-05T09:57:47.618 INFO:tasks.workunit.client.1.smithi150.stdout:6/855: chown d2/d23/d2e/d44/da0/cfc 3 1 2023-12-05T09:57:47.618 INFO:tasks.workunit.client.1.smithi150.stdout:6/856: read d2/d23/d3b/d64/fea [2776066,105925] 0 2023-12-05T09:57:47.618 INFO:tasks.workunit.client.1.smithi150.stdout:6/857: readlink d2/d23/d3b/d64/d7a/d5d/d6b/d9c/l104 0 2023-12-05T09:57:47.618 INFO:tasks.workunit.client.1.smithi150.stdout:9/935: rename d3/d9/dc/d91 to d3/d9/d9c/d12b 0 2023-12-05T09:57:47.622 INFO:tasks.workunit.client.0.smithi100.stdout:8/921: dwrite d0/d12/f48 [4194304,4194304] 0 2023-12-05T09:57:47.622 INFO:tasks.workunit.client.0.smithi100.stdout:8/922: stat d0/d12/d13/d45/dba/df1 0 2023-12-05T09:57:47.622 INFO:tasks.workunit.client.1.smithi150.stdout:6/858: getdents d2/d23/d3b/d64/d7a/d5d/dcd 0 2023-12-05T09:57:47.622 INFO:tasks.workunit.client.1.smithi150.stdout:3/991: creat d6/d9/d116/f146 x:0 0 0 2023-12-05T09:57:47.625 INFO:tasks.workunit.client.0.smithi100.stdout:0/904: dwrite da/d22/d33/d74/dca/db4/fc1 [0,4194304] 0 2023-12-05T09:57:47.626 INFO:tasks.workunit.client.0.smithi100.stdout:0/905: fdatasync da/d1b/ffd 0 2023-12-05T09:57:47.626 INFO:tasks.workunit.client.1.smithi150.stdout:6/859: rename d2/d23/d3b/d64/d7a/d5d/d6b/d9c to d2/d11d 0 2023-12-05T09:57:47.626 INFO:tasks.workunit.client.1.smithi150.stdout:6/860: write d2/d23/ffd [448722,124430] 0 2023-12-05T09:57:47.626 INFO:tasks.workunit.client.1.smithi150.stdout:3/992: truncate d6/d9/d3d/d11e/f76 3262554 0 2023-12-05T09:57:47.626 INFO:tasks.workunit.client.0.smithi100.stdout:8/923: rename d0/d12/d13/d45/dba to d0/d12/d13/d45/da6/d76/d113 0 2023-12-05T09:57:47.630 INFO:tasks.workunit.client.1.smithi150.stdout:3/993: creat d6/d9/d3d/d56/d53/f147 x:0 0 0 2023-12-05T09:57:47.631 INFO:tasks.workunit.client.1.smithi150.stdout:3/994: write d6/d9/d3d/d56/d71/db6/db2/ff4 [1409928,44868] 0 2023-12-05T09:57:47.632 INFO:tasks.workunit.client.0.smithi100.stdout:3/992: dwrite d0/d3d/d5c/d139/de/db8/dee/df6/f11a [0,4194304] 0 2023-12-05T09:57:47.632 INFO:tasks.workunit.client.0.smithi100.stdout:3/993: write d0/d4/f14 [1834082,32463] 0 2023-12-05T09:57:47.633 INFO:tasks.workunit.client.0.smithi100.stdout:0/906: creat da/d1b/d6b/d78/f115 x:0 0 0 2023-12-05T09:57:47.633 INFO:tasks.workunit.client.0.smithi100.stdout:7/880: dwrite d3/ff2 [0,4194304] 0 2023-12-05T09:57:47.633 INFO:tasks.workunit.client.0.smithi100.stdout:0/907: read da/d22/fec [3517233,87364] 0 2023-12-05T09:57:47.633 INFO:tasks.workunit.client.0.smithi100.stdout:7/881: dread - d3/dc/d11/d13/de/d2d/d47/dbd/f13d zero size 2023-12-05T09:57:47.633 INFO:tasks.workunit.client.0.smithi100.stdout:1/895: dwrite db/d12/f1d [0,4194304] 0 2023-12-05T09:57:47.634 INFO:tasks.workunit.client.1.smithi150.stdout:3/995: truncate d6/d9/d43/d13f/f1a 2966389 0 2023-12-05T09:57:47.643 INFO:tasks.workunit.client.0.smithi100.stdout:0/908: creat da/d2a/d45/de3/de6/f116 x:0 0 0 2023-12-05T09:57:47.643 INFO:tasks.workunit.client.1.smithi150.stdout:3/996: rename d6/d25/dd7/f108 to d6/d25/f148 0 2023-12-05T09:57:47.644 INFO:tasks.workunit.client.1.smithi150.stdout:4/890: dwrite d0/d5f/f82 [0,4194304] 0 2023-12-05T09:57:47.646 INFO:tasks.workunit.client.0.smithi100.stdout:8/924: dread d0/d35/d64/d81/f98 [0,4194304] 0 2023-12-05T09:57:47.646 INFO:tasks.workunit.client.0.smithi100.stdout:8/925: stat d0/ce 0 2023-12-05T09:57:47.646 INFO:tasks.workunit.client.0.smithi100.stdout:8/926: chown d0/d12/f48 98 1 2023-12-05T09:57:47.647 INFO:tasks.workunit.client.0.smithi100.stdout:3/994: dread d0/f88 [4194304,4194304] 0 2023-12-05T09:57:47.648 INFO:tasks.workunit.client.0.smithi100.stdout:1/896: link db/d12/d1e/d26/d39/de9/c10b db/d12/d1e/c111 0 2023-12-05T09:57:47.649 INFO:tasks.workunit.client.0.smithi100.stdout:0/909: creat da/d22/d33/d35/d3a/d8b/f117 x:0 0 0 2023-12-05T09:57:47.649 INFO:tasks.workunit.client.0.smithi100.stdout:0/910: stat da/d60/dba/lbb 0 2023-12-05T09:57:47.653 INFO:tasks.workunit.client.1.smithi150.stdout:5/958: dwrite d1/d2e/f80 [0,4194304] 0 2023-12-05T09:57:47.656 INFO:tasks.workunit.client.0.smithi100.stdout:7/882: link d3/dc/d11/d13/de/d18/lae d3/dc/d11/d13/l143 0 2023-12-05T09:57:47.656 INFO:tasks.workunit.client.0.smithi100.stdout:7/883: creat d3/dc/d11/d13/de/d18/f144 x:0 0 0 2023-12-05T09:57:47.657 INFO:tasks.workunit.client.0.smithi100.stdout:8/927: creat d0/d12/d13/d45/da6/d76/d113/dbd/f114 x:0 0 0 2023-12-05T09:57:47.657 INFO:tasks.workunit.client.0.smithi100.stdout:8/928: fsync d0/db7/de2/ff4 0 2023-12-05T09:57:47.661 INFO:tasks.workunit.client.0.smithi100.stdout:3/995: symlink d0/d3d/dfc/d10d/db0/d100/l158 0 2023-12-05T09:57:47.664 INFO:tasks.workunit.client.0.smithi100.stdout:1/897: mknod db/d31/d3a/d4a/dad/d67/c112 0 2023-12-05T09:57:47.666 INFO:tasks.workunit.client.1.smithi150.stdout:5/959: symlink d1/d7f/d65/d3b/d6b/d109/l14d 0 2023-12-05T09:57:47.671 INFO:tasks.workunit.client.1.smithi150.stdout:4/891: read d0/f24 [2743920,56449] 0 2023-12-05T09:57:47.671 INFO:tasks.workunit.client.1.smithi150.stdout:4/892: chown d0/d5f/fd4 2039601262 1 2023-12-05T09:57:47.672 INFO:tasks.workunit.client.0.smithi100.stdout:0/911: dread da/d2a/f56 [0,4194304] 0 2023-12-05T09:57:47.672 INFO:tasks.workunit.client.0.smithi100.stdout:0/912: truncate da/d22/d33/d74/dca/f10a 120123 0 2023-12-05T09:57:47.672 INFO:tasks.workunit.client.1.smithi150.stdout:5/960: unlink d1/d7f/d65/d3b/l14b 0 2023-12-05T09:57:47.673 INFO:tasks.workunit.client.1.smithi150.stdout:5/961: chown d1/d2e/da6/d24/d59/d104/l13c 49532 1 2023-12-05T09:57:47.674 INFO:tasks.workunit.client.1.smithi150.stdout:7/968: dwrite d2/db/d30/d53/fcc [0,4194304] 0 2023-12-05T09:57:47.674 INFO:tasks.workunit.client.1.smithi150.stdout:7/969: fsync d2/db/d30/d13/f14 0 2023-12-05T09:57:47.675 INFO:tasks.workunit.client.1.smithi150.stdout:9/936: dwrite d3/d9/dc/d1f/d24/f63 [0,4194304] 0 2023-12-05T09:57:47.676 INFO:tasks.workunit.client.1.smithi150.stdout:4/893: symlink d0/d3e/d6d/ddf/da4/l113 0 2023-12-05T09:57:47.681 INFO:tasks.workunit.client.1.smithi150.stdout:5/962: rmdir d1/d7f/d65/de3/d10a 39 2023-12-05T09:57:47.684 INFO:tasks.workunit.client.1.smithi150.stdout:7/970: symlink d2/d72/d82/l143 0 2023-12-05T09:57:47.684 INFO:tasks.workunit.client.1.smithi150.stdout:7/971: readlink d2/db/d30/d13/d4f/l8c 0 2023-12-05T09:57:47.685 INFO:tasks.workunit.client.0.smithi100.stdout:7/884: dread d3/dc/ff3 [0,4194304] 0 2023-12-05T09:57:47.685 INFO:tasks.workunit.client.0.smithi100.stdout:7/885: readlink d3/dc/d11/d13/de/d2d/l7c 0 2023-12-05T09:57:47.685 INFO:tasks.workunit.client.0.smithi100.stdout:7/886: fsync d3/dc/d11/d13/de/d18/d3b/dd7/f13b 0 2023-12-05T09:57:47.688 INFO:tasks.workunit.client.0.smithi100.stdout:8/929: dread d0/d12/d13/d16/f46 [4194304,4194304] 0 2023-12-05T09:57:47.688 INFO:tasks.workunit.client.0.smithi100.stdout:8/930: write d0/d12/d13/d45/da6/d76/d113/fdf [223929,89093] 0 2023-12-05T09:57:47.688 INFO:tasks.workunit.client.0.smithi100.stdout:8/931: stat d0/d12/d13/f30 0 2023-12-05T09:57:47.689 INFO:tasks.workunit.client.0.smithi100.stdout:1/898: stat db/d12/d1e/d26/d30/cfe 0 2023-12-05T09:57:47.691 INFO:tasks.workunit.client.1.smithi150.stdout:9/937: symlink d3/d42/l12c 0 2023-12-05T09:57:47.692 INFO:tasks.workunit.client.0.smithi100.stdout:0/913: rename da/d2a/d45/de3/ff7 to da/d2a/d45/de3/f118 0 2023-12-05T09:57:47.694 INFO:tasks.workunit.client.1.smithi150.stdout:4/894: unlink d0/d3e/f8d 0 2023-12-05T09:57:47.697 INFO:tasks.workunit.client.0.smithi100.stdout:8/932: creat d0/db7/dcf/f115 x:0 0 0 2023-12-05T09:57:47.697 INFO:tasks.workunit.client.0.smithi100.stdout:8/933: fsync d0/d12/d13/d45/da6/d76/d91/ffd 0 2023-12-05T09:57:47.701 INFO:tasks.workunit.client.0.smithi100.stdout:0/914: unlink da/d2a/d45/lbd 0 2023-12-05T09:57:47.702 INFO:tasks.workunit.client.1.smithi150.stdout:3/997: dwrite d6/d9/d3d/d56/d71/db6/db2/fec [0,4194304] 0 2023-12-05T09:57:47.702 INFO:tasks.workunit.client.1.smithi150.stdout:5/963: creat d1/d3/d92/f14e x:0 0 0 2023-12-05T09:57:47.702 INFO:tasks.workunit.client.1.smithi150.stdout:5/964: truncate d1/d2e/da6/d24/d59/d104/f136 866061 0 2023-12-05T09:57:47.707 INFO:tasks.workunit.client.0.smithi100.stdout:0/915: creat da/d22/d33/d74/f119 x:0 0 0 2023-12-05T09:57:47.708 INFO:tasks.workunit.client.0.smithi100.stdout:0/916: write da/f2c [1988915,25030] 0 2023-12-05T09:57:47.709 INFO:tasks.workunit.client.0.smithi100.stdout:0/917: creat da/d22/d33/d74/dca/f11a x:0 0 0 2023-12-05T09:57:47.710 INFO:tasks.workunit.client.0.smithi100.stdout:7/887: write d3/dc/d11/f32 [1956168,113746] 0 2023-12-05T09:57:47.717 INFO:tasks.workunit.client.1.smithi150.stdout:4/895: chown d0/d3e/d48/c49 1071 1 2023-12-05T09:57:47.717 INFO:tasks.workunit.client.1.smithi150.stdout:4/896: creat d0/d3e/d5b/d80/dc8/f114 x:0 0 0 2023-12-05T09:57:47.723 INFO:tasks.workunit.client.1.smithi150.stdout:5/965: creat d1/d7f/d65/d3b/d6b/f14f x:0 0 0 2023-12-05T09:57:47.727 INFO:tasks.workunit.client.0.smithi100.stdout:0/918: write da/d22/d33/d74/dca/fdd [593409,102242] 0 2023-12-05T09:57:47.728 INFO:tasks.workunit.client.0.smithi100.stdout:0/919: stat da/d2a/d45/de3/f118 0 2023-12-05T09:57:47.728 INFO:tasks.workunit.client.1.smithi150.stdout:7/972: rename d2/db/d30/d13/d4f/d5a to d2/d4/d144 0 2023-12-05T09:57:47.730 INFO:tasks.workunit.client.0.smithi100.stdout:4/875: sync 2023-12-05T09:57:47.730 INFO:tasks.workunit.client.0.smithi100.stdout:9/966: sync 2023-12-05T09:57:47.736 INFO:tasks.workunit.client.1.smithi150.stdout:4/897: mkdir d0/d3e/d5b/d80/dc8/dfe/d115 0 2023-12-05T09:57:47.736 INFO:tasks.workunit.client.1.smithi150.stdout:4/898: dread - d0/d3e/d6d/ddf/fd6 zero size 2023-12-05T09:57:47.736 INFO:tasks.workunit.client.1.smithi150.stdout:9/938: dwrite d3/d9/dc/d1f/d24/d75/d95/dd0/f128 [0,4194304] 0 2023-12-05T09:57:47.736 INFO:tasks.workunit.client.1.smithi150.stdout:9/939: fdatasync d3/d9/dc/d1f/d24/f6b 0 2023-12-05T09:57:47.736 INFO:tasks.workunit.client.1.smithi150.stdout:9/940: fsync d3/d9/dc/d1f/f5f 0 2023-12-05T09:57:47.737 INFO:tasks.workunit.client.1.smithi150.stdout:9/941: stat d3/d82/ff7 0 2023-12-05T09:57:47.738 INFO:tasks.workunit.client.1.smithi150.stdout:3/998: truncate d6/d9/d3d/d56/d53/d51/f6b 1798821 0 2023-12-05T09:57:47.738 INFO:tasks.workunit.client.1.smithi150.stdout:3/999: chown d6/d9/d3d/d56/d71/cc6 792280557 1 2023-12-05T09:57:47.741 INFO:tasks.workunit.client.0.smithi100.stdout:9/967: creat d7/d1b/d22/d93/dd9/f158 x:0 0 0 2023-12-05T09:57:47.741 INFO:tasks.workunit.client.0.smithi100.stdout:9/968: truncate d7/d1b/d22/d51/d32/d96/f13a 955377 0 2023-12-05T09:57:47.743 INFO:tasks.workunit.client.1.smithi150.stdout:5/966: creat d1/d64/de7/f150 x:0 0 0 2023-12-05T09:57:47.747 INFO:tasks.workunit.client.0.smithi100.stdout:4/876: creat de/d16/d23/d60/de3/deb/f11b x:0 0 0 2023-12-05T09:57:47.747 INFO:tasks.workunit.client.0.smithi100.stdout:4/877: dread - de/d16/d23/d60/de3/deb/f11b zero size 2023-12-05T09:57:47.748 INFO:tasks.workunit.client.0.smithi100.stdout:4/878: write de/d16/d23/d60/df7/fe6 [862628,75341] 0 2023-12-05T09:57:47.749 INFO:tasks.workunit.client.1.smithi150.stdout:4/899: getdents d0/d3e/d5b/d80 0 2023-12-05T09:57:47.750 INFO:tasks.workunit.client.1.smithi150.stdout:4/900: write d0/d3e/d5b/d6e/daa/fea [244499,80761] 0 2023-12-05T09:57:47.750 INFO:tasks.workunit.client.1.smithi150.stdout:4/901: creat d0/d3e/d6d/ddf/da4/dd7/f116 x:0 0 0 2023-12-05T09:57:47.750 INFO:tasks.workunit.client.0.smithi100.stdout:9/969: symlink d7/d60/l159 0 2023-12-05T09:57:47.756 INFO:tasks.workunit.client.1.smithi150.stdout:7/973: write d2/db/d30/daf/dd3/d2b/f34 [10799755,120635] 0 2023-12-05T09:57:47.756 INFO:tasks.workunit.client.0.smithi100.stdout:1/899: dwrite db/d12/fb1 [0,4194304] 0 2023-12-05T09:57:47.762 INFO:tasks.workunit.client.0.smithi100.stdout:9/970: mkdir d7/d20/d69/def/d15a 0 2023-12-05T09:57:47.762 INFO:tasks.workunit.client.0.smithi100.stdout:9/971: chown d7/d1b/d22/d2a/d56/d2e/l116 7122 1 2023-12-05T09:57:47.762 INFO:tasks.workunit.client.0.smithi100.stdout:9/972: chown d7/d35/d71/fff 132772883 1 2023-12-05T09:57:47.768 INFO:tasks.workunit.client.1.smithi150.stdout:5/967: mkdir d1/d7f/d65/d3b/d6b/d109/d151 0 2023-12-05T09:57:47.769 INFO:tasks.workunit.client.1.smithi150.stdout:5/968: truncate d1/d7f/fa5 1050861 0 2023-12-05T09:57:47.772 INFO:tasks.workunit.client.1.smithi150.stdout:5/969: fsync d1/d64/de7/f150 0 2023-12-05T09:57:47.772 INFO:tasks.workunit.client.1.smithi150.stdout:5/970: write d1/d64/ded/f113 [462679,90307] 0 2023-12-05T09:57:47.772 INFO:tasks.workunit.client.1.smithi150.stdout:5/971: write d1/d3/d6/f3f [9033025,20015] 0 2023-12-05T09:57:47.772 INFO:tasks.workunit.client.1.smithi150.stdout:5/972: readlink d1/d64/lb8 0 2023-12-05T09:57:47.772 INFO:tasks.workunit.client.1.smithi150.stdout:5/973: fdatasync d1/d7f/d65/d3b/d6b/fb0 0 2023-12-05T09:57:47.773 INFO:tasks.workunit.client.0.smithi100.stdout:4/879: rmdir de/d16/d23/d36 39 2023-12-05T09:57:47.773 INFO:tasks.workunit.client.0.smithi100.stdout:4/880: dread - de/d16/d23/d60/df7/d4e/fe7 zero size 2023-12-05T09:57:47.773 INFO:tasks.workunit.client.0.smithi100.stdout:4/881: write de/d16/d23/d33/f6b [518568,68685] 0 2023-12-05T09:57:47.773 INFO:tasks.workunit.client.0.smithi100.stdout:1/900: unlink db/d12/d1e/d26/d30/d52/f102 0 2023-12-05T09:57:47.774 INFO:tasks.workunit.client.1.smithi150.stdout:4/902: creat d0/d3e/d5b/d80/da1/db2/f117 x:0 0 0 2023-12-05T09:57:47.774 INFO:tasks.workunit.client.1.smithi150.stdout:4/903: fdatasync d0/d3e/d5b/fc6 0 2023-12-05T09:57:47.775 INFO:tasks.workunit.client.1.smithi150.stdout:9/942: mkdir d3/d9/d12d 0 2023-12-05T09:57:47.777 INFO:tasks.workunit.client.1.smithi150.stdout:5/974: write d1/d7f/d65/ff9 [877051,77520] 0 2023-12-05T09:57:47.780 INFO:tasks.workunit.client.1.smithi150.stdout:5/975: creat d1/d7f/d65/d3b/d6b/d11e/f152 x:0 0 0 2023-12-05T09:57:47.780 INFO:tasks.workunit.client.1.smithi150.stdout:5/976: getdents d1/d7f/d65/d3b/d6b/d109/d151 0 2023-12-05T09:57:47.780 INFO:tasks.workunit.client.1.smithi150.stdout:5/977: fsync d1/d7f/d65/d3b/d6b/d11e/dca/f108 0 2023-12-05T09:57:47.780 INFO:tasks.workunit.client.1.smithi150.stdout:5/978: chown d1/d7f/d65/d3b/d6b/d128/f132 10291830 1 2023-12-05T09:57:47.780 INFO:tasks.workunit.client.1.smithi150.stdout:5/979: readlink d1/d7f/d65/d3b/d6b/d11e/l7b 0 2023-12-05T09:57:47.780 INFO:tasks.workunit.client.1.smithi150.stdout:5/980: truncate d1/d7f/d65/d3b/d6b/d128/f132 825040 0 2023-12-05T09:57:47.780 INFO:tasks.workunit.client.1.smithi150.stdout:5/981: truncate d1/d64/d31/f13f 757120 0 2023-12-05T09:57:47.780 INFO:tasks.workunit.client.1.smithi150.stdout:5/982: chown d1/d7f/d65/l5f 6261187 1 2023-12-05T09:57:47.781 INFO:tasks.workunit.client.1.smithi150.stdout:6/861: sync 2023-12-05T09:57:47.783 INFO:tasks.workunit.client.1.smithi150.stdout:5/983: getdents d1/d3 0 2023-12-05T09:57:47.784 INFO:tasks.workunit.client.0.smithi100.stdout:0/920: dwrite da/d22/d33/d74/dca/db4/f103 [0,4194304] 0 2023-12-05T09:57:47.785 INFO:tasks.workunit.client.0.smithi100.stdout:0/921: fdatasync da/d22/f3b 0 2023-12-05T09:57:47.785 INFO:tasks.workunit.client.0.smithi100.stdout:0/922: write da/d22/d33/d35/d3a/de9/f106 [864348,83023] 0 2023-12-05T09:57:47.785 INFO:tasks.workunit.client.1.smithi150.stdout:6/862: creat d2/d23/d2e/d5f/d99/dd8/d10c/f11e x:0 0 0 2023-12-05T09:57:47.785 INFO:tasks.workunit.client.1.smithi150.stdout:6/863: dread - d2/d23/d3b/f74 zero size 2023-12-05T09:57:47.786 INFO:tasks.workunit.client.1.smithi150.stdout:6/864: write d2/f34 [4092976,101551] 0 2023-12-05T09:57:47.786 INFO:tasks.workunit.client.1.smithi150.stdout:6/865: chown d2/d11d/l104 3 1 2023-12-05T09:57:47.786 INFO:tasks.workunit.client.0.smithi100.stdout:8/934: dwrite d0/d35/f10c [0,4194304] 0 2023-12-05T09:57:47.786 INFO:tasks.workunit.client.0.smithi100.stdout:7/888: dwrite d3/dc/d11/d13/de/d2d/d47/dbd/f101 [0,4194304] 0 2023-12-05T09:57:47.788 INFO:tasks.workunit.client.1.smithi150.stdout:5/984: rename d1/d7f/d65/d3b/d6b/d11e/dca/f108 to d1/d7f/d65/d3b/f153 0 2023-12-05T09:57:47.788 INFO:tasks.workunit.client.1.smithi150.stdout:6/866: rename d2/d23/d2e/dd6 to d2/d23/d2e/dd6/df3/d11f 22 2023-12-05T09:57:47.793 INFO:tasks.workunit.client.1.smithi150.stdout:5/985: truncate d1/d7f/d65/d3b/f84 1185584 0 2023-12-05T09:57:47.794 INFO:tasks.workunit.client.1.smithi150.stdout:4/904: write d0/d3e/d6d/f34 [332154,67591] 0 2023-12-05T09:57:47.794 INFO:tasks.workunit.client.1.smithi150.stdout:4/905: creat d0/d3e/d48/d8a/f118 x:0 0 0 2023-12-05T09:57:47.794 INFO:tasks.workunit.client.1.smithi150.stdout:4/906: write d0/d3e/d6d/d4b/fae [735057,120772] 0 2023-12-05T09:57:47.797 INFO:tasks.workunit.client.1.smithi150.stdout:6/867: symlink d2/d23/d2e/d5f/d99/dd8/l120 0 2023-12-05T09:57:47.798 INFO:tasks.workunit.client.1.smithi150.stdout:6/868: write d2/d23/d3b/d64/d7a/d5d/fbd [152572,121368] 0 2023-12-05T09:57:47.798 INFO:tasks.workunit.client.1.smithi150.stdout:6/869: fdatasync d2/d23/d3b/df0/fba 0 2023-12-05T09:57:47.798 INFO:tasks.workunit.client.1.smithi150.stdout:6/870: fdatasync d2/d23/d3b/d64/d7a/d5d/d6b/f53 0 2023-12-05T09:57:47.799 INFO:tasks.workunit.client.1.smithi150.stdout:6/871: creat d2/d23/d3b/d64/f121 x:0 0 0 2023-12-05T09:57:47.799 INFO:tasks.workunit.client.1.smithi150.stdout:6/872: write d2/d23/d3b/d64/d7a/f40 [4303350,65989] 0 2023-12-05T09:57:47.800 INFO:tasks.workunit.client.0.smithi100.stdout:8/935: mkdir d0/d12/d13/d16/d42/d43/d116 0 2023-12-05T09:57:47.800 INFO:tasks.workunit.client.0.smithi100.stdout:8/936: chown d0/d12/d13/d45/da6/d76/d113/dbd/lf8 3884 1 2023-12-05T09:57:47.800 INFO:tasks.workunit.client.0.smithi100.stdout:4/882: dread de/d16/d1e/fb1 [0,4194304] 0 2023-12-05T09:57:47.800 INFO:tasks.workunit.client.0.smithi100.stdout:1/901: dread db/d12/f75 [0,4194304] 0 2023-12-05T09:57:47.801 INFO:tasks.workunit.client.1.smithi150.stdout:5/986: readlink d1/d2e/l10b 0 2023-12-05T09:57:47.801 INFO:tasks.workunit.client.0.smithi100.stdout:9/973: dread d7/d20/d12b/f124 [0,4194304] 0 2023-12-05T09:57:47.803 INFO:tasks.workunit.client.0.smithi100.stdout:7/889: creat d3/dc/d11/d13/de/d18/d3b/d12c/f145 x:0 0 0 2023-12-05T09:57:47.803 INFO:tasks.workunit.client.0.smithi100.stdout:7/890: dread - d3/dc/d11/d33/f10d zero size 2023-12-05T09:57:47.804 INFO:tasks.workunit.client.1.smithi150.stdout:7/974: dwrite d2/db/d17/d38/dc8/f123 [0,4194304] 0 2023-12-05T09:57:47.804 INFO:tasks.workunit.client.1.smithi150.stdout:7/975: dread - d2/db/d17/d38/d85/fc5 zero size 2023-12-05T09:57:47.807 INFO:tasks.workunit.client.0.smithi100.stdout:3/996: dwrite d0/d3d/d5c/fd8 [0,4194304] 0 2023-12-05T09:57:47.811 INFO:tasks.workunit.client.0.smithi100.stdout:4/883: mknod de/d16/d23/d60/d98/da6/d118/c11c 0 2023-12-05T09:57:47.817 INFO:tasks.workunit.client.0.smithi100.stdout:9/974: rename d7/d35/f55 to d7/d1b/d22/d2a/d56/d9c/dfd/d109/f15b 0 2023-12-05T09:57:47.817 INFO:tasks.workunit.client.0.smithi100.stdout:9/975: fdatasync d7/d20/f3a 0 2023-12-05T09:57:47.823 INFO:tasks.workunit.client.1.smithi150.stdout:6/873: symlink d2/d11d/dc6/l122 0 2023-12-05T09:57:47.823 INFO:tasks.workunit.client.1.smithi150.stdout:6/874: chown d2/d23/d2e/d44/ce9 3490 1 2023-12-05T09:57:47.828 INFO:tasks.workunit.client.0.smithi100.stdout:7/891: creat d3/dc/d11/d13/de/d18/d3b/f146 x:0 0 0 2023-12-05T09:57:47.828 INFO:tasks.workunit.client.0.smithi100.stdout:7/892: chown d3/db3/le7 151885 1 2023-12-05T09:57:47.833 INFO:tasks.workunit.client.1.smithi150.stdout:5/987: unlink d1/d7f/d65/f63 0 2023-12-05T09:57:47.838 INFO:tasks.workunit.client.0.smithi100.stdout:4/884: mknod de/d16/d23/d60/df7/d4e/d85/d107/d10a/c11d 0 2023-12-05T09:57:47.839 INFO:tasks.workunit.client.1.smithi150.stdout:7/976: rmdir d2/d4/d144/d5c 39 2023-12-05T09:57:47.840 INFO:tasks.workunit.client.1.smithi150.stdout:7/977: dread - d2/d1b/fa1 zero size 2023-12-05T09:57:47.840 INFO:tasks.workunit.client.1.smithi150.stdout:7/978: read - d2/db/d2e/d71/f102 zero size 2023-12-05T09:57:47.840 INFO:tasks.workunit.client.1.smithi150.stdout:7/979: chown d2/d72/d82/l118 747085801 1 2023-12-05T09:57:47.840 INFO:tasks.workunit.client.1.smithi150.stdout:7/980: chown d2/le4 0 1 2023-12-05T09:57:47.840 INFO:tasks.workunit.client.1.smithi150.stdout:5/988: chown d1/d2e/ce9 668594948 1 2023-12-05T09:57:47.840 INFO:tasks.workunit.client.1.smithi150.stdout:7/981: write d2/db/d30/f94 [3001965,92005] 0 2023-12-05T09:57:47.841 INFO:tasks.workunit.client.0.smithi100.stdout:3/997: rename d0/fa7 to d0/d3d/d5c/d139/de/d11/d7c/dd0/d125/d45/f159 0 2023-12-05T09:57:47.842 INFO:tasks.workunit.client.0.smithi100.stdout:9/976: truncate d7/d20/f3a 4997410 0 2023-12-05T09:57:47.843 INFO:tasks.workunit.client.1.smithi150.stdout:5/989: rmdir d1/d7f/d65/d3b/d6b/d11e/d9a 39 2023-12-05T09:57:47.847 INFO:tasks.workunit.client.1.smithi150.stdout:7/982: rmdir d2/db/d30/d18/d63 39 2023-12-05T09:57:47.849 INFO:tasks.workunit.client.1.smithi150.stdout:4/907: dwrite d0/d3e/d5b/d80/d44/f98 [0,4194304] 0 2023-12-05T09:57:47.851 INFO:tasks.workunit.client.1.smithi150.stdout:9/943: dwrite d3/d9/dc/d1f/d24/d75/d95/dbc/f116 [0,4194304] 0 2023-12-05T09:57:47.851 INFO:tasks.workunit.client.1.smithi150.stdout:9/944: chown d3/d9/d58/fc5 6829 1 2023-12-05T09:57:47.852 INFO:tasks.workunit.client.0.smithi100.stdout:3/998: mknod d0/d3d/d5c/d139/de/db8/dee/c15a 0 2023-12-05T09:57:47.855 INFO:tasks.workunit.client.0.smithi100.stdout:9/977: rename d7/d35/d71/d9a/dcd/d122/c8f to d7/d35/d71/dda/c15c 0 2023-12-05T09:57:47.855 INFO:tasks.workunit.client.0.smithi100.stdout:9/978: dread - d7/d20/d69/def/ddf/f13e zero size 2023-12-05T09:57:47.855 INFO:tasks.workunit.client.0.smithi100.stdout:9/979: readlink l5 0 2023-12-05T09:57:47.858 INFO:tasks.workunit.client.1.smithi150.stdout:4/908: link d0/d3e/d5b/de4/cf2 d0/d3e/d48/d8a/dec/c119 0 2023-12-05T09:57:47.859 INFO:tasks.workunit.client.0.smithi100.stdout:0/923: dwrite da/d1b/ffd [0,4194304] 0 2023-12-05T09:57:47.859 INFO:tasks.workunit.client.0.smithi100.stdout:0/924: readlink da/d22/d33/d74/le8 0 2023-12-05T09:57:47.859 INFO:tasks.workunit.client.0.smithi100.stdout:0/925: truncate da/d1b/d6b/d78/fe5 1475692 0 2023-12-05T09:57:47.859 INFO:tasks.workunit.client.0.smithi100.stdout:7/893: getdents d3/dc/d11/d13/de/d18/dcb 0 2023-12-05T09:57:47.862 INFO:tasks.workunit.client.0.smithi100.stdout:9/980: mkdir d7/d35/d71/d9a/dcd/d122/ddd/d15d 0 2023-12-05T09:57:47.863 INFO:tasks.workunit.client.1.smithi150.stdout:5/990: dread d1/d2e/da6/d24/f93 [0,4194304] 0 2023-12-05T09:57:47.865 INFO:tasks.workunit.client.0.smithi100.stdout:8/937: dwrite d0/d35/d64/f85 [0,4194304] 0 2023-12-05T09:57:47.865 INFO:tasks.workunit.client.0.smithi100.stdout:8/938: chown d0/d12/d13/d45/da6/d76/d113/dbd/d72 1350745182 1 2023-12-05T09:57:47.866 INFO:tasks.workunit.client.0.smithi100.stdout:8/939: truncate d0/d12/d52/fda 588642 0 2023-12-05T09:57:47.866 INFO:tasks.workunit.client.0.smithi100.stdout:8/940: fdatasync d0/d12/d13/d45/da6/d76/d91/ffd 0 2023-12-05T09:57:47.867 INFO:tasks.workunit.client.1.smithi150.stdout:9/945: link d3/d1b/d46/d55/d64/ld7 d3/d9/dc/d1f/d24/d75/d95/d9a/dcb/de4/def/l12e 0 2023-12-05T09:57:47.867 INFO:tasks.workunit.client.1.smithi150.stdout:9/946: creat d3/d42/dd2/f12f x:0 0 0 2023-12-05T09:57:47.867 INFO:tasks.workunit.client.1.smithi150.stdout:9/947: readlink d3/d42/d62/l4d 0 2023-12-05T09:57:47.867 INFO:tasks.workunit.client.1.smithi150.stdout:9/948: truncate d3/f71 4627729 0 2023-12-05T09:57:47.867 INFO:tasks.workunit.client.1.smithi150.stdout:9/949: chown d3/d9/dc/c23 8264 1 2023-12-05T09:57:47.868 INFO:tasks.workunit.client.1.smithi150.stdout:7/983: read d2/db/d17/d38/dc8/f123 [3374928,1004] 0 2023-12-05T09:57:47.868 INFO:tasks.workunit.client.1.smithi150.stdout:7/984: readlink d2/db/d17/l115 0 2023-12-05T09:57:47.870 INFO:tasks.workunit.client.0.smithi100.stdout:1/902: dwrite db/d12/d1e/dd3/db8/fba [0,4194304] 0 2023-12-05T09:57:47.872 INFO:tasks.workunit.client.0.smithi100.stdout:7/894: mkdir d3/dc/d11/d13/de/d18/d3b/d40/d4c/d7f/d147 0 2023-12-05T09:57:47.875 INFO:tasks.workunit.client.0.smithi100.stdout:9/981: mkdir d7/d1b/d22/d2a/d56/d15e 0 2023-12-05T09:57:47.875 INFO:tasks.workunit.client.1.smithi150.stdout:4/909: getdents d0 0 2023-12-05T09:57:47.886 INFO:tasks.workunit.client.0.smithi100.stdout:8/941: creat d0/d12/d13/d45/da6/d76/d113/dbd/d72/d9f/f117 x:0 0 0 2023-12-05T09:57:47.886 INFO:tasks.workunit.client.0.smithi100.stdout:8/942: dread - d0/d12/d13/d45/da6/d9c/f112 zero size 2023-12-05T09:57:47.887 INFO:tasks.workunit.client.1.smithi150.stdout:6/875: dwrite d2/d23/d3b/d64/d7a/fb9 [0,4194304] 0 2023-12-05T09:57:47.887 INFO:tasks.workunit.client.1.smithi150.stdout:6/876: creat d2/d23/d2e/d5f/d99/dd8/f123 x:0 0 0 2023-12-05T09:57:47.887 INFO:tasks.workunit.client.1.smithi150.stdout:4/910: symlink d0/d3e/d5b/d80/da1/l11a 0 2023-12-05T09:57:47.887 INFO:tasks.workunit.client.0.smithi100.stdout:4/885: dwrite de/d38/d5d/f5e [0,4194304] 0 2023-12-05T09:57:47.893 INFO:tasks.workunit.client.1.smithi150.stdout:9/950: dread d3/d9/dc/d1f/f5f [0,4194304] 0 2023-12-05T09:57:47.895 INFO:tasks.workunit.client.0.smithi100.stdout:0/926: getdents da/d1b/d6b/d78 0 2023-12-05T09:57:47.897 INFO:tasks.workunit.client.0.smithi100.stdout:1/903: mkdir db/d12/d113 0 2023-12-05T09:57:47.897 INFO:tasks.workunit.client.0.smithi100.stdout:1/904: fdatasync db/d12/d1e/f50 0 2023-12-05T09:57:47.898 INFO:tasks.workunit.client.1.smithi150.stdout:7/985: dread d2/d4/f6d [0,4194304] 0 2023-12-05T09:57:47.902 INFO:tasks.workunit.client.0.smithi100.stdout:7/895: creat d3/dc/d11/d13/f148 x:0 0 0 2023-12-05T09:57:47.902 INFO:tasks.workunit.client.0.smithi100.stdout:7/896: dread - d3/dc/d11/d13/d37/d97/dc1/dcd/f140 zero size 2023-12-05T09:57:47.903 INFO:tasks.workunit.client.1.smithi150.stdout:6/877: mknod d2/d23/d2e/d5f/c124 0 2023-12-05T09:57:47.903 INFO:tasks.workunit.client.1.smithi150.stdout:6/878: dread - d2/d23/d3b/d64/d7a/d5d/de0/ff6 zero size 2023-12-05T09:57:47.904 INFO:tasks.workunit.client.0.smithi100.stdout:8/943: creat d0/d35/d64/d81/d9a/dfe/f118 x:0 0 0 2023-12-05T09:57:47.907 INFO:tasks.workunit.client.1.smithi150.stdout:9/951: symlink d3/d9/d26/d9b/l130 0 2023-12-05T09:57:47.909 INFO:tasks.workunit.client.1.smithi150.stdout:5/991: dwrite d1/d7f/d65/de3/d10a/f105 [0,4194304] 0 2023-12-05T09:57:47.912 INFO:tasks.workunit.client.1.smithi150.stdout:9/952: rename d3/d9/d6e/d84/f125 to d3/d1b/d46/f131 0 2023-12-05T09:57:47.912 INFO:tasks.workunit.client.1.smithi150.stdout:9/953: fsync d3/d42/f56 0 2023-12-05T09:57:47.915 INFO:tasks.workunit.client.1.smithi150.stdout:9/954: mknod d3/d9/dc/d1f/d24/d75/d95/c132 0 2023-12-05T09:57:47.916 INFO:tasks.workunit.client.0.smithi100.stdout:8/944: creat d0/d12/d13/d45/da6/d76/d113/dbd/d72/f119 x:0 0 0 2023-12-05T09:57:47.916 INFO:tasks.workunit.client.0.smithi100.stdout:8/945: stat d0/d12/d13/d16/d42/le7 0 2023-12-05T09:57:47.921 INFO:tasks.workunit.client.0.smithi100.stdout:4/886: dread de/d16/d1e/f30 [0,4194304] 0 2023-12-05T09:57:47.921 INFO:tasks.workunit.client.0.smithi100.stdout:4/887: creat de/d16/d23/d60/de3/f11e x:0 0 0 2023-12-05T09:57:47.921 INFO:tasks.workunit.client.0.smithi100.stdout:3/999: dwrite d0/d3d/dfc/d10d/db0/d100/f111 [0,4194304] 0 2023-12-05T09:57:47.928 INFO:tasks.workunit.client.1.smithi150.stdout:7/986: write d2/db/f45 [425006,74023] 0 2023-12-05T09:57:47.932 INFO:tasks.workunit.client.1.smithi150.stdout:9/955: getdents d3/d82 0 2023-12-05T09:57:47.932 INFO:tasks.workunit.client.1.smithi150.stdout:9/956: read d3/d9/d6e/d84/f103 [6753900,10685] 0 2023-12-05T09:57:47.935 INFO:tasks.workunit.client.0.smithi100.stdout:9/982: dwrite d7/d20/d12b/f133 [0,4194304] 0 2023-12-05T09:57:47.937 INFO:tasks.workunit.client.1.smithi150.stdout:7/987: unlink d2/db/d30/daf/dd3/c51 0 2023-12-05T09:57:47.937 INFO:tasks.workunit.client.1.smithi150.stdout:7/988: fdatasync d2/d9d/fdd 0 2023-12-05T09:57:47.937 INFO:tasks.workunit.client.1.smithi150.stdout:7/989: chown d2/d9d/da0/cc2 511 1 2023-12-05T09:57:47.938 INFO:tasks.workunit.client.1.smithi150.stdout:6/879: dread d2/d23/d3b/d64/d7a/f40 [0,4194304] 0 2023-12-05T09:57:47.947 INFO:tasks.workunit.client.1.smithi150.stdout:9/957: symlink d3/l133 0 2023-12-05T09:57:47.949 INFO:tasks.workunit.client.1.smithi150.stdout:6/880: rename d2/d23/d3b/d64/f121 to d2/d23/d2e/d72/f125 0 2023-12-05T09:57:47.949 INFO:tasks.workunit.client.1.smithi150.stdout:4/911: write d0/d3e/d6d/d4b/d8c/f8e [1052966,79255] 0 2023-12-05T09:57:47.951 INFO:tasks.workunit.client.0.smithi100.stdout:4/888: creat de/d16/d23/d33/d51/f11f x:0 0 0 2023-12-05T09:57:47.955 INFO:tasks.workunit.client.0.smithi100.stdout:4/889: rename de/d38/fb9 to de/d16/d1e/f120 0 2023-12-05T09:57:47.956 INFO:tasks.workunit.client.1.smithi150.stdout:4/912: rmdir d0 39 2023-12-05T09:57:47.956 INFO:tasks.workunit.client.1.smithi150.stdout:4/913: chown d0/d3e/d6d/d4b/c4f 50 1 2023-12-05T09:57:47.958 INFO:tasks.workunit.client.1.smithi150.stdout:9/958: rename d3/d9/dc/d1f/cbb to d3/d9/d6e/d84/c134 0 2023-12-05T09:57:47.959 INFO:tasks.workunit.client.1.smithi150.stdout:9/959: fsync d3/d9/dc/d1f/fa1 0 2023-12-05T09:57:47.959 INFO:tasks.workunit.client.1.smithi150.stdout:9/960: fdatasync d3/d1b/d46/d55/fc4 0 2023-12-05T09:57:47.959 INFO:tasks.workunit.client.1.smithi150.stdout:9/961: fdatasync d3/d42/f56 0 2023-12-05T09:57:47.959 INFO:tasks.workunit.client.1.smithi150.stdout:9/962: fsync d3/d9/d58/fdd 0 2023-12-05T09:57:47.959 INFO:tasks.workunit.client.1.smithi150.stdout:9/963: creat d3/d9/d6e/d84/f135 x:0 0 0 2023-12-05T09:57:47.969 INFO:tasks.workunit.client.1.smithi150.stdout:4/914: link d0/d3e/d6d/d95/l9d d0/d3e/d5b/d80/da1/db2/dbe/d104/l11b 0 2023-12-05T09:57:47.973 INFO:tasks.workunit.client.1.smithi150.stdout:7/990: dread d2/db/d30/d13/f66 [4194304,4194304] 0 2023-12-05T09:57:47.986 INFO:tasks.workunit.client.0.smithi100.stdout:9/983: dwrite d7/d1b/d22/d51/f2d [8388608,4194304] 0 2023-12-05T09:57:47.986 INFO:tasks.workunit.client.0.smithi100.stdout:9/984: dread - d7/d1b/d89/f140 zero size 2023-12-05T09:57:47.986 INFO:tasks.workunit.client.0.smithi100.stdout:9/985: creat d7/d1b/d22/d2a/d56/d9c/f15f x:0 0 0 2023-12-05T09:57:47.987 INFO:tasks.workunit.client.1.smithi150.stdout:7/991: mknod d2/d9d/c145 0 2023-12-05T09:57:47.987 INFO:tasks.workunit.client.1.smithi150.stdout:9/964: rmdir d3/d9/dc/d1f/d24 39 2023-12-05T09:57:47.987 INFO:tasks.workunit.client.1.smithi150.stdout:7/992: write d2/db/d30/d53/d90/fb8 [1915868,88171] 0 2023-12-05T09:57:47.987 INFO:tasks.workunit.client.1.smithi150.stdout:7/993: truncate d2/db/d30/d47/fea 618657 0 2023-12-05T09:57:47.987 INFO:tasks.workunit.client.1.smithi150.stdout:7/994: write d2/db/d2e/d9a/df1/f142 [677102,81034] 0 2023-12-05T09:57:47.989 INFO:tasks.workunit.client.0.smithi100.stdout:1/905: dwrite db/d12/d61/f85 [0,4194304] 0 2023-12-05T09:57:47.989 INFO:tasks.workunit.client.0.smithi100.stdout:1/906: fsync db/d12/d1e/d26/d30/d52/f5f 0 2023-12-05T09:57:47.989 INFO:tasks.workunit.client.0.smithi100.stdout:1/907: write db/d31/d3a/f5b [3019949,95897] 0 2023-12-05T09:57:47.991 INFO:tasks.workunit.client.0.smithi100.stdout:0/927: dwrite da/d22/d33/d74/f119 [0,4194304] 0 2023-12-05T09:57:47.994 INFO:tasks.workunit.client.1.smithi150.stdout:7/995: mkdir d2/d4/d144/d5c/d146 0 2023-12-05T09:57:47.995 INFO:tasks.workunit.client.1.smithi150.stdout:9/965: getdents d3/d9/d6e/d76 0 2023-12-05T09:57:47.995 INFO:tasks.workunit.client.1.smithi150.stdout:9/966: write d3/d1b/d46/d55/ff5 [3681932,127767] 0 2023-12-05T09:57:47.997 INFO:tasks.workunit.client.1.smithi150.stdout:7/996: unlink d2/db/d30/d13/f37 0 2023-12-05T09:57:47.998 INFO:tasks.workunit.client.0.smithi100.stdout:9/986: mknod d7/d1b/d22/d2a/d56/d9c/dfd/d109/c160 0 2023-12-05T09:57:47.999 INFO:tasks.workunit.client.1.smithi150.stdout:9/967: unlink d3/d9/dc/d1f/d24/d75/d95/d9a/dcb/l102 0 2023-12-05T09:57:48.000 INFO:tasks.workunit.client.1.smithi150.stdout:7/997: creat d2/db/d30/daf/dd3/d2b/dd2/f147 x:0 0 0 2023-12-05T09:57:48.002 INFO:tasks.workunit.client.1.smithi150.stdout:9/968: symlink d3/d9/dc/d1f/d24/d75/d95/dbc/dad/l136 0 2023-12-05T09:57:48.002 INFO:tasks.workunit.client.1.smithi150.stdout:9/969: readlink d3/d9/d67/l8b 0 2023-12-05T09:57:48.004 INFO:tasks.workunit.client.0.smithi100.stdout:0/928: creat da/d1b/d6b/d78/f11b x:0 0 0 2023-12-05T09:57:48.006 INFO:tasks.workunit.client.1.smithi150.stdout:9/970: creat d3/d9/d6e/f137 x:0 0 0 2023-12-05T09:57:48.007 INFO:tasks.workunit.client.0.smithi100.stdout:9/987: creat d7/d1b/d22/d93/dc9/f161 x:0 0 0 2023-12-05T09:57:48.007 INFO:tasks.workunit.client.0.smithi100.stdout:9/988: fsync d7/d1b/d22/d93/dc9/ffa 0 2023-12-05T09:57:48.008 INFO:tasks.workunit.client.0.smithi100.stdout:7/897: dwrite d3/dc/f11c [0,4194304] 0 2023-12-05T09:57:48.009 INFO:tasks.workunit.client.0.smithi100.stdout:8/946: dwrite d0/d12/d13/d16/f79 [4194304,4194304] 0 2023-12-05T09:57:48.010 INFO:tasks.workunit.client.1.smithi150.stdout:5/992: dwrite d1/f74 [0,4194304] 0 2023-12-05T09:57:48.010 INFO:tasks.workunit.client.1.smithi150.stdout:5/993: read d1/d3/f7d [2501688,19189] 0 2023-12-05T09:57:48.010 INFO:tasks.workunit.client.0.smithi100.stdout:0/929: rename da/d22/d33/d35/d3a/f83 to da/d1b/d73/d82/f11c 0 2023-12-05T09:57:48.011 INFO:tasks.workunit.client.0.smithi100.stdout:9/989: mkdir d7/d35/d71/d9a/dcd/d162 0 2023-12-05T09:57:48.013 INFO:tasks.workunit.client.1.smithi150.stdout:6/881: dwrite d2/d23/d2e/f91 [4194304,4194304] 0 2023-12-05T09:57:48.013 INFO:tasks.workunit.client.1.smithi150.stdout:6/882: fsync d2/d23/d3b/df0/fc2 0 2023-12-05T09:57:48.013 INFO:tasks.workunit.client.1.smithi150.stdout:6/883: creat d2/d23/d3b/d64/d7a/d5d/f126 x:0 0 0 2023-12-05T09:57:48.013 INFO:tasks.workunit.client.1.smithi150.stdout:6/884: chown d2/d23/d2e/d5f/d99/dd8/ddf/dfa/c10d 49 1 2023-12-05T09:57:48.013 INFO:tasks.workunit.client.1.smithi150.stdout:6/885: fsync d2/d23/d3b/df0/d97/f98 0 2023-12-05T09:57:48.013 INFO:tasks.workunit.client.1.smithi150.stdout:6/886: chown d2/d23/d3b/d64/d7a/d5d/d6b/f89 20552 1 2023-12-05T09:57:48.013 INFO:tasks.workunit.client.1.smithi150.stdout:6/887: getdents d2/d23/d3b/d64/d7a/d5d/dcd 0 2023-12-05T09:57:48.013 INFO:tasks.workunit.client.1.smithi150.stdout:5/994: stat d1/d2e/c95 0 2023-12-05T09:57:48.015 INFO:tasks.workunit.client.0.smithi100.stdout:9/990: read - d7/d1b/d22/d93/dd9/f11e zero size 2023-12-05T09:57:48.015 INFO:tasks.workunit.client.0.smithi100.stdout:9/991: fsync d7/d1b/d22/d51/d32/d96/ff4 0 2023-12-05T09:57:48.015 INFO:tasks.workunit.client.0.smithi100.stdout:9/992: write d7/d1b/d22/d2a/d56/d9c/f15f [5903,37997] 0 2023-12-05T09:57:48.017 INFO:tasks.workunit.client.0.smithi100.stdout:1/908: read db/d31/d3a/d3b/fa1 [2642166,8769] 0 2023-12-05T09:57:48.017 INFO:tasks.workunit.client.1.smithi150.stdout:4/915: dwrite d0/d3e/d5b/d80/d44/f60 [0,4194304] 0 2023-12-05T09:57:48.022 INFO:tasks.workunit.client.0.smithi100.stdout:7/898: creat d3/dc/d11/d13/d37/d97/dc1/dcd/d13f/f149 x:0 0 0 2023-12-05T09:57:48.022 INFO:tasks.workunit.client.0.smithi100.stdout:7/899: fdatasync d3/dc/d11/d13/f148 0 2023-12-05T09:57:48.024 INFO:tasks.workunit.client.0.smithi100.stdout:8/947: unlink d0/d12/d13/d45/da6/d9c/f112 0 2023-12-05T09:57:48.024 INFO:tasks.workunit.client.0.smithi100.stdout:8/948: write d0/f19 [890076,29834] 0 2023-12-05T09:57:48.025 INFO:tasks.workunit.client.1.smithi150.stdout:9/971: write d3/d9/dc/d1f/fa1 [2041575,60461] 0 2023-12-05T09:57:48.026 INFO:tasks.workunit.client.1.smithi150.stdout:6/888: mkdir d2/d23/d3b/d64/d7a/d127 0 2023-12-05T09:57:48.031 INFO:tasks.workunit.client.0.smithi100.stdout:1/909: rename db/d31/d3a/c3c to db/d12/d1e/dd3/db8/de7/c114 0 2023-12-05T09:57:48.031 INFO:tasks.workunit.client.0.smithi100.stdout:7/900: dread d3/dc/d11/d13/d37/d97/dc1/dcd/d13f/f128 [0,4194304] 0 2023-12-05T09:57:48.032 INFO:tasks.workunit.client.0.smithi100.stdout:0/930: symlink da/d22/d33/d109/l11d 0 2023-12-05T09:57:48.034 INFO:tasks.workunit.client.1.smithi150.stdout:4/916: creat d0/d3e/d6d/ddf/da4/f11c x:0 0 0 2023-12-05T09:57:48.034 INFO:tasks.workunit.client.1.smithi150.stdout:4/917: chown d0/d3e/d48/d8a/lc2 0 1 2023-12-05T09:57:48.036 INFO:tasks.workunit.client.1.smithi150.stdout:9/972: mknod d3/d9/d26/d34/c138 0 2023-12-05T09:57:48.039 INFO:tasks.workunit.client.0.smithi100.stdout:8/949: rename d0/d12/d13/d16/d42/d43/f66 to d0/d12/d13/d16/d42/f11a 0 2023-12-05T09:57:48.045 INFO:tasks.workunit.client.1.smithi150.stdout:6/889: link d2/d23/d2e/d72/fec d2/d23/d2e/d5f/d99/dd8/ddf/f128 0 2023-12-05T09:57:48.045 INFO:tasks.workunit.client.1.smithi150.stdout:7/998: dwrite d2/d4/d144/d5c/f43 [0,4194304] 0 2023-12-05T09:57:48.046 INFO:tasks.workunit.client.0.smithi100.stdout:0/931: stat da/d1b/d73/db3/ld4 0 2023-12-05T09:57:48.049 INFO:tasks.workunit.client.0.smithi100.stdout:1/910: symlink db/l115 0 2023-12-05T09:57:48.050 INFO:tasks.workunit.client.1.smithi150.stdout:6/890: mknod d2/d23/d2e/d5f/d99/c129 0 2023-12-05T09:57:48.050 INFO:tasks.workunit.client.1.smithi150.stdout:6/891: creat d2/d23/d3b/d83/f12a x:0 0 0 2023-12-05T09:57:48.050 INFO:tasks.workunit.client.1.smithi150.stdout:6/892: readlink d2/d23/l4c 0 2023-12-05T09:57:48.051 INFO:tasks.workunit.client.0.smithi100.stdout:4/890: dwrite de/d16/d23/d60/df7/fe6 [0,4194304] 0 2023-12-05T09:57:48.057 INFO:tasks.workunit.client.0.smithi100.stdout:8/950: dread d0/d12/d13/d16/da3/fe0 [0,4194304] 0 2023-12-05T09:57:48.058 INFO:tasks.workunit.client.1.smithi150.stdout:9/973: write d3/d9/f20 [6369015,69061] 0 2023-12-05T09:57:48.059 INFO:tasks.workunit.client.1.smithi150.stdout:9/974: dread - d3/d9/d58/fc5 zero size 2023-12-05T09:57:48.064 INFO:tasks.workunit.client.1.smithi150.stdout:9/975: mknod d3/d1b/c139 0 2023-12-05T09:57:48.073 INFO:tasks.workunit.client.0.smithi100.stdout:8/951: symlink d0/d12/d13/d45/da6/d76/d113/df1/d103/l11b 0 2023-12-05T09:57:48.073 INFO:tasks.workunit.client.0.smithi100.stdout:8/952: chown d0/d12/d13/d45/da6/d76/d113/dbd/d72/l97 190 1 2023-12-05T09:57:48.073 INFO:tasks.workunit.client.0.smithi100.stdout:7/901: write d3/dc/d11/d33/f53 [1045800,16706] 0 2023-12-05T09:57:48.074 INFO:tasks.workunit.client.0.smithi100.stdout:7/902: write d3/dc/d11/d13/d37/d97/dc1/dcd/f140 [594107,130575] 0 2023-12-05T09:57:48.074 INFO:tasks.workunit.client.0.smithi100.stdout:7/903: chown d3/dc/d11/d13/de/d18/c124 3 1 2023-12-05T09:57:48.074 INFO:tasks.workunit.client.0.smithi100.stdout:7/904: chown d3/dc/d11/d13/d37/d97/fec 8 1 2023-12-05T09:57:48.077 INFO:tasks.workunit.client.0.smithi100.stdout:7/905: mkdir d3/dc/d11/d13/d37/d97/dc1/dcd/d14a 0 2023-12-05T09:57:48.077 INFO:tasks.workunit.client.1.smithi150.stdout:9/976: symlink d3/d9/d58/l13a 0 2023-12-05T09:57:48.077 INFO:tasks.workunit.client.1.smithi150.stdout:9/977: readlink d3/d42/l12c 0 2023-12-05T09:57:48.078 INFO:tasks.workunit.client.0.smithi100.stdout:8/953: write d0/d12/d13/d45/f5d [78437,83825] 0 2023-12-05T09:57:48.079 INFO:tasks.workunit.client.1.smithi150.stdout:5/995: dwrite d1/d7f/d65/d3b/fdc [0,4194304] 0 2023-12-05T09:57:48.081 INFO:tasks.workunit.client.1.smithi150.stdout:9/978: write d3/d1b/d46/d55/fc4 [792676,41117] 0 2023-12-05T09:57:48.081 INFO:tasks.workunit.client.0.smithi100.stdout:1/911: write db/d12/f16 [4188356,73422] 0 2023-12-05T09:57:48.083 INFO:tasks.workunit.client.0.smithi100.stdout:4/891: write de/d16/d23/f29 [2962143,63541] 0 2023-12-05T09:57:48.090 INFO:tasks.workunit.client.1.smithi150.stdout:5/996: getdents d1/d7f/d65/d3b/d6b/dcb 0 2023-12-05T09:57:48.100 INFO:tasks.workunit.client.0.smithi100.stdout:1/912: write db/d31/d3a/f4c [5566921,18627] 0 2023-12-05T09:57:48.102 INFO:tasks.workunit.client.1.smithi150.stdout:4/918: dwrite d0/f61 [0,4194304] 0 2023-12-05T09:57:48.106 INFO:tasks.workunit.client.0.smithi100.stdout:4/892: dread de/d16/f45 [0,4194304] 0 2023-12-05T09:57:48.106 INFO:tasks.workunit.client.0.smithi100.stdout:4/893: dread - de/d16/d23/d33/fdd zero size 2023-12-05T09:57:48.107 INFO:tasks.workunit.client.1.smithi150.stdout:4/919: mknod d0/d3e/d5b/d6e/c11d 0 2023-12-05T09:57:48.108 INFO:tasks.workunit.client.1.smithi150.stdout:4/920: mknod d0/d3e/d48/dbb/c11e 0 2023-12-05T09:57:48.110 INFO:tasks.workunit.client.0.smithi100.stdout:4/894: mkdir de/d38/d8b/d121 0 2023-12-05T09:57:48.112 INFO:tasks.workunit.client.1.smithi150.stdout:4/921: mkdir d0/d3e/d6d/d4b/d8c/d11f 0 2023-12-05T09:57:48.113 INFO:tasks.workunit.client.0.smithi100.stdout:4/895: creat de/d16/d23/d60/f122 x:0 0 0 2023-12-05T09:57:48.113 INFO:tasks.workunit.client.0.smithi100.stdout:4/896: write de/d16/f67 [516988,36521] 0 2023-12-05T09:57:48.114 INFO:tasks.workunit.client.1.smithi150.stdout:4/922: symlink d0/d3e/d5b/d80/l120 0 2023-12-05T09:57:48.116 INFO:tasks.workunit.client.1.smithi150.stdout:4/923: creat d0/d3e/d5b/de4/d108/f121 x:0 0 0 2023-12-05T09:57:48.118 INFO:tasks.workunit.client.0.smithi100.stdout:9/993: dwrite d7/d20/d69/def/da2/fc3 [0,4194304] 0 2023-12-05T09:57:48.121 INFO:tasks.workunit.client.0.smithi100.stdout:7/906: dread d3/dc/d11/d13/de/d2d/d42/f83 [0,4194304] 0 2023-12-05T09:57:48.127 INFO:tasks.workunit.client.0.smithi100.stdout:9/994: write d7/d1b/d22/d2a/d56/d9c/dfd/d109/f113 [42232,45137] 0 2023-12-05T09:57:48.140 INFO:tasks.workunit.client.1.smithi150.stdout:7/999: dwrite d2/db/d30/d47/fed [0,4194304] 0 2023-12-05T09:57:48.141 INFO:tasks.workunit.client.0.smithi100.stdout:9/995: fdatasync d7/d1b/d22/d51/f5f 0 2023-12-05T09:57:48.141 INFO:tasks.workunit.client.0.smithi100.stdout:9/996: creat d7/d35/d71/d9a/dcd/d122/f163 x:0 0 0 2023-12-05T09:57:48.146 INFO:tasks.workunit.client.0.smithi100.stdout:8/954: dread d0/d12/d13/d16/d42/f11a [0,4194304] 0 2023-12-05T09:57:48.146 INFO:tasks.workunit.client.0.smithi100.stdout:8/955: write d0/d35/f68 [1442293,98142] 0 2023-12-05T09:57:48.149 INFO:tasks.workunit.client.0.smithi100.stdout:0/932: dwrite da/d1b/d6b/fa7 [0,4194304] 0 2023-12-05T09:57:48.149 INFO:tasks.workunit.client.0.smithi100.stdout:9/997: unlink d7/d1b/d22/d93/fd7 0 2023-12-05T09:57:48.157 INFO:tasks.workunit.client.0.smithi100.stdout:8/956: rmdir d0/d12/d13/d45/da6/d76/d113/df1/d103 39 2023-12-05T09:57:48.158 INFO:tasks.workunit.client.0.smithi100.stdout:8/957: stat d0/d35/c51 0 2023-12-05T09:57:48.168 INFO:tasks.workunit.client.1.smithi150.stdout:5/997: dwrite d1/d3/f7e [0,4194304] 0 2023-12-05T09:57:48.168 INFO:tasks.workunit.client.1.smithi150.stdout:6/893: dwrite d2/d23/d3b/d64/d7a/d5d/d6b/f111 [0,4194304] 0 2023-12-05T09:57:48.174 INFO:tasks.workunit.client.0.smithi100.stdout:0/933: symlink da/d22/d33/d74/dca/df1/l11e 0 2023-12-05T09:57:48.175 INFO:tasks.workunit.client.0.smithi100.stdout:9/998: truncate d7/d1b/f33 1041587 0 2023-12-05T09:57:48.175 INFO:tasks.workunit.client.0.smithi100.stdout:9/999: dread - d7/d1b/d22/d93/dc9/f148 zero size 2023-12-05T09:57:48.178 INFO:tasks.workunit.client.0.smithi100.stdout:1/913: dwrite db/d12/fb1 [0,4194304] 0 2023-12-05T09:57:48.178 INFO:tasks.workunit.client.0.smithi100.stdout:1/914: truncate db/d12/d1e/fc3 710264 0 2023-12-05T09:57:48.182 INFO:tasks.workunit.client.0.smithi100.stdout:8/958: creat d0/d12/d13/d45/dc9/f11c x:0 0 0 2023-12-05T09:57:48.184 INFO:tasks.workunit.client.1.smithi150.stdout:4/924: dwrite d0/d3e/d5b/d80/d44/f46 [0,4194304] 0 2023-12-05T09:57:48.184 INFO:tasks.workunit.client.0.smithi100.stdout:7/907: dwrite d3/dc/d11/d13/d37/d97/dc1/dcd/d13f/f149 [0,4194304] 0 2023-12-05T09:57:48.195 INFO:tasks.workunit.client.0.smithi100.stdout:0/934: creat da/d2a/d45/f11f x:0 0 0 2023-12-05T09:57:48.196 INFO:tasks.workunit.client.0.smithi100.stdout:0/935: chown da/d22/d33/d7f/cfb 12674002 1 2023-12-05T09:57:48.196 INFO:tasks.workunit.client.0.smithi100.stdout:0/936: chown da/f11 437306 1 2023-12-05T09:57:48.196 INFO:tasks.workunit.client.0.smithi100.stdout:0/937: fdatasync da/d22/d33/d74/dca/fdf 0 2023-12-05T09:57:48.196 INFO:tasks.workunit.client.0.smithi100.stdout:0/938: stat da/d22/d33/d74/fdb 0 2023-12-05T09:57:48.196 INFO:tasks.workunit.client.0.smithi100.stdout:0/939: stat da/d22/d33/d35/cf6 0 2023-12-05T09:57:48.197 INFO:tasks.workunit.client.0.smithi100.stdout:1/915: mkdir db/d31/d3a/d4a/dad/d67/d116 0 2023-12-05T09:57:48.197 INFO:tasks.workunit.client.0.smithi100.stdout:1/916: creat db/d12/d1e/d26/f117 x:0 0 0 2023-12-05T09:57:48.197 INFO:tasks.workunit.client.1.smithi150.stdout:5/998: truncate d1/d7f/d65/d3b/d6b/d11e/d9a/dc7/f12b 279047 0 2023-12-05T09:57:48.199 INFO:tasks.workunit.client.0.smithi100.stdout:8/959: mkdir d0/d12/d13/d16/d42/d104/d11d 0 2023-12-05T09:57:48.199 INFO:tasks.workunit.client.0.smithi100.stdout:8/960: chown d0/d12/d13/d45/da6/d76/d113/dbd/f65 3524 1 2023-12-05T09:57:48.199 INFO:tasks.workunit.client.0.smithi100.stdout:8/961: chown d0/d35/f70 1768734059 1 2023-12-05T09:57:48.199 INFO:tasks.workunit.client.0.smithi100.stdout:8/962: chown d0/d12/d13/f2f 0 1 2023-12-05T09:57:48.200 INFO:tasks.workunit.client.1.smithi150.stdout:6/894: mknod d2/d23/d2e/d5f/d99/dd8/c12b 0 2023-12-05T09:57:48.200 INFO:tasks.workunit.client.1.smithi150.stdout:6/895: creat d2/d23/d3b/db4/df1/f12c x:0 0 0 2023-12-05T09:57:48.200 INFO:tasks.workunit.client.1.smithi150.stdout:6/896: creat d2/d23/d2e/d5f/df5/f12d x:0 0 0 2023-12-05T09:57:48.202 INFO:tasks.workunit.client.1.smithi150.stdout:4/925: symlink d0/d3e/d5b/d6e/l122 0 2023-12-05T09:57:48.203 INFO:tasks.workunit.client.1.smithi150.stdout:4/926: truncate d0/d3e/d48/dbb/fc9 649867 0 2023-12-05T09:57:48.205 INFO:tasks.workunit.client.0.smithi100.stdout:7/908: rename d3/dc/d11/d13/de/d18/d3b/d40/d4c/d7f/f111 to d3/dc/d11/d13/de/d18/d3b/d40/d46/d9e/f14b 0 2023-12-05T09:57:48.206 INFO:tasks.workunit.client.0.smithi100.stdout:0/940: mkdir da/d22/d33/d35/d3a/de9/d120 0 2023-12-05T09:57:48.209 INFO:tasks.workunit.client.1.smithi150.stdout:5/999: rename d1/d7f/c141 to d1/d7f/d65/d3b/d6b/d11e/d9a/d10e/c154 0 2023-12-05T09:57:48.212 INFO:tasks.workunit.client.0.smithi100.stdout:8/963: mknod d0/d12/d13/d45/da6/d76/d113/dbd/d72/d9f/dde/c11e 0 2023-12-05T09:57:48.212 INFO:tasks.workunit.client.0.smithi100.stdout:8/964: dread - d0/d12/fd8 zero size 2023-12-05T09:57:48.217 INFO:tasks.workunit.client.1.smithi150.stdout:6/897: rmdir d2/d23/d2e/d5f/d99/dd8/ddf 39 2023-12-05T09:57:48.218 INFO:tasks.workunit.client.1.smithi150.stdout:6/898: write d2/d23/d3b/d64/d7a/d5d/d6b/fca [3187817,30888] 0 2023-12-05T09:57:48.220 INFO:tasks.workunit.client.0.smithi100.stdout:0/941: unlink da/d22/d33/d35/d3a/f67 0 2023-12-05T09:57:48.220 INFO:tasks.workunit.client.0.smithi100.stdout:0/942: chown da/d1b 14816 1 2023-12-05T09:57:48.221 INFO:tasks.workunit.client.0.smithi100.stdout:1/917: symlink db/ddf/l118 0 2023-12-05T09:57:48.223 INFO:tasks.workunit.client.0.smithi100.stdout:0/943: creat da/d2a/f121 x:0 0 0 2023-12-05T09:57:48.224 INFO:tasks.workunit.client.0.smithi100.stdout:0/944: dread - da/f108 zero size 2023-12-05T09:57:48.225 INFO:tasks.workunit.client.0.smithi100.stdout:1/918: creat db/d12/d1e/dd3/db8/f119 x:0 0 0 2023-12-05T09:57:48.228 INFO:tasks.workunit.client.0.smithi100.stdout:1/919: truncate db/d12/f96 2084129 0 2023-12-05T09:57:48.235 INFO:tasks.workunit.client.0.smithi100.stdout:1/920: rmdir db/d12/d1e/d26/d39 39 2023-12-05T09:57:48.236 INFO:tasks.workunit.client.0.smithi100.stdout:1/921: symlink db/d12/d113/l11a 0 2023-12-05T09:57:48.237 INFO:tasks.workunit.client.0.smithi100.stdout:1/922: truncate db/d12/d1e/dd3/db8/fd9 8416331 0 2023-12-05T09:57:48.242 INFO:tasks.workunit.client.1.smithi150.stdout:9/979: sync 2023-12-05T09:57:48.266 INFO:tasks.workunit.client.1.smithi150.stdout:9/980: dread d3/d9/d26/d34/f5b [0,4194304] 0 2023-12-05T09:57:48.266 INFO:tasks.workunit.client.1.smithi150.stdout:9/981: write d3/d1b/d46/d55/fc4 [1569761,85151] 0 2023-12-05T09:57:48.266 INFO:tasks.workunit.client.1.smithi150.stdout:9/982: dread - d3/d9/d26/d34/dd5/fea zero size 2023-12-05T09:57:48.266 INFO:tasks.workunit.client.1.smithi150.stdout:6/899: dwrite d2/d23/d2e/d5f/df5/f12d [0,4194304] 0 2023-12-05T09:57:48.268 INFO:tasks.workunit.client.1.smithi150.stdout:9/983: mknod d3/d9/dc/d1f/d24/d75/d95/dbc/dad/db7/c13b 0 2023-12-05T09:57:48.269 INFO:tasks.workunit.client.1.smithi150.stdout:6/900: link d2/d23/d2e/d44/da0/lce d2/d23/d2e/d5f/d99/dd8/ddf/dfa/l12e 0 2023-12-05T09:57:48.270 INFO:tasks.workunit.client.1.smithi150.stdout:9/984: mkdir d3/d1b/d46/d55/d64/d13c 0 2023-12-05T09:57:48.270 INFO:tasks.workunit.client.1.smithi150.stdout:9/985: write d3/d9/dc/fa2 [715467,76934] 0 2023-12-05T09:57:48.270 INFO:tasks.workunit.client.1.smithi150.stdout:4/927: dwrite d0/d3e/d6d/d4b/d8c/f8e [0,4194304] 0 2023-12-05T09:57:48.271 INFO:tasks.workunit.client.1.smithi150.stdout:6/901: unlink d2/d23/d3b/d64/fea 0 2023-12-05T09:57:48.271 INFO:tasks.workunit.client.1.smithi150.stdout:4/928: mknod d0/d3e/d5b/d80/da1/db2/c123 0 2023-12-05T09:57:48.272 INFO:tasks.workunit.client.1.smithi150.stdout:4/929: read - d0/d3e/d48/d8a/f118 zero size 2023-12-05T09:57:48.272 INFO:tasks.workunit.client.1.smithi150.stdout:6/902: creat d2/d23/d3b/d11b/f12f x:0 0 0 2023-12-05T09:57:48.273 INFO:tasks.workunit.client.1.smithi150.stdout:4/930: mknod d0/d3e/d5b/d80/da1/db2/c124 0 2023-12-05T09:57:48.275 INFO:tasks.workunit.client.1.smithi150.stdout:4/931: creat d0/d3e/d5b/de4/f125 x:0 0 0 2023-12-05T09:57:48.275 INFO:tasks.workunit.client.1.smithi150.stdout:4/932: creat d0/d3e/d6d/ddf/da4/f126 x:0 0 0 2023-12-05T09:57:48.276 INFO:tasks.workunit.client.1.smithi150.stdout:6/903: getdents d2/d23/d3b/d83 0 2023-12-05T09:57:48.277 INFO:tasks.workunit.client.1.smithi150.stdout:4/933: symlink d0/d3e/l127 0 2023-12-05T09:57:48.277 INFO:tasks.workunit.client.1.smithi150.stdout:4/934: chown d0/f30 405591 1 2023-12-05T09:57:48.278 INFO:tasks.workunit.client.0.smithi100.stdout:0/945: dread da/d22/f2b [0,4194304] 0 2023-12-05T09:57:48.278 INFO:tasks.workunit.client.1.smithi150.stdout:6/904: symlink d2/d23/d2e/d5f/d99/dd8/l130 0 2023-12-05T09:57:48.282 INFO:tasks.workunit.client.1.smithi150.stdout:4/935: link d0/d3e/d5b/fd5 d0/d3e/d48/dbb/f128 0 2023-12-05T09:57:48.282 INFO:tasks.workunit.client.0.smithi100.stdout:1/923: read db/d12/d61/f85 [700037,111712] 0 2023-12-05T09:57:48.284 INFO:tasks.workunit.client.0.smithi100.stdout:7/909: dwrite d3/dc/d11/d13/d37/d97/dc1/dcd/f103 [0,4194304] 0 2023-12-05T09:57:48.284 INFO:tasks.workunit.client.0.smithi100.stdout:7/910: write d3/dc/d11/d13/de/d18/d3b/d40/d4c/f100 [937057,45153] 0 2023-12-05T09:57:48.284 INFO:tasks.workunit.client.1.smithi150.stdout:6/905: link d2/d23/c2d d2/d23/d3b/ded/c131 0 2023-12-05T09:57:48.284 INFO:tasks.workunit.client.1.smithi150.stdout:6/906: readlink d2/d23/d2e/d44/lbb 0 2023-12-05T09:57:48.288 INFO:tasks.workunit.client.1.smithi150.stdout:4/936: mkdir d0/d3e/d5b/de4/d108/d129 0 2023-12-05T09:57:48.301 INFO:tasks.workunit.client.0.smithi100.stdout:1/924: truncate db/d12/d1e/dd3/db8/fd9 4196527 0 2023-12-05T09:57:48.314 INFO:tasks.workunit.client.1.smithi150.stdout:9/986: dwrite d3/d9/dc/f33 [0,4194304] 0 2023-12-05T09:57:48.319 INFO:tasks.workunit.client.0.smithi100.stdout:1/925: dread db/d12/d1e/f50 [0,4194304] 0 2023-12-05T09:57:48.321 INFO:tasks.workunit.client.0.smithi100.stdout:1/926: rename db/d12/d1e/dd3/db8/de6 to db/d12/d1e/d72/d11b 0 2023-12-05T09:57:48.321 INFO:tasks.workunit.client.0.smithi100.stdout:1/927: chown db 33058590 1 2023-12-05T09:57:48.321 INFO:tasks.workunit.client.0.smithi100.stdout:1/928: write db/d12/d1e/f9f [1220312,58731] 0 2023-12-05T09:57:48.321 INFO:tasks.workunit.client.0.smithi100.stdout:1/929: getdents db/d12/d1e/d72/ddd/dfd/dd6 0 2023-12-05T09:57:48.335 INFO:tasks.workunit.client.0.smithi100.stdout:1/930: dread db/d12/d1e/d26/f62 [0,4194304] 0 2023-12-05T09:57:48.342 INFO:tasks.workunit.client.1.smithi150.stdout:4/937: dread d0/d3e/d48/ff1 [4194304,4194304] 0 2023-12-05T09:57:48.343 INFO:tasks.workunit.client.1.smithi150.stdout:6/907: dwrite d2/f13 [0,4194304] 0 2023-12-05T09:57:48.344 INFO:tasks.workunit.client.0.smithi100.stdout:0/946: dwrite da/d2a/d45/f11f [0,4194304] 0 2023-12-05T09:57:48.347 INFO:tasks.workunit.client.1.smithi150.stdout:6/908: mknod d2/d23/d2e/d5f/d99/dd8/c132 0 2023-12-05T09:57:48.352 INFO:tasks.workunit.client.1.smithi150.stdout:6/909: creat d2/d23/d3b/df0/f133 x:0 0 0 2023-12-05T09:57:48.356 INFO:tasks.workunit.client.1.smithi150.stdout:6/910: creat d2/d23/d2e/d5f/f134 x:0 0 0 2023-12-05T09:57:48.357 INFO:tasks.workunit.client.1.smithi150.stdout:6/911: fsync d2/d23/fb6 0 2023-12-05T09:57:48.362 INFO:tasks.workunit.client.1.smithi150.stdout:6/912: rename d2/d23/d3b/d64/d7a/d8c to d2/d23/d2e/d72/d135 0 2023-12-05T09:57:48.362 INFO:tasks.workunit.client.1.smithi150.stdout:6/913: creat d2/d23/d3b/db4/df1/f136 x:0 0 0 2023-12-05T09:57:48.363 INFO:tasks.workunit.client.0.smithi100.stdout:0/947: creat da/d1b/f122 x:0 0 0 2023-12-05T09:57:48.363 INFO:tasks.workunit.client.0.smithi100.stdout:0/948: fdatasync da/d1b/d6b/d78/f115 0 2023-12-05T09:57:48.366 INFO:tasks.workunit.client.0.smithi100.stdout:0/949: getdents da/d2a/d45/de3/de6 0 2023-12-05T09:57:48.377 INFO:tasks.workunit.client.0.smithi100.stdout:0/950: rename da/d22/d33/d74/cf8 to da/d22/d33/d74/c123 0 2023-12-05T09:57:48.377 INFO:tasks.workunit.client.0.smithi100.stdout:0/951: write da/d22/d33/fa9 [4122917,3041] 0 2023-12-05T09:57:48.382 INFO:tasks.workunit.client.1.smithi150.stdout:9/987: dwrite d3/d9/dc/d1f/fa1 [0,4194304] 0 2023-12-05T09:57:48.382 INFO:tasks.workunit.client.1.smithi150.stdout:9/988: dread - d3/d9/d26/f81 zero size 2023-12-05T09:57:48.387 INFO:tasks.workunit.client.0.smithi100.stdout:0/952: unlink da/d1b/d6b/d78/f11b 0 2023-12-05T09:57:48.392 INFO:tasks.workunit.client.0.smithi100.stdout:0/953: creat da/d22/d33/d74/d77/f124 x:0 0 0 2023-12-05T09:57:48.392 INFO:tasks.workunit.client.0.smithi100.stdout:0/954: dread - da/d22/d33/d74/d77/d105/f10b zero size 2023-12-05T09:57:48.392 INFO:tasks.workunit.client.0.smithi100.stdout:0/955: chown da/d2a/d45 3921344 1 2023-12-05T09:57:48.394 INFO:tasks.workunit.client.0.smithi100.stdout:0/956: creat da/d1b/dbe/f125 x:0 0 0 2023-12-05T09:57:48.397 INFO:tasks.workunit.client.0.smithi100.stdout:7/911: dwrite d3/dc/d11/d13/de/d18/d3b/de2/feb [0,4194304] 0 2023-12-05T09:57:48.398 INFO:tasks.workunit.client.0.smithi100.stdout:7/912: truncate d3/dc/d11/d13/f148 704347 0 2023-12-05T09:57:48.400 INFO:tasks.workunit.client.0.smithi100.stdout:7/913: rename d3/dc/d11/d13/de/d18/d3b/d40/d4c/c63 to d3/dc/d11/c14c 0 2023-12-05T09:57:48.401 INFO:tasks.workunit.client.0.smithi100.stdout:7/914: rename d3/dc/d11/d13/de/c17 to d3/dc/d11/d13/de/d18/d3b/d40/d4c/c14d 0 2023-12-05T09:57:48.402 INFO:tasks.workunit.client.0.smithi100.stdout:7/915: write d3/db3/fd2 [446993,96702] 0 2023-12-05T09:57:48.404 INFO:tasks.workunit.client.0.smithi100.stdout:1/931: dwrite db/d12/d61/f85 [4194304,4194304] 0 2023-12-05T09:57:48.412 INFO:tasks.workunit.client.0.smithi100.stdout:1/932: link db/d12/d1e/d26/d30/cfe db/c11c 0 2023-12-05T09:57:48.412 INFO:tasks.workunit.client.1.smithi150.stdout:4/938: dwrite d0/d3e/d5b/de4/f125 [0,4194304] 0 2023-12-05T09:57:48.414 INFO:tasks.workunit.client.0.smithi100.stdout:1/933: mkdir db/d31/d11d 0 2023-12-05T09:57:48.418 INFO:tasks.workunit.client.0.smithi100.stdout:1/934: mkdir db/d12/d1e/d26/d39/d11e 0 2023-12-05T09:57:48.420 INFO:tasks.workunit.client.0.smithi100.stdout:1/935: rmdir db/d12/d1e/dd3/db8 39 2023-12-05T09:57:48.421 INFO:tasks.workunit.client.1.smithi150.stdout:9/989: read d3/d1b/d79/fb2 [1436443,70116] 0 2023-12-05T09:57:48.424 INFO:tasks.workunit.client.1.smithi150.stdout:9/990: creat d3/d42/d62/de7/f13d x:0 0 0 2023-12-05T09:57:48.424 INFO:tasks.workunit.client.1.smithi150.stdout:6/914: dwrite d2/d23/d3b/d64/d7a/d5d/d6b/fca [0,4194304] 0 2023-12-05T09:57:48.425 INFO:tasks.workunit.client.1.smithi150.stdout:9/991: symlink d3/d82/l13e 0 2023-12-05T09:57:48.425 INFO:tasks.workunit.client.1.smithi150.stdout:9/992: chown d3/d82/l106 8003883 1 2023-12-05T09:57:48.426 INFO:tasks.workunit.client.0.smithi100.stdout:8/965: sync 2023-12-05T09:57:48.426 INFO:tasks.workunit.client.0.smithi100.stdout:4/897: sync 2023-12-05T09:57:48.426 INFO:tasks.workunit.client.0.smithi100.stdout:4/898: fdatasync de/d16/d23/d36/dfe/f104 0 2023-12-05T09:57:48.427 INFO:tasks.workunit.client.0.smithi100.stdout:4/899: chown de/d16/d23/d60/d98/da6/lb4 19373829 1 2023-12-05T09:57:48.427 INFO:tasks.workunit.client.1.smithi150.stdout:6/915: link d2/d23/d2e/d5f/d99/dd8/l130 d2/d23/d2e/dd6/l137 0 2023-12-05T09:57:48.429 INFO:tasks.workunit.client.1.smithi150.stdout:9/993: symlink d3/d9/d26/d34/ded/d129/l13f 0 2023-12-05T09:57:48.429 INFO:tasks.workunit.client.0.smithi100.stdout:8/966: symlink d0/d12/l11f 0 2023-12-05T09:57:48.436 INFO:tasks.workunit.client.0.smithi100.stdout:4/900: mkdir de/d16/d23/d60/df7/d4e/d85/d123 0 2023-12-05T09:57:48.437 INFO:tasks.workunit.client.1.smithi150.stdout:6/916: write d2/d23/d3b/d46/f68 [1477167,115313] 0 2023-12-05T09:57:48.444 INFO:tasks.workunit.client.0.smithi100.stdout:1/936: dread db/d12/d1e/d72/ddd/dfd/dd6/fdc [0,4194304] 0 2023-12-05T09:57:48.446 INFO:tasks.workunit.client.0.smithi100.stdout:1/937: mkdir db/ddf/d11f 0 2023-12-05T09:57:48.446 INFO:tasks.workunit.client.0.smithi100.stdout:1/938: chown db/d31/d73/fac 2596 1 2023-12-05T09:57:48.446 INFO:tasks.workunit.client.0.smithi100.stdout:1/939: write db/d31/f51 [695404,128711] 0 2023-12-05T09:57:48.446 INFO:tasks.workunit.client.0.smithi100.stdout:4/901: write de/d66/fa7 [450340,19764] 0 2023-12-05T09:57:48.446 INFO:tasks.workunit.client.0.smithi100.stdout:1/940: readlink db/d31/d3a/l7e 0 2023-12-05T09:57:48.446 INFO:tasks.workunit.client.0.smithi100.stdout:4/902: fdatasync de/d16/d23/d36/f56 0 2023-12-05T09:57:48.447 INFO:tasks.workunit.client.1.smithi150.stdout:9/994: dread d3/d9/dc/d1f/d24/d75/d95/d9a/f11d [0,4194304] 0 2023-12-05T09:57:48.447 INFO:tasks.workunit.client.1.smithi150.stdout:9/995: truncate d3/d1b/d46/d55/d64/fa6 867431 0 2023-12-05T09:57:48.447 INFO:tasks.workunit.client.1.smithi150.stdout:9/996: fsync d3/d9/d9c/f107 0 2023-12-05T09:57:48.448 INFO:tasks.workunit.client.1.smithi150.stdout:9/997: read d3/d9/dc/d1f/d24/d75/d95/d9a/f11d [677534,3747] 0 2023-12-05T09:57:48.449 INFO:tasks.workunit.client.0.smithi100.stdout:1/941: getdents db/d12/d1e/d26/d30/d6e 0 2023-12-05T09:57:48.452 INFO:tasks.workunit.client.0.smithi100.stdout:8/967: write d0/d35/d64/d81/f98 [26560,67879] 0 2023-12-05T09:57:48.453 INFO:tasks.workunit.client.0.smithi100.stdout:8/968: fsync d0/d12/d13/d45/da6/d76/d113/dbd/f114 0 2023-12-05T09:57:48.453 INFO:tasks.workunit.client.0.smithi100.stdout:8/969: dread - d0/d12/d13/d45/da6/d76/d113/dbd/f114 zero size 2023-12-05T09:57:48.453 INFO:tasks.workunit.client.0.smithi100.stdout:8/970: truncate d0/d12/d13/d45/fbf 803261 0 2023-12-05T09:57:48.459 INFO:tasks.workunit.client.1.smithi150.stdout:4/939: dwrite d0/d3e/d5b/d6e/f88 [0,4194304] 0 2023-12-05T09:57:48.459 INFO:tasks.workunit.client.0.smithi100.stdout:0/957: dwrite da/f11 [0,4194304] 0 2023-12-05T09:57:48.462 INFO:tasks.workunit.client.0.smithi100.stdout:0/958: getdents da/d22/d33 0 2023-12-05T09:57:48.466 INFO:tasks.workunit.client.0.smithi100.stdout:4/903: write de/d16/d23/d36/dfe/f6f [713072,21839] 0 2023-12-05T09:57:48.468 INFO:tasks.workunit.client.1.smithi150.stdout:9/998: truncate d3/d1b/d46/d55/fc4 785314 0 2023-12-05T09:57:48.468 INFO:tasks.workunit.client.0.smithi100.stdout:0/959: mkdir da/d22/d33/d35/d3a/de9/d120/d126 0 2023-12-05T09:57:48.469 INFO:tasks.workunit.client.0.smithi100.stdout:0/960: chown c9 3226 1 2023-12-05T09:57:48.471 INFO:tasks.workunit.client.0.smithi100.stdout:0/961: mknod da/d22/d33/d35/d3a/de9/d120/d126/c127 0 2023-12-05T09:57:48.473 INFO:tasks.workunit.client.0.smithi100.stdout:0/962: getdents da/d22/d33/d74/d77 0 2023-12-05T09:57:48.473 INFO:tasks.workunit.client.0.smithi100.stdout:0/963: truncate da/d60/dba/feb 981333 0 2023-12-05T09:57:48.474 INFO:tasks.workunit.client.1.smithi150.stdout:9/999: symlink d3/d42/dd2/de0/l140 0 2023-12-05T09:57:48.474 INFO:tasks.workunit.client.0.smithi100.stdout:0/964: mkdir da/d22/d33/d35/d3a/de9/d120/d128 0 2023-12-05T09:57:48.480 INFO:tasks.workunit.client.0.smithi100.stdout:4/904: read de/d16/d23/d60/d98/fa8 [303353,10880] 0 2023-12-05T09:57:48.480 INFO:tasks.workunit.client.0.smithi100.stdout:4/905: chown de/d16/d23/d33/d51/l74 99225083 1 2023-12-05T09:57:48.480 INFO:tasks.workunit.client.0.smithi100.stdout:4/906: creat de/d16/d23/d33/d51/f124 x:0 0 0 2023-12-05T09:57:48.482 INFO:tasks.workunit.client.1.smithi150.stdout:6/917: dwrite d2/d23/d2e/d5f/d99/dd8/ff2 [0,4194304] 0 2023-12-05T09:57:48.482 INFO:tasks.workunit.client.1.smithi150.stdout:6/918: fdatasync d2/d23/d2e/d5f/fdb 0 2023-12-05T09:57:48.483 INFO:tasks.workunit.client.1.smithi150.stdout:4/940: dread d0/d3e/d6d/ddf/da4/ffb [0,4194304] 0 2023-12-05T09:57:48.485 INFO:tasks.workunit.client.1.smithi150.stdout:6/919: symlink d2/d23/d2e/d5f/d99/dd8/l138 0 2023-12-05T09:57:48.486 INFO:tasks.workunit.client.1.smithi150.stdout:6/920: mknod d2/d23/d2e/d44/c139 0 2023-12-05T09:57:48.488 INFO:tasks.workunit.client.0.smithi100.stdout:0/965: dread da/d60/fb9 [0,4194304] 0 2023-12-05T09:57:48.488 INFO:tasks.workunit.client.0.smithi100.stdout:0/966: stat da/d22/d33/d74/l10c 0 2023-12-05T09:57:48.488 INFO:tasks.workunit.client.0.smithi100.stdout:1/942: dwrite db/d12/f16 [0,4194304] 0 2023-12-05T09:57:48.488 INFO:tasks.workunit.client.1.smithi150.stdout:4/941: mkdir d0/d3e/d48/d12a 0 2023-12-05T09:57:48.489 INFO:tasks.workunit.client.0.smithi100.stdout:0/967: mkdir da/d22/d33/d35/d3a/d8b/d129 0 2023-12-05T09:57:48.490 INFO:tasks.workunit.client.0.smithi100.stdout:1/943: symlink db/d31/d3a/d3b/l120 0 2023-12-05T09:57:48.491 INFO:tasks.workunit.client.1.smithi150.stdout:4/942: mkdir d0/d3e/d5b/d80/d44/d12b 0 2023-12-05T09:57:48.505 INFO:tasks.workunit.client.0.smithi100.stdout:0/968: write da/d22/d33/d7f/fb5 [994526,122214] 0 2023-12-05T09:57:48.506 INFO:tasks.workunit.client.0.smithi100.stdout:0/969: rmdir da/d60 39 2023-12-05T09:57:48.506 INFO:tasks.workunit.client.0.smithi100.stdout:0/970: write da/d22/d33/d74/f119 [4468633,31957] 0 2023-12-05T09:57:48.521 INFO:tasks.workunit.client.0.smithi100.stdout:4/907: dwrite de/d16/d23/d36/dfe/fce [0,4194304] 0 2023-12-05T09:57:48.522 INFO:tasks.workunit.client.0.smithi100.stdout:4/908: symlink de/d16/d23/d60/df7/d4e/d80/d112/l125 0 2023-12-05T09:57:48.522 INFO:tasks.workunit.client.0.smithi100.stdout:4/909: fsync de/d16/d23/d60/df7/f82 0 2023-12-05T09:57:48.524 INFO:tasks.workunit.client.0.smithi100.stdout:4/910: creat de/dc3/f126 x:0 0 0 2023-12-05T09:57:48.524 INFO:tasks.workunit.client.0.smithi100.stdout:4/911: dread - de/d16/d23/d33/fdd zero size 2023-12-05T09:57:48.543 INFO:tasks.workunit.client.1.smithi150.stdout:6/921: dwrite d2/d23/d2e/f85 [0,4194304] 0 2023-12-05T09:57:48.544 INFO:tasks.workunit.client.1.smithi150.stdout:6/922: rename d2/d23/d3b/df0/d97/f84 to d2/d23/d3b/d64/d7a/d5d/de0/f13a 0 2023-12-05T09:57:48.569 INFO:tasks.workunit.client.0.smithi100.stdout:8/971: dwrite d0/d35/f39 [0,4194304] 0 2023-12-05T09:57:48.569 INFO:tasks.workunit.client.0.smithi100.stdout:8/972: fsync d0/d12/d13/d45/da6/d76/d113/fe5 0 2023-12-05T09:57:48.570 INFO:tasks.workunit.client.0.smithi100.stdout:4/912: read de/d16/d23/d36/dfe/fdb [315436,102388] 0 2023-12-05T09:57:48.572 INFO:tasks.workunit.client.0.smithi100.stdout:8/973: mknod d0/db7/dcf/c120 0 2023-12-05T09:57:48.572 INFO:tasks.workunit.client.0.smithi100.stdout:8/974: write d0/d35/d64/d81/fdb [1256316,6686] 0 2023-12-05T09:57:48.575 INFO:tasks.workunit.client.0.smithi100.stdout:4/913: rename de/d38/d8b/fc7 to de/d16/d23/d60/d88/d105/f127 0 2023-12-05T09:57:48.577 INFO:tasks.workunit.client.0.smithi100.stdout:8/975: getdents d0/d12/d13/d16/d42 0 2023-12-05T09:57:48.582 INFO:tasks.workunit.client.0.smithi100.stdout:4/914: rename de/d16/d23/l7e to de/d16/dc8/l128 0 2023-12-05T09:57:48.587 INFO:tasks.workunit.client.0.smithi100.stdout:0/971: dwrite da/fd [4194304,4194304] 0 2023-12-05T09:57:48.587 INFO:tasks.workunit.client.0.smithi100.stdout:0/972: chown da/d22/d33/d35/l4e 93287 1 2023-12-05T09:57:48.587 INFO:tasks.workunit.client.0.smithi100.stdout:0/973: fsync da/d22/d33/d74/dca/f11a 0 2023-12-05T09:57:48.588 INFO:tasks.workunit.client.1.smithi150.stdout:6/923: dwrite d2/d23/d2e/d5f/d99/fac [0,4194304] 0 2023-12-05T09:57:48.588 INFO:tasks.workunit.client.1.smithi150.stdout:6/924: write d2/d23/d2e/d72/fe7 [4808092,23334] 0 2023-12-05T09:57:48.591 INFO:tasks.workunit.client.0.smithi100.stdout:0/974: creat da/d22/d33/d74/dca/df1/f12a x:0 0 0 2023-12-05T09:57:48.591 INFO:tasks.workunit.client.0.smithi100.stdout:0/975: fsync da/d1b/d73/d82/f11c 0 2023-12-05T09:57:48.591 INFO:tasks.workunit.client.0.smithi100.stdout:0/976: truncate da/d1b/d6b/d78/de2/fed 987876 0 2023-12-05T09:57:48.594 INFO:tasks.workunit.client.1.smithi150.stdout:6/925: mkdir d2/d23/d3b/d64/d7a/d127/d13b 0 2023-12-05T09:57:48.598 INFO:tasks.workunit.client.1.smithi150.stdout:4/943: sync 2023-12-05T09:57:48.599 INFO:tasks.workunit.client.1.smithi150.stdout:4/944: unlink d0/d3e/d5b/d80/cb1 0 2023-12-05T09:57:48.600 INFO:tasks.workunit.client.1.smithi150.stdout:4/945: write d0/d3e/fc1 [721162,12690] 0 2023-12-05T09:57:48.601 INFO:tasks.workunit.client.0.smithi100.stdout:0/977: dread da/d22/d33/d35/d3a/d8b/d8f/fae [0,4194304] 0 2023-12-05T09:57:48.601 INFO:tasks.workunit.client.0.smithi100.stdout:0/978: truncate da/d1b/d73/d82/ffc 831867 0 2023-12-05T09:57:48.602 INFO:tasks.workunit.client.0.smithi100.stdout:0/979: link da/d1b/d6b/d78/f88 da/d1b/d6b/f12b 0 2023-12-05T09:57:48.604 INFO:tasks.workunit.client.0.smithi100.stdout:0/980: truncate da/d1b/f3c 2881277 0 2023-12-05T09:57:48.604 INFO:tasks.workunit.client.0.smithi100.stdout:0/981: fdatasync da/d22/d33/d35/d3a/d8b/d8f/fb6 0 2023-12-05T09:57:48.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:48 smithi100 ceph-mon[107145]: pgmap v40: 65 pgs: 65 active+clean; 3.6 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 165 MiB/s rd, 209 MiB/s wr, 294 op/s 2023-12-05T09:57:48.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:48 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:57:48.647 INFO:tasks.workunit.client.0.smithi100.stdout:8/976: dwrite d0/d12/d13/f25 [0,4194304] 0 2023-12-05T09:57:48.648 INFO:tasks.workunit.client.1.smithi150.stdout:6/926: dwrite d2/d23/d3b/d64/f88 [0,4194304] 0 2023-12-05T09:57:48.648 INFO:tasks.workunit.client.1.smithi150.stdout:6/927: fsync d2/d23/d3b/db4/df1/f136 0 2023-12-05T09:57:48.648 INFO:tasks.workunit.client.0.smithi100.stdout:4/915: dwrite de/d16/d23/d33/fdd [0,4194304] 0 2023-12-05T09:57:48.649 INFO:tasks.workunit.client.0.smithi100.stdout:4/916: chown de/d16/d23/d60/de3/deb/f111 695945 1 2023-12-05T09:57:48.649 INFO:tasks.workunit.client.0.smithi100.stdout:4/917: write de/d16/d1e/fb1 [241944,90482] 0 2023-12-05T09:57:48.649 INFO:tasks.workunit.client.0.smithi100.stdout:4/918: fdatasync f2 0 2023-12-05T09:57:48.650 INFO:tasks.workunit.client.1.smithi150.stdout:6/928: rename d2/d23/d3b/fc3 to d2/d23/d2e/f13c 0 2023-12-05T09:57:48.652 INFO:tasks.workunit.client.1.smithi150.stdout:6/929: mknod d2/d23/d3b/ded/c13d 0 2023-12-05T09:57:48.654 INFO:tasks.workunit.client.0.smithi100.stdout:4/919: creat de/de8/f129 x:0 0 0 2023-12-05T09:57:48.659 INFO:tasks.workunit.client.0.smithi100.stdout:4/920: truncate de/d16/d23/d60/df7/f10e 2187208 0 2023-12-05T09:57:48.662 INFO:tasks.workunit.client.0.smithi100.stdout:4/921: rename de/d16/d23/d60/df7/d4e/d85/d107/d10a/c11d to de/d16/d23/d60/df7/d4e/d85/d123/c12a 0 2023-12-05T09:57:48.662 INFO:tasks.workunit.client.0.smithi100.stdout:4/922: chown de/d38/lb7 3 1 2023-12-05T09:57:48.665 INFO:tasks.workunit.client.0.smithi100.stdout:8/977: write d0/d35/f93 [1632289,48599] 0 2023-12-05T09:57:48.666 INFO:tasks.workunit.client.0.smithi100.stdout:8/978: dread - d0/d12/d13/d16/df5/f106 zero size 2023-12-05T09:57:48.669 INFO:tasks.workunit.client.0.smithi100.stdout:4/923: getdents de/d16/d23/d60/df7/d4e/d85/d107/d10a 0 2023-12-05T09:57:48.670 INFO:tasks.workunit.client.0.smithi100.stdout:4/924: symlink de/d16/d23/d60/d88/dc5/l12b 0 2023-12-05T09:57:48.671 INFO:tasks.workunit.client.0.smithi100.stdout:4/925: mknod de/d16/d23/d60/df7/d4e/dbe/d11a/c12c 0 2023-12-05T09:57:48.695 INFO:tasks.workunit.client.1.smithi150.stdout:4/946: sync 2023-12-05T09:57:48.695 INFO:tasks.workunit.client.1.smithi150.stdout:6/930: dwrite d2/d23/d3b/d64/d7a/fb9 [4194304,4194304] 0 2023-12-05T09:57:48.697 INFO:tasks.workunit.client.1.smithi150.stdout:6/931: fsync d2/d23/d2e/d5f/fdb 0 2023-12-05T09:57:48.698 INFO:tasks.workunit.client.1.smithi150.stdout:6/932: truncate d2/d23/d2e/fc4 7338 0 2023-12-05T09:57:48.698 INFO:tasks.workunit.client.1.smithi150.stdout:6/933: fdatasync d2/d23/d3b/df0/f133 0 2023-12-05T09:57:48.704 INFO:tasks.workunit.client.0.smithi100.stdout:7/916: sync 2023-12-05T09:57:48.705 INFO:tasks.workunit.client.1.smithi150.stdout:6/934: dread d2/d23/ffd [0,4194304] 0 2023-12-05T09:57:48.705 INFO:tasks.workunit.client.1.smithi150.stdout:6/935: read d2/d23/ffd [547917,74242] 0 2023-12-05T09:57:48.705 INFO:tasks.workunit.client.1.smithi150.stdout:6/936: fsync d2/d23/d3b/d83/f71 0 2023-12-05T09:57:48.720 INFO:tasks.workunit.client.0.smithi100.stdout:8/979: dwrite d0/d12/d13/d16/d42/f75 [0,4194304] 0 2023-12-05T09:57:48.720 INFO:tasks.workunit.client.0.smithi100.stdout:4/926: dwrite de/d16/d23/d60/de3/ff8 [0,4194304] 0 2023-12-05T09:57:48.721 INFO:tasks.workunit.client.0.smithi100.stdout:4/927: write de/d16/d23/d60/de3/deb/f111 [304056,56476] 0 2023-12-05T09:57:48.721 INFO:tasks.workunit.client.0.smithi100.stdout:4/928: stat de/d38/d86/lc6 0 2023-12-05T09:57:48.721 INFO:tasks.workunit.client.0.smithi100.stdout:4/929: truncate de/d16/fc9 8935021 0 2023-12-05T09:57:48.721 INFO:tasks.workunit.client.0.smithi100.stdout:4/930: readlink de/d16/d1e/le0 0 2023-12-05T09:57:48.721 INFO:tasks.workunit.client.0.smithi100.stdout:4/931: stat de/d16/d23/d60/dc4/cbd 0 2023-12-05T09:57:48.724 INFO:tasks.workunit.client.0.smithi100.stdout:4/932: mknod de/d16/d23/d33/d51/c12d 0 2023-12-05T09:57:48.725 INFO:tasks.workunit.client.0.smithi100.stdout:4/933: write de/d16/d23/d33/d51/f79 [1031737,20772] 0 2023-12-05T09:57:48.726 INFO:tasks.workunit.client.0.smithi100.stdout:4/934: getdents de/d16/d23/d33/dae/dd3 0 2023-12-05T09:57:48.727 INFO:tasks.workunit.client.1.smithi150.stdout:6/937: dread d2/d23/fb6 [0,4194304] 0 2023-12-05T09:57:48.727 INFO:tasks.workunit.client.1.smithi150.stdout:6/938: creat d2/d23/d3b/d64/d7a/d5d/de0/f13e x:0 0 0 2023-12-05T09:57:48.727 INFO:tasks.workunit.client.0.smithi100.stdout:4/935: write de/d16/d23/d60/df7/d4e/d85/d107/f119 [209830,96584] 0 2023-12-05T09:57:48.732 INFO:tasks.workunit.client.1.smithi150.stdout:6/939: creat d2/d23/d2e/d72/d135/f13f x:0 0 0 2023-12-05T09:57:48.732 INFO:tasks.workunit.client.1.smithi150.stdout:6/940: fsync d2/d23/d2e/d44/f50 0 2023-12-05T09:57:48.734 INFO:tasks.workunit.client.1.smithi150.stdout:6/941: unlink d2/d23/d2e/d72/c101 0 2023-12-05T09:57:48.736 INFO:tasks.workunit.client.1.smithi150.stdout:6/942: truncate d2/d23/d2e/d5f/d99/dd8/fe4 668911 0 2023-12-05T09:57:48.736 INFO:tasks.workunit.client.1.smithi150.stdout:6/943: fdatasync d2/d11d/dc6/fe2 0 2023-12-05T09:57:48.736 INFO:tasks.workunit.client.1.smithi150.stdout:6/944: fdatasync d2/d23/d3b/f100 0 2023-12-05T09:57:48.736 INFO:tasks.workunit.client.1.smithi150.stdout:6/945: dread - d2/d23/d2e/d72/fcb zero size 2023-12-05T09:57:48.736 INFO:tasks.workunit.client.1.smithi150.stdout:6/946: mkdir d2/d23/d3b/d64/d7a/d5d/dcd/d140 0 2023-12-05T09:57:48.738 INFO:tasks.workunit.client.0.smithi100.stdout:8/980: write d0/d12/d13/d45/da6/d76/d113/dbd/d82/fb5 [2810112,33407] 0 2023-12-05T09:57:48.738 INFO:tasks.workunit.client.0.smithi100.stdout:8/981: fsync d0/f1d 0 2023-12-05T09:57:48.739 INFO:tasks.workunit.client.1.smithi150.stdout:6/947: symlink d2/d23/d3b/d11b/l141 0 2023-12-05T09:57:48.742 INFO:tasks.workunit.client.1.smithi150.stdout:6/948: truncate d2/d23/f3f 411512 0 2023-12-05T09:57:48.743 INFO:tasks.workunit.client.1.smithi150.stdout:6/949: write d2/d23/d3b/d64/f113 [689841,13627] 0 2023-12-05T09:57:48.743 INFO:tasks.workunit.client.1.smithi150.stdout:6/950: creat d2/d23/d3b/d64/d7a/d5d/d6b/f142 x:0 0 0 2023-12-05T09:57:48.743 INFO:tasks.workunit.client.1.smithi150.stdout:6/951: readlink d2/d23/d2e/d5f/d99/dd8/l120 0 2023-12-05T09:57:48.743 INFO:tasks.workunit.client.1.smithi150.stdout:6/952: fsync d2/d23/d3b/d83/f71 0 2023-12-05T09:57:48.743 INFO:tasks.workunit.client.1.smithi150.stdout:6/953: chown d2/d23/d2e/d5f/d99/dd8/ddf/f128 10 1 2023-12-05T09:57:48.745 INFO:tasks.workunit.client.1.smithi150.stdout:6/954: link d2/d23/d3b/d83/f71 d2/d23/d3b/ded/f143 0 2023-12-05T09:57:48.745 INFO:tasks.workunit.client.1.smithi150.stdout:6/955: read d2/d23/d3b/df0/fc2 [2331960,14102] 0 2023-12-05T09:57:48.746 INFO:tasks.workunit.client.1.smithi150.stdout:6/956: creat d2/d23/d3b/df0/d97/f144 x:0 0 0 2023-12-05T09:57:48.748 INFO:tasks.workunit.client.1.smithi150.stdout:4/947: dwrite d0/d3e/d6d/ddf/da4/dd7/f86 [0,4194304] 0 2023-12-05T09:57:48.757 INFO:tasks.workunit.client.0.smithi100.stdout:7/917: dwrite d3/dc/d11/d13/de/d18/d3b/d12c/f145 [0,4194304] 0 2023-12-05T09:57:48.757 INFO:tasks.workunit.client.0.smithi100.stdout:7/918: chown d3/dc/d11/d13/de/d18/d3b/d12c 23 1 2023-12-05T09:57:48.759 INFO:tasks.workunit.client.1.smithi150.stdout:6/957: read d2/d23/d2e/d5f/f6d [1036648,79759] 0 2023-12-05T09:57:48.765 INFO:tasks.workunit.client.1.smithi150.stdout:6/958: creat d2/d23/d3b/d64/d7a/d127/f145 x:0 0 0 2023-12-05T09:57:48.765 INFO:tasks.workunit.client.1.smithi150.stdout:6/959: write d2/d23/d3b/d64/d7a/d5d/de0/f13a [724966,57334] 0 2023-12-05T09:57:48.768 INFO:tasks.workunit.client.0.smithi100.stdout:8/982: write d0/d12/d13/d16/d42/fac [3719521,92527] 0 2023-12-05T09:57:48.771 INFO:tasks.workunit.client.0.smithi100.stdout:8/983: unlink d0/d12/d13/d45/da6/d76/d113/dbd/d72/d9f/lb9 0 2023-12-05T09:57:48.771 INFO:tasks.workunit.client.0.smithi100.stdout:8/984: fsync d0/d12/d13/d45/da6/d76/d113/dbd/d72/d9f/fe3 0 2023-12-05T09:57:48.771 INFO:tasks.workunit.client.0.smithi100.stdout:8/985: dread - d0/d12/d13/d45/da6/d76/d91/d99/fed zero size 2023-12-05T09:57:48.771 INFO:tasks.workunit.client.0.smithi100.stdout:8/986: write d0/d12/d13/d45/da6/d76/d113/dbd/d72/d9f/f117 [44655,20703] 0 2023-12-05T09:57:48.771 INFO:tasks.workunit.client.0.smithi100.stdout:8/987: chown d0/d12/d13/d16/da3/dff/cd0 327838968 1 2023-12-05T09:57:48.771 INFO:tasks.workunit.client.0.smithi100.stdout:8/988: rmdir d0/d12/d13/d16/d42 39 2023-12-05T09:57:48.773 INFO:tasks.workunit.client.1.smithi150.stdout:4/948: write d0/f3a [1522171,51121] 0 2023-12-05T09:57:48.773 INFO:tasks.workunit.client.1.smithi150.stdout:4/949: chown d0/c10 1204128412 1 2023-12-05T09:57:48.777 INFO:tasks.workunit.client.0.smithi100.stdout:8/989: unlink d0/d12/d13/d45/da6/d76/d113/dbd/d72/f94 0 2023-12-05T09:57:48.778 INFO:tasks.workunit.client.0.smithi100.stdout:0/982: sync 2023-12-05T09:57:48.778 INFO:tasks.workunit.client.0.smithi100.stdout:1/944: sync 2023-12-05T09:57:48.778 INFO:tasks.workunit.client.0.smithi100.stdout:0/983: write da/d22/d33/d35/d3a/d8b/d8f/fb6 [556407,62606] 0 2023-12-05T09:57:48.778 INFO:tasks.workunit.client.0.smithi100.stdout:0/984: dread - da/f108 zero size 2023-12-05T09:57:48.779 INFO:tasks.workunit.client.1.smithi150.stdout:6/960: dread d2/f13 [0,4194304] 0 2023-12-05T09:57:48.780 INFO:tasks.workunit.client.0.smithi100.stdout:0/985: rename da/d1b/d73/d82/f8a to da/d60/f12c 0 2023-12-05T09:57:48.780 INFO:tasks.workunit.client.0.smithi100.stdout:0/986: dread - da/d22/d33/d74/dca/db4/f10e zero size 2023-12-05T09:57:48.780 INFO:tasks.workunit.client.0.smithi100.stdout:0/987: write da/d22/d33/d74/d77/d105/f10b [529274,108681] 0 2023-12-05T09:57:48.787 INFO:tasks.workunit.client.1.smithi150.stdout:4/950: link d0/d3e/d48/c55 d0/d3e/d6d/d4b/d8c/c12c 0 2023-12-05T09:57:48.790 INFO:tasks.workunit.client.1.smithi150.stdout:4/951: mkdir d0/d5f/d12d 0 2023-12-05T09:57:48.791 INFO:tasks.workunit.client.1.smithi150.stdout:4/952: write d0/d3e/d48/fdb [1082194,97395] 0 2023-12-05T09:57:48.791 INFO:tasks.workunit.client.1.smithi150.stdout:4/953: write d0/d3e/d5b/d80/d44/fe0 [317563,94323] 0 2023-12-05T09:57:48.801 INFO:tasks.workunit.client.0.smithi100.stdout:4/936: dwrite de/f11 [0,4194304] 0 2023-12-05T09:57:48.802 INFO:tasks.workunit.client.0.smithi100.stdout:4/937: symlink de/d16/d23/d33/dae/dd1/l12e 0 2023-12-05T09:57:48.830 INFO:tasks.workunit.client.0.smithi100.stdout:4/938: read de/d16/d23/d33/d51/fb3 [4180968,68019] 0 2023-12-05T09:57:48.832 INFO:tasks.workunit.client.0.smithi100.stdout:4/939: creat de/d16/d23/d60/df7/d4e/dbe/d11a/f12f x:0 0 0 2023-12-05T09:57:48.832 INFO:tasks.workunit.client.0.smithi100.stdout:4/940: truncate de/d16/d23/d60/df7/d4e/d85/fa3 1049450 0 2023-12-05T09:57:48.834 INFO:tasks.workunit.client.0.smithi100.stdout:4/941: creat de/d16/d23/d60/df7/f130 x:0 0 0 2023-12-05T09:57:48.837 INFO:tasks.workunit.client.0.smithi100.stdout:4/942: rename de/d38/d86/f116 to de/d16/d23/f131 0 2023-12-05T09:57:48.838 INFO:tasks.workunit.client.0.smithi100.stdout:4/943: creat de/d16/d23/d60/df7/d4e/d80/d112/f132 x:0 0 0 2023-12-05T09:57:48.839 INFO:tasks.workunit.client.0.smithi100.stdout:0/988: dwrite da/d22/d33/d74/d77/fce [0,4194304] 0 2023-12-05T09:57:48.842 INFO:tasks.workunit.client.0.smithi100.stdout:4/944: creat de/d16/d23/d60/df7/d4e/d85/d123/f133 x:0 0 0 2023-12-05T09:57:48.845 INFO:tasks.workunit.client.0.smithi100.stdout:8/990: dwrite d0/d12/d13/d45/da6/d9c/fc4 [4194304,4194304] 0 2023-12-05T09:57:48.845 INFO:tasks.workunit.client.0.smithi100.stdout:8/991: stat d0/lf 0 2023-12-05T09:57:48.845 INFO:tasks.workunit.client.0.smithi100.stdout:8/992: stat d0/d12/d13/d45/da6/d76/d113/dbd/d72/cdd 0 2023-12-05T09:57:48.846 INFO:tasks.workunit.client.0.smithi100.stdout:4/945: mknod de/d16/d23/d60/c134 0 2023-12-05T09:57:48.846 INFO:tasks.workunit.client.0.smithi100.stdout:0/989: dread da/f2d [0,4194304] 0 2023-12-05T09:57:48.847 INFO:tasks.workunit.client.0.smithi100.stdout:8/993: rename d0/d12/d13/f3e to d0/d12/d13/d16/df5/f121 0 2023-12-05T09:57:48.847 INFO:tasks.workunit.client.1.smithi150.stdout:6/961: dwrite d2/d23/d3b/d64/d7a/d5d/de0/fe3 [0,4194304] 0 2023-12-05T09:57:48.848 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:48 smithi150 ceph-mon[116142]: pgmap v40: 65 pgs: 65 active+clean; 3.6 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 165 MiB/s rd, 209 MiB/s wr, 294 op/s 2023-12-05T09:57:48.848 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:48 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:57:48.848 INFO:tasks.workunit.client.1.smithi150.stdout:6/962: read d2/d23/d2e/d72/fe7 [2277469,106293] 0 2023-12-05T09:57:48.848 INFO:tasks.workunit.client.1.smithi150.stdout:4/954: dwrite d0/d3e/d48/f4e [0,4194304] 0 2023-12-05T09:57:48.848 INFO:tasks.workunit.client.1.smithi150.stdout:6/963: creat d2/d23/d3b/db4/df1/f146 x:0 0 0 2023-12-05T09:57:48.848 INFO:tasks.workunit.client.1.smithi150.stdout:6/964: write d2/d23/d3b/d64/d7a/d5d/f102 [745381,93144] 0 2023-12-05T09:57:48.850 INFO:tasks.workunit.client.0.smithi100.stdout:0/990: rename da/d1b/d6b/d78/l99 to da/d1b/d6b/d78/l12d 0 2023-12-05T09:57:48.856 INFO:tasks.workunit.client.1.smithi150.stdout:4/955: truncate d0/d3e/d48/dbb/fc9 1472546 0 2023-12-05T09:57:48.856 INFO:tasks.workunit.client.0.smithi100.stdout:4/946: rename de/d16/d23/d60/de3/deb/f111 to de/d16/d23/d33/dae/dd1/f135 0 2023-12-05T09:57:48.857 INFO:tasks.workunit.client.0.smithi100.stdout:0/991: creat da/d2a/d45/de3/de6/f12e x:0 0 0 2023-12-05T09:57:48.860 INFO:tasks.workunit.client.1.smithi150.stdout:6/965: unlink d2/f34 0 2023-12-05T09:57:48.864 INFO:tasks.workunit.client.0.smithi100.stdout:4/947: getdents de/d16/d23/d60/df7/d4e/dbe/d11a 0 2023-12-05T09:57:48.865 INFO:tasks.workunit.client.0.smithi100.stdout:8/994: dread d0/d12/d13/d45/da6/d76/f6f [0,4194304] 0 2023-12-05T09:57:48.865 INFO:tasks.workunit.client.0.smithi100.stdout:8/995: creat d0/d35/d64/d81/d9a/dfe/f122 x:0 0 0 2023-12-05T09:57:48.866 INFO:tasks.workunit.client.0.smithi100.stdout:0/992: rmdir da/d22/d33/d74/dca 39 2023-12-05T09:57:48.868 INFO:tasks.workunit.client.0.smithi100.stdout:4/948: creat de/d38/d8b/d121/f136 x:0 0 0 2023-12-05T09:57:48.868 INFO:tasks.workunit.client.0.smithi100.stdout:4/949: dread - de/d16/d23/d60/dc4/ff5 zero size 2023-12-05T09:57:48.870 INFO:tasks.workunit.client.0.smithi100.stdout:0/993: rename da/c91 to da/d22/d33/d74/d77/c12f 0 2023-12-05T09:57:48.870 INFO:tasks.workunit.client.0.smithi100.stdout:0/994: creat da/d22/d33/d74/d77/d105/f130 x:0 0 0 2023-12-05T09:57:48.871 INFO:tasks.workunit.client.0.smithi100.stdout:8/996: write d0/d35/d64/d81/fa1 [1011041,94564] 0 2023-12-05T09:57:48.871 INFO:tasks.workunit.client.0.smithi100.stdout:4/950: symlink de/d16/d23/d36/l137 0 2023-12-05T09:57:48.874 INFO:tasks.workunit.client.1.smithi150.stdout:6/966: read d2/d23/d3b/d64/d7a/d5d/d6b/fca [2013462,83358] 0 2023-12-05T09:57:48.874 INFO:tasks.workunit.client.1.smithi150.stdout:6/967: write d2/d23/d2e/d72/f125 [980454,56560] 0 2023-12-05T09:57:48.874 INFO:tasks.workunit.client.1.smithi150.stdout:6/968: stat d2/d23/d2e/d44/da0/lb3 0 2023-12-05T09:57:48.875 INFO:tasks.workunit.client.0.smithi100.stdout:0/995: creat da/de1/f131 x:0 0 0 2023-12-05T09:57:48.877 INFO:tasks.workunit.client.1.smithi150.stdout:6/969: link d2/d23/d2e/d44/ce9 d2/d23/c147 0 2023-12-05T09:57:48.880 INFO:tasks.workunit.client.0.smithi100.stdout:8/997: dread d0/d35/d64/d81/fdb [0,4194304] 0 2023-12-05T09:57:48.882 INFO:tasks.workunit.client.0.smithi100.stdout:8/998: mknod d0/d12/d13/d45/dc9/c123 0 2023-12-05T09:57:48.882 INFO:tasks.workunit.client.0.smithi100.stdout:8/999: truncate d0/d35/d64/d81/d9a/dfe/f118 7194 0 2023-12-05T09:57:48.885 INFO:tasks.workunit.client.1.smithi150.stdout:6/970: mknod d2/d23/d3b/d64/d7a/d5d/dcd/d140/c148 0 2023-12-05T09:57:48.888 INFO:tasks.workunit.client.1.smithi150.stdout:6/971: truncate d2/d23/d2e/d72/f75 2931772 0 2023-12-05T09:57:48.890 INFO:tasks.workunit.client.0.smithi100.stdout:4/951: dread de/d16/d23/d33/d51/fb3 [0,4194304] 0 2023-12-05T09:57:48.890 INFO:tasks.workunit.client.0.smithi100.stdout:4/952: dread - de/d16/d23/d60/df7/d4e/d85/d123/f133 zero size 2023-12-05T09:57:48.890 INFO:tasks.workunit.client.1.smithi150.stdout:6/972: truncate d2/d23/d2e/d5f/d99/fac 3460016 0 2023-12-05T09:57:48.892 INFO:tasks.workunit.client.0.smithi100.stdout:4/953: rename de/d16/d23/d60/df7/fe6 to de/d16/d23/d60/d98/da6/f138 0 2023-12-05T09:57:48.892 INFO:tasks.workunit.client.0.smithi100.stdout:4/954: chown de/d16/d23/d60/d98/da6/fb5 1370405 1 2023-12-05T09:57:48.893 INFO:tasks.workunit.client.0.smithi100.stdout:4/955: creat de/d16/d23/d60/df7/d4e/dbe/f139 x:0 0 0 2023-12-05T09:57:48.894 INFO:tasks.workunit.client.1.smithi150.stdout:6/973: rmdir d2/d23/d3b/d64/d7a/d5d/de0 39 2023-12-05T09:57:48.895 INFO:tasks.workunit.client.1.smithi150.stdout:4/956: dwrite d0/d3e/d5b/d80/dc8/fce [4194304,4194304] 0 2023-12-05T09:57:48.895 INFO:tasks.workunit.client.1.smithi150.stdout:4/957: chown d0/d3e/d5b/d80/da1/c10b 32175 1 2023-12-05T09:57:48.896 INFO:tasks.workunit.client.0.smithi100.stdout:4/956: symlink de/d16/d23/d60/df7/d4e/d80/d112/l13a 0 2023-12-05T09:57:48.896 INFO:tasks.workunit.client.0.smithi100.stdout:4/957: fsync de/d16/d23/d60/de3/deb/f11b 0 2023-12-05T09:57:48.897 INFO:tasks.workunit.client.1.smithi150.stdout:6/974: mknod d2/d23/d2e/d44/c149 0 2023-12-05T09:57:48.897 INFO:tasks.workunit.client.1.smithi150.stdout:6/975: dread - d2/d23/d3b/d64/d7a/d5d/d6b/f142 zero size 2023-12-05T09:57:48.897 INFO:tasks.workunit.client.1.smithi150.stdout:6/976: truncate d2/d23/d3b/f117 309065 0 2023-12-05T09:57:48.897 INFO:tasks.workunit.client.1.smithi150.stdout:6/977: fdatasync d2/d23/d3b/d64/f88 0 2023-12-05T09:57:48.899 INFO:tasks.workunit.client.0.smithi100.stdout:4/958: unlink de/d16/d23/d33/dae/dd3/cf4 0 2023-12-05T09:57:48.900 INFO:tasks.workunit.client.1.smithi150.stdout:4/958: mknod d0/d3e/d48/dbb/c12e 0 2023-12-05T09:57:48.900 INFO:tasks.workunit.client.1.smithi150.stdout:6/978: mkdir d2/d23/d3b/df0/d14a 0 2023-12-05T09:57:48.901 INFO:tasks.workunit.client.1.smithi150.stdout:6/979: creat d2/d23/d3b/ded/f14b x:0 0 0 2023-12-05T09:57:48.902 INFO:tasks.workunit.client.0.smithi100.stdout:4/959: link de/d38/d8b/cd6 de/d16/d23/d60/df7/c13b 0 2023-12-05T09:57:48.903 INFO:tasks.workunit.client.1.smithi150.stdout:4/959: mkdir d0/d3e/d6d/ddf/da4/d12f 0 2023-12-05T09:57:48.905 INFO:tasks.workunit.client.0.smithi100.stdout:4/960: rename de/d16/d23/d33/d51/c12d to de/d16/c13c 0 2023-12-05T09:57:48.906 INFO:tasks.workunit.client.0.smithi100.stdout:4/961: dread - de/d16/d23/d60/df7/d4e/d80/d112/f132 zero size 2023-12-05T09:57:48.907 INFO:tasks.workunit.client.1.smithi150.stdout:6/980: symlink d2/d23/d3b/db4/df1/l14c 0 2023-12-05T09:57:48.909 INFO:tasks.workunit.client.1.smithi150.stdout:4/960: symlink d0/d3e/d5b/de4/d108/l130 0 2023-12-05T09:57:48.909 INFO:tasks.workunit.client.1.smithi150.stdout:4/961: chown d0/d3e/d5b/fd5 522797809 1 2023-12-05T09:57:48.909 INFO:tasks.workunit.client.1.smithi150.stdout:4/962: getdents d0/d3e/d5b/de4/d108/d129 0 2023-12-05T09:57:48.910 INFO:tasks.workunit.client.1.smithi150.stdout:6/981: truncate d2/d23/d3b/df0/d97/f98 621870 0 2023-12-05T09:57:48.913 INFO:tasks.workunit.client.1.smithi150.stdout:4/963: mknod d0/d3e/d5b/d6e/c131 0 2023-12-05T09:57:48.917 INFO:tasks.workunit.client.1.smithi150.stdout:6/982: link d2/d23/d2e/f94 d2/d23/d3b/df0/d97/f14d 0 2023-12-05T09:57:48.917 INFO:tasks.workunit.client.1.smithi150.stdout:6/983: chown d2/d23/d3b/db4/df1/l14c 1278855 1 2023-12-05T09:57:48.919 INFO:tasks.workunit.client.1.smithi150.stdout:4/964: mknod d0/d3e/d5b/d80/dc8/dfe/d115/c132 0 2023-12-05T09:57:48.921 INFO:tasks.workunit.client.1.smithi150.stdout:6/984: symlink d2/d23/d3b/db4/l14e 0 2023-12-05T09:57:48.921 INFO:tasks.workunit.client.1.smithi150.stdout:6/985: chown d2/d23/d2e/d72/fec 43 1 2023-12-05T09:57:48.921 INFO:tasks.workunit.client.1.smithi150.stdout:6/986: truncate d2/d23/d2e/d5f/fdb 356911 0 2023-12-05T09:57:48.921 INFO:tasks.workunit.client.1.smithi150.stdout:6/987: readlink d2/l30 0 2023-12-05T09:57:48.922 INFO:tasks.workunit.client.1.smithi150.stdout:4/965: rename d0/d3e/d48/d8a/la9 to d0/d3e/d48/d8a/dec/l133 0 2023-12-05T09:57:48.924 INFO:tasks.workunit.client.0.smithi100.stdout:4/962: dread de/d16/d1e/f30 [0,4194304] 0 2023-12-05T09:57:48.925 INFO:tasks.workunit.client.1.smithi150.stdout:4/966: link d0/d3e/d48/dbb/fc9 d0/d3e/d5b/d80/dc8/dfe/d10c/f134 0 2023-12-05T09:57:48.925 INFO:tasks.workunit.client.1.smithi150.stdout:4/967: dread - d0/d3e/d6d/fdc zero size 2023-12-05T09:57:48.927 INFO:tasks.workunit.client.0.smithi100.stdout:4/963: symlink de/d16/d23/d60/df7/d4e/d85/l13d 0 2023-12-05T09:57:48.928 INFO:tasks.workunit.client.0.smithi100.stdout:4/964: write de/d16/d23/f58 [1800312,53992] 0 2023-12-05T09:57:48.928 INFO:tasks.workunit.client.0.smithi100.stdout:4/965: chown de/d16/d23/d33/d51/f79 0 1 2023-12-05T09:57:48.928 INFO:tasks.workunit.client.0.smithi100.stdout:4/966: dread - de/d16/d23/d60/d88/f109 zero size 2023-12-05T09:57:48.928 INFO:tasks.workunit.client.1.smithi150.stdout:4/968: mkdir d0/d3e/d5b/d80/d44/d12b/d135 0 2023-12-05T09:57:48.930 INFO:tasks.workunit.client.0.smithi100.stdout:4/967: unlink de/d16/d23/d60/f9f 0 2023-12-05T09:57:48.931 INFO:tasks.workunit.client.0.smithi100.stdout:0/996: dwrite da/d1b/d6b/d78/f88 [4194304,4194304] 0 2023-12-05T09:57:48.931 INFO:tasks.workunit.client.0.smithi100.stdout:0/997: readlink da/lf 0 2023-12-05T09:57:48.931 INFO:tasks.workunit.client.0.smithi100.stdout:4/968: mkdir de/d16/d23/d60/d98/da6/d13e 0 2023-12-05T09:57:48.937 INFO:tasks.workunit.client.0.smithi100.stdout:0/998: creat da/d22/d33/d74/dca/d9f/f132 x:0 0 0 2023-12-05T09:57:48.937 INFO:tasks.workunit.client.0.smithi100.stdout:4/969: link de/d16/d23/d60/df7/d4e/d85/fa3 de/d16/d23/d60/df7/d4e/dbe/d11a/f13f 0 2023-12-05T09:57:48.940 INFO:tasks.workunit.client.0.smithi100.stdout:4/970: creat de/d66/f140 x:0 0 0 2023-12-05T09:57:48.940 INFO:tasks.workunit.client.0.smithi100.stdout:4/971: creat de/d16/d23/d60/df7/f141 x:0 0 0 2023-12-05T09:57:48.943 INFO:tasks.workunit.client.0.smithi100.stdout:4/972: rename de/d16/d23/d60/dc4/ff5 to de/d16/d23/d60/f142 0 2023-12-05T09:57:48.949 INFO:tasks.workunit.client.0.smithi100.stdout:1/945: sync 2023-12-05T09:57:48.950 INFO:tasks.workunit.client.0.smithi100.stdout:7/919: sync 2023-12-05T09:57:48.951 INFO:tasks.workunit.client.0.smithi100.stdout:1/946: link db/d12/d1e/de0/l10e db/d31/d73/l121 0 2023-12-05T09:57:48.951 INFO:tasks.workunit.client.0.smithi100.stdout:1/947: chown db/d12/d1e/d26/d30/d6e/f91 0 1 2023-12-05T09:57:48.952 INFO:tasks.workunit.client.0.smithi100.stdout:7/920: creat d3/dc/d11/d13/de/d2d/f14e x:0 0 0 2023-12-05T09:57:48.953 INFO:tasks.workunit.client.0.smithi100.stdout:7/921: rmdir d3/db3 39 2023-12-05T09:57:48.960 INFO:tasks.workunit.client.0.smithi100.stdout:7/922: getdents d3/dc/d11/d13 0 2023-12-05T09:57:48.960 INFO:tasks.workunit.client.0.smithi100.stdout:4/973: getdents de/d16/d23/d60/df7 0 2023-12-05T09:57:48.964 INFO:tasks.workunit.client.0.smithi100.stdout:1/948: dread db/d31/d3a/d4a/dad/d67/fde [0,4194304] 0 2023-12-05T09:57:48.965 INFO:tasks.workunit.client.0.smithi100.stdout:4/974: mknod de/d16/d23/d60/de3/c143 0 2023-12-05T09:57:48.966 INFO:tasks.workunit.client.0.smithi100.stdout:4/975: mknod de/d38/d86/c144 0 2023-12-05T09:57:48.967 INFO:tasks.workunit.client.0.smithi100.stdout:4/976: mknod de/d16/d23/d60/df7/d4e/dbe/c145 0 2023-12-05T09:57:48.967 INFO:tasks.workunit.client.0.smithi100.stdout:4/977: fsync de/d16/fc0 0 2023-12-05T09:57:48.968 INFO:tasks.workunit.client.0.smithi100.stdout:4/978: truncate de/d16/d23/d60/d98/da6/fc2 628491 0 2023-12-05T09:57:48.968 INFO:tasks.workunit.client.0.smithi100.stdout:1/949: write db/d12/d1e/d26/d30/d6e/fcc [739349,57259] 0 2023-12-05T09:57:48.969 INFO:tasks.workunit.client.0.smithi100.stdout:4/979: unlink de/d16/d23/d60/dc4/cab 0 2023-12-05T09:57:48.971 INFO:tasks.workunit.client.0.smithi100.stdout:1/950: rename db/d12/d1e/d26/d30/cfe to db/d12/d1e/d26/d30/d6e/c122 0 2023-12-05T09:57:48.971 INFO:tasks.workunit.client.0.smithi100.stdout:1/951: fdatasync db/d12/f16 0 2023-12-05T09:57:48.971 INFO:tasks.workunit.client.0.smithi100.stdout:1/952: truncate db/d31/f81 1336821 0 2023-12-05T09:57:48.978 INFO:tasks.workunit.client.1.smithi150.stdout:4/969: dwrite d0/d3e/d6d/f39 [0,4194304] 0 2023-12-05T09:57:48.978 INFO:tasks.workunit.client.1.smithi150.stdout:4/970: dread - d0/d3e/d5b/fc4 zero size 2023-12-05T09:57:48.978 INFO:tasks.workunit.client.1.smithi150.stdout:4/971: chown d0/d3e/d48/dbb/fc9 500549886 1 2023-12-05T09:57:48.979 INFO:tasks.workunit.client.1.smithi150.stdout:4/972: getdents d0/d3e/d6d/ddf/da4 0 2023-12-05T09:57:48.981 INFO:tasks.workunit.client.1.smithi150.stdout:6/988: dwrite d2/d23/d2e/d72/d135/f13f [0,4194304] 0 2023-12-05T09:57:48.983 INFO:tasks.workunit.client.0.smithi100.stdout:7/923: dread d3/dc/d11/d13/de/d18/d3b/d40/d46/f5f [0,4194304] 0 2023-12-05T09:57:48.983 INFO:tasks.workunit.client.0.smithi100.stdout:7/924: write d3/dc/d11/d13/de/d2d/ff4 [4610731,119882] 0 2023-12-05T09:57:48.983 INFO:tasks.workunit.client.0.smithi100.stdout:7/925: stat d3/dc/d11/d13/de/d18/d3b/d40/d4c/d7f/c130 0 2023-12-05T09:57:48.984 INFO:tasks.workunit.client.1.smithi150.stdout:4/973: mkdir d0/d3e/d136 0 2023-12-05T09:57:48.984 INFO:tasks.workunit.client.1.smithi150.stdout:4/974: creat d0/d3e/d5b/d6e/f137 x:0 0 0 2023-12-05T09:57:48.987 INFO:tasks.workunit.client.0.smithi100.stdout:7/926: symlink d3/dc/d11/d13/de/d18/dcb/l14f 0 2023-12-05T09:57:48.987 INFO:tasks.workunit.client.0.smithi100.stdout:7/927: creat d3/dc/d11/d13/de/d18/d3b/d12c/f150 x:0 0 0 2023-12-05T09:57:48.993 INFO:tasks.workunit.client.0.smithi100.stdout:7/928: rmdir d3/dc/d11/d13/d37/d11f 0 2023-12-05T09:57:48.994 INFO:tasks.workunit.client.1.smithi150.stdout:6/989: write d2/d23/d3b/d64/f88 [1588024,118266] 0 2023-12-05T09:57:48.994 INFO:tasks.workunit.client.1.smithi150.stdout:6/990: truncate d2/d11d/dc6/fe2 327988 0 2023-12-05T09:57:48.995 INFO:tasks.workunit.client.1.smithi150.stdout:4/975: dread d0/d3e/d48/dbb/fc9 [0,4194304] 0 2023-12-05T09:57:48.996 INFO:tasks.workunit.client.0.smithi100.stdout:7/929: rename d3/dc/d11/d13/d119 to d3/dc/d11/d13/de/d18/dcb/d151 0 2023-12-05T09:57:48.997 INFO:tasks.workunit.client.0.smithi100.stdout:7/930: write d3/dc/d11/d13/d37/fef [292966,72971] 0 2023-12-05T09:57:48.998 INFO:tasks.workunit.client.1.smithi150.stdout:6/991: symlink d2/d23/d2e/d5f/d99/dd8/l14f 0 2023-12-05T09:57:48.999 INFO:tasks.workunit.client.1.smithi150.stdout:4/976: rmdir d0/d3e/d5b/d80/dc8/dfe 39 2023-12-05T09:57:49.001 INFO:tasks.workunit.client.1.smithi150.stdout:6/992: link d2/f26 d2/d23/d3b/d64/d7a/d5d/de0/f150 0 2023-12-05T09:57:49.002 INFO:tasks.workunit.client.1.smithi150.stdout:4/977: symlink d0/d3e/d6d/d4b/d8c/d11f/l138 0 2023-12-05T09:57:49.002 INFO:tasks.workunit.client.1.smithi150.stdout:4/978: chown d0/d3e/d6d/d4b/c7d 683669328 1 2023-12-05T09:57:49.004 INFO:tasks.workunit.client.1.smithi150.stdout:6/993: mkdir d2/d11d/d151 0 2023-12-05T09:57:49.010 INFO:tasks.workunit.client.0.smithi100.stdout:1/953: dwrite db/d12/d1e/f41 [4194304,4194304] 0 2023-12-05T09:57:49.010 INFO:tasks.workunit.client.0.smithi100.stdout:1/954: readlink db/d12/l88 0 2023-12-05T09:57:49.018 INFO:tasks.workunit.client.1.smithi150.stdout:6/994: rmdir d2/d23/d3b 39 2023-12-05T09:57:49.018 INFO:tasks.workunit.client.1.smithi150.stdout:4/979: dread d0/d3e/d6d/ddf/da4/ffb [4194304,4194304] 0 2023-12-05T09:57:49.019 INFO:tasks.workunit.client.1.smithi150.stdout:6/995: getdents d2/d11d/dc6 0 2023-12-05T09:57:49.019 INFO:tasks.workunit.client.1.smithi150.stdout:6/996: creat d2/d23/d2e/d5f/d99/f152 x:0 0 0 2023-12-05T09:57:49.019 INFO:tasks.workunit.client.1.smithi150.stdout:6/997: fsync d2/d23/d3b/d64/d7a/f40 0 2023-12-05T09:57:49.024 INFO:tasks.workunit.client.1.smithi150.stdout:6/998: rename d2/d23/d3b/ded/c131 to d2/d23/d3b/d46/c153 0 2023-12-05T09:57:49.024 INFO:tasks.workunit.client.1.smithi150.stdout:6/999: write d2/d23/d2e/dd6/df3/f118 [38396,83486] 0 2023-12-05T09:57:49.024 INFO:tasks.workunit.client.0.smithi100.stdout:1/955: dread db/d12/f96 [0,4194304] 0 2023-12-05T09:57:49.027 INFO:tasks.workunit.client.0.smithi100.stdout:1/956: unlink db/d31/d3a/c5c 0 2023-12-05T09:57:49.027 INFO:tasks.workunit.client.0.smithi100.stdout:1/957: creat db/d12/d1e/d72/ddd/dfd/f123 x:0 0 0 2023-12-05T09:57:49.027 INFO:tasks.workunit.client.0.smithi100.stdout:1/958: fdatasync db/d12/f96 0 2023-12-05T09:57:49.031 INFO:tasks.workunit.client.0.smithi100.stdout:1/959: rename db/d12/d1e/de0/fb2 to db/d12/d1e/d72/ddd/dfd/dd6/f124 0 2023-12-05T09:57:49.040 INFO:tasks.workunit.client.1.smithi150.stdout:4/980: dread d0/d3e/d6d/f92 [0,4194304] 0 2023-12-05T09:57:49.040 INFO:tasks.workunit.client.1.smithi150.stdout:4/981: stat d0/d3e/d6d/d4b/f111 0 2023-12-05T09:57:49.041 INFO:tasks.workunit.client.0.smithi100.stdout:1/960: rmdir db/d31 39 2023-12-05T09:57:49.043 INFO:tasks.workunit.client.1.smithi150.stdout:4/982: rename d0/d3e/d5b/d6e/c131 to d0/d3e/d48/d12a/c139 0 2023-12-05T09:57:49.045 INFO:tasks.workunit.client.0.smithi100.stdout:1/961: mkdir db/d12/d1e/d72/d125 0 2023-12-05T09:57:49.045 INFO:tasks.workunit.client.0.smithi100.stdout:1/962: fsync db/d12/d61/f64 0 2023-12-05T09:57:49.046 INFO:tasks.workunit.client.1.smithi150.stdout:4/983: mkdir d0/d3e/d5b/d80/dc8/dfe/d10c/d13a 0 2023-12-05T09:57:49.048 INFO:tasks.workunit.client.1.smithi150.stdout:4/984: creat d0/d3e/d48/dbb/dca/f13b x:0 0 0 2023-12-05T09:57:49.048 INFO:tasks.workunit.client.1.smithi150.stdout:4/985: creat d0/d3e/d6d/d4b/d8c/f13c x:0 0 0 2023-12-05T09:57:49.048 INFO:tasks.workunit.client.1.smithi150.stdout:4/986: stat d0/d3e/d5b/de4/d108/l130 0 2023-12-05T09:57:49.048 INFO:tasks.workunit.client.0.smithi100.stdout:1/963: read db/d12/d1e/fa2 [361664,66587] 0 2023-12-05T09:57:49.051 INFO:tasks.workunit.client.0.smithi100.stdout:1/964: unlink db/d12/d1e/de0/c94 0 2023-12-05T09:57:49.051 INFO:tasks.workunit.client.0.smithi100.stdout:7/931: dwrite d3/dc/d11/d13/de/f73 [0,4194304] 0 2023-12-05T09:57:49.051 INFO:tasks.workunit.client.0.smithi100.stdout:7/932: write d3/dc/d11/d13/de/d18/d3b/d40/d4c/fa4 [903351,10879] 0 2023-12-05T09:57:49.062 INFO:tasks.workunit.client.1.smithi150.stdout:4/987: dread d0/d3e/d48/fbc [0,4194304] 0 2023-12-05T09:57:49.064 INFO:tasks.workunit.client.1.smithi150.stdout:4/988: creat d0/d5f/d12d/f13d x:0 0 0 2023-12-05T09:57:49.064 INFO:tasks.workunit.client.1.smithi150.stdout:4/989: stat d0/d3e/d48 0 2023-12-05T09:57:49.069 INFO:tasks.workunit.client.0.smithi100.stdout:1/965: dread db/d12/fae [0,4194304] 0 2023-12-05T09:57:49.069 INFO:tasks.workunit.client.0.smithi100.stdout:1/966: read - db/d12/fe5 zero size 2023-12-05T09:57:49.078 INFO:tasks.workunit.client.1.smithi150.stdout:4/990: write d0/d3e/d5b/d80/dc8/fce [7936397,84776] 0 2023-12-05T09:57:49.078 INFO:tasks.workunit.client.1.smithi150.stdout:4/991: creat d0/d3e/d5b/d6e/f13e x:0 0 0 2023-12-05T09:57:49.081 INFO:tasks.workunit.client.1.smithi150.stdout:4/992: getdents d0/d3e 0 2023-12-05T09:57:49.088 INFO:tasks.workunit.client.0.smithi100.stdout:1/967: dread db/d12/f1d [0,4194304] 0 2023-12-05T09:57:49.089 INFO:tasks.workunit.client.1.smithi150.stdout:4/993: dread d0/d3e/f6b [0,4194304] 0 2023-12-05T09:57:49.090 INFO:tasks.workunit.client.0.smithi100.stdout:1/968: truncate db/d31/f51 2857619 0 2023-12-05T09:57:49.091 INFO:tasks.workunit.client.0.smithi100.stdout:1/969: link db/d12/d1e/d72/fc6 db/d12/d1e/dd3/f126 0 2023-12-05T09:57:49.092 INFO:tasks.workunit.client.0.smithi100.stdout:1/970: mkdir db/d31/d73/d127 0 2023-12-05T09:57:49.092 INFO:tasks.workunit.client.0.smithi100.stdout:1/971: fdatasync db/d12/d1e/dd3/fcf 0 2023-12-05T09:57:49.103 INFO:tasks.workunit.client.0.smithi100.stdout:1/972: dread db/d12/f45 [0,4194304] 0 2023-12-05T09:57:49.103 INFO:tasks.workunit.client.0.smithi100.stdout:1/973: creat db/d12/d1e/f128 x:0 0 0 2023-12-05T09:57:49.103 INFO:tasks.workunit.client.0.smithi100.stdout:1/974: readlink db/d12/d113/l11a 0 2023-12-05T09:57:49.104 INFO:tasks.workunit.client.0.smithi100.stdout:7/933: dwrite d3/dc/d11/d13/de/d2d/d42/f83 [0,4194304] 0 2023-12-05T09:57:49.114 INFO:tasks.workunit.client.0.smithi100.stdout:7/934: rmdir d3/dc/d11/d13/de/d18/d3b/d40/d46/d9e 39 2023-12-05T09:57:49.120 INFO:tasks.workunit.client.0.smithi100.stdout:4/980: sync 2023-12-05T09:57:49.120 INFO:tasks.workunit.client.0.smithi100.stdout:0/999: sync 2023-12-05T09:57:49.120 INFO:tasks.workunit.client.0.smithi100.stdout:4/981: write de/d38/d5d/f6e [553603,98084] 0 2023-12-05T09:57:49.122 INFO:tasks.workunit.client.0.smithi100.stdout:4/982: mknod de/d16/d23/c146 0 2023-12-05T09:57:49.141 INFO:tasks.workunit.client.0.smithi100.stdout:4/983: write de/d38/d5d/f71 [3109271,67789] 0 2023-12-05T09:57:49.142 INFO:tasks.workunit.client.0.smithi100.stdout:4/984: chown de/d16/d23/d60/df7/d4e/dbe/d11a 1515 1 2023-12-05T09:57:49.148 INFO:tasks.workunit.client.0.smithi100.stdout:1/975: dwrite db/d12/f45 [0,4194304] 0 2023-12-05T09:57:49.148 INFO:tasks.workunit.client.0.smithi100.stdout:1/976: write db/d31/d3a/d4a/dad/fbf [34663,67643] 0 2023-12-05T09:57:49.150 INFO:tasks.workunit.client.0.smithi100.stdout:1/977: truncate db/d12/d1e/fa2 685818 0 2023-12-05T09:57:49.150 INFO:tasks.workunit.client.0.smithi100.stdout:1/978: stat db/d12/d1e/d72/ddd/dfd/f108 0 2023-12-05T09:57:49.150 INFO:tasks.workunit.client.0.smithi100.stdout:1/979: write db/d12/d1e/dd3/fcf [8122374,110519] 0 2023-12-05T09:57:49.150 INFO:tasks.workunit.client.0.smithi100.stdout:1/980: chown db/d12/d1e/dd3/db8/f119 279908 1 2023-12-05T09:57:49.153 INFO:tasks.workunit.client.0.smithi100.stdout:7/935: dwrite d3/dc/d11/d13/de/d2d/d47/dbd/f13d [0,4194304] 0 2023-12-05T09:57:49.161 INFO:tasks.workunit.client.0.smithi100.stdout:7/936: getdents d3/dc/d11/d13/de/d18/d3b/d12c 0 2023-12-05T09:57:49.161 INFO:tasks.workunit.client.0.smithi100.stdout:7/937: dread - d3/dc/d11/d13/d37/d97/dc1/dcd/fe4 zero size 2023-12-05T09:57:49.163 INFO:tasks.workunit.client.0.smithi100.stdout:7/938: link d3/dc/d11/d13/d37/fa9 d3/dc/d11/f152 0 2023-12-05T09:57:49.171 INFO:tasks.workunit.client.1.smithi150.stdout:4/994: sync 2023-12-05T09:57:49.172 INFO:tasks.workunit.client.0.smithi100.stdout:7/939: dread d3/dc/fa6 [0,4194304] 0 2023-12-05T09:57:49.173 INFO:tasks.workunit.client.0.smithi100.stdout:7/940: creat d3/dc/d11/d13/de/d18/d3b/d40/d4c/d7f/f153 x:0 0 0 2023-12-05T09:57:49.173 INFO:tasks.workunit.client.0.smithi100.stdout:7/941: fsync d3/ff2 0 2023-12-05T09:57:49.174 INFO:tasks.workunit.client.0.smithi100.stdout:7/942: getdents d3/dc/d11/d13/de/d18/d3b/de2 0 2023-12-05T09:57:49.180 INFO:tasks.workunit.client.0.smithi100.stdout:4/985: dwrite de/d16/d23/d33/f6b [0,4194304] 0 2023-12-05T09:57:49.180 INFO:tasks.workunit.client.0.smithi100.stdout:4/986: chown de/d16/d23/f26 442 1 2023-12-05T09:57:49.194 INFO:tasks.workunit.client.1.smithi150.stdout:4/995: dread d0/f61 [0,4194304] 0 2023-12-05T09:57:49.194 INFO:tasks.workunit.client.0.smithi100.stdout:4/987: read de/d16/f52 [57576,91927] 0 2023-12-05T09:57:49.195 INFO:tasks.workunit.client.1.smithi150.stdout:4/996: mkdir d0/d3e/d5b/de4/d108/d129/d13f 0 2023-12-05T09:57:49.195 INFO:tasks.workunit.client.0.smithi100.stdout:1/981: dwrite db/d12/f75 [0,4194304] 0 2023-12-05T09:57:49.197 INFO:tasks.workunit.client.0.smithi100.stdout:1/982: creat db/d12/d1e/d26/d39/d11e/f129 x:0 0 0 2023-12-05T09:57:49.198 INFO:tasks.workunit.client.0.smithi100.stdout:1/983: chown db/ddf/l118 13884027 1 2023-12-05T09:57:49.200 INFO:tasks.workunit.client.0.smithi100.stdout:1/984: unlink db/d31/d3a/l8b 0 2023-12-05T09:57:49.200 INFO:tasks.workunit.client.0.smithi100.stdout:1/985: dread - db/d12/d1e/d26/d30/d6e/ffb zero size 2023-12-05T09:57:49.200 INFO:tasks.workunit.client.0.smithi100.stdout:4/988: dread de/d16/f52 [0,4194304] 0 2023-12-05T09:57:49.204 INFO:tasks.workunit.client.0.smithi100.stdout:7/943: dwrite d3/dc/d11/d13/d37/d97/dc1/dcd/f103 [0,4194304] 0 2023-12-05T09:57:49.207 INFO:tasks.workunit.client.1.smithi150.stdout:4/997: dread d0/d3e/d5b/f94 [0,4194304] 0 2023-12-05T09:57:49.207 INFO:tasks.workunit.client.1.smithi150.stdout:4/998: truncate d0/d3e/d5b/d80/f4c 13505779 0 2023-12-05T09:57:49.253 INFO:tasks.workunit.client.0.smithi100.stdout:1/986: symlink db/d12/d1e/d26/d39/de9/l12a 0 2023-12-05T09:57:49.255 INFO:tasks.workunit.client.0.smithi100.stdout:4/989: mknod de/d38/c147 0 2023-12-05T09:57:49.255 INFO:tasks.workunit.client.0.smithi100.stdout:4/990: write de/d16/d23/d60/df7/d4e/d85/fff [628688,20289] 0 2023-12-05T09:57:49.266 INFO:tasks.workunit.client.0.smithi100.stdout:7/944: mknod d3/dc/d11/d13/d1b/d60/c154 0 2023-12-05T09:57:49.266 INFO:tasks.workunit.client.0.smithi100.stdout:7/945: truncate d3/dc/d11/d13/f30 1744044 0 2023-12-05T09:57:49.279 INFO:tasks.workunit.client.0.smithi100.stdout:1/987: dread db/d31/d3a/d3b/f4b [0,4194304] 0 2023-12-05T09:57:49.279 INFO:tasks.workunit.client.0.smithi100.stdout:1/988: readlink db/d12/d113/l11a 0 2023-12-05T09:57:49.279 INFO:tasks.workunit.client.0.smithi100.stdout:1/989: readlink db/d31/d3a/l7e 0 2023-12-05T09:57:49.298 INFO:tasks.workunit.client.1.smithi150.stdout:4/999: dwrite d0/d5f/fd4 [0,4194304] 0 2023-12-05T09:57:49.393 INFO:tasks.workunit.client.0.smithi100.stdout:7/946: symlink d3/dc/d11/d13/d37/d97/l155 0 2023-12-05T09:57:49.393 INFO:tasks.workunit.client.0.smithi100.stdout:7/947: chown d3/dc/d11/d13/de/d2d/d47/dbd/cd4 782 1 2023-12-05T09:57:49.393 INFO:tasks.workunit.client.0.smithi100.stdout:7/948: chown d3/dc/d11/d13/de/d2d/d47/dbd/cd5 31525129 1 2023-12-05T09:57:49.393 INFO:tasks.workunit.client.0.smithi100.stdout:7/949: dread - d3/dc/d11/d13/de/d18/d3b/f146 zero size 2023-12-05T09:57:49.394 INFO:tasks.workunit.client.0.smithi100.stdout:1/990: mkdir db/d31/d3a/d4a/dad/d67/d12b 0 2023-12-05T09:57:49.399 INFO:tasks.workunit.client.0.smithi100.stdout:7/950: unlink d3/db3/le7 0 2023-12-05T09:57:49.404 INFO:tasks.workunit.client.1.smithi150.stderr:+ rm -rf -- ./tmp.ElShauuFLf 2023-12-05T09:57:49.409 INFO:tasks.workunit.client.0.smithi100.stdout:1/991: dread db/d12/d1e/d72/dc4/fd7 [0,4194304] 0 2023-12-05T09:57:49.446 INFO:tasks.workunit.client.0.smithi100.stdout:7/951: dwrite d3/dc/d11/d33/f53 [0,4194304] 0 2023-12-05T09:57:49.449 INFO:tasks.workunit.client.0.smithi100.stdout:7/952: symlink d3/dc/d11/d13/l156 0 2023-12-05T09:57:49.464 INFO:tasks.workunit.client.0.smithi100.stdout:7/953: write d3/dc/d11/d13/de/d18/d3b/d12c/f145 [1118435,33763] 0 2023-12-05T09:57:49.464 INFO:tasks.workunit.client.0.smithi100.stdout:7/954: stat d3/dc/d11/d33/f79 0 2023-12-05T09:57:49.467 INFO:tasks.workunit.client.0.smithi100.stdout:7/955: mknod d3/dc/d11/d33/c157 0 2023-12-05T09:57:49.467 INFO:tasks.workunit.client.0.smithi100.stdout:7/956: readlink d3/dc/d11/d13/de/d18/d3b/d40/d4c/d7f/l8e 0 2023-12-05T09:57:49.467 INFO:tasks.workunit.client.0.smithi100.stdout:7/957: dread - d3/dc/d11/d13/d37/d97/f13c zero size 2023-12-05T09:57:49.467 INFO:tasks.workunit.client.0.smithi100.stdout:7/958: readlink d3/dc/d11/d13/de/d18/d3b/d40/d4c/l90 0 2023-12-05T09:57:49.468 INFO:tasks.workunit.client.0.smithi100.stdout:7/959: symlink d3/dc/daa/l158 0 2023-12-05T09:57:49.470 INFO:tasks.workunit.client.0.smithi100.stdout:7/960: creat d3/dc/d11/d13/d37/d97/dc1/dcd/f159 x:0 0 0 2023-12-05T09:57:49.516 INFO:tasks.workunit.client.0.smithi100.stdout:1/992: creat db/d12/f12c x:0 0 0 2023-12-05T09:57:49.532 INFO:tasks.workunit.client.0.smithi100.stdout:4/991: rename de/d16/c4b to de/d16/d23/d60/d98/da6/c148 0 2023-12-05T09:57:49.532 INFO:tasks.workunit.client.0.smithi100.stdout:4/992: chown de/d16/d23/d60/de3/deb/f100 399438282 1 2023-12-05T09:57:49.533 INFO:tasks.workunit.client.0.smithi100.stdout:1/993: rename db/le to db/d12/d1e/dd3/db8/l12d 0 2023-12-05T09:57:49.533 INFO:tasks.workunit.client.0.smithi100.stdout:1/994: write db/d12/d1e/dd3/f126 [670546,3327] 0 2023-12-05T09:57:49.535 INFO:tasks.workunit.client.0.smithi100.stdout:4/993: rename de/d16/d23/d36/dfe/fce to de/d16/d23/d60/d98/da6/f149 0 2023-12-05T09:57:49.535 INFO:tasks.workunit.client.0.smithi100.stdout:4/994: fsync de/d16/d23/f58 0 2023-12-05T09:57:49.537 INFO:tasks.workunit.client.0.smithi100.stdout:4/995: mkdir de/d16/d23/d60/d98/da6/d13e/d14a 0 2023-12-05T09:57:49.537 INFO:tasks.workunit.client.0.smithi100.stdout:4/996: chown de/d16/d23/d36/f3e 773863 1 2023-12-05T09:57:49.542 INFO:tasks.workunit.client.0.smithi100.stdout:4/997: symlink de/d16/d23/l14b 0 2023-12-05T09:57:49.543 INFO:tasks.workunit.client.0.smithi100.stdout:4/998: creat de/d16/df1/f14c x:0 0 0 2023-12-05T09:57:49.546 INFO:tasks.workunit.client.0.smithi100.stdout:4/999: rename de/d38/fb6 to de/d16/d23/d36/f14d 0 2023-12-05T09:57:49.581 INFO:tasks.workunit.client.0.smithi100.stdout:1/995: dwrite f1 [0,4194304] 0 2023-12-05T09:57:49.583 INFO:tasks.workunit.client.0.smithi100.stdout:1/996: symlink db/d12/d1e/d72/l12e 0 2023-12-05T09:57:49.583 INFO:tasks.workunit.client.0.smithi100.stdout:1/997: truncate db/d12/d1e/d26/d30/d6e/f91 215949 0 2023-12-05T09:57:49.586 INFO:tasks.workunit.client.0.smithi100.stdout:1/998: truncate db/d12/d1e/dd3/fcf 2914360 0 2023-12-05T09:57:49.586 INFO:tasks.workunit.client.0.smithi100.stdout:1/999: rmdir db/d12/d1e/d26 39 2023-12-05T09:57:49.735 INFO:tasks.workunit.client.0.smithi100.stdout:7/961: sync 2023-12-05T09:57:49.750 INFO:tasks.workunit.client.0.smithi100.stdout:7/962: dread d3/dc/d11/d13/de/d18/d3b/d40/d46/f5f [0,4194304] 0 2023-12-05T09:57:49.789 INFO:tasks.workunit.client.0.smithi100.stdout:7/963: dwrite d3/dc/d11/d13/d37/d97/dc1/dcd/d13f/f13a [0,4194304] 0 2023-12-05T09:57:49.789 INFO:tasks.workunit.client.0.smithi100.stdout:7/964: dread - d3/dc/d11/d13/de/d18/d3b/d40/d46/d9e/f132 zero size 2023-12-05T09:57:49.999 INFO:tasks.workunit.client.0.smithi100.stdout:7/965: sync 2023-12-05T09:57:50.217 INFO:tasks.workunit.client.0.smithi100.stdout:7/966: sync 2023-12-05T09:57:50.217 INFO:tasks.workunit.client.0.smithi100.stdout:7/967: fsync d3/dc/d11/d13/de/d2d/d47/fca 0 2023-12-05T09:57:50.217 INFO:tasks.workunit.client.0.smithi100.stdout:7/968: chown d3/dc/d11/d13/de/d2d/d47/l6e 10395 1 2023-12-05T09:57:50.217 INFO:tasks.workunit.client.0.smithi100.stdout:7/969: truncate d3/dc/d11/d13/de/d18/d3b/f11b 989583 0 2023-12-05T09:57:50.267 INFO:tasks.workunit.client.0.smithi100.stdout:7/970: dwrite d3/dc/d11/d13/de/d18/fc4 [0,4194304] 0 2023-12-05T09:57:50.288 INFO:tasks.workunit.client.0.smithi100.stdout:7/971: read d3/dc/d11/d13/d1b/d60/fe0 [2238538,5897] 0 2023-12-05T09:57:50.288 INFO:tasks.workunit.client.0.smithi100.stdout:7/972: readlink d3/l61 0 2023-12-05T09:57:50.290 INFO:tasks.workunit.client.0.smithi100.stdout:7/973: truncate d3/dc/d11/d13/de/d18/d3b/d40/d46/d9e/f107 520040 0 2023-12-05T09:57:50.290 INFO:tasks.workunit.client.0.smithi100.stdout:7/974: write d3/dc/d11/d13/d37/d97/dc1/dcd/f159 [434866,130053] 0 2023-12-05T09:57:50.290 INFO:tasks.workunit.client.0.smithi100.stdout:7/975: fdatasync d3/dc/d11/d13/d37/d97/fec 0 2023-12-05T09:57:50.292 INFO:tasks.workunit.client.0.smithi100.stdout:7/976: mkdir d3/dc/d11/d13/d1b/d60/d15a 0 2023-12-05T09:57:50.299 INFO:tasks.workunit.client.0.smithi100.stdout:7/977: rename d3/dc/d11/d13/de/d18/d3b/f11b to d3/dc/f15b 0 2023-12-05T09:57:50.299 INFO:tasks.workunit.client.0.smithi100.stdout:7/978: creat d3/dc/d11/d13/de/d18/d3b/dd7/f15c x:0 0 0 2023-12-05T09:57:50.304 INFO:tasks.workunit.client.0.smithi100.stdout:7/979: mknod d3/dc/d11/d13/de/d18/d3b/d40/d4c/c15d 0 2023-12-05T09:57:50.324 INFO:tasks.workunit.client.0.smithi100.stdout:7/980: read d3/dc/d11/f59 [486144,8138] 0 2023-12-05T09:57:50.326 INFO:tasks.workunit.client.0.smithi100.stdout:7/981: write d3/dc/d11/d13/f148 [309367,92164] 0 2023-12-05T09:57:50.326 INFO:tasks.workunit.client.0.smithi100.stdout:7/982: write d3/dc/d11/d13/de/d18/d3b/dd7/f13b [81002,19144] 0 2023-12-05T09:57:50.326 INFO:tasks.workunit.client.0.smithi100.stdout:7/983: truncate d3/dc/d11/d13/d1b/d60/fe0 4447287 0 2023-12-05T09:57:50.359 INFO:tasks.workunit.client.0.smithi100.stdout:7/984: dwrite d3/dc/d11/d13/de/d18/d3b/d12c/f150 [0,4194304] 0 2023-12-05T09:57:50.363 INFO:tasks.workunit.client.0.smithi100.stdout:7/985: rename d3/dc/d11/c39 to d3/dc/d11/d13/de/d18/d3b/d40/d46/d9e/c15e 0 2023-12-05T09:57:50.365 INFO:tasks.workunit.client.0.smithi100.stdout:7/986: symlink d3/dc/d11/d13/de/d18/dcb/d151/l15f 0 2023-12-05T09:57:50.369 INFO:tasks.workunit.client.0.smithi100.stdout:7/987: unlink d3/dc/d11/d13/de/d18/d3b/d40/d4c/f100 0 2023-12-05T09:57:50.391 INFO:tasks.workunit.client.0.smithi100.stdout:7/988: dread d3/dc/d11/d13/de/d18/d3b/d40/d46/fba [0,4194304] 0 2023-12-05T09:57:50.393 INFO:tasks.workunit.client.0.smithi100.stdout:7/989: mknod d3/dc/d11/d13/d37/d97/dc1/dcd/c160 0 2023-12-05T09:57:50.393 INFO:tasks.workunit.client.0.smithi100.stdout:7/990: truncate d3/dc/d11/d13/d1b/d60/fe0 5180472 0 2023-12-05T09:57:50.393 INFO:tasks.workunit.client.0.smithi100.stdout:7/991: read - d3/dc/d11/d33/f10d zero size 2023-12-05T09:57:50.398 INFO:tasks.workunit.client.0.smithi100.stdout:7/992: rename d3/dc/d11/d13/da8/f113 to d3/dc/d11/d13/de/d18/d3b/dd7/f161 0 2023-12-05T09:57:50.437 INFO:tasks.workunit.client.0.smithi100.stdout:7/993: dwrite d3/dc/d11/d33/fb4 [0,4194304] 0 2023-12-05T09:57:50.477 INFO:tasks.workunit.client.0.smithi100.stdout:7/994: dwrite d3/dc/d11/d13/de/d2d/f14e [0,4194304] 0 2023-12-05T09:57:50.499 INFO:tasks.workunit.client.0.smithi100.stdout:7/995: dread d3/dc/d11/d13/de/d2d/f44 [0,4194304] 0 2023-12-05T09:57:50.499 INFO:tasks.workunit.client.0.smithi100.stdout:7/996: creat d3/dc/d11/d13/da8/d10f/f162 x:0 0 0 2023-12-05T09:57:50.499 INFO:tasks.workunit.client.0.smithi100.stdout:7/997: dread - d3/dc/d11/d13/de/d18/d3b/d40/d4c/d7f/f153 zero size 2023-12-05T09:57:50.499 INFO:tasks.workunit.client.0.smithi100.stdout:7/998: write d3/dc/d11/d13/de/d18/d3b/dd7/f13b [585011,8516] 0 2023-12-05T09:57:50.501 INFO:tasks.workunit.client.0.smithi100.stdout:7/999: symlink d3/dc/d11/d13/de/d18/d3b/de2/l163 0 2023-12-05T09:57:50.506 INFO:tasks.workunit.client.0.smithi100.stderr:+ rm -rf -- ./tmp.XnAl0zcD3v 2023-12-05T09:57:50.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:50 smithi100 ceph-mon[107145]: pgmap v41: 65 pgs: 65 active+clean; 3.6 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 165 MiB/s rd, 209 MiB/s wr, 294 op/s 2023-12-05T09:57:50.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:50 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:57:50.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:50 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:57:50.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:50 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:57:51.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:50 smithi150 ceph-mon[116142]: pgmap v41: 65 pgs: 65 active+clean; 3.6 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 165 MiB/s rd, 209 MiB/s wr, 294 op/s 2023-12-05T09:57:51.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:50 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:57:51.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:50 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:57:51.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:50 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:57:52.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:52 smithi100 ceph-mon[107145]: pgmap v42: 65 pgs: 65 active+clean; 4.1 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 241 MiB/s rd, 305 MiB/s wr, 439 op/s 2023-12-05T09:57:52.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:52 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:57:52.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:52 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:57:53.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:52 smithi150 ceph-mon[116142]: pgmap v42: 65 pgs: 65 active+clean; 4.1 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 241 MiB/s rd, 305 MiB/s wr, 439 op/s 2023-12-05T09:57:53.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:52 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:57:53.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:52 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:57:54.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:54 smithi100 ceph-mon[107145]: pgmap v43: 65 pgs: 65 active+clean; 4.1 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 160 MiB/s rd, 202 MiB/s wr, 302 op/s 2023-12-05T09:57:55.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:54 smithi150 ceph-mon[116142]: pgmap v43: 65 pgs: 65 active+clean; 4.1 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 160 MiB/s rd, 202 MiB/s wr, 302 op/s 2023-12-05T09:57:56.149 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:55 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:57:56.150 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:55 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:57:56.345 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:55 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:57:56.345 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:55 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:57:57.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:56 smithi100 ceph-mon[107145]: pgmap v44: 65 pgs: 65 active+clean; 3.7 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 165 MiB/s rd, 208 MiB/s wr, 377 op/s 2023-12-05T09:57:57.147 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:56 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:57:57.147 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:56 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:57:57.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:56 smithi150 ceph-mon[116142]: pgmap v44: 65 pgs: 65 active+clean; 3.7 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 165 MiB/s rd, 208 MiB/s wr, 377 op/s 2023-12-05T09:57:57.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:56 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:57:57.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:56 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:57:59.318 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:57:58 smithi100 ceph-mon[107145]: pgmap v45: 65 pgs: 65 active+clean; 3.7 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 80 MiB/s rd, 102 MiB/s wr, 220 op/s 2023-12-05T09:57:59.345 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:57:58 smithi150 ceph-mon[116142]: pgmap v45: 65 pgs: 65 active+clean; 3.7 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 80 MiB/s rd, 102 MiB/s wr, 220 op/s 2023-12-05T09:58:01.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:00 smithi100 ceph-mon[107145]: pgmap v46: 65 pgs: 65 active+clean; 3.7 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 80 MiB/s rd, 102 MiB/s wr, 220 op/s 2023-12-05T09:58:01.235 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:00 smithi150 ceph-mon[116142]: pgmap v46: 65 pgs: 65 active+clean; 3.7 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 80 MiB/s rd, 102 MiB/s wr, 220 op/s 2023-12-05T09:58:02.096 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:01 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:58:02.097 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:01 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:58:02.097 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:01 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:58:02.097 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:01 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:58:02.097 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:01 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:58:02.097 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:01 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:58:02.097 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:01 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "mgr fail", "who": "smithi150.zkskag"}]: dispatch 2023-12-05T09:58:02.097 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:01 smithi100 ceph-mon[107145]: osdmap e49: 6 total, 6 up, 6 in 2023-12-05T09:58:02.097 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:01 smithi100 ceph-mon[107145]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd='[{"prefix": "mgr fail", "who": "smithi150.zkskag"}]': finished 2023-12-05T09:58:02.097 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:01 smithi100 ceph-mon[107145]: mgrmap e26: smithi100.ehmuhg(active, starting, since 0.0094838s) 2023-12-05T09:58:02.097 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:01 smithi100 ceph-mon[107145]: Active manager daemon smithi100.ehmuhg restarted 2023-12-05T09:58:02.097 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:01 smithi100 ceph-mon[107145]: Activating manager daemon smithi100.ehmuhg 2023-12-05T09:58:02.098 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:01 smithi100 ceph-mon[107145]: osdmap e50: 6 total, 6 up, 6 in 2023-12-05T09:58:02.098 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:01 smithi100 ceph-mon[107145]: mgrmap e27: smithi100.ehmuhg(active, starting, since 0.00638691s) 2023-12-05T09:58:02.098 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:01 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi100.ehmuhg/crt"}]: dispatch 2023-12-05T09:58:02.098 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:01 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mon metadata", "id": "smithi100"}]: dispatch 2023-12-05T09:58:02.098 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:01 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mon metadata", "id": "smithi150"}]: dispatch 2023-12-05T09:58:02.098 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:01 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi150.pcbpxm"}]: dispatch 2023-12-05T09:58:02.098 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:01 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi100.akmstb"}]: dispatch 2023-12-05T09:58:02.098 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:01 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi150.fcnhsv"}]: dispatch 2023-12-05T09:58:02.098 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:01 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi100.sqplhn"}]: dispatch 2023-12-05T09:58:02.098 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:01 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mgr metadata", "who": "smithi100.ehmuhg", "id": "smithi100.ehmuhg"}]: dispatch 2023-12-05T09:58:02.098 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:01 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-05T09:58:02.098 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:01 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-05T09:58:02.098 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:01 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-05T09:58:02.098 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:01 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-05T09:58:02.099 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:01 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-05T09:58:02.099 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:01 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-05T09:58:02.099 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:01 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-05T09:58:02.099 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:01 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-05T09:58:02.099 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:01 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-05T09:58:02.099 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:01 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-05T09:58:02.099 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:01 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi100.ehmuhg/key"}]: dispatch 2023-12-05T09:58:02.099 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:01 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-05T09:58:02.099 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:01 smithi100 ceph-mon[107145]: Manager daemon smithi100.ehmuhg is now available 2023-12-05T09:58:02.247 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:01 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:58:02.247 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:01 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:58:02.247 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:01 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:58:02.247 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:01 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:58:02.248 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:01 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' 2023-12-05T09:58:02.248 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:01 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:58:02.248 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:01 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "mgr fail", "who": "smithi150.zkskag"}]: dispatch 2023-12-05T09:58:02.248 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:01 smithi150 ceph-mon[116142]: osdmap e49: 6 total, 6 up, 6 in 2023-12-05T09:58:02.248 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:01 smithi150 ceph-mon[116142]: from='mgr.24423 172.21.15.150:0/1720344025' entity='mgr.smithi150.zkskag' cmd='[{"prefix": "mgr fail", "who": "smithi150.zkskag"}]': finished 2023-12-05T09:58:02.248 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:01 smithi150 ceph-mon[116142]: mgrmap e26: smithi100.ehmuhg(active, starting, since 0.0094838s) 2023-12-05T09:58:02.248 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:01 smithi150 ceph-mon[116142]: Active manager daemon smithi100.ehmuhg restarted 2023-12-05T09:58:02.248 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:01 smithi150 ceph-mon[116142]: Activating manager daemon smithi100.ehmuhg 2023-12-05T09:58:02.248 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:01 smithi150 ceph-mon[116142]: osdmap e50: 6 total, 6 up, 6 in 2023-12-05T09:58:02.249 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:01 smithi150 ceph-mon[116142]: mgrmap e27: smithi100.ehmuhg(active, starting, since 0.00638691s) 2023-12-05T09:58:02.249 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:01 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi100.ehmuhg/crt"}]: dispatch 2023-12-05T09:58:02.249 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:01 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mon metadata", "id": "smithi100"}]: dispatch 2023-12-05T09:58:02.249 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:01 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mon metadata", "id": "smithi150"}]: dispatch 2023-12-05T09:58:02.249 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:01 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi150.pcbpxm"}]: dispatch 2023-12-05T09:58:02.249 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:01 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi100.akmstb"}]: dispatch 2023-12-05T09:58:02.249 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:01 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi150.fcnhsv"}]: dispatch 2023-12-05T09:58:02.249 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:01 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi100.sqplhn"}]: dispatch 2023-12-05T09:58:02.249 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:01 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mgr metadata", "who": "smithi100.ehmuhg", "id": "smithi100.ehmuhg"}]: dispatch 2023-12-05T09:58:02.249 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:01 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-05T09:58:02.250 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:01 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-05T09:58:02.250 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:01 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-05T09:58:02.250 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:01 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-05T09:58:02.250 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:01 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-05T09:58:02.250 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:01 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-05T09:58:02.250 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:01 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-05T09:58:02.250 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:01 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-05T09:58:02.250 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:01 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-05T09:58:02.250 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:01 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-05T09:58:02.251 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:01 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi100.ehmuhg/key"}]: dispatch 2023-12-05T09:58:02.251 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:01 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-05T09:58:02.251 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:01 smithi150 ceph-mon[116142]: Manager daemon smithi100.ehmuhg is now available 2023-12-05T09:58:03.345 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:02 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:58:03.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:02 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:58:03.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:02 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:58:03.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:02 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi100.ehmuhg/mirror_snapshot_schedule"}]: dispatch 2023-12-05T09:58:03.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:02 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi100.ehmuhg/trash_purge_schedule"}]: dispatch 2023-12-05T09:58:03.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:02 smithi150 ceph-mon[116142]: mgrmap e28: smithi100.ehmuhg(active, since 1.01135s) 2023-12-05T09:58:03.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:02 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:58:03.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:02 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:58:03.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:02 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:58:03.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:02 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi100.ehmuhg/mirror_snapshot_schedule"}]: dispatch 2023-12-05T09:58:03.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:02 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi100.ehmuhg/trash_purge_schedule"}]: dispatch 2023-12-05T09:58:03.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:02 smithi100 ceph-mon[107145]: mgrmap e28: smithi100.ehmuhg(active, since 1.01135s) 2023-12-05T09:58:04.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:04 smithi100 ceph-mon[107145]: [05/Dec/2023:09:58:03] ENGINE Bus STARTING 2023-12-05T09:58:04.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:04 smithi100 ceph-mon[107145]: [05/Dec/2023:09:58:03] ENGINE Serving on http://172.21.15.100:8765 2023-12-05T09:58:04.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:04 smithi100 ceph-mon[107145]: [05/Dec/2023:09:58:03] ENGINE Serving on https://172.21.15.100:7150 2023-12-05T09:58:04.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:04 smithi100 ceph-mon[107145]: [05/Dec/2023:09:58:03] ENGINE Bus STARTED 2023-12-05T09:58:04.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:04 smithi150 ceph-mon[116142]: [05/Dec/2023:09:58:03] ENGINE Bus STARTING 2023-12-05T09:58:04.968 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:04 smithi150 ceph-mon[116142]: [05/Dec/2023:09:58:03] ENGINE Serving on http://172.21.15.100:8765 2023-12-05T09:58:04.968 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:04 smithi150 ceph-mon[116142]: [05/Dec/2023:09:58:03] ENGINE Serving on https://172.21.15.100:7150 2023-12-05T09:58:04.968 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:04 smithi150 ceph-mon[116142]: [05/Dec/2023:09:58:03] ENGINE Bus STARTED 2023-12-05T09:58:05.595 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:05 smithi150 ceph-mon[116142]: pgmap v4: 65 pgs: 65 active+clean; 1.8 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail 2023-12-05T09:58:05.595 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:05 smithi150 ceph-mon[116142]: mgrmap e29: smithi100.ehmuhg(active, since 2s) 2023-12-05T09:58:05.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:05 smithi100 ceph-mon[107145]: pgmap v4: 65 pgs: 65 active+clean; 1.8 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail 2023-12-05T09:58:05.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:05 smithi100 ceph-mon[107145]: mgrmap e29: smithi100.ehmuhg(active, since 2s) 2023-12-05T09:58:06.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:06 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:58:06.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:06 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:58:06.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:06 smithi150 ceph-mon[116142]: pgmap v5: 65 pgs: 65 active+clean; 1.8 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail 2023-12-05T09:58:06.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:06 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:58:06.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:06 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:58:06.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:06 smithi100 ceph-mon[107145]: pgmap v5: 65 pgs: 65 active+clean; 1.8 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail 2023-12-05T09:58:07.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:07 smithi150 ceph-mon[116142]: mgrmap e30: smithi100.ehmuhg(active, since 4s) 2023-12-05T09:58:07.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:07 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:58:07.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:07 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:58:08.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:07 smithi100 ceph-mon[107145]: mgrmap e30: smithi100.ehmuhg(active, since 4s) 2023-12-05T09:58:08.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:07 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:58:08.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:07 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:58:08.166 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-05T09:58:08.167 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2023-12-05T09:58:08.223 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-05T09:58:08.223 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-05T09:58:08.521 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:08.523+0000 7f0a9b4f9700 1 -- 172.21.15.100:0/3736172921 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a94071b60 msgr2=0x7f0a9406ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:58:08.521 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:08.523+0000 7f0a9b4f9700 1 --2- 172.21.15.100:0/3736172921 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a94071b60 0x7f0a9406ffd0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f0a90004940 tx=0x7f0a90009e30 comp rx=0 tx=0).stop 2023-12-05T09:58:08.521 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:08.523+0000 7f0a9b4f9700 1 -- 172.21.15.100:0/3736172921 shutdown_connections 2023-12-05T09:58:08.522 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:08.523+0000 7f0a9b4f9700 1 --2- 172.21.15.100:0/3736172921 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a94070510 0x7f0a94070980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:08.522 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:08.523+0000 7f0a9b4f9700 1 --2- 172.21.15.100:0/3736172921 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a94071b60 0x7f0a9406ffd0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:08.522 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:08.523+0000 7f0a9b4f9700 1 -- 172.21.15.100:0/3736172921 >> 172.21.15.100:0/3736172921 conn(0x7f0a940f82d0 msgr2=0x7f0a940fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:58:08.522 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:08.523+0000 7f0a9b4f9700 1 -- 172.21.15.100:0/3736172921 shutdown_connections 2023-12-05T09:58:08.522 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:08.524+0000 7f0a9b4f9700 1 -- 172.21.15.100:0/3736172921 wait complete. 2023-12-05T09:58:08.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:08.525+0000 7f0a9b4f9700 1 Processor -- start 2023-12-05T09:58:08.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:08.525+0000 7f0a9b4f9700 1 -- start start 2023-12-05T09:58:08.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:08.525+0000 7f0a9b4f9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a94070510 0x7f0a9410f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:58:08.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:08.525+0000 7f0a9b4f9700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a94071b60 0x7f0a9410fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:58:08.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:08.525+0000 7f0a9b4f9700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a941102d0 con 0x7f0a94071b60 2023-12-05T09:58:08.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:08.525+0000 7f0a9b4f9700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a94110b70 con 0x7f0a94070510 2023-12-05T09:58:08.524 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:08.526+0000 7f0a99295700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a94070510 0x7f0a9410f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:58:08.524 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:08.526+0000 7f0a99295700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a94070510 0x7f0a9410f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.100:39570/0 (socket says 172.21.15.100:39570) 2023-12-05T09:58:08.524 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:08.526+0000 7f0a99295700 1 -- 172.21.15.100:0/890096743 learned_addr learned my addr 172.21.15.100:0/890096743 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:58:08.524 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:08.526+0000 7f0a98a94700 1 --2- 172.21.15.100:0/890096743 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a94071b60 0x7f0a9410fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:58:08.524 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:08.526+0000 7f0a99295700 1 -- 172.21.15.100:0/890096743 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a94071b60 msgr2=0x7f0a9410fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:58:08.524 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:08.526+0000 7f0a99295700 1 --2- 172.21.15.100:0/890096743 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a94071b60 0x7f0a9410fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:08.524 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:08.526+0000 7f0a99295700 1 -- 172.21.15.100:0/890096743 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a90005040 con 0x7f0a94070510 2023-12-05T09:58:08.524 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:08.526+0000 7f0a98a94700 1 --2- 172.21.15.100:0/890096743 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a94071b60 0x7f0a9410fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-05T09:58:08.525 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:08.526+0000 7f0a99295700 1 --2- 172.21.15.100:0/890096743 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a94070510 0x7f0a9410f790 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0a90009fd0 tx=0x7f0a90009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:58:08.525 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:08.527+0000 7f0a89ffb700 1 -- 172.21.15.100:0/890096743 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a90021070 con 0x7f0a94070510 2023-12-05T09:58:08.525 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:08.527+0000 7f0a89ffb700 1 -- 172.21.15.100:0/890096743 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0a90013c60 con 0x7f0a94070510 2023-12-05T09:58:08.525 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:08.527+0000 7f0a89ffb700 1 -- 172.21.15.100:0/890096743 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a9000e070 con 0x7f0a94070510 2023-12-05T09:58:08.525 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:08.528+0000 7f0a9b4f9700 1 -- 172.21.15.100:0/890096743 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a94110df0 con 0x7f0a94070510 2023-12-05T09:58:08.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:08.528+0000 7f0a9b4f9700 1 -- 172.21.15.100:0/890096743 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a94111250 con 0x7f0a94070510 2023-12-05T09:58:08.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:08.529+0000 7f0a89ffb700 1 -- 172.21.15.100:0/890096743 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 30) v1 ==== 45729+0+0 (secure 0 0 0) 0x7f0a9001c450 con 0x7f0a94070510 2023-12-05T09:58:08.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:08.529+0000 7f0a9b4f9700 1 -- 172.21.15.100:0/890096743 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a941096f0 con 0x7f0a94070510 2023-12-05T09:58:08.527 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:08.529+0000 7f0a89ffb700 1 --2- 172.21.15.100:0/890096743 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7f0a80038760 0x7f0a8003ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:58:08.527 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:08.530+0000 7f0a89ffb700 1 -- 172.21.15.100:0/890096743 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f0a9004d0b0 con 0x7f0a94070510 2023-12-05T09:58:08.527 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:08.530+0000 7f0a98a94700 1 --2- 172.21.15.100:0/890096743 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7f0a80038760 0x7f0a8003ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:58:08.528 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:08.531+0000 7f0a98a94700 1 --2- 172.21.15.100:0/890096743 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7f0a80038760 0x7f0a8003ac10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0a84009fd0 tx=0x7f0a8400b040 comp rx=0 tx=0).ready entity=mgr.24533 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:58:08.533 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:08.536+0000 7f0a89ffb700 1 -- 172.21.15.100:0/890096743 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f0a9007fce0 con 0x7f0a94070510 2023-12-05T09:58:08.891 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:08.894+0000 7f0a9b4f9700 1 -- 172.21.15.100:0/890096743 --> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0a941114c0 con 0x7f0a80038760 2023-12-05T09:58:08.902 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:08.905+0000 7f0a89ffb700 1 -- 172.21.15.100:0/890096743 <== mgr.24533 v2:172.21.15.100:6800/3060005571 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f0a941114c0 con 0x7f0a80038760 2023-12-05T09:58:08.905 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:08.907+0000 7f0a9b4f9700 1 -- 172.21.15.100:0/890096743 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7f0a80038760 msgr2=0x7f0a8003ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:58:08.905 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:08.907+0000 7f0a9b4f9700 1 --2- 172.21.15.100:0/890096743 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7f0a80038760 0x7f0a8003ac10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0a84009fd0 tx=0x7f0a8400b040 comp rx=0 tx=0).stop 2023-12-05T09:58:08.905 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:08.907+0000 7f0a9b4f9700 1 -- 172.21.15.100:0/890096743 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a94070510 msgr2=0x7f0a9410f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:58:08.905 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:08.907+0000 7f0a9b4f9700 1 --2- 172.21.15.100:0/890096743 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a94070510 0x7f0a9410f790 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0a90009fd0 tx=0x7f0a90009e30 comp rx=0 tx=0).stop 2023-12-05T09:58:08.906 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:08.907+0000 7f0a9b4f9700 1 -- 172.21.15.100:0/890096743 shutdown_connections 2023-12-05T09:58:08.906 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:08.907+0000 7f0a9b4f9700 1 --2- 172.21.15.100:0/890096743 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7f0a80038760 0x7f0a8003ac10 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:08.906 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:08.907+0000 7f0a9b4f9700 1 --2- 172.21.15.100:0/890096743 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a94070510 0x7f0a9410f790 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:08.906 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:08.907+0000 7f0a9b4f9700 1 --2- 172.21.15.100:0/890096743 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a94071b60 0x7f0a9410fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:08.906 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:08.907+0000 7f0a9b4f9700 1 -- 172.21.15.100:0/890096743 >> 172.21.15.100:0/890096743 conn(0x7f0a940f82d0 msgr2=0x7f0a940fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:58:08.906 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:08.908+0000 7f0a9b4f9700 1 -- 172.21.15.100:0/890096743 shutdown_connections 2023-12-05T09:58:08.906 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:08.908+0000 7f0a9b4f9700 1 -- 172.21.15.100:0/890096743 wait complete. 2023-12-05T09:58:08.923 INFO:teuthology.orchestra.run.smithi100.stdout:true 2023-12-05T09:58:09.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:08 smithi150 ceph-mon[116142]: pgmap v6: 65 pgs: 65 active+clean; 1.8 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail 2023-12-05T09:58:09.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:08 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:58:09.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:08 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:58:09.107 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.110+0000 7fefe687e700 1 -- 172.21.15.100:0/3538151339 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fefe00fcbf0 msgr2=0x7fefe00fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:58:09.108 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.110+0000 7fefe687e700 1 --2- 172.21.15.100:0/3538151339 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fefe00fcbf0 0x7fefe00fd000 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fefd0004940 tx=0x7fefd0009e30 comp rx=0 tx=0).stop 2023-12-05T09:58:09.108 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.110+0000 7fefe687e700 1 -- 172.21.15.100:0/3538151339 shutdown_connections 2023-12-05T09:58:09.108 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.110+0000 7fefe687e700 1 --2- 172.21.15.100:0/3538151339 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fefe00fde00 0x7fefe00fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:09.108 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.110+0000 7fefe687e700 1 --2- 172.21.15.100:0/3538151339 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fefe00fcbf0 0x7fefe00fd000 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:09.108 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.110+0000 7fefe687e700 1 -- 172.21.15.100:0/3538151339 >> 172.21.15.100:0/3538151339 conn(0x7fefe00f82d0 msgr2=0x7fefe00fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:58:09.108 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.111+0000 7fefe687e700 1 -- 172.21.15.100:0/3538151339 shutdown_connections 2023-12-05T09:58:09.109 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.111+0000 7fefe687e700 1 -- 172.21.15.100:0/3538151339 wait complete. 2023-12-05T09:58:09.109 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.112+0000 7fefe687e700 1 Processor -- start 2023-12-05T09:58:09.109 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.112+0000 7fefe687e700 1 -- start start 2023-12-05T09:58:09.109 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.112+0000 7fefe687e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fefe00fcbf0 0x7fefe010b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:58:09.110 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.112+0000 7fefe687e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fefe00fde00 0x7fefe010b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:58:09.110 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.112+0000 7fefe687e700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe010bdf0 con 0x7fefe00fcbf0 2023-12-05T09:58:09.110 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.112+0000 7fefe687e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe010c690 con 0x7fefe00fde00 2023-12-05T09:58:09.110 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.113+0000 7fefdf7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fefe00fde00 0x7fefe010b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:58:09.110 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.113+0000 7fefdf7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fefe00fde00 0x7fefe010b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.100:39582/0 (socket says 172.21.15.100:39582) 2023-12-05T09:58:09.110 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.113+0000 7fefdf7fe700 1 -- 172.21.15.100:0/3033576994 learned_addr learned my addr 172.21.15.100:0/3033576994 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:58:09.110 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.113+0000 7fefdf7fe700 1 -- 172.21.15.100:0/3033576994 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fefe00fcbf0 msgr2=0x7fefe010b260 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-05T09:58:09.112 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.113+0000 7fefdf7fe700 1 --2- 172.21.15.100:0/3033576994 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fefe00fcbf0 0x7fefe010b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:09.112 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.113+0000 7fefdf7fe700 1 -- 172.21.15.100:0/3033576994 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd0005040 con 0x7fefe00fde00 2023-12-05T09:58:09.112 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.114+0000 7fefdf7fe700 1 --2- 172.21.15.100:0/3033576994 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fefe00fde00 0x7fefe010b7a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fefd400eb40 tx=0x7fefd400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:58:09.113 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.114+0000 7fefdcff9700 1 -- 172.21.15.100:0/3033576994 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fefd4007cc0 con 0x7fefe00fde00 2023-12-05T09:58:09.113 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.114+0000 7fefe687e700 1 -- 172.21.15.100:0/3033576994 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefe010c910 con 0x7fefe00fde00 2023-12-05T09:58:09.113 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.114+0000 7fefe687e700 1 -- 172.21.15.100:0/3033576994 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefe010ce50 con 0x7fefe00fde00 2023-12-05T09:58:09.113 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.115+0000 7fefdcff9700 1 -- 172.21.15.100:0/3033576994 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fefd400f040 con 0x7fefe00fde00 2023-12-05T09:58:09.113 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.116+0000 7fefdcff9700 1 -- 172.21.15.100:0/3033576994 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fefd4009570 con 0x7fefe00fde00 2023-12-05T09:58:09.113 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.116+0000 7fefe687e700 1 -- 172.21.15.100:0/3033576994 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefcc0052e0 con 0x7fefe00fde00 2023-12-05T09:58:09.114 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.116+0000 7fefdcff9700 1 -- 172.21.15.100:0/3033576994 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 30) v1 ==== 45729+0+0 (secure 0 0 0) 0x7fefd40097e0 con 0x7fefe00fde00 2023-12-05T09:58:09.114 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.117+0000 7fefdcff9700 1 --2- 172.21.15.100:0/3033576994 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7fefc8038770 0x7fefc803ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:58:09.115 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.117+0000 7fefdcff9700 1 -- 172.21.15.100:0/3033576994 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fefd401b4a0 con 0x7fefe00fde00 2023-12-05T09:58:09.115 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.117+0000 7fefdffff700 1 --2- 172.21.15.100:0/3033576994 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7fefc8038770 0x7fefc803ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:58:09.115 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.118+0000 7fefdffff700 1 --2- 172.21.15.100:0/3033576994 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7fefc8038770 0x7fefc803ac20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fefd0009fd0 tx=0x7fefd0009e30 comp rx=0 tx=0).ready entity=mgr.24533 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:58:09.120 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.122+0000 7fefdcff9700 1 -- 172.21.15.100:0/3033576994 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fefd401d550 con 0x7fefe00fde00 2023-12-05T09:58:09.149 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:08 smithi100 ceph-mon[107145]: pgmap v6: 65 pgs: 65 active+clean; 1.8 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail 2023-12-05T09:58:09.149 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:08 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:58:09.149 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:08 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:58:09.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.528+0000 7fefe687e700 1 -- 172.21.15.100:0/3033576994 --> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fefcc000bf0 con 0x7fefc8038770 2023-12-05T09:58:09.527 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.530+0000 7fefdcff9700 1 -- 172.21.15.100:0/3033576994 <== mgr.24533 v2:172.21.15.100:6800/3060005571 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7fefcc000bf0 con 0x7fefc8038770 2023-12-05T09:58:09.530 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.532+0000 7fefe687e700 1 -- 172.21.15.100:0/3033576994 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7fefc8038770 msgr2=0x7fefc803ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:58:09.530 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.532+0000 7fefe687e700 1 --2- 172.21.15.100:0/3033576994 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7fefc8038770 0x7fefc803ac20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fefd0009fd0 tx=0x7fefd0009e30 comp rx=0 tx=0).stop 2023-12-05T09:58:09.530 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.532+0000 7fefe687e700 1 -- 172.21.15.100:0/3033576994 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fefe00fde00 msgr2=0x7fefe010b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:58:09.530 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.532+0000 7fefe687e700 1 --2- 172.21.15.100:0/3033576994 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fefe00fde00 0x7fefe010b7a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fefd400eb40 tx=0x7fefd400b040 comp rx=0 tx=0).stop 2023-12-05T09:58:09.530 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.533+0000 7fefe687e700 1 -- 172.21.15.100:0/3033576994 shutdown_connections 2023-12-05T09:58:09.530 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.533+0000 7fefe687e700 1 --2- 172.21.15.100:0/3033576994 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7fefc8038770 0x7fefc803ac20 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:09.530 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.533+0000 7fefe687e700 1 --2- 172.21.15.100:0/3033576994 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fefe00fcbf0 0x7fefe010b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:09.531 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.533+0000 7fefe687e700 1 --2- 172.21.15.100:0/3033576994 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fefe00fde00 0x7fefe010b7a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:09.531 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.533+0000 7fefe687e700 1 -- 172.21.15.100:0/3033576994 >> 172.21.15.100:0/3033576994 conn(0x7fefe00f82d0 msgr2=0x7fefe00ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:58:09.531 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.533+0000 7fefe687e700 1 -- 172.21.15.100:0/3033576994 shutdown_connections 2023-12-05T09:58:09.531 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.533+0000 7fefe687e700 1 -- 172.21.15.100:0/3033576994 wait complete. 2023-12-05T09:58:09.710 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.712+0000 7f3d2e97b700 1 -- 172.21.15.100:0/4202419984 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d28072540 msgr2=0x7f3d28072950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:58:09.710 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.712+0000 7f3d2e97b700 1 --2- 172.21.15.100:0/4202419984 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d28072540 0x7f3d28072950 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f3d18004940 tx=0x7f3d18009e30 comp rx=0 tx=0).stop 2023-12-05T09:58:09.711 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.712+0000 7f3d2e97b700 1 -- 172.21.15.100:0/4202419984 shutdown_connections 2023-12-05T09:58:09.711 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.712+0000 7f3d2e97b700 1 --2- 172.21.15.100:0/4202419984 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d280737a0 0x7f3d28073c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:09.711 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.712+0000 7f3d2e97b700 1 --2- 172.21.15.100:0/4202419984 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d28072540 0x7f3d28072950 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:09.711 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.712+0000 7f3d2e97b700 1 -- 172.21.15.100:0/4202419984 >> 172.21.15.100:0/4202419984 conn(0x7f3d280fa5d0 msgr2=0x7f3d280fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:58:09.711 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.712+0000 7f3d2e97b700 1 -- 172.21.15.100:0/4202419984 shutdown_connections 2023-12-05T09:58:09.711 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.712+0000 7f3d2e97b700 1 -- 172.21.15.100:0/4202419984 wait complete. 2023-12-05T09:58:09.712 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.713+0000 7f3d2e97b700 1 Processor -- start 2023-12-05T09:58:09.712 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.713+0000 7f3d2e97b700 1 -- start start 2023-12-05T09:58:09.712 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.714+0000 7f3d2e97b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d28072540 0x7f3d28113af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:58:09.713 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.714+0000 7f3d2e97b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d280737a0 0x7f3d28114030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:58:09.713 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.714+0000 7f3d2e97b700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d28114630 con 0x7f3d280737a0 2023-12-05T09:58:09.713 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.714+0000 7f3d2e97b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d28114ed0 con 0x7f3d28072540 2023-12-05T09:58:09.713 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.714+0000 7f3d277fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d280737a0 0x7f3d28114030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:58:09.713 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.714+0000 7f3d27fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d28072540 0x7f3d28113af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:58:09.713 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.714+0000 7f3d277fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d280737a0 0x7f3d28114030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36496/0 (socket says 172.21.15.100:36496) 2023-12-05T09:58:09.713 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.714+0000 7f3d277fe700 1 -- 172.21.15.100:0/1594185381 learned_addr learned my addr 172.21.15.100:0/1594185381 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:58:09.713 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.715+0000 7f3d27fff700 1 -- 172.21.15.100:0/1594185381 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d280737a0 msgr2=0x7f3d28114030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:58:09.714 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.715+0000 7f3d27fff700 1 --2- 172.21.15.100:0/1594185381 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d280737a0 0x7f3d28114030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:09.714 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.715+0000 7f3d27fff700 1 -- 172.21.15.100:0/1594185381 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d1c005040 con 0x7f3d28072540 2023-12-05T09:58:09.714 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.715+0000 7f3d277fe700 1 --2- 172.21.15.100:0/1594185381 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d280737a0 0x7f3d28114030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-05T09:58:09.714 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.716+0000 7f3d27fff700 1 --2- 172.21.15.100:0/1594185381 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d28072540 0x7f3d28113af0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3d18009fd0 tx=0x7f3d18009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:58:09.714 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.716+0000 7f3d24ff9700 1 -- 172.21.15.100:0/1594185381 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d1800e070 con 0x7f3d28072540 2023-12-05T09:58:09.714 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.716+0000 7f3d24ff9700 1 -- 172.21.15.100:0/1594185381 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3d1801c400 con 0x7f3d28072540 2023-12-05T09:58:09.714 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.716+0000 7f3d24ff9700 1 -- 172.21.15.100:0/1594185381 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d1800b650 con 0x7f3d28072540 2023-12-05T09:58:09.714 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.716+0000 7f3d2e97b700 1 -- 172.21.15.100:0/1594185381 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d18005040 con 0x7f3d28072540 2023-12-05T09:58:09.715 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.717+0000 7f3d2e97b700 1 -- 172.21.15.100:0/1594185381 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d28115450 con 0x7f3d28072540 2023-12-05T09:58:09.715 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.718+0000 7f3d24ff9700 1 -- 172.21.15.100:0/1594185381 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 30) v1 ==== 45729+0+0 (secure 0 0 0) 0x7f3d1801c570 con 0x7f3d28072540 2023-12-05T09:58:09.716 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.718+0000 7f3d2e97b700 1 -- 172.21.15.100:0/1594185381 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d2804bb80 con 0x7f3d28072540 2023-12-05T09:58:09.716 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.719+0000 7f3d24ff9700 1 --2- 172.21.15.100:0/1594185381 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7f3d10038770 0x7f3d1003ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:58:09.716 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.719+0000 7f3d24ff9700 1 -- 172.21.15.100:0/1594185381 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f3d1804d9a0 con 0x7f3d28072540 2023-12-05T09:58:09.717 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.719+0000 7f3d277fe700 1 --2- 172.21.15.100:0/1594185381 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7f3d10038770 0x7f3d1003ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:58:09.717 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.720+0000 7f3d277fe700 1 --2- 172.21.15.100:0/1594185381 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7f3d10038770 0x7f3d1003ac20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3d1c0044e0 tx=0x7f3d1c00b040 comp rx=0 tx=0).ready entity=mgr.24533 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:58:09.722 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:09.724+0000 7f3d24ff9700 1 -- 172.21.15.100:0/1594185381 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f3d1800b8c0 con 0x7f3d28072540 2023-12-05T09:58:10.095 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.097+0000 7f3d2e97b700 1 -- 172.21.15.100:0/1594185381 --> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3d28115090 con 0x7f3d10038770 2023-12-05T09:58:10.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:09 smithi150 ceph-mon[116142]: from='client.24559 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:58:10.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:09 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:58:10.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:09 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:58:10.115 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.117+0000 7f3d24ff9700 1 -- 172.21.15.100:0/1594185381 <== mgr.24533 v2:172.21.15.100:6800/3060005571 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f3d28115090 con 0x7f3d10038770 2023-12-05T09:58:10.117 INFO:teuthology.orchestra.run.smithi100.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-05T09:58:10.117 INFO:teuthology.orchestra.run.smithi100.stdout:alertmanager.smithi100 smithi100 *:9093,9094 running (52s) 2s ago 8m 15.8M - 0.25.0 c8568f914cd2 f443e6a4242b 2023-12-05T09:58:10.117 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi100 smithi100 running (8m) 2s ago 8m 7822k - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 6379a3185d48 2023-12-05T09:58:10.117 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi150 smithi150 running (7m) 4s ago 7m 7826k - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 349d37092dbd 2023-12-05T09:58:10.117 INFO:teuthology.orchestra.run.smithi100.stdout:grafana.smithi100 smithi100 *:3000 running (43s) 2s ago 7m 79.4M - 9.4.7 2c41d148cca3 d666da9c4e4d 2023-12-05T09:58:10.117 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.akmstb smithi100 running (3m) 2s ago 3m 5824M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 6ce55c42c55b 2023-12-05T09:58:10.118 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.sqplhn smithi100 running (3m) 2s ago 3m 13.9M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc c2682d65f0c9 2023-12-05T09:58:10.118 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi150.fcnhsv smithi150 running (3m) 4s ago 3m 13.6M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 1a259762235d 2023-12-05T09:58:10.118 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi150.pcbpxm smithi150 running (3m) 4s ago 3m 13.6M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 27f730f8b9f9 2023-12-05T09:58:10.118 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi100.ehmuhg smithi100 *:8443,9283,8765 running (20s) 2s ago 9m 480M - 19.0.0-11-g3fe8d441 56dea28e5206 ebe3dfbb0356 2023-12-05T09:58:10.118 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi150.zkskag smithi150 *:8443,9283 running (107s) 4s ago 7m 124M - 19.0.0-11-g3fe8d441 56dea28e5206 154eb1df84c7 2023-12-05T09:58:10.118 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi100 smithi100 running (9m) 2s ago 9m 89.6M 2048M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 8e091d6081cc 2023-12-05T09:58:10.118 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi150 smithi150 running (7m) 4s ago 7m 59.4M 2048M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 05fe70420b09 2023-12-05T09:58:10.118 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi100 smithi100 *:9100 running (60s) 2s ago 8m 8388k - 1.5.0 0da6a335fe13 a2653da0d840 2023-12-05T09:58:10.118 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi150 smithi150 *:9100 running (30s) 4s ago 7m 8396k - 1.5.0 0da6a335fe13 67523645e73b 2023-12-05T09:58:10.118 INFO:teuthology.orchestra.run.smithi100.stdout:osd.0 smithi100 running (6m) 2s ago 6m 524M 1618M 17.2.7-109-g1fd3ca3c e139fc5fd9fc c8e64a62cd47 2023-12-05T09:58:10.118 INFO:teuthology.orchestra.run.smithi100.stdout:osd.1 smithi100 running (6m) 2s ago 6m 587M 1618M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 0500895cdfc2 2023-12-05T09:58:10.118 INFO:teuthology.orchestra.run.smithi100.stdout:osd.2 smithi100 running (5m) 2s ago 5m 439M 1618M 17.2.7-109-g1fd3ca3c e139fc5fd9fc f145372c8ccc 2023-12-05T09:58:10.118 INFO:teuthology.orchestra.run.smithi100.stdout:osd.3 smithi150 running (5m) 4s ago 5m 644M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 78137d463d29 2023-12-05T09:58:10.118 INFO:teuthology.orchestra.run.smithi100.stdout:osd.4 smithi150 running (5m) 4s ago 5m 492M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc dfef9accd162 2023-12-05T09:58:10.118 INFO:teuthology.orchestra.run.smithi100.stdout:osd.5 smithi150 running (4m) 4s ago 4m 567M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc d9720b1eae0c 2023-12-05T09:58:10.119 INFO:teuthology.orchestra.run.smithi100.stdout:prometheus.smithi100 smithi100 *:9095 running (34s) 2s ago 7m 39.4M - 2.43.0 a07b618ecd1d 8b15b23fe11d 2023-12-05T09:58:10.119 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.120+0000 7f3d2e97b700 1 -- 172.21.15.100:0/1594185381 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7f3d10038770 msgr2=0x7f3d1003ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:58:10.119 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.120+0000 7f3d2e97b700 1 --2- 172.21.15.100:0/1594185381 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7f3d10038770 0x7f3d1003ac20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3d1c0044e0 tx=0x7f3d1c00b040 comp rx=0 tx=0).stop 2023-12-05T09:58:10.119 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.120+0000 7f3d2e97b700 1 -- 172.21.15.100:0/1594185381 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d28072540 msgr2=0x7f3d28113af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:58:10.120 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.120+0000 7f3d2e97b700 1 --2- 172.21.15.100:0/1594185381 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d28072540 0x7f3d28113af0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3d18009fd0 tx=0x7f3d18009e30 comp rx=0 tx=0).stop 2023-12-05T09:58:10.120 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.120+0000 7f3d2e97b700 1 -- 172.21.15.100:0/1594185381 shutdown_connections 2023-12-05T09:58:10.120 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.120+0000 7f3d2e97b700 1 --2- 172.21.15.100:0/1594185381 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7f3d10038770 0x7f3d1003ac20 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:10.120 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.120+0000 7f3d2e97b700 1 --2- 172.21.15.100:0/1594185381 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d28072540 0x7f3d28113af0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:10.120 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.120+0000 7f3d2e97b700 1 --2- 172.21.15.100:0/1594185381 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d280737a0 0x7f3d28114030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:10.120 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.120+0000 7f3d2e97b700 1 -- 172.21.15.100:0/1594185381 >> 172.21.15.100:0/1594185381 conn(0x7f3d280fa5d0 msgr2=0x7f3d28109110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:58:10.120 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.120+0000 7f3d2e97b700 1 -- 172.21.15.100:0/1594185381 shutdown_connections 2023-12-05T09:58:10.120 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.120+0000 7f3d2e97b700 1 -- 172.21.15.100:0/1594185381 wait complete. 2023-12-05T09:58:10.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:09 smithi100 ceph-mon[107145]: from='client.24559 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:58:10.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:09 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:58:10.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:09 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:58:10.305 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.307+0000 7f1966bf7700 1 -- 172.21.15.100:0/4158006813 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f196006e210 msgr2=0x7f196006e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:58:10.305 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.307+0000 7f1966bf7700 1 --2- 172.21.15.100:0/4158006813 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f196006e210 0x7f196006e620 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1954004940 tx=0x7f1954009e30 comp rx=0 tx=0).stop 2023-12-05T09:58:10.310 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.310+0000 7f1966bf7700 1 -- 172.21.15.100:0/4158006813 shutdown_connections 2023-12-05T09:58:10.310 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.310+0000 7f1966bf7700 1 --2- 172.21.15.100:0/4158006813 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f196006eb60 0x7f1960108c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:10.310 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.310+0000 7f1966bf7700 1 --2- 172.21.15.100:0/4158006813 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f196006e210 0x7f196006e620 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:10.310 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.310+0000 7f1966bf7700 1 -- 172.21.15.100:0/4158006813 >> 172.21.15.100:0/4158006813 conn(0x7f1960069b20 msgr2=0x7f196006bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:58:10.310 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.311+0000 7f1966bf7700 1 -- 172.21.15.100:0/4158006813 shutdown_connections 2023-12-05T09:58:10.310 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.311+0000 7f1966bf7700 1 -- 172.21.15.100:0/4158006813 wait complete. 2023-12-05T09:58:10.310 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.312+0000 7f1966bf7700 1 Processor -- start 2023-12-05T09:58:10.311 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.314+0000 7f1966bf7700 1 -- start start 2023-12-05T09:58:10.311 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.314+0000 7f1966bf7700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f196006e210 0x7f196011c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:58:10.313 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.314+0000 7f1966bf7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f196006eb60 0x7f196011c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:58:10.313 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.314+0000 7f1966bf7700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f196011ce50 con 0x7f196006e210 2023-12-05T09:58:10.313 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.314+0000 7f1966bf7700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f196011d6f0 con 0x7f196006eb60 2023-12-05T09:58:10.313 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.315+0000 7f1964993700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f196006e210 0x7f196011c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:58:10.313 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.315+0000 7f1964993700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f196006e210 0x7f196011c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36506/0 (socket says 172.21.15.100:36506) 2023-12-05T09:58:10.313 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.315+0000 7f1964993700 1 -- 172.21.15.100:0/654309063 learned_addr learned my addr 172.21.15.100:0/654309063 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:58:10.313 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.315+0000 7f195ffff700 1 --2- 172.21.15.100:0/654309063 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f196006eb60 0x7f196011c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:58:10.314 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.316+0000 7f195ffff700 1 -- 172.21.15.100:0/654309063 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f196006e210 msgr2=0x7f196011c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:58:10.314 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.316+0000 7f195ffff700 1 --2- 172.21.15.100:0/654309063 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f196006e210 0x7f196011c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:10.314 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.316+0000 7f195ffff700 1 -- 172.21.15.100:0/654309063 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1954005040 con 0x7f196006eb60 2023-12-05T09:58:10.315 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.318+0000 7f195ffff700 1 --2- 172.21.15.100:0/654309063 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f196006eb60 0x7f196011c850 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f196006f690 tx=0x7f194c00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:58:10.318 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.321+0000 7f195d7fa700 1 -- 172.21.15.100:0/654309063 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f194c004e90 con 0x7f196006eb60 2023-12-05T09:58:10.319 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.321+0000 7f195d7fa700 1 -- 172.21.15.100:0/654309063 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f194c00f040 con 0x7f196006eb60 2023-12-05T09:58:10.319 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.321+0000 7f195d7fa700 1 -- 172.21.15.100:0/654309063 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f194c00c850 con 0x7f196006eb60 2023-12-05T09:58:10.319 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.321+0000 7f1966bf7700 1 -- 172.21.15.100:0/654309063 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f196011d970 con 0x7f196006eb60 2023-12-05T09:58:10.319 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.321+0000 7f1966bf7700 1 -- 172.21.15.100:0/654309063 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f196011deb0 con 0x7f196006eb60 2023-12-05T09:58:10.321 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.323+0000 7f1966bf7700 1 -- 172.21.15.100:0/654309063 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1960116400 con 0x7f196006eb60 2023-12-05T09:58:10.321 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.323+0000 7f195d7fa700 1 -- 172.21.15.100:0/654309063 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 30) v1 ==== 45729+0+0 (secure 0 0 0) 0x7f194c007cc0 con 0x7f196006eb60 2023-12-05T09:58:10.321 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.323+0000 7f195d7fa700 1 --2- 172.21.15.100:0/654309063 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7f1950038850 0x7f195003ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:58:10.321 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.324+0000 7f195d7fa700 1 -- 172.21.15.100:0/654309063 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f194c04bd70 con 0x7f196006eb60 2023-12-05T09:58:10.322 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.325+0000 7f1964993700 1 --2- 172.21.15.100:0/654309063 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7f1950038850 0x7f195003ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:58:10.324 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.326+0000 7f1964993700 1 --2- 172.21.15.100:0/654309063 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7f1950038850 0x7f195003ad00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f195400b0d0 tx=0x7f1954009e30 comp rx=0 tx=0).ready entity=mgr.24533 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:58:10.332 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.334+0000 7f195d7fa700 1 -- 172.21.15.100:0/654309063 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f194c050070 con 0x7f196006eb60 2023-12-05T09:58:10.734 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.736+0000 7f1966bf7700 1 -- 172.21.15.100:0/654309063 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f196004bb80 con 0x7f196006eb60 2023-12-05T09:58:10.734 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.737+0000 7f195d7fa700 1 -- 172.21.15.100:0/654309063 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+733 (secure 0 0 0) 0x7f194c0192f0 con 0x7f196006eb60 2023-12-05T09:58:10.735 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2023-12-05T09:58:10.735 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": { 2023-12-05T09:58:10.735 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 2 2023-12-05T09:58:10.735 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-12-05T09:58:10.735 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": { 2023-12-05T09:58:10.735 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 1 2023-12-05T09:58:10.735 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-12-05T09:58:10.735 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": { 2023-12-05T09:58:10.735 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 6 2023-12-05T09:58:10.735 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-12-05T09:58:10.735 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": { 2023-12-05T09:58:10.735 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 4 2023-12-05T09:58:10.736 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-12-05T09:58:10.736 INFO:teuthology.orchestra.run.smithi100.stdout: "overall": { 2023-12-05T09:58:10.736 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 12, 2023-12-05T09:58:10.736 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 1 2023-12-05T09:58:10.736 INFO:teuthology.orchestra.run.smithi100.stdout: } 2023-12-05T09:58:10.736 INFO:teuthology.orchestra.run.smithi100.stdout:} 2023-12-05T09:58:10.737 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.739+0000 7f1966bf7700 1 -- 172.21.15.100:0/654309063 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7f1950038850 msgr2=0x7f195003ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:58:10.737 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.739+0000 7f1966bf7700 1 --2- 172.21.15.100:0/654309063 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7f1950038850 0x7f195003ad00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f195400b0d0 tx=0x7f1954009e30 comp rx=0 tx=0).stop 2023-12-05T09:58:10.737 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.739+0000 7f1966bf7700 1 -- 172.21.15.100:0/654309063 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f196006eb60 msgr2=0x7f196011c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:58:10.737 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.739+0000 7f1966bf7700 1 --2- 172.21.15.100:0/654309063 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f196006eb60 0x7f196011c850 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f196006f690 tx=0x7f194c00b040 comp rx=0 tx=0).stop 2023-12-05T09:58:10.738 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.740+0000 7f1966bf7700 1 -- 172.21.15.100:0/654309063 shutdown_connections 2023-12-05T09:58:10.738 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.740+0000 7f1966bf7700 1 --2- 172.21.15.100:0/654309063 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7f1950038850 0x7f195003ad00 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:10.738 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.740+0000 7f1966bf7700 1 --2- 172.21.15.100:0/654309063 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f196006e210 0x7f196011c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:10.738 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.740+0000 7f1966bf7700 1 --2- 172.21.15.100:0/654309063 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f196006eb60 0x7f196011c850 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:10.739 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.740+0000 7f1966bf7700 1 -- 172.21.15.100:0/654309063 >> 172.21.15.100:0/654309063 conn(0x7f1960069b20 msgr2=0x7f19601074e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:58:10.739 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.740+0000 7f1966bf7700 1 -- 172.21.15.100:0/654309063 shutdown_connections 2023-12-05T09:58:10.739 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.740+0000 7f1966bf7700 1 -- 172.21.15.100:0/654309063 wait complete. 2023-12-05T09:58:10.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:10 smithi100 ceph-mon[107145]: from='client.24563 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:58:10.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:10 smithi100 ceph-mon[107145]: pgmap v7: 65 pgs: 65 active+clean; 746 MiB data, 4.5 GiB used, 532 GiB / 536 GiB avail; 50 KiB/s rd, 1.0 MiB/s wr, 140 op/s 2023-12-05T09:58:10.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:10 smithi100 ceph-mon[107145]: from='client.24567 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:58:10.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:10 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/654309063' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:58:10.918 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.920+0000 7f0f1263e700 1 -- 172.21.15.100:0/2292174653 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f0c0ffd70 msgr2=0x7f0f0c1021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:58:10.918 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.920+0000 7f0f1263e700 1 --2- 172.21.15.100:0/2292174653 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f0c0ffd70 0x7f0f0c1021d0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f0efc004940 tx=0x7f0efc009e30 comp rx=0 tx=0).stop 2023-12-05T09:58:10.918 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.920+0000 7f0f1263e700 1 -- 172.21.15.100:0/2292174653 shutdown_connections 2023-12-05T09:58:10.918 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.920+0000 7f0f1263e700 1 --2- 172.21.15.100:0/2292174653 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f0c0ffd70 0x7f0f0c1021d0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:10.918 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.920+0000 7f0f1263e700 1 --2- 172.21.15.100:0/2292174653 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f0c066090 0x7f0f0c0ff7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:10.918 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.920+0000 7f0f1263e700 1 -- 172.21.15.100:0/2292174653 >> 172.21.15.100:0/2292174653 conn(0x7f0f0c0f7190 msgr2=0x7f0f0c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:58:10.918 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.920+0000 7f0f1263e700 1 -- 172.21.15.100:0/2292174653 shutdown_connections 2023-12-05T09:58:10.918 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.920+0000 7f0f1263e700 1 -- 172.21.15.100:0/2292174653 wait complete. 2023-12-05T09:58:10.919 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.921+0000 7f0f1263e700 1 Processor -- start 2023-12-05T09:58:10.919 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.921+0000 7f0f1263e700 1 -- start start 2023-12-05T09:58:10.919 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.922+0000 7f0f1263e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f0c066090 0x7f0f0c06ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:58:10.920 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.922+0000 7f0f1263e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f0c0ffd70 0x7f0f0c06f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:58:10.920 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.922+0000 7f0f1263e700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0c06f850 con 0x7f0f0c066090 2023-12-05T09:58:10.920 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.922+0000 7f0f1263e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0c117050 con 0x7f0f0c0ffd70 2023-12-05T09:58:10.920 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.922+0000 7f0f0bfff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f0c066090 0x7f0f0c06ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:58:10.921 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.922+0000 7f0f0bfff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f0c066090 0x7f0f0c06ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36526/0 (socket says 172.21.15.100:36526) 2023-12-05T09:58:10.921 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.922+0000 7f0f0bfff700 1 -- 172.21.15.100:0/3642439022 learned_addr learned my addr 172.21.15.100:0/3642439022 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:58:10.921 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.922+0000 7f0f0b7fe700 1 --2- 172.21.15.100:0/3642439022 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f0c0ffd70 0x7f0f0c06f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:58:10.921 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.923+0000 7f0f0bfff700 1 -- 172.21.15.100:0/3642439022 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f0c0ffd70 msgr2=0x7f0f0c06f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:58:10.921 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.923+0000 7f0f0bfff700 1 --2- 172.21.15.100:0/3642439022 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f0c0ffd70 0x7f0f0c06f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:10.921 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.923+0000 7f0f0bfff700 1 -- 172.21.15.100:0/3642439022 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ef4005040 con 0x7f0f0c066090 2023-12-05T09:58:10.921 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.923+0000 7f0f0bfff700 1 --2- 172.21.15.100:0/3642439022 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f0c066090 0x7f0f0c06ed10 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f0ef40096d0 tx=0x7f0ef4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:58:10.921 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.923+0000 7f0f08ff9700 1 -- 172.21.15.100:0/3642439022 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ef400e840 con 0x7f0f0c066090 2023-12-05T09:58:10.921 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.923+0000 7f0f08ff9700 1 -- 172.21.15.100:0/3642439022 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0ef400f040 con 0x7f0f0c066090 2023-12-05T09:58:10.921 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.923+0000 7f0f1263e700 1 -- 172.21.15.100:0/3642439022 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0efc005040 con 0x7f0f0c066090 2023-12-05T09:58:10.921 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.923+0000 7f0f08ff9700 1 -- 172.21.15.100:0/3642439022 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ef4013d30 con 0x7f0f0c066090 2023-12-05T09:58:10.922 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.924+0000 7f0f1263e700 1 -- 172.21.15.100:0/3642439022 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f0c117650 con 0x7f0f0c066090 2023-12-05T09:58:10.928 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.925+0000 7f0f1263e700 1 -- 172.21.15.100:0/3642439022 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0eec0052e0 con 0x7f0f0c066090 2023-12-05T09:58:10.928 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.925+0000 7f0f08ff9700 1 -- 172.21.15.100:0/3642439022 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 30) v1 ==== 45729+0+0 (secure 0 0 0) 0x7f0ef400e9a0 con 0x7f0f0c066090 2023-12-05T09:58:10.928 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.926+0000 7f0f08ff9700 1 --2- 172.21.15.100:0/3642439022 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7f0ef8038770 0x7f0ef803ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:58:10.928 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.927+0000 7f0f08ff9700 1 -- 172.21.15.100:0/3642439022 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f0ef4054420 con 0x7f0f0c066090 2023-12-05T09:58:10.928 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.927+0000 7f0f0b7fe700 1 --2- 172.21.15.100:0/3642439022 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7f0ef8038770 0x7f0ef803ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:58:10.928 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.928+0000 7f0f0b7fe700 1 --2- 172.21.15.100:0/3642439022 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7f0ef8038770 0x7f0ef803ac20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0efc00b0d0 tx=0x7f0efc009e30 comp rx=0 tx=0).ready entity=mgr.24533 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:58:10.933 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:10.935+0000 7f0f08ff9700 1 -- 172.21.15.100:0/3642439022 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f0ef4011e70 con 0x7f0f0c066090 2023-12-05T09:58:11.000 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:10 smithi150 ceph-mon[116142]: from='client.24563 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:58:11.001 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:10 smithi150 ceph-mon[116142]: pgmap v7: 65 pgs: 65 active+clean; 746 MiB data, 4.5 GiB used, 532 GiB / 536 GiB avail; 50 KiB/s rd, 1.0 MiB/s wr, 140 op/s 2023-12-05T09:58:11.001 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:10 smithi150 ceph-mon[116142]: from='client.24567 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:58:11.001 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:10 smithi150 ceph-mon[116142]: from='client.? 172.21.15.100:0/654309063' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:58:11.280 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:11.284+0000 7f0f1263e700 1 -- 172.21.15.100:0/3642439022 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0eec005860 con 0x7f0f0c066090 2023-12-05T09:58:11.281 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:11.284+0000 7f0f08ff9700 1 -- 172.21.15.100:0/3642439022 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1814 (secure 0 0 0) 0x7f0ef4011ab0 con 0x7f0f0c066090 2023-12-05T09:58:11.281 INFO:teuthology.orchestra.run.smithi100.stdout:e13 2023-12-05T09:58:11.281 INFO:teuthology.orchestra.run.smithi100.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-05T09:58:11.281 INFO:teuthology.orchestra.run.smithi100.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T09:58:11.281 INFO:teuthology.orchestra.run.smithi100.stdout:legacy client fscid: 1 2023-12-05T09:58:11.281 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:58:11.282 INFO:teuthology.orchestra.run.smithi100.stdout:Filesystem 'cephfs' (1) 2023-12-05T09:58:11.282 INFO:teuthology.orchestra.run.smithi100.stdout:fs_name cephfs 2023-12-05T09:58:11.282 INFO:teuthology.orchestra.run.smithi100.stdout:epoch 13 2023-12-05T09:58:11.282 INFO:teuthology.orchestra.run.smithi100.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-05T09:58:11.282 INFO:teuthology.orchestra.run.smithi100.stdout:created 2023-12-05T09:54:30.515778+0000 2023-12-05T09:58:11.282 INFO:teuthology.orchestra.run.smithi100.stdout:modified 2023-12-05T09:54:46.403009+0000 2023-12-05T09:58:11.282 INFO:teuthology.orchestra.run.smithi100.stdout:tableserver 0 2023-12-05T09:58:11.282 INFO:teuthology.orchestra.run.smithi100.stdout:root 0 2023-12-05T09:58:11.282 INFO:teuthology.orchestra.run.smithi100.stdout:session_timeout 60 2023-12-05T09:58:11.282 INFO:teuthology.orchestra.run.smithi100.stdout:session_autoclose 300 2023-12-05T09:58:11.282 INFO:teuthology.orchestra.run.smithi100.stdout:max_file_size 1099511627776 2023-12-05T09:58:11.282 INFO:teuthology.orchestra.run.smithi100.stdout:required_client_features {} 2023-12-05T09:58:11.282 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure 0 2023-12-05T09:58:11.283 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure_osd_epoch 46 2023-12-05T09:58:11.283 INFO:teuthology.orchestra.run.smithi100.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T09:58:11.283 INFO:teuthology.orchestra.run.smithi100.stdout:max_mds 1 2023-12-05T09:58:11.283 INFO:teuthology.orchestra.run.smithi100.stdout:in 0 2023-12-05T09:58:11.283 INFO:teuthology.orchestra.run.smithi100.stdout:up {0=14490} 2023-12-05T09:58:11.283 INFO:teuthology.orchestra.run.smithi100.stdout:failed 2023-12-05T09:58:11.283 INFO:teuthology.orchestra.run.smithi100.stdout:damaged 2023-12-05T09:58:11.283 INFO:teuthology.orchestra.run.smithi100.stdout:stopped 2023-12-05T09:58:11.283 INFO:teuthology.orchestra.run.smithi100.stdout:data_pools [3] 2023-12-05T09:58:11.283 INFO:teuthology.orchestra.run.smithi100.stdout:metadata_pool 2 2023-12-05T09:58:11.283 INFO:teuthology.orchestra.run.smithi100.stdout:inline_data disabled 2023-12-05T09:58:11.283 INFO:teuthology.orchestra.run.smithi100.stdout:balancer 2023-12-05T09:58:11.283 INFO:teuthology.orchestra.run.smithi100.stdout:standby_count_wanted 1 2023-12-05T09:58:11.283 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi100.akmstb{0:14490} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.100:6828/627555128,v1:172.21.15.100:6829/627555128] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:58:11.283 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:58:11.284 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:58:11.284 INFO:teuthology.orchestra.run.smithi100.stdout:Standby daemons: 2023-12-05T09:58:11.284 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:58:11.284 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi150.pcbpxm{-1:14486} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.150:6824/3645854543,v1:172.21.15.150:6825/3645854543] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:58:11.284 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi150.fcnhsv{-1:14498} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.150:6826/3249949736,v1:172.21.15.150:6827/3249949736] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:58:11.284 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi100.sqplhn{-1:14506} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.100:6826/2472212864,v1:172.21.15.100:6827/2472212864] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:58:11.284 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:11.287+0000 7f0f1263e700 1 -- 172.21.15.100:0/3642439022 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7f0ef8038770 msgr2=0x7f0ef803ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:58:11.285 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:11.287+0000 7f0f1263e700 1 --2- 172.21.15.100:0/3642439022 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7f0ef8038770 0x7f0ef803ac20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0efc00b0d0 tx=0x7f0efc009e30 comp rx=0 tx=0).stop 2023-12-05T09:58:11.285 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:11.287+0000 7f0f1263e700 1 -- 172.21.15.100:0/3642439022 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f0c066090 msgr2=0x7f0f0c06ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:58:11.285 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:11.287+0000 7f0f1263e700 1 --2- 172.21.15.100:0/3642439022 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f0c066090 0x7f0f0c06ed10 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f0ef40096d0 tx=0x7f0ef4009e30 comp rx=0 tx=0).stop 2023-12-05T09:58:11.285 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:11.288+0000 7f0f1263e700 1 -- 172.21.15.100:0/3642439022 shutdown_connections 2023-12-05T09:58:11.285 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:11.288+0000 7f0f1263e700 1 --2- 172.21.15.100:0/3642439022 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7f0ef8038770 0x7f0ef803ac20 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:11.285 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:11.288+0000 7f0f1263e700 1 --2- 172.21.15.100:0/3642439022 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f0c066090 0x7f0f0c06ed10 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:11.285 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:11.288+0000 7f0f1263e700 1 --2- 172.21.15.100:0/3642439022 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f0c0ffd70 0x7f0f0c06f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:11.285 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:11.288+0000 7f0f1263e700 1 -- 172.21.15.100:0/3642439022 >> 172.21.15.100:0/3642439022 conn(0x7f0f0c0f7190 msgr2=0x7f0f0c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:58:11.285 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:11.288+0000 7f0f1263e700 1 -- 172.21.15.100:0/3642439022 shutdown_connections 2023-12-05T09:58:11.285 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:11.288+0000 7f0f1263e700 1 -- 172.21.15.100:0/3642439022 wait complete. 2023-12-05T09:58:11.286 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 13 2023-12-05T09:58:11.516 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:11.519+0000 7efd00da8700 1 -- 172.21.15.100:0/1968808648 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efcfc070510 msgr2=0x7efcfc070980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:58:11.516 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:11.519+0000 7efd00da8700 1 --2- 172.21.15.100:0/1968808648 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efcfc070510 0x7efcfc070980 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7efce4004940 tx=0x7efce4009e30 comp rx=0 tx=0).stop 2023-12-05T09:58:11.516 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:11.520+0000 7efd00da8700 1 -- 172.21.15.100:0/1968808648 shutdown_connections 2023-12-05T09:58:11.517 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:11.520+0000 7efd00da8700 1 --2- 172.21.15.100:0/1968808648 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efcfc070510 0x7efcfc070980 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:11.517 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:11.520+0000 7efd00da8700 1 --2- 172.21.15.100:0/1968808648 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efcfc071b60 0x7efcfc06ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:11.517 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:11.520+0000 7efd00da8700 1 -- 172.21.15.100:0/1968808648 >> 172.21.15.100:0/1968808648 conn(0x7efcfc0f82d0 msgr2=0x7efcfc0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:58:11.517 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:11.520+0000 7efd00da8700 1 -- 172.21.15.100:0/1968808648 shutdown_connections 2023-12-05T09:58:11.517 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:11.520+0000 7efd00da8700 1 -- 172.21.15.100:0/1968808648 wait complete. 2023-12-05T09:58:11.517 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:11.521+0000 7efd00da8700 1 Processor -- start 2023-12-05T09:58:11.518 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:11.521+0000 7efd00da8700 1 -- start start 2023-12-05T09:58:11.518 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:11.521+0000 7efd00da8700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efcfc070510 0x7efcfc10f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:58:11.518 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:11.521+0000 7efd00da8700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efcfc071b60 0x7efcfc10fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:58:11.518 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:11.521+0000 7efd00da8700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcfc110300 con 0x7efcfc071b60 2023-12-05T09:58:11.518 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:11.521+0000 7efd00da8700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcfc110b40 con 0x7efcfc070510 2023-12-05T09:58:11.518 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:11.522+0000 7efcfa59c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efcfc070510 0x7efcfc10f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:58:11.519 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:11.522+0000 7efcfa59c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efcfc070510 0x7efcfc10f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.100:59502/0 (socket says 172.21.15.100:59502) 2023-12-05T09:58:11.519 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:11.522+0000 7efcfa59c700 1 -- 172.21.15.100:0/2173167263 learned_addr learned my addr 172.21.15.100:0/2173167263 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:58:11.519 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:11.522+0000 7efcfa59c700 1 -- 172.21.15.100:0/2173167263 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efcfc071b60 msgr2=0x7efcfc10fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:58:11.519 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:11.522+0000 7efcfa59c700 1 --2- 172.21.15.100:0/2173167263 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efcfc071b60 0x7efcfc10fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:11.519 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:11.522+0000 7efcfa59c700 1 -- 172.21.15.100:0/2173167263 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efce4005040 con 0x7efcfc070510 2023-12-05T09:58:11.520 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:11.522+0000 7efcfa59c700 1 --2- 172.21.15.100:0/2173167263 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efcfc070510 0x7efcfc10f730 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7efcf400bbb0 tx=0x7efcf4009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:58:11.521 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:11.523+0000 7efcf2ffd700 1 -- 172.21.15.100:0/2173167263 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efcf40092e0 con 0x7efcfc070510 2023-12-05T09:58:11.521 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:11.523+0000 7efcf2ffd700 1 -- 172.21.15.100:0/2173167263 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7efcf400cbb0 con 0x7efcfc070510 2023-12-05T09:58:11.521 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:11.523+0000 7efd00da8700 1 -- 172.21.15.100:0/2173167263 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcfc110e20 con 0x7efcfc070510 2023-12-05T09:58:11.521 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:11.523+0000 7efcf2ffd700 1 -- 172.21.15.100:0/2173167263 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efcf4015d70 con 0x7efcfc070510 2023-12-05T09:58:11.521 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:11.523+0000 7efd00da8700 1 -- 172.21.15.100:0/2173167263 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcfc111360 con 0x7efcfc070510 2023-12-05T09:58:11.521 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:11.524+0000 7efcf2ffd700 1 -- 172.21.15.100:0/2173167263 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 30) v1 ==== 45729+0+0 (secure 0 0 0) 0x7efcf4012070 con 0x7efcfc070510 2023-12-05T09:58:11.521 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:11.524+0000 7efd00da8700 1 -- 172.21.15.100:0/2173167263 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcfc04bb80 con 0x7efcfc070510 2023-12-05T09:58:11.522 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:11.524+0000 7efcf2ffd700 1 --2- 172.21.15.100:0/2173167263 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7efce80387b0 0x7efce803ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:58:11.522 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:11.525+0000 7efcf2ffd700 1 -- 172.21.15.100:0/2173167263 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6152+0+0 (secure 0 0 0) 0x7efcf404c340 con 0x7efcfc070510 2023-12-05T09:58:11.522 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:11.525+0000 7efcf9d9b700 1 --2- 172.21.15.100:0/2173167263 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7efce80387b0 0x7efce803ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:58:11.522 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:11.525+0000 7efcf9d9b700 1 --2- 172.21.15.100:0/2173167263 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7efce80387b0 0x7efce803ac60 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7efce4000c00 tx=0x7efce4009e30 comp rx=0 tx=0).ready entity=mgr.24533 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:58:11.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:11.530+0000 7efcf2ffd700 1 -- 172.21.15.100:0/2173167263 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7efcf4012910 con 0x7efcfc070510 2023-12-05T09:58:11.823 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:11.825+0000 7efcf2ffd700 1 -- 172.21.15.100:0/2173167263 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mgrmap(e 31) v1 ==== 90901+0+0 (secure 0 0 0) 0x7efcf400cd20 con 0x7efcfc070510 2023-12-05T09:58:11.835 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:11.838+0000 7efd00da8700 1 -- 172.21.15.100:0/2173167263 --> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efcfc104200 con 0x7efce80387b0 2023-12-05T09:58:11.836 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:11.840+0000 7efcf2ffd700 1 -- 172.21.15.100:0/2173167263 <== mgr.24533 v2:172.21.15.100:6800/3060005571 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7efcfc104200 con 0x7efce80387b0 2023-12-05T09:58:11.836 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2023-12-05T09:58:11.836 INFO:teuthology.orchestra.run.smithi100.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ff918c95653912ae4c171d8d1db5f5eabc756f85ff7e3ce78f13f9c521198459", 2023-12-05T09:58:11.836 INFO:teuthology.orchestra.run.smithi100.stdout: "in_progress": true, 2023-12-05T09:58:11.836 INFO:teuthology.orchestra.run.smithi100.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-05T09:58:11.836 INFO:teuthology.orchestra.run.smithi100.stdout: "services_complete": [ 2023-12-05T09:58:11.836 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr" 2023-12-05T09:58:11.836 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2023-12-05T09:58:11.837 INFO:teuthology.orchestra.run.smithi100.stdout: "progress": "2/21 daemons upgraded", 2023-12-05T09:58:11.837 INFO:teuthology.orchestra.run.smithi100.stdout: "message": "", 2023-12-05T09:58:11.837 INFO:teuthology.orchestra.run.smithi100.stdout: "is_paused": false 2023-12-05T09:58:11.837 INFO:teuthology.orchestra.run.smithi100.stdout:} 2023-12-05T09:58:11.840 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:11.843+0000 7efd00da8700 1 -- 172.21.15.100:0/2173167263 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7efce80387b0 msgr2=0x7efce803ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:58:11.840 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:11.843+0000 7efd00da8700 1 --2- 172.21.15.100:0/2173167263 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7efce80387b0 0x7efce803ac60 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7efce4000c00 tx=0x7efce4009e30 comp rx=0 tx=0).stop 2023-12-05T09:58:11.840 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:11.843+0000 7efd00da8700 1 -- 172.21.15.100:0/2173167263 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efcfc070510 msgr2=0x7efcfc10f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:58:11.840 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:11.843+0000 7efd00da8700 1 --2- 172.21.15.100:0/2173167263 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efcfc070510 0x7efcfc10f730 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7efcf400bbb0 tx=0x7efcf4009840 comp rx=0 tx=0).stop 2023-12-05T09:58:11.840 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:11.843+0000 7efd00da8700 1 -- 172.21.15.100:0/2173167263 shutdown_connections 2023-12-05T09:58:11.840 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:11.843+0000 7efd00da8700 1 --2- 172.21.15.100:0/2173167263 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7efce80387b0 0x7efce803ac60 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:11.840 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:11.843+0000 7efd00da8700 1 --2- 172.21.15.100:0/2173167263 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efcfc070510 0x7efcfc10f730 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:11.840 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:11.843+0000 7efd00da8700 1 --2- 172.21.15.100:0/2173167263 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efcfc071b60 0x7efcfc10fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:11.840 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:11.843+0000 7efd00da8700 1 -- 172.21.15.100:0/2173167263 >> 172.21.15.100:0/2173167263 conn(0x7efcfc0f82d0 msgr2=0x7efcfc102ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:58:11.840 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:11.843+0000 7efd00da8700 1 -- 172.21.15.100:0/2173167263 shutdown_connections 2023-12-05T09:58:11.841 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:11.844+0000 7efd00da8700 1 -- 172.21.15.100:0/2173167263 wait complete. 2023-12-05T09:58:12.014 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:12.017+0000 7fc55b298700 1 -- 172.21.15.100:0/1554985827 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5540fb8f0 msgr2=0x7fc5540fbd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:58:12.014 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:12.017+0000 7fc55b298700 1 --2- 172.21.15.100:0/1554985827 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5540fb8f0 0x7fc5540fbd00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc550004940 tx=0x7fc550009e30 comp rx=0 tx=0).stop 2023-12-05T09:58:12.014 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:12.017+0000 7fc55b298700 1 -- 172.21.15.100:0/1554985827 shutdown_connections 2023-12-05T09:58:12.014 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:12.017+0000 7fc55b298700 1 --2- 172.21.15.100:0/1554985827 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5540fcb00 0x7fc5540fcf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:12.015 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:12.017+0000 7fc55b298700 1 --2- 172.21.15.100:0/1554985827 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5540fb8f0 0x7fc5540fbd00 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:12.015 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:12.017+0000 7fc55b298700 1 -- 172.21.15.100:0/1554985827 >> 172.21.15.100:0/1554985827 conn(0x7fc5540f6f70 msgr2=0x7fc5540f93e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:58:12.015 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:12.018+0000 7fc55b298700 1 -- 172.21.15.100:0/1554985827 shutdown_connections 2023-12-05T09:58:12.015 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:12.018+0000 7fc55b298700 1 -- 172.21.15.100:0/1554985827 wait complete. 2023-12-05T09:58:12.015 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:12.019+0000 7fc55b298700 1 Processor -- start 2023-12-05T09:58:12.015 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:12.019+0000 7fc55b298700 1 -- start start 2023-12-05T09:58:12.016 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:12.019+0000 7fc55b298700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5540fb8f0 0x7fc5540ff9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:58:12.016 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:12.019+0000 7fc55b298700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5540fcb00 0x7fc5540fde40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:58:12.016 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:12.019+0000 7fc55b298700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5540fe440 con 0x7fc5540fcb00 2023-12-05T09:58:12.016 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:12.019+0000 7fc55b298700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5540fe5b0 con 0x7fc5540fb8f0 2023-12-05T09:58:12.017 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:12.020+0000 7fc55a296700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5540fb8f0 0x7fc5540ff9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:58:12.017 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:12.020+0000 7fc55a296700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5540fb8f0 0x7fc5540ff9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.100:59532/0 (socket says 172.21.15.100:59532) 2023-12-05T09:58:12.017 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:12.020+0000 7fc55a296700 1 -- 172.21.15.100:0/612920324 learned_addr learned my addr 172.21.15.100:0/612920324 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:58:12.017 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:12.020+0000 7fc559a95700 1 --2- 172.21.15.100:0/612920324 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5540fcb00 0x7fc5540fde40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:58:12.017 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:12.020+0000 7fc55a296700 1 -- 172.21.15.100:0/612920324 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5540fcb00 msgr2=0x7fc5540fde40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:58:12.017 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:12.020+0000 7fc55a296700 1 --2- 172.21.15.100:0/612920324 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5540fcb00 0x7fc5540fde40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:12.018 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:12.020+0000 7fc55a296700 1 -- 172.21.15.100:0/612920324 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc550005040 con 0x7fc5540fb8f0 2023-12-05T09:58:12.019 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:12.021+0000 7fc55a296700 1 --2- 172.21.15.100:0/612920324 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5540fb8f0 0x7fc5540ff9c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc550000c00 tx=0x7fc550009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:58:12.019 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:12.021+0000 7fc54affd700 1 -- 172.21.15.100:0/612920324 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc550021070 con 0x7fc5540fb8f0 2023-12-05T09:58:12.019 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:12.021+0000 7fc54affd700 1 -- 172.21.15.100:0/612920324 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc55001c400 con 0x7fc5540fb8f0 2023-12-05T09:58:12.019 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:12.021+0000 7fc54affd700 1 -- 172.21.15.100:0/612920324 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc55000e070 con 0x7fc5540fb8f0 2023-12-05T09:58:12.019 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:12.021+0000 7fc55b298700 1 -- 172.21.15.100:0/612920324 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5540fe830 con 0x7fc5540fb8f0 2023-12-05T09:58:12.020 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:12.022+0000 7fc55b298700 1 -- 172.21.15.100:0/612920324 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5541152c0 con 0x7fc5540fb8f0 2023-12-05T09:58:12.021 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:12.023+0000 7fc55b298700 1 -- 172.21.15.100:0/612920324 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc55404bb80 con 0x7fc5540fb8f0 2023-12-05T09:58:12.022 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:12.024+0000 7fc54affd700 1 -- 172.21.15.100:0/612920324 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 31) v1 ==== 90901+0+0 (secure 0 0 0) 0x7fc55001ca00 con 0x7fc5540fb8f0 2023-12-05T09:58:12.022 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:12.025+0000 7fc54affd700 1 --2- 172.21.15.100:0/612920324 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7fc54006cc00 0x7fc54006f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:58:12.022 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:12.026+0000 7fc54affd700 1 -- 172.21.15.100:0/612920324 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fc55008cde0 con 0x7fc5540fb8f0 2023-12-05T09:58:12.023 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:12.027+0000 7fc559a95700 1 --2- 172.21.15.100:0/612920324 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7fc54006cc00 0x7fc54006f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:58:12.024 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:12.028+0000 7fc559a95700 1 --2- 172.21.15.100:0/612920324 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7fc54006cc00 0x7fc54006f0b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc544004600 tx=0x7fc54400b040 comp rx=0 tx=0).ready entity=mgr.24533 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:58:12.026 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:12.029+0000 7fc54affd700 1 -- 172.21.15.100:0/612920324 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fc55005aad0 con 0x7fc5540fb8f0 2023-12-05T09:58:12.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:11 smithi150 ceph-mon[116142]: from='client.? 172.21.15.100:0/3642439022' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-05T09:58:12.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:11 smithi150 ceph-mon[116142]: Standby manager daemon smithi150.zkskag started 2023-12-05T09:58:12.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:11 smithi150 ceph-mon[116142]: from='mgr.? 172.21.15.150:0/3667487478' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi150.zkskag/crt"}]: dispatch 2023-12-05T09:58:12.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:11 smithi150 ceph-mon[116142]: from='mgr.? 172.21.15.150:0/3667487478' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-05T09:58:12.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:11 smithi150 ceph-mon[116142]: from='mgr.? 172.21.15.150:0/3667487478' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi150.zkskag/key"}]: dispatch 2023-12-05T09:58:12.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:11 smithi150 ceph-mon[116142]: from='mgr.? 172.21.15.150:0/3667487478' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-05T09:58:12.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:11 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/3642439022' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-05T09:58:12.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:11 smithi100 ceph-mon[107145]: Standby manager daemon smithi150.zkskag started 2023-12-05T09:58:12.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:11 smithi100 ceph-mon[107145]: from='mgr.? 172.21.15.150:0/3667487478' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi150.zkskag/crt"}]: dispatch 2023-12-05T09:58:12.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:11 smithi100 ceph-mon[107145]: from='mgr.? 172.21.15.150:0/3667487478' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-05T09:58:12.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:11 smithi100 ceph-mon[107145]: from='mgr.? 172.21.15.150:0/3667487478' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi150.zkskag/key"}]: dispatch 2023-12-05T09:58:12.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:11 smithi100 ceph-mon[107145]: from='mgr.? 172.21.15.150:0/3667487478' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-05T09:58:12.403 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:12.406+0000 7fc55b298700 1 -- 172.21.15.100:0/612920324 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fc554115600 con 0x7fc5540fb8f0 2023-12-05T09:58:12.403 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:12.407+0000 7fc54affd700 1 -- 172.21.15.100:0/612920324 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fc55005a660 con 0x7fc5540fb8f0 2023-12-05T09:58:12.403 INFO:teuthology.orchestra.run.smithi100.stdout:HEALTH_OK 2023-12-05T09:58:12.406 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:12.409+0000 7fc55b298700 1 -- 172.21.15.100:0/612920324 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7fc54006cc00 msgr2=0x7fc54006f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:58:12.406 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:12.409+0000 7fc55b298700 1 --2- 172.21.15.100:0/612920324 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7fc54006cc00 0x7fc54006f0b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc544004600 tx=0x7fc54400b040 comp rx=0 tx=0).stop 2023-12-05T09:58:12.406 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:12.409+0000 7fc55b298700 1 -- 172.21.15.100:0/612920324 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5540fb8f0 msgr2=0x7fc5540ff9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:58:12.407 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:12.409+0000 7fc55b298700 1 --2- 172.21.15.100:0/612920324 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5540fb8f0 0x7fc5540ff9c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc550000c00 tx=0x7fc550009e30 comp rx=0 tx=0).stop 2023-12-05T09:58:12.407 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:12.409+0000 7fc55b298700 1 -- 172.21.15.100:0/612920324 shutdown_connections 2023-12-05T09:58:12.407 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:12.409+0000 7fc55b298700 1 --2- 172.21.15.100:0/612920324 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7fc54006cc00 0x7fc54006f0b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:12.407 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:12.409+0000 7fc55b298700 1 --2- 172.21.15.100:0/612920324 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5540fb8f0 0x7fc5540ff9c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:12.407 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:12.409+0000 7fc55b298700 1 --2- 172.21.15.100:0/612920324 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5540fcb00 0x7fc5540fde40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:12.407 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:12.409+0000 7fc55b298700 1 -- 172.21.15.100:0/612920324 >> 172.21.15.100:0/612920324 conn(0x7fc5540f6f70 msgr2=0x7fc554065370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:58:12.407 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:12.409+0000 7fc55b298700 1 -- 172.21.15.100:0/612920324 shutdown_connections 2023-12-05T09:58:12.407 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:12.410+0000 7fc55b298700 1 -- 172.21.15.100:0/612920324 wait complete. 2023-12-05T09:58:13.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:12 smithi150 ceph-mon[116142]: pgmap v8: 65 pgs: 65 active+clean; 746 MiB data, 4.5 GiB used, 532 GiB / 536 GiB avail; 39 KiB/s rd, 801 KiB/s wr, 108 op/s 2023-12-05T09:58:13.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:12 smithi150 ceph-mon[116142]: mgrmap e31: smithi100.ehmuhg(active, since 10s), standbys: smithi150.zkskag 2023-12-05T09:58:13.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:12 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mgr metadata", "who": "smithi150.zkskag", "id": "smithi150.zkskag"}]: dispatch 2023-12-05T09:58:13.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:12 smithi150 ceph-mon[116142]: from='client.24579 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:58:13.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:12 smithi150 ceph-mon[116142]: from='client.? 172.21.15.100:0/612920324' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-05T09:58:13.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:12 smithi100 ceph-mon[107145]: pgmap v8: 65 pgs: 65 active+clean; 746 MiB data, 4.5 GiB used, 532 GiB / 536 GiB avail; 39 KiB/s rd, 801 KiB/s wr, 108 op/s 2023-12-05T09:58:13.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:12 smithi100 ceph-mon[107145]: mgrmap e31: smithi100.ehmuhg(active, since 10s), standbys: smithi150.zkskag 2023-12-05T09:58:13.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:12 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mgr metadata", "who": "smithi150.zkskag", "id": "smithi150.zkskag"}]: dispatch 2023-12-05T09:58:13.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:12 smithi100 ceph-mon[107145]: from='client.24579 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:58:13.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:12 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/612920324' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-05T09:58:14.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:14 smithi150 ceph-mon[116142]: pgmap v9: 65 pgs: 65 active+clean; 306 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 46 KiB/s rd, 1.4 MiB/s wr, 208 op/s 2023-12-05T09:58:14.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:14 smithi100 ceph-mon[107145]: pgmap v9: 65 pgs: 65 active+clean; 306 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 46 KiB/s rd, 1.4 MiB/s wr, 208 op/s 2023-12-05T09:58:17.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:16 smithi150 ceph-mon[116142]: pgmap v10: 65 pgs: 65 active+clean; 306 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 1.2 MiB/s wr, 190 op/s 2023-12-05T09:58:17.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:16 smithi100 ceph-mon[107145]: pgmap v10: 65 pgs: 65 active+clean; 306 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 1.2 MiB/s wr, 190 op/s 2023-12-05T09:58:18.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:17 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:58:18.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:17 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:58:19.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:18 smithi150 ceph-mon[116142]: pgmap v11: 65 pgs: 65 active+clean; 306 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 1.2 MiB/s wr, 190 op/s 2023-12-05T09:58:19.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:18 smithi100 ceph-mon[107145]: pgmap v11: 65 pgs: 65 active+clean; 306 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 1.2 MiB/s wr, 190 op/s 2023-12-05T09:58:21.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:20 smithi150 ceph-mon[116142]: pgmap v12: 65 pgs: 65 active+clean; 318 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 48 KiB/s rd, 2.2 MiB/s wr, 258 op/s 2023-12-05T09:58:21.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:20 smithi100 ceph-mon[107145]: pgmap v12: 65 pgs: 65 active+clean; 318 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 48 KiB/s rd, 2.2 MiB/s wr, 258 op/s 2023-12-05T09:58:22.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:22 smithi100 ceph-mon[107145]: pgmap v13: 65 pgs: 65 active+clean; 318 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 1.6 MiB/s wr, 176 op/s 2023-12-05T09:58:23.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:22 smithi150 ceph-mon[116142]: pgmap v13: 65 pgs: 65 active+clean; 318 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 1.6 MiB/s wr, 176 op/s 2023-12-05T09:58:24.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:24 smithi150 ceph-mon[116142]: pgmap v14: 65 pgs: 65 active+clean; 323 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 35 KiB/s rd, 2.4 MiB/s wr, 343 op/s 2023-12-05T09:58:24.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:24 smithi100 ceph-mon[107145]: pgmap v14: 65 pgs: 65 active+clean; 323 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 35 KiB/s rd, 2.4 MiB/s wr, 343 op/s 2023-12-05T09:58:26.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:26 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:58:26.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:26 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:58:26.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:26 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:58:26.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:26 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:58:26.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:26 smithi150 ceph-mon[116142]: Updating smithi100:/etc/ceph/ceph.conf 2023-12-05T09:58:26.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:26 smithi150 ceph-mon[116142]: Updating smithi150:/etc/ceph/ceph.conf 2023-12-05T09:58:26.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:26 smithi150 ceph-mon[116142]: pgmap v15: 65 pgs: 65 active+clean; 323 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 1.7 MiB/s wr, 233 op/s 2023-12-05T09:58:26.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:26 smithi150 ceph-mon[116142]: Updating smithi150:/var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-05T09:58:26.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:26 smithi150 ceph-mon[116142]: Updating smithi100:/var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-05T09:58:26.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:26 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:58:26.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:26 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:58:26.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:26 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:58:26.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:26 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:58:26.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:26 smithi100 ceph-mon[107145]: Updating smithi100:/etc/ceph/ceph.conf 2023-12-05T09:58:26.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:26 smithi100 ceph-mon[107145]: Updating smithi150:/etc/ceph/ceph.conf 2023-12-05T09:58:26.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:26 smithi100 ceph-mon[107145]: pgmap v15: 65 pgs: 65 active+clean; 323 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 1.7 MiB/s wr, 233 op/s 2023-12-05T09:58:26.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:26 smithi100 ceph-mon[107145]: Updating smithi150:/var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-05T09:58:26.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:26 smithi100 ceph-mon[107145]: Updating smithi100:/var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-05T09:58:27.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:27 smithi150 ceph-mon[116142]: Updating smithi150:/etc/ceph/ceph.client.admin.keyring 2023-12-05T09:58:27.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:27 smithi150 ceph-mon[116142]: Updating smithi100:/etc/ceph/ceph.client.admin.keyring 2023-12-05T09:58:27.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:27 smithi150 ceph-mon[116142]: Updating smithi150:/var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-05T09:58:27.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:27 smithi100 ceph-mon[107145]: Updating smithi150:/etc/ceph/ceph.client.admin.keyring 2023-12-05T09:58:27.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:27 smithi100 ceph-mon[107145]: Updating smithi100:/etc/ceph/ceph.client.admin.keyring 2023-12-05T09:58:27.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:27 smithi100 ceph-mon[107145]: Updating smithi150:/var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-05T09:58:29.345 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:29 smithi150 ceph-mon[116142]: Updating smithi100:/var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-05T09:58:29.345 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:29 smithi150 ceph-mon[116142]: pgmap v16: 65 pgs: 65 active+clean; 323 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 1.7 MiB/s wr, 233 op/s 2023-12-05T09:58:29.345 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:29 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:58:29.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:29 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:58:29.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:29 smithi100 ceph-mon[107145]: Updating smithi100:/var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-05T09:58:29.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:29 smithi100 ceph-mon[107145]: pgmap v16: 65 pgs: 65 active+clean; 323 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 1.7 MiB/s wr, 233 op/s 2023-12-05T09:58:29.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:29 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:58:29.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:29 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:58:30.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:30 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:58:30.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:30 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:58:30.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:30 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:58:30.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:30 smithi100 ceph-mon[107145]: pgmap v17: 65 pgs: 65 active+clean; 329 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 37 KiB/s rd, 2.5 MiB/s wr, 379 op/s 2023-12-05T09:58:30.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:30 smithi100 ceph-mon[107145]: Reconfiguring prometheus.smithi100 (dependencies changed)... 2023-12-05T09:58:30.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:30 smithi100 ceph-mon[107145]: Reconfiguring daemon prometheus.smithi100 on smithi100 2023-12-05T09:58:31.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:30 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:58:31.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:30 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:58:31.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:30 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:58:31.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:30 smithi150 ceph-mon[116142]: pgmap v17: 65 pgs: 65 active+clean; 329 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 37 KiB/s rd, 2.5 MiB/s wr, 379 op/s 2023-12-05T09:58:31.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:30 smithi150 ceph-mon[116142]: Reconfiguring prometheus.smithi100 (dependencies changed)... 2023-12-05T09:58:31.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:30 smithi150 ceph-mon[116142]: Reconfiguring daemon prometheus.smithi100 on smithi100 2023-12-05T09:58:33.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:32 smithi150 ceph-mon[116142]: pgmap v18: 65 pgs: 65 active+clean; 329 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.5 MiB/s wr, 311 op/s 2023-12-05T09:58:33.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:32 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:58:33.132 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:32 smithi100 ceph-mon[107145]: pgmap v18: 65 pgs: 65 active+clean; 329 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.5 MiB/s wr, 311 op/s 2023-12-05T09:58:33.133 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:32 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:58:34.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:34 smithi150 ceph-mon[116142]: pgmap v19: 65 pgs: 65 active+clean; 334 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 46 KiB/s rd, 2.3 MiB/s wr, 597 op/s 2023-12-05T09:58:34.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:34 smithi100 ceph-mon[107145]: pgmap v19: 65 pgs: 65 active+clean; 334 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 46 KiB/s rd, 2.3 MiB/s wr, 597 op/s 2023-12-05T09:58:35.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:35 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:58:35.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:35 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:58:35.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:35 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-05T09:58:35.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:35 smithi150 ceph-mon[116142]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-05T09:58:35.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:35 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:58:35.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:35 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:58:35.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:35 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:58:35.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:35 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-05T09:58:35.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:35 smithi100 ceph-mon[107145]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-05T09:58:35.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:35 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:58:36.595 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:36 smithi150 ceph-mon[116142]: pgmap v20: 65 pgs: 65 active+clean; 334 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.5 MiB/s wr, 431 op/s 2023-12-05T09:58:36.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:36 smithi150 ceph-mon[116142]: Upgrade: Updating mgr.smithi150.zkskag 2023-12-05T09:58:36.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:36 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi150.zkskag", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-05T09:58:36.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:36 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-05T09:58:36.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:36 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:58:36.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:36 smithi150 ceph-mon[116142]: Deploying daemon mgr.smithi150.zkskag on smithi150 2023-12-05T09:58:36.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:36 smithi100 ceph-mon[107145]: pgmap v20: 65 pgs: 65 active+clean; 334 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.5 MiB/s wr, 431 op/s 2023-12-05T09:58:36.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:36 smithi100 ceph-mon[107145]: Upgrade: Updating mgr.smithi150.zkskag 2023-12-05T09:58:36.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:36 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi150.zkskag", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-05T09:58:36.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:36 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-05T09:58:36.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:36 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:58:36.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:36 smithi100 ceph-mon[107145]: Deploying daemon mgr.smithi150.zkskag on smithi150 2023-12-05T09:58:39.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:38 smithi150 ceph-mon[116142]: pgmap v21: 65 pgs: 65 active+clean; 331 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.8 MiB/s wr, 720 op/s 2023-12-05T09:58:39.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:38 smithi100 ceph-mon[107145]: pgmap v21: 65 pgs: 65 active+clean; 331 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.8 MiB/s wr, 720 op/s 2023-12-05T09:58:41.297 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:41 smithi150 ceph-mon[116142]: pgmap v22: 65 pgs: 65 active+clean; 331 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 44 KiB/s rd, 2.4 MiB/s wr, 1.11k op/s 2023-12-05T09:58:41.297 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:41 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:58:41.297 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:41 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:58:41.297 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:41 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:58:41.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:41 smithi100 ceph-mon[107145]: pgmap v22: 65 pgs: 65 active+clean; 331 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 44 KiB/s rd, 2.4 MiB/s wr, 1.11k op/s 2023-12-05T09:58:41.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:41 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:58:41.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:41 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:58:41.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:41 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:58:42.599 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:42.601+0000 7f8771c28700 1 -- 172.21.15.100:0/3653692261 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f876c0fcbf0 msgr2=0x7f876c0fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:58:42.599 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:42.601+0000 7f8771c28700 1 --2- 172.21.15.100:0/3653692261 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f876c0fcbf0 0x7f876c0fd000 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f875c004940 tx=0x7f875c009e30 comp rx=0 tx=0).stop 2023-12-05T09:58:42.600 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:42.601+0000 7f8771c28700 1 -- 172.21.15.100:0/3653692261 shutdown_connections 2023-12-05T09:58:42.600 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:42.601+0000 7f8771c28700 1 --2- 172.21.15.100:0/3653692261 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f876c0fde00 0x7f876c0fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:42.600 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:42.601+0000 7f8771c28700 1 --2- 172.21.15.100:0/3653692261 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f876c0fcbf0 0x7f876c0fd000 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:42.600 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:42.601+0000 7f8771c28700 1 -- 172.21.15.100:0/3653692261 >> 172.21.15.100:0/3653692261 conn(0x7f876c0f82d0 msgr2=0x7f876c0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:58:42.600 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:42.602+0000 7f8771c28700 1 -- 172.21.15.100:0/3653692261 shutdown_connections 2023-12-05T09:58:42.600 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:42.602+0000 7f8771c28700 1 -- 172.21.15.100:0/3653692261 wait complete. 2023-12-05T09:58:42.601 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:42.603+0000 7f8771c28700 1 Processor -- start 2023-12-05T09:58:42.601 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:42.603+0000 7f8771c28700 1 -- start start 2023-12-05T09:58:42.601 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:42.603+0000 7f8771c28700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f876c0fcbf0 0x7f876c10d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:58:42.601 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:42.603+0000 7f8771c28700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f876c0fde00 0x7f876c10da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:58:42.601 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:42.603+0000 7f8771c28700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f876c10e050 con 0x7f876c0fde00 2023-12-05T09:58:42.601 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:42.603+0000 7f8771c28700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f876c10e8f0 con 0x7f876c0fcbf0 2023-12-05T09:58:42.602 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:42.604+0000 7f876affd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f876c0fde00 0x7f876c10da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:58:42.602 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:42.604+0000 7f876b7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f876c0fcbf0 0x7f876c10d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:58:42.602 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:42.604+0000 7f876b7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f876c0fcbf0 0x7f876c10d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.100:60956/0 (socket says 172.21.15.100:60956) 2023-12-05T09:58:42.602 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:42.604+0000 7f876b7fe700 1 -- 172.21.15.100:0/1734283038 learned_addr learned my addr 172.21.15.100:0/1734283038 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:58:42.602 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:42.604+0000 7f876affd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f876c0fde00 0x7f876c10da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42612/0 (socket says 172.21.15.100:42612) 2023-12-05T09:58:42.603 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:42.604+0000 7f876affd700 1 -- 172.21.15.100:0/1734283038 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f876c0fcbf0 msgr2=0x7f876c10d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:58:42.603 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:42.604+0000 7f876affd700 1 --2- 172.21.15.100:0/1734283038 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f876c0fcbf0 0x7f876c10d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:42.603 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:42.604+0000 7f876affd700 1 -- 172.21.15.100:0/1734283038 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f875c005040 con 0x7f876c0fde00 2023-12-05T09:58:42.603 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:42.604+0000 7f876affd700 1 --2- 172.21.15.100:0/1734283038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f876c0fde00 0x7f876c10da50 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f8760009fd0 tx=0x7f876000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:58:42.603 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:42.605+0000 7f8753fff700 1 -- 172.21.15.100:0/1734283038 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8760004e70 con 0x7f876c0fde00 2023-12-05T09:58:42.603 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:42.605+0000 7f8753fff700 1 -- 172.21.15.100:0/1734283038 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f876000f040 con 0x7f876c0fde00 2023-12-05T09:58:42.603 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:42.605+0000 7f8753fff700 1 -- 172.21.15.100:0/1734283038 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f876000c930 con 0x7f876c0fde00 2023-12-05T09:58:42.603 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:42.605+0000 7f8771c28700 1 -- 172.21.15.100:0/1734283038 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f876c10eb70 con 0x7f876c0fde00 2023-12-05T09:58:42.603 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:42.605+0000 7f8771c28700 1 -- 172.21.15.100:0/1734283038 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f876c10f0b0 con 0x7f876c0fde00 2023-12-05T09:58:42.604 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:42.606+0000 7f8771c28700 1 -- 172.21.15.100:0/1734283038 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f876c04bb80 con 0x7f876c0fde00 2023-12-05T09:58:42.604 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:42.607+0000 7f8753fff700 1 -- 172.21.15.100:0/1734283038 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 31) v1 ==== 90901+0+0 (secure 0 0 0) 0x7f8760007cc0 con 0x7f876c0fde00 2023-12-05T09:58:42.606 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:42.608+0000 7f8753fff700 1 --2- 172.21.15.100:0/1734283038 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7f875406cc00 0x7f875406f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:58:42.606 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:42.608+0000 7f8753fff700 1 -- 172.21.15.100:0/1734283038 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f876008ba30 con 0x7f876c0fde00 2023-12-05T09:58:42.606 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:42.609+0000 7f876b7fe700 1 --2- 172.21.15.100:0/1734283038 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7f875406cc00 0x7f875406f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:58:42.607 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:42.609+0000 7f876b7fe700 1 --2- 172.21.15.100:0/1734283038 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7f875406cc00 0x7f875406f0b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f875c013680 tx=0x7f875c009e30 comp rx=0 tx=0).ready entity=mgr.24533 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:58:42.611 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:42.613+0000 7f8753fff700 1 -- 172.21.15.100:0/1734283038 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f87600595e0 con 0x7f876c0fde00 2023-12-05T09:58:42.880 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:42.883+0000 7f8771c28700 1 -- 172.21.15.100:0/1734283038 --> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f876c10f590 con 0x7f875406cc00 2023-12-05T09:58:42.881 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:42.884+0000 7f8753fff700 1 -- 172.21.15.100:0/1734283038 <== mgr.24533 v2:172.21.15.100:6800/3060005571 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+328 (secure 0 0 0) 0x7f876c10f590 con 0x7f875406cc00 2023-12-05T09:58:42.885 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:42.888+0000 7f8771c28700 1 -- 172.21.15.100:0/1734283038 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7f875406cc00 msgr2=0x7f875406f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:58:42.885 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:42.888+0000 7f8771c28700 1 --2- 172.21.15.100:0/1734283038 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7f875406cc00 0x7f875406f0b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f875c013680 tx=0x7f875c009e30 comp rx=0 tx=0).stop 2023-12-05T09:58:42.886 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:42.888+0000 7f8771c28700 1 -- 172.21.15.100:0/1734283038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f876c0fde00 msgr2=0x7f876c10da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:58:42.886 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:42.888+0000 7f8771c28700 1 --2- 172.21.15.100:0/1734283038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f876c0fde00 0x7f876c10da50 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f8760009fd0 tx=0x7f876000b040 comp rx=0 tx=0).stop 2023-12-05T09:58:42.886 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:42.888+0000 7f8771c28700 1 -- 172.21.15.100:0/1734283038 shutdown_connections 2023-12-05T09:58:42.886 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:42.888+0000 7f8771c28700 1 --2- 172.21.15.100:0/1734283038 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7f875406cc00 0x7f875406f0b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:42.886 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:42.888+0000 7f8771c28700 1 --2- 172.21.15.100:0/1734283038 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f876c0fcbf0 0x7f876c10d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:42.886 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:42.888+0000 7f8771c28700 1 --2- 172.21.15.100:0/1734283038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f876c0fde00 0x7f876c10da50 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:42.886 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:42.888+0000 7f8771c28700 1 -- 172.21.15.100:0/1734283038 >> 172.21.15.100:0/1734283038 conn(0x7f876c0f82d0 msgr2=0x7f876c101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:58:42.886 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:42.888+0000 7f8771c28700 1 -- 172.21.15.100:0/1734283038 shutdown_connections 2023-12-05T09:58:42.886 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:42.888+0000 7f8771c28700 1 -- 172.21.15.100:0/1734283038 wait complete. 2023-12-05T09:58:42.903 INFO:teuthology.orchestra.run.smithi100.stdout:true 2023-12-05T09:58:43.055 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.057+0000 7f7421fda700 1 -- 172.21.15.100:0/886125949 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f741c0fcbf0 msgr2=0x7f741c0fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:58:43.056 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.057+0000 7f7421fda700 1 --2- 172.21.15.100:0/886125949 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f741c0fcbf0 0x7f741c0fd000 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f740c004940 tx=0x7f740c009e30 comp rx=0 tx=0).stop 2023-12-05T09:58:43.056 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.057+0000 7f7421fda700 1 -- 172.21.15.100:0/886125949 shutdown_connections 2023-12-05T09:58:43.056 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.057+0000 7f7421fda700 1 --2- 172.21.15.100:0/886125949 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f741c0fde00 0x7f741c0fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:43.056 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.057+0000 7f7421fda700 1 --2- 172.21.15.100:0/886125949 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f741c0fcbf0 0x7f741c0fd000 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:43.056 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.057+0000 7f7421fda700 1 -- 172.21.15.100:0/886125949 >> 172.21.15.100:0/886125949 conn(0x7f741c0f82d0 msgr2=0x7f741c0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:58:43.056 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.058+0000 7f7421fda700 1 -- 172.21.15.100:0/886125949 shutdown_connections 2023-12-05T09:58:43.056 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.058+0000 7f7421fda700 1 -- 172.21.15.100:0/886125949 wait complete. 2023-12-05T09:58:43.057 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.059+0000 7f7421fda700 1 Processor -- start 2023-12-05T09:58:43.057 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.059+0000 7f7421fda700 1 -- start start 2023-12-05T09:58:43.058 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.059+0000 7f7421fda700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f741c0fcbf0 0x7f741c10b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:58:43.058 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.059+0000 7f7421fda700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f741c0fde00 0x7f741c10b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:58:43.058 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.059+0000 7f7421fda700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741c10bdf0 con 0x7f741c0fde00 2023-12-05T09:58:43.058 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.059+0000 7f7421fda700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741c10c690 con 0x7f741c0fcbf0 2023-12-05T09:58:43.058 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.060+0000 7f741b7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f741c0fcbf0 0x7f741c10b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:58:43.058 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.060+0000 7f741b7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f741c0fcbf0 0x7f741c10b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.100:60984/0 (socket says 172.21.15.100:60984) 2023-12-05T09:58:43.058 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.060+0000 7f741b7fe700 1 -- 172.21.15.100:0/3625626586 learned_addr learned my addr 172.21.15.100:0/3625626586 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:58:43.059 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.060+0000 7f741affd700 1 --2- 172.21.15.100:0/3625626586 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f741c0fde00 0x7f741c10b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:58:43.060 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.061+0000 7f741affd700 1 -- 172.21.15.100:0/3625626586 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f741c0fcbf0 msgr2=0x7f741c10b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:58:43.060 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.061+0000 7f741affd700 1 --2- 172.21.15.100:0/3625626586 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f741c0fcbf0 0x7f741c10b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:43.060 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.061+0000 7f741affd700 1 -- 172.21.15.100:0/3625626586 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f740c005040 con 0x7f741c0fde00 2023-12-05T09:58:43.060 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.061+0000 7f741b7fe700 1 --2- 172.21.15.100:0/3625626586 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f741c0fcbf0 0x7f741c10b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-05T09:58:43.060 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.061+0000 7f741affd700 1 --2- 172.21.15.100:0/3625626586 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f741c0fde00 0x7f741c10b7a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f7410009fd0 tx=0x7f741000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:58:43.060 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.061+0000 7f7403fff700 1 -- 172.21.15.100:0/3625626586 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7410004e90 con 0x7f741c0fde00 2023-12-05T09:58:43.060 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.061+0000 7f7403fff700 1 -- 172.21.15.100:0/3625626586 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f741000f040 con 0x7f741c0fde00 2023-12-05T09:58:43.060 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.061+0000 7f7421fda700 1 -- 172.21.15.100:0/3625626586 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f741c10c910 con 0x7f741c0fde00 2023-12-05T09:58:43.060 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.062+0000 7f7403fff700 1 -- 172.21.15.100:0/3625626586 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f741000c8f0 con 0x7f741c0fde00 2023-12-05T09:58:43.061 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.063+0000 7f7421fda700 1 -- 172.21.15.100:0/3625626586 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f741c10ce50 con 0x7f741c0fde00 2023-12-05T09:58:43.062 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.064+0000 7f7403fff700 1 -- 172.21.15.100:0/3625626586 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 31) v1 ==== 90901+0+0 (secure 0 0 0) 0x7f741000ca50 con 0x7f741c0fde00 2023-12-05T09:58:43.062 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.065+0000 7f7421fda700 1 -- 172.21.15.100:0/3625626586 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f741c04bb80 con 0x7f741c0fde00 2023-12-05T09:58:43.063 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.065+0000 7f7403fff700 1 --2- 172.21.15.100:0/3625626586 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7f740406cc50 0x7f740406f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:58:43.063 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.066+0000 7f7403fff700 1 -- 172.21.15.100:0/3625626586 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f7410092060 con 0x7f741c0fde00 2023-12-05T09:58:43.063 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.066+0000 7f741b7fe700 1 --2- 172.21.15.100:0/3625626586 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7f740406cc50 0x7f740406f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:58:43.064 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.067+0000 7f741b7fe700 1 --2- 172.21.15.100:0/3625626586 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7f740406cc50 0x7f740406f100 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f740c013680 tx=0x7f740c009e30 comp rx=0 tx=0).ready entity=mgr.24533 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:58:43.069 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.072+0000 7f7403fff700 1 -- 172.21.15.100:0/3625626586 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f7410056980 con 0x7f741c0fde00 2023-12-05T09:58:43.438 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:43 smithi100 ceph-mon[107145]: pgmap v23: 65 pgs: 65 active+clean; 331 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.6 MiB/s wr, 969 op/s 2023-12-05T09:58:43.503 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.504+0000 7f7421fda700 1 -- 172.21.15.100:0/3625626586 --> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f741c10d380 con 0x7f740406cc50 2023-12-05T09:58:43.509 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.509+0000 7f7403fff700 1 -- 172.21.15.100:0/3625626586 <== mgr.24533 v2:172.21.15.100:6800/3060005571 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+328 (secure 0 0 0) 0x7f741c10d380 con 0x7f740406cc50 2023-12-05T09:58:43.512 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.514+0000 7f7421fda700 1 -- 172.21.15.100:0/3625626586 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7f740406cc50 msgr2=0x7f740406f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:58:43.512 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.514+0000 7f7421fda700 1 --2- 172.21.15.100:0/3625626586 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7f740406cc50 0x7f740406f100 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f740c013680 tx=0x7f740c009e30 comp rx=0 tx=0).stop 2023-12-05T09:58:43.513 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.514+0000 7f7421fda700 1 -- 172.21.15.100:0/3625626586 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f741c0fde00 msgr2=0x7f741c10b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:58:43.513 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.514+0000 7f7421fda700 1 --2- 172.21.15.100:0/3625626586 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f741c0fde00 0x7f741c10b7a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f7410009fd0 tx=0x7f741000b040 comp rx=0 tx=0).stop 2023-12-05T09:58:43.514 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.515+0000 7f7421fda700 1 -- 172.21.15.100:0/3625626586 shutdown_connections 2023-12-05T09:58:43.514 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.515+0000 7f7421fda700 1 --2- 172.21.15.100:0/3625626586 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7f740406cc50 0x7f740406f100 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:43.514 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.515+0000 7f7421fda700 1 --2- 172.21.15.100:0/3625626586 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f741c0fcbf0 0x7f741c10b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:43.514 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.515+0000 7f7421fda700 1 --2- 172.21.15.100:0/3625626586 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f741c0fde00 0x7f741c10b7a0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:43.514 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.515+0000 7f7421fda700 1 -- 172.21.15.100:0/3625626586 >> 172.21.15.100:0/3625626586 conn(0x7f741c0f82d0 msgr2=0x7f741c0ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:58:43.514 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.516+0000 7f7421fda700 1 -- 172.21.15.100:0/3625626586 shutdown_connections 2023-12-05T09:58:43.514 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.516+0000 7f7421fda700 1 -- 172.21.15.100:0/3625626586 wait complete. 2023-12-05T09:58:43.595 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:43 smithi150 ceph-mon[116142]: pgmap v23: 65 pgs: 65 active+clean; 331 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.6 MiB/s wr, 969 op/s 2023-12-05T09:58:43.723 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.724+0000 7f0517752700 1 -- 172.21.15.100:0/3582119857 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0510066090 msgr2=0x7f05100ff7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:58:43.723 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.724+0000 7f0517752700 1 --2- 172.21.15.100:0/3582119857 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0510066090 0x7f05100ff7a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f050c004940 tx=0x7f050c009e30 comp rx=0 tx=0).stop 2023-12-05T09:58:43.723 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.725+0000 7f0517752700 1 -- 172.21.15.100:0/3582119857 shutdown_connections 2023-12-05T09:58:43.723 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.725+0000 7f0517752700 1 --2- 172.21.15.100:0/3582119857 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05100ffd70 0x7f05101021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:43.723 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.725+0000 7f0517752700 1 --2- 172.21.15.100:0/3582119857 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0510066090 0x7f05100ff7a0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:43.723 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.725+0000 7f0517752700 1 -- 172.21.15.100:0/3582119857 >> 172.21.15.100:0/3582119857 conn(0x7f05100f7190 msgr2=0x7f05100f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:58:43.723 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.725+0000 7f0517752700 1 -- 172.21.15.100:0/3582119857 shutdown_connections 2023-12-05T09:58:43.723 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.725+0000 7f0517752700 1 -- 172.21.15.100:0/3582119857 wait complete. 2023-12-05T09:58:43.724 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.726+0000 7f0517752700 1 Processor -- start 2023-12-05T09:58:43.724 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.726+0000 7f0517752700 1 -- start start 2023-12-05T09:58:43.724 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.726+0000 7f0517752700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0510066090 0x7f051010f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:58:43.724 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.726+0000 7f0517752700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05100ffd70 0x7f051010fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:58:43.724 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.726+0000 7f0517752700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0510110250 con 0x7f0510066090 2023-12-05T09:58:43.724 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.726+0000 7f0517752700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0510110af0 con 0x7f05100ffd70 2023-12-05T09:58:43.725 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.727+0000 7f0514ced700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05100ffd70 0x7f051010fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:58:43.725 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.727+0000 7f05154ee700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0510066090 0x7f051010f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:58:43.725 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.727+0000 7f0514ced700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05100ffd70 0x7f051010fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.100:32780/0 (socket says 172.21.15.100:32780) 2023-12-05T09:58:43.725 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.727+0000 7f0514ced700 1 -- 172.21.15.100:0/3580478144 learned_addr learned my addr 172.21.15.100:0/3580478144 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:58:43.725 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.727+0000 7f0514ced700 1 -- 172.21.15.100:0/3580478144 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0510066090 msgr2=0x7f051010f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:58:43.725 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.727+0000 7f0514ced700 1 --2- 172.21.15.100:0/3580478144 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0510066090 0x7f051010f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:43.725 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.727+0000 7f0514ced700 1 -- 172.21.15.100:0/3580478144 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f050c005040 con 0x7f05100ffd70 2023-12-05T09:58:43.725 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.727+0000 7f05154ee700 1 --2- 172.21.15.100:0/3580478144 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0510066090 0x7f051010f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-05T09:58:43.726 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.728+0000 7f0514ced700 1 --2- 172.21.15.100:0/3580478144 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05100ffd70 0x7f051010fc50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f050000eb40 tx=0x7f050000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:58:43.726 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.728+0000 7f0505ffb700 1 -- 172.21.15.100:0/3580478144 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0500007cc0 con 0x7f05100ffd70 2023-12-05T09:58:43.726 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.728+0000 7f0505ffb700 1 -- 172.21.15.100:0/3580478144 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f050000f040 con 0x7f05100ffd70 2023-12-05T09:58:43.726 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.728+0000 7f0505ffb700 1 -- 172.21.15.100:0/3580478144 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f050000c8f0 con 0x7f05100ffd70 2023-12-05T09:58:43.726 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.728+0000 7f0517752700 1 -- 172.21.15.100:0/3580478144 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0510110d70 con 0x7f05100ffd70 2023-12-05T09:58:43.726 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.728+0000 7f0517752700 1 -- 172.21.15.100:0/3580478144 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0510111260 con 0x7f05100ffd70 2023-12-05T09:58:43.727 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.730+0000 7f04fb7fe700 1 -- 172.21.15.100:0/3580478144 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f051004bb80 con 0x7f05100ffd70 2023-12-05T09:58:43.729 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.731+0000 7f0505ffb700 1 -- 172.21.15.100:0/3580478144 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 31) v1 ==== 90901+0+0 (secure 0 0 0) 0x7f050000cb60 con 0x7f05100ffd70 2023-12-05T09:58:43.730 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.732+0000 7f0505ffb700 1 --2- 172.21.15.100:0/3580478144 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7f04fc06cc00 0x7f04fc06f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:58:43.730 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.733+0000 7f0505ffb700 1 -- 172.21.15.100:0/3580478144 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f050008bb20 con 0x7f05100ffd70 2023-12-05T09:58:43.730 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.733+0000 7f05154ee700 1 --2- 172.21.15.100:0/3580478144 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7f04fc06cc00 0x7f04fc06f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:58:43.731 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.733+0000 7f05154ee700 1 --2- 172.21.15.100:0/3580478144 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7f04fc06cc00 0x7f04fc06f0b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f050c013680 tx=0x7f050c009e30 comp rx=0 tx=0).ready entity=mgr.24533 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:58:43.735 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.738+0000 7f0505ffb700 1 -- 172.21.15.100:0/3580478144 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f0500059700 con 0x7f05100ffd70 2023-12-05T09:58:43.992 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:43.995+0000 7f04fb7fe700 1 -- 172.21.15.100:0/3580478144 --> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f05101055a0 con 0x7f04fc06cc00 2023-12-05T09:58:44.009 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.012+0000 7f0505ffb700 1 -- 172.21.15.100:0/3580478144 <== mgr.24533 v2:172.21.15.100:6800/3060005571 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f05101055a0 con 0x7f04fc06cc00 2023-12-05T09:58:44.010 INFO:teuthology.orchestra.run.smithi100.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-05T09:58:44.010 INFO:teuthology.orchestra.run.smithi100.stdout:alertmanager.smithi100 smithi100 *:9093,9094 running (86s) 36s ago 8m 15.8M - 0.25.0 c8568f914cd2 f443e6a4242b 2023-12-05T09:58:44.010 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi100 smithi100 running (9m) 36s ago 9m 7822k - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 6379a3185d48 2023-12-05T09:58:44.010 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi150 smithi150 running (8m) 38s ago 8m 7826k - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 349d37092dbd 2023-12-05T09:58:44.011 INFO:teuthology.orchestra.run.smithi100.stdout:grafana.smithi100 smithi100 *:3000 running (77s) 36s ago 8m 79.4M - 9.4.7 2c41d148cca3 d666da9c4e4d 2023-12-05T09:58:44.011 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.akmstb smithi100 running (4m) 36s ago 4m 5824M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 6ce55c42c55b 2023-12-05T09:58:44.011 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.sqplhn smithi100 running (4m) 36s ago 4m 13.9M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc c2682d65f0c9 2023-12-05T09:58:44.011 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi150.fcnhsv smithi150 running (4m) 38s ago 4m 13.6M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 1a259762235d 2023-12-05T09:58:44.011 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi150.pcbpxm smithi150 running (4m) 38s ago 4m 13.6M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 27f730f8b9f9 2023-12-05T09:58:44.011 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi100.ehmuhg smithi100 *:8443,9283,8765 running (54s) 36s ago 10m 480M - 19.0.0-11-g3fe8d441 56dea28e5206 ebe3dfbb0356 2023-12-05T09:58:44.012 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi150.zkskag smithi150 *:8443,9283,8765 starting - - - - 2023-12-05T09:58:44.012 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi100 smithi100 running (10m) 36s ago 10m 89.6M 2048M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 8e091d6081cc 2023-12-05T09:58:44.012 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi150 smithi150 running (7m) 38s ago 7m 59.4M 2048M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 05fe70420b09 2023-12-05T09:58:44.012 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi100 smithi100 *:9100 running (94s) 36s ago 8m 8388k - 1.5.0 0da6a335fe13 a2653da0d840 2023-12-05T09:58:44.012 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi150 smithi150 *:9100 running (64s) 38s ago 7m 8396k - 1.5.0 0da6a335fe13 67523645e73b 2023-12-05T09:58:44.013 INFO:teuthology.orchestra.run.smithi100.stdout:osd.0 smithi100 running (7m) 36s ago 7m 524M 1618M 17.2.7-109-g1fd3ca3c e139fc5fd9fc c8e64a62cd47 2023-12-05T09:58:44.013 INFO:teuthology.orchestra.run.smithi100.stdout:osd.1 smithi100 running (6m) 36s ago 6m 587M 1618M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 0500895cdfc2 2023-12-05T09:58:44.013 INFO:teuthology.orchestra.run.smithi100.stdout:osd.2 smithi100 running (6m) 36s ago 6m 439M 1618M 17.2.7-109-g1fd3ca3c e139fc5fd9fc f145372c8ccc 2023-12-05T09:58:44.013 INFO:teuthology.orchestra.run.smithi100.stdout:osd.3 smithi150 running (6m) 38s ago 6m 644M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 78137d463d29 2023-12-05T09:58:44.013 INFO:teuthology.orchestra.run.smithi100.stdout:osd.4 smithi150 running (5m) 38s ago 5m 492M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc dfef9accd162 2023-12-05T09:58:44.013 INFO:teuthology.orchestra.run.smithi100.stdout:osd.5 smithi150 running (5m) 38s ago 5m 567M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc d9720b1eae0c 2023-12-05T09:58:44.014 INFO:teuthology.orchestra.run.smithi100.stdout:prometheus.smithi100 smithi100 *:9095 starting - - - - 2023-12-05T09:58:44.017 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.015+0000 7f04fb7fe700 1 -- 172.21.15.100:0/3580478144 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7f04fc06cc00 msgr2=0x7f04fc06f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:58:44.017 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.015+0000 7f04fb7fe700 1 --2- 172.21.15.100:0/3580478144 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7f04fc06cc00 0x7f04fc06f0b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f050c013680 tx=0x7f050c009e30 comp rx=0 tx=0).stop 2023-12-05T09:58:44.017 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.015+0000 7f04fb7fe700 1 -- 172.21.15.100:0/3580478144 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05100ffd70 msgr2=0x7f051010fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:58:44.017 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.015+0000 7f04fb7fe700 1 --2- 172.21.15.100:0/3580478144 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05100ffd70 0x7f051010fc50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f050000eb40 tx=0x7f050000b040 comp rx=0 tx=0).stop 2023-12-05T09:58:44.017 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.015+0000 7f04fb7fe700 1 -- 172.21.15.100:0/3580478144 shutdown_connections 2023-12-05T09:58:44.017 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.015+0000 7f04fb7fe700 1 --2- 172.21.15.100:0/3580478144 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7f04fc06cc00 0x7f04fc06f0b0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:44.017 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.015+0000 7f04fb7fe700 1 --2- 172.21.15.100:0/3580478144 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0510066090 0x7f051010f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:44.018 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.015+0000 7f04fb7fe700 1 --2- 172.21.15.100:0/3580478144 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05100ffd70 0x7f051010fc50 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:44.018 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.015+0000 7f04fb7fe700 1 -- 172.21.15.100:0/3580478144 >> 172.21.15.100:0/3580478144 conn(0x7f05100f7190 msgr2=0x7f0510100a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:58:44.018 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.015+0000 7f04fb7fe700 1 -- 172.21.15.100:0/3580478144 shutdown_connections 2023-12-05T09:58:44.018 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.015+0000 7f04fb7fe700 1 -- 172.21.15.100:0/3580478144 wait complete. 2023-12-05T09:58:44.203 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.206+0000 7fb501037700 1 -- 172.21.15.100:0/690571089 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4fc06e210 msgr2=0x7fb4fc06e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:58:44.204 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.206+0000 7fb501037700 1 --2- 172.21.15.100:0/690571089 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4fc06e210 0x7fb4fc06e620 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec004940 tx=0x7fb4ec009e30 comp rx=0 tx=0).stop 2023-12-05T09:58:44.204 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.206+0000 7fb501037700 1 -- 172.21.15.100:0/690571089 shutdown_connections 2023-12-05T09:58:44.204 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.206+0000 7fb501037700 1 --2- 172.21.15.100:0/690571089 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4fc06eb60 0x7fb4fc108c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:44.205 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.206+0000 7fb501037700 1 --2- 172.21.15.100:0/690571089 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4fc06e210 0x7fb4fc06e620 secure :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec004940 tx=0x7fb4ec009e30 comp rx=0 tx=0).stop 2023-12-05T09:58:44.205 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.206+0000 7fb501037700 1 -- 172.21.15.100:0/690571089 >> 172.21.15.100:0/690571089 conn(0x7fb4fc069b20 msgr2=0x7fb4fc06bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:58:44.205 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.207+0000 7fb501037700 1 -- 172.21.15.100:0/690571089 shutdown_connections 2023-12-05T09:58:44.205 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.207+0000 7fb501037700 1 -- 172.21.15.100:0/690571089 wait complete. 2023-12-05T09:58:44.205 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.208+0000 7fb501037700 1 Processor -- start 2023-12-05T09:58:44.206 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.209+0000 7fb501037700 1 -- start start 2023-12-05T09:58:44.207 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.209+0000 7fb501037700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4fc06eb60 0x7fb4fc11c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:58:44.207 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.209+0000 7fb501037700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4fc11c9d0 0x7fb4fc11d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:58:44.207 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.209+0000 7fb501037700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4fc11ce90 con 0x7fb4fc06eb60 2023-12-05T09:58:44.207 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.209+0000 7fb501037700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4fc11cfd0 con 0x7fb4fc11c9d0 2023-12-05T09:58:44.208 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.210+0000 7fb4fad9d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4fc06eb60 0x7fb4fc11c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:58:44.208 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.210+0000 7fb4fa59c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4fc11c9d0 0x7fb4fc11d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:58:44.208 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.210+0000 7fb4fa59c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4fc11c9d0 0x7fb4fc11d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.100:32790/0 (socket says 172.21.15.100:32790) 2023-12-05T09:58:44.208 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.210+0000 7fb4fa59c700 1 -- 172.21.15.100:0/1484360717 learned_addr learned my addr 172.21.15.100:0/1484360717 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:58:44.208 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.211+0000 7fb4fa59c700 1 -- 172.21.15.100:0/1484360717 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4fc06eb60 msgr2=0x7fb4fc11c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:58:44.209 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.211+0000 7fb4fa59c700 1 --2- 172.21.15.100:0/1484360717 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4fc06eb60 0x7fb4fc11c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:44.209 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.211+0000 7fb4fa59c700 1 -- 172.21.15.100:0/1484360717 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4ec005040 con 0x7fb4fc11c9d0 2023-12-05T09:58:44.209 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.212+0000 7fb4fa59c700 1 --2- 172.21.15.100:0/1484360717 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4fc11c9d0 0x7fb4fc11d870 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb4f000eb70 tx=0x7fb4f000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:58:44.210 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.212+0000 7fb4e37fe700 1 -- 172.21.15.100:0/1484360717 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb4f0007cc0 con 0x7fb4fc11c9d0 2023-12-05T09:58:44.211 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.213+0000 7fb4e37fe700 1 -- 172.21.15.100:0/1484360717 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb4f000f040 con 0x7fb4fc11c9d0 2023-12-05T09:58:44.211 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.213+0000 7fb4e37fe700 1 -- 172.21.15.100:0/1484360717 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb4f000cad0 con 0x7fb4fc11c9d0 2023-12-05T09:58:44.211 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.213+0000 7fb501037700 1 -- 172.21.15.100:0/1484360717 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4fc11de70 con 0x7fb4fc11c9d0 2023-12-05T09:58:44.212 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.213+0000 7fb501037700 1 -- 172.21.15.100:0/1484360717 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4fc11e380 con 0x7fb4fc11c9d0 2023-12-05T09:58:44.217 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.218+0000 7fb4e37fe700 1 -- 172.21.15.100:0/1484360717 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 31) v1 ==== 90901+0+0 (secure 0 0 0) 0x7fb4f000cc30 con 0x7fb4fc11c9d0 2023-12-05T09:58:44.217 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.218+0000 7fb501037700 1 -- 172.21.15.100:0/1484360717 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4fc116400 con 0x7fb4fc11c9d0 2023-12-05T09:58:44.217 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.219+0000 7fb4e37fe700 1 --2- 172.21.15.100:0/1484360717 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7fb4e406cd90 0x7fb4e406f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:58:44.218 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.219+0000 7fb4e37fe700 1 -- 172.21.15.100:0/1484360717 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fb4f008ba70 con 0x7fb4fc11c9d0 2023-12-05T09:58:44.218 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.220+0000 7fb4fad9d700 1 --2- 172.21.15.100:0/1484360717 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7fb4e406cd90 0x7fb4e406f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:58:44.218 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.221+0000 7fb4fad9d700 1 --2- 172.21.15.100:0/1484360717 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7fb4e406cd90 0x7fb4e406f240 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec000c00 tx=0x7fb4ec009e30 comp rx=0 tx=0).ready entity=mgr.24533 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:58:44.224 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.227+0000 7fb4e37fe700 1 -- 172.21.15.100:0/1484360717 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fb4f0059750 con 0x7fb4fc11c9d0 2023-12-05T09:58:44.454 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:44 smithi100 ceph-mon[107145]: from='client.14778 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:58:44.459 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:44 smithi150 ceph-mon[116142]: from='client.14778 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:58:44.667 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.669+0000 7fb501037700 1 -- 172.21.15.100:0/1484360717 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb4fc11e660 con 0x7fb4fc11c9d0 2023-12-05T09:58:44.667 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.670+0000 7fb4e37fe700 1 -- 172.21.15.100:0/1484360717 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+733 (secure 0 0 0) 0x7fb4f0019070 con 0x7fb4fc11c9d0 2023-12-05T09:58:44.667 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2023-12-05T09:58:44.667 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": { 2023-12-05T09:58:44.667 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 2 2023-12-05T09:58:44.668 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-12-05T09:58:44.668 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": { 2023-12-05T09:58:44.668 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 2 2023-12-05T09:58:44.668 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-12-05T09:58:44.668 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": { 2023-12-05T09:58:44.668 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 6 2023-12-05T09:58:44.668 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-12-05T09:58:44.668 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": { 2023-12-05T09:58:44.668 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 4 2023-12-05T09:58:44.668 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-12-05T09:58:44.668 INFO:teuthology.orchestra.run.smithi100.stdout: "overall": { 2023-12-05T09:58:44.668 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 12, 2023-12-05T09:58:44.668 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 2 2023-12-05T09:58:44.668 INFO:teuthology.orchestra.run.smithi100.stdout: } 2023-12-05T09:58:44.669 INFO:teuthology.orchestra.run.smithi100.stdout:} 2023-12-05T09:58:44.670 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.672+0000 7fb501037700 1 -- 172.21.15.100:0/1484360717 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7fb4e406cd90 msgr2=0x7fb4e406f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:58:44.670 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.672+0000 7fb501037700 1 --2- 172.21.15.100:0/1484360717 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7fb4e406cd90 0x7fb4e406f240 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec000c00 tx=0x7fb4ec009e30 comp rx=0 tx=0).stop 2023-12-05T09:58:44.670 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.672+0000 7fb501037700 1 -- 172.21.15.100:0/1484360717 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4fc11c9d0 msgr2=0x7fb4fc11d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:58:44.671 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.672+0000 7fb501037700 1 --2- 172.21.15.100:0/1484360717 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4fc11c9d0 0x7fb4fc11d870 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb4f000eb70 tx=0x7fb4f000b040 comp rx=0 tx=0).stop 2023-12-05T09:58:44.671 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.672+0000 7fb501037700 1 -- 172.21.15.100:0/1484360717 shutdown_connections 2023-12-05T09:58:44.671 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.672+0000 7fb501037700 1 --2- 172.21.15.100:0/1484360717 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7fb4e406cd90 0x7fb4e406f240 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:44.671 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.672+0000 7fb501037700 1 --2- 172.21.15.100:0/1484360717 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4fc06eb60 0x7fb4fc11c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:44.671 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.672+0000 7fb501037700 1 --2- 172.21.15.100:0/1484360717 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4fc11c9d0 0x7fb4fc11d870 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:44.671 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.672+0000 7fb501037700 1 -- 172.21.15.100:0/1484360717 >> 172.21.15.100:0/1484360717 conn(0x7fb4fc069b20 msgr2=0x7fb4fc1074e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:58:44.671 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.673+0000 7fb501037700 1 -- 172.21.15.100:0/1484360717 shutdown_connections 2023-12-05T09:58:44.671 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.673+0000 7fb501037700 1 -- 172.21.15.100:0/1484360717 wait complete. 2023-12-05T09:58:44.906 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.909+0000 7f509ef0e700 1 -- 172.21.15.100:0/2790594178 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50980fcbf0 msgr2=0x7f50980fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:58:44.906 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.909+0000 7f509ef0e700 1 --2- 172.21.15.100:0/2790594178 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50980fcbf0 0x7f50980fd000 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f508c004940 tx=0x7f508c009e30 comp rx=0 tx=0).stop 2023-12-05T09:58:44.907 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.910+0000 7f509ef0e700 1 -- 172.21.15.100:0/2790594178 shutdown_connections 2023-12-05T09:58:44.907 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.910+0000 7f509ef0e700 1 --2- 172.21.15.100:0/2790594178 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50980fde00 0x7f50980fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:44.907 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.910+0000 7f509ef0e700 1 --2- 172.21.15.100:0/2790594178 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50980fcbf0 0x7f50980fd000 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:44.907 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.910+0000 7f509ef0e700 1 -- 172.21.15.100:0/2790594178 >> 172.21.15.100:0/2790594178 conn(0x7f50980f82d0 msgr2=0x7f50980fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:58:44.908 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.910+0000 7f509ef0e700 1 -- 172.21.15.100:0/2790594178 shutdown_connections 2023-12-05T09:58:44.908 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.910+0000 7f509ef0e700 1 -- 172.21.15.100:0/2790594178 wait complete. 2023-12-05T09:58:44.908 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.911+0000 7f509ef0e700 1 Processor -- start 2023-12-05T09:58:44.912 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.911+0000 7f509ef0e700 1 -- start start 2023-12-05T09:58:44.913 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.912+0000 7f509ef0e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50980fcbf0 0x7f509806ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:58:44.913 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.912+0000 7f509ef0e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50980fde00 0x7f509806f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:58:44.913 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.912+0000 7f509ef0e700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5098117150 con 0x7f50980fcbf0 2023-12-05T09:58:44.913 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.912+0000 7f509ef0e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50981172c0 con 0x7f50980fde00 2023-12-05T09:58:44.913 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.912+0000 7f5097fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50980fde00 0x7f509806f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:58:44.913 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.913+0000 7f5097fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50980fde00 0x7f509806f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.100:32812/0 (socket says 172.21.15.100:32812) 2023-12-05T09:58:44.913 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.913+0000 7f5097fff700 1 -- 172.21.15.100:0/1538581720 learned_addr learned my addr 172.21.15.100:0/1538581720 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:58:44.913 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.913+0000 7f509ccaa700 1 --2- 172.21.15.100:0/1538581720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50980fcbf0 0x7f509806ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:58:44.913 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.914+0000 7f5097fff700 1 -- 172.21.15.100:0/1538581720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50980fcbf0 msgr2=0x7f509806ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:58:44.913 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.914+0000 7f5097fff700 1 --2- 172.21.15.100:0/1538581720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50980fcbf0 0x7f509806ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:44.913 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.914+0000 7f5097fff700 1 -- 172.21.15.100:0/1538581720 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f508c005040 con 0x7f50980fde00 2023-12-05T09:58:44.913 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.915+0000 7f5097fff700 1 --2- 172.21.15.100:0/1538581720 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50980fde00 0x7f509806f380 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5084002a50 tx=0x7f50840046b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:58:44.914 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.915+0000 7f50957fa700 1 -- 172.21.15.100:0/1538581720 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5084007cc0 con 0x7f50980fde00 2023-12-05T09:58:44.914 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.915+0000 7f50957fa700 1 -- 172.21.15.100:0/1538581720 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f508400f040 con 0x7f50980fde00 2023-12-05T09:58:44.914 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.915+0000 7f50957fa700 1 -- 172.21.15.100:0/1538581720 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50840094d0 con 0x7f50980fde00 2023-12-05T09:58:44.914 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.917+0000 7f509ef0e700 1 -- 172.21.15.100:0/1538581720 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5098117540 con 0x7f50980fde00 2023-12-05T09:58:44.914 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.917+0000 7f509ef0e700 1 -- 172.21.15.100:0/1538581720 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5098117a50 con 0x7f50980fde00 2023-12-05T09:58:44.916 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.918+0000 7f509ef0e700 1 -- 172.21.15.100:0/1538581720 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f509804bb80 con 0x7f50980fde00 2023-12-05T09:58:44.920 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.921+0000 7f50957fa700 1 -- 172.21.15.100:0/1538581720 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 31) v1 ==== 90901+0+0 (secure 0 0 0) 0x7f5084009630 con 0x7f50980fde00 2023-12-05T09:58:44.920 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.922+0000 7f50957fa700 1 --2- 172.21.15.100:0/1538581720 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7f508806cc50 0x7f508806f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:58:44.920 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.922+0000 7f50957fa700 1 -- 172.21.15.100:0/1538581720 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f508408b780 con 0x7f50980fde00 2023-12-05T09:58:44.920 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.923+0000 7f509ccaa700 1 --2- 172.21.15.100:0/1538581720 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7f508806cc50 0x7f508806f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:58:44.923 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.924+0000 7f509ccaa700 1 --2- 172.21.15.100:0/1538581720 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7f508806cc50 0x7f508806f100 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f508c00b3b0 tx=0x7f508c009e30 comp rx=0 tx=0).ready entity=mgr.24533 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:58:44.931 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:44.933+0000 7f50957fa700 1 -- 172.21.15.100:0/1538581720 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f50840558a0 con 0x7f50980fde00 2023-12-05T09:58:45.345 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:45 smithi150 ceph-mon[116142]: from='client.14782 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:58:45.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:45 smithi150 ceph-mon[116142]: pgmap v24: 65 pgs: 65 active+clean; 309 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 44 KiB/s rd, 2.5 MiB/s wr, 1.25k op/s 2023-12-05T09:58:45.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:45 smithi150 ceph-mon[116142]: from='client.24599 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:58:45.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:45 smithi150 ceph-mon[116142]: from='client.? 172.21.15.100:0/1484360717' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:58:45.437 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:45.439+0000 7f509ef0e700 1 -- 172.21.15.100:0/1538581720 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5098105590 con 0x7f50980fde00 2023-12-05T09:58:45.438 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:45.440+0000 7f50957fa700 1 -- 172.21.15.100:0/1538581720 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1814 (secure 0 0 0) 0x7f5084089e60 con 0x7f50980fde00 2023-12-05T09:58:45.438 INFO:teuthology.orchestra.run.smithi100.stdout:e13 2023-12-05T09:58:45.438 INFO:teuthology.orchestra.run.smithi100.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-05T09:58:45.438 INFO:teuthology.orchestra.run.smithi100.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T09:58:45.439 INFO:teuthology.orchestra.run.smithi100.stdout:legacy client fscid: 1 2023-12-05T09:58:45.439 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:58:45.439 INFO:teuthology.orchestra.run.smithi100.stdout:Filesystem 'cephfs' (1) 2023-12-05T09:58:45.439 INFO:teuthology.orchestra.run.smithi100.stdout:fs_name cephfs 2023-12-05T09:58:45.439 INFO:teuthology.orchestra.run.smithi100.stdout:epoch 13 2023-12-05T09:58:45.439 INFO:teuthology.orchestra.run.smithi100.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-05T09:58:45.439 INFO:teuthology.orchestra.run.smithi100.stdout:created 2023-12-05T09:54:30.515778+0000 2023-12-05T09:58:45.439 INFO:teuthology.orchestra.run.smithi100.stdout:modified 2023-12-05T09:54:46.403009+0000 2023-12-05T09:58:45.439 INFO:teuthology.orchestra.run.smithi100.stdout:tableserver 0 2023-12-05T09:58:45.439 INFO:teuthology.orchestra.run.smithi100.stdout:root 0 2023-12-05T09:58:45.440 INFO:teuthology.orchestra.run.smithi100.stdout:session_timeout 60 2023-12-05T09:58:45.440 INFO:teuthology.orchestra.run.smithi100.stdout:session_autoclose 300 2023-12-05T09:58:45.440 INFO:teuthology.orchestra.run.smithi100.stdout:max_file_size 1099511627776 2023-12-05T09:58:45.440 INFO:teuthology.orchestra.run.smithi100.stdout:required_client_features {} 2023-12-05T09:58:45.440 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure 0 2023-12-05T09:58:45.440 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure_osd_epoch 46 2023-12-05T09:58:45.440 INFO:teuthology.orchestra.run.smithi100.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T09:58:45.440 INFO:teuthology.orchestra.run.smithi100.stdout:max_mds 1 2023-12-05T09:58:45.440 INFO:teuthology.orchestra.run.smithi100.stdout:in 0 2023-12-05T09:58:45.441 INFO:teuthology.orchestra.run.smithi100.stdout:up {0=14490} 2023-12-05T09:58:45.441 INFO:teuthology.orchestra.run.smithi100.stdout:failed 2023-12-05T09:58:45.441 INFO:teuthology.orchestra.run.smithi100.stdout:damaged 2023-12-05T09:58:45.441 INFO:teuthology.orchestra.run.smithi100.stdout:stopped 2023-12-05T09:58:45.441 INFO:teuthology.orchestra.run.smithi100.stdout:data_pools [3] 2023-12-05T09:58:45.441 INFO:teuthology.orchestra.run.smithi100.stdout:metadata_pool 2 2023-12-05T09:58:45.441 INFO:teuthology.orchestra.run.smithi100.stdout:inline_data disabled 2023-12-05T09:58:45.441 INFO:teuthology.orchestra.run.smithi100.stdout:balancer 2023-12-05T09:58:45.441 INFO:teuthology.orchestra.run.smithi100.stdout:standby_count_wanted 1 2023-12-05T09:58:45.441 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi100.akmstb{0:14490} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.100:6828/627555128,v1:172.21.15.100:6829/627555128] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:58:45.441 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:58:45.442 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:58:45.442 INFO:teuthology.orchestra.run.smithi100.stdout:Standby daemons: 2023-12-05T09:58:45.442 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:58:45.442 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi150.pcbpxm{-1:14486} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.150:6824/3645854543,v1:172.21.15.150:6825/3645854543] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:58:45.442 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi150.fcnhsv{-1:14498} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.150:6826/3249949736,v1:172.21.15.150:6827/3249949736] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:58:45.442 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi100.sqplhn{-1:14506} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.100:6826/2472212864,v1:172.21.15.100:6827/2472212864] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:58:45.443 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:45.444+0000 7f509ef0e700 1 -- 172.21.15.100:0/1538581720 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7f508806cc50 msgr2=0x7f508806f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:58:45.443 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:45.444+0000 7f509ef0e700 1 --2- 172.21.15.100:0/1538581720 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7f508806cc50 0x7f508806f100 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f508c00b3b0 tx=0x7f508c009e30 comp rx=0 tx=0).stop 2023-12-05T09:58:45.443 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:45.444+0000 7f509ef0e700 1 -- 172.21.15.100:0/1538581720 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50980fde00 msgr2=0x7f509806f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:58:45.443 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:45.444+0000 7f509ef0e700 1 --2- 172.21.15.100:0/1538581720 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50980fde00 0x7f509806f380 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5084002a50 tx=0x7f50840046b0 comp rx=0 tx=0).stop 2023-12-05T09:58:45.443 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:45.445+0000 7f509ef0e700 1 -- 172.21.15.100:0/1538581720 shutdown_connections 2023-12-05T09:58:45.443 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:45.445+0000 7f509ef0e700 1 --2- 172.21.15.100:0/1538581720 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7f508806cc50 0x7f508806f100 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:45.443 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:45.445+0000 7f509ef0e700 1 --2- 172.21.15.100:0/1538581720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50980fcbf0 0x7f509806ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:45.443 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:45.445+0000 7f509ef0e700 1 --2- 172.21.15.100:0/1538581720 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50980fde00 0x7f509806f380 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:45.443 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:45.445+0000 7f509ef0e700 1 -- 172.21.15.100:0/1538581720 >> 172.21.15.100:0/1538581720 conn(0x7f50980f82d0 msgr2=0x7f5098101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:58:45.444 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:45.445+0000 7f509ef0e700 1 -- 172.21.15.100:0/1538581720 shutdown_connections 2023-12-05T09:58:45.444 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:45.446+0000 7f509ef0e700 1 -- 172.21.15.100:0/1538581720 wait complete. 2023-12-05T09:58:45.446 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 13 2023-12-05T09:58:45.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:45 smithi100 ceph-mon[107145]: from='client.14782 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:58:45.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:45 smithi100 ceph-mon[107145]: pgmap v24: 65 pgs: 65 active+clean; 309 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 44 KiB/s rd, 2.5 MiB/s wr, 1.25k op/s 2023-12-05T09:58:45.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:45 smithi100 ceph-mon[107145]: from='client.24599 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:58:45.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:45 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/1484360717' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:58:45.695 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:45.696+0000 7f867aefc700 1 -- 172.21.15.100:0/1992118393 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8674071bc0 msgr2=0x7f8674070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:58:45.695 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:45.696+0000 7f867aefc700 1 --2- 172.21.15.100:0/1992118393 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8674071bc0 0x7f8674070030 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8668004880 tx=0x7f8668009e30 comp rx=0 tx=0).stop 2023-12-05T09:58:45.695 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:45.697+0000 7f867aefc700 1 -- 172.21.15.100:0/1992118393 shutdown_connections 2023-12-05T09:58:45.696 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:45.697+0000 7f867aefc700 1 --2- 172.21.15.100:0/1992118393 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8674070570 0x7f86740709c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:45.696 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:45.697+0000 7f867aefc700 1 --2- 172.21.15.100:0/1992118393 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8674071bc0 0x7f8674070030 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:45.696 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:45.697+0000 7f867aefc700 1 -- 172.21.15.100:0/1992118393 >> 172.21.15.100:0/1992118393 conn(0x7f86740f82d0 msgr2=0x7f86740fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:58:45.696 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:45.697+0000 7f867aefc700 1 -- 172.21.15.100:0/1992118393 shutdown_connections 2023-12-05T09:58:45.696 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:45.697+0000 7f867aefc700 1 -- 172.21.15.100:0/1992118393 wait complete. 2023-12-05T09:58:45.697 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:45.699+0000 7f867aefc700 1 Processor -- start 2023-12-05T09:58:45.697 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:45.699+0000 7f867aefc700 1 -- start start 2023-12-05T09:58:45.697 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:45.700+0000 7f867aefc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8674070570 0x7f867406ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:58:45.698 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:45.700+0000 7f867aefc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8674071bc0 0x7f867406f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:58:45.698 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:45.701+0000 7f867aefc700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867406f8b0 con 0x7f8674071bc0 2023-12-05T09:58:45.699 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:45.701+0000 7f8678c98700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8674070570 0x7f867406ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:58:45.699 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:45.701+0000 7f8678c98700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8674070570 0x7f867406ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.100:32840/0 (socket says 172.21.15.100:32840) 2023-12-05T09:58:45.699 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:45.701+0000 7f8678c98700 1 -- 172.21.15.100:0/1092870871 learned_addr learned my addr 172.21.15.100:0/1092870871 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:58:45.699 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:45.701+0000 7f867aefc700 1 -- 172.21.15.100:0/1092870871 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867411d6b0 con 0x7f8674070570 2023-12-05T09:58:45.700 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:45.701+0000 7f8673fff700 1 --2- 172.21.15.100:0/1092870871 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8674071bc0 0x7f867406f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:58:45.700 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:45.702+0000 7f8678c98700 1 -- 172.21.15.100:0/1092870871 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8674071bc0 msgr2=0x7f867406f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:58:45.700 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:45.702+0000 7f8678c98700 1 --2- 172.21.15.100:0/1092870871 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8674071bc0 0x7f867406f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:45.700 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:45.702+0000 7f8678c98700 1 -- 172.21.15.100:0/1092870871 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8668005040 con 0x7f8674070570 2023-12-05T09:58:45.700 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:45.702+0000 7f8673fff700 1 --2- 172.21.15.100:0/1092870871 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8674071bc0 0x7f867406f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-05T09:58:45.700 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:45.702+0000 7f8678c98700 1 --2- 172.21.15.100:0/1092870871 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8674070570 0x7f867406ed20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f86680040d0 tx=0x7f8668009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:58:45.701 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:45.703+0000 7f86717fa700 1 -- 172.21.15.100:0/1092870871 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f866800e030 con 0x7f8674070570 2023-12-05T09:58:45.701 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:45.703+0000 7f86717fa700 1 -- 172.21.15.100:0/1092870871 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f866801c400 con 0x7f8674070570 2023-12-05T09:58:45.702 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:45.703+0000 7f86717fa700 1 -- 172.21.15.100:0/1092870871 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f866800e030 con 0x7f8674070570 2023-12-05T09:58:45.702 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:45.703+0000 7f867aefc700 1 -- 172.21.15.100:0/1092870871 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f867411d8a0 con 0x7f8674070570 2023-12-05T09:58:45.703 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:45.703+0000 7f867aefc700 1 -- 172.21.15.100:0/1092870871 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f867411dde0 con 0x7f8674070570 2023-12-05T09:58:45.703 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:45.705+0000 7f867aefc700 1 -- 172.21.15.100:0/1092870871 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f867404bb80 con 0x7f8674070570 2023-12-05T09:58:45.706 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:45.707+0000 7f86717fa700 1 -- 172.21.15.100:0/1092870871 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 31) v1 ==== 90901+0+0 (secure 0 0 0) 0x7f866801c570 con 0x7f8674070570 2023-12-05T09:58:45.706 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:45.709+0000 7f86717fa700 1 --2- 172.21.15.100:0/1092870871 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7f866406cc60 0x7f866406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:58:45.707 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:45.709+0000 7f8673fff700 1 --2- 172.21.15.100:0/1092870871 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7f866406cc60 0x7f866406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:58:45.707 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:45.709+0000 7f86717fa700 1 -- 172.21.15.100:0/1092870871 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f866808da10 con 0x7f8674070570 2023-12-05T09:58:45.708 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:45.710+0000 7f8673fff700 1 --2- 172.21.15.100:0/1092870871 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7f866406cc60 0x7f866406f110 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8660007fd0 tx=0x7f866000b040 comp rx=0 tx=0).ready entity=mgr.24533 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:58:45.712 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:45.714+0000 7f86717fa700 1 -- 172.21.15.100:0/1092870871 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f8668057bb0 con 0x7f8674070570 2023-12-05T09:58:46.051 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:46.054+0000 7f867aefc700 1 -- 172.21.15.100:0/1092870871 --> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f86740ffd50 con 0x7f866406cc60 2023-12-05T09:58:46.053 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2023-12-05T09:58:46.054 INFO:teuthology.orchestra.run.smithi100.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ff918c95653912ae4c171d8d1db5f5eabc756f85ff7e3ce78f13f9c521198459", 2023-12-05T09:58:46.054 INFO:teuthology.orchestra.run.smithi100.stdout: "in_progress": true, 2023-12-05T09:58:46.054 INFO:teuthology.orchestra.run.smithi100.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-05T09:58:46.054 INFO:teuthology.orchestra.run.smithi100.stdout: "services_complete": [ 2023-12-05T09:58:46.054 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr" 2023-12-05T09:58:46.054 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2023-12-05T09:58:46.054 INFO:teuthology.orchestra.run.smithi100.stdout: "progress": "2/21 daemons upgraded", 2023-12-05T09:58:46.054 INFO:teuthology.orchestra.run.smithi100.stdout: "message": "Currently upgrading mgr daemons", 2023-12-05T09:58:46.054 INFO:teuthology.orchestra.run.smithi100.stdout: "is_paused": false 2023-12-05T09:58:46.054 INFO:teuthology.orchestra.run.smithi100.stdout:} 2023-12-05T09:58:46.054 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:46.056+0000 7f86717fa700 1 -- 172.21.15.100:0/1092870871 <== mgr.24533 v2:172.21.15.100:6800/3060005571 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f86740ffd50 con 0x7f866406cc60 2023-12-05T09:58:46.057 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:46.060+0000 7f867aefc700 1 -- 172.21.15.100:0/1092870871 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7f866406cc60 msgr2=0x7f866406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:58:46.058 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:46.060+0000 7f867aefc700 1 --2- 172.21.15.100:0/1092870871 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7f866406cc60 0x7f866406f110 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8660007fd0 tx=0x7f866000b040 comp rx=0 tx=0).stop 2023-12-05T09:58:46.058 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:46.060+0000 7f867aefc700 1 -- 172.21.15.100:0/1092870871 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8674070570 msgr2=0x7f867406ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:58:46.058 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:46.060+0000 7f867aefc700 1 --2- 172.21.15.100:0/1092870871 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8674070570 0x7f867406ed20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f86680040d0 tx=0x7f8668009e30 comp rx=0 tx=0).stop 2023-12-05T09:58:46.058 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:46.060+0000 7f867aefc700 1 -- 172.21.15.100:0/1092870871 shutdown_connections 2023-12-05T09:58:46.058 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:46.060+0000 7f867aefc700 1 --2- 172.21.15.100:0/1092870871 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7f866406cc60 0x7f866406f110 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:46.058 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:46.060+0000 7f867aefc700 1 --2- 172.21.15.100:0/1092870871 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8674070570 0x7f867406ed20 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:46.058 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:46.060+0000 7f867aefc700 1 --2- 172.21.15.100:0/1092870871 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8674071bc0 0x7f867406f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:46.058 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:46.060+0000 7f867aefc700 1 -- 172.21.15.100:0/1092870871 >> 172.21.15.100:0/1092870871 conn(0x7f86740f82d0 msgr2=0x7f86740fe630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:58:46.059 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:46.061+0000 7f867aefc700 1 -- 172.21.15.100:0/1092870871 shutdown_connections 2023-12-05T09:58:46.059 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:46.061+0000 7f867aefc700 1 -- 172.21.15.100:0/1092870871 wait complete. 2023-12-05T09:58:46.239 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:46.241+0000 7efd4e695700 1 -- 172.21.15.100:0/1796570283 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd48070570 msgr2=0x7efd480709c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:58:46.239 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:46.241+0000 7efd4e695700 1 --2- 172.21.15.100:0/1796570283 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd48070570 0x7efd480709c0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7efd3c004940 tx=0x7efd3c009e30 comp rx=0 tx=0).stop 2023-12-05T09:58:46.239 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:46.242+0000 7efd4e695700 1 -- 172.21.15.100:0/1796570283 shutdown_connections 2023-12-05T09:58:46.239 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:46.242+0000 7efd4e695700 1 --2- 172.21.15.100:0/1796570283 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd48070570 0x7efd480709c0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:46.240 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:46.242+0000 7efd4e695700 1 --2- 172.21.15.100:0/1796570283 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efd48071bc0 0x7efd48070030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:46.240 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:46.242+0000 7efd4e695700 1 -- 172.21.15.100:0/1796570283 >> 172.21.15.100:0/1796570283 conn(0x7efd480f82d0 msgr2=0x7efd480fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:58:46.240 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:46.242+0000 7efd4e695700 1 -- 172.21.15.100:0/1796570283 shutdown_connections 2023-12-05T09:58:46.240 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:46.242+0000 7efd4e695700 1 -- 172.21.15.100:0/1796570283 wait complete. 2023-12-05T09:58:46.240 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:46.243+0000 7efd4e695700 1 Processor -- start 2023-12-05T09:58:46.240 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:46.243+0000 7efd4e695700 1 -- start start 2023-12-05T09:58:46.241 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:46.243+0000 7efd4e695700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd48070570 0x7efd4810f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:58:46.241 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:46.244+0000 7efd4e695700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efd48071bc0 0x7efd4810fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:58:46.241 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:46.244+0000 7efd4e695700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd481103a0 con 0x7efd48070570 2023-12-05T09:58:46.241 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:46.244+0000 7efd4e695700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd48110c40 con 0x7efd48071bc0 2023-12-05T09:58:46.242 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:46.244+0000 7efd47fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd48070570 0x7efd4810f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:58:46.242 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:46.244+0000 7efd477fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efd48071bc0 0x7efd4810fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:58:46.242 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:46.244+0000 7efd477fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efd48071bc0 0x7efd4810fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.100:32860/0 (socket says 172.21.15.100:32860) 2023-12-05T09:58:46.242 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:46.244+0000 7efd477fe700 1 -- 172.21.15.100:0/1571505191 learned_addr learned my addr 172.21.15.100:0/1571505191 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:58:46.242 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:46.244+0000 7efd47fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd48070570 0x7efd4810f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42730/0 (socket says 172.21.15.100:42730) 2023-12-05T09:58:46.242 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:46.244+0000 7efd477fe700 1 -- 172.21.15.100:0/1571505191 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd48070570 msgr2=0x7efd4810f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:58:46.242 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:46.244+0000 7efd477fe700 1 --2- 172.21.15.100:0/1571505191 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd48070570 0x7efd4810f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:46.242 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:46.244+0000 7efd477fe700 1 -- 172.21.15.100:0/1571505191 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd3c005040 con 0x7efd48071bc0 2023-12-05T09:58:46.242 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:46.244+0000 7efd47fff700 1 --2- 172.21.15.100:0/1571505191 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd48070570 0x7efd4810f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-05T09:58:46.243 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:46.245+0000 7efd477fe700 1 --2- 172.21.15.100:0/1571505191 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efd48071bc0 0x7efd4810fda0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7efd3c009fd0 tx=0x7efd3c009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:58:46.243 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:46.245+0000 7efd44ff9700 1 -- 172.21.15.100:0/1571505191 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd3c021070 con 0x7efd48071bc0 2023-12-05T09:58:46.243 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:46.245+0000 7efd44ff9700 1 -- 172.21.15.100:0/1571505191 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7efd3c01c400 con 0x7efd48071bc0 2023-12-05T09:58:46.243 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:46.245+0000 7efd44ff9700 1 -- 172.21.15.100:0/1571505191 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd3c00e070 con 0x7efd48071bc0 2023-12-05T09:58:46.243 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:46.245+0000 7efd4e695700 1 -- 172.21.15.100:0/1571505191 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd48110ec0 con 0x7efd48071bc0 2023-12-05T09:58:46.244 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:46.245+0000 7efd4e695700 1 -- 172.21.15.100:0/1571505191 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd48111400 con 0x7efd48071bc0 2023-12-05T09:58:46.244 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:46.246+0000 7efd4e695700 1 -- 172.21.15.100:0/1571505191 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd481096f0 con 0x7efd48071bc0 2023-12-05T09:58:46.245 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:46.247+0000 7efd44ff9700 1 -- 172.21.15.100:0/1571505191 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 31) v1 ==== 90901+0+0 (secure 0 0 0) 0x7efd3c01ca00 con 0x7efd48071bc0 2023-12-05T09:58:46.247 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:46.249+0000 7efd44ff9700 1 --2- 172.21.15.100:0/1571505191 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7efd3006cc00 0x7efd3006f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:58:46.247 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:46.249+0000 7efd44ff9700 1 -- 172.21.15.100:0/1571505191 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6152+0+0 (secure 0 0 0) 0x7efd3c08d140 con 0x7efd48071bc0 2023-12-05T09:58:46.247 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:46.250+0000 7efd47fff700 1 --2- 172.21.15.100:0/1571505191 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7efd3006cc00 0x7efd3006f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:58:46.248 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:46.250+0000 7efd47fff700 1 --2- 172.21.15.100:0/1571505191 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7efd3006cc00 0x7efd3006f0b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7efd38009b80 tx=0x7efd3800b040 comp rx=0 tx=0).ready entity=mgr.24533 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:58:46.254 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:46.257+0000 7efd44ff9700 1 -- 172.21.15.100:0/1571505191 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7efd3c05acf0 con 0x7efd48071bc0 2023-12-05T09:58:46.575 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:46 smithi150 ceph-mon[116142]: from='client.? 172.21.15.100:0/1538581720' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-05T09:58:46.576 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:46 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:58:46.576 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:46 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:58:46.588 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:46.590+0000 7efd4e695700 1 -- 172.21.15.100:0/1571505191 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7efd4804bb80 con 0x7efd48071bc0 2023-12-05T09:58:46.588 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:46.591+0000 7efd44ff9700 1 -- 172.21.15.100:0/1571505191 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7efd3c05a880 con 0x7efd48071bc0 2023-12-05T09:58:46.588 INFO:teuthology.orchestra.run.smithi100.stdout:HEALTH_OK 2023-12-05T09:58:46.591 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:46.593+0000 7efd4e695700 1 -- 172.21.15.100:0/1571505191 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7efd3006cc00 msgr2=0x7efd3006f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:58:46.591 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:46.593+0000 7efd4e695700 1 --2- 172.21.15.100:0/1571505191 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7efd3006cc00 0x7efd3006f0b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7efd38009b80 tx=0x7efd3800b040 comp rx=0 tx=0).stop 2023-12-05T09:58:46.591 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:46.593+0000 7efd4e695700 1 -- 172.21.15.100:0/1571505191 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efd48071bc0 msgr2=0x7efd4810fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:58:46.591 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:46.593+0000 7efd4e695700 1 --2- 172.21.15.100:0/1571505191 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efd48071bc0 0x7efd4810fda0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7efd3c009fd0 tx=0x7efd3c009e30 comp rx=0 tx=0).stop 2023-12-05T09:58:46.591 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:46.593+0000 7efd4e695700 1 -- 172.21.15.100:0/1571505191 shutdown_connections 2023-12-05T09:58:46.591 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:46.593+0000 7efd4e695700 1 --2- 172.21.15.100:0/1571505191 >> [v2:172.21.15.100:6800/3060005571,v1:172.21.15.100:6801/3060005571] conn(0x7efd3006cc00 0x7efd3006f0b0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:46.591 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:46.593+0000 7efd4e695700 1 --2- 172.21.15.100:0/1571505191 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd48070570 0x7efd4810f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:46.591 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:46.593+0000 7efd4e695700 1 --2- 172.21.15.100:0/1571505191 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efd48071bc0 0x7efd4810fda0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:58:46.592 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:46.593+0000 7efd4e695700 1 -- 172.21.15.100:0/1571505191 >> 172.21.15.100:0/1571505191 conn(0x7efd480f82d0 msgr2=0x7efd48103310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:58:46.592 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:46.594+0000 7efd4e695700 1 -- 172.21.15.100:0/1571505191 shutdown_connections 2023-12-05T09:58:46.592 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:58:46.594+0000 7efd4e695700 1 -- 172.21.15.100:0/1571505191 wait complete. 2023-12-05T09:58:46.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:46 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/1538581720' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-05T09:58:46.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:46 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:58:46.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:46 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:58:47.647 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:47 smithi100 ceph-mon[107145]: pgmap v25: 65 pgs: 65 active+clean; 309 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.7 MiB/s wr, 963 op/s 2023-12-05T09:58:47.647 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:47 smithi100 ceph-mon[107145]: from='client.24611 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:58:47.647 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:47 smithi100 ceph-mon[107145]: from='client.? 172.21.15.100:0/1571505191' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-05T09:58:47.647 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:47 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:58:47.647 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:47 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:58:47.648 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:47 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:58:47.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:47 smithi150 ceph-mon[116142]: pgmap v25: 65 pgs: 65 active+clean; 309 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.7 MiB/s wr, 963 op/s 2023-12-05T09:58:47.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:47 smithi150 ceph-mon[116142]: from='client.24611 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:58:47.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:47 smithi150 ceph-mon[116142]: from='client.? 172.21.15.100:0/1571505191' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-05T09:58:47.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:47 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:58:47.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:47 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:58:47.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:47 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:58:49.597 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:49 smithi150 ceph-mon[116142]: pgmap v26: 65 pgs: 65 active+clean; 301 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 2.1 MiB/s wr, 1.28k op/s 2023-12-05T09:58:49.597 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:49 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:58:49.597 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:49 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:58:49.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:49 smithi100 ceph-mon[107145]: pgmap v26: 65 pgs: 65 active+clean; 301 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 2.1 MiB/s wr, 1.28k op/s 2023-12-05T09:58:49.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:49 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:58:49.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:49 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:58:51.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:51 smithi100 ceph-mon[107145]: pgmap v27: 65 pgs: 65 active+clean; 294 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 44 KiB/s rd, 2.2 MiB/s wr, 1.27k op/s 2023-12-05T09:58:51.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:51 smithi100 ceph-mon[107145]: Standby manager daemon smithi150.zkskag restarted 2023-12-05T09:58:51.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:51 smithi100 ceph-mon[107145]: Standby manager daemon smithi150.zkskag started 2023-12-05T09:58:51.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:51 smithi100 ceph-mon[107145]: from='mgr.? 172.21.15.150:0/538508957' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi150.zkskag/crt"}]: dispatch 2023-12-05T09:58:51.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:51 smithi100 ceph-mon[107145]: from='mgr.? 172.21.15.150:0/538508957' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-05T09:58:51.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:51 smithi100 ceph-mon[107145]: from='mgr.? 172.21.15.150:0/538508957' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi150.zkskag/key"}]: dispatch 2023-12-05T09:58:51.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:51 smithi100 ceph-mon[107145]: from='mgr.? 172.21.15.150:0/538508957' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-05T09:58:51.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:51 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:58:51.397 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:51 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:58:51.397 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:51 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:58:51.397 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:51 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:58:51.397 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:51 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:58:51.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:51 smithi150 ceph-mon[116142]: pgmap v27: 65 pgs: 65 active+clean; 294 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 44 KiB/s rd, 2.2 MiB/s wr, 1.27k op/s 2023-12-05T09:58:51.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:51 smithi150 ceph-mon[116142]: Standby manager daemon smithi150.zkskag restarted 2023-12-05T09:58:51.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:51 smithi150 ceph-mon[116142]: Standby manager daemon smithi150.zkskag started 2023-12-05T09:58:51.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:51 smithi150 ceph-mon[116142]: from='mgr.? 172.21.15.150:0/538508957' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi150.zkskag/crt"}]: dispatch 2023-12-05T09:58:51.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:51 smithi150 ceph-mon[116142]: from='mgr.? 172.21.15.150:0/538508957' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-05T09:58:51.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:51 smithi150 ceph-mon[116142]: from='mgr.? 172.21.15.150:0/538508957' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi150.zkskag/key"}]: dispatch 2023-12-05T09:58:51.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:51 smithi150 ceph-mon[116142]: from='mgr.? 172.21.15.150:0/538508957' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-05T09:58:51.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:51 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:58:51.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:51 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:58:51.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:51 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:58:51.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:51 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:58:51.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:51 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:58:52.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:52 smithi100 ceph-mon[107145]: mgrmap e32: smithi100.ehmuhg(active, since 49s), standbys: smithi150.zkskag 2023-12-05T09:58:52.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:52 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:58:52.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:52 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:58:52.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:52 smithi100 ceph-mon[107145]: Upgrade: Setting container_image for all mgr 2023-12-05T09:58:52.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:52 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:58:52.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:52 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi100.ehmuhg"}]: dispatch 2023-12-05T09:58:52.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:52 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi100.ehmuhg"}]': finished 2023-12-05T09:58:52.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:52 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi150.zkskag"}]: dispatch 2023-12-05T09:58:52.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:52 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi150.zkskag"}]': finished 2023-12-05T09:58:52.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:52 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "quorum_status"}]: dispatch 2023-12-05T09:58:52.595 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:52 smithi150 ceph-mon[116142]: mgrmap e32: smithi100.ehmuhg(active, since 49s), standbys: smithi150.zkskag 2023-12-05T09:58:52.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:52 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:58:52.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:52 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:58:52.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:52 smithi150 ceph-mon[116142]: Upgrade: Setting container_image for all mgr 2023-12-05T09:58:52.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:52 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:58:52.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:52 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi100.ehmuhg"}]: dispatch 2023-12-05T09:58:52.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:52 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi100.ehmuhg"}]': finished 2023-12-05T09:58:52.597 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:52 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi150.zkskag"}]: dispatch 2023-12-05T09:58:52.597 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:52 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi150.zkskag"}]': finished 2023-12-05T09:58:52.597 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:52 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "quorum_status"}]: dispatch 2023-12-05T09:58:53.595 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:53 smithi150 ceph-mon[116142]: pgmap v28: 65 pgs: 65 active+clean; 294 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.7 MiB/s wr, 878 op/s 2023-12-05T09:58:53.595 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:53 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:58:53.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:53 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-05T09:58:53.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:53 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-05T09:58:53.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:53 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:58:53.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:53 smithi100 ceph-mon[107145]: pgmap v28: 65 pgs: 65 active+clean; 294 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.7 MiB/s wr, 878 op/s 2023-12-05T09:58:53.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:53 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:58:53.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:53 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-05T09:58:53.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:53 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-05T09:58:53.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:53 smithi100 ceph-mon[107145]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:58:54.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:54 smithi100 ceph-mon[107145]: Upgrade: Updating mon.smithi100 2023-12-05T09:58:54.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:54 smithi100 ceph-mon[107145]: Deploying daemon mon.smithi100 on smithi100 2023-12-05T09:58:54.595 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:54 smithi150 ceph-mon[116142]: Upgrade: Updating mon.smithi100 2023-12-05T09:58:54.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:54 smithi150 ceph-mon[116142]: Deploying daemon mon.smithi100 on smithi100 2023-12-05T09:58:55.124 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:54 smithi100 systemd[1]: Stopping Ceph mon.smithi100 for 5b035ce6-9353-11ee-95a2-87774f69a715... 2023-12-05T09:58:55.376 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:55 smithi100 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-mon-smithi100[107122]: 2023-12-05T09:58:55.125+0000 7f925a893700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi100 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-05T09:58:55.376 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:55 smithi100 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-mon-smithi100[107122]: 2023-12-05T09:58:55.125+0000 7f925a893700 -1 mon.smithi100@0(leader) e2 *** Got Signal Terminated *** 2023-12-05T09:58:55.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:55 smithi100 bash[187333]: ceph-5b035ce6-9353-11ee-95a2-87774f69a715-mon-smithi100 2023-12-05T09:58:56.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:55 smithi100 systemd[1]: ceph-5b035ce6-9353-11ee-95a2-87774f69a715@mon.smithi100.service: Succeeded. 2023-12-05T09:58:56.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:55 smithi100 systemd[1]: Stopped Ceph mon.smithi100 for 5b035ce6-9353-11ee-95a2-87774f69a715. 2023-12-05T09:58:56.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 systemd[1]: Starting Ceph mon.smithi100 for 5b035ce6-9353-11ee-95a2-87774f69a715... 2023-12-05T09:58:57.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 bash[187490]: 21003fd7eaf43fd51b4c1ac115ae59e06510cb234fb4117fac1919344b174b1e 2023-12-05T09:58:57.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 systemd[1]: Started Ceph mon.smithi100 for 5b035ce6-9353-11ee-95a2-87774f69a715. 2023-12-05T09:58:57.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: set uid:gid to 167:167 (ceph:ceph) 2023-12-05T09:58:57.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev), process ceph-mon, pid 7 2023-12-05T09:58:57.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: pidfile_write: ignore empty --pid-file 2023-12-05T09:58:57.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: load: jerasure load: lrc 2023-12-05T09:58:57.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: RocksDB version: 7.9.2 2023-12-05T09:58:57.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Git sha 0 2023-12-05T09:58:57.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Compile date 2023-12-05 07:02:20 2023-12-05T09:58:57.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: DB SUMMARY 2023-12-05T09:58:57.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: DB Session ID: KZA5N814WI6Q0RFM8U7X 2023-12-05T09:58:57.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: CURRENT file: CURRENT 2023-12-05T09:58:57.397 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: IDENTITY file: IDENTITY 2023-12-05T09:58:57.397 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: MANIFEST file: MANIFEST-000015 size: 971 Bytes 2023-12-05T09:58:57.397 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi100/store.db dir, Total Num: 1, files: 000030.sst 2023-12-05T09:58:57.397 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi100/store.db: 000028.log size: 302887 ; 2023-12-05T09:58:57.397 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.error_if_exists: 0 2023-12-05T09:58:57.397 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.create_if_missing: 0 2023-12-05T09:58:57.397 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.paranoid_checks: 1 2023-12-05T09:58:57.397 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.flush_verify_memtable_count: 1 2023-12-05T09:58:57.397 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-12-05T09:58:57.397 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-12-05T09:58:57.397 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.env: 0x55c905390a60 2023-12-05T09:58:57.397 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.fs: PosixFileSystem 2023-12-05T09:58:57.397 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.info_log: 0x55c90661d640 2023-12-05T09:58:57.397 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.max_file_opening_threads: 16 2023-12-05T09:58:57.398 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.statistics: (nil) 2023-12-05T09:58:57.398 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.use_fsync: 0 2023-12-05T09:58:57.398 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.max_log_file_size: 0 2023-12-05T09:58:57.398 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-12-05T09:58:57.398 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.log_file_time_to_roll: 0 2023-12-05T09:58:57.398 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.keep_log_file_num: 1000 2023-12-05T09:58:57.398 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.recycle_log_file_num: 0 2023-12-05T09:58:57.398 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.allow_fallocate: 1 2023-12-05T09:58:57.398 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.allow_mmap_reads: 0 2023-12-05T09:58:57.398 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.allow_mmap_writes: 0 2023-12-05T09:58:57.398 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.use_direct_reads: 0 2023-12-05T09:58:57.398 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-12-05T09:58:57.398 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.create_missing_column_families: 0 2023-12-05T09:58:57.399 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.db_log_dir: 2023-12-05T09:58:57.399 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.wal_dir: 2023-12-05T09:58:57.399 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.table_cache_numshardbits: 6 2023-12-05T09:58:57.399 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.WAL_ttl_seconds: 0 2023-12-05T09:58:57.399 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.WAL_size_limit_MB: 0 2023-12-05T09:58:57.399 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-12-05T09:58:57.399 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-12-05T09:58:57.399 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.is_fd_close_on_exec: 1 2023-12-05T09:58:57.399 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.advise_random_on_open: 1 2023-12-05T09:58:57.399 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.db_write_buffer_size: 0 2023-12-05T09:58:57.399 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.write_buffer_manager: 0x55c9065d3360 2023-12-05T09:58:57.399 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-12-05T09:58:57.399 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-12-05T09:58:57.399 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.use_adaptive_mutex: 0 2023-12-05T09:58:57.399 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.rate_limiter: (nil) 2023-12-05T09:58:57.400 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-12-05T09:58:57.400 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.wal_recovery_mode: 2 2023-12-05T09:58:57.400 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.enable_thread_tracking: 0 2023-12-05T09:58:57.400 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.enable_pipelined_write: 0 2023-12-05T09:58:57.400 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.unordered_write: 0 2023-12-05T09:58:57.400 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-12-05T09:58:57.400 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-12-05T09:58:57.400 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-12-05T09:58:57.400 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-12-05T09:58:57.400 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.row_cache: None 2023-12-05T09:58:57.400 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.wal_filter: None 2023-12-05T09:58:57.400 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-12-05T09:58:57.400 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.allow_ingest_behind: 0 2023-12-05T09:58:57.400 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.two_write_queues: 0 2023-12-05T09:58:57.400 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.manual_wal_flush: 0 2023-12-05T09:58:57.401 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.wal_compression: 0 2023-12-05T09:58:57.401 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.atomic_flush: 0 2023-12-05T09:58:57.401 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-12-05T09:58:57.401 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.persist_stats_to_disk: 0 2023-12-05T09:58:57.401 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.write_dbid_to_manifest: 0 2023-12-05T09:58:57.401 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.log_readahead_size: 0 2023-12-05T09:58:57.401 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-12-05T09:58:57.401 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.best_efforts_recovery: 0 2023-12-05T09:58:57.401 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-12-05T09:58:57.401 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-12-05T09:58:57.402 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.allow_data_in_errors: 0 2023-12-05T09:58:57.402 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.db_host_id: __hostname__ 2023-12-05T09:58:57.402 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.enforce_single_del_contracts: true 2023-12-05T09:58:57.403 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.max_background_jobs: 2 2023-12-05T09:58:57.403 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.max_background_compactions: -1 2023-12-05T09:58:57.403 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.max_subcompactions: 1 2023-12-05T09:58:57.403 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-12-05T09:58:57.403 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-12-05T09:58:57.403 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.delayed_write_rate : 16777216 2023-12-05T09:58:57.403 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.max_total_wal_size: 0 2023-12-05T09:58:57.403 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-12-05T09:58:57.403 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.stats_dump_period_sec: 600 2023-12-05T09:58:57.403 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.stats_persist_period_sec: 600 2023-12-05T09:58:57.403 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-12-05T09:58:57.403 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.max_open_files: -1 2023-12-05T09:58:57.403 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.bytes_per_sync: 0 2023-12-05T09:58:57.403 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.wal_bytes_per_sync: 0 2023-12-05T09:58:57.403 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.strict_bytes_per_sync: 0 2023-12-05T09:58:57.404 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.compaction_readahead_size: 0 2023-12-05T09:58:57.404 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.max_background_flushes: -1 2023-12-05T09:58:57.404 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Compression algorithms supported: 2023-12-05T09:58:57.404 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-12-05T09:58:57.404 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: kZSTD supported: 0 2023-12-05T09:58:57.404 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: kXpressCompression supported: 0 2023-12-05T09:58:57.404 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: kLZ4HCCompression supported: 1 2023-12-05T09:58:57.404 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: kZlibCompression supported: 1 2023-12-05T09:58:57.404 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: kSnappyCompression supported: 1 2023-12-05T09:58:57.404 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: kLZ4Compression supported: 1 2023-12-05T09:58:57.404 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: kBZip2Compression supported: 0 2023-12-05T09:58:57.404 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Fast CRC32 supported: Supported on x86 2023-12-05T09:58:57.404 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: DMutex implementation: pthread_mutex_t 2023-12-05T09:58:57.404 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi100/store.db/MANIFEST-000015 2023-12-05T09:58:57.404 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-12-05T09:58:57.405 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-12-05T09:58:57.405 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.merge_operator: 2023-12-05T09:58:57.405 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.compaction_filter: None 2023-12-05T09:58:57.405 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.compaction_filter_factory: None 2023-12-05T09:58:57.405 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.sst_partitioner_factory: None 2023-12-05T09:58:57.405 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.memtable_factory: SkipListFactory 2023-12-05T09:58:57.405 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.table_factory: BlockBasedTable 2023-12-05T09:58:57.406 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55c90661d740) 2023-12-05T09:58:57.406 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: cache_index_and_filter_blocks: 1 2023-12-05T09:58:57.406 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-12-05T09:58:57.406 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-12-05T09:58:57.406 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: pin_top_level_index_and_filter: 1 2023-12-05T09:58:57.407 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: index_type: 0 2023-12-05T09:58:57.407 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: data_block_index_type: 0 2023-12-05T09:58:57.407 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: index_shortening: 1 2023-12-05T09:58:57.407 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: data_block_hash_table_util_ratio: 0.750000 2023-12-05T09:58:57.407 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: checksum: 4 2023-12-05T09:58:57.407 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: no_block_cache: 0 2023-12-05T09:58:57.407 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: block_cache: 0x55c906673090 2023-12-05T09:58:57.407 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: block_cache_name: BinnedLRUCache 2023-12-05T09:58:57.407 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: block_cache_options: 2023-12-05T09:58:57.407 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: capacity : 536870912 2023-12-05T09:58:57.407 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: num_shard_bits : 4 2023-12-05T09:58:57.407 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: strict_capacity_limit : 0 2023-12-05T09:58:57.407 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: high_pri_pool_ratio: 0.000 2023-12-05T09:58:57.407 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: block_cache_compressed: (nil) 2023-12-05T09:58:57.407 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: persistent_cache: (nil) 2023-12-05T09:58:57.408 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: block_size: 4096 2023-12-05T09:58:57.408 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: block_size_deviation: 10 2023-12-05T09:58:57.408 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: block_restart_interval: 16 2023-12-05T09:58:57.408 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: index_block_restart_interval: 1 2023-12-05T09:58:57.408 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: metadata_block_size: 4096 2023-12-05T09:58:57.408 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: partition_filters: 0 2023-12-05T09:58:57.408 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: use_delta_encoding: 1 2023-12-05T09:58:57.408 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: filter_policy: bloomfilter 2023-12-05T09:58:57.408 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: whole_key_filtering: 1 2023-12-05T09:58:57.408 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: verify_compression: 0 2023-12-05T09:58:57.408 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: read_amp_bytes_per_bit: 0 2023-12-05T09:58:57.408 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: format_version: 5 2023-12-05T09:58:57.408 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: enable_index_compression: 1 2023-12-05T09:58:57.408 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: block_align: 0 2023-12-05T09:58:57.409 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: max_auto_readahead_size: 262144 2023-12-05T09:58:57.409 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: prepopulate_block_cache: 0 2023-12-05T09:58:57.409 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: initial_auto_readahead_size: 8192 2023-12-05T09:58:57.409 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: num_file_reads_for_auto_readahead: 2 2023-12-05T09:58:57.409 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.write_buffer_size: 33554432 2023-12-05T09:58:57.409 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.max_write_buffer_number: 2 2023-12-05T09:58:57.409 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.compression: NoCompression 2023-12-05T09:58:57.409 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.bottommost_compression: Disabled 2023-12-05T09:58:57.409 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.prefix_extractor: nullptr 2023-12-05T09:58:57.409 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-12-05T09:58:57.409 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.num_levels: 7 2023-12-05T09:58:57.409 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-12-05T09:58:57.409 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-12-05T09:58:57.409 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-12-05T09:58:57.409 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-12-05T09:58:57.410 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-12-05T09:58:57.410 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-12-05T09:58:57.410 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-12-05T09:58:57.410 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-12-05T09:58:57.410 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-12-05T09:58:57.410 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-12-05T09:58:57.410 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-12-05T09:58:57.410 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-12-05T09:58:57.410 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.compression_opts.window_bits: -14 2023-12-05T09:58:57.410 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.compression_opts.level: 32767 2023-12-05T09:58:57.411 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.compression_opts.strategy: 0 2023-12-05T09:58:57.411 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-12-05T09:58:57.411 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-12-05T09:58:57.411 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-12-05T09:58:57.411 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-12-05T09:58:57.411 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.compression_opts.enabled: false 2023-12-05T09:58:57.411 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-12-05T09:58:57.411 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-12-05T09:58:57.411 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-12-05T09:58:57.411 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-12-05T09:58:57.411 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.target_file_size_base: 67108864 2023-12-05T09:58:57.411 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.target_file_size_multiplier: 1 2023-12-05T09:58:57.411 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-12-05T09:58:57.411 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-12-05T09:58:57.412 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-12-05T09:58:57.412 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-12-05T09:58:57.412 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-12-05T09:58:57.412 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-12-05T09:58:57.412 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-12-05T09:58:57.412 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-12-05T09:58:57.412 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-12-05T09:58:57.412 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-12-05T09:58:57.412 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-12-05T09:58:57.412 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-12-05T09:58:57.412 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-12-05T09:58:57.412 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.arena_block_size: 1048576 2023-12-05T09:58:57.412 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-12-05T09:58:57.412 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-12-05T09:58:57.413 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.disable_auto_compactions: 0 2023-12-05T09:58:57.413 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-12-05T09:58:57.413 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-12-05T09:58:57.413 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-12-05T09:58:57.413 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-12-05T09:58:57.413 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-12-05T09:58:57.413 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-12-05T09:58:57.413 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-12-05T09:58:57.413 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-12-05T09:58:57.413 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-12-05T09:58:57.413 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-12-05T09:58:57.413 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.table_properties_collectors: 2023-12-05T09:58:57.413 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.inplace_update_support: 0 2023-12-05T09:58:57.413 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.inplace_update_num_locks: 10000 2023-12-05T09:58:57.414 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-12-05T09:58:57.414 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-12-05T09:58:57.414 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.memtable_huge_page_size: 0 2023-12-05T09:58:57.414 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.bloom_locality: 0 2023-12-05T09:58:57.414 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.max_successive_merges: 0 2023-12-05T09:58:57.414 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.optimize_filters_for_hits: 0 2023-12-05T09:58:57.414 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.paranoid_file_checks: 0 2023-12-05T09:58:57.414 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.force_consistency_checks: 1 2023-12-05T09:58:57.414 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.report_bg_io_stats: 0 2023-12-05T09:58:57.414 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.ttl: 2592000 2023-12-05T09:58:57.414 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.periodic_compaction_seconds: 0 2023-12-05T09:58:57.414 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-12-05T09:58:57.414 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-12-05T09:58:57.414 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.enable_blob_files: false 2023-12-05T09:58:57.414 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.min_blob_size: 0 2023-12-05T09:58:57.415 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.blob_file_size: 268435456 2023-12-05T09:58:57.415 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.blob_compression_type: NoCompression 2023-12-05T09:58:57.415 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.enable_blob_garbage_collection: false 2023-12-05T09:58:57.415 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-12-05T09:58:57.415 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-12-05T09:58:57.415 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-12-05T09:58:57.415 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.blob_file_starting_level: 0 2023-12-05T09:58:57.415 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-12-05T09:58:57.415 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 30.sst 2023-12-05T09:58:57.415 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2023-12-05T09:58:57.415 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi100/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 32, last_sequence is 11512, log_number is 28,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-12-05T09:58:57.415 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 28 2023-12-05T09:58:57.415 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: eca67d5f-e8f3-4aec-bfcf-e8e867a7d5f4 2023-12-05T09:58:57.415 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: EVENT_LOG_v1 {"time_micros": 1701770336966668, "job": 1, "event": "recovery_started", "wal_files": [28]} 2023-12-05T09:58:57.416 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #28 mode 2 2023-12-05T09:58:57.416 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: EVENT_LOG_v1 {"time_micros": 1701770336971424, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 33, "file_size": 301738, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 11504, "largest_seqno": 11674, "table_properties": {"data_size": 300024, "index_size": 446, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 261, "raw_key_size": 2738, "raw_average_key_size": 27, "raw_value_size": 297768, "raw_average_value_size": 3038, "num_data_blocks": 19, "num_entries": 98, "num_filter_entries": 98, "num_deletions": 2, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1701770336, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "eca67d5f-e8f3-4aec-bfcf-e8e867a7d5f4", "db_session_id": "KZA5N814WI6Q0RFM8U7X", "orig_file_number": 33, "seqno_to_time_mapping": "N/A"}} 2023-12-05T09:58:57.416 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: EVENT_LOG_v1 {"time_micros": 1701770336971632, "job": 1, "event": "recovery_finished"} 2023-12-05T09:58:57.416 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: [db/version_set.cc:5047] Creating manifest 35 2023-12-05T09:58:57.416 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2023-12-05T09:58:57.416 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi100/store.db/000028.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-12-05T09:58:57.416 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55c90670e000 2023-12-05T09:58:57.416 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: DB pointer 0x55c9066fa000 2023-12-05T09:58:57.416 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-12-05T09:58:57.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-12-05T09:58:57.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: ** DB Stats ** 2023-12-05T09:58:57.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-05T09:58:57.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-12-05T09:58:57.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-05T09:58:57.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-05T09:58:57.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-12-05T09:58:57.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-05T09:58:57.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-05T09:58:57.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: 2023-12-05T09:58:57.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: ** Compaction Stats [default] ** 2023-12-05T09:58:57.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-05T09:58:57.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-12-05T09:58:57.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: L0 1/0 294.67 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 100.8 0.00 0.00 1 0.003 0 0 0.0 0.0 2023-12-05T09:58:57.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: L6 1/0 6.42 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2023-12-05T09:58:57.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Sum 2/0 6.71 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 100.8 0.00 0.00 1 0.003 0 0 0.0 0.0 2023-12-05T09:58:57.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 100.8 0.00 0.00 1 0.003 0 0 0.0 0.0 2023-12-05T09:58:57.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: 2023-12-05T09:58:57.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: ** Compaction Stats [default] ** 2023-12-05T09:58:57.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-05T09:58:57.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-05T09:58:57.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 100.8 0.00 0.00 1 0.003 0 0 0.0 0.0 2023-12-05T09:58:57.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: 2023-12-05T09:58:57.419 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-12-05T09:58:57.419 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: 2023-12-05T09:58:57.419 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-05T09:58:57.419 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-12-05T09:58:57.419 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-05T09:58:57.419 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-05T09:58:57.419 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-05T09:58:57.419 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-05T09:58:57.419 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Cumulative compaction: 0.00 GB write, 25.49 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-05T09:58:57.419 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Interval compaction: 0.00 GB write, 25.49 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-05T09:58:57.419 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-05T09:58:57.419 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Block cache BinnedLRUCache@0x55c906673090#7 capacity: 512.00 MB usage: 0.83 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2023-12-05T09:58:57.419 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.31 KB,5.96046e-05%) IndexBlock(1,0.52 KB,9.83477e-05%) Misc(1,0.00 KB,0%) 2023-12-05T09:58:57.419 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: 2023-12-05T09:58:57.419 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-05T09:58:57.420 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: starting mon.smithi100 rank 0 at public addrs [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] at bind addrs [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi100 fsid 5b035ce6-9353-11ee-95a2-87774f69a715 2023-12-05T09:58:57.420 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: mon.smithi100@-1(???) e2 preinit fsid 5b035ce6-9353-11ee-95a2-87774f69a715 2023-12-05T09:58:57.420 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: mon.smithi100@-1(???).mds e13 new map 2023-12-05T09:58:57.420 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: mon.smithi100@-1(???).mds e13 print_map 2023-12-05T09:58:57.420 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: e13 2023-12-05T09:58:57.420 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-12-05T09:58:57.420 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T09:58:57.420 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: legacy client fscid: 1 2023-12-05T09:58:57.420 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: 2023-12-05T09:58:57.420 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Filesystem 'cephfs' (1) 2023-12-05T09:58:57.420 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: fs_name cephfs 2023-12-05T09:58:57.420 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: epoch 13 2023-12-05T09:58:57.420 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-05T09:58:57.420 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: created 2023-12-05T09:54:30.515778+0000 2023-12-05T09:58:57.420 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: modified 2023-12-05T09:54:46.403009+0000 2023-12-05T09:58:57.421 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: tableserver 0 2023-12-05T09:58:57.421 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: root 0 2023-12-05T09:58:57.421 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: session_timeout 60 2023-12-05T09:58:57.421 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: session_autoclose 300 2023-12-05T09:58:57.421 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: max_file_size 1099511627776 2023-12-05T09:58:57.421 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: max_xattr_size 65536 2023-12-05T09:58:57.421 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: required_client_features {} 2023-12-05T09:58:57.421 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: last_failure 0 2023-12-05T09:58:57.421 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: last_failure_osd_epoch 46 2023-12-05T09:58:57.421 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T09:58:57.421 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: max_mds 1 2023-12-05T09:58:57.421 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: in 0 2023-12-05T09:58:57.421 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: up {0=14490} 2023-12-05T09:58:57.421 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: failed 2023-12-05T09:58:57.421 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: damaged 2023-12-05T09:58:57.422 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: stopped 2023-12-05T09:58:57.422 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: data_pools [3] 2023-12-05T09:58:57.422 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: metadata_pool 2 2023-12-05T09:58:57.422 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: inline_data disabled 2023-12-05T09:58:57.422 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: balancer 2023-12-05T09:58:57.422 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: bal_rank_mask -1 2023-12-05T09:58:57.422 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: standby_count_wanted 1 2023-12-05T09:58:57.422 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: [mds.cephfs.smithi100.akmstb{0:14490} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.100:6828/627555128,v1:172.21.15.100:6829/627555128] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:58:57.422 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: 2023-12-05T09:58:57.422 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: 2023-12-05T09:58:57.422 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Standby daemons: 2023-12-05T09:58:57.422 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: 2023-12-05T09:58:57.422 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: [mds.cephfs.smithi150.pcbpxm{-1:14486} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.150:6824/3645854543,v1:172.21.15.150:6825/3645854543] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:58:57.422 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: [mds.cephfs.smithi150.fcnhsv{-1:14498} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.150:6826/3249949736,v1:172.21.15.150:6827/3249949736] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:58:57.422 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: [mds.cephfs.smithi100.sqplhn{-1:14506} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.100:6826/2472212864,v1:172.21.15.100:6827/2472212864] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:58:57.423 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: mon.smithi100@-1(???).osd e50 crush map has features 3314933000852226048, adjusting msgr requires 2023-12-05T09:58:57.423 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: mon.smithi100@-1(???).osd e50 crush map has features 288514051259236352, adjusting msgr requires 2023-12-05T09:58:57.423 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: mon.smithi100@-1(???).osd e50 crush map has features 288514051259236352, adjusting msgr requires 2023-12-05T09:58:57.423 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: mon.smithi100@-1(???).osd e50 crush map has features 288514051259236352, adjusting msgr requires 2023-12-05T09:58:57.423 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:56 smithi100 ceph-mon[187528]: mon.smithi100@-1(???).paxosservice(auth 1..20) refresh upgraded, format 0 -> 3 2023-12-05T09:58:58.741 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:58 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mon metadata", "id": "smithi100"}]: dispatch 2023-12-05T09:58:58.742 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:58 smithi150 ceph-mon[116142]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mon metadata", "id": "smithi150"}]: dispatch 2023-12-05T09:58:58.742 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:58 smithi150 ceph-mon[116142]: pgmap v30: 65 pgs: 65 active+clean; 282 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.6 MiB/s wr, 912 op/s 2023-12-05T09:58:58.742 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:58 smithi150 ceph-mon[116142]: mon.smithi100 calling monitor election 2023-12-05T09:58:58.742 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:58 smithi150 ceph-mon[116142]: mon.smithi100 is new leader, mons smithi100,smithi150 in quorum (ranks 0,1) 2023-12-05T09:58:58.742 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:58 smithi150 ceph-mon[116142]: monmap e2: 2 mons at {smithi100=[v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0],smithi150=[v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-05T09:58:58.742 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:58 smithi150 ceph-mon[116142]: fsmap cephfs:1 {0=cephfs.smithi100.akmstb=up:active} 3 up:standby 2023-12-05T09:58:58.742 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:58 smithi150 ceph-mon[116142]: osdmap e50: 6 total, 6 up, 6 in 2023-12-05T09:58:58.742 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:58 smithi150 ceph-mon[116142]: mgrmap e32: smithi100.ehmuhg(active, since 56s), standbys: smithi150.zkskag 2023-12-05T09:58:58.742 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:58 smithi150 ceph-mon[116142]: from='mgr.24533 ' entity='' 2023-12-05T09:58:58.742 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:58 smithi150 ceph-mon[116142]: mgrmap e33: smithi100.ehmuhg(active, since 56s), standbys: smithi150.zkskag 2023-12-05T09:58:58.742 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:58:58 smithi150 ceph-mon[116142]: overall HEALTH_OK 2023-12-05T09:58:58.818 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:58 smithi100 ceph-mon[187528]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mon metadata", "id": "smithi100"}]: dispatch 2023-12-05T09:58:58.818 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:58 smithi100 ceph-mon[187528]: from='mgr.24533 172.21.15.100:0/3121938693' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mon metadata", "id": "smithi150"}]: dispatch 2023-12-05T09:58:58.818 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:58 smithi100 ceph-mon[187528]: pgmap v30: 65 pgs: 65 active+clean; 282 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.6 MiB/s wr, 912 op/s 2023-12-05T09:58:58.818 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:58 smithi100 ceph-mon[187528]: mon.smithi100 calling monitor election 2023-12-05T09:58:58.818 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:58 smithi100 ceph-mon[187528]: mon.smithi100 is new leader, mons smithi100,smithi150 in quorum (ranks 0,1) 2023-12-05T09:58:58.818 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:58 smithi100 ceph-mon[187528]: monmap e2: 2 mons at {smithi100=[v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0],smithi150=[v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-05T09:58:58.818 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:58 smithi100 ceph-mon[187528]: fsmap cephfs:1 {0=cephfs.smithi100.akmstb=up:active} 3 up:standby 2023-12-05T09:58:58.819 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:58 smithi100 ceph-mon[187528]: osdmap e50: 6 total, 6 up, 6 in 2023-12-05T09:58:58.819 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:58 smithi100 ceph-mon[187528]: mgrmap e32: smithi100.ehmuhg(active, since 56s), standbys: smithi150.zkskag 2023-12-05T09:58:58.819 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:58 smithi100 ceph-mon[187528]: from='mgr.24533 ' entity='' 2023-12-05T09:58:58.819 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:58 smithi100 ceph-mon[187528]: mgrmap e33: smithi100.ehmuhg(active, since 56s), standbys: smithi150.zkskag 2023-12-05T09:58:58.819 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:58:58 smithi100 ceph-mon[187528]: overall HEALTH_OK 2023-12-05T09:59:08.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:08 smithi150 ceph-mon[116142]: Standby manager daemon smithi150.zkskag restarted 2023-12-05T09:59:08.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:08 smithi150 ceph-mon[116142]: Standby manager daemon smithi150.zkskag started 2023-12-05T09:59:08.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:08 smithi150 ceph-mon[116142]: from='mgr.? 172.21.15.150:0/3504891783' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi150.zkskag/crt"}]: dispatch 2023-12-05T09:59:08.847 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:08 smithi150 ceph-mon[116142]: from='mgr.? 172.21.15.150:0/3504891783' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-05T09:59:08.847 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:08 smithi150 ceph-mon[116142]: from='mgr.? 172.21.15.150:0/3504891783' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi150.zkskag/key"}]: dispatch 2023-12-05T09:59:08.847 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:08 smithi150 ceph-mon[116142]: from='mgr.? 172.21.15.150:0/3504891783' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-05T09:59:08.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:08 smithi100 ceph-mon[187528]: Standby manager daemon smithi150.zkskag restarted 2023-12-05T09:59:08.897 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:08 smithi100 ceph-mon[187528]: Standby manager daemon smithi150.zkskag started 2023-12-05T09:59:08.897 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:08 smithi100 ceph-mon[187528]: from='mgr.? 172.21.15.150:0/3504891783' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi150.zkskag/crt"}]: dispatch 2023-12-05T09:59:08.897 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:08 smithi100 ceph-mon[187528]: from='mgr.? 172.21.15.150:0/3504891783' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-05T09:59:08.897 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:08 smithi100 ceph-mon[187528]: from='mgr.? 172.21.15.150:0/3504891783' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi150.zkskag/key"}]: dispatch 2023-12-05T09:59:08.897 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:08 smithi100 ceph-mon[187528]: from='mgr.? 172.21.15.150:0/3504891783' entity='mgr.smithi150.zkskag' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-05T09:59:09.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:09 smithi150 ceph-mon[116142]: mgrmap e34: smithi100.ehmuhg(active, since 66s), standbys: smithi150.zkskag 2023-12-05T09:59:09.884 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:09 smithi100 ceph-mon[187528]: mgrmap e34: smithi100.ehmuhg(active, since 66s), standbys: smithi150.zkskag 2023-12-05T09:59:10.882 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:10 smithi100 ceph-mon[187528]: Active manager daemon smithi100.ehmuhg restarted 2023-12-05T09:59:10.882 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:10 smithi100 ceph-mon[187528]: Activating manager daemon smithi100.ehmuhg 2023-12-05T09:59:10.882 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:10 smithi100 ceph-mon[187528]: osdmap e51: 6 total, 6 up, 6 in 2023-12-05T09:59:10.882 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:10 smithi100 ceph-mon[187528]: mgrmap e35: smithi100.ehmuhg(active, starting, since 0.0124495s), standbys: smithi150.zkskag 2023-12-05T09:59:10.882 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:10 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mon metadata", "id": "smithi100"}]: dispatch 2023-12-05T09:59:10.882 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:10 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mon metadata", "id": "smithi150"}]: dispatch 2023-12-05T09:59:10.882 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:10 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi150.pcbpxm"}]: dispatch 2023-12-05T09:59:10.882 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:10 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi100.akmstb"}]: dispatch 2023-12-05T09:59:10.882 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:10 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi150.fcnhsv"}]: dispatch 2023-12-05T09:59:10.882 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:10 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi100.sqplhn"}]: dispatch 2023-12-05T09:59:10.882 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:10 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mgr metadata", "who": "smithi100.ehmuhg", "id": "smithi100.ehmuhg"}]: dispatch 2023-12-05T09:59:10.883 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:10 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mgr metadata", "who": "smithi150.zkskag", "id": "smithi150.zkskag"}]: dispatch 2023-12-05T09:59:10.883 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:10 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-05T09:59:10.883 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:10 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-05T09:59:10.883 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:10 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-05T09:59:10.883 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:10 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-05T09:59:10.883 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:10 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-05T09:59:10.883 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:10 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-05T09:59:10.883 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:10 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-05T09:59:10.883 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:10 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-05T09:59:10.883 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:10 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-05T09:59:10.883 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:10 smithi100 ceph-mon[187528]: Manager daemon smithi100.ehmuhg is now available 2023-12-05T09:59:10.918 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:10 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-mon-smithi150[116119]: 2023-12-05T09:59:10.605+0000 7f2deb41a700 -1 mon.smithi150@1(peon).osd e51 update_from_paxos full map CRC mismatch, resetting to canonical 2023-12-05T09:59:10.918 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:10 smithi150 ceph-mon[116142]: Active manager daemon smithi100.ehmuhg restarted 2023-12-05T09:59:10.918 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:10 smithi150 ceph-mon[116142]: Activating manager daemon smithi100.ehmuhg 2023-12-05T09:59:10.918 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:10 smithi150 ceph-mon[116142]: osdmap e51: 6 total, 6 up, 6 in 2023-12-05T09:59:10.919 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:10 smithi150 ceph-mon[116142]: mgrmap e35: smithi100.ehmuhg(active, starting, since 0.0124495s), standbys: smithi150.zkskag 2023-12-05T09:59:10.919 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:10 smithi150 ceph-mon[116142]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mon metadata", "id": "smithi100"}]: dispatch 2023-12-05T09:59:10.919 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:10 smithi150 ceph-mon[116142]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mon metadata", "id": "smithi150"}]: dispatch 2023-12-05T09:59:10.919 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:10 smithi150 ceph-mon[116142]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi150.pcbpxm"}]: dispatch 2023-12-05T09:59:10.919 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:10 smithi150 ceph-mon[116142]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi100.akmstb"}]: dispatch 2023-12-05T09:59:10.919 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:10 smithi150 ceph-mon[116142]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi150.fcnhsv"}]: dispatch 2023-12-05T09:59:10.919 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:10 smithi150 ceph-mon[116142]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi100.sqplhn"}]: dispatch 2023-12-05T09:59:10.919 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:10 smithi150 ceph-mon[116142]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mgr metadata", "who": "smithi100.ehmuhg", "id": "smithi100.ehmuhg"}]: dispatch 2023-12-05T09:59:10.919 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:10 smithi150 ceph-mon[116142]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mgr metadata", "who": "smithi150.zkskag", "id": "smithi150.zkskag"}]: dispatch 2023-12-05T09:59:10.919 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:10 smithi150 ceph-mon[116142]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-05T09:59:10.919 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:10 smithi150 ceph-mon[116142]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-05T09:59:10.919 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:10 smithi150 ceph-mon[116142]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-05T09:59:10.919 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:10 smithi150 ceph-mon[116142]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-05T09:59:10.919 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:10 smithi150 ceph-mon[116142]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-05T09:59:10.920 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:10 smithi150 ceph-mon[116142]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-05T09:59:10.920 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:10 smithi150 ceph-mon[116142]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-05T09:59:10.920 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:10 smithi150 ceph-mon[116142]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-05T09:59:10.920 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:10 smithi150 ceph-mon[116142]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-05T09:59:10.920 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:10 smithi150 ceph-mon[116142]: Manager daemon smithi100.ehmuhg is now available 2023-12-05T09:59:11.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:11 smithi100 ceph-mon[187528]: failed to encode map e51 with expected crc 2023-12-05T09:59:11.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:11 smithi100 ceph-mon[187528]: failed to encode map e51 with expected crc 2023-12-05T09:59:11.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:11 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:59:11.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:11 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:59:11.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:11 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:59:11.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:11 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi100.ehmuhg/mirror_snapshot_schedule"}]: dispatch 2023-12-05T09:59:11.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:11 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi100.ehmuhg/trash_purge_schedule"}]: dispatch 2023-12-05T09:59:11.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:11 smithi100 ceph-mon[187528]: mgrmap e36: smithi100.ehmuhg(active, since 1.01538s), standbys: smithi150.zkskag 2023-12-05T09:59:12.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:11 smithi150 ceph-mon[116142]: failed to encode map e51 with expected crc 2023-12-05T09:59:12.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:11 smithi150 ceph-mon[116142]: failed to encode map e51 with expected crc 2023-12-05T09:59:12.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:11 smithi150 ceph-mon[116142]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:59:12.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:11 smithi150 ceph-mon[116142]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:59:12.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:11 smithi150 ceph-mon[116142]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:59:12.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:11 smithi150 ceph-mon[116142]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi100.ehmuhg/mirror_snapshot_schedule"}]: dispatch 2023-12-05T09:59:12.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:11 smithi150 ceph-mon[116142]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi100.ehmuhg/trash_purge_schedule"}]: dispatch 2023-12-05T09:59:12.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:11 smithi150 ceph-mon[116142]: mgrmap e36: smithi100.ehmuhg(active, since 1.01538s), standbys: smithi150.zkskag 2023-12-05T09:59:13.295 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:12 smithi150 ceph-mon[116142]: [05/Dec/2023:09:59:11] ENGINE Bus STARTING 2023-12-05T09:59:13.295 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:12 smithi150 ceph-mon[116142]: [05/Dec/2023:09:59:11] ENGINE Serving on https://172.21.15.100:7150 2023-12-05T09:59:13.295 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:12 smithi150 ceph-mon[116142]: [05/Dec/2023:09:59:11] ENGINE Serving on http://172.21.15.100:8765 2023-12-05T09:59:13.295 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:12 smithi150 ceph-mon[116142]: [05/Dec/2023:09:59:11] ENGINE Bus STARTED 2023-12-05T09:59:13.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:12 smithi100 ceph-mon[187528]: [05/Dec/2023:09:59:11] ENGINE Bus STARTING 2023-12-05T09:59:13.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:12 smithi100 ceph-mon[187528]: [05/Dec/2023:09:59:11] ENGINE Serving on https://172.21.15.100:7150 2023-12-05T09:59:13.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:12 smithi100 ceph-mon[187528]: [05/Dec/2023:09:59:11] ENGINE Serving on http://172.21.15.100:8765 2023-12-05T09:59:13.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:12 smithi100 ceph-mon[187528]: [05/Dec/2023:09:59:11] ENGINE Bus STARTED 2023-12-05T09:59:14.345 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:14 smithi150 ceph-mon[116142]: pgmap v4: 65 pgs: 65 active+clean; 247 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:59:14.345 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:14 smithi150 ceph-mon[116142]: mgrmap e37: smithi100.ehmuhg(active, since 2s), standbys: smithi150.zkskag 2023-12-05T09:59:14.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:14 smithi100 ceph-mon[187528]: pgmap v4: 65 pgs: 65 active+clean; 247 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:59:14.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:14 smithi100 ceph-mon[187528]: mgrmap e37: smithi100.ehmuhg(active, since 2s), standbys: smithi150.zkskag 2023-12-05T09:59:15.345 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:15 smithi150 ceph-mon[116142]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:15.345 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:15 smithi150 ceph-mon[116142]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:15.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:15 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:15.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:15 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:16.345 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:16 smithi150 ceph-mon[116142]: pgmap v5: 65 pgs: 65 active+clean; 247 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:59:16.345 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:16 smithi150 ceph-mon[116142]: mgrmap e38: smithi100.ehmuhg(active, since 4s), standbys: smithi150.zkskag 2023-12-05T09:59:16.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:16 smithi150 ceph-mon[116142]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:16.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:16 smithi150 ceph-mon[116142]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:16.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:16 smithi100 ceph-mon[187528]: pgmap v5: 65 pgs: 65 active+clean; 247 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:59:16.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:16 smithi100 ceph-mon[187528]: mgrmap e38: smithi100.ehmuhg(active, since 4s), standbys: smithi150.zkskag 2023-12-05T09:59:16.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:16 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:16.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:16 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:16.751 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:16.752+0000 7fa08f31e700 1 -- 172.21.15.100:0/4024312173 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa088071b40 msgr2=0x7fa08806ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:59:16.752 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:16.752+0000 7fa08f31e700 1 --2- 172.21.15.100:0/4024312173 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa088071b40 0x7fa08806ffb0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa084004940 tx=0x7fa084009e30 comp rx=0 tx=0).stop 2023-12-05T09:59:16.752 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:16.753+0000 7fa08f31e700 1 -- 172.21.15.100:0/4024312173 shutdown_connections 2023-12-05T09:59:16.752 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:16.753+0000 7fa08f31e700 1 --2- 172.21.15.100:0/4024312173 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0880704f0 0x7fa088070960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:16.752 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:16.753+0000 7fa08f31e700 1 --2- 172.21.15.100:0/4024312173 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa088071b40 0x7fa08806ffb0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:16.752 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:16.753+0000 7fa08f31e700 1 -- 172.21.15.100:0/4024312173 >> 172.21.15.100:0/4024312173 conn(0x7fa0880f82d0 msgr2=0x7fa0880fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:59:16.752 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:16.753+0000 7fa08f31e700 1 -- 172.21.15.100:0/4024312173 shutdown_connections 2023-12-05T09:59:16.752 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:16.753+0000 7fa08f31e700 1 -- 172.21.15.100:0/4024312173 wait complete. 2023-12-05T09:59:16.752 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:16.754+0000 7fa08f31e700 1 Processor -- start 2023-12-05T09:59:16.752 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:16.754+0000 7fa08f31e700 1 -- start start 2023-12-05T09:59:16.753 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:16.755+0000 7fa08f31e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0880704f0 0x7fa08810f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:59:16.753 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:16.755+0000 7fa08f31e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa088071b40 0x7fa08810fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:59:16.753 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:16.755+0000 7fa08f31e700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa088110340 con 0x7fa088071b40 2023-12-05T09:59:16.753 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:16.755+0000 7fa08f31e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa088110be0 con 0x7fa0880704f0 2023-12-05T09:59:16.753 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:16.755+0000 7fa08c8b9700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa088071b40 0x7fa08810fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:59:16.753 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:16.755+0000 7fa08d0ba700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0880704f0 0x7fa08810f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:59:16.753 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:16.755+0000 7fa08c8b9700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa088071b40 0x7fa08810fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37834/0 (socket says 172.21.15.100:37834) 2023-12-05T09:59:16.753 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:16.755+0000 7fa08d0ba700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0880704f0 0x7fa08810f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.100:53054/0 (socket says 172.21.15.100:53054) 2023-12-05T09:59:16.754 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:16.755+0000 7fa08c8b9700 1 -- 172.21.15.100:0/352193668 learned_addr learned my addr 172.21.15.100:0/352193668 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:59:16.754 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:16.755+0000 7fa08d0ba700 1 -- 172.21.15.100:0/352193668 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa088071b40 msgr2=0x7fa08810fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:59:16.754 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:16.755+0000 7fa08d0ba700 1 --2- 172.21.15.100:0/352193668 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa088071b40 0x7fa08810fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:16.754 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:16.755+0000 7fa08d0ba700 1 -- 172.21.15.100:0/352193668 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa084005040 con 0x7fa0880704f0 2023-12-05T09:59:16.754 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:16.756+0000 7fa08d0ba700 1 --2- 172.21.15.100:0/352193668 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0880704f0 0x7fa08810f800 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa084000c00 tx=0x7fa084009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:59:16.754 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:16.756+0000 7fa07dffb700 1 -- 172.21.15.100:0/352193668 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa084021070 con 0x7fa0880704f0 2023-12-05T09:59:16.754 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:16.756+0000 7fa08f31e700 1 -- 172.21.15.100:0/352193668 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa088110e60 con 0x7fa0880704f0 2023-12-05T09:59:16.755 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:16.756+0000 7fa07dffb700 1 -- 172.21.15.100:0/352193668 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa08401c400 con 0x7fa0880704f0 2023-12-05T09:59:16.755 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:16.756+0000 7fa07dffb700 1 -- 172.21.15.100:0/352193668 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa08400e070 con 0x7fa0880704f0 2023-12-05T09:59:16.755 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:16.756+0000 7fa08f31e700 1 -- 172.21.15.100:0/352193668 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa088111340 con 0x7fa0880704f0 2023-12-05T09:59:16.755 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:16.758+0000 7fa08f31e700 1 -- 172.21.15.100:0/352193668 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0881096e0 con 0x7fa0880704f0 2023-12-05T09:59:16.756 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:16.758+0000 7fa07dffb700 1 -- 172.21.15.100:0/352193668 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 38) v1 ==== 91040+0+0 (secure 0 0 0) 0x7fa08401c970 con 0x7fa0880704f0 2023-12-05T09:59:16.757 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:16.759+0000 7fa07dffb700 1 --2- 172.21.15.100:0/352193668 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fa07406cf80 0x7fa07406f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:59:16.757 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:16.759+0000 7fa07dffb700 1 -- 172.21.15.100:0/352193668 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fa08408d5a0 con 0x7fa0880704f0 2023-12-05T09:59:16.757 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:16.760+0000 7fa08c8b9700 1 --2- 172.21.15.100:0/352193668 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fa07406cf80 0x7fa07406f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:59:16.758 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:16.760+0000 7fa08c8b9700 1 --2- 172.21.15.100:0/352193668 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fa07406cf80 0x7fa07406f430 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa078008fd0 tx=0x7fa07800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:59:16.762 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:16.765+0000 7fa07dffb700 1 -- 172.21.15.100:0/352193668 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fa08405adb0 con 0x7fa0880704f0 2023-12-05T09:59:17.128 INFO:teuthology.orchestra.run.smithi100.stdout:true 2023-12-05T09:59:17.128 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.027+0000 7fa08f31e700 1 -- 172.21.15.100:0/352193668 --> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa088111670 con 0x7fa07406cf80 2023-12-05T09:59:17.128 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.029+0000 7fa07dffb700 1 -- 172.21.15.100:0/352193668 <== mgr.34104 v2:172.21.15.100:6800/3489431924 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7fa088111670 con 0x7fa07406cf80 2023-12-05T09:59:17.128 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.032+0000 7fa08f31e700 1 -- 172.21.15.100:0/352193668 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fa07406cf80 msgr2=0x7fa07406f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:59:17.128 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.032+0000 7fa08f31e700 1 --2- 172.21.15.100:0/352193668 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fa07406cf80 0x7fa07406f430 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa078008fd0 tx=0x7fa07800b040 comp rx=0 tx=0).stop 2023-12-05T09:59:17.128 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.032+0000 7fa08f31e700 1 -- 172.21.15.100:0/352193668 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0880704f0 msgr2=0x7fa08810f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:59:17.128 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.032+0000 7fa08f31e700 1 --2- 172.21.15.100:0/352193668 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0880704f0 0x7fa08810f800 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa084000c00 tx=0x7fa084009e30 comp rx=0 tx=0).stop 2023-12-05T09:59:17.129 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.032+0000 7fa08f31e700 1 -- 172.21.15.100:0/352193668 shutdown_connections 2023-12-05T09:59:17.129 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.032+0000 7fa08f31e700 1 --2- 172.21.15.100:0/352193668 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fa07406cf80 0x7fa07406f430 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:17.129 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.032+0000 7fa08f31e700 1 --2- 172.21.15.100:0/352193668 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0880704f0 0x7fa08810f800 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:17.129 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.032+0000 7fa08f31e700 1 --2- 172.21.15.100:0/352193668 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa088071b40 0x7fa08810fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:17.129 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.032+0000 7fa08f31e700 1 -- 172.21.15.100:0/352193668 >> 172.21.15.100:0/352193668 conn(0x7fa0880f82d0 msgr2=0x7fa088103390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:59:17.129 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.032+0000 7fa08f31e700 1 -- 172.21.15.100:0/352193668 shutdown_connections 2023-12-05T09:59:17.129 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.032+0000 7fa08f31e700 1 -- 172.21.15.100:0/352193668 wait complete. 2023-12-05T09:59:17.185 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.187+0000 7fb87c486700 1 -- 172.21.15.100:0/3440911057 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb874066920 msgr2=0x7fb8740ff7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:59:17.185 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.187+0000 7fb87c486700 1 --2- 172.21.15.100:0/3440911057 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb874066920 0x7fb8740ff7a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb870004940 tx=0x7fb870009e30 comp rx=0 tx=0).stop 2023-12-05T09:59:17.185 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.187+0000 7fb87c486700 1 -- 172.21.15.100:0/3440911057 shutdown_connections 2023-12-05T09:59:17.185 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.187+0000 7fb87c486700 1 --2- 172.21.15.100:0/3440911057 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8740ffd70 0x7fb8741021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:17.185 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.187+0000 7fb87c486700 1 --2- 172.21.15.100:0/3440911057 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb874066920 0x7fb8740ff7a0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:17.185 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.187+0000 7fb87c486700 1 -- 172.21.15.100:0/3440911057 >> 172.21.15.100:0/3440911057 conn(0x7fb8740f71d0 msgr2=0x7fb8740f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:59:17.185 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.187+0000 7fb87c486700 1 -- 172.21.15.100:0/3440911057 shutdown_connections 2023-12-05T09:59:17.185 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.187+0000 7fb87c486700 1 -- 172.21.15.100:0/3440911057 wait complete. 2023-12-05T09:59:17.186 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.188+0000 7fb87c486700 1 Processor -- start 2023-12-05T09:59:17.186 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.188+0000 7fb87c486700 1 -- start start 2023-12-05T09:59:17.186 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.188+0000 7fb87c486700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb874066920 0x7fb87410f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:59:17.186 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.189+0000 7fb87c486700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8740ffd70 0x7fb87410fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:59:17.186 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.189+0000 7fb87c486700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb874110240 con 0x7fb874066920 2023-12-05T09:59:17.186 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.189+0000 7fb87c486700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb874110ae0 con 0x7fb8740ffd70 2023-12-05T09:59:17.187 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.189+0000 7fb87a222700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb874066920 0x7fb87410f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:59:17.187 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.189+0000 7fb87a222700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb874066920 0x7fb87410f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37852/0 (socket says 172.21.15.100:37852) 2023-12-05T09:59:17.187 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.189+0000 7fb87a222700 1 -- 172.21.15.100:0/1148597767 learned_addr learned my addr 172.21.15.100:0/1148597767 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:59:17.187 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.189+0000 7fb87a222700 1 -- 172.21.15.100:0/1148597767 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8740ffd70 msgr2=0x7fb87410fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:59:17.187 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.189+0000 7fb87a222700 1 --2- 172.21.15.100:0/1148597767 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8740ffd70 0x7fb87410fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:17.187 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.189+0000 7fb87a222700 1 -- 172.21.15.100:0/1148597767 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb870005040 con 0x7fb874066920 2023-12-05T09:59:17.187 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.190+0000 7fb87a222700 1 --2- 172.21.15.100:0/1148597767 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb874066920 0x7fb87410f700 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb870008f90 tx=0x7fb870009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:59:17.188 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.190+0000 7fb86affd700 1 -- 172.21.15.100:0/1148597767 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb870021070 con 0x7fb874066920 2023-12-05T09:59:17.188 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.190+0000 7fb86affd700 1 -- 172.21.15.100:0/1148597767 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb87001c400 con 0x7fb874066920 2023-12-05T09:59:17.188 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.190+0000 7fb87c486700 1 -- 172.21.15.100:0/1148597767 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb874110d60 con 0x7fb874066920 2023-12-05T09:59:17.188 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.190+0000 7fb86affd700 1 -- 172.21.15.100:0/1148597767 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb87000e030 con 0x7fb874066920 2023-12-05T09:59:17.188 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.190+0000 7fb87c486700 1 -- 172.21.15.100:0/1148597767 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8741112a0 con 0x7fb874066920 2023-12-05T09:59:17.188 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.191+0000 7fb87c486700 1 -- 172.21.15.100:0/1148597767 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb87404bb80 con 0x7fb874066920 2023-12-05T09:59:17.192 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.194+0000 7fb86affd700 1 -- 172.21.15.100:0/1148597767 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 91040+0+0 (secure 0 0 0) 0x7fb87001ca00 con 0x7fb874066920 2023-12-05T09:59:17.193 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.195+0000 7fb86affd700 1 --2- 172.21.15.100:0/1148597767 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fb86006cf80 0x7fb86006f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:59:17.193 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.195+0000 7fb86affd700 1 -- 172.21.15.100:0/1148597767 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fb87008dc00 con 0x7fb874066920 2023-12-05T09:59:17.193 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.195+0000 7fb879a21700 1 --2- 172.21.15.100:0/1148597767 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fb86006cf80 0x7fb86006f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:59:17.193 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.196+0000 7fb879a21700 1 --2- 172.21.15.100:0/1148597767 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fb86006cf80 0x7fb86006f430 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb874066660 tx=0x7fb86400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:59:17.197 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.199+0000 7fb86affd700 1 -- 172.21.15.100:0/1148597767 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fb87005b410 con 0x7fb874066920 2023-12-05T09:59:17.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.529+0000 7fb87c486700 1 -- 172.21.15.100:0/1148597767 --> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb8740fbc90 con 0x7fb86006cf80 2023-12-05T09:59:17.527 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.530+0000 7fb86affd700 1 -- 172.21.15.100:0/1148597767 <== mgr.34104 v2:172.21.15.100:6800/3489431924 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7fb8740fbc90 con 0x7fb86006cf80 2023-12-05T09:59:17.530 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.533+0000 7fb87c486700 1 -- 172.21.15.100:0/1148597767 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fb86006cf80 msgr2=0x7fb86006f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:59:17.531 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.533+0000 7fb87c486700 1 --2- 172.21.15.100:0/1148597767 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fb86006cf80 0x7fb86006f430 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb874066660 tx=0x7fb86400b040 comp rx=0 tx=0).stop 2023-12-05T09:59:17.531 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.533+0000 7fb87c486700 1 -- 172.21.15.100:0/1148597767 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb874066920 msgr2=0x7fb87410f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:59:17.531 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.533+0000 7fb87c486700 1 --2- 172.21.15.100:0/1148597767 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb874066920 0x7fb87410f700 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb870008f90 tx=0x7fb870009e30 comp rx=0 tx=0).stop 2023-12-05T09:59:17.531 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.533+0000 7fb87c486700 1 -- 172.21.15.100:0/1148597767 shutdown_connections 2023-12-05T09:59:17.531 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.533+0000 7fb87c486700 1 --2- 172.21.15.100:0/1148597767 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fb86006cf80 0x7fb86006f430 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:17.531 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.533+0000 7fb87c486700 1 --2- 172.21.15.100:0/1148597767 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb874066920 0x7fb87410f700 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:17.531 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.533+0000 7fb87c486700 1 --2- 172.21.15.100:0/1148597767 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8740ffd70 0x7fb87410fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:17.531 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.533+0000 7fb87c486700 1 -- 172.21.15.100:0/1148597767 >> 172.21.15.100:0/1148597767 conn(0x7fb8740f71d0 msgr2=0x7fb8740fb580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:59:17.531 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.533+0000 7fb87c486700 1 -- 172.21.15.100:0/1148597767 shutdown_connections 2023-12-05T09:59:17.531 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.533+0000 7fb87c486700 1 -- 172.21.15.100:0/1148597767 wait complete. 2023-12-05T09:59:17.719 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.721+0000 7ffb6b15d700 1 -- 172.21.15.100:0/819273698 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb64066090 msgr2=0x7ffb641019a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:59:17.719 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.721+0000 7ffb6b15d700 1 --2- 172.21.15.100:0/819273698 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb64066090 0x7ffb641019a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ffb60004940 tx=0x7ffb60009e30 comp rx=0 tx=0).stop 2023-12-05T09:59:17.720 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.721+0000 7ffb6b15d700 1 -- 172.21.15.100:0/819273698 shutdown_connections 2023-12-05T09:59:17.720 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.721+0000 7ffb6b15d700 1 --2- 172.21.15.100:0/819273698 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb64101ee0 0x7ffb641042c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:17.720 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.721+0000 7ffb6b15d700 1 --2- 172.21.15.100:0/819273698 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb64066090 0x7ffb641019a0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:17.720 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.721+0000 7ffb6b15d700 1 -- 172.21.15.100:0/819273698 >> 172.21.15.100:0/819273698 conn(0x7ffb640f6f70 msgr2=0x7ffb640f93e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:59:17.720 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.721+0000 7ffb6b15d700 1 -- 172.21.15.100:0/819273698 shutdown_connections 2023-12-05T09:59:17.720 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.722+0000 7ffb6b15d700 1 -- 172.21.15.100:0/819273698 wait complete. 2023-12-05T09:59:17.720 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.722+0000 7ffb6b15d700 1 Processor -- start 2023-12-05T09:59:17.720 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.723+0000 7ffb6b15d700 1 -- start start 2023-12-05T09:59:17.721 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.723+0000 7ffb6b15d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb64066090 0x7ffb6410f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:59:17.721 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.723+0000 7ffb6b15d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb64101ee0 0x7ffb6410f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:59:17.721 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.723+0000 7ffb6b15d700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6410ffe0 con 0x7ffb64066090 2023-12-05T09:59:17.721 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.723+0000 7ffb6b15d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb64110880 con 0x7ffb64101ee0 2023-12-05T09:59:17.721 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.723+0000 7ffb6995a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb64101ee0 0x7ffb6410f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:59:17.722 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.723+0000 7ffb6995a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb64101ee0 0x7ffb6410f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.100:53110/0 (socket says 172.21.15.100:53110) 2023-12-05T09:59:17.722 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.723+0000 7ffb6995a700 1 -- 172.21.15.100:0/2168044556 learned_addr learned my addr 172.21.15.100:0/2168044556 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:59:17.722 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.724+0000 7ffb6995a700 1 -- 172.21.15.100:0/2168044556 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb64066090 msgr2=0x7ffb6410f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:59:17.722 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.724+0000 7ffb6995a700 1 --2- 172.21.15.100:0/2168044556 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb64066090 0x7ffb6410f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:17.722 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.724+0000 7ffb6995a700 1 -- 172.21.15.100:0/2168044556 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb60005040 con 0x7ffb64101ee0 2023-12-05T09:59:17.722 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.724+0000 7ffb6995a700 1 --2- 172.21.15.100:0/2168044556 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb64101ee0 0x7ffb6410f9e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ffb5400eb40 tx=0x7ffb5400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:59:17.723 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.725+0000 7ffb5affd700 1 -- 172.21.15.100:0/2168044556 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb54007cc0 con 0x7ffb64101ee0 2023-12-05T09:59:17.723 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.725+0000 7ffb6b15d700 1 -- 172.21.15.100:0/2168044556 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb64110b00 con 0x7ffb64101ee0 2023-12-05T09:59:17.723 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.725+0000 7ffb5affd700 1 -- 172.21.15.100:0/2168044556 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ffb5400f040 con 0x7ffb64101ee0 2023-12-05T09:59:17.723 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.725+0000 7ffb5affd700 1 -- 172.21.15.100:0/2168044556 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb540093f0 con 0x7ffb64101ee0 2023-12-05T09:59:17.723 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.725+0000 7ffb6b15d700 1 -- 172.21.15.100:0/2168044556 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb64111040 con 0x7ffb64101ee0 2023-12-05T09:59:17.723 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.726+0000 7ffb6b15d700 1 -- 172.21.15.100:0/2168044556 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb641095e0 con 0x7ffb64101ee0 2023-12-05T09:59:17.724 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.727+0000 7ffb5affd700 1 -- 172.21.15.100:0/2168044556 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 38) v1 ==== 91040+0+0 (secure 0 0 0) 0x7ffb54009660 con 0x7ffb64101ee0 2023-12-05T09:59:17.726 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.729+0000 7ffb5affd700 1 --2- 172.21.15.100:0/2168044556 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7ffb5006cf80 0x7ffb5006f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:59:17.726 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.729+0000 7ffb5affd700 1 -- 172.21.15.100:0/2168044556 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6500+0+0 (secure 0 0 0) 0x7ffb5408cb00 con 0x7ffb64101ee0 2023-12-05T09:59:17.726 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.729+0000 7ffb6a15b700 1 --2- 172.21.15.100:0/2168044556 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7ffb5006cf80 0x7ffb5006f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:59:17.727 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.730+0000 7ffb6a15b700 1 --2- 172.21.15.100:0/2168044556 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7ffb5006cf80 0x7ffb5006f430 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ffb60009fd0 tx=0x7ffb60009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:59:17.728 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:17.731+0000 7ffb5affd700 1 -- 172.21.15.100:0/2168044556 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7ffb5405a250 con 0x7ffb64101ee0 2023-12-05T09:59:18.073 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:18.075+0000 7ffb6b15d700 1 -- 172.21.15.100:0/2168044556 --> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ffb64111490 con 0x7ffb5006cf80 2023-12-05T09:59:18.092 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:18.094+0000 7ffb5affd700 1 -- 172.21.15.100:0/2168044556 <== mgr.34104 v2:172.21.15.100:6800/3489431924 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7ffb64111490 con 0x7ffb5006cf80 2023-12-05T09:59:18.092 INFO:teuthology.orchestra.run.smithi100.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-05T09:59:18.092 INFO:teuthology.orchestra.run.smithi100.stdout:alertmanager.smithi100 smithi100 *:9093,9094 running (2m) 29s ago 9m 15.9M - 0.25.0 c8568f914cd2 f443e6a4242b 2023-12-05T09:59:18.092 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi100 smithi100 running (9m) 29s ago 9m 7822k - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 6379a3185d48 2023-12-05T09:59:18.092 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi150 smithi150 running (8m) 4s ago 8m 7826k - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 349d37092dbd 2023-12-05T09:59:18.092 INFO:teuthology.orchestra.run.smithi100.stdout:grafana.smithi100 smithi100 *:3000 running (111s) 29s ago 9m 80.1M - 9.4.7 2c41d148cca3 d666da9c4e4d 2023-12-05T09:59:18.093 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.akmstb smithi100 running (4m) 29s ago 4m 8248M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 6ce55c42c55b 2023-12-05T09:59:18.093 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.sqplhn smithi100 running (4m) 29s ago 4m 14.3M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc c2682d65f0c9 2023-12-05T09:59:18.093 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi150.fcnhsv smithi150 running (4m) 4s ago 4m 14.7M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 1a259762235d 2023-12-05T09:59:18.093 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi150.pcbpxm smithi150 running (4m) 4s ago 4m 14.7M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 27f730f8b9f9 2023-12-05T09:59:18.093 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi100.ehmuhg smithi100 *:8443,9283,8765 running (88s) 29s ago 10m 500M - 19.0.0-11-g3fe8d441 56dea28e5206 ebe3dfbb0356 2023-12-05T09:59:18.093 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi150.zkskag smithi150 *:8443,9283,8765 running (38s) 4s ago 8m 449M - 19.0.0-11-g3fe8d441 56dea28e5206 a2b40e2421f2 2023-12-05T09:59:18.093 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi100 smithi100 running (10m) 29s ago 10m 92.1M 2048M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 8e091d6081cc 2023-12-05T09:59:18.093 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi150 smithi150 running (8m) 4s ago 8m 67.1M 2048M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 05fe70420b09 2023-12-05T09:59:18.093 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi100 smithi100 *:9100 running (2m) 29s ago 9m 8090k - 1.5.0 0da6a335fe13 a2653da0d840 2023-12-05T09:59:18.093 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi150 smithi150 *:9100 running (98s) 4s ago 8m 8019k - 1.5.0 0da6a335fe13 67523645e73b 2023-12-05T09:59:18.093 INFO:teuthology.orchestra.run.smithi100.stdout:osd.0 smithi100 running (7m) 29s ago 7m 684M 1618M 17.2.7-109-g1fd3ca3c e139fc5fd9fc c8e64a62cd47 2023-12-05T09:59:18.093 INFO:teuthology.orchestra.run.smithi100.stdout:osd.1 smithi100 running (7m) 29s ago 7m 752M 1618M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 0500895cdfc2 2023-12-05T09:59:18.093 INFO:teuthology.orchestra.run.smithi100.stdout:osd.2 smithi100 running (6m) 29s ago 6m 590M 1618M 17.2.7-109-g1fd3ca3c e139fc5fd9fc f145372c8ccc 2023-12-05T09:59:18.094 INFO:teuthology.orchestra.run.smithi100.stdout:osd.3 smithi150 running (6m) 4s ago 6m 1090M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 78137d463d29 2023-12-05T09:59:18.094 INFO:teuthology.orchestra.run.smithi100.stdout:osd.4 smithi150 running (6m) 4s ago 6m 792M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc dfef9accd162 2023-12-05T09:59:18.094 INFO:teuthology.orchestra.run.smithi100.stdout:osd.5 smithi150 running (5m) 4s ago 5m 929M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc d9720b1eae0c 2023-12-05T09:59:18.094 INFO:teuthology.orchestra.run.smithi100.stdout:prometheus.smithi100 smithi100 *:9095 running (43s) 29s ago 8m 36.7M - 2.43.0 a07b618ecd1d 8ade75deb316 2023-12-05T09:59:18.094 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:18.096+0000 7ffb6b15d700 1 -- 172.21.15.100:0/2168044556 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7ffb5006cf80 msgr2=0x7ffb5006f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:59:18.094 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:18.096+0000 7ffb6b15d700 1 --2- 172.21.15.100:0/2168044556 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7ffb5006cf80 0x7ffb5006f430 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ffb60009fd0 tx=0x7ffb60009e30 comp rx=0 tx=0).stop 2023-12-05T09:59:18.095 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:18.096+0000 7ffb6b15d700 1 -- 172.21.15.100:0/2168044556 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb64101ee0 msgr2=0x7ffb6410f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:59:18.095 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:18.096+0000 7ffb6b15d700 1 --2- 172.21.15.100:0/2168044556 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb64101ee0 0x7ffb6410f9e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ffb5400eb40 tx=0x7ffb5400b040 comp rx=0 tx=0).stop 2023-12-05T09:59:18.095 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:18.096+0000 7ffb6b15d700 1 -- 172.21.15.100:0/2168044556 shutdown_connections 2023-12-05T09:59:18.095 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:18.096+0000 7ffb6b15d700 1 --2- 172.21.15.100:0/2168044556 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7ffb5006cf80 0x7ffb5006f430 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:18.095 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:18.096+0000 7ffb6b15d700 1 --2- 172.21.15.100:0/2168044556 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb64066090 0x7ffb6410f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:18.095 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:18.096+0000 7ffb6b15d700 1 --2- 172.21.15.100:0/2168044556 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb64101ee0 0x7ffb6410f9e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:18.095 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:18.096+0000 7ffb6b15d700 1 -- 172.21.15.100:0/2168044556 >> 172.21.15.100:0/2168044556 conn(0x7ffb640f6f70 msgr2=0x7ffb640f93e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:59:18.095 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:18.096+0000 7ffb6b15d700 1 -- 172.21.15.100:0/2168044556 shutdown_connections 2023-12-05T09:59:18.095 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:18.097+0000 7ffb6b15d700 1 -- 172.21.15.100:0/2168044556 wait complete. 2023-12-05T09:59:18.269 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:18.271+0000 7fddfa8cd700 1 -- 172.21.15.100:0/3948244268 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fddf40fee20 msgr2=0x7fddf40ff230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:59:18.269 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:18.271+0000 7fddfa8cd700 1 --2- 172.21.15.100:0/3948244268 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fddf40fee20 0x7fddf40ff230 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fdde4004940 tx=0x7fdde4009e30 comp rx=0 tx=0).stop 2023-12-05T09:59:18.269 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:18.272+0000 7fddfa8cd700 1 -- 172.21.15.100:0/3948244268 shutdown_connections 2023-12-05T09:59:18.270 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:18.272+0000 7fddfa8cd700 1 --2- 172.21.15.100:0/3948244268 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fddf40fff90 0x7fddf4100400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:18.270 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:18.272+0000 7fddfa8cd700 1 --2- 172.21.15.100:0/3948244268 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fddf40fee20 0x7fddf40ff230 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:18.270 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:18.272+0000 7fddfa8cd700 1 -- 172.21.15.100:0/3948244268 >> 172.21.15.100:0/3948244268 conn(0x7fddf40fa5d0 msgr2=0x7fddf40fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:59:18.270 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:18.272+0000 7fddfa8cd700 1 -- 172.21.15.100:0/3948244268 shutdown_connections 2023-12-05T09:59:18.270 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:18.272+0000 7fddfa8cd700 1 -- 172.21.15.100:0/3948244268 wait complete. 2023-12-05T09:59:18.270 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:18.273+0000 7fddfa8cd700 1 Processor -- start 2023-12-05T09:59:18.271 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:18.273+0000 7fddfa8cd700 1 -- start start 2023-12-05T09:59:18.272 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:18.274+0000 7fddfa8cd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fddf40fee20 0x7fddf410f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:59:18.272 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:18.274+0000 7fddfa8cd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fddf40fff90 0x7fddf410fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:59:18.272 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:18.274+0000 7fddfa8cd700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf4110210 con 0x7fddf40fee20 2023-12-05T09:59:18.272 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:18.274+0000 7fddfa8cd700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf4110ab0 con 0x7fddf40fff90 2023-12-05T09:59:18.272 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:18.274+0000 7fddf3fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fddf40fee20 0x7fddf410f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:59:18.272 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:18.274+0000 7fddf3fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fddf40fee20 0x7fddf410f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37900/0 (socket says 172.21.15.100:37900) 2023-12-05T09:59:18.272 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:18.274+0000 7fddf37fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fddf40fff90 0x7fddf410fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:59:18.272 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:18.274+0000 7fddf3fff700 1 -- 172.21.15.100:0/438971069 learned_addr learned my addr 172.21.15.100:0/438971069 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:59:18.273 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:18.275+0000 7fddf3fff700 1 -- 172.21.15.100:0/438971069 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fddf40fff90 msgr2=0x7fddf410fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:59:18.273 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:18.275+0000 7fddf3fff700 1 --2- 172.21.15.100:0/438971069 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fddf40fff90 0x7fddf410fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:18.273 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:18.275+0000 7fddf3fff700 1 -- 172.21.15.100:0/438971069 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdde4005040 con 0x7fddf40fee20 2023-12-05T09:59:18.273 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:18.275+0000 7fddf37fe700 1 --2- 172.21.15.100:0/438971069 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fddf40fff90 0x7fddf410fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-05T09:59:18.273 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:18.275+0000 7fddf3fff700 1 --2- 172.21.15.100:0/438971069 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fddf40fee20 0x7fddf410f6d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdde4009fd0 tx=0x7fdde4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:59:18.274 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:18.276+0000 7fddf0ff9700 1 -- 172.21.15.100:0/438971069 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdde4021070 con 0x7fddf40fee20 2023-12-05T09:59:18.274 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:18.276+0000 7fddfa8cd700 1 -- 172.21.15.100:0/438971069 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddf4110d30 con 0x7fddf40fee20 2023-12-05T09:59:18.274 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:18.276+0000 7fddfa8cd700 1 -- 172.21.15.100:0/438971069 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddf4111270 con 0x7fddf40fee20 2023-12-05T09:59:18.278 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:18.276+0000 7fddf0ff9700 1 -- 172.21.15.100:0/438971069 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdde4026410 con 0x7fddf40fee20 2023-12-05T09:59:18.278 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:18.276+0000 7fddf0ff9700 1 -- 172.21.15.100:0/438971069 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdde400e070 con 0x7fddf40fee20 2023-12-05T09:59:18.278 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:18.278+0000 7fddfa8cd700 1 -- 172.21.15.100:0/438971069 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdde00052e0 con 0x7fddf40fee20 2023-12-05T09:59:18.278 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:18.280+0000 7fddf0ff9700 1 -- 172.21.15.100:0/438971069 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 91040+0+0 (secure 0 0 0) 0x7fdde4013a50 con 0x7fddf40fee20 2023-12-05T09:59:18.280 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:18.282+0000 7fddf0ff9700 1 --2- 172.21.15.100:0/438971069 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fdddc06cf80 0x7fdddc06f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:59:18.280 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:18.282+0000 7fddf0ff9700 1 -- 172.21.15.100:0/438971069 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fdde408dd80 con 0x7fddf40fee20 2023-12-05T09:59:18.280 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:18.283+0000 7fddf37fe700 1 --2- 172.21.15.100:0/438971069 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fdddc06cf80 0x7fdddc06f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:59:18.281 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:18.284+0000 7fddf37fe700 1 --2- 172.21.15.100:0/438971069 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fdddc06cf80 0x7fdddc06f430 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fdde8009b80 tx=0x7fdde800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:59:18.286 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:18.289+0000 7fddf0ff9700 1 -- 172.21.15.100:0/438971069 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fdde405b4d0 con 0x7fddf40fee20 2023-12-05T09:59:18.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:18 smithi150 ceph-mon[116142]: pgmap v6: 65 pgs: 65 active+clean; 237 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 41 KiB/s rd, 724 KiB/s wr, 264 op/s 2023-12-05T09:59:18.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:18 smithi150 ceph-mon[116142]: from='client.24647 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:59:18.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:18 smithi150 ceph-mon[116142]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:59:18.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:18 smithi100 ceph-mon[187528]: pgmap v6: 65 pgs: 65 active+clean; 237 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 41 KiB/s rd, 724 KiB/s wr, 264 op/s 2023-12-05T09:59:18.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:18 smithi100 ceph-mon[187528]: from='client.24647 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:59:18.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:18 smithi100 ceph-mon[187528]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:59:18.816 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:18.817+0000 7fddfa8cd700 1 -- 172.21.15.100:0/438971069 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fdde0005860 con 0x7fddf40fee20 2023-12-05T09:59:18.816 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:18.818+0000 7fddf0ff9700 1 -- 172.21.15.100:0/438971069 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+834 (secure 0 0 0) 0x7fdde405b060 con 0x7fddf40fee20 2023-12-05T09:59:18.816 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2023-12-05T09:59:18.816 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": { 2023-12-05T09:59:18.816 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 1, 2023-12-05T09:59:18.816 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 1 2023-12-05T09:59:18.816 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-12-05T09:59:18.817 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": { 2023-12-05T09:59:18.817 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 2 2023-12-05T09:59:18.817 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-12-05T09:59:18.817 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": { 2023-12-05T09:59:18.817 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 6 2023-12-05T09:59:18.817 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-12-05T09:59:18.817 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": { 2023-12-05T09:59:18.817 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 4 2023-12-05T09:59:18.817 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-12-05T09:59:18.817 INFO:teuthology.orchestra.run.smithi100.stdout: "overall": { 2023-12-05T09:59:18.817 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 11, 2023-12-05T09:59:18.817 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 3 2023-12-05T09:59:18.817 INFO:teuthology.orchestra.run.smithi100.stdout: } 2023-12-05T09:59:18.817 INFO:teuthology.orchestra.run.smithi100.stdout:} 2023-12-05T09:59:18.822 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:18.824+0000 7fddfa8cd700 1 -- 172.21.15.100:0/438971069 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fdddc06cf80 msgr2=0x7fdddc06f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:59:18.822 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:18.824+0000 7fddfa8cd700 1 --2- 172.21.15.100:0/438971069 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fdddc06cf80 0x7fdddc06f430 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fdde8009b80 tx=0x7fdde800b040 comp rx=0 tx=0).stop 2023-12-05T09:59:18.822 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:18.824+0000 7fddfa8cd700 1 -- 172.21.15.100:0/438971069 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fddf40fee20 msgr2=0x7fddf410f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:59:18.822 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:18.824+0000 7fddfa8cd700 1 --2- 172.21.15.100:0/438971069 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fddf40fee20 0x7fddf410f6d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdde4009fd0 tx=0x7fdde4009e30 comp rx=0 tx=0).stop 2023-12-05T09:59:18.822 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:18.824+0000 7fddfa8cd700 1 -- 172.21.15.100:0/438971069 shutdown_connections 2023-12-05T09:59:18.822 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:18.824+0000 7fddfa8cd700 1 --2- 172.21.15.100:0/438971069 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fdddc06cf80 0x7fdddc06f430 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:18.822 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:18.824+0000 7fddfa8cd700 1 --2- 172.21.15.100:0/438971069 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fddf40fee20 0x7fddf410f6d0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:18.822 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:18.824+0000 7fddfa8cd700 1 --2- 172.21.15.100:0/438971069 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fddf40fff90 0x7fddf410fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:18.822 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:18.824+0000 7fddfa8cd700 1 -- 172.21.15.100:0/438971069 >> 172.21.15.100:0/438971069 conn(0x7fddf40fa5d0 msgr2=0x7fddf4103250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:59:18.823 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:18.824+0000 7fddfa8cd700 1 -- 172.21.15.100:0/438971069 shutdown_connections 2023-12-05T09:59:18.823 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:18.824+0000 7fddfa8cd700 1 -- 172.21.15.100:0/438971069 wait complete. 2023-12-05T09:59:19.018 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.021+0000 7f98a5b5c700 1 -- 172.21.15.100:0/2086401306 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98a00fde00 msgr2=0x7f98a00fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:59:19.019 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.021+0000 7f98a5b5c700 1 --2- 172.21.15.100:0/2086401306 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98a00fde00 0x7f98a00fe250 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9894004940 tx=0x7f9894009e30 comp rx=0 tx=0).stop 2023-12-05T09:59:19.019 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.021+0000 7f98a5b5c700 1 -- 172.21.15.100:0/2086401306 shutdown_connections 2023-12-05T09:59:19.019 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.021+0000 7f98a5b5c700 1 --2- 172.21.15.100:0/2086401306 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98a00fde00 0x7f98a00fe250 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:19.019 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.021+0000 7f98a5b5c700 1 --2- 172.21.15.100:0/2086401306 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98a00fcbf0 0x7f98a00fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:19.019 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.021+0000 7f98a5b5c700 1 -- 172.21.15.100:0/2086401306 >> 172.21.15.100:0/2086401306 conn(0x7f98a00f82d0 msgr2=0x7f98a00fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:59:19.019 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.021+0000 7f98a5b5c700 1 -- 172.21.15.100:0/2086401306 shutdown_connections 2023-12-05T09:59:19.019 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.021+0000 7f98a5b5c700 1 -- 172.21.15.100:0/2086401306 wait complete. 2023-12-05T09:59:19.019 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.022+0000 7f98a5b5c700 1 Processor -- start 2023-12-05T09:59:19.021 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.023+0000 7f98a5b5c700 1 -- start start 2023-12-05T09:59:19.021 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.023+0000 7f98a5b5c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98a00fcbf0 0x7f98a00715f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:59:19.021 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.023+0000 7f98a5b5c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98a00fde00 0x7f98a0071b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:59:19.021 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.023+0000 7f98a5b5c700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a011afb0 con 0x7f98a00fde00 2023-12-05T09:59:19.021 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.023+0000 7f98a5b5c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a011b0f0 con 0x7f98a00fcbf0 2023-12-05T09:59:19.022 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.024+0000 7f989f7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98a00fcbf0 0x7f98a00715f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:59:19.022 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.024+0000 7f989effd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98a00fde00 0x7f98a0071b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:59:19.022 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.024+0000 7f989effd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98a00fde00 0x7f98a0071b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37904/0 (socket says 172.21.15.100:37904) 2023-12-05T09:59:19.023 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.024+0000 7f989effd700 1 -- 172.21.15.100:0/3252656433 learned_addr learned my addr 172.21.15.100:0/3252656433 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:59:19.023 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.024+0000 7f989f7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98a00fcbf0 0x7f98a00715f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.100:53140/0 (socket says 172.21.15.100:53140) 2023-12-05T09:59:19.023 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.024+0000 7f989effd700 1 -- 172.21.15.100:0/3252656433 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98a00fcbf0 msgr2=0x7f98a00715f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:59:19.023 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.024+0000 7f989effd700 1 --2- 172.21.15.100:0/3252656433 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98a00fcbf0 0x7f98a00715f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:19.023 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.025+0000 7f989effd700 1 -- 172.21.15.100:0/3252656433 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9894005040 con 0x7f98a00fde00 2023-12-05T09:59:19.023 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.025+0000 7f989f7fe700 1 --2- 172.21.15.100:0/3252656433 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98a00fcbf0 0x7f98a00715f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-05T09:59:19.023 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.025+0000 7f989effd700 1 --2- 172.21.15.100:0/3252656433 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98a00fde00 0x7f98a0071b30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9894008f90 tx=0x7f9894009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:59:19.023 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.025+0000 7f9887fff700 1 -- 172.21.15.100:0/3252656433 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9894021070 con 0x7f98a00fde00 2023-12-05T09:59:19.023 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.025+0000 7f9887fff700 1 -- 172.21.15.100:0/3252656433 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f989401c400 con 0x7f98a00fde00 2023-12-05T09:59:19.023 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.025+0000 7f9887fff700 1 -- 172.21.15.100:0/3252656433 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f989400e030 con 0x7f98a00fde00 2023-12-05T09:59:19.024 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.025+0000 7f98a5b5c700 1 -- 172.21.15.100:0/3252656433 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98a011b370 con 0x7f98a00fde00 2023-12-05T09:59:19.024 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.026+0000 7f98a5b5c700 1 -- 172.21.15.100:0/3252656433 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98a011b860 con 0x7f98a00fde00 2023-12-05T09:59:19.025 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.028+0000 7f98a5b5c700 1 -- 172.21.15.100:0/3252656433 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98a004bb80 con 0x7f98a00fde00 2023-12-05T09:59:19.029 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.029+0000 7f9887fff700 1 -- 172.21.15.100:0/3252656433 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 91040+0+0 (secure 0 0 0) 0x7f989401ca00 con 0x7f98a00fde00 2023-12-05T09:59:19.029 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.031+0000 7f9887fff700 1 --2- 172.21.15.100:0/3252656433 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f988806d110 0x7f988806f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:59:19.029 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.031+0000 7f9887fff700 1 -- 172.21.15.100:0/3252656433 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f989408d850 con 0x7f98a00fde00 2023-12-05T09:59:19.030 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.032+0000 7f989f7fe700 1 --2- 172.21.15.100:0/3252656433 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f988806d110 0x7f988806f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:59:19.030 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.033+0000 7f989f7fe700 1 --2- 172.21.15.100:0/3252656433 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f988806d110 0x7f988806f5c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f98a0071380 tx=0x7f989000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:59:19.035 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.038+0000 7f9887fff700 1 -- 172.21.15.100:0/3252656433 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f9894057510 con 0x7f98a00fde00 2023-12-05T09:59:19.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:19 smithi150 ceph-mon[116142]: from='client.24653 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:59:19.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:19 smithi150 ceph-mon[116142]: from='client.? 172.21.15.100:0/438971069' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:59:19.397 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:19 smithi100 ceph-mon[187528]: from='client.24653 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:59:19.397 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:19 smithi100 ceph-mon[187528]: from='client.? 172.21.15.100:0/438971069' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:59:19.431 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.431+0000 7f98a5b5c700 1 -- 172.21.15.100:0/3252656433 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f98a0070240 con 0x7f98a00fde00 2023-12-05T09:59:19.431 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.433+0000 7f9887fff700 1 -- 172.21.15.100:0/3252656433 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1852 (secure 0 0 0) 0x7f989405ab30 con 0x7f98a00fde00 2023-12-05T09:59:19.431 INFO:teuthology.orchestra.run.smithi100.stdout:e13 2023-12-05T09:59:19.431 INFO:teuthology.orchestra.run.smithi100.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-05T09:59:19.431 INFO:teuthology.orchestra.run.smithi100.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T09:59:19.431 INFO:teuthology.orchestra.run.smithi100.stdout:legacy client fscid: 1 2023-12-05T09:59:19.432 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:59:19.432 INFO:teuthology.orchestra.run.smithi100.stdout:Filesystem 'cephfs' (1) 2023-12-05T09:59:19.432 INFO:teuthology.orchestra.run.smithi100.stdout:fs_name cephfs 2023-12-05T09:59:19.432 INFO:teuthology.orchestra.run.smithi100.stdout:epoch 13 2023-12-05T09:59:19.432 INFO:teuthology.orchestra.run.smithi100.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-05T09:59:19.432 INFO:teuthology.orchestra.run.smithi100.stdout:created 2023-12-05T09:54:30.515778+0000 2023-12-05T09:59:19.432 INFO:teuthology.orchestra.run.smithi100.stdout:modified 2023-12-05T09:54:46.403009+0000 2023-12-05T09:59:19.432 INFO:teuthology.orchestra.run.smithi100.stdout:tableserver 0 2023-12-05T09:59:19.432 INFO:teuthology.orchestra.run.smithi100.stdout:root 0 2023-12-05T09:59:19.432 INFO:teuthology.orchestra.run.smithi100.stdout:session_timeout 60 2023-12-05T09:59:19.432 INFO:teuthology.orchestra.run.smithi100.stdout:session_autoclose 300 2023-12-05T09:59:19.432 INFO:teuthology.orchestra.run.smithi100.stdout:max_file_size 1099511627776 2023-12-05T09:59:19.432 INFO:teuthology.orchestra.run.smithi100.stdout:max_xattr_size 65536 2023-12-05T09:59:19.432 INFO:teuthology.orchestra.run.smithi100.stdout:required_client_features {} 2023-12-05T09:59:19.432 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure 0 2023-12-05T09:59:19.433 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure_osd_epoch 46 2023-12-05T09:59:19.433 INFO:teuthology.orchestra.run.smithi100.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T09:59:19.433 INFO:teuthology.orchestra.run.smithi100.stdout:max_mds 1 2023-12-05T09:59:19.433 INFO:teuthology.orchestra.run.smithi100.stdout:in 0 2023-12-05T09:59:19.433 INFO:teuthology.orchestra.run.smithi100.stdout:up {0=14490} 2023-12-05T09:59:19.433 INFO:teuthology.orchestra.run.smithi100.stdout:failed 2023-12-05T09:59:19.433 INFO:teuthology.orchestra.run.smithi100.stdout:damaged 2023-12-05T09:59:19.433 INFO:teuthology.orchestra.run.smithi100.stdout:stopped 2023-12-05T09:59:19.433 INFO:teuthology.orchestra.run.smithi100.stdout:data_pools [3] 2023-12-05T09:59:19.433 INFO:teuthology.orchestra.run.smithi100.stdout:metadata_pool 2 2023-12-05T09:59:19.433 INFO:teuthology.orchestra.run.smithi100.stdout:inline_data disabled 2023-12-05T09:59:19.433 INFO:teuthology.orchestra.run.smithi100.stdout:balancer 2023-12-05T09:59:19.433 INFO:teuthology.orchestra.run.smithi100.stdout:bal_rank_mask -1 2023-12-05T09:59:19.433 INFO:teuthology.orchestra.run.smithi100.stdout:standby_count_wanted 1 2023-12-05T09:59:19.433 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi100.akmstb{0:14490} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.100:6828/627555128,v1:172.21.15.100:6829/627555128] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:59:19.434 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:59:19.434 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:59:19.434 INFO:teuthology.orchestra.run.smithi100.stdout:Standby daemons: 2023-12-05T09:59:19.434 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:59:19.434 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi150.pcbpxm{-1:14486} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.150:6824/3645854543,v1:172.21.15.150:6825/3645854543] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:59:19.434 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi150.fcnhsv{-1:14498} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.150:6826/3249949736,v1:172.21.15.150:6827/3249949736] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:59:19.434 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi100.sqplhn{-1:14506} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.100:6826/2472212864,v1:172.21.15.100:6827/2472212864] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:59:19.434 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.437+0000 7f98a5b5c700 1 -- 172.21.15.100:0/3252656433 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f988806d110 msgr2=0x7f988806f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:59:19.435 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.437+0000 7f98a5b5c700 1 --2- 172.21.15.100:0/3252656433 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f988806d110 0x7f988806f5c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f98a0071380 tx=0x7f989000b040 comp rx=0 tx=0).stop 2023-12-05T09:59:19.435 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.437+0000 7f98a5b5c700 1 -- 172.21.15.100:0/3252656433 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98a00fde00 msgr2=0x7f98a0071b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:59:19.435 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.437+0000 7f98a5b5c700 1 --2- 172.21.15.100:0/3252656433 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98a00fde00 0x7f98a0071b30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9894008f90 tx=0x7f9894009e30 comp rx=0 tx=0).stop 2023-12-05T09:59:19.437 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.439+0000 7f98a5b5c700 1 -- 172.21.15.100:0/3252656433 shutdown_connections 2023-12-05T09:59:19.437 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.440+0000 7f98a5b5c700 1 --2- 172.21.15.100:0/3252656433 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f988806d110 0x7f988806f5c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:19.438 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.440+0000 7f98a5b5c700 1 --2- 172.21.15.100:0/3252656433 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98a00fcbf0 0x7f98a00715f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:19.438 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.440+0000 7f98a5b5c700 1 --2- 172.21.15.100:0/3252656433 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98a00fde00 0x7f98a0071b30 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:19.438 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.440+0000 7f98a5b5c700 1 -- 172.21.15.100:0/3252656433 >> 172.21.15.100:0/3252656433 conn(0x7f98a00f82d0 msgr2=0x7f98a0101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:59:19.439 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.440+0000 7f98a5b5c700 1 -- 172.21.15.100:0/3252656433 shutdown_connections 2023-12-05T09:59:19.439 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.440+0000 7f98a5b5c700 1 -- 172.21.15.100:0/3252656433 wait complete. 2023-12-05T09:59:19.441 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 13 2023-12-05T09:59:19.682 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.683+0000 7f18b874c700 1 -- 172.21.15.100:0/1370268626 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18b006e670 msgr2=0x7f18b006ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:59:19.682 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.683+0000 7f18b874c700 1 --2- 172.21.15.100:0/1370268626 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18b006e670 0x7f18b006ea80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f18ac004940 tx=0x7f18ac009e30 comp rx=0 tx=0).stop 2023-12-05T09:59:19.682 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.683+0000 7f18b874c700 1 -- 172.21.15.100:0/1370268626 shutdown_connections 2023-12-05T09:59:19.682 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.683+0000 7f18b874c700 1 --2- 172.21.15.100:0/1370268626 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18b006efc0 0x7f18b0109d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:19.682 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.683+0000 7f18b874c700 1 --2- 172.21.15.100:0/1370268626 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18b006e670 0x7f18b006ea80 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:19.682 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.683+0000 7f18b874c700 1 -- 172.21.15.100:0/1370268626 >> 172.21.15.100:0/1370268626 conn(0x7f18b0069b20 msgr2=0x7f18b006bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:59:19.682 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.684+0000 7f18b874c700 1 -- 172.21.15.100:0/1370268626 shutdown_connections 2023-12-05T09:59:19.682 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.684+0000 7f18b874c700 1 -- 172.21.15.100:0/1370268626 wait complete. 2023-12-05T09:59:19.683 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.685+0000 7f18b874c700 1 Processor -- start 2023-12-05T09:59:19.683 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.685+0000 7f18b874c700 1 -- start start 2023-12-05T09:59:19.683 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.685+0000 7f18b874c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18b006e670 0x7f18b0117ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:59:19.683 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.686+0000 7f18b874c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18b006efc0 0x7f18b0118410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:59:19.683 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.686+0000 7f18b874c700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b0118a10 con 0x7f18b006e670 2023-12-05T09:59:19.683 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.686+0000 7f18b874c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b01192b0 con 0x7f18b006efc0 2023-12-05T09:59:19.685 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.686+0000 7f18b5ce7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18b006efc0 0x7f18b0118410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:59:19.685 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.686+0000 7f18b5ce7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18b006efc0 0x7f18b0118410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.100:53150/0 (socket says 172.21.15.100:53150) 2023-12-05T09:59:19.685 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.686+0000 7f18b5ce7700 1 -- 172.21.15.100:0/1552099667 learned_addr learned my addr 172.21.15.100:0/1552099667 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:59:19.686 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.686+0000 7f18b64e8700 1 --2- 172.21.15.100:0/1552099667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18b006e670 0x7f18b0117ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:59:19.686 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.687+0000 7f18b64e8700 1 -- 172.21.15.100:0/1552099667 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18b006efc0 msgr2=0x7f18b0118410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:59:19.686 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.687+0000 7f18b64e8700 1 --2- 172.21.15.100:0/1552099667 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18b006efc0 0x7f18b0118410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:19.686 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.687+0000 7f18b64e8700 1 -- 172.21.15.100:0/1552099667 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18ac005040 con 0x7f18b006e670 2023-12-05T09:59:19.686 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.687+0000 7f18b5ce7700 1 --2- 172.21.15.100:0/1552099667 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18b006efc0 0x7f18b0118410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-05T09:59:19.686 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.688+0000 7f18b64e8700 1 --2- 172.21.15.100:0/1552099667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18b006e670 0x7f18b0117ed0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f18ac004890 tx=0x7f18ac009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:59:19.686 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.689+0000 7f18a6ffd700 1 -- 172.21.15.100:0/1552099667 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18ac00e070 con 0x7f18b006e670 2023-12-05T09:59:19.687 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.689+0000 7f18a6ffd700 1 -- 172.21.15.100:0/1552099667 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f18ac004290 con 0x7f18b006e670 2023-12-05T09:59:19.687 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.689+0000 7f18a6ffd700 1 -- 172.21.15.100:0/1552099667 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18ac01cdb0 con 0x7f18b006e670 2023-12-05T09:59:19.688 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.690+0000 7f18b874c700 1 -- 172.21.15.100:0/1552099667 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18b0119530 con 0x7f18b006e670 2023-12-05T09:59:19.688 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.690+0000 7f18b874c700 1 -- 172.21.15.100:0/1552099667 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18b0119a10 con 0x7f18b006e670 2023-12-05T09:59:19.689 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.692+0000 7f18b874c700 1 -- 172.21.15.100:0/1552099667 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18b004bb80 con 0x7f18b006e670 2023-12-05T09:59:19.696 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.697+0000 7f18a6ffd700 1 -- 172.21.15.100:0/1552099667 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 91040+0+0 (secure 0 0 0) 0x7f18ac01c600 con 0x7f18b006e670 2023-12-05T09:59:19.696 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.699+0000 7f18a6ffd700 1 --2- 172.21.15.100:0/1552099667 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f189c06d160 0x7f189c06f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:59:19.696 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.699+0000 7f18a6ffd700 1 -- 172.21.15.100:0/1552099667 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f18ac08e620 con 0x7f18b006e670 2023-12-05T09:59:19.697 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.700+0000 7f18b5ce7700 1 --2- 172.21.15.100:0/1552099667 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f189c06d160 0x7f189c06f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:59:19.699 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.701+0000 7f18b5ce7700 1 --2- 172.21.15.100:0/1552099667 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f189c06d160 0x7f189c06f610 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f18a00041d0 tx=0x7f18a000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:59:19.703 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:19.705+0000 7f18a6ffd700 1 -- 172.21.15.100:0/1552099667 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f18ac05bd70 con 0x7f18b006e670 2023-12-05T09:59:20.068 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:20.070+0000 7f18b874c700 1 -- 172.21.15.100:0/1552099667 --> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f18b006af20 con 0x7f189c06d160 2023-12-05T09:59:20.069 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:20.072+0000 7f18a6ffd700 1 -- 172.21.15.100:0/1552099667 <== mgr.34104 v2:172.21.15.100:6800/3489431924 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f18b006af20 con 0x7f189c06d160 2023-12-05T09:59:20.069 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2023-12-05T09:59:20.069 INFO:teuthology.orchestra.run.smithi100.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ff918c95653912ae4c171d8d1db5f5eabc756f85ff7e3ce78f13f9c521198459", 2023-12-05T09:59:20.069 INFO:teuthology.orchestra.run.smithi100.stdout: "in_progress": true, 2023-12-05T09:59:20.069 INFO:teuthology.orchestra.run.smithi100.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-05T09:59:20.069 INFO:teuthology.orchestra.run.smithi100.stdout: "services_complete": [ 2023-12-05T09:59:20.069 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr" 2023-12-05T09:59:20.070 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2023-12-05T09:59:20.070 INFO:teuthology.orchestra.run.smithi100.stdout: "progress": "2/21 daemons upgraded", 2023-12-05T09:59:20.070 INFO:teuthology.orchestra.run.smithi100.stdout: "message": "", 2023-12-05T09:59:20.070 INFO:teuthology.orchestra.run.smithi100.stdout: "is_paused": false 2023-12-05T09:59:20.070 INFO:teuthology.orchestra.run.smithi100.stdout:} 2023-12-05T09:59:20.072 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:20.074+0000 7f18b874c700 1 -- 172.21.15.100:0/1552099667 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f189c06d160 msgr2=0x7f189c06f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:59:20.072 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:20.074+0000 7f18b874c700 1 --2- 172.21.15.100:0/1552099667 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f189c06d160 0x7f189c06f610 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f18a00041d0 tx=0x7f18a000b040 comp rx=0 tx=0).stop 2023-12-05T09:59:20.072 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:20.074+0000 7f18b874c700 1 -- 172.21.15.100:0/1552099667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18b006e670 msgr2=0x7f18b0117ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:59:20.072 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:20.074+0000 7f18b874c700 1 --2- 172.21.15.100:0/1552099667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18b006e670 0x7f18b0117ed0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f18ac004890 tx=0x7f18ac009e30 comp rx=0 tx=0).stop 2023-12-05T09:59:20.072 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:20.074+0000 7f18b874c700 1 -- 172.21.15.100:0/1552099667 shutdown_connections 2023-12-05T09:59:20.072 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:20.074+0000 7f18b874c700 1 --2- 172.21.15.100:0/1552099667 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f189c06d160 0x7f189c06f610 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:20.072 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:20.074+0000 7f18b874c700 1 --2- 172.21.15.100:0/1552099667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18b006e670 0x7f18b0117ed0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:20.072 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:20.074+0000 7f18b874c700 1 --2- 172.21.15.100:0/1552099667 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18b006efc0 0x7f18b0118410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:20.072 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:20.074+0000 7f18b874c700 1 -- 172.21.15.100:0/1552099667 >> 172.21.15.100:0/1552099667 conn(0x7f18b0069b20 msgr2=0x7f18b006a810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:59:20.073 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:20.075+0000 7f18b874c700 1 -- 172.21.15.100:0/1552099667 shutdown_connections 2023-12-05T09:59:20.073 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:20.075+0000 7f18b874c700 1 -- 172.21.15.100:0/1552099667 wait complete. 2023-12-05T09:59:20.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:20 smithi100 ceph-mon[187528]: pgmap v7: 65 pgs: 65 active+clean; 233 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 53 KiB/s rd, 1.1 MiB/s wr, 333 op/s 2023-12-05T09:59:20.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:20 smithi100 ceph-mon[187528]: from='client.? 172.21.15.100:0/3252656433' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-05T09:59:20.219 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:20 smithi150 ceph-mon[116142]: pgmap v7: 65 pgs: 65 active+clean; 233 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 53 KiB/s rd, 1.1 MiB/s wr, 333 op/s 2023-12-05T09:59:20.220 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:20 smithi150 ceph-mon[116142]: from='client.? 172.21.15.100:0/3252656433' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-05T09:59:20.270 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:20.272+0000 7ff258b93700 1 -- 172.21.15.100:0/1129520752 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff2540fcbf0 msgr2=0x7ff2540fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:59:20.270 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:20.272+0000 7ff258b93700 1 --2- 172.21.15.100:0/1129520752 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff2540fcbf0 0x7ff2540fd000 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff244004940 tx=0x7ff244009e30 comp rx=0 tx=0).stop 2023-12-05T09:59:20.270 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:20.272+0000 7ff258b93700 1 -- 172.21.15.100:0/1129520752 shutdown_connections 2023-12-05T09:59:20.270 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:20.272+0000 7ff258b93700 1 --2- 172.21.15.100:0/1129520752 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2540fde00 0x7ff2540fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:20.270 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:20.272+0000 7ff258b93700 1 --2- 172.21.15.100:0/1129520752 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff2540fcbf0 0x7ff2540fd000 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:20.270 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:20.272+0000 7ff258b93700 1 -- 172.21.15.100:0/1129520752 >> 172.21.15.100:0/1129520752 conn(0x7ff2540f82d0 msgr2=0x7ff2540fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:59:20.270 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:20.272+0000 7ff258b93700 1 -- 172.21.15.100:0/1129520752 shutdown_connections 2023-12-05T09:59:20.270 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:20.272+0000 7ff258b93700 1 -- 172.21.15.100:0/1129520752 wait complete. 2023-12-05T09:59:20.271 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:20.273+0000 7ff258b93700 1 Processor -- start 2023-12-05T09:59:20.272 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:20.274+0000 7ff258b93700 1 -- start start 2023-12-05T09:59:20.272 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:20.275+0000 7ff258b93700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2540fcbf0 0x7ff25410f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:59:20.272 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:20.275+0000 7ff258b93700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff2540fde00 0x7ff25410fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:59:20.272 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:20.275+0000 7ff258b93700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff254110200 con 0x7ff2540fde00 2023-12-05T09:59:20.272 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:20.275+0000 7ff258b93700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff254110aa0 con 0x7ff2540fcbf0 2023-12-05T09:59:20.273 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:20.275+0000 7ff251d9b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff2540fde00 0x7ff25410fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:59:20.273 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:20.275+0000 7ff251d9b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff2540fde00 0x7ff25410fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41162/0 (socket says 172.21.15.100:41162) 2023-12-05T09:59:20.273 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:20.275+0000 7ff251d9b700 1 -- 172.21.15.100:0/970016153 learned_addr learned my addr 172.21.15.100:0/970016153 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:59:20.273 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:20.276+0000 7ff251d9b700 1 -- 172.21.15.100:0/970016153 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2540fcbf0 msgr2=0x7ff25410f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:59:20.273 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:20.276+0000 7ff251d9b700 1 --2- 172.21.15.100:0/970016153 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2540fcbf0 0x7ff25410f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:20.273 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:20.276+0000 7ff251d9b700 1 -- 172.21.15.100:0/970016153 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff244005040 con 0x7ff2540fde00 2023-12-05T09:59:20.274 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:20.276+0000 7ff251d9b700 1 --2- 172.21.15.100:0/970016153 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff2540fde00 0x7ff25410fc00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff24800eb40 tx=0x7ff24800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:59:20.274 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:20.276+0000 7ff242ffd700 1 -- 172.21.15.100:0/970016153 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff248007cc0 con 0x7ff2540fde00 2023-12-05T09:59:20.274 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:20.276+0000 7ff242ffd700 1 -- 172.21.15.100:0/970016153 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff24800f040 con 0x7ff2540fde00 2023-12-05T09:59:20.274 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:20.276+0000 7ff258b93700 1 -- 172.21.15.100:0/970016153 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff254110d20 con 0x7ff2540fde00 2023-12-05T09:59:20.274 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:20.276+0000 7ff242ffd700 1 -- 172.21.15.100:0/970016153 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff248009570 con 0x7ff2540fde00 2023-12-05T09:59:20.274 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:20.277+0000 7ff258b93700 1 -- 172.21.15.100:0/970016153 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff254111260 con 0x7ff2540fde00 2023-12-05T09:59:20.276 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:20.279+0000 7ff242ffd700 1 -- 172.21.15.100:0/970016153 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 91040+0+0 (secure 0 0 0) 0x7ff2480096d0 con 0x7ff2540fde00 2023-12-05T09:59:20.277 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:20.280+0000 7ff258b93700 1 -- 172.21.15.100:0/970016153 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff254101ea0 con 0x7ff2540fde00 2023-12-05T09:59:20.278 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:20.280+0000 7ff242ffd700 1 --2- 172.21.15.100:0/970016153 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7ff23c06cf80 0x7ff23c06f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:59:20.278 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:20.280+0000 7ff242ffd700 1 -- 172.21.15.100:0/970016153 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6500+0+0 (secure 0 0 0) 0x7ff24808c1d0 con 0x7ff2540fde00 2023-12-05T09:59:20.278 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:20.281+0000 7ff25259c700 1 --2- 172.21.15.100:0/970016153 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7ff23c06cf80 0x7ff23c06f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:59:20.279 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:20.282+0000 7ff25259c700 1 --2- 172.21.15.100:0/970016153 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7ff23c06cf80 0x7ff23c06f430 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff244013600 tx=0x7ff244009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:59:20.285 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:20.287+0000 7ff242ffd700 1 -- 172.21.15.100:0/970016153 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7ff248059950 con 0x7ff2540fde00 2023-12-05T09:59:20.777 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:20.779+0000 7ff258b93700 1 -- 172.21.15.100:0/970016153 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7ff25404bb80 con 0x7ff2540fde00 2023-12-05T09:59:20.777 INFO:teuthology.orchestra.run.smithi100.stdout:HEALTH_OK 2023-12-05T09:59:20.777 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:20.780+0000 7ff242ffd700 1 -- 172.21.15.100:0/970016153 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7ff248019070 con 0x7ff2540fde00 2023-12-05T09:59:20.781 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:20.784+0000 7ff258b93700 1 -- 172.21.15.100:0/970016153 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7ff23c06cf80 msgr2=0x7ff23c06f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:59:20.781 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:20.784+0000 7ff258b93700 1 --2- 172.21.15.100:0/970016153 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7ff23c06cf80 0x7ff23c06f430 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff244013600 tx=0x7ff244009e30 comp rx=0 tx=0).stop 2023-12-05T09:59:20.781 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:20.784+0000 7ff258b93700 1 -- 172.21.15.100:0/970016153 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff2540fde00 msgr2=0x7ff25410fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:59:20.781 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:20.784+0000 7ff258b93700 1 --2- 172.21.15.100:0/970016153 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff2540fde00 0x7ff25410fc00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff24800eb40 tx=0x7ff24800b040 comp rx=0 tx=0).stop 2023-12-05T09:59:20.782 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:20.784+0000 7ff258b93700 1 -- 172.21.15.100:0/970016153 shutdown_connections 2023-12-05T09:59:20.782 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:20.784+0000 7ff258b93700 1 --2- 172.21.15.100:0/970016153 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7ff23c06cf80 0x7ff23c06f430 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:20.782 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:20.784+0000 7ff258b93700 1 --2- 172.21.15.100:0/970016153 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2540fcbf0 0x7ff25410f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:20.782 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:20.784+0000 7ff258b93700 1 --2- 172.21.15.100:0/970016153 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff2540fde00 0x7ff25410fc00 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:20.783 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:20.784+0000 7ff258b93700 1 -- 172.21.15.100:0/970016153 >> 172.21.15.100:0/970016153 conn(0x7ff2540f82d0 msgr2=0x7ff2540ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:59:20.783 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:20.785+0000 7ff258b93700 1 -- 172.21.15.100:0/970016153 shutdown_connections 2023-12-05T09:59:20.783 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:20.785+0000 7ff258b93700 1 -- 172.21.15.100:0/970016153 wait complete. 2023-12-05T09:59:21.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:21 smithi100 ceph-mon[187528]: from='client.34146 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:59:21.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:21 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:21.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:21 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:21.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:21 smithi100 ceph-mon[187528]: from='client.? 172.21.15.100:0/970016153' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-05T09:59:21.595 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:21 smithi150 ceph-mon[116142]: from='client.34146 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:59:21.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:21 smithi150 ceph-mon[116142]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:21.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:21 smithi150 ceph-mon[116142]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:21.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:21 smithi150 ceph-mon[116142]: from='client.? 172.21.15.100:0/970016153' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-05T09:59:22.595 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:22 smithi150 ceph-mon[116142]: pgmap v8: 65 pgs: 65 active+clean; 233 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 41 KiB/s rd, 899 KiB/s wr, 259 op/s 2023-12-05T09:59:22.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:22 smithi100 ceph-mon[187528]: pgmap v8: 65 pgs: 65 active+clean; 233 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 41 KiB/s rd, 899 KiB/s wr, 259 op/s 2023-12-05T09:59:23.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:23 smithi150 ceph-mon[116142]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:23.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:23 smithi150 ceph-mon[116142]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:23.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:23 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:23.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:23 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:24.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:24 smithi150 ceph-mon[116142]: pgmap v9: 65 pgs: 65 active+clean; 226 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 46 KiB/s rd, 1.3 MiB/s wr, 540 op/s 2023-12-05T09:59:24.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:24 smithi150 ceph-mon[116142]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:24.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:24 smithi150 ceph-mon[116142]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:24.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:24 smithi150 ceph-mon[116142]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:59:24.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:24 smithi150 ceph-mon[116142]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:59:24.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:24 smithi100 ceph-mon[187528]: pgmap v9: 65 pgs: 65 active+clean; 226 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 46 KiB/s rd, 1.3 MiB/s wr, 540 op/s 2023-12-05T09:59:24.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:24 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:24.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:24 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:24.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:24 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:59:24.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:24 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:59:25.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:25 smithi150 ceph-mon[116142]: Updating smithi100:/etc/ceph/ceph.conf 2023-12-05T09:59:25.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:25 smithi150 ceph-mon[116142]: Updating smithi150:/etc/ceph/ceph.conf 2023-12-05T09:59:25.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:25 smithi100 ceph-mon[187528]: Updating smithi100:/etc/ceph/ceph.conf 2023-12-05T09:59:25.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:25 smithi100 ceph-mon[187528]: Updating smithi150:/etc/ceph/ceph.conf 2023-12-05T09:59:26.120 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2023-12-05T09:59:26.120 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-12-05T09:59:26.303 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2023-12-05T09:59:26.303 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2023-12-05T09:59:26.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:26 smithi150 ceph-mon[116142]: pgmap v10: 65 pgs: 65 active+clean; 226 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 1.2 MiB/s wr, 495 op/s 2023-12-05T09:59:26.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:26 smithi150 ceph-mon[116142]: Updating smithi150:/var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-05T09:59:26.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:26 smithi150 ceph-mon[116142]: Updating smithi100:/var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-05T09:59:26.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:26 smithi150 ceph-mon[116142]: Updating smithi150:/etc/ceph/ceph.client.admin.keyring 2023-12-05T09:59:26.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:26 smithi150 ceph-mon[116142]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:59:26.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:26 smithi100 ceph-mon[187528]: pgmap v10: 65 pgs: 65 active+clean; 226 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 1.2 MiB/s wr, 495 op/s 2023-12-05T09:59:26.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:26 smithi100 ceph-mon[187528]: Updating smithi150:/var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-05T09:59:26.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:26 smithi100 ceph-mon[187528]: Updating smithi100:/var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-05T09:59:26.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:26 smithi100 ceph-mon[187528]: Updating smithi150:/etc/ceph/ceph.client.admin.keyring 2023-12-05T09:59:26.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:26 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:59:27.208 DEBUG:teuthology.parallel:result is None 2023-12-05T09:59:27.292 DEBUG:teuthology.parallel:result is None 2023-12-05T09:59:27.292 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2023-12-05T09:59:27.370 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2023-12-05T09:59:27.371 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2023-12-05T09:59:27.452 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2023-12-05T09:59:27.452 DEBUG:teuthology.parallel:result is None 2023-12-05T09:59:27.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:27 smithi150 ceph-mon[116142]: Updating smithi100:/etc/ceph/ceph.client.admin.keyring 2023-12-05T09:59:27.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:27 smithi150 ceph-mon[116142]: Updating smithi150:/var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-05T09:59:27.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:27 smithi150 ceph-mon[116142]: Updating smithi100:/var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-05T09:59:27.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:27 smithi150 ceph-mon[116142]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:27.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:27 smithi150 ceph-mon[116142]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:27.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:27 smithi150 ceph-mon[116142]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:27.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:27 smithi150 ceph-mon[116142]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:27.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:27 smithi150 ceph-mon[116142]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:27.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:27 smithi150 ceph-mon[116142]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:59:27.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:27 smithi150 ceph-mon[116142]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:59:27.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:27 smithi150 ceph-mon[116142]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "quorum_status"}]: dispatch 2023-12-05T09:59:27.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:27 smithi100 ceph-mon[187528]: Updating smithi100:/etc/ceph/ceph.client.admin.keyring 2023-12-05T09:59:27.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:27 smithi100 ceph-mon[187528]: Updating smithi150:/var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-05T09:59:27.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:27 smithi100 ceph-mon[187528]: Updating smithi100:/var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-05T09:59:27.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:27 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:27.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:27 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:27.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:27 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:27.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:27 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:27.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:27 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:27.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:27 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:59:27.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:27 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:59:27.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:27 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "quorum_status"}]: dispatch 2023-12-05T09:59:28.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:28 smithi150 ceph-mon[116142]: pgmap v11: 65 pgs: 65 active+clean; 222 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 1.5 MiB/s wr, 564 op/s 2023-12-05T09:59:28.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:28 smithi100 ceph-mon[187528]: pgmap v11: 65 pgs: 65 active+clean; 222 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 1.5 MiB/s wr, 564 op/s 2023-12-05T09:59:29.798 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:29 smithi150 ceph-mon[116142]: Upgrade: Updating mon.smithi150 2023-12-05T09:59:29.798 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:29 smithi150 ceph-mon[116142]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:29.798 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:29 smithi150 ceph-mon[116142]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-05T09:59:29.798 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:29 smithi150 ceph-mon[116142]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-05T09:59:29.799 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:29 smithi150 ceph-mon[116142]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:59:29.799 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:29 smithi150 ceph-mon[116142]: Deploying daemon mon.smithi150 on smithi150 2023-12-05T09:59:29.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:29 smithi100 ceph-mon[187528]: Upgrade: Updating mon.smithi150 2023-12-05T09:59:29.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:29 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:29.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:29 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-05T09:59:29.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:29 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-05T09:59:29.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:29 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:59:29.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:29 smithi100 ceph-mon[187528]: Deploying daemon mon.smithi150 on smithi150 2023-12-05T09:59:30.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:30 smithi150 systemd[1]: Stopping Ceph mon.smithi150 for 5b035ce6-9353-11ee-95a2-87774f69a715... 2023-12-05T09:59:30.565 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:30 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-mon-smithi150[116119]: 2023-12-05T09:59:30.303+0000 7f2df0c25700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi150 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-05T09:59:30.565 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:30 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-mon-smithi150[116119]: 2023-12-05T09:59:30.303+0000 7f2df0c25700 -1 mon.smithi150@1(peon) e2 *** Got Signal Terminated *** 2023-12-05T09:59:30.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:30 smithi150 bash[171419]: ceph-5b035ce6-9353-11ee-95a2-87774f69a715-mon-smithi150 2023-12-05T09:59:31.153 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:30 smithi150 systemd[1]: ceph-5b035ce6-9353-11ee-95a2-87774f69a715@mon.smithi150.service: Succeeded. 2023-12-05T09:59:31.154 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:30 smithi150 systemd[1]: Stopped Ceph mon.smithi150 for 5b035ce6-9353-11ee-95a2-87774f69a715. 2023-12-05T09:59:31.573 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 systemd[1]: Starting Ceph mon.smithi150 for 5b035ce6-9353-11ee-95a2-87774f69a715... 2023-12-05T09:59:32.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 bash[171569]: 010f2f658fca0b4071134a33b1fe6690c9aaa4452eb2a268258b1832c5669847 2023-12-05T09:59:32.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 systemd[1]: Started Ceph mon.smithi150 for 5b035ce6-9353-11ee-95a2-87774f69a715. 2023-12-05T09:59:32.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: set uid:gid to 167:167 (ceph:ceph) 2023-12-05T09:59:32.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev), process ceph-mon, pid 7 2023-12-05T09:59:32.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: pidfile_write: ignore empty --pid-file 2023-12-05T09:59:32.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: load: jerasure load: lrc 2023-12-05T09:59:32.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: RocksDB version: 7.9.2 2023-12-05T09:59:32.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Git sha 0 2023-12-05T09:59:32.097 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Compile date 2023-12-05 07:02:20 2023-12-05T09:59:32.097 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: DB SUMMARY 2023-12-05T09:59:32.097 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: DB Session ID: XKHQKLH9SZB0Z8DER47H 2023-12-05T09:59:32.097 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: CURRENT file: CURRENT 2023-12-05T09:59:32.097 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: IDENTITY file: IDENTITY 2023-12-05T09:59:32.097 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: MANIFEST file: MANIFEST-000009 size: 1082 Bytes 2023-12-05T09:59:32.097 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi150/store.db dir, Total Num: 1, files: 000027.sst 2023-12-05T09:59:32.097 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi150/store.db: 000025.log size: 535321 ; 2023-12-05T09:59:32.097 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.error_if_exists: 0 2023-12-05T09:59:32.097 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.create_if_missing: 0 2023-12-05T09:59:32.097 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.paranoid_checks: 1 2023-12-05T09:59:32.097 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.flush_verify_memtable_count: 1 2023-12-05T09:59:32.097 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-12-05T09:59:32.097 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-12-05T09:59:32.098 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.env: 0x55631d1b9a60 2023-12-05T09:59:32.098 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.fs: PosixFileSystem 2023-12-05T09:59:32.098 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.info_log: 0x55631f42f640 2023-12-05T09:59:32.098 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.max_file_opening_threads: 16 2023-12-05T09:59:32.098 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.statistics: (nil) 2023-12-05T09:59:32.098 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.use_fsync: 0 2023-12-05T09:59:32.098 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.max_log_file_size: 0 2023-12-05T09:59:32.098 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-12-05T09:59:32.098 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.log_file_time_to_roll: 0 2023-12-05T09:59:32.098 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.keep_log_file_num: 1000 2023-12-05T09:59:32.098 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.recycle_log_file_num: 0 2023-12-05T09:59:32.098 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.allow_fallocate: 1 2023-12-05T09:59:32.098 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.allow_mmap_reads: 0 2023-12-05T09:59:32.099 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.allow_mmap_writes: 0 2023-12-05T09:59:32.099 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.use_direct_reads: 0 2023-12-05T09:59:32.099 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-12-05T09:59:32.099 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.create_missing_column_families: 0 2023-12-05T09:59:32.099 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.db_log_dir: 2023-12-05T09:59:32.099 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.wal_dir: 2023-12-05T09:59:32.099 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.table_cache_numshardbits: 6 2023-12-05T09:59:32.099 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.WAL_ttl_seconds: 0 2023-12-05T09:59:32.099 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.WAL_size_limit_MB: 0 2023-12-05T09:59:32.099 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-12-05T09:59:32.099 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-12-05T09:59:32.099 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.is_fd_close_on_exec: 1 2023-12-05T09:59:32.099 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.advise_random_on_open: 1 2023-12-05T09:59:32.099 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.db_write_buffer_size: 0 2023-12-05T09:59:32.099 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.write_buffer_manager: 0x55631f3e5360 2023-12-05T09:59:32.100 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-12-05T09:59:32.100 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-12-05T09:59:32.100 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.use_adaptive_mutex: 0 2023-12-05T09:59:32.100 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.rate_limiter: (nil) 2023-12-05T09:59:32.100 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-12-05T09:59:32.100 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.wal_recovery_mode: 2 2023-12-05T09:59:32.100 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.enable_thread_tracking: 0 2023-12-05T09:59:32.100 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.enable_pipelined_write: 0 2023-12-05T09:59:32.100 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.unordered_write: 0 2023-12-05T09:59:32.100 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-12-05T09:59:32.100 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-12-05T09:59:32.100 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-12-05T09:59:32.100 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-12-05T09:59:32.100 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.row_cache: None 2023-12-05T09:59:32.100 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.wal_filter: None 2023-12-05T09:59:32.101 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-12-05T09:59:32.101 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.allow_ingest_behind: 0 2023-12-05T09:59:32.101 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.two_write_queues: 0 2023-12-05T09:59:32.101 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.manual_wal_flush: 0 2023-12-05T09:59:32.101 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.wal_compression: 0 2023-12-05T09:59:32.101 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.atomic_flush: 0 2023-12-05T09:59:32.101 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-12-05T09:59:32.101 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.persist_stats_to_disk: 0 2023-12-05T09:59:32.101 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.write_dbid_to_manifest: 0 2023-12-05T09:59:32.101 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.log_readahead_size: 0 2023-12-05T09:59:32.101 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-12-05T09:59:32.102 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.best_efforts_recovery: 0 2023-12-05T09:59:32.102 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-12-05T09:59:32.102 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-12-05T09:59:32.103 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.allow_data_in_errors: 0 2023-12-05T09:59:32.103 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.db_host_id: __hostname__ 2023-12-05T09:59:32.103 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.enforce_single_del_contracts: true 2023-12-05T09:59:32.103 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.max_background_jobs: 2 2023-12-05T09:59:32.104 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.max_background_compactions: -1 2023-12-05T09:59:32.104 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.max_subcompactions: 1 2023-12-05T09:59:32.104 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-12-05T09:59:32.104 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-12-05T09:59:32.104 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.delayed_write_rate : 16777216 2023-12-05T09:59:32.104 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.max_total_wal_size: 0 2023-12-05T09:59:32.104 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-12-05T09:59:32.104 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.stats_dump_period_sec: 600 2023-12-05T09:59:32.104 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.stats_persist_period_sec: 600 2023-12-05T09:59:32.104 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-12-05T09:59:32.104 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.max_open_files: -1 2023-12-05T09:59:32.104 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.bytes_per_sync: 0 2023-12-05T09:59:32.104 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.wal_bytes_per_sync: 0 2023-12-05T09:59:32.104 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.strict_bytes_per_sync: 0 2023-12-05T09:59:32.105 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.compaction_readahead_size: 0 2023-12-05T09:59:32.105 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.max_background_flushes: -1 2023-12-05T09:59:32.105 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Compression algorithms supported: 2023-12-05T09:59:32.105 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-12-05T09:59:32.105 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: kZSTD supported: 0 2023-12-05T09:59:32.105 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: kXpressCompression supported: 0 2023-12-05T09:59:32.105 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: kLZ4HCCompression supported: 1 2023-12-05T09:59:32.105 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: kZlibCompression supported: 1 2023-12-05T09:59:32.105 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: kSnappyCompression supported: 1 2023-12-05T09:59:32.105 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: kLZ4Compression supported: 1 2023-12-05T09:59:32.105 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: kBZip2Compression supported: 0 2023-12-05T09:59:32.105 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Fast CRC32 supported: Supported on x86 2023-12-05T09:59:32.105 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: DMutex implementation: pthread_mutex_t 2023-12-05T09:59:32.105 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi150/store.db/MANIFEST-000009 2023-12-05T09:59:32.105 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-12-05T09:59:32.106 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-12-05T09:59:32.106 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.merge_operator: 2023-12-05T09:59:32.106 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.compaction_filter: None 2023-12-05T09:59:32.106 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.compaction_filter_factory: None 2023-12-05T09:59:32.106 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.sst_partitioner_factory: None 2023-12-05T09:59:32.106 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.memtable_factory: SkipListFactory 2023-12-05T09:59:32.106 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.table_factory: BlockBasedTable 2023-12-05T09:59:32.106 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55631f42f740) 2023-12-05T09:59:32.106 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: cache_index_and_filter_blocks: 1 2023-12-05T09:59:32.106 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-12-05T09:59:32.106 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-12-05T09:59:32.106 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: pin_top_level_index_and_filter: 1 2023-12-05T09:59:32.106 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: index_type: 0 2023-12-05T09:59:32.106 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: data_block_index_type: 0 2023-12-05T09:59:32.107 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: index_shortening: 1 2023-12-05T09:59:32.107 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: data_block_hash_table_util_ratio: 0.750000 2023-12-05T09:59:32.107 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: checksum: 4 2023-12-05T09:59:32.107 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: no_block_cache: 0 2023-12-05T09:59:32.107 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: block_cache: 0x55631f485090 2023-12-05T09:59:32.107 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: block_cache_name: BinnedLRUCache 2023-12-05T09:59:32.107 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: block_cache_options: 2023-12-05T09:59:32.107 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: capacity : 536870912 2023-12-05T09:59:32.107 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: num_shard_bits : 4 2023-12-05T09:59:32.107 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: strict_capacity_limit : 0 2023-12-05T09:59:32.107 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: high_pri_pool_ratio: 0.000 2023-12-05T09:59:32.107 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: block_cache_compressed: (nil) 2023-12-05T09:59:32.107 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: persistent_cache: (nil) 2023-12-05T09:59:32.107 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: block_size: 4096 2023-12-05T09:59:32.107 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: block_size_deviation: 10 2023-12-05T09:59:32.107 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: block_restart_interval: 16 2023-12-05T09:59:32.108 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: index_block_restart_interval: 1 2023-12-05T09:59:32.108 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: metadata_block_size: 4096 2023-12-05T09:59:32.108 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: partition_filters: 0 2023-12-05T09:59:32.108 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: use_delta_encoding: 1 2023-12-05T09:59:32.108 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: filter_policy: bloomfilter 2023-12-05T09:59:32.108 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: whole_key_filtering: 1 2023-12-05T09:59:32.108 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: verify_compression: 0 2023-12-05T09:59:32.108 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: read_amp_bytes_per_bit: 0 2023-12-05T09:59:32.108 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: format_version: 5 2023-12-05T09:59:32.108 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: enable_index_compression: 1 2023-12-05T09:59:32.108 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: block_align: 0 2023-12-05T09:59:32.108 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: max_auto_readahead_size: 262144 2023-12-05T09:59:32.108 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: prepopulate_block_cache: 0 2023-12-05T09:59:32.108 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: initial_auto_readahead_size: 8192 2023-12-05T09:59:32.108 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: num_file_reads_for_auto_readahead: 2 2023-12-05T09:59:32.108 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.write_buffer_size: 33554432 2023-12-05T09:59:32.109 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.max_write_buffer_number: 2 2023-12-05T09:59:32.109 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.compression: NoCompression 2023-12-05T09:59:32.109 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.bottommost_compression: Disabled 2023-12-05T09:59:32.109 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.prefix_extractor: nullptr 2023-12-05T09:59:32.109 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-12-05T09:59:32.109 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.num_levels: 7 2023-12-05T09:59:32.109 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-12-05T09:59:32.109 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-12-05T09:59:32.109 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-12-05T09:59:32.109 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-12-05T09:59:32.109 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-12-05T09:59:32.109 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-12-05T09:59:32.109 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-12-05T09:59:32.109 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-12-05T09:59:32.110 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-12-05T09:59:32.110 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-12-05T09:59:32.110 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-12-05T09:59:32.110 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-12-05T09:59:32.110 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.compression_opts.window_bits: -14 2023-12-05T09:59:32.110 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.compression_opts.level: 32767 2023-12-05T09:59:32.110 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.compression_opts.strategy: 0 2023-12-05T09:59:32.110 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-12-05T09:59:32.110 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-12-05T09:59:32.110 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-12-05T09:59:32.110 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-12-05T09:59:32.110 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.compression_opts.enabled: false 2023-12-05T09:59:32.110 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-12-05T09:59:32.110 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-12-05T09:59:32.111 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-12-05T09:59:32.111 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-12-05T09:59:32.111 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.target_file_size_base: 67108864 2023-12-05T09:59:32.111 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.target_file_size_multiplier: 1 2023-12-05T09:59:32.111 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-12-05T09:59:32.111 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-12-05T09:59:32.111 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-12-05T09:59:32.111 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-12-05T09:59:32.111 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-12-05T09:59:32.111 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-12-05T09:59:32.111 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-12-05T09:59:32.111 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-12-05T09:59:32.111 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-12-05T09:59:32.111 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-12-05T09:59:32.111 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-12-05T09:59:32.111 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-12-05T09:59:32.112 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-12-05T09:59:32.112 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.arena_block_size: 1048576 2023-12-05T09:59:32.112 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-12-05T09:59:32.112 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-12-05T09:59:32.112 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.disable_auto_compactions: 0 2023-12-05T09:59:32.112 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-12-05T09:59:32.112 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-12-05T09:59:32.112 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-12-05T09:59:32.112 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-12-05T09:59:32.112 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-12-05T09:59:32.112 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-12-05T09:59:32.112 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-12-05T09:59:32.112 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-12-05T09:59:32.112 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-12-05T09:59:32.112 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-12-05T09:59:32.113 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.table_properties_collectors: 2023-12-05T09:59:32.113 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.inplace_update_support: 0 2023-12-05T09:59:32.113 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.inplace_update_num_locks: 10000 2023-12-05T09:59:32.113 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-12-05T09:59:32.113 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-12-05T09:59:32.113 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.memtable_huge_page_size: 0 2023-12-05T09:59:32.113 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.bloom_locality: 0 2023-12-05T09:59:32.113 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.max_successive_merges: 0 2023-12-05T09:59:32.113 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.optimize_filters_for_hits: 0 2023-12-05T09:59:32.113 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.paranoid_file_checks: 0 2023-12-05T09:59:32.113 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.force_consistency_checks: 1 2023-12-05T09:59:32.113 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.report_bg_io_stats: 0 2023-12-05T09:59:32.113 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.ttl: 2592000 2023-12-05T09:59:32.113 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.periodic_compaction_seconds: 0 2023-12-05T09:59:32.113 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-12-05T09:59:32.113 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-12-05T09:59:32.114 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.enable_blob_files: false 2023-12-05T09:59:32.114 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.min_blob_size: 0 2023-12-05T09:59:32.114 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.blob_file_size: 268435456 2023-12-05T09:59:32.114 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.blob_compression_type: NoCompression 2023-12-05T09:59:32.114 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.enable_blob_garbage_collection: false 2023-12-05T09:59:32.114 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-12-05T09:59:32.114 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-12-05T09:59:32.114 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-12-05T09:59:32.114 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.blob_file_starting_level: 0 2023-12-05T09:59:32.114 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-12-05T09:59:32.114 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 27.sst 2023-12-05T09:59:32.114 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2023-12-05T09:59:32.114 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi150/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 29, last_sequence is 12484, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-12-05T09:59:32.114 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2023-12-05T09:59:32.115 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 8144f002-811e-496c-99f3-b258df80b236 2023-12-05T09:59:32.115 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: EVENT_LOG_v1 {"time_micros": 1701770371672298, "job": 1, "event": "recovery_started", "wal_files": [25]} 2023-12-05T09:59:32.115 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2023-12-05T09:59:32.115 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: EVENT_LOG_v1 {"time_micros": 1701770371677579, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 314709, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12489, "largest_seqno": 12744, "table_properties": {"data_size": 312648, "index_size": 729, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 325, "raw_key_size": 2731, "raw_average_key_size": 24, "raw_value_size": 310054, "raw_average_value_size": 2743, "num_data_blocks": 32, "num_entries": 113, "num_filter_entries": 113, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1701770371, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "8144f002-811e-496c-99f3-b258df80b236", "db_session_id": "XKHQKLH9SZB0Z8DER47H", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2023-12-05T09:59:32.115 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: EVENT_LOG_v1 {"time_micros": 1701770371677835, "job": 1, "event": "recovery_finished"} 2023-12-05T09:59:32.115 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2023-12-05T09:59:32.115 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2023-12-05T09:59:32.115 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi150/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-12-05T09:59:32.115 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55631f520000 2023-12-05T09:59:32.115 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: DB pointer 0x55631f50c000 2023-12-05T09:59:32.115 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-12-05T09:59:32.115 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-12-05T09:59:32.115 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: ** DB Stats ** 2023-12-05T09:59:32.115 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-05T09:59:32.116 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-12-05T09:59:32.116 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-05T09:59:32.116 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-05T09:59:32.116 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-12-05T09:59:32.116 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-05T09:59:32.116 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-05T09:59:32.116 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: 2023-12-05T09:59:32.116 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: ** Compaction Stats [default] ** 2023-12-05T09:59:32.116 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-05T09:59:32.116 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-12-05T09:59:32.116 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: L0 1/0 307.33 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 107.8 0.00 0.00 1 0.003 0 0 0.0 0.0 2023-12-05T09:59:32.116 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: L6 1/0 7.24 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2023-12-05T09:59:32.116 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: Sum 2/0 7.54 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 107.8 0.00 0.00 1 0.003 0 0 0.0 0.0 2023-12-05T09:59:32.116 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 107.8 0.00 0.00 1 0.003 0 0 0.0 0.0 2023-12-05T09:59:32.116 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: 2023-12-05T09:59:32.117 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: ** Compaction Stats [default] ** 2023-12-05T09:59:32.117 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-05T09:59:32.117 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-05T09:59:32.117 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 107.8 0.00 0.00 1 0.003 0 0 0.0 0.0 2023-12-05T09:59:32.117 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: 2023-12-05T09:59:32.117 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-12-05T09:59:32.117 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: 2023-12-05T09:59:32.117 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-05T09:59:32.117 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-12-05T09:59:32.117 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-05T09:59:32.117 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-05T09:59:32.117 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-05T09:59:32.117 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-05T09:59:32.117 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: Cumulative compaction: 0.00 GB write, 25.94 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-05T09:59:32.117 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: Interval compaction: 0.00 GB write, 25.94 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-05T09:59:32.118 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-05T09:59:32.118 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: Block cache BinnedLRUCache@0x55631f485090#7 capacity: 512.00 MB usage: 1.20 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2023-12-05T09:59:32.118 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.38 KB,7.15256e-05%) IndexBlock(1,0.83 KB,0.000157952%) Misc(1,0.00 KB,0%) 2023-12-05T09:59:32.118 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: 2023-12-05T09:59:32.118 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-05T09:59:32.118 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: starting mon.smithi150 rank 1 at public addrs [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] at bind addrs [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi150 fsid 5b035ce6-9353-11ee-95a2-87774f69a715 2023-12-05T09:59:32.118 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: mon.smithi150@-1(???) e2 preinit fsid 5b035ce6-9353-11ee-95a2-87774f69a715 2023-12-05T09:59:32.118 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: mon.smithi150@-1(???).mds e13 new map 2023-12-05T09:59:32.118 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: mon.smithi150@-1(???).mds e13 print_map 2023-12-05T09:59:32.118 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: e13 2023-12-05T09:59:32.118 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-12-05T09:59:32.118 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T09:59:32.118 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: legacy client fscid: 1 2023-12-05T09:59:32.119 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: 2023-12-05T09:59:32.119 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: Filesystem 'cephfs' (1) 2023-12-05T09:59:32.119 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: fs_name cephfs 2023-12-05T09:59:32.119 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: epoch 13 2023-12-05T09:59:32.119 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-05T09:59:32.119 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: created 2023-12-05T09:54:30.515778+0000 2023-12-05T09:59:32.119 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: modified 2023-12-05T09:54:46.403009+0000 2023-12-05T09:59:32.119 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: tableserver 0 2023-12-05T09:59:32.119 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: root 0 2023-12-05T09:59:32.119 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: session_timeout 60 2023-12-05T09:59:32.119 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: session_autoclose 300 2023-12-05T09:59:32.119 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: max_file_size 1099511627776 2023-12-05T09:59:32.119 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: max_xattr_size 65536 2023-12-05T09:59:32.119 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: required_client_features {} 2023-12-05T09:59:32.119 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: last_failure 0 2023-12-05T09:59:32.120 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: last_failure_osd_epoch 46 2023-12-05T09:59:32.120 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T09:59:32.120 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: max_mds 1 2023-12-05T09:59:32.120 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: in 0 2023-12-05T09:59:32.120 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: up {0=14490} 2023-12-05T09:59:32.120 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: failed 2023-12-05T09:59:32.120 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: damaged 2023-12-05T09:59:32.120 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: stopped 2023-12-05T09:59:32.120 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: data_pools [3] 2023-12-05T09:59:32.120 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: metadata_pool 2 2023-12-05T09:59:32.120 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: inline_data disabled 2023-12-05T09:59:32.120 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: balancer 2023-12-05T09:59:32.120 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: bal_rank_mask -1 2023-12-05T09:59:32.120 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: standby_count_wanted 1 2023-12-05T09:59:32.120 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: [mds.cephfs.smithi100.akmstb{0:14490} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.100:6828/627555128,v1:172.21.15.100:6829/627555128] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:59:32.121 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: 2023-12-05T09:59:32.121 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: 2023-12-05T09:59:32.121 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: Standby daemons: 2023-12-05T09:59:32.121 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: 2023-12-05T09:59:32.121 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: [mds.cephfs.smithi150.pcbpxm{-1:14486} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.150:6824/3645854543,v1:172.21.15.150:6825/3645854543] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:59:32.121 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: [mds.cephfs.smithi150.fcnhsv{-1:14498} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.150:6826/3249949736,v1:172.21.15.150:6827/3249949736] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:59:32.121 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout: [mds.cephfs.smithi100.sqplhn{-1:14506} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.100:6826/2472212864,v1:172.21.15.100:6827/2472212864] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:59:32.121 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: mon.smithi150@-1(???).osd e51 crush map has features 3314933000852226048, adjusting msgr requires 2023-12-05T09:59:32.121 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: mon.smithi150@-1(???).osd e51 crush map has features 288514051259236352, adjusting msgr requires 2023-12-05T09:59:32.121 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: mon.smithi150@-1(???).osd e51 crush map has features 288514051259236352, adjusting msgr requires 2023-12-05T09:59:32.121 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: mon.smithi150@-1(???).osd e51 crush map has features 288514051259236352, adjusting msgr requires 2023-12-05T09:59:32.121 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: mon.smithi150@-1(???).paxosservice(auth 1..21) refresh upgraded, format 0 -> 3 2023-12-05T09:59:32.121 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:31 smithi150 ceph-mon[171606]: pgmap v12: 65 pgs: 65 active+clean; 212 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 37 KiB/s rd, 1.6 MiB/s wr, 559 op/s 2023-12-05T09:59:32.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:31 smithi100 ceph-mon[187528]: pgmap v12: 65 pgs: 65 active+clean; 212 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 37 KiB/s rd, 1.6 MiB/s wr, 559 op/s 2023-12-05T09:59:33.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:32 smithi150 ceph-mon[171606]: overall HEALTH_OK 2023-12-05T09:59:33.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:32 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mon metadata", "id": "smithi100"}]: dispatch 2023-12-05T09:59:33.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:32 smithi150 ceph-mon[171606]: mon.smithi100 calling monitor election 2023-12-05T09:59:33.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:32 smithi150 ceph-mon[171606]: mon.smithi150 calling monitor election 2023-12-05T09:59:33.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:32 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mon metadata", "id": "smithi150"}]: dispatch 2023-12-05T09:59:33.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:32 smithi150 ceph-mon[171606]: mon.smithi100 is new leader, mons smithi100,smithi150 in quorum (ranks 0,1) 2023-12-05T09:59:33.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:32 smithi150 ceph-mon[171606]: monmap e3: 2 mons at {smithi100=[v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0],smithi150=[v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-05T09:59:33.097 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:32 smithi150 ceph-mon[171606]: fsmap cephfs:1 {0=cephfs.smithi100.akmstb=up:active} 3 up:standby 2023-12-05T09:59:33.097 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:32 smithi150 ceph-mon[171606]: osdmap e51: 6 total, 6 up, 6 in 2023-12-05T09:59:33.097 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:32 smithi150 ceph-mon[171606]: mgrmap e38: smithi100.ehmuhg(active, since 21s), standbys: smithi150.zkskag 2023-12-05T09:59:33.097 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:32 smithi150 ceph-mon[171606]: overall HEALTH_OK 2023-12-05T09:59:33.097 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:32 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:33.097 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:32 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:33.097 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:32 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:59:33.097 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:32 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:33.097 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:32 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:33.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:32 smithi100 ceph-mon[187528]: overall HEALTH_OK 2023-12-05T09:59:33.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:32 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mon metadata", "id": "smithi100"}]: dispatch 2023-12-05T09:59:33.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:32 smithi100 ceph-mon[187528]: mon.smithi100 calling monitor election 2023-12-05T09:59:33.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:32 smithi100 ceph-mon[187528]: mon.smithi150 calling monitor election 2023-12-05T09:59:33.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:32 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mon metadata", "id": "smithi150"}]: dispatch 2023-12-05T09:59:33.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:32 smithi100 ceph-mon[187528]: mon.smithi100 is new leader, mons smithi100,smithi150 in quorum (ranks 0,1) 2023-12-05T09:59:33.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:32 smithi100 ceph-mon[187528]: monmap e3: 2 mons at {smithi100=[v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0],smithi150=[v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-05T09:59:33.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:32 smithi100 ceph-mon[187528]: fsmap cephfs:1 {0=cephfs.smithi100.akmstb=up:active} 3 up:standby 2023-12-05T09:59:33.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:32 smithi100 ceph-mon[187528]: osdmap e51: 6 total, 6 up, 6 in 2023-12-05T09:59:33.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:32 smithi100 ceph-mon[187528]: mgrmap e38: smithi100.ehmuhg(active, since 21s), standbys: smithi150.zkskag 2023-12-05T09:59:33.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:32 smithi100 ceph-mon[187528]: overall HEALTH_OK 2023-12-05T09:59:33.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:32 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:33.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:32 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:33.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:32 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:59:33.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:32 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:33.147 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:32 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:34.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:34 smithi150 ceph-mon[171606]: pgmap v14: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 26 KiB/s rd, 1.2 MiB/s wr, 498 op/s 2023-12-05T09:59:34.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:34 smithi100 ceph-mon[187528]: pgmap v14: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 26 KiB/s rd, 1.2 MiB/s wr, 498 op/s 2023-12-05T09:59:35.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:35 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:35.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:35 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:35.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:35 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:35.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:35 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:36.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:36 smithi150 ceph-mon[171606]: pgmap v15: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 15 KiB/s rd, 657 KiB/s wr, 197 op/s 2023-12-05T09:59:36.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:36 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:36.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:36 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:36.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:36 smithi100 ceph-mon[187528]: pgmap v15: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 15 KiB/s rd, 657 KiB/s wr, 197 op/s 2023-12-05T09:59:36.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:36 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:36.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:36 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:38.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:38 smithi150 ceph-mon[171606]: pgmap v16: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 15 KiB/s rd, 670 KiB/s wr, 197 op/s 2023-12-05T09:59:38.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:38 smithi100 ceph-mon[187528]: pgmap v16: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 15 KiB/s rd, 670 KiB/s wr, 197 op/s 2023-12-05T09:59:40.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:40 smithi100 ceph-mon[187528]: pgmap v17: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 15 KiB/s rd, 388 KiB/s wr, 129 op/s 2023-12-05T09:59:40.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:40 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:40.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:40 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:40.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:40 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:59:40.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:40 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:59:40.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:40 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:40.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:40 smithi100 ceph-mon[187528]: Reconfiguring mon.smithi100 (monmap changed)... 2023-12-05T09:59:40.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:40 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-05T09:59:40.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:40 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-05T09:59:40.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:40 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:59:40.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:40 smithi100 ceph-mon[187528]: Reconfiguring daemon mon.smithi100 on smithi100 2023-12-05T09:59:40.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:40 smithi150 ceph-mon[171606]: pgmap v17: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 15 KiB/s rd, 388 KiB/s wr, 129 op/s 2023-12-05T09:59:40.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:40 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:40.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:40 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:40.597 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:40 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:59:40.597 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:40 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:59:40.597 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:40 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:40.597 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:40 smithi150 ceph-mon[171606]: Reconfiguring mon.smithi100 (monmap changed)... 2023-12-05T09:59:40.597 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:40 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-05T09:59:40.597 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:40 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-05T09:59:40.598 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:40 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:59:40.598 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:40 smithi150 ceph-mon[171606]: Reconfiguring daemon mon.smithi100 on smithi100 2023-12-05T09:59:41.360 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:41 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:59:41.360 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:41 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:41.360 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:41 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:41.360 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:41 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi100.ehmuhg", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-05T09:59:41.361 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:41 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-05T09:59:41.361 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:41 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:59:41.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:41 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:59:41.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:41 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:41.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:41 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:41.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:41 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi100.ehmuhg", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-05T09:59:41.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:41 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-05T09:59:41.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:41 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:59:42.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:42 smithi150 ceph-mon[171606]: pgmap v18: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.2 KiB/s rd, 25 KiB/s wr, 23 op/s 2023-12-05T09:59:42.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:42 smithi150 ceph-mon[171606]: Reconfiguring mgr.smithi100.ehmuhg (monmap changed)... 2023-12-05T09:59:42.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:42 smithi150 ceph-mon[171606]: Reconfiguring daemon mgr.smithi100.ehmuhg on smithi100 2023-12-05T09:59:42.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:42 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:42.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:42 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:42.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:42 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi100", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-05T09:59:42.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:42 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:59:42.600 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:42 smithi100 ceph-mon[187528]: pgmap v18: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.2 KiB/s rd, 25 KiB/s wr, 23 op/s 2023-12-05T09:59:42.600 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:42 smithi100 ceph-mon[187528]: Reconfiguring mgr.smithi100.ehmuhg (monmap changed)... 2023-12-05T09:59:42.600 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:42 smithi100 ceph-mon[187528]: Reconfiguring daemon mgr.smithi100.ehmuhg on smithi100 2023-12-05T09:59:42.600 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:42 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:42.600 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:42 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:42.600 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:42 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi100", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-05T09:59:42.600 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:42 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:59:43.595 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:43 smithi150 ceph-mon[171606]: Reconfiguring crash.smithi100 (monmap changed)... 2023-12-05T09:59:43.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:43 smithi150 ceph-mon[171606]: Reconfiguring daemon crash.smithi100 on smithi100 2023-12-05T09:59:43.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:43 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:43.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:43 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:43.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:43 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-05T09:59:43.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:43 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:59:43.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:43 smithi100 ceph-mon[187528]: Reconfiguring crash.smithi100 (monmap changed)... 2023-12-05T09:59:43.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:43 smithi100 ceph-mon[187528]: Reconfiguring daemon crash.smithi100 on smithi100 2023-12-05T09:59:43.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:43 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:43.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:43 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:43.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:43 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-05T09:59:43.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:43 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:59:44.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:44 smithi100 ceph-mon[187528]: pgmap v19: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.2 KiB/s rd, 25 KiB/s wr, 23 op/s 2023-12-05T09:59:44.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:44 smithi100 ceph-mon[187528]: Reconfiguring osd.0 (monmap changed)... 2023-12-05T09:59:44.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:44 smithi100 ceph-mon[187528]: Reconfiguring daemon osd.0 on smithi100 2023-12-05T09:59:44.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:44 smithi150 ceph-mon[171606]: pgmap v19: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.2 KiB/s rd, 25 KiB/s wr, 23 op/s 2023-12-05T09:59:44.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:44 smithi150 ceph-mon[171606]: Reconfiguring osd.0 (monmap changed)... 2023-12-05T09:59:44.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:44 smithi150 ceph-mon[171606]: Reconfiguring daemon osd.0 on smithi100 2023-12-05T09:59:45.845 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:45 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:45.845 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:45 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:45.845 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:45 smithi100 ceph-mon[187528]: Reconfiguring osd.1 (monmap changed)... 2023-12-05T09:59:45.845 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:45 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-05T09:59:45.845 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:45 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:59:45.845 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:45 smithi100 ceph-mon[187528]: Reconfiguring daemon osd.1 on smithi100 2023-12-05T09:59:45.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:45 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:45.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:45 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:45.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:45 smithi150 ceph-mon[171606]: Reconfiguring osd.1 (monmap changed)... 2023-12-05T09:59:45.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:45 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-05T09:59:45.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:45 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:59:45.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:45 smithi150 ceph-mon[171606]: Reconfiguring daemon osd.1 on smithi100 2023-12-05T09:59:46.797 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:46 smithi100 ceph-mon[187528]: pgmap v20: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 13 KiB/s wr, 0 op/s 2023-12-05T09:59:46.797 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:46 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:46.797 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:46 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:46.797 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:46 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-05T09:59:46.797 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:46 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:59:46.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:46 smithi150 ceph-mon[171606]: pgmap v20: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 13 KiB/s wr, 0 op/s 2023-12-05T09:59:46.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:46 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:46.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:46 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:46.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:46 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-05T09:59:46.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:46 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:59:47.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:47 smithi150 ceph-mon[171606]: Reconfiguring osd.2 (monmap changed)... 2023-12-05T09:59:47.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:47 smithi150 ceph-mon[171606]: Reconfiguring daemon osd.2 on smithi100 2023-12-05T09:59:47.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:47 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:47.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:47 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:47.849 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:47 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi100.sqplhn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-05T09:59:47.849 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:47 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:59:47.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:47 smithi100 ceph-mon[187528]: Reconfiguring osd.2 (monmap changed)... 2023-12-05T09:59:47.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:47 smithi100 ceph-mon[187528]: Reconfiguring daemon osd.2 on smithi100 2023-12-05T09:59:47.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:47 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:47.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:47 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:47.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:47 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi100.sqplhn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-05T09:59:47.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:47 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:59:48.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:48 smithi100 ceph-mon[187528]: pgmap v21: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 13 KiB/s wr, 0 op/s 2023-12-05T09:59:48.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:48 smithi100 ceph-mon[187528]: Reconfiguring mds.cephfs.smithi100.sqplhn (monmap changed)... 2023-12-05T09:59:48.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:48 smithi100 ceph-mon[187528]: Reconfiguring daemon mds.cephfs.smithi100.sqplhn on smithi100 2023-12-05T09:59:48.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:48 smithi150 ceph-mon[171606]: pgmap v21: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 13 KiB/s wr, 0 op/s 2023-12-05T09:59:48.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:48 smithi150 ceph-mon[171606]: Reconfiguring mds.cephfs.smithi100.sqplhn (monmap changed)... 2023-12-05T09:59:48.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:48 smithi150 ceph-mon[171606]: Reconfiguring daemon mds.cephfs.smithi100.sqplhn on smithi100 2023-12-05T09:59:49.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:49 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:49.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:49 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:49.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:49 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi100.akmstb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-05T09:59:49.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:49 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:59:49.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:49 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:49.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:49 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:49.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:49 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi100.akmstb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-05T09:59:49.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:49 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:59:50.789 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:50 smithi150 ceph-mon[171606]: Reconfiguring mds.cephfs.smithi100.akmstb (monmap changed)... 2023-12-05T09:59:50.790 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:50 smithi150 ceph-mon[171606]: Reconfiguring daemon mds.cephfs.smithi100.akmstb on smithi100 2023-12-05T09:59:50.790 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:50 smithi150 ceph-mon[171606]: pgmap v22: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-05T09:59:50.790 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:50 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:50.790 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:50 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:50.790 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:50 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi150", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-05T09:59:50.790 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:50 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:59:50.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:50 smithi100 ceph-mon[187528]: Reconfiguring mds.cephfs.smithi100.akmstb (monmap changed)... 2023-12-05T09:59:50.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:50 smithi100 ceph-mon[187528]: Reconfiguring daemon mds.cephfs.smithi100.akmstb on smithi100 2023-12-05T09:59:50.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:50 smithi100 ceph-mon[187528]: pgmap v22: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-05T09:59:50.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:50 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:50.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:50 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:50.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:50 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi150", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-05T09:59:50.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:50 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:59:50.952 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:50.954+0000 7f0b38a0e700 1 -- 172.21.15.100:0/4284994489 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0b340fcbf0 msgr2=0x7f0b340fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:59:50.952 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:50.954+0000 7f0b38a0e700 1 --2- 172.21.15.100:0/4284994489 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0b340fcbf0 0x7f0b340fd000 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0b24004940 tx=0x7f0b24009e30 comp rx=0 tx=0).stop 2023-12-05T09:59:50.952 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:50.954+0000 7f0b38a0e700 1 -- 172.21.15.100:0/4284994489 shutdown_connections 2023-12-05T09:59:50.952 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:50.954+0000 7f0b38a0e700 1 --2- 172.21.15.100:0/4284994489 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b340fde00 0x7f0b340fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:50.952 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:50.954+0000 7f0b38a0e700 1 --2- 172.21.15.100:0/4284994489 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0b340fcbf0 0x7f0b340fd000 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:50.952 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:50.954+0000 7f0b38a0e700 1 -- 172.21.15.100:0/4284994489 >> 172.21.15.100:0/4284994489 conn(0x7f0b340f82d0 msgr2=0x7f0b340fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:59:50.952 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:50.954+0000 7f0b38a0e700 1 -- 172.21.15.100:0/4284994489 shutdown_connections 2023-12-05T09:59:50.952 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:50.954+0000 7f0b38a0e700 1 -- 172.21.15.100:0/4284994489 wait complete. 2023-12-05T09:59:50.953 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:50.955+0000 7f0b38a0e700 1 Processor -- start 2023-12-05T09:59:50.953 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:50.955+0000 7f0b38a0e700 1 -- start start 2023-12-05T09:59:50.953 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:50.955+0000 7f0b38a0e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0b340fcbf0 0x7f0b3410f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:59:50.953 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:50.955+0000 7f0b38a0e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b340fde00 0x7f0b3410fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:59:50.953 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:50.955+0000 7f0b38a0e700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b341102a0 con 0x7f0b340fcbf0 2023-12-05T09:59:50.953 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:50.955+0000 7f0b38a0e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b34110b40 con 0x7f0b340fde00 2023-12-05T09:59:50.954 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:50.956+0000 7f0b3259c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0b340fcbf0 0x7f0b3410f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:59:50.954 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:50.956+0000 7f0b3259c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0b340fcbf0 0x7f0b3410f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58580/0 (socket says 172.21.15.100:58580) 2023-12-05T09:59:50.954 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:50.956+0000 7f0b3259c700 1 -- 172.21.15.100:0/1077025491 learned_addr learned my addr 172.21.15.100:0/1077025491 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:59:50.954 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:50.956+0000 7f0b31d9b700 1 --2- 172.21.15.100:0/1077025491 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b340fde00 0x7f0b3410fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:59:50.955 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:50.956+0000 7f0b3259c700 1 -- 172.21.15.100:0/1077025491 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b340fde00 msgr2=0x7f0b3410fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:59:50.955 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:50.956+0000 7f0b3259c700 1 --2- 172.21.15.100:0/1077025491 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b340fde00 0x7f0b3410fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:50.955 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:50.956+0000 7f0b3259c700 1 -- 172.21.15.100:0/1077025491 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b24005040 con 0x7f0b340fcbf0 2023-12-05T09:59:50.955 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:50.956+0000 7f0b3259c700 1 --2- 172.21.15.100:0/1077025491 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0b340fcbf0 0x7f0b3410f760 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0b24000c00 tx=0x7f0b24009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:59:50.955 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:50.957+0000 7f0b22ffd700 1 -- 172.21.15.100:0/1077025491 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b2400e040 con 0x7f0b340fcbf0 2023-12-05T09:59:50.955 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:50.957+0000 7f0b22ffd700 1 -- 172.21.15.100:0/1077025491 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0b24013420 con 0x7f0b340fcbf0 2023-12-05T09:59:50.955 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:50.957+0000 7f0b38a0e700 1 -- 172.21.15.100:0/1077025491 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b34110dc0 con 0x7f0b340fcbf0 2023-12-05T09:59:50.955 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:50.957+0000 7f0b22ffd700 1 -- 172.21.15.100:0/1077025491 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b2401c630 con 0x7f0b340fcbf0 2023-12-05T09:59:50.955 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:50.957+0000 7f0b38a0e700 1 -- 172.21.15.100:0/1077025491 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b34111300 con 0x7f0b340fcbf0 2023-12-05T09:59:50.956 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:50.958+0000 7f0b38a0e700 1 -- 172.21.15.100:0/1077025491 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b34101ea0 con 0x7f0b340fcbf0 2023-12-05T09:59:50.956 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:50.959+0000 7f0b22ffd700 1 -- 172.21.15.100:0/1077025491 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 91040+0+0 (secure 0 0 0) 0x7f0b24013590 con 0x7f0b340fcbf0 2023-12-05T09:59:50.957 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:50.960+0000 7f0b22ffd700 1 --2- 172.21.15.100:0/1077025491 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f0b1c06cf80 0x7f0b1c06f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:59:50.957 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:50.960+0000 7f0b22ffd700 1 -- 172.21.15.100:0/1077025491 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f0b2408d870 con 0x7f0b340fcbf0 2023-12-05T09:59:50.958 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:50.960+0000 7f0b31d9b700 1 --2- 172.21.15.100:0/1077025491 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f0b1c06cf80 0x7f0b1c06f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:59:50.958 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:50.961+0000 7f0b31d9b700 1 --2- 172.21.15.100:0/1077025491 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f0b1c06cf80 0x7f0b1c06f430 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0b28004f40 tx=0x7f0b2800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:59:50.963 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:50.965+0000 7f0b22ffd700 1 -- 172.21.15.100:0/1077025491 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f0b2405afc0 con 0x7f0b340fcbf0 2023-12-05T09:59:51.188 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.191+0000 7f0b38a0e700 1 -- 172.21.15.100:0/1077025491 --> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0b341116f0 con 0x7f0b1c06cf80 2023-12-05T09:59:51.190 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.192+0000 7f0b22ffd700 1 -- 172.21.15.100:0/1077025491 <== mgr.34104 v2:172.21.15.100:6800/3489431924 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f0b341116f0 con 0x7f0b1c06cf80 2023-12-05T09:59:51.193 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.195+0000 7f0b38a0e700 1 -- 172.21.15.100:0/1077025491 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f0b1c06cf80 msgr2=0x7f0b1c06f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:59:51.193 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.195+0000 7f0b38a0e700 1 --2- 172.21.15.100:0/1077025491 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f0b1c06cf80 0x7f0b1c06f430 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0b28004f40 tx=0x7f0b2800b040 comp rx=0 tx=0).stop 2023-12-05T09:59:51.193 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.195+0000 7f0b38a0e700 1 -- 172.21.15.100:0/1077025491 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0b340fcbf0 msgr2=0x7f0b3410f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:59:51.194 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.195+0000 7f0b38a0e700 1 --2- 172.21.15.100:0/1077025491 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0b340fcbf0 0x7f0b3410f760 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0b24000c00 tx=0x7f0b24009e30 comp rx=0 tx=0).stop 2023-12-05T09:59:51.194 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.195+0000 7f0b38a0e700 1 -- 172.21.15.100:0/1077025491 shutdown_connections 2023-12-05T09:59:51.194 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.195+0000 7f0b38a0e700 1 --2- 172.21.15.100:0/1077025491 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f0b1c06cf80 0x7f0b1c06f430 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:51.194 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.195+0000 7f0b38a0e700 1 --2- 172.21.15.100:0/1077025491 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0b340fcbf0 0x7f0b3410f760 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:51.194 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.195+0000 7f0b38a0e700 1 --2- 172.21.15.100:0/1077025491 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b340fde00 0x7f0b3410fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:51.194 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.195+0000 7f0b38a0e700 1 -- 172.21.15.100:0/1077025491 >> 172.21.15.100:0/1077025491 conn(0x7f0b340f82d0 msgr2=0x7f0b340ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:59:51.195 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.195+0000 7f0b38a0e700 1 -- 172.21.15.100:0/1077025491 shutdown_connections 2023-12-05T09:59:51.195 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.195+0000 7f0b38a0e700 1 -- 172.21.15.100:0/1077025491 wait complete. 2023-12-05T09:59:51.207 INFO:teuthology.orchestra.run.smithi100.stdout:true 2023-12-05T09:59:51.338 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.340+0000 7fcc01bf3700 1 -- 172.21.15.100:0/2273975283 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbfc0fde00 msgr2=0x7fcbfc0fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:59:51.338 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.340+0000 7fcc01bf3700 1 --2- 172.21.15.100:0/2273975283 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbfc0fde00 0x7fcbfc0fe250 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fcbf0004940 tx=0x7fcbf0009e30 comp rx=0 tx=0).stop 2023-12-05T09:59:51.338 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.340+0000 7fcc01bf3700 1 -- 172.21.15.100:0/2273975283 shutdown_connections 2023-12-05T09:59:51.338 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.340+0000 7fcc01bf3700 1 --2- 172.21.15.100:0/2273975283 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbfc0fde00 0x7fcbfc0fe250 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:51.338 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.340+0000 7fcc01bf3700 1 --2- 172.21.15.100:0/2273975283 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcbfc0fcbf0 0x7fcbfc0fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:51.339 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.340+0000 7fcc01bf3700 1 -- 172.21.15.100:0/2273975283 >> 172.21.15.100:0/2273975283 conn(0x7fcbfc0f82d0 msgr2=0x7fcbfc0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:59:51.339 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.340+0000 7fcc01bf3700 1 -- 172.21.15.100:0/2273975283 shutdown_connections 2023-12-05T09:59:51.339 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.340+0000 7fcc01bf3700 1 -- 172.21.15.100:0/2273975283 wait complete. 2023-12-05T09:59:51.342 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.341+0000 7fcc01bf3700 1 Processor -- start 2023-12-05T09:59:51.343 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.341+0000 7fcc01bf3700 1 -- start start 2023-12-05T09:59:51.343 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.342+0000 7fcc01bf3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcbfc0fcbf0 0x7fcbfc10f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:59:51.343 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.342+0000 7fcc01bf3700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbfc0fde00 0x7fcbfc10fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:59:51.343 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.342+0000 7fcc01bf3700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbfc110310 con 0x7fcbfc0fde00 2023-12-05T09:59:51.343 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.342+0000 7fcc01bf3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbfc110b60 con 0x7fcbfc0fcbf0 2023-12-05T09:59:51.343 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.342+0000 7fcbfaffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbfc0fde00 0x7fcbfc10fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:59:51.343 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.342+0000 7fcbfaffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbfc0fde00 0x7fcbfc10fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58606/0 (socket says 172.21.15.100:58606) 2023-12-05T09:59:51.343 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.342+0000 7fcbfaffd700 1 -- 172.21.15.100:0/3905636341 learned_addr learned my addr 172.21.15.100:0/3905636341 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:59:51.343 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.342+0000 7fcbfb7fe700 1 --2- 172.21.15.100:0/3905636341 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcbfc0fcbf0 0x7fcbfc10f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:59:51.343 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.342+0000 7fcbfaffd700 1 -- 172.21.15.100:0/3905636341 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcbfc0fcbf0 msgr2=0x7fcbfc10f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:59:51.343 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.342+0000 7fcbfaffd700 1 --2- 172.21.15.100:0/3905636341 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcbfc0fcbf0 0x7fcbfc10f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:51.344 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.342+0000 7fcbfaffd700 1 -- 172.21.15.100:0/3905636341 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbf0005040 con 0x7fcbfc0fde00 2023-12-05T09:59:51.344 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.343+0000 7fcbfaffd700 1 --2- 172.21.15.100:0/3905636341 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbfc0fde00 0x7fcbfc10fd10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fcbf000b3b0 tx=0x7fcbf0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:59:51.344 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.343+0000 7fcbe3fff700 1 -- 172.21.15.100:0/3905636341 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcbf000e040 con 0x7fcbfc0fde00 2023-12-05T09:59:51.344 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.343+0000 7fcbe3fff700 1 -- 172.21.15.100:0/3905636341 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcbf000bc50 con 0x7fcbfc0fde00 2023-12-05T09:59:51.344 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.343+0000 7fcc01bf3700 1 -- 172.21.15.100:0/3905636341 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbfc110de0 con 0x7fcbfc0fde00 2023-12-05T09:59:51.344 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.343+0000 7fcbe3fff700 1 -- 172.21.15.100:0/3905636341 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcbf001c630 con 0x7fcbfc0fde00 2023-12-05T09:59:51.344 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.343+0000 7fcc01bf3700 1 -- 172.21.15.100:0/3905636341 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbfc111320 con 0x7fcbfc0fde00 2023-12-05T09:59:51.344 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.344+0000 7fcc01bf3700 1 -- 172.21.15.100:0/3905636341 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbfc101ea0 con 0x7fcbfc0fde00 2023-12-05T09:59:51.345 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.345+0000 7fcbe3fff700 1 -- 172.21.15.100:0/3905636341 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 91040+0+0 (secure 0 0 0) 0x7fcbf0013420 con 0x7fcbfc0fde00 2023-12-05T09:59:51.345 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.346+0000 7fcbe3fff700 1 --2- 172.21.15.100:0/3905636341 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fcbe406cf80 0x7fcbe406f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:59:51.345 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.346+0000 7fcbe3fff700 1 -- 172.21.15.100:0/3905636341 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fcbf008d8e0 con 0x7fcbfc0fde00 2023-12-05T09:59:51.345 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.347+0000 7fcbfb7fe700 1 --2- 172.21.15.100:0/3905636341 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fcbe406cf80 0x7fcbe406f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:59:51.345 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.347+0000 7fcbfb7fe700 1 --2- 172.21.15.100:0/3905636341 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fcbe406cf80 0x7fcbe406f430 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc0fdc60 tx=0x7fcbec00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:59:51.350 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.351+0000 7fcbe3fff700 1 -- 172.21.15.100:0/3905636341 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fcbf005b0f0 con 0x7fcbfc0fde00 2023-12-05T09:59:51.576 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.579+0000 7fcc01bf3700 1 -- 172.21.15.100:0/3905636341 --> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcbfc02b180 con 0x7fcbe406cf80 2023-12-05T09:59:51.577 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.580+0000 7fcbe3fff700 1 -- 172.21.15.100:0/3905636341 <== mgr.34104 v2:172.21.15.100:6800/3489431924 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7fcbfc02b180 con 0x7fcbe406cf80 2023-12-05T09:59:51.580 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.582+0000 7fcc01bf3700 1 -- 172.21.15.100:0/3905636341 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fcbe406cf80 msgr2=0x7fcbe406f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:59:51.580 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.582+0000 7fcc01bf3700 1 --2- 172.21.15.100:0/3905636341 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fcbe406cf80 0x7fcbe406f430 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc0fdc60 tx=0x7fcbec00b040 comp rx=0 tx=0).stop 2023-12-05T09:59:51.580 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.582+0000 7fcc01bf3700 1 -- 172.21.15.100:0/3905636341 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbfc0fde00 msgr2=0x7fcbfc10fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:59:51.580 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.582+0000 7fcc01bf3700 1 --2- 172.21.15.100:0/3905636341 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbfc0fde00 0x7fcbfc10fd10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fcbf000b3b0 tx=0x7fcbf0009e30 comp rx=0 tx=0).stop 2023-12-05T09:59:51.580 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.583+0000 7fcc01bf3700 1 -- 172.21.15.100:0/3905636341 shutdown_connections 2023-12-05T09:59:51.581 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.583+0000 7fcc01bf3700 1 --2- 172.21.15.100:0/3905636341 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fcbe406cf80 0x7fcbe406f430 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:51.581 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.583+0000 7fcc01bf3700 1 --2- 172.21.15.100:0/3905636341 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcbfc0fcbf0 0x7fcbfc10f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:51.581 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.583+0000 7fcc01bf3700 1 --2- 172.21.15.100:0/3905636341 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbfc0fde00 0x7fcbfc10fd10 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:51.581 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.583+0000 7fcc01bf3700 1 -- 172.21.15.100:0/3905636341 >> 172.21.15.100:0/3905636341 conn(0x7fcbfc0f82d0 msgr2=0x7fcbfc0ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:59:51.581 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.583+0000 7fcc01bf3700 1 -- 172.21.15.100:0/3905636341 shutdown_connections 2023-12-05T09:59:51.581 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.583+0000 7fcc01bf3700 1 -- 172.21.15.100:0/3905636341 wait complete. 2023-12-05T09:59:51.719 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.721+0000 7f93f133e700 1 -- 172.21.15.100:0/160902869 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93ec0fde00 msgr2=0x7f93ec0fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:59:51.719 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.721+0000 7f93f133e700 1 --2- 172.21.15.100:0/160902869 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93ec0fde00 0x7f93ec0fe250 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f93e0004940 tx=0x7f93e0009e30 comp rx=0 tx=0).stop 2023-12-05T09:59:51.719 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.721+0000 7f93f133e700 1 -- 172.21.15.100:0/160902869 shutdown_connections 2023-12-05T09:59:51.719 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.721+0000 7f93f133e700 1 --2- 172.21.15.100:0/160902869 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93ec0fde00 0x7f93ec0fe250 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:51.719 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.721+0000 7f93f133e700 1 --2- 172.21.15.100:0/160902869 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93ec0fcbf0 0x7f93ec0fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:51.719 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.721+0000 7f93f133e700 1 -- 172.21.15.100:0/160902869 >> 172.21.15.100:0/160902869 conn(0x7f93ec0f82d0 msgr2=0x7f93ec0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:59:51.719 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.721+0000 7f93f133e700 1 -- 172.21.15.100:0/160902869 shutdown_connections 2023-12-05T09:59:51.720 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.721+0000 7f93f133e700 1 -- 172.21.15.100:0/160902869 wait complete. 2023-12-05T09:59:51.721 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.722+0000 7f93f133e700 1 Processor -- start 2023-12-05T09:59:51.721 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.722+0000 7f93f133e700 1 -- start start 2023-12-05T09:59:51.721 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.723+0000 7f93f133e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93ec0fcbf0 0x7f93ec071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:59:51.721 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.723+0000 7f93f133e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93ec0fde00 0x7f93ec06ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:59:51.721 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.723+0000 7f93f133e700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93ec1111d0 con 0x7f93ec0fcbf0 2023-12-05T09:59:51.721 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.723+0000 7f93f133e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93ec111340 con 0x7f93ec0fde00 2023-12-05T09:59:51.721 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.723+0000 7f93eaffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93ec0fcbf0 0x7f93ec071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:59:51.721 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.723+0000 7f93eaffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93ec0fcbf0 0x7f93ec071b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58628/0 (socket says 172.21.15.100:58628) 2023-12-05T09:59:51.721 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.723+0000 7f93eaffd700 1 -- 172.21.15.100:0/3423895778 learned_addr learned my addr 172.21.15.100:0/3423895778 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:59:51.721 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.723+0000 7f93ea7fc700 1 --2- 172.21.15.100:0/3423895778 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93ec0fde00 0x7f93ec06ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:59:51.721 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.723+0000 7f93eaffd700 1 -- 172.21.15.100:0/3423895778 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93ec0fde00 msgr2=0x7f93ec06ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:59:51.721 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.723+0000 7f93eaffd700 1 --2- 172.21.15.100:0/3423895778 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93ec0fde00 0x7f93ec06ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:51.721 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.723+0000 7f93eaffd700 1 -- 172.21.15.100:0/3423895778 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e0005040 con 0x7f93ec0fcbf0 2023-12-05T09:59:51.722 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.724+0000 7f93eaffd700 1 --2- 172.21.15.100:0/3423895778 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93ec0fcbf0 0x7f93ec071b10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f93dc00eb70 tx=0x7f93dc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:59:51.722 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.724+0000 7f93d37fe700 1 -- 172.21.15.100:0/3423895778 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93dc007cc0 con 0x7f93ec0fcbf0 2023-12-05T09:59:51.722 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.724+0000 7f93d37fe700 1 -- 172.21.15.100:0/3423895778 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f93dc00f040 con 0x7f93ec0fcbf0 2023-12-05T09:59:51.722 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.724+0000 7f93f133e700 1 -- 172.21.15.100:0/3423895778 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93ec070590 con 0x7f93ec0fcbf0 2023-12-05T09:59:51.723 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.724+0000 7f93d37fe700 1 -- 172.21.15.100:0/3423895778 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93dc00c9d0 con 0x7f93ec0fcbf0 2023-12-05T09:59:51.723 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.724+0000 7f93f133e700 1 -- 172.21.15.100:0/3423895778 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93ec070ad0 con 0x7f93ec0fcbf0 2023-12-05T09:59:51.723 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.725+0000 7f93f133e700 1 -- 172.21.15.100:0/3423895778 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93ec04bb80 con 0x7f93ec0fcbf0 2023-12-05T09:59:51.723 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.726+0000 7f93d37fe700 1 -- 172.21.15.100:0/3423895778 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 91040+0+0 (secure 0 0 0) 0x7f93dc00cb30 con 0x7f93ec0fcbf0 2023-12-05T09:59:51.724 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.727+0000 7f93d37fe700 1 --2- 172.21.15.100:0/3423895778 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f93d406cf80 0x7f93d406f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:59:51.724 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.727+0000 7f93d37fe700 1 -- 172.21.15.100:0/3423895778 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f93dc08bfb0 con 0x7f93ec0fcbf0 2023-12-05T09:59:51.724 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.727+0000 7f93ea7fc700 1 --2- 172.21.15.100:0/3423895778 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f93d406cf80 0x7f93d406f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:59:51.725 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.728+0000 7f93ea7fc700 1 --2- 172.21.15.100:0/3423895778 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f93d406cf80 0x7f93d406f430 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f93e0013600 tx=0x7f93e0009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:59:51.729 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.731+0000 7f93d37fe700 1 -- 172.21.15.100:0/3423895778 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f93dc0597d0 con 0x7f93ec0fcbf0 2023-12-05T09:59:51.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:51 smithi150 ceph-mon[171606]: Reconfiguring crash.smithi150 (monmap changed)... 2023-12-05T09:59:51.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:51 smithi150 ceph-mon[171606]: Reconfiguring daemon crash.smithi150 on smithi150 2023-12-05T09:59:51.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:51 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:51.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:51 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:51.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:51 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi150.zkskag", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-05T09:59:51.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:51 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-05T09:59:51.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:51 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:59:51.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:51 smithi100 ceph-mon[187528]: Reconfiguring crash.smithi150 (monmap changed)... 2023-12-05T09:59:51.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:51 smithi100 ceph-mon[187528]: Reconfiguring daemon crash.smithi150 on smithi150 2023-12-05T09:59:51.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:51 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:51.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:51 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:51.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:51 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi150.zkskag", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-05T09:59:51.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:51 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-05T09:59:51.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:51 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:59:51.941 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.943+0000 7f93f133e700 1 -- 172.21.15.100:0/3423895778 --> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f93ec102750 con 0x7f93d406cf80 2023-12-05T09:59:51.950 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.953+0000 7f93d37fe700 1 -- 172.21.15.100:0/3423895778 <== mgr.34104 v2:172.21.15.100:6800/3489431924 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f93ec102750 con 0x7f93d406cf80 2023-12-05T09:59:51.951 INFO:teuthology.orchestra.run.smithi100.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-05T09:59:51.951 INFO:teuthology.orchestra.run.smithi100.stdout:alertmanager.smithi100 smithi100 *:9093,9094 running (2m) 29s ago 9m 15.9M - 0.25.0 c8568f914cd2 f443e6a4242b 2023-12-05T09:59:51.951 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi100 smithi100 running (10m) 29s ago 10m 7822k - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 6379a3185d48 2023-12-05T09:59:51.951 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi150 smithi150 running (9m) 17s ago 9m 7826k - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 349d37092dbd 2023-12-05T09:59:51.951 INFO:teuthology.orchestra.run.smithi100.stdout:grafana.smithi100 smithi100 *:3000 running (2m) 29s ago 9m 80.1M - 9.4.7 2c41d148cca3 d666da9c4e4d 2023-12-05T09:59:51.951 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.akmstb smithi100 running (5m) 29s ago 5m 9999M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 6ce55c42c55b 2023-12-05T09:59:51.951 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.sqplhn smithi100 running (5m) 29s ago 5m 14.9M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc c2682d65f0c9 2023-12-05T09:59:51.951 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi150.fcnhsv smithi150 running (5m) 17s ago 5m 15.0M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 1a259762235d 2023-12-05T09:59:51.951 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi150.pcbpxm smithi150 running (5m) 17s ago 5m 15.0M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 27f730f8b9f9 2023-12-05T09:59:51.951 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi100.ehmuhg smithi100 *:8443,9283,8765 running (2m) 29s ago 11m 489M - 19.0.0-11-g3fe8d441 56dea28e5206 ebe3dfbb0356 2023-12-05T09:59:51.951 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi150.zkskag smithi150 *:8443,9283,8765 running (72s) 17s ago 9m 450M - 19.0.0-11-g3fe8d441 56dea28e5206 a2b40e2421f2 2023-12-05T09:59:51.952 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi100 smithi100 running (55s) 29s ago 11m 32.0M 2048M 19.0.0-11-g3fe8d441 56dea28e5206 21003fd7eaf4 2023-12-05T09:59:51.952 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi150 smithi150 running (20s) 17s ago 8m 19.5M 2048M 19.0.0-11-g3fe8d441 56dea28e5206 010f2f658fca 2023-12-05T09:59:51.952 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi100 smithi100 *:9100 running (2m) 29s ago 10m 8342k - 1.5.0 0da6a335fe13 a2653da0d840 2023-12-05T09:59:51.952 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi150 smithi150 *:9100 running (2m) 17s ago 9m 8094k - 1.5.0 0da6a335fe13 67523645e73b 2023-12-05T09:59:51.952 INFO:teuthology.orchestra.run.smithi100.stdout:osd.0 smithi100 running (8m) 29s ago 8m 855M 1618M 17.2.7-109-g1fd3ca3c e139fc5fd9fc c8e64a62cd47 2023-12-05T09:59:51.952 INFO:teuthology.orchestra.run.smithi100.stdout:osd.1 smithi100 running (7m) 29s ago 7m 935M 1618M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 0500895cdfc2 2023-12-05T09:59:51.952 INFO:teuthology.orchestra.run.smithi100.stdout:osd.2 smithi100 running (7m) 29s ago 7m 737M 1618M 17.2.7-109-g1fd3ca3c e139fc5fd9fc f145372c8ccc 2023-12-05T09:59:51.952 INFO:teuthology.orchestra.run.smithi100.stdout:osd.3 smithi150 running (7m) 17s ago 7m 1166M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 78137d463d29 2023-12-05T09:59:51.952 INFO:teuthology.orchestra.run.smithi100.stdout:osd.4 smithi150 running (6m) 17s ago 6m 846M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc dfef9accd162 2023-12-05T09:59:51.952 INFO:teuthology.orchestra.run.smithi100.stdout:osd.5 smithi150 running (6m) 17s ago 6m 992M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc d9720b1eae0c 2023-12-05T09:59:51.952 INFO:teuthology.orchestra.run.smithi100.stdout:prometheus.smithi100 smithi100 *:9095 running (77s) 29s ago 9m 46.8M - 2.43.0 a07b618ecd1d 8ade75deb316 2023-12-05T09:59:51.953 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.955+0000 7f93f133e700 1 -- 172.21.15.100:0/3423895778 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f93d406cf80 msgr2=0x7f93d406f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:59:51.953 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.955+0000 7f93f133e700 1 --2- 172.21.15.100:0/3423895778 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f93d406cf80 0x7f93d406f430 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f93e0013600 tx=0x7f93e0009e30 comp rx=0 tx=0).stop 2023-12-05T09:59:51.953 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.955+0000 7f93f133e700 1 -- 172.21.15.100:0/3423895778 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93ec0fcbf0 msgr2=0x7f93ec071b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:59:51.953 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.955+0000 7f93f133e700 1 --2- 172.21.15.100:0/3423895778 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93ec0fcbf0 0x7f93ec071b10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f93dc00eb70 tx=0x7f93dc00b040 comp rx=0 tx=0).stop 2023-12-05T09:59:51.953 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.956+0000 7f93f133e700 1 -- 172.21.15.100:0/3423895778 shutdown_connections 2023-12-05T09:59:51.954 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.956+0000 7f93f133e700 1 --2- 172.21.15.100:0/3423895778 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f93d406cf80 0x7f93d406f430 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:51.954 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.956+0000 7f93f133e700 1 --2- 172.21.15.100:0/3423895778 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93ec0fcbf0 0x7f93ec071b10 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:51.954 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.956+0000 7f93f133e700 1 --2- 172.21.15.100:0/3423895778 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93ec0fde00 0x7f93ec06ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:51.954 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.956+0000 7f93f133e700 1 -- 172.21.15.100:0/3423895778 >> 172.21.15.100:0/3423895778 conn(0x7f93ec0f82d0 msgr2=0x7f93ec101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:59:51.954 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.956+0000 7f93f133e700 1 -- 172.21.15.100:0/3423895778 shutdown_connections 2023-12-05T09:59:51.954 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:51.956+0000 7f93f133e700 1 -- 172.21.15.100:0/3423895778 wait complete. 2023-12-05T09:59:52.091 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.093+0000 7f178df02700 1 -- 172.21.15.100:0/2582645994 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1788070570 msgr2=0x7f17880709c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:59:52.091 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.093+0000 7f178df02700 1 --2- 172.21.15.100:0/2582645994 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1788070570 0x7f17880709c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1774004940 tx=0x7f1774009e30 comp rx=0 tx=0).stop 2023-12-05T09:59:52.091 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.093+0000 7f178df02700 1 -- 172.21.15.100:0/2582645994 shutdown_connections 2023-12-05T09:59:52.091 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.093+0000 7f178df02700 1 --2- 172.21.15.100:0/2582645994 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1788070570 0x7f17880709c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:52.091 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.093+0000 7f178df02700 1 --2- 172.21.15.100:0/2582645994 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1788071bc0 0x7f1788070030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:52.091 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.093+0000 7f178df02700 1 -- 172.21.15.100:0/2582645994 >> 172.21.15.100:0/2582645994 conn(0x7f17880f8090 msgr2=0x7f17880fa4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:59:52.091 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.093+0000 7f178df02700 1 -- 172.21.15.100:0/2582645994 shutdown_connections 2023-12-05T09:59:52.091 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.093+0000 7f178df02700 1 -- 172.21.15.100:0/2582645994 wait complete. 2023-12-05T09:59:52.092 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.094+0000 7f178df02700 1 Processor -- start 2023-12-05T09:59:52.092 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.094+0000 7f178df02700 1 -- start start 2023-12-05T09:59:52.092 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.094+0000 7f178df02700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1788070570 0x7f1788113830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:59:52.092 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.094+0000 7f178df02700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1788071bc0 0x7f1788113d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:59:52.092 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.094+0000 7f178df02700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1788114370 con 0x7f1788070570 2023-12-05T09:59:52.093 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.094+0000 7f178df02700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1788114c10 con 0x7f1788071bc0 2023-12-05T09:59:52.093 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.095+0000 7f178cf00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1788070570 0x7f1788113830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:59:52.093 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.095+0000 7f178cf00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1788070570 0x7f1788113830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58640/0 (socket says 172.21.15.100:58640) 2023-12-05T09:59:52.093 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.095+0000 7f178cf00700 1 -- 172.21.15.100:0/2314991719 learned_addr learned my addr 172.21.15.100:0/2314991719 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:59:52.093 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.095+0000 7f1787fff700 1 --2- 172.21.15.100:0/2314991719 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1788071bc0 0x7f1788113d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:59:52.093 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.095+0000 7f178cf00700 1 -- 172.21.15.100:0/2314991719 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1788071bc0 msgr2=0x7f1788113d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:59:52.094 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.095+0000 7f178cf00700 1 --2- 172.21.15.100:0/2314991719 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1788071bc0 0x7f1788113d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:52.094 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.095+0000 7f178cf00700 1 -- 172.21.15.100:0/2314991719 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1774005040 con 0x7f1788070570 2023-12-05T09:59:52.094 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.095+0000 7f178cf00700 1 --2- 172.21.15.100:0/2314991719 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1788070570 0x7f1788113830 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f177c00eb40 tx=0x7f177c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:59:52.094 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.096+0000 7f17857fa700 1 -- 172.21.15.100:0/2314991719 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f177c007cc0 con 0x7f1788070570 2023-12-05T09:59:52.094 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.096+0000 7f17857fa700 1 -- 172.21.15.100:0/2314991719 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f177c00f040 con 0x7f1788070570 2023-12-05T09:59:52.094 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.096+0000 7f17857fa700 1 -- 172.21.15.100:0/2314991719 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f177c00c990 con 0x7f1788070570 2023-12-05T09:59:52.094 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.096+0000 7f178df02700 1 -- 172.21.15.100:0/2314991719 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1788114e90 con 0x7f1788070570 2023-12-05T09:59:52.094 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.096+0000 7f178df02700 1 -- 172.21.15.100:0/2314991719 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17881153d0 con 0x7f1788070570 2023-12-05T09:59:52.094 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.097+0000 7f178df02700 1 -- 172.21.15.100:0/2314991719 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f178804bb80 con 0x7f1788070570 2023-12-05T09:59:52.095 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.098+0000 7f17857fa700 1 -- 172.21.15.100:0/2314991719 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 91040+0+0 (secure 0 0 0) 0x7f177c00caf0 con 0x7f1788070570 2023-12-05T09:59:52.097 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.099+0000 7f17857fa700 1 --2- 172.21.15.100:0/2314991719 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f177806cf80 0x7f177806f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:59:52.097 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.099+0000 7f17857fa700 1 -- 172.21.15.100:0/2314991719 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f177c08c090 con 0x7f1788070570 2023-12-05T09:59:52.097 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.100+0000 7f1787fff700 1 --2- 172.21.15.100:0/2314991719 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f177806cf80 0x7f177806f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:59:52.097 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.100+0000 7f1787fff700 1 --2- 172.21.15.100:0/2314991719 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f177806cf80 0x7f177806f430 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1774013600 tx=0x7f1774009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:59:52.102 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.104+0000 7f17857fa700 1 -- 172.21.15.100:0/2314991719 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f177c0598b0 con 0x7f1788070570 2023-12-05T09:59:52.387 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.390+0000 7f178df02700 1 -- 172.21.15.100:0/2314991719 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1788115640 con 0x7f1788070570 2023-12-05T09:59:52.388 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.390+0000 7f17857fa700 1 -- 172.21.15.100:0/2314991719 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+727 (secure 0 0 0) 0x7f177c059440 con 0x7f1788070570 2023-12-05T09:59:52.388 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2023-12-05T09:59:52.388 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": { 2023-12-05T09:59:52.388 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 2 2023-12-05T09:59:52.388 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-12-05T09:59:52.388 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": { 2023-12-05T09:59:52.389 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 2 2023-12-05T09:59:52.389 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-12-05T09:59:52.389 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": { 2023-12-05T09:59:52.389 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 6 2023-12-05T09:59:52.389 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-12-05T09:59:52.389 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": { 2023-12-05T09:59:52.389 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 4 2023-12-05T09:59:52.389 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-12-05T09:59:52.389 INFO:teuthology.orchestra.run.smithi100.stdout: "overall": { 2023-12-05T09:59:52.389 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 10, 2023-12-05T09:59:52.389 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 4 2023-12-05T09:59:52.389 INFO:teuthology.orchestra.run.smithi100.stdout: } 2023-12-05T09:59:52.389 INFO:teuthology.orchestra.run.smithi100.stdout:} 2023-12-05T09:59:52.391 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.393+0000 7f178df02700 1 -- 172.21.15.100:0/2314991719 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f177806cf80 msgr2=0x7f177806f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:59:52.391 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.393+0000 7f178df02700 1 --2- 172.21.15.100:0/2314991719 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f177806cf80 0x7f177806f430 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1774013600 tx=0x7f1774009e30 comp rx=0 tx=0).stop 2023-12-05T09:59:52.391 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.393+0000 7f178df02700 1 -- 172.21.15.100:0/2314991719 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1788070570 msgr2=0x7f1788113830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:59:52.391 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.393+0000 7f178df02700 1 --2- 172.21.15.100:0/2314991719 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1788070570 0x7f1788113830 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f177c00eb40 tx=0x7f177c00b040 comp rx=0 tx=0).stop 2023-12-05T09:59:52.391 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.393+0000 7f178df02700 1 -- 172.21.15.100:0/2314991719 shutdown_connections 2023-12-05T09:59:52.391 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.393+0000 7f178df02700 1 --2- 172.21.15.100:0/2314991719 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f177806cf80 0x7f177806f430 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:52.391 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.393+0000 7f178df02700 1 --2- 172.21.15.100:0/2314991719 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1788070570 0x7f1788113830 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:52.391 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.393+0000 7f178df02700 1 --2- 172.21.15.100:0/2314991719 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1788071bc0 0x7f1788113d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:52.391 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.393+0000 7f178df02700 1 -- 172.21.15.100:0/2314991719 >> 172.21.15.100:0/2314991719 conn(0x7f17880f8090 msgr2=0x7f17880fe320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:59:52.391 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.393+0000 7f178df02700 1 -- 172.21.15.100:0/2314991719 shutdown_connections 2023-12-05T09:59:52.391 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.393+0000 7f178df02700 1 -- 172.21.15.100:0/2314991719 wait complete. 2023-12-05T09:59:52.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.528+0000 7f88298a5700 1 -- 172.21.15.100:0/4073771534 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f88240fde00 msgr2=0x7f88240fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:59:52.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.528+0000 7f88298a5700 1 --2- 172.21.15.100:0/4073771534 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f88240fde00 0x7f88240fe250 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8818004940 tx=0x7f8818009e30 comp rx=0 tx=0).stop 2023-12-05T09:59:52.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.528+0000 7f88298a5700 1 -- 172.21.15.100:0/4073771534 shutdown_connections 2023-12-05T09:59:52.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.528+0000 7f88298a5700 1 --2- 172.21.15.100:0/4073771534 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f88240fde00 0x7f88240fe250 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:52.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.528+0000 7f88298a5700 1 --2- 172.21.15.100:0/4073771534 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88240fcbf0 0x7f88240fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:52.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.528+0000 7f88298a5700 1 -- 172.21.15.100:0/4073771534 >> 172.21.15.100:0/4073771534 conn(0x7f88240f82d0 msgr2=0x7f88240fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:59:52.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.528+0000 7f88298a5700 1 -- 172.21.15.100:0/4073771534 shutdown_connections 2023-12-05T09:59:52.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.528+0000 7f88298a5700 1 -- 172.21.15.100:0/4073771534 wait complete. 2023-12-05T09:59:52.528 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.529+0000 7f88298a5700 1 Processor -- start 2023-12-05T09:59:52.528 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.529+0000 7f88298a5700 1 -- start start 2023-12-05T09:59:52.528 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.529+0000 7f88298a5700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f88240fcbf0 0x7f882410f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:59:52.528 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.529+0000 7f88298a5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88240fde00 0x7f882410fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:59:52.528 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.529+0000 7f88298a5700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8824110310 con 0x7f88240fcbf0 2023-12-05T09:59:52.528 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.529+0000 7f88298a5700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8824110b60 con 0x7f88240fde00 2023-12-05T09:59:52.529 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.530+0000 7f8822ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f88240fcbf0 0x7f882410f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:59:52.529 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.530+0000 7f8822ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f88240fcbf0 0x7f882410f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58664/0 (socket says 172.21.15.100:58664) 2023-12-05T09:59:52.529 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.530+0000 7f8822ffd700 1 -- 172.21.15.100:0/874755145 learned_addr learned my addr 172.21.15.100:0/874755145 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:59:52.529 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.530+0000 7f88227fc700 1 --2- 172.21.15.100:0/874755145 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88240fde00 0x7f882410fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:59:52.529 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.530+0000 7f8822ffd700 1 -- 172.21.15.100:0/874755145 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88240fde00 msgr2=0x7f882410fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:59:52.529 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.530+0000 7f8822ffd700 1 --2- 172.21.15.100:0/874755145 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88240fde00 0x7f882410fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:52.529 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.530+0000 7f8822ffd700 1 -- 172.21.15.100:0/874755145 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8818005040 con 0x7f88240fcbf0 2023-12-05T09:59:52.529 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.530+0000 7f8822ffd700 1 --2- 172.21.15.100:0/874755145 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f88240fcbf0 0x7f882410f7d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8814002a80 tx=0x7f8814004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:59:52.529 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.531+0000 7f880b7fe700 1 -- 172.21.15.100:0/874755145 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8814007cc0 con 0x7f88240fcbf0 2023-12-05T09:59:52.529 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.531+0000 7f880b7fe700 1 -- 172.21.15.100:0/874755145 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f881400f040 con 0x7f88240fcbf0 2023-12-05T09:59:52.529 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.531+0000 7f88298a5700 1 -- 172.21.15.100:0/874755145 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8824110e40 con 0x7f88240fcbf0 2023-12-05T09:59:52.529 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.531+0000 7f880b7fe700 1 -- 172.21.15.100:0/874755145 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f881400d9c0 con 0x7f88240fcbf0 2023-12-05T09:59:52.529 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.531+0000 7f88298a5700 1 -- 172.21.15.100:0/874755145 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8824111380 con 0x7f88240fcbf0 2023-12-05T09:59:52.530 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.532+0000 7f88298a5700 1 -- 172.21.15.100:0/874755145 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8824101ea0 con 0x7f88240fcbf0 2023-12-05T09:59:52.530 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.533+0000 7f880b7fe700 1 -- 172.21.15.100:0/874755145 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 91040+0+0 (secure 0 0 0) 0x7f881400db20 con 0x7f88240fcbf0 2023-12-05T09:59:52.532 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.534+0000 7f880b7fe700 1 --2- 172.21.15.100:0/874755145 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f880c06cf80 0x7f880c06f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:59:52.532 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.534+0000 7f880b7fe700 1 -- 172.21.15.100:0/874755145 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f881408c270 con 0x7f88240fcbf0 2023-12-05T09:59:52.532 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.535+0000 7f88227fc700 1 --2- 172.21.15.100:0/874755145 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f880c06cf80 0x7f880c06f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:59:52.532 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.535+0000 7f88227fc700 1 --2- 172.21.15.100:0/874755145 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f880c06cf80 0x7f880c06f430 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f88180043d0 tx=0x7f8818009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:59:52.536 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.539+0000 7f880b7fe700 1 -- 172.21.15.100:0/874755145 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f8814059940 con 0x7f88240fcbf0 2023-12-05T09:59:52.786 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.788+0000 7f88298a5700 1 -- 172.21.15.100:0/874755145 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f88241115f0 con 0x7f88240fcbf0 2023-12-05T09:59:52.786 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.789+0000 7f880b7fe700 1 -- 172.21.15.100:0/874755145 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1852 (secure 0 0 0) 0x7f88140594d0 con 0x7f88240fcbf0 2023-12-05T09:59:52.786 INFO:teuthology.orchestra.run.smithi100.stdout:e13 2023-12-05T09:59:52.787 INFO:teuthology.orchestra.run.smithi100.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-05T09:59:52.787 INFO:teuthology.orchestra.run.smithi100.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T09:59:52.787 INFO:teuthology.orchestra.run.smithi100.stdout:legacy client fscid: 1 2023-12-05T09:59:52.787 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:59:52.787 INFO:teuthology.orchestra.run.smithi100.stdout:Filesystem 'cephfs' (1) 2023-12-05T09:59:52.787 INFO:teuthology.orchestra.run.smithi100.stdout:fs_name cephfs 2023-12-05T09:59:52.787 INFO:teuthology.orchestra.run.smithi100.stdout:epoch 13 2023-12-05T09:59:52.787 INFO:teuthology.orchestra.run.smithi100.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-05T09:59:52.787 INFO:teuthology.orchestra.run.smithi100.stdout:created 2023-12-05T09:54:30.515778+0000 2023-12-05T09:59:52.787 INFO:teuthology.orchestra.run.smithi100.stdout:modified 2023-12-05T09:54:46.403009+0000 2023-12-05T09:59:52.787 INFO:teuthology.orchestra.run.smithi100.stdout:tableserver 0 2023-12-05T09:59:52.787 INFO:teuthology.orchestra.run.smithi100.stdout:root 0 2023-12-05T09:59:52.787 INFO:teuthology.orchestra.run.smithi100.stdout:session_timeout 60 2023-12-05T09:59:52.787 INFO:teuthology.orchestra.run.smithi100.stdout:session_autoclose 300 2023-12-05T09:59:52.787 INFO:teuthology.orchestra.run.smithi100.stdout:max_file_size 1099511627776 2023-12-05T09:59:52.788 INFO:teuthology.orchestra.run.smithi100.stdout:max_xattr_size 65536 2023-12-05T09:59:52.788 INFO:teuthology.orchestra.run.smithi100.stdout:required_client_features {} 2023-12-05T09:59:52.788 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure 0 2023-12-05T09:59:52.788 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure_osd_epoch 46 2023-12-05T09:59:52.788 INFO:teuthology.orchestra.run.smithi100.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T09:59:52.788 INFO:teuthology.orchestra.run.smithi100.stdout:max_mds 1 2023-12-05T09:59:52.788 INFO:teuthology.orchestra.run.smithi100.stdout:in 0 2023-12-05T09:59:52.788 INFO:teuthology.orchestra.run.smithi100.stdout:up {0=14490} 2023-12-05T09:59:52.788 INFO:teuthology.orchestra.run.smithi100.stdout:failed 2023-12-05T09:59:52.788 INFO:teuthology.orchestra.run.smithi100.stdout:damaged 2023-12-05T09:59:52.788 INFO:teuthology.orchestra.run.smithi100.stdout:stopped 2023-12-05T09:59:52.788 INFO:teuthology.orchestra.run.smithi100.stdout:data_pools [3] 2023-12-05T09:59:52.788 INFO:teuthology.orchestra.run.smithi100.stdout:metadata_pool 2 2023-12-05T09:59:52.788 INFO:teuthology.orchestra.run.smithi100.stdout:inline_data disabled 2023-12-05T09:59:52.788 INFO:teuthology.orchestra.run.smithi100.stdout:balancer 2023-12-05T09:59:52.789 INFO:teuthology.orchestra.run.smithi100.stdout:bal_rank_mask -1 2023-12-05T09:59:52.789 INFO:teuthology.orchestra.run.smithi100.stdout:standby_count_wanted 1 2023-12-05T09:59:52.789 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi100.akmstb{0:14490} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.100:6828/627555128,v1:172.21.15.100:6829/627555128] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:59:52.789 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:59:52.789 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:59:52.789 INFO:teuthology.orchestra.run.smithi100.stdout:Standby daemons: 2023-12-05T09:59:52.789 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T09:59:52.789 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi150.pcbpxm{-1:14486} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.150:6824/3645854543,v1:172.21.15.150:6825/3645854543] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:59:52.789 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi150.fcnhsv{-1:14498} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.150:6826/3249949736,v1:172.21.15.150:6827/3249949736] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:59:52.789 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi100.sqplhn{-1:14506} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.100:6826/2472212864,v1:172.21.15.100:6827/2472212864] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:59:52.790 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.791+0000 7f88298a5700 1 -- 172.21.15.100:0/874755145 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f880c06cf80 msgr2=0x7f880c06f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:59:52.790 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.791+0000 7f88298a5700 1 --2- 172.21.15.100:0/874755145 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f880c06cf80 0x7f880c06f430 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f88180043d0 tx=0x7f8818009e30 comp rx=0 tx=0).stop 2023-12-05T09:59:52.790 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.791+0000 7f88298a5700 1 -- 172.21.15.100:0/874755145 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f88240fcbf0 msgr2=0x7f882410f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:59:52.790 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.791+0000 7f88298a5700 1 --2- 172.21.15.100:0/874755145 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f88240fcbf0 0x7f882410f7d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8814002a80 tx=0x7f8814004600 comp rx=0 tx=0).stop 2023-12-05T09:59:52.790 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.791+0000 7f88298a5700 1 -- 172.21.15.100:0/874755145 shutdown_connections 2023-12-05T09:59:52.790 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.791+0000 7f88298a5700 1 --2- 172.21.15.100:0/874755145 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f880c06cf80 0x7f880c06f430 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:52.790 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.791+0000 7f88298a5700 1 --2- 172.21.15.100:0/874755145 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f88240fcbf0 0x7f882410f7d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:52.791 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.791+0000 7f88298a5700 1 --2- 172.21.15.100:0/874755145 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88240fde00 0x7f882410fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:52.791 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.791+0000 7f88298a5700 1 -- 172.21.15.100:0/874755145 >> 172.21.15.100:0/874755145 conn(0x7f88240f82d0 msgr2=0x7f88240ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:59:52.791 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.792+0000 7f88298a5700 1 -- 172.21.15.100:0/874755145 shutdown_connections 2023-12-05T09:59:52.791 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.792+0000 7f88298a5700 1 -- 172.21.15.100:0/874755145 wait complete. 2023-12-05T09:59:52.791 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 13 2023-12-05T09:59:52.841 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:52 smithi150 ceph-mon[171606]: pgmap v23: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:59:52.841 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:52 smithi150 ceph-mon[171606]: Reconfiguring mgr.smithi150.zkskag (monmap changed)... 2023-12-05T09:59:52.841 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:52 smithi150 ceph-mon[171606]: Reconfiguring daemon mgr.smithi150.zkskag on smithi150 2023-12-05T09:59:52.841 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:52 smithi150 ceph-mon[171606]: from='client.34154 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:59:52.841 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:52 smithi150 ceph-mon[171606]: from='client.34158 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:59:52.842 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:52 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:52.842 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:52 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:52.842 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:52 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-05T09:59:52.842 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:52 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-05T09:59:52.842 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:52 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:59:52.842 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:52 smithi150 ceph-mon[171606]: from='client.? 172.21.15.100:0/2314991719' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:59:52.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:52 smithi100 ceph-mon[187528]: pgmap v23: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:59:52.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:52 smithi100 ceph-mon[187528]: Reconfiguring mgr.smithi150.zkskag (monmap changed)... 2023-12-05T09:59:52.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:52 smithi100 ceph-mon[187528]: Reconfiguring daemon mgr.smithi150.zkskag on smithi150 2023-12-05T09:59:52.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:52 smithi100 ceph-mon[187528]: from='client.34154 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:59:52.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:52 smithi100 ceph-mon[187528]: from='client.34158 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:59:52.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:52 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:52.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:52 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:52.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:52 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-05T09:59:52.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:52 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-05T09:59:52.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:52 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:59:52.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:52 smithi100 ceph-mon[187528]: from='client.? 172.21.15.100:0/2314991719' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:59:52.926 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.929+0000 7f521360f700 1 -- 172.21.15.100:0/2604172451 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f520c070570 msgr2=0x7f520c0709c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:59:52.927 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.929+0000 7f521360f700 1 --2- 172.21.15.100:0/2604172451 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f520c070570 0x7f520c0709c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f51fc004940 tx=0x7f51fc009e30 comp rx=0 tx=0).stop 2023-12-05T09:59:52.927 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.929+0000 7f521360f700 1 -- 172.21.15.100:0/2604172451 shutdown_connections 2023-12-05T09:59:52.927 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.929+0000 7f521360f700 1 --2- 172.21.15.100:0/2604172451 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f520c070570 0x7f520c0709c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:52.927 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.929+0000 7f521360f700 1 --2- 172.21.15.100:0/2604172451 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f520c071bc0 0x7f520c070030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:52.927 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.929+0000 7f521360f700 1 -- 172.21.15.100:0/2604172451 >> 172.21.15.100:0/2604172451 conn(0x7f520c0f82d0 msgr2=0x7f520c0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:59:52.927 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.929+0000 7f521360f700 1 -- 172.21.15.100:0/2604172451 shutdown_connections 2023-12-05T09:59:52.927 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.929+0000 7f521360f700 1 -- 172.21.15.100:0/2604172451 wait complete. 2023-12-05T09:59:52.927 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.930+0000 7f521360f700 1 Processor -- start 2023-12-05T09:59:52.927 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.930+0000 7f521360f700 1 -- start start 2023-12-05T09:59:52.928 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.931+0000 7f521360f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f520c070570 0x7f520c10f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:59:52.928 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.931+0000 7f521360f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f520c071bc0 0x7f520c10fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:59:52.928 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.931+0000 7f521360f700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520c1103a0 con 0x7f520c071bc0 2023-12-05T09:59:52.928 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.931+0000 7f521360f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520c110c40 con 0x7f520c070570 2023-12-05T09:59:52.929 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.931+0000 7f5210baa700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f520c071bc0 0x7f520c10fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:59:52.929 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.931+0000 7f5210baa700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f520c071bc0 0x7f520c10fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58680/0 (socket says 172.21.15.100:58680) 2023-12-05T09:59:52.929 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.931+0000 7f5210baa700 1 -- 172.21.15.100:0/715608464 learned_addr learned my addr 172.21.15.100:0/715608464 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:59:52.929 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.931+0000 7f52113ab700 1 --2- 172.21.15.100:0/715608464 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f520c070570 0x7f520c10f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:59:52.929 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.931+0000 7f5210baa700 1 -- 172.21.15.100:0/715608464 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f520c070570 msgr2=0x7f520c10f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:59:52.930 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.931+0000 7f5210baa700 1 --2- 172.21.15.100:0/715608464 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f520c070570 0x7f520c10f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:52.930 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.931+0000 7f5210baa700 1 -- 172.21.15.100:0/715608464 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51fc005040 con 0x7f520c071bc0 2023-12-05T09:59:52.930 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.931+0000 7f52113ab700 1 --2- 172.21.15.100:0/715608464 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f520c070570 0x7f520c10f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-05T09:59:52.930 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.931+0000 7f5210baa700 1 --2- 172.21.15.100:0/715608464 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f520c071bc0 0x7f520c10fda0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f51fc009fd0 tx=0x7f51fc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:59:52.930 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.932+0000 7f5201ffb700 1 -- 172.21.15.100:0/715608464 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51fc021070 con 0x7f520c071bc0 2023-12-05T09:59:52.930 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.932+0000 7f5201ffb700 1 -- 172.21.15.100:0/715608464 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f51fc01c400 con 0x7f520c071bc0 2023-12-05T09:59:52.930 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.932+0000 7f5201ffb700 1 -- 172.21.15.100:0/715608464 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51fc00e070 con 0x7f520c071bc0 2023-12-05T09:59:52.930 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.932+0000 7f521360f700 1 -- 172.21.15.100:0/715608464 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f520c110ec0 con 0x7f520c071bc0 2023-12-05T09:59:52.930 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.932+0000 7f521360f700 1 -- 172.21.15.100:0/715608464 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f520c1113a0 con 0x7f520c071bc0 2023-12-05T09:59:52.930 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.933+0000 7f521360f700 1 -- 172.21.15.100:0/715608464 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f520c1096f0 con 0x7f520c071bc0 2023-12-05T09:59:52.931 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.934+0000 7f5201ffb700 1 -- 172.21.15.100:0/715608464 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 91040+0+0 (secure 0 0 0) 0x7f51fc01c570 con 0x7f520c071bc0 2023-12-05T09:59:52.932 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.935+0000 7f5201ffb700 1 --2- 172.21.15.100:0/715608464 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f51f806cf80 0x7f51f806f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:59:52.932 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.935+0000 7f5201ffb700 1 -- 172.21.15.100:0/715608464 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f51fc08d780 con 0x7f520c071bc0 2023-12-05T09:59:52.932 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.935+0000 7f52113ab700 1 --2- 172.21.15.100:0/715608464 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f51f806cf80 0x7f51f806f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:59:52.933 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.936+0000 7f52113ab700 1 --2- 172.21.15.100:0/715608464 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f51f806cf80 0x7f51f806f430 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5208004600 tx=0x7f520800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:59:52.936 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:52.939+0000 7f5201ffb700 1 -- 172.21.15.100:0/715608464 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f51fc05aed0 con 0x7f520c071bc0 2023-12-05T09:59:53.155 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:53.157+0000 7f521360f700 1 -- 172.21.15.100:0/715608464 --> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f520c107890 con 0x7f51f806cf80 2023-12-05T09:59:53.156 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:53.159+0000 7f5201ffb700 1 -- 172.21.15.100:0/715608464 <== mgr.34104 v2:172.21.15.100:6800/3489431924 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f520c107890 con 0x7f51f806cf80 2023-12-05T09:59:53.156 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2023-12-05T09:59:53.156 INFO:teuthology.orchestra.run.smithi100.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ff918c95653912ae4c171d8d1db5f5eabc756f85ff7e3ce78f13f9c521198459", 2023-12-05T09:59:53.157 INFO:teuthology.orchestra.run.smithi100.stdout: "in_progress": true, 2023-12-05T09:59:53.157 INFO:teuthology.orchestra.run.smithi100.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-05T09:59:53.157 INFO:teuthology.orchestra.run.smithi100.stdout: "services_complete": [ 2023-12-05T09:59:53.157 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr", 2023-12-05T09:59:53.157 INFO:teuthology.orchestra.run.smithi100.stdout: "mon" 2023-12-05T09:59:53.157 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2023-12-05T09:59:53.157 INFO:teuthology.orchestra.run.smithi100.stdout: "progress": "4/21 daemons upgraded", 2023-12-05T09:59:53.157 INFO:teuthology.orchestra.run.smithi100.stdout: "message": "Currently upgrading mon daemons", 2023-12-05T09:59:53.157 INFO:teuthology.orchestra.run.smithi100.stdout: "is_paused": false 2023-12-05T09:59:53.157 INFO:teuthology.orchestra.run.smithi100.stdout:} 2023-12-05T09:59:53.159 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:53.161+0000 7f521360f700 1 -- 172.21.15.100:0/715608464 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f51f806cf80 msgr2=0x7f51f806f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:59:53.159 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:53.161+0000 7f521360f700 1 --2- 172.21.15.100:0/715608464 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f51f806cf80 0x7f51f806f430 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5208004600 tx=0x7f520800b040 comp rx=0 tx=0).stop 2023-12-05T09:59:53.159 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:53.161+0000 7f521360f700 1 -- 172.21.15.100:0/715608464 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f520c071bc0 msgr2=0x7f520c10fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:59:53.159 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:53.161+0000 7f521360f700 1 --2- 172.21.15.100:0/715608464 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f520c071bc0 0x7f520c10fda0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f51fc009fd0 tx=0x7f51fc009e30 comp rx=0 tx=0).stop 2023-12-05T09:59:53.159 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:53.161+0000 7f521360f700 1 -- 172.21.15.100:0/715608464 shutdown_connections 2023-12-05T09:59:53.159 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:53.161+0000 7f521360f700 1 --2- 172.21.15.100:0/715608464 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f51f806cf80 0x7f51f806f430 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:53.159 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:53.161+0000 7f521360f700 1 --2- 172.21.15.100:0/715608464 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f520c070570 0x7f520c10f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:53.160 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:53.161+0000 7f521360f700 1 --2- 172.21.15.100:0/715608464 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f520c071bc0 0x7f520c10fda0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:53.160 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:53.161+0000 7f521360f700 1 -- 172.21.15.100:0/715608464 >> 172.21.15.100:0/715608464 conn(0x7f520c0f82d0 msgr2=0x7f520c103310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:59:53.160 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:53.161+0000 7f521360f700 1 -- 172.21.15.100:0/715608464 shutdown_connections 2023-12-05T09:59:53.160 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:53.162+0000 7f521360f700 1 -- 172.21.15.100:0/715608464 wait complete. 2023-12-05T09:59:53.293 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:53.296+0000 7f80681e0700 1 -- 172.21.15.100:0/3557604655 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80600fde00 msgr2=0x7f80600fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:59:53.293 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:53.296+0000 7f80681e0700 1 --2- 172.21.15.100:0/3557604655 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80600fde00 0x7f80600fe250 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8050004940 tx=0x7f8050009e30 comp rx=0 tx=0).stop 2023-12-05T09:59:53.294 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:53.296+0000 7f80681e0700 1 -- 172.21.15.100:0/3557604655 shutdown_connections 2023-12-05T09:59:53.294 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:53.296+0000 7f80681e0700 1 --2- 172.21.15.100:0/3557604655 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80600fde00 0x7f80600fe250 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:53.294 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:53.296+0000 7f80681e0700 1 --2- 172.21.15.100:0/3557604655 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80600fcbf0 0x7f80600fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:53.294 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:53.296+0000 7f80681e0700 1 -- 172.21.15.100:0/3557604655 >> 172.21.15.100:0/3557604655 conn(0x7f80600f82d0 msgr2=0x7f80600fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:59:53.294 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:53.296+0000 7f80681e0700 1 -- 172.21.15.100:0/3557604655 shutdown_connections 2023-12-05T09:59:53.294 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:53.296+0000 7f80681e0700 1 -- 172.21.15.100:0/3557604655 wait complete. 2023-12-05T09:59:53.295 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:53.297+0000 7f80681e0700 1 Processor -- start 2023-12-05T09:59:53.296 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:53.297+0000 7f80681e0700 1 -- start start 2023-12-05T09:59:53.296 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:53.297+0000 7f80681e0700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80600fcbf0 0x7f806010d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:59:53.296 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:53.297+0000 7f80681e0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80600fde00 0x7f806010dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:59:53.296 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:53.297+0000 7f80681e0700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f806010e0c0 con 0x7f80600fcbf0 2023-12-05T09:59:53.296 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:53.297+0000 7f80681e0700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f806010e960 con 0x7f80600fde00 2023-12-05T09:59:53.296 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:53.297+0000 7f8065f7c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80600fcbf0 0x7f806010d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:59:53.296 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:53.297+0000 7f8065f7c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80600fcbf0 0x7f806010d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58694/0 (socket says 172.21.15.100:58694) 2023-12-05T09:59:53.296 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:53.297+0000 7f8065f7c700 1 -- 172.21.15.100:0/584473080 learned_addr learned my addr 172.21.15.100:0/584473080 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T09:59:53.296 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:53.297+0000 7f806577b700 1 --2- 172.21.15.100:0/584473080 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80600fde00 0x7f806010dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:59:53.296 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:53.298+0000 7f8065f7c700 1 -- 172.21.15.100:0/584473080 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80600fde00 msgr2=0x7f806010dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:59:53.296 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:53.298+0000 7f8065f7c700 1 --2- 172.21.15.100:0/584473080 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80600fde00 0x7f806010dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:53.296 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:53.298+0000 7f8065f7c700 1 -- 172.21.15.100:0/584473080 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8050005040 con 0x7f80600fcbf0 2023-12-05T09:59:53.296 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:53.298+0000 7f8065f7c700 1 --2- 172.21.15.100:0/584473080 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80600fcbf0 0x7f806010d580 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f805c002a80 tx=0x7f805c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:59:53.297 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:53.298+0000 7f80567fc700 1 -- 172.21.15.100:0/584473080 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f805c007cc0 con 0x7f80600fcbf0 2023-12-05T09:59:53.297 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:53.298+0000 7f80567fc700 1 -- 172.21.15.100:0/584473080 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f805c00f040 con 0x7f80600fcbf0 2023-12-05T09:59:53.297 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:53.298+0000 7f80567fc700 1 -- 172.21.15.100:0/584473080 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f805c00d9c0 con 0x7f80600fcbf0 2023-12-05T09:59:53.297 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:53.298+0000 7f80681e0700 1 -- 172.21.15.100:0/584473080 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f806010ec40 con 0x7f80600fcbf0 2023-12-05T09:59:53.297 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:53.298+0000 7f80681e0700 1 -- 172.21.15.100:0/584473080 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f806010f180 con 0x7f80600fcbf0 2023-12-05T09:59:53.297 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:53.299+0000 7f80681e0700 1 -- 172.21.15.100:0/584473080 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f806004bb80 con 0x7f80600fcbf0 2023-12-05T09:59:53.297 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:53.300+0000 7f80567fc700 1 -- 172.21.15.100:0/584473080 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 91040+0+0 (secure 0 0 0) 0x7f805c00db20 con 0x7f80600fcbf0 2023-12-05T09:59:53.298 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:53.301+0000 7f80567fc700 1 --2- 172.21.15.100:0/584473080 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f804c06cf80 0x7f804c06f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:59:53.298 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:53.301+0000 7f80567fc700 1 -- 172.21.15.100:0/584473080 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f805c08c1d0 con 0x7f80600fcbf0 2023-12-05T09:59:53.299 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:53.301+0000 7f806577b700 1 --2- 172.21.15.100:0/584473080 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f804c06cf80 0x7f804c06f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:59:53.299 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:53.302+0000 7f806577b700 1 --2- 172.21.15.100:0/584473080 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f804c06cf80 0x7f804c06f430 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f80500043d0 tx=0x7f8050009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:59:53.303 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:53.306+0000 7f80567fc700 1 -- 172.21.15.100:0/584473080 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f805c059940 con 0x7f80600fcbf0 2023-12-05T09:59:53.589 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:53.591+0000 7f80681e0700 1 -- 172.21.15.100:0/584473080 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f806010f510 con 0x7f80600fcbf0 2023-12-05T09:59:53.589 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:53.592+0000 7f80567fc700 1 -- 172.21.15.100:0/584473080 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f805c0594d0 con 0x7f80600fcbf0 2023-12-05T09:59:53.589 INFO:teuthology.orchestra.run.smithi100.stdout:HEALTH_OK 2023-12-05T09:59:53.592 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:53.594+0000 7f80681e0700 1 -- 172.21.15.100:0/584473080 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f804c06cf80 msgr2=0x7f804c06f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:59:53.592 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:53.594+0000 7f80681e0700 1 --2- 172.21.15.100:0/584473080 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f804c06cf80 0x7f804c06f430 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f80500043d0 tx=0x7f8050009e30 comp rx=0 tx=0).stop 2023-12-05T09:59:53.592 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:53.594+0000 7f80681e0700 1 -- 172.21.15.100:0/584473080 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80600fcbf0 msgr2=0x7f806010d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:59:53.592 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:53.594+0000 7f80681e0700 1 --2- 172.21.15.100:0/584473080 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80600fcbf0 0x7f806010d580 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f805c002a80 tx=0x7f805c004600 comp rx=0 tx=0).stop 2023-12-05T09:59:53.592 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:53.594+0000 7f80681e0700 1 -- 172.21.15.100:0/584473080 shutdown_connections 2023-12-05T09:59:53.592 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:53.594+0000 7f80681e0700 1 --2- 172.21.15.100:0/584473080 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f804c06cf80 0x7f804c06f430 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:53.592 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:53.594+0000 7f80681e0700 1 --2- 172.21.15.100:0/584473080 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80600fcbf0 0x7f806010d580 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:53.592 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:53.594+0000 7f80681e0700 1 --2- 172.21.15.100:0/584473080 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80600fde00 0x7f806010dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:59:53.592 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:53.594+0000 7f80681e0700 1 -- 172.21.15.100:0/584473080 >> 172.21.15.100:0/584473080 conn(0x7f80600f82d0 msgr2=0x7f8060101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:59:53.592 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:53.594+0000 7f80681e0700 1 -- 172.21.15.100:0/584473080 shutdown_connections 2023-12-05T09:59:53.592 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T09:59:53.594+0000 7f80681e0700 1 -- 172.21.15.100:0/584473080 wait complete. 2023-12-05T09:59:53.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:53 smithi150 ceph-mon[171606]: from='client.34162 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:59:53.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:53 smithi150 ceph-mon[171606]: Reconfiguring mon.smithi150 (monmap changed)... 2023-12-05T09:59:53.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:53 smithi150 ceph-mon[171606]: Reconfiguring daemon mon.smithi150 on smithi150 2023-12-05T09:59:53.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:53 smithi150 ceph-mon[171606]: from='client.? 172.21.15.100:0/874755145' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-05T09:59:53.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:53 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:53.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:53 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:53.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:53 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-05T09:59:53.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:53 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:59:53.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:53 smithi100 ceph-mon[187528]: from='client.34162 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:59:53.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:53 smithi100 ceph-mon[187528]: Reconfiguring mon.smithi150 (monmap changed)... 2023-12-05T09:59:53.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:53 smithi100 ceph-mon[187528]: Reconfiguring daemon mon.smithi150 on smithi150 2023-12-05T09:59:53.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:53 smithi100 ceph-mon[187528]: from='client.? 172.21.15.100:0/874755145' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-05T09:59:53.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:53 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:53.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:53 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:53.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:53 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-05T09:59:53.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:53 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:59:54.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:54 smithi150 ceph-mon[171606]: pgmap v24: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:59:54.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:54 smithi150 ceph-mon[171606]: from='client.34174 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:59:54.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:54 smithi150 ceph-mon[171606]: Reconfiguring osd.3 (monmap changed)... 2023-12-05T09:59:54.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:54 smithi150 ceph-mon[171606]: Reconfiguring daemon osd.3 on smithi150 2023-12-05T09:59:54.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:54 smithi150 ceph-mon[171606]: from='client.? 172.21.15.100:0/584473080' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-05T09:59:54.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:54 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:54.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:54 smithi100 ceph-mon[187528]: pgmap v24: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:59:54.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:54 smithi100 ceph-mon[187528]: from='client.34174 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:59:54.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:54 smithi100 ceph-mon[187528]: Reconfiguring osd.3 (monmap changed)... 2023-12-05T09:59:54.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:54 smithi100 ceph-mon[187528]: Reconfiguring daemon osd.3 on smithi150 2023-12-05T09:59:54.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:54 smithi100 ceph-mon[187528]: from='client.? 172.21.15.100:0/584473080' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-05T09:59:54.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:54 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:55.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:55 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:55.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:55 smithi150 ceph-mon[171606]: Reconfiguring osd.4 (monmap changed)... 2023-12-05T09:59:55.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:55 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-05T09:59:55.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:55 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:59:55.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:55 smithi150 ceph-mon[171606]: Reconfiguring daemon osd.4 on smithi150 2023-12-05T09:59:55.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:55 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:55.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:55 smithi100 ceph-mon[187528]: Reconfiguring osd.4 (monmap changed)... 2023-12-05T09:59:55.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:55 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-05T09:59:55.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:55 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:59:55.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:55 smithi100 ceph-mon[187528]: Reconfiguring daemon osd.4 on smithi150 2023-12-05T09:59:56.831 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:56 smithi150 ceph-mon[171606]: pgmap v25: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:59:56.831 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:56 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:59:56.831 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:56 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:56.831 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:56 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:56.831 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:56 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-05T09:59:56.831 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:56 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:59:56.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:56 smithi100 ceph-mon[187528]: pgmap v25: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:59:56.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:56 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:59:56.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:56 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:56.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:56 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:56.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:56 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-05T09:59:56.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:56 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:59:57.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:57 smithi100 ceph-mon[187528]: Reconfiguring osd.5 (monmap changed)... 2023-12-05T09:59:57.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:57 smithi100 ceph-mon[187528]: Reconfiguring daemon osd.5 on smithi150 2023-12-05T09:59:57.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:57 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:57.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:57 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:57.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:57 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi150.pcbpxm", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-05T09:59:57.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:57 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:59:57.924 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:57 smithi150 ceph-mon[171606]: Reconfiguring osd.5 (monmap changed)... 2023-12-05T09:59:57.924 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:57 smithi150 ceph-mon[171606]: Reconfiguring daemon osd.5 on smithi150 2023-12-05T09:59:57.924 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:57 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:57.924 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:57 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:57.925 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:57 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi150.pcbpxm", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-05T09:59:57.925 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:57 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:59:58.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:58 smithi100 ceph-mon[187528]: pgmap v26: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:59:58.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:58 smithi100 ceph-mon[187528]: Reconfiguring mds.cephfs.smithi150.pcbpxm (monmap changed)... 2023-12-05T09:59:58.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:58 smithi100 ceph-mon[187528]: Reconfiguring daemon mds.cephfs.smithi150.pcbpxm on smithi150 2023-12-05T09:59:58.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:58 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:58.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:58 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:58.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:58 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi150.fcnhsv", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-05T09:59:58.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:58 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:59:58.930 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:58 smithi150 ceph-mon[171606]: pgmap v26: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:59:58.930 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:58 smithi150 ceph-mon[171606]: Reconfiguring mds.cephfs.smithi150.pcbpxm (monmap changed)... 2023-12-05T09:59:58.930 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:58 smithi150 ceph-mon[171606]: Reconfiguring daemon mds.cephfs.smithi150.pcbpxm on smithi150 2023-12-05T09:59:58.930 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:58 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:58.930 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:58 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:58.930 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:58 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi150.fcnhsv", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-05T09:59:58.930 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:58 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:59:59.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:59 smithi100 ceph-mon[187528]: Reconfiguring mds.cephfs.smithi150.fcnhsv (monmap changed)... 2023-12-05T09:59:59.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:59 smithi100 ceph-mon[187528]: Reconfiguring daemon mds.cephfs.smithi150.fcnhsv on smithi150 2023-12-05T09:59:59.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:59 smithi100 ceph-mon[187528]: pgmap v27: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:59:59.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:59 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:59.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:59 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:59.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:59 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:59:59.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:59 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:59:59.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:59 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:59:59.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:59 smithi100 ceph-mon[187528]: Upgrade: Setting container_image for all mon 2023-12-05T09:59:59.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:59 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T09:59:59.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:59 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi100"}]: dispatch 2023-12-05T09:59:59.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:59 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi100"}]': finished 2023-12-05T09:59:59.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:59 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi150"}]: dispatch 2023-12-05T09:59:59.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 09:59:59 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi150"}]': finished 2023-12-05T10:00:00.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:59 smithi150 ceph-mon[171606]: Reconfiguring mds.cephfs.smithi150.fcnhsv (monmap changed)... 2023-12-05T10:00:00.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:59 smithi150 ceph-mon[171606]: Reconfiguring daemon mds.cephfs.smithi150.fcnhsv on smithi150 2023-12-05T10:00:00.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:59 smithi150 ceph-mon[171606]: pgmap v27: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T10:00:00.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:59 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:00:00.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:59 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:00:00.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:59 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T10:00:00.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:59 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T10:00:00.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:59 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T10:00:00.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:59 smithi150 ceph-mon[171606]: Upgrade: Setting container_image for all mon 2023-12-05T10:00:00.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:59 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:00:00.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:59 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi100"}]: dispatch 2023-12-05T10:00:00.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:59 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi100"}]': finished 2023-12-05T10:00:00.097 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:59 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi150"}]: dispatch 2023-12-05T10:00:00.097 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 09:59:59 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi150"}]': finished 2023-12-05T10:00:00.843 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:00 smithi100 ceph-mon[187528]: overall HEALTH_OK 2023-12-05T10:00:01.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:00 smithi150 ceph-mon[171606]: overall HEALTH_OK 2023-12-05T10:00:02.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:01 smithi100 ceph-mon[187528]: pgmap v28: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T10:00:02.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:01 smithi100 ceph-mon[187528]: Upgrade: Updating crash.smithi100 (1/2) 2023-12-05T10:00:02.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:01 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:00:02.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:01 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi100", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-05T10:00:02.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:01 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T10:00:02.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:01 smithi100 ceph-mon[187528]: Deploying daemon crash.smithi100 on smithi100 2023-12-05T10:00:02.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:01 smithi150 ceph-mon[171606]: pgmap v28: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T10:00:02.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:01 smithi150 ceph-mon[171606]: Upgrade: Updating crash.smithi100 (1/2) 2023-12-05T10:00:02.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:01 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:00:02.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:01 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi100", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-05T10:00:02.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:01 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T10:00:02.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:01 smithi150 ceph-mon[171606]: Deploying daemon crash.smithi100 on smithi100 2023-12-05T10:00:04.259 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:04 smithi100 ceph-mon[187528]: pgmap v29: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T10:00:04.345 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:04 smithi150 ceph-mon[171606]: pgmap v29: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T10:00:05.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:05 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:00:05.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:05 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:00:05.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:05 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:00:05.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:05 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:00:06.659 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:06 smithi150 ceph-mon[171606]: pgmap v30: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T10:00:06.659 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:06 smithi150 ceph-mon[171606]: Upgrade: Updating crash.smithi150 (2/2) 2023-12-05T10:00:06.659 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:06 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:00:06.659 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:06 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi150", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-05T10:00:06.659 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:06 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T10:00:06.659 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:06 smithi150 ceph-mon[171606]: Deploying daemon crash.smithi150 on smithi150 2023-12-05T10:00:06.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:06 smithi100 ceph-mon[187528]: pgmap v30: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T10:00:06.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:06 smithi100 ceph-mon[187528]: Upgrade: Updating crash.smithi150 (2/2) 2023-12-05T10:00:06.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:06 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:00:06.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:06 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi150", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-05T10:00:06.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:06 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T10:00:06.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:06 smithi100 ceph-mon[187528]: Deploying daemon crash.smithi150 on smithi150 2023-12-05T10:00:08.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:08 smithi150 ceph-mon[171606]: pgmap v31: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T10:00:08.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:08 smithi100 ceph-mon[187528]: pgmap v31: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T10:00:09.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:09 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:00:09.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:09 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:00:09.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:09 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T10:00:09.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:09 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:00:09.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:09 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:00:09.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:09 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T10:00:10.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:10 smithi150 ceph-mon[171606]: pgmap v32: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T10:00:10.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:10 smithi100 ceph-mon[187528]: pgmap v32: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T10:00:11.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:11 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T10:00:11.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:11 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:00:11.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:11 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:00:11.890 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:11 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T10:00:11.890 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:11 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:00:11.890 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:11 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:00:12.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:12 smithi150 ceph-mon[171606]: pgmap v33: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T10:00:12.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:12 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:00:12.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:12 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:00:12.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:12 smithi100 ceph-mon[187528]: pgmap v33: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T10:00:12.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:12 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:00:12.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:12 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:00:14.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:14 smithi150 ceph-mon[171606]: pgmap v34: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T10:00:14.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:14 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:00:14.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:14 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:00:14.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:14 smithi100 ceph-mon[187528]: pgmap v34: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T10:00:14.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:14 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:00:14.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:14 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:00:15.478 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:15 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:00:15.478 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:15 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:00:15.606 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:15 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:00:15.606 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:15 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:00:16.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:16 smithi150 ceph-mon[171606]: pgmap v35: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T10:00:16.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:16 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:00:16.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:16 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:00:16.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:16 smithi100 ceph-mon[187528]: pgmap v35: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T10:00:16.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:16 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:00:16.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:16 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:00:18.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:18 smithi100 ceph-mon[187528]: pgmap v36: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T10:00:18.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:18 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:00:18.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:18 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:00:18.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:18 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T10:00:18.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:18 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T10:00:18.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:18 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:00:18.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:18 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T10:00:18.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:18 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T10:00:18.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:18 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T10:00:18.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:18 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T10:00:18.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:18 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:00:18.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:18 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi100"}]: dispatch 2023-12-05T10:00:18.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:18 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi100"}]': finished 2023-12-05T10:00:18.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:18 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi150"}]: dispatch 2023-12-05T10:00:18.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:18 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi150"}]': finished 2023-12-05T10:00:18.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:18 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2023-12-05T10:00:19.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:18 smithi150 ceph-mon[171606]: pgmap v36: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T10:00:19.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:18 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:00:19.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:18 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:00:19.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:18 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T10:00:19.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:18 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T10:00:19.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:18 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:00:19.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:18 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T10:00:19.097 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:18 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T10:00:19.097 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:18 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T10:00:19.097 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:18 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T10:00:19.097 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:18 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:00:19.097 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:18 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi100"}]: dispatch 2023-12-05T10:00:19.097 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:18 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi100"}]': finished 2023-12-05T10:00:19.097 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:18 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi150"}]: dispatch 2023-12-05T10:00:19.097 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:18 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi150"}]': finished 2023-12-05T10:00:19.097 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:18 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2023-12-05T10:00:19.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:19 smithi100 ceph-mon[187528]: Upgrade: Setting container_image for all crash 2023-12-05T10:00:19.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:19 smithi100 ceph-mon[187528]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2023-12-05T10:00:19.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:19 smithi100 ceph-mon[187528]: Upgrade: osd.0 is safe to restart 2023-12-05T10:00:19.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:19 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:00:19.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:19 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-05T10:00:19.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:19 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T10:00:20.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:19 smithi150 ceph-mon[171606]: Upgrade: Setting container_image for all crash 2023-12-05T10:00:20.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:19 smithi150 ceph-mon[171606]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2023-12-05T10:00:20.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:19 smithi150 ceph-mon[171606]: Upgrade: osd.0 is safe to restart 2023-12-05T10:00:20.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:19 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:00:20.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:19 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-05T10:00:20.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:19 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T10:00:20.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:20 smithi100 ceph-mon[187528]: pgmap v37: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T10:00:20.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:20 smithi100 ceph-mon[187528]: Upgrade: Updating osd.0 2023-12-05T10:00:20.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:20 smithi100 ceph-mon[187528]: Deploying daemon osd.0 on smithi100 2023-12-05T10:00:21.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:20 smithi150 ceph-mon[171606]: pgmap v37: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T10:00:21.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:20 smithi150 ceph-mon[171606]: Upgrade: Updating osd.0 2023-12-05T10:00:21.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:20 smithi150 ceph-mon[171606]: Deploying daemon osd.0 on smithi100 2023-12-05T10:00:22.664 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:22 smithi100 ceph-mon[187528]: pgmap v38: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T10:00:22.664 INFO:journalctl@ceph.osd.0.smithi100.stdout:Dec 05 10:00:22 smithi100 systemd[1]: Stopping Ceph osd.0 for 5b035ce6-9353-11ee-95a2-87774f69a715... 2023-12-05T10:00:23.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:22 smithi150 ceph-mon[171606]: pgmap v38: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T10:00:23.145 INFO:journalctl@ceph.osd.0.smithi100.stdout:Dec 05 10:00:22 smithi100 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-0[130830]: 2023-12-05T10:00:22.666+0000 7f312d11a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-05T10:00:23.145 INFO:journalctl@ceph.osd.0.smithi100.stdout:Dec 05 10:00:22 smithi100 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-0[130830]: 2023-12-05T10:00:22.666+0000 7f312d11a700 -1 osd.0 51 *** Got signal Terminated *** 2023-12-05T10:00:23.145 INFO:journalctl@ceph.osd.0.smithi100.stdout:Dec 05 10:00:22 smithi100 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-0[130830]: 2023-12-05T10:00:22.666+0000 7f312d11a700 -1 osd.0 51 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-05T10:00:23.751 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:23.753+0000 7fe71b01f700 1 -- 172.21.15.100:0/205842821 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7140fcbf0 msgr2=0x7fe7140fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:00:23.751 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:23.753+0000 7fe71b01f700 1 --2- 172.21.15.100:0/205842821 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7140fcbf0 0x7fe7140fd000 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe708004940 tx=0x7fe708009e30 comp rx=0 tx=0).stop 2023-12-05T10:00:23.751 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:23.753+0000 7fe71b01f700 1 -- 172.21.15.100:0/205842821 shutdown_connections 2023-12-05T10:00:23.751 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:23.753+0000 7fe71b01f700 1 --2- 172.21.15.100:0/205842821 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7140fde00 0x7fe7140fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:23.752 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:23.753+0000 7fe71b01f700 1 --2- 172.21.15.100:0/205842821 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7140fcbf0 0x7fe7140fd000 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:23.752 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:23.753+0000 7fe71b01f700 1 -- 172.21.15.100:0/205842821 >> 172.21.15.100:0/205842821 conn(0x7fe7140f82d0 msgr2=0x7fe7140fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:00:23.752 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:23.753+0000 7fe71b01f700 1 -- 172.21.15.100:0/205842821 shutdown_connections 2023-12-05T10:00:23.752 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:23.753+0000 7fe71b01f700 1 -- 172.21.15.100:0/205842821 wait complete. 2023-12-05T10:00:23.752 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:23.754+0000 7fe71b01f700 1 Processor -- start 2023-12-05T10:00:23.753 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:23.754+0000 7fe71b01f700 1 -- start start 2023-12-05T10:00:23.753 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:23.755+0000 7fe71b01f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7140fcbf0 0x7fe71410d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:00:23.753 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:23.755+0000 7fe71b01f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7140fde00 0x7fe71410daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:00:23.754 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:23.755+0000 7fe71b01f700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe71410e0a0 con 0x7fe7140fcbf0 2023-12-05T10:00:23.754 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:23.755+0000 7fe71b01f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe71410e940 con 0x7fe7140fde00 2023-12-05T10:00:23.754 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:23.755+0000 7fe718dbb700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7140fcbf0 0x7fe71410d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:00:23.754 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:23.755+0000 7fe718dbb700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7140fcbf0 0x7fe71410d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52768/0 (socket says 172.21.15.100:52768) 2023-12-05T10:00:23.754 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:23.755+0000 7fe718dbb700 1 -- 172.21.15.100:0/3334033688 learned_addr learned my addr 172.21.15.100:0/3334033688 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T10:00:23.754 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:23.755+0000 7fe713fff700 1 --2- 172.21.15.100:0/3334033688 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7140fde00 0x7fe71410daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:00:23.754 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:23.755+0000 7fe718dbb700 1 -- 172.21.15.100:0/3334033688 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7140fde00 msgr2=0x7fe71410daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:00:23.754 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:23.755+0000 7fe718dbb700 1 --2- 172.21.15.100:0/3334033688 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7140fde00 0x7fe71410daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:23.754 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:23.755+0000 7fe718dbb700 1 -- 172.21.15.100:0/3334033688 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe708005040 con 0x7fe7140fcbf0 2023-12-05T10:00:23.754 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:23.755+0000 7fe713fff700 1 --2- 172.21.15.100:0/3334033688 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7140fde00 0x7fe71410daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-05T10:00:23.754 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:23.756+0000 7fe718dbb700 1 --2- 172.21.15.100:0/3334033688 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7140fcbf0 0x7fe71410d560 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe708000c00 tx=0x7fe708009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:00:23.754 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:23.756+0000 7fe7117fa700 1 -- 172.21.15.100:0/3334033688 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe70800e040 con 0x7fe7140fcbf0 2023-12-05T10:00:23.754 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:23.756+0000 7fe7117fa700 1 -- 172.21.15.100:0/3334033688 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe708009af0 con 0x7fe7140fcbf0 2023-12-05T10:00:23.754 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:23.756+0000 7fe71b01f700 1 -- 172.21.15.100:0/3334033688 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe71410ebc0 con 0x7fe7140fcbf0 2023-12-05T10:00:23.755 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:23.756+0000 7fe7117fa700 1 -- 172.21.15.100:0/3334033688 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe70801c630 con 0x7fe7140fcbf0 2023-12-05T10:00:23.755 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:23.756+0000 7fe71b01f700 1 -- 172.21.15.100:0/3334033688 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe71410f100 con 0x7fe7140fcbf0 2023-12-05T10:00:23.755 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:23.757+0000 7fe71b01f700 1 -- 172.21.15.100:0/3334033688 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe71404bb80 con 0x7fe7140fcbf0 2023-12-05T10:00:23.755 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:23.758+0000 7fe7117fa700 1 -- 172.21.15.100:0/3334033688 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 91040+0+0 (secure 0 0 0) 0x7fe70800bcd0 con 0x7fe7140fcbf0 2023-12-05T10:00:23.757 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:23.759+0000 7fe7117fa700 1 --2- 172.21.15.100:0/3334033688 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fe70406cf80 0x7fe70406f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:00:23.757 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:23.759+0000 7fe7117fa700 1 -- 172.21.15.100:0/3334033688 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fe70808daa0 con 0x7fe7140fcbf0 2023-12-05T10:00:23.757 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:23.760+0000 7fe713fff700 1 --2- 172.21.15.100:0/3334033688 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fe70406cf80 0x7fe70406f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:00:23.757 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:23.760+0000 7fe713fff700 1 --2- 172.21.15.100:0/3334033688 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fe70406cf80 0x7fe70406f430 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe700009fd0 tx=0x7fe700009ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:00:23.762 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:23.764+0000 7fe7117fa700 1 -- 172.21.15.100:0/3334033688 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fe70805b170 con 0x7fe7140fcbf0 2023-12-05T10:00:23.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:23 smithi100 ceph-mon[187528]: pgmap v39: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T10:00:23.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:23 smithi100 ceph-mon[187528]: osd.0 marked itself down and dead 2023-12-05T10:00:23.985 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:23.987+0000 7fe71b01f700 1 -- 172.21.15.100:0/3334033688 --> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe71410f4f0 con 0x7fe70406cf80 2023-12-05T10:00:23.986 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:23.988+0000 7fe7117fa700 1 -- 172.21.15.100:0/3334033688 <== mgr.34104 v2:172.21.15.100:6800/3489431924 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fe71410f4f0 con 0x7fe70406cf80 2023-12-05T10:00:23.989 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:23.991+0000 7fe71b01f700 1 -- 172.21.15.100:0/3334033688 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fe70406cf80 msgr2=0x7fe70406f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:00:23.989 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:23.991+0000 7fe71b01f700 1 --2- 172.21.15.100:0/3334033688 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fe70406cf80 0x7fe70406f430 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe700009fd0 tx=0x7fe700009ee0 comp rx=0 tx=0).stop 2023-12-05T10:00:23.989 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:23.991+0000 7fe71b01f700 1 -- 172.21.15.100:0/3334033688 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7140fcbf0 msgr2=0x7fe71410d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:00:23.989 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:23.991+0000 7fe71b01f700 1 --2- 172.21.15.100:0/3334033688 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7140fcbf0 0x7fe71410d560 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe708000c00 tx=0x7fe708009e30 comp rx=0 tx=0).stop 2023-12-05T10:00:23.989 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:23.991+0000 7fe71b01f700 1 -- 172.21.15.100:0/3334033688 shutdown_connections 2023-12-05T10:00:23.989 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:23.991+0000 7fe71b01f700 1 --2- 172.21.15.100:0/3334033688 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fe70406cf80 0x7fe70406f430 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:23.989 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:23.991+0000 7fe71b01f700 1 --2- 172.21.15.100:0/3334033688 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7140fcbf0 0x7fe71410d560 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:23.989 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:23.991+0000 7fe71b01f700 1 --2- 172.21.15.100:0/3334033688 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7140fde00 0x7fe71410daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:23.989 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:23.991+0000 7fe71b01f700 1 -- 172.21.15.100:0/3334033688 >> 172.21.15.100:0/3334033688 conn(0x7fe7140f82d0 msgr2=0x7fe714101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:00:23.989 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:23.991+0000 7fe71b01f700 1 -- 172.21.15.100:0/3334033688 shutdown_connections 2023-12-05T10:00:23.989 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:23.991+0000 7fe71b01f700 1 -- 172.21.15.100:0/3334033688 wait complete. 2023-12-05T10:00:24.003 INFO:teuthology.orchestra.run.smithi100.stdout:true 2023-12-05T10:00:24.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:23 smithi150 ceph-mon[171606]: pgmap v39: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T10:00:24.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:23 smithi150 ceph-mon[171606]: osd.0 marked itself down and dead 2023-12-05T10:00:24.145 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.147+0000 7f742ef8d700 1 -- 172.21.15.100:0/2331960098 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7428070570 msgr2=0x7f74280709c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:00:24.145 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.147+0000 7f742ef8d700 1 --2- 172.21.15.100:0/2331960098 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7428070570 0x7f74280709c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7414004940 tx=0x7f7414009e30 comp rx=0 tx=0).stop 2023-12-05T10:00:24.145 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.147+0000 7f742ef8d700 1 -- 172.21.15.100:0/2331960098 shutdown_connections 2023-12-05T10:00:24.145 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.147+0000 7f742ef8d700 1 --2- 172.21.15.100:0/2331960098 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7428070570 0x7f74280709c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:24.146 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.147+0000 7f742ef8d700 1 --2- 172.21.15.100:0/2331960098 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7428071bc0 0x7f7428070030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:24.146 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.147+0000 7f742ef8d700 1 -- 172.21.15.100:0/2331960098 >> 172.21.15.100:0/2331960098 conn(0x7f74280f82d0 msgr2=0x7f74280fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:00:24.146 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.147+0000 7f742ef8d700 1 -- 172.21.15.100:0/2331960098 shutdown_connections 2023-12-05T10:00:24.146 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.148+0000 7f742ef8d700 1 -- 172.21.15.100:0/2331960098 wait complete. 2023-12-05T10:00:24.147 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.149+0000 7f742ef8d700 1 Processor -- start 2023-12-05T10:00:24.147 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.149+0000 7f742ef8d700 1 -- start start 2023-12-05T10:00:24.147 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.149+0000 7f742ef8d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7428070570 0x7f742810f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:00:24.147 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.149+0000 7f742ef8d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7428071bc0 0x7f742810fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:00:24.147 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.149+0000 7f742ef8d700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74281103d0 con 0x7f7428070570 2023-12-05T10:00:24.147 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.149+0000 7f742ef8d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7428110c10 con 0x7f7428071bc0 2023-12-05T10:00:24.148 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.150+0000 7f742cd29700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7428070570 0x7f742810f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:00:24.149 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.150+0000 7f742cd29700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7428070570 0x7f742810f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52784/0 (socket says 172.21.15.100:52784) 2023-12-05T10:00:24.149 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.150+0000 7f742cd29700 1 -- 172.21.15.100:0/2835568933 learned_addr learned my addr 172.21.15.100:0/2835568933 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T10:00:24.149 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.150+0000 7f7427fff700 1 --2- 172.21.15.100:0/2835568933 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7428071bc0 0x7f742810fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:00:24.149 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.150+0000 7f742cd29700 1 -- 172.21.15.100:0/2835568933 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7428071bc0 msgr2=0x7f742810fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:00:24.149 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.150+0000 7f742cd29700 1 --2- 172.21.15.100:0/2835568933 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7428071bc0 0x7f742810fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:24.149 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.150+0000 7f742cd29700 1 -- 172.21.15.100:0/2835568933 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7414005040 con 0x7f7428070570 2023-12-05T10:00:24.149 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.150+0000 7f7427fff700 1 --2- 172.21.15.100:0/2835568933 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7428071bc0 0x7f742810fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-05T10:00:24.149 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.150+0000 7f742cd29700 1 --2- 172.21.15.100:0/2835568933 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7428070570 0x7f742810f800 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f741c00b790 tx=0x7f741c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:00:24.149 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.151+0000 7f74257fa700 1 -- 172.21.15.100:0/2835568933 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f741c00f770 con 0x7f7428070570 2023-12-05T10:00:24.149 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.151+0000 7f74257fa700 1 -- 172.21.15.100:0/2835568933 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f741c00fd80 con 0x7f7428070570 2023-12-05T10:00:24.149 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.151+0000 7f74257fa700 1 -- 172.21.15.100:0/2835568933 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f741c00d310 con 0x7f7428070570 2023-12-05T10:00:24.149 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.151+0000 7f742ef8d700 1 -- 172.21.15.100:0/2835568933 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7428110ef0 con 0x7f7428070570 2023-12-05T10:00:24.149 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.151+0000 7f742ef8d700 1 -- 172.21.15.100:0/2835568933 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7428111430 con 0x7f7428070570 2023-12-05T10:00:24.150 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.152+0000 7f742ef8d700 1 -- 172.21.15.100:0/2835568933 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f742804bb80 con 0x7f7428070570 2023-12-05T10:00:24.151 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.154+0000 7f74257fa700 1 -- 172.21.15.100:0/2835568933 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 91040+0+0 (secure 0 0 0) 0x7f741c010420 con 0x7f7428070570 2023-12-05T10:00:24.152 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.154+0000 7f74257fa700 1 --2- 172.21.15.100:0/2835568933 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f741806cf80 0x7f741806f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:00:24.152 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.154+0000 7f74257fa700 1 -- 172.21.15.100:0/2835568933 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f741c08c340 con 0x7f7428070570 2023-12-05T10:00:24.152 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.155+0000 7f7427fff700 1 --2- 172.21.15.100:0/2835568933 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f741806cf80 0x7f741806f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:00:24.153 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.156+0000 7f7427fff700 1 --2- 172.21.15.100:0/2835568933 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f741806cf80 0x7f741806f430 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f741400b3b0 tx=0x7f7414009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:00:24.157 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.160+0000 7f74257fa700 1 -- 172.21.15.100:0/2835568933 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f741c059c60 con 0x7f7428070570 2023-12-05T10:00:24.398 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.401+0000 7f742ef8d700 1 -- 172.21.15.100:0/2835568933 --> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f74281041a0 con 0x7f741806cf80 2023-12-05T10:00:24.400 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.402+0000 7f74257fa700 1 -- 172.21.15.100:0/2835568933 <== mgr.34104 v2:172.21.15.100:6800/3489431924 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f74281041a0 con 0x7f741806cf80 2023-12-05T10:00:24.402 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.404+0000 7f742ef8d700 1 -- 172.21.15.100:0/2835568933 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f741806cf80 msgr2=0x7f741806f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:00:24.402 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.404+0000 7f742ef8d700 1 --2- 172.21.15.100:0/2835568933 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f741806cf80 0x7f741806f430 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f741400b3b0 tx=0x7f7414009e30 comp rx=0 tx=0).stop 2023-12-05T10:00:24.402 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.404+0000 7f742ef8d700 1 -- 172.21.15.100:0/2835568933 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7428070570 msgr2=0x7f742810f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:00:24.402 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.404+0000 7f742ef8d700 1 --2- 172.21.15.100:0/2835568933 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7428070570 0x7f742810f800 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f741c00b790 tx=0x7f741c009250 comp rx=0 tx=0).stop 2023-12-05T10:00:24.402 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.404+0000 7f742ef8d700 1 -- 172.21.15.100:0/2835568933 shutdown_connections 2023-12-05T10:00:24.402 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.404+0000 7f742ef8d700 1 --2- 172.21.15.100:0/2835568933 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f741806cf80 0x7f741806f430 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:24.402 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.404+0000 7f742ef8d700 1 --2- 172.21.15.100:0/2835568933 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7428070570 0x7f742810f800 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:24.402 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.404+0000 7f742ef8d700 1 --2- 172.21.15.100:0/2835568933 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7428071bc0 0x7f742810fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:24.402 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.404+0000 7f742ef8d700 1 -- 172.21.15.100:0/2835568933 >> 172.21.15.100:0/2835568933 conn(0x7f74280f82d0 msgr2=0x7f7428102a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:00:24.402 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.405+0000 7f742ef8d700 1 -- 172.21.15.100:0/2835568933 shutdown_connections 2023-12-05T10:00:24.403 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.405+0000 7f742ef8d700 1 -- 172.21.15.100:0/2835568933 wait complete. 2023-12-05T10:00:24.545 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.547+0000 7fbd98947700 1 -- 172.21.15.100:0/3912350813 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd94070570 msgr2=0x7fbd940709c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:00:24.545 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.547+0000 7fbd98947700 1 --2- 172.21.15.100:0/3912350813 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd94070570 0x7fbd940709c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbd88004940 tx=0x7fbd88009e30 comp rx=0 tx=0).stop 2023-12-05T10:00:24.545 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.547+0000 7fbd98947700 1 -- 172.21.15.100:0/3912350813 shutdown_connections 2023-12-05T10:00:24.545 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.547+0000 7fbd98947700 1 --2- 172.21.15.100:0/3912350813 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd94070570 0x7fbd940709c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:24.545 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.547+0000 7fbd98947700 1 --2- 172.21.15.100:0/3912350813 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd94071bc0 0x7fbd94070030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:24.545 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.547+0000 7fbd98947700 1 -- 172.21.15.100:0/3912350813 >> 172.21.15.100:0/3912350813 conn(0x7fbd940f82d0 msgr2=0x7fbd940fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:00:24.545 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.547+0000 7fbd98947700 1 -- 172.21.15.100:0/3912350813 shutdown_connections 2023-12-05T10:00:24.545 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.547+0000 7fbd98947700 1 -- 172.21.15.100:0/3912350813 wait complete. 2023-12-05T10:00:24.546 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.548+0000 7fbd98947700 1 Processor -- start 2023-12-05T10:00:24.546 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.548+0000 7fbd98947700 1 -- start start 2023-12-05T10:00:24.546 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.548+0000 7fbd98947700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd94070570 0x7fbd9410f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:00:24.546 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.548+0000 7fbd98947700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd94071bc0 0x7fbd9410fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:00:24.546 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.548+0000 7fbd98947700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd941103a0 con 0x7fbd94070570 2023-12-05T10:00:24.547 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.548+0000 7fbd98947700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd94110c40 con 0x7fbd94071bc0 2023-12-05T10:00:24.547 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.549+0000 7fbd9259c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd94070570 0x7fbd9410f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:00:24.547 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.549+0000 7fbd9259c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd94070570 0x7fbd9410f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52804/0 (socket says 172.21.15.100:52804) 2023-12-05T10:00:24.547 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.549+0000 7fbd9259c700 1 -- 172.21.15.100:0/708775325 learned_addr learned my addr 172.21.15.100:0/708775325 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T10:00:24.547 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.549+0000 7fbd91d9b700 1 --2- 172.21.15.100:0/708775325 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd94071bc0 0x7fbd9410fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:00:24.548 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.549+0000 7fbd9259c700 1 -- 172.21.15.100:0/708775325 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd94071bc0 msgr2=0x7fbd9410fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:00:24.548 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.549+0000 7fbd9259c700 1 --2- 172.21.15.100:0/708775325 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd94071bc0 0x7fbd9410fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:24.548 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.549+0000 7fbd9259c700 1 -- 172.21.15.100:0/708775325 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd88005040 con 0x7fbd94070570 2023-12-05T10:00:24.548 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.550+0000 7fbd9259c700 1 --2- 172.21.15.100:0/708775325 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd94070570 0x7fbd9410f860 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbd8400c830 tx=0x7fbd84004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:00:24.548 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.550+0000 7fbd82ffd700 1 -- 172.21.15.100:0/708775325 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd840106f0 con 0x7fbd94070570 2023-12-05T10:00:24.548 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.550+0000 7fbd82ffd700 1 -- 172.21.15.100:0/708775325 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbd84010d00 con 0x7fbd94070570 2023-12-05T10:00:24.548 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.550+0000 7fbd82ffd700 1 -- 172.21.15.100:0/708775325 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd84012e90 con 0x7fbd94070570 2023-12-05T10:00:24.548 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.550+0000 7fbd98947700 1 -- 172.21.15.100:0/708775325 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd94110f20 con 0x7fbd94070570 2023-12-05T10:00:24.548 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.550+0000 7fbd98947700 1 -- 172.21.15.100:0/708775325 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd94111410 con 0x7fbd94070570 2023-12-05T10:00:24.548 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.551+0000 7fbd98947700 1 -- 172.21.15.100:0/708775325 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd941096f0 con 0x7fbd94070570 2023-12-05T10:00:24.550 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.553+0000 7fbd82ffd700 1 -- 172.21.15.100:0/708775325 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 91040+0+0 (secure 0 0 0) 0x7fbd84010850 con 0x7fbd94070570 2023-12-05T10:00:24.551 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.554+0000 7fbd82ffd700 1 --2- 172.21.15.100:0/708775325 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fbd7c06cf80 0x7fbd7c06f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:00:24.551 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.554+0000 7fbd82ffd700 1 -- 172.21.15.100:0/708775325 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fbd8408c470 con 0x7fbd94070570 2023-12-05T10:00:24.552 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.554+0000 7fbd91d9b700 1 --2- 172.21.15.100:0/708775325 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fbd7c06cf80 0x7fbd7c06f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:00:24.552 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.555+0000 7fbd91d9b700 1 --2- 172.21.15.100:0/708775325 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fbd7c06cf80 0x7fbd7c06f430 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbd88004560 tx=0x7fbd88009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:00:24.556 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.559+0000 7fbd82ffd700 1 -- 172.21.15.100:0/708775325 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fbd84059cd0 con 0x7fbd94070570 2023-12-05T10:00:24.619 INFO:journalctl@ceph.osd.0.smithi100.stdout:Dec 05 10:00:24 smithi100 bash[196981]: ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-0 2023-12-05T10:00:24.805 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.807+0000 7fbd98947700 1 -- 172.21.15.100:0/708775325 --> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fbd94111740 con 0x7fbd7c06cf80 2023-12-05T10:00:24.817 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.819+0000 7fbd82ffd700 1 -- 172.21.15.100:0/708775325 <== mgr.34104 v2:172.21.15.100:6800/3489431924 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fbd94111740 con 0x7fbd7c06cf80 2023-12-05T10:00:24.817 INFO:teuthology.orchestra.run.smithi100.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-05T10:00:24.817 INFO:teuthology.orchestra.run.smithi100.stdout:alertmanager.smithi100 smithi100 *:9093,9094 running (3m) 11s ago 10m 16.0M - 0.25.0 c8568f914cd2 f443e6a4242b 2023-12-05T10:00:24.818 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi100 smithi100 running (20s) 11s ago 10m 7856k - 19.0.0-11-g3fe8d441 56dea28e5206 fb8e6b844fba 2023-12-05T10:00:24.818 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi150 smithi150 running (16s) 13s ago 9m 7847k - 19.0.0-11-g3fe8d441 56dea28e5206 a035052de6cf 2023-12-05T10:00:24.818 INFO:teuthology.orchestra.run.smithi100.stdout:grafana.smithi100 smithi100 *:3000 running (2m) 11s ago 10m 79.7M - 9.4.7 2c41d148cca3 d666da9c4e4d 2023-12-05T10:00:24.818 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.akmstb smithi100 running (5m) 11s ago 5m 10.5G - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 6ce55c42c55b 2023-12-05T10:00:24.818 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.sqplhn smithi100 running (5m) 11s ago 5m 15.5M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc c2682d65f0c9 2023-12-05T10:00:24.819 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi150.fcnhsv smithi150 running (5m) 13s ago 5m 15.1M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 1a259762235d 2023-12-05T10:00:24.819 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi150.pcbpxm smithi150 running (5m) 13s ago 5m 15.2M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 27f730f8b9f9 2023-12-05T10:00:24.819 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi100.ehmuhg smithi100 *:8443,9283,8765 running (2m) 11s ago 11m 509M - 19.0.0-11-g3fe8d441 56dea28e5206 ebe3dfbb0356 2023-12-05T10:00:24.819 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi150.zkskag smithi150 *:8443,9283,8765 running (105s) 13s ago 9m 451M - 19.0.0-11-g3fe8d441 56dea28e5206 a2b40e2421f2 2023-12-05T10:00:24.819 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi100 smithi100 running (88s) 11s ago 11m 57.4M 2048M 19.0.0-11-g3fe8d441 56dea28e5206 21003fd7eaf4 2023-12-05T10:00:24.819 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi150 smithi150 running (53s) 13s ago 9m 35.5M 2048M 19.0.0-11-g3fe8d441 56dea28e5206 010f2f658fca 2023-12-05T10:00:24.820 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi100 smithi100 *:9100 running (3m) 11s ago 10m 8484k - 1.5.0 0da6a335fe13 a2653da0d840 2023-12-05T10:00:24.820 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi150 smithi150 *:9100 running (2m) 13s ago 9m 8170k - 1.5.0 0da6a335fe13 67523645e73b 2023-12-05T10:00:24.821 INFO:teuthology.orchestra.run.smithi100.stdout:osd.0 smithi100 running (8m) 11s ago 8m 928M 1618M 17.2.7-109-g1fd3ca3c e139fc5fd9fc c8e64a62cd47 2023-12-05T10:00:24.821 INFO:teuthology.orchestra.run.smithi100.stdout:osd.1 smithi100 running (8m) 11s ago 8m 999M 1618M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 0500895cdfc2 2023-12-05T10:00:24.821 INFO:teuthology.orchestra.run.smithi100.stdout:osd.2 smithi100 running (8m) 11s ago 8m 813M 1618M 17.2.7-109-g1fd3ca3c e139fc5fd9fc f145372c8ccc 2023-12-05T10:00:24.821 INFO:teuthology.orchestra.run.smithi100.stdout:osd.3 smithi150 running (7m) 13s ago 7m 1168M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 78137d463d29 2023-12-05T10:00:24.821 INFO:teuthology.orchestra.run.smithi100.stdout:osd.4 smithi150 running (7m) 13s ago 7m 848M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc dfef9accd162 2023-12-05T10:00:24.821 INFO:teuthology.orchestra.run.smithi100.stdout:osd.5 smithi150 running (6m) 13s ago 6m 994M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc d9720b1eae0c 2023-12-05T10:00:24.822 INFO:teuthology.orchestra.run.smithi100.stdout:prometheus.smithi100 smithi100 *:9095 running (110s) 11s ago 10m 48.8M - 2.43.0 a07b618ecd1d 8ade75deb316 2023-12-05T10:00:24.823 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.821+0000 7fbd98947700 1 -- 172.21.15.100:0/708775325 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fbd7c06cf80 msgr2=0x7fbd7c06f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:00:24.823 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.821+0000 7fbd98947700 1 --2- 172.21.15.100:0/708775325 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fbd7c06cf80 0x7fbd7c06f430 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbd88004560 tx=0x7fbd88009e30 comp rx=0 tx=0).stop 2023-12-05T10:00:24.823 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.821+0000 7fbd98947700 1 -- 172.21.15.100:0/708775325 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd94070570 msgr2=0x7fbd9410f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:00:24.823 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.821+0000 7fbd98947700 1 --2- 172.21.15.100:0/708775325 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd94070570 0x7fbd9410f860 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbd8400c830 tx=0x7fbd84004470 comp rx=0 tx=0).stop 2023-12-05T10:00:24.823 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.821+0000 7fbd98947700 1 -- 172.21.15.100:0/708775325 shutdown_connections 2023-12-05T10:00:24.824 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.821+0000 7fbd98947700 1 --2- 172.21.15.100:0/708775325 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fbd7c06cf80 0x7fbd7c06f430 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:24.824 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.821+0000 7fbd98947700 1 --2- 172.21.15.100:0/708775325 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd94070570 0x7fbd9410f860 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:24.824 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.821+0000 7fbd98947700 1 --2- 172.21.15.100:0/708775325 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd94071bc0 0x7fbd9410fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:24.824 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.821+0000 7fbd98947700 1 -- 172.21.15.100:0/708775325 >> 172.21.15.100:0/708775325 conn(0x7fbd940f82d0 msgr2=0x7fbd94103310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:00:24.824 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.821+0000 7fbd98947700 1 -- 172.21.15.100:0/708775325 shutdown_connections 2023-12-05T10:00:24.824 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.821+0000 7fbd98947700 1 -- 172.21.15.100:0/708775325 wait complete. 2023-12-05T10:00:24.899 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:24 smithi100 ceph-mon[187528]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-05T10:00:24.899 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:24 smithi100 ceph-mon[187528]: failed to encode map e52 with expected crc 2023-12-05T10:00:24.899 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:24 smithi100 ceph-mon[187528]: osdmap e52: 6 total, 5 up, 6 in 2023-12-05T10:00:24.899 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:24 smithi100 ceph-mon[187528]: from='client.34182 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T10:00:24.899 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:24 smithi100 ceph-mon[187528]: from='client.34186 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T10:00:24.960 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.962+0000 7f19d6e29700 1 -- 172.21.15.100:0/2793021764 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19d00fde00 msgr2=0x7f19d00fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:00:24.960 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.962+0000 7f19d6e29700 1 --2- 172.21.15.100:0/2793021764 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19d00fde00 0x7f19d00fe250 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f19bc004940 tx=0x7f19bc009e30 comp rx=0 tx=0).stop 2023-12-05T10:00:24.961 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.962+0000 7f19d6e29700 1 -- 172.21.15.100:0/2793021764 shutdown_connections 2023-12-05T10:00:24.961 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.962+0000 7f19d6e29700 1 --2- 172.21.15.100:0/2793021764 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19d00fde00 0x7f19d00fe250 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:24.961 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.962+0000 7f19d6e29700 1 --2- 172.21.15.100:0/2793021764 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f19d00fcbf0 0x7f19d00fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:24.961 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.962+0000 7f19d6e29700 1 -- 172.21.15.100:0/2793021764 >> 172.21.15.100:0/2793021764 conn(0x7f19d00f82d0 msgr2=0x7f19d00fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:00:24.961 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.963+0000 7f19d6e29700 1 -- 172.21.15.100:0/2793021764 shutdown_connections 2023-12-05T10:00:24.961 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.963+0000 7f19d6e29700 1 -- 172.21.15.100:0/2793021764 wait complete. 2023-12-05T10:00:24.962 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.963+0000 7f19d6e29700 1 Processor -- start 2023-12-05T10:00:24.962 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.963+0000 7f19d6e29700 1 -- start start 2023-12-05T10:00:24.962 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.964+0000 7f19d6e29700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19d00fcbf0 0x7f19d010d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:00:24.962 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.964+0000 7f19d6e29700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f19d00fde00 0x7f19d010dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:00:24.962 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.964+0000 7f19d6e29700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d010e0c0 con 0x7f19d00fcbf0 2023-12-05T10:00:24.962 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.964+0000 7f19d6e29700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d010e960 con 0x7f19d00fde00 2023-12-05T10:00:24.962 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.964+0000 7f19d4bc5700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19d00fcbf0 0x7f19d010d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:00:24.963 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.964+0000 7f19d4bc5700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19d00fcbf0 0x7f19d010d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52816/0 (socket says 172.21.15.100:52816) 2023-12-05T10:00:24.963 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.964+0000 7f19d4bc5700 1 -- 172.21.15.100:0/2901955054 learned_addr learned my addr 172.21.15.100:0/2901955054 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T10:00:24.963 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.964+0000 7f19cffff700 1 --2- 172.21.15.100:0/2901955054 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f19d00fde00 0x7f19d010dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:00:24.963 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.965+0000 7f19d4bc5700 1 -- 172.21.15.100:0/2901955054 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f19d00fde00 msgr2=0x7f19d010dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:00:24.963 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.965+0000 7f19d4bc5700 1 --2- 172.21.15.100:0/2901955054 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f19d00fde00 0x7f19d010dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:24.963 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.965+0000 7f19d4bc5700 1 -- 172.21.15.100:0/2901955054 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19bc005040 con 0x7f19d00fcbf0 2023-12-05T10:00:24.964 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.965+0000 7f19d4bc5700 1 --2- 172.21.15.100:0/2901955054 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19d00fcbf0 0x7f19d010d580 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f19c4002a80 tx=0x7f19c4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:00:24.964 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.965+0000 7f19cd7fa700 1 -- 172.21.15.100:0/2901955054 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19c4007cc0 con 0x7f19d00fcbf0 2023-12-05T10:00:24.964 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.965+0000 7f19cd7fa700 1 -- 172.21.15.100:0/2901955054 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f19c400f040 con 0x7f19d00fcbf0 2023-12-05T10:00:24.964 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.965+0000 7f19d6e29700 1 -- 172.21.15.100:0/2901955054 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19d010ec40 con 0x7f19d00fcbf0 2023-12-05T10:00:24.964 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.966+0000 7f19d6e29700 1 -- 172.21.15.100:0/2901955054 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19d010f180 con 0x7f19d00fcbf0 2023-12-05T10:00:24.964 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.966+0000 7f19cd7fa700 1 -- 172.21.15.100:0/2901955054 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19c400d9c0 con 0x7f19d00fcbf0 2023-12-05T10:00:24.964 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.967+0000 7f19d6e29700 1 -- 172.21.15.100:0/2901955054 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19d004bb80 con 0x7f19d00fcbf0 2023-12-05T10:00:24.965 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.967+0000 7f19cd7fa700 1 -- 172.21.15.100:0/2901955054 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 91040+0+0 (secure 0 0 0) 0x7f19c400db20 con 0x7f19d00fcbf0 2023-12-05T10:00:24.966 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.968+0000 7f19cd7fa700 1 --2- 172.21.15.100:0/2901955054 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f19c006cf80 0x7f19c006f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:00:24.966 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.969+0000 7f19cd7fa700 1 -- 172.21.15.100:0/2901955054 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f19c408c1c0 con 0x7f19d00fcbf0 2023-12-05T10:00:24.966 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.969+0000 7f19cffff700 1 --2- 172.21.15.100:0/2901955054 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f19c006cf80 0x7f19c006f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:00:24.967 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.969+0000 7f19cffff700 1 --2- 172.21.15.100:0/2901955054 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f19c006cf80 0x7f19c006f430 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f19bc0043d0 tx=0x7f19bc009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:00:24.970 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:24.973+0000 7f19cd7fa700 1 -- 172.21.15.100:0/2901955054 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f19c4059930 con 0x7f19d00fcbf0 2023-12-05T10:00:25.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:24 smithi150 ceph-mon[171606]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-05T10:00:25.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:24 smithi150 ceph-mon[171606]: failed to encode map e52 with expected crc 2023-12-05T10:00:25.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:24 smithi150 ceph-mon[171606]: osdmap e52: 6 total, 5 up, 6 in 2023-12-05T10:00:25.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:24 smithi150 ceph-mon[171606]: from='client.34182 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T10:00:25.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:24 smithi150 ceph-mon[171606]: from='client.34186 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T10:00:25.269 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.268+0000 7f19d6e29700 1 -- 172.21.15.100:0/2901955054 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f19d010f510 con 0x7f19d00fcbf0 2023-12-05T10:00:25.270 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.268+0000 7f19cd7fa700 1 -- 172.21.15.100:0/2901955054 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+726 (secure 0 0 0) 0x7f19c40594c0 con 0x7f19d00fcbf0 2023-12-05T10:00:25.270 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2023-12-05T10:00:25.271 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": { 2023-12-05T10:00:25.271 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 2 2023-12-05T10:00:25.271 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-12-05T10:00:25.271 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": { 2023-12-05T10:00:25.271 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 2 2023-12-05T10:00:25.271 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-12-05T10:00:25.271 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": { 2023-12-05T10:00:25.271 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 5 2023-12-05T10:00:25.271 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-12-05T10:00:25.271 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": { 2023-12-05T10:00:25.271 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 4 2023-12-05T10:00:25.272 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-12-05T10:00:25.272 INFO:teuthology.orchestra.run.smithi100.stdout: "overall": { 2023-12-05T10:00:25.272 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 9, 2023-12-05T10:00:25.272 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 4 2023-12-05T10:00:25.272 INFO:teuthology.orchestra.run.smithi100.stdout: } 2023-12-05T10:00:25.272 INFO:teuthology.orchestra.run.smithi100.stdout:} 2023-12-05T10:00:25.272 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.270+0000 7f19d6e29700 1 -- 172.21.15.100:0/2901955054 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f19c006cf80 msgr2=0x7f19c006f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:00:25.273 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.270+0000 7f19d6e29700 1 --2- 172.21.15.100:0/2901955054 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f19c006cf80 0x7f19c006f430 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f19bc0043d0 tx=0x7f19bc009e30 comp rx=0 tx=0).stop 2023-12-05T10:00:25.273 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.271+0000 7f19d6e29700 1 -- 172.21.15.100:0/2901955054 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19d00fcbf0 msgr2=0x7f19d010d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:00:25.273 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.271+0000 7f19d6e29700 1 --2- 172.21.15.100:0/2901955054 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19d00fcbf0 0x7f19d010d580 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f19c4002a80 tx=0x7f19c4004600 comp rx=0 tx=0).stop 2023-12-05T10:00:25.273 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.271+0000 7f19d6e29700 1 -- 172.21.15.100:0/2901955054 shutdown_connections 2023-12-05T10:00:25.273 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.271+0000 7f19d6e29700 1 --2- 172.21.15.100:0/2901955054 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f19c006cf80 0x7f19c006f430 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:25.273 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.271+0000 7f19d6e29700 1 --2- 172.21.15.100:0/2901955054 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19d00fcbf0 0x7f19d010d580 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:25.273 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.271+0000 7f19d6e29700 1 --2- 172.21.15.100:0/2901955054 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f19d00fde00 0x7f19d010dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:25.273 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.271+0000 7f19d6e29700 1 -- 172.21.15.100:0/2901955054 >> 172.21.15.100:0/2901955054 conn(0x7f19d00f82d0 msgr2=0x7f19d0101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:00:25.273 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.271+0000 7f19d6e29700 1 -- 172.21.15.100:0/2901955054 shutdown_connections 2023-12-05T10:00:25.273 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.271+0000 7f19d6e29700 1 -- 172.21.15.100:0/2901955054 wait complete. 2023-12-05T10:00:25.408 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.410+0000 7f6f9943f700 1 -- 172.21.15.100:0/586594165 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f940fdc00 msgr2=0x7f6f940fe050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:00:25.408 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.410+0000 7f6f9943f700 1 --2- 172.21.15.100:0/586594165 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f940fdc00 0x7f6f940fe050 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6f88004940 tx=0x7f6f88009e30 comp rx=0 tx=0).stop 2023-12-05T10:00:25.408 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.410+0000 7f6f9943f700 1 -- 172.21.15.100:0/586594165 shutdown_connections 2023-12-05T10:00:25.408 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.410+0000 7f6f9943f700 1 --2- 172.21.15.100:0/586594165 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f940fdc00 0x7f6f940fe050 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:25.408 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.410+0000 7f6f9943f700 1 --2- 172.21.15.100:0/586594165 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6f940fc9f0 0x7f6f940fce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:25.408 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.410+0000 7f6f9943f700 1 -- 172.21.15.100:0/586594165 >> 172.21.15.100:0/586594165 conn(0x7f6f940f8090 msgr2=0x7f6f940fa4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:00:25.409 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.410+0000 7f6f9943f700 1 -- 172.21.15.100:0/586594165 shutdown_connections 2023-12-05T10:00:25.409 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.410+0000 7f6f9943f700 1 -- 172.21.15.100:0/586594165 wait complete. 2023-12-05T10:00:25.415 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.411+0000 7f6f9943f700 1 Processor -- start 2023-12-05T10:00:25.415 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.411+0000 7f6f9943f700 1 -- start start 2023-12-05T10:00:25.416 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.411+0000 7f6f9943f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f940fc9f0 0x7f6f9410f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:00:25.417 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.411+0000 7f6f9943f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6f940fdc00 0x7f6f9410fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:00:25.417 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.411+0000 7f6f9943f700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f941100e0 con 0x7f6f940fc9f0 2023-12-05T10:00:25.417 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.411+0000 7f6f9943f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f94110980 con 0x7f6f940fdc00 2023-12-05T10:00:25.417 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.411+0000 7f6f93fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f940fc9f0 0x7f6f9410f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:00:25.417 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.411+0000 7f6f93fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f940fc9f0 0x7f6f9410f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52838/0 (socket says 172.21.15.100:52838) 2023-12-05T10:00:25.417 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.411+0000 7f6f93fff700 1 -- 172.21.15.100:0/666593626 learned_addr learned my addr 172.21.15.100:0/666593626 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T10:00:25.417 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.412+0000 7f6f937fe700 1 --2- 172.21.15.100:0/666593626 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6f940fdc00 0x7f6f9410fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:00:25.417 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.412+0000 7f6f93fff700 1 -- 172.21.15.100:0/666593626 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6f940fdc00 msgr2=0x7f6f9410fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:00:25.418 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.412+0000 7f6f93fff700 1 --2- 172.21.15.100:0/666593626 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6f940fdc00 0x7f6f9410fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:25.418 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.412+0000 7f6f93fff700 1 -- 172.21.15.100:0/666593626 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f88005040 con 0x7f6f940fc9f0 2023-12-05T10:00:25.418 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.412+0000 7f6f937fe700 1 --2- 172.21.15.100:0/666593626 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6f940fdc00 0x7f6f9410fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-05T10:00:25.418 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.412+0000 7f6f93fff700 1 --2- 172.21.15.100:0/666593626 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f940fc9f0 0x7f6f9410f5a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6f84002a80 tx=0x7f6f84004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:00:25.419 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.412+0000 7f6f90ff9700 1 -- 172.21.15.100:0/666593626 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f84007cc0 con 0x7f6f940fc9f0 2023-12-05T10:00:25.419 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.412+0000 7f6f90ff9700 1 -- 172.21.15.100:0/666593626 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6f8400f040 con 0x7f6f940fc9f0 2023-12-05T10:00:25.420 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.412+0000 7f6f90ff9700 1 -- 172.21.15.100:0/666593626 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f8400da20 con 0x7f6f940fc9f0 2023-12-05T10:00:25.422 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.413+0000 7f6f9943f700 1 -- 172.21.15.100:0/666593626 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f94110c60 con 0x7f6f940fc9f0 2023-12-05T10:00:25.422 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.413+0000 7f6f9943f700 1 -- 172.21.15.100:0/666593626 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f94111150 con 0x7f6f940fc9f0 2023-12-05T10:00:25.422 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.414+0000 7f6f9943f700 1 -- 172.21.15.100:0/666593626 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f94101ca0 con 0x7f6f940fc9f0 2023-12-05T10:00:25.422 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.415+0000 7f6f90ff9700 1 -- 172.21.15.100:0/666593626 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 91040+0+0 (secure 0 0 0) 0x7f6f8400db80 con 0x7f6f940fc9f0 2023-12-05T10:00:25.424 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.416+0000 7f6f90ff9700 1 --2- 172.21.15.100:0/666593626 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f6f7c06cf80 0x7f6f7c06f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:00:25.424 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.416+0000 7f6f90ff9700 1 -- 172.21.15.100:0/666593626 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f6f8408c370 con 0x7f6f940fc9f0 2023-12-05T10:00:25.424 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.416+0000 7f6f937fe700 1 --2- 172.21.15.100:0/666593626 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f6f7c06cf80 0x7f6f7c06f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:00:25.424 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.417+0000 7f6f937fe700 1 --2- 172.21.15.100:0/666593626 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f6f7c06cf80 0x7f6f7c06f430 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6f88009fd0 tx=0x7f6f88009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:00:25.424 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.420+0000 7f6f90ff9700 1 -- 172.21.15.100:0/666593626 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f6f84059a60 con 0x7f6f940fc9f0 2023-12-05T10:00:25.682 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.684+0000 7f6f9943f700 1 -- 172.21.15.100:0/666593626 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6f941113f0 con 0x7f6f940fc9f0 2023-12-05T10:00:25.682 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.684+0000 7f6f90ff9700 1 -- 172.21.15.100:0/666593626 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1852 (secure 0 0 0) 0x7f6f840595f0 con 0x7f6f940fc9f0 2023-12-05T10:00:25.683 INFO:teuthology.orchestra.run.smithi100.stdout:e13 2023-12-05T10:00:25.683 INFO:teuthology.orchestra.run.smithi100.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-05T10:00:25.683 INFO:teuthology.orchestra.run.smithi100.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T10:00:25.683 INFO:teuthology.orchestra.run.smithi100.stdout:legacy client fscid: 1 2023-12-05T10:00:25.683 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T10:00:25.683 INFO:teuthology.orchestra.run.smithi100.stdout:Filesystem 'cephfs' (1) 2023-12-05T10:00:25.683 INFO:teuthology.orchestra.run.smithi100.stdout:fs_name cephfs 2023-12-05T10:00:25.683 INFO:teuthology.orchestra.run.smithi100.stdout:epoch 13 2023-12-05T10:00:25.683 INFO:teuthology.orchestra.run.smithi100.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-05T10:00:25.683 INFO:teuthology.orchestra.run.smithi100.stdout:created 2023-12-05T09:54:30.515778+0000 2023-12-05T10:00:25.683 INFO:teuthology.orchestra.run.smithi100.stdout:modified 2023-12-05T09:54:46.403009+0000 2023-12-05T10:00:25.684 INFO:teuthology.orchestra.run.smithi100.stdout:tableserver 0 2023-12-05T10:00:25.684 INFO:teuthology.orchestra.run.smithi100.stdout:root 0 2023-12-05T10:00:25.684 INFO:teuthology.orchestra.run.smithi100.stdout:session_timeout 60 2023-12-05T10:00:25.684 INFO:teuthology.orchestra.run.smithi100.stdout:session_autoclose 300 2023-12-05T10:00:25.684 INFO:teuthology.orchestra.run.smithi100.stdout:max_file_size 1099511627776 2023-12-05T10:00:25.684 INFO:teuthology.orchestra.run.smithi100.stdout:max_xattr_size 65536 2023-12-05T10:00:25.684 INFO:teuthology.orchestra.run.smithi100.stdout:required_client_features {} 2023-12-05T10:00:25.684 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure 0 2023-12-05T10:00:25.684 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure_osd_epoch 46 2023-12-05T10:00:25.684 INFO:teuthology.orchestra.run.smithi100.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T10:00:25.684 INFO:teuthology.orchestra.run.smithi100.stdout:max_mds 1 2023-12-05T10:00:25.684 INFO:teuthology.orchestra.run.smithi100.stdout:in 0 2023-12-05T10:00:25.684 INFO:teuthology.orchestra.run.smithi100.stdout:up {0=14490} 2023-12-05T10:00:25.684 INFO:teuthology.orchestra.run.smithi100.stdout:failed 2023-12-05T10:00:25.684 INFO:teuthology.orchestra.run.smithi100.stdout:damaged 2023-12-05T10:00:25.685 INFO:teuthology.orchestra.run.smithi100.stdout:stopped 2023-12-05T10:00:25.685 INFO:teuthology.orchestra.run.smithi100.stdout:data_pools [3] 2023-12-05T10:00:25.685 INFO:teuthology.orchestra.run.smithi100.stdout:metadata_pool 2 2023-12-05T10:00:25.685 INFO:teuthology.orchestra.run.smithi100.stdout:inline_data disabled 2023-12-05T10:00:25.685 INFO:teuthology.orchestra.run.smithi100.stdout:balancer 2023-12-05T10:00:25.685 INFO:teuthology.orchestra.run.smithi100.stdout:bal_rank_mask -1 2023-12-05T10:00:25.685 INFO:teuthology.orchestra.run.smithi100.stdout:standby_count_wanted 1 2023-12-05T10:00:25.685 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi100.akmstb{0:14490} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.100:6828/627555128,v1:172.21.15.100:6829/627555128] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T10:00:25.685 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T10:00:25.685 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T10:00:25.685 INFO:teuthology.orchestra.run.smithi100.stdout:Standby daemons: 2023-12-05T10:00:25.685 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T10:00:25.685 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi150.pcbpxm{-1:14486} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.150:6824/3645854543,v1:172.21.15.150:6825/3645854543] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T10:00:25.685 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi150.fcnhsv{-1:14498} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.150:6826/3249949736,v1:172.21.15.150:6827/3249949736] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T10:00:25.685 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi100.sqplhn{-1:14506} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.100:6826/2472212864,v1:172.21.15.100:6827/2472212864] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T10:00:25.686 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.687+0000 7f6f9943f700 1 -- 172.21.15.100:0/666593626 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f6f7c06cf80 msgr2=0x7f6f7c06f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:00:25.686 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.687+0000 7f6f9943f700 1 --2- 172.21.15.100:0/666593626 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f6f7c06cf80 0x7f6f7c06f430 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6f88009fd0 tx=0x7f6f88009e30 comp rx=0 tx=0).stop 2023-12-05T10:00:25.686 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.687+0000 7f6f9943f700 1 -- 172.21.15.100:0/666593626 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f940fc9f0 msgr2=0x7f6f9410f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:00:25.687 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.687+0000 7f6f9943f700 1 --2- 172.21.15.100:0/666593626 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f940fc9f0 0x7f6f9410f5a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6f84002a80 tx=0x7f6f84004600 comp rx=0 tx=0).stop 2023-12-05T10:00:25.687 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.687+0000 7f6f9943f700 1 -- 172.21.15.100:0/666593626 shutdown_connections 2023-12-05T10:00:25.687 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.687+0000 7f6f9943f700 1 --2- 172.21.15.100:0/666593626 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f6f7c06cf80 0x7f6f7c06f430 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:25.687 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.687+0000 7f6f9943f700 1 --2- 172.21.15.100:0/666593626 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f940fc9f0 0x7f6f9410f5a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:25.687 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.687+0000 7f6f9943f700 1 --2- 172.21.15.100:0/666593626 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6f940fdc00 0x7f6f9410fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:25.687 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.687+0000 7f6f9943f700 1 -- 172.21.15.100:0/666593626 >> 172.21.15.100:0/666593626 conn(0x7f6f940f8090 msgr2=0x7f6f940fee20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:00:25.687 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.687+0000 7f6f9943f700 1 -- 172.21.15.100:0/666593626 shutdown_connections 2023-12-05T10:00:25.687 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.687+0000 7f6f9943f700 1 -- 172.21.15.100:0/666593626 wait complete. 2023-12-05T10:00:25.687 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 13 2023-12-05T10:00:25.826 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.828+0000 7f89b6650700 1 -- 172.21.15.100:0/2653057414 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89b00fcbf0 msgr2=0x7f89b00fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:00:25.826 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.828+0000 7f89b6650700 1 --2- 172.21.15.100:0/2653057414 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89b00fcbf0 0x7f89b00fd000 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f89a0004940 tx=0x7f89a0009e30 comp rx=0 tx=0).stop 2023-12-05T10:00:25.826 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.828+0000 7f89b6650700 1 -- 172.21.15.100:0/2653057414 shutdown_connections 2023-12-05T10:00:25.826 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.828+0000 7f89b6650700 1 --2- 172.21.15.100:0/2653057414 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89b00fde00 0x7f89b00fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:25.827 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.828+0000 7f89b6650700 1 --2- 172.21.15.100:0/2653057414 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89b00fcbf0 0x7f89b00fd000 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:25.827 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.828+0000 7f89b6650700 1 -- 172.21.15.100:0/2653057414 >> 172.21.15.100:0/2653057414 conn(0x7f89b00f82d0 msgr2=0x7f89b00fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:00:25.827 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.828+0000 7f89b6650700 1 -- 172.21.15.100:0/2653057414 shutdown_connections 2023-12-05T10:00:25.827 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.828+0000 7f89b6650700 1 -- 172.21.15.100:0/2653057414 wait complete. 2023-12-05T10:00:25.828 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.829+0000 7f89b6650700 1 Processor -- start 2023-12-05T10:00:25.829 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.829+0000 7f89b6650700 1 -- start start 2023-12-05T10:00:25.829 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.830+0000 7f89b6650700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89b00fcbf0 0x7f89b010d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:00:25.829 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.830+0000 7f89b6650700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89b00fde00 0x7f89b010daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:00:25.829 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.830+0000 7f89b6650700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b010e0a0 con 0x7f89b00fde00 2023-12-05T10:00:25.829 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.830+0000 7f89b6650700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b010e940 con 0x7f89b00fcbf0 2023-12-05T10:00:25.829 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.830+0000 7f89af7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89b00fde00 0x7f89b010daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:00:25.829 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.830+0000 7f89af7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89b00fde00 0x7f89b010daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52860/0 (socket says 172.21.15.100:52860) 2023-12-05T10:00:25.829 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.830+0000 7f89af7fe700 1 -- 172.21.15.100:0/1708823861 learned_addr learned my addr 172.21.15.100:0/1708823861 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T10:00:25.829 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.830+0000 7f89affff700 1 --2- 172.21.15.100:0/1708823861 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89b00fcbf0 0x7f89b010d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:00:25.829 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.830+0000 7f89af7fe700 1 -- 172.21.15.100:0/1708823861 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89b00fcbf0 msgr2=0x7f89b010d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:00:25.830 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.830+0000 7f89af7fe700 1 --2- 172.21.15.100:0/1708823861 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89b00fcbf0 0x7f89b010d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:25.830 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.830+0000 7f89af7fe700 1 -- 172.21.15.100:0/1708823861 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a0005040 con 0x7f89b00fde00 2023-12-05T10:00:25.830 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.831+0000 7f89af7fe700 1 --2- 172.21.15.100:0/1708823861 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89b00fde00 0x7f89b010daa0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f89a4002a50 tx=0x7f89a40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:00:25.831 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.831+0000 7f89acff9700 1 -- 172.21.15.100:0/1708823861 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89a4007cc0 con 0x7f89b00fde00 2023-12-05T10:00:25.831 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.831+0000 7f89acff9700 1 -- 172.21.15.100:0/1708823861 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f89a400f040 con 0x7f89b00fde00 2023-12-05T10:00:25.831 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.831+0000 7f89b6650700 1 -- 172.21.15.100:0/1708823861 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89b010ec20 con 0x7f89b00fde00 2023-12-05T10:00:25.831 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.831+0000 7f89acff9700 1 -- 172.21.15.100:0/1708823861 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89a400d9c0 con 0x7f89b00fde00 2023-12-05T10:00:25.831 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.831+0000 7f89b6650700 1 -- 172.21.15.100:0/1708823861 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89b010f160 con 0x7f89b00fde00 2023-12-05T10:00:25.833 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.832+0000 7f89b6650700 1 -- 172.21.15.100:0/1708823861 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89b004bb80 con 0x7f89b00fde00 2023-12-05T10:00:25.833 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.833+0000 7f89acff9700 1 -- 172.21.15.100:0/1708823861 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 91040+0+0 (secure 0 0 0) 0x7f89a400db20 con 0x7f89b00fde00 2023-12-05T10:00:25.833 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.834+0000 7f89acff9700 1 --2- 172.21.15.100:0/1708823861 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f899806cf80 0x7f899806f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:00:25.833 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.834+0000 7f89acff9700 1 -- 172.21.15.100:0/1708823861 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f89a408c350 con 0x7f89b00fde00 2023-12-05T10:00:25.834 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.835+0000 7f89affff700 1 --2- 172.21.15.100:0/1708823861 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f899806cf80 0x7f899806f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:00:25.834 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.835+0000 7f89affff700 1 --2- 172.21.15.100:0/1708823861 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f899806cf80 0x7f899806f430 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f89a000b7d0 tx=0x7f89a0009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:00:25.836 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:25.838+0000 7f89acff9700 1 -- 172.21.15.100:0/1708823861 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f89a40599a0 con 0x7f89b00fde00 2023-12-05T10:00:25.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:25 smithi100 ceph-mon[187528]: failed to encode map e53 with expected crc 2023-12-05T10:00:25.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:25 smithi100 ceph-mon[187528]: osdmap e53: 6 total, 5 up, 6 in 2023-12-05T10:00:25.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:25 smithi100 ceph-mon[187528]: failed to encode map e53 with expected crc 2023-12-05T10:00:25.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:25 smithi100 ceph-mon[187528]: failed to encode map e53 with expected crc 2023-12-05T10:00:25.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:25 smithi100 ceph-mon[187528]: failed to encode map e53 with expected crc 2023-12-05T10:00:25.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:25 smithi100 ceph-mon[187528]: failed to encode map e53 with expected crc 2023-12-05T10:00:25.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:25 smithi100 ceph-mon[187528]: failed to encode map e53 with expected crc 2023-12-05T10:00:25.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:25 smithi100 ceph-mon[187528]: pgmap v42: 65 pgs: 9 stale+active+clean, 56 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T10:00:25.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:25 smithi100 ceph-mon[187528]: from='client.34190 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T10:00:25.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:25 smithi100 ceph-mon[187528]: from='client.? 172.21.15.100:0/2901955054' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T10:00:26.094 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:26.095+0000 7f89b6650700 1 -- 172.21.15.100:0/1708823861 --> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f89b010f5b0 con 0x7f899806cf80 2023-12-05T10:00:26.095 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:26.097+0000 7f89acff9700 1 -- 172.21.15.100:0/1708823861 <== mgr.34104 v2:172.21.15.100:6800/3489431924 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f89b010f5b0 con 0x7f899806cf80 2023-12-05T10:00:26.095 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2023-12-05T10:00:26.095 INFO:teuthology.orchestra.run.smithi100.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ff918c95653912ae4c171d8d1db5f5eabc756f85ff7e3ce78f13f9c521198459", 2023-12-05T10:00:26.095 INFO:teuthology.orchestra.run.smithi100.stdout: "in_progress": true, 2023-12-05T10:00:26.095 INFO:teuthology.orchestra.run.smithi100.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-05T10:00:26.095 INFO:teuthology.orchestra.run.smithi100.stdout: "services_complete": [ 2023-12-05T10:00:26.095 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr", 2023-12-05T10:00:26.095 INFO:teuthology.orchestra.run.smithi100.stdout: "crash", 2023-12-05T10:00:26.095 INFO:teuthology.orchestra.run.smithi100.stdout: "mon" 2023-12-05T10:00:26.095 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2023-12-05T10:00:26.095 INFO:teuthology.orchestra.run.smithi100.stdout: "progress": "6/21 daemons upgraded", 2023-12-05T10:00:26.095 INFO:teuthology.orchestra.run.smithi100.stdout: "message": "Currently upgrading osd daemons", 2023-12-05T10:00:26.096 INFO:teuthology.orchestra.run.smithi100.stdout: "is_paused": false 2023-12-05T10:00:26.096 INFO:teuthology.orchestra.run.smithi100.stdout:} 2023-12-05T10:00:26.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:25 smithi150 ceph-mon[171606]: failed to encode map e53 with expected crc 2023-12-05T10:00:26.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:25 smithi150 ceph-mon[171606]: osdmap e53: 6 total, 5 up, 6 in 2023-12-05T10:00:26.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:25 smithi150 ceph-mon[171606]: failed to encode map e53 with expected crc 2023-12-05T10:00:26.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:25 smithi150 ceph-mon[171606]: failed to encode map e53 with expected crc 2023-12-05T10:00:26.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:25 smithi150 ceph-mon[171606]: failed to encode map e53 with expected crc 2023-12-05T10:00:26.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:25 smithi150 ceph-mon[171606]: failed to encode map e53 with expected crc 2023-12-05T10:00:26.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:25 smithi150 ceph-mon[171606]: failed to encode map e53 with expected crc 2023-12-05T10:00:26.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:25 smithi150 ceph-mon[171606]: pgmap v42: 65 pgs: 9 stale+active+clean, 56 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T10:00:26.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:25 smithi150 ceph-mon[171606]: from='client.34190 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T10:00:26.097 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:25 smithi150 ceph-mon[171606]: from='client.? 172.21.15.100:0/2901955054' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T10:00:26.097 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:26.100+0000 7f89b6650700 1 -- 172.21.15.100:0/1708823861 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f899806cf80 msgr2=0x7f899806f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:00:26.097 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:26.100+0000 7f89b6650700 1 --2- 172.21.15.100:0/1708823861 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f899806cf80 0x7f899806f430 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f89a000b7d0 tx=0x7f89a0009e30 comp rx=0 tx=0).stop 2023-12-05T10:00:26.097 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:26.100+0000 7f89b6650700 1 -- 172.21.15.100:0/1708823861 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89b00fde00 msgr2=0x7f89b010daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:00:26.097 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:26.100+0000 7f89b6650700 1 --2- 172.21.15.100:0/1708823861 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89b00fde00 0x7f89b010daa0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f89a4002a50 tx=0x7f89a40046b0 comp rx=0 tx=0).stop 2023-12-05T10:00:26.097 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:26.100+0000 7f89b6650700 1 -- 172.21.15.100:0/1708823861 shutdown_connections 2023-12-05T10:00:26.098 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:26.100+0000 7f89b6650700 1 --2- 172.21.15.100:0/1708823861 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f899806cf80 0x7f899806f430 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:26.098 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:26.100+0000 7f89b6650700 1 --2- 172.21.15.100:0/1708823861 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89b00fcbf0 0x7f89b010d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:26.098 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:26.100+0000 7f89b6650700 1 --2- 172.21.15.100:0/1708823861 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89b00fde00 0x7f89b010daa0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:26.098 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:26.100+0000 7f89b6650700 1 -- 172.21.15.100:0/1708823861 >> 172.21.15.100:0/1708823861 conn(0x7f89b00f82d0 msgr2=0x7f89b0101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:00:26.098 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:26.100+0000 7f89b6650700 1 -- 172.21.15.100:0/1708823861 shutdown_connections 2023-12-05T10:00:26.098 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:26.100+0000 7f89b6650700 1 -- 172.21.15.100:0/1708823861 wait complete. 2023-12-05T10:00:26.239 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:26.240+0000 7fd64585c700 1 -- 172.21.15.100:0/1514606413 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd640070570 msgr2=0x7fd6400709c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:00:26.239 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:26.240+0000 7fd64585c700 1 --2- 172.21.15.100:0/1514606413 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd640070570 0x7fd6400709c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd634004940 tx=0x7fd634009e30 comp rx=0 tx=0).stop 2023-12-05T10:00:26.239 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:26.240+0000 7fd64585c700 1 -- 172.21.15.100:0/1514606413 shutdown_connections 2023-12-05T10:00:26.239 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:26.240+0000 7fd64585c700 1 --2- 172.21.15.100:0/1514606413 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd640070570 0x7fd6400709c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:26.239 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:26.240+0000 7fd64585c700 1 --2- 172.21.15.100:0/1514606413 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd640071bc0 0x7fd640070030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:26.239 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:26.240+0000 7fd64585c700 1 -- 172.21.15.100:0/1514606413 >> 172.21.15.100:0/1514606413 conn(0x7fd6400f82d0 msgr2=0x7fd6400fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:00:26.239 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:26.240+0000 7fd64585c700 1 -- 172.21.15.100:0/1514606413 shutdown_connections 2023-12-05T10:00:26.239 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:26.240+0000 7fd64585c700 1 -- 172.21.15.100:0/1514606413 wait complete. 2023-12-05T10:00:26.239 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:26.241+0000 7fd64585c700 1 Processor -- start 2023-12-05T10:00:26.239 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:26.241+0000 7fd64585c700 1 -- start start 2023-12-05T10:00:26.240 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:26.241+0000 7fd64585c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd640070570 0x7fd64010f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:00:26.240 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:26.241+0000 7fd64585c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd640071bc0 0x7fd64010fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:00:26.240 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:26.241+0000 7fd64585c700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6401103d0 con 0x7fd640070570 2023-12-05T10:00:26.240 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:26.241+0000 7fd64585c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd640110c10 con 0x7fd640071bc0 2023-12-05T10:00:26.241 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:26.241+0000 7fd63effd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd640070570 0x7fd64010f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:00:26.241 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:26.242+0000 7fd63effd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd640070570 0x7fd64010f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52886/0 (socket says 172.21.15.100:52886) 2023-12-05T10:00:26.241 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:26.242+0000 7fd63effd700 1 -- 172.21.15.100:0/3350773326 learned_addr learned my addr 172.21.15.100:0/3350773326 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T10:00:26.241 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:26.242+0000 7fd63e7fc700 1 --2- 172.21.15.100:0/3350773326 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd640071bc0 0x7fd64010fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:00:26.241 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:26.242+0000 7fd63effd700 1 -- 172.21.15.100:0/3350773326 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd640071bc0 msgr2=0x7fd64010fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:00:26.241 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:26.242+0000 7fd63effd700 1 --2- 172.21.15.100:0/3350773326 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd640071bc0 0x7fd64010fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:26.241 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:26.242+0000 7fd63effd700 1 -- 172.21.15.100:0/3350773326 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd634005040 con 0x7fd640070570 2023-12-05T10:00:26.241 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:26.242+0000 7fd63effd700 1 --2- 172.21.15.100:0/3350773326 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd640070570 0x7fd64010f800 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd63000b790 tx=0x7fd630009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:00:26.242 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:26.243+0000 7fd6277fe700 1 -- 172.21.15.100:0/3350773326 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd63000f6f0 con 0x7fd640070570 2023-12-05T10:00:26.242 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:26.243+0000 7fd6277fe700 1 -- 172.21.15.100:0/3350773326 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd63000fd00 con 0x7fd640070570 2023-12-05T10:00:26.242 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:26.243+0000 7fd64585c700 1 -- 172.21.15.100:0/3350773326 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd640110ef0 con 0x7fd640070570 2023-12-05T10:00:26.242 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:26.243+0000 7fd6277fe700 1 -- 172.21.15.100:0/3350773326 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6300103a0 con 0x7fd640070570 2023-12-05T10:00:26.242 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:26.243+0000 7fd64585c700 1 -- 172.21.15.100:0/3350773326 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd640111430 con 0x7fd640070570 2023-12-05T10:00:26.242 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:26.244+0000 7fd64585c700 1 -- 172.21.15.100:0/3350773326 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd64004bb80 con 0x7fd640070570 2023-12-05T10:00:26.242 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:26.245+0000 7fd6277fe700 1 -- 172.21.15.100:0/3350773326 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 91040+0+0 (secure 0 0 0) 0x7fd63000f850 con 0x7fd640070570 2023-12-05T10:00:26.244 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:26.246+0000 7fd6277fe700 1 --2- 172.21.15.100:0/3350773326 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fd62806cf80 0x7fd62806f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:00:26.244 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:26.246+0000 7fd6277fe700 1 -- 172.21.15.100:0/3350773326 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fd63008c290 con 0x7fd640070570 2023-12-05T10:00:26.244 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:26.247+0000 7fd63e7fc700 1 --2- 172.21.15.100:0/3350773326 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fd62806cf80 0x7fd62806f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:00:26.245 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:26.247+0000 7fd63e7fc700 1 --2- 172.21.15.100:0/3350773326 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fd62806cf80 0x7fd62806f430 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd634009fd0 tx=0x7fd634009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:00:26.248 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:26.251+0000 7fd6277fe700 1 -- 172.21.15.100:0/3350773326 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fd630059af0 con 0x7fd640070570 2023-12-05T10:00:26.273 INFO:journalctl@ceph.osd.0.smithi100.stdout:Dec 05 10:00:25 smithi100 systemd[1]: ceph-5b035ce6-9353-11ee-95a2-87774f69a715@osd.0.service: Succeeded. 2023-12-05T10:00:26.273 INFO:journalctl@ceph.osd.0.smithi100.stdout:Dec 05 10:00:25 smithi100 systemd[1]: Stopped Ceph osd.0 for 5b035ce6-9353-11ee-95a2-87774f69a715. 2023-12-05T10:00:26.585 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:26.587+0000 7fd64585c700 1 -- 172.21.15.100:0/3350773326 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fd640107800 con 0x7fd640070570 2023-12-05T10:00:26.585 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:26.588+0000 7fd6277fe700 1 -- 172.21.15.100:0/3350773326 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+100 (secure 0 0 0) 0x7fd630059680 con 0x7fd640070570 2023-12-05T10:00:26.586 INFO:teuthology.orchestra.run.smithi100.stdout:HEALTH_WARN 1 osds down 2023-12-05T10:00:26.586 INFO:teuthology.orchestra.run.smithi100.stdout:[WRN] OSD_DOWN: 1 osds down 2023-12-05T10:00:26.586 INFO:teuthology.orchestra.run.smithi100.stdout: osd.0 (root=default,host=smithi100) is down 2023-12-05T10:00:26.588 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:26.590+0000 7fd64585c700 1 -- 172.21.15.100:0/3350773326 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fd62806cf80 msgr2=0x7fd62806f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:00:26.588 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:26.590+0000 7fd64585c700 1 --2- 172.21.15.100:0/3350773326 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fd62806cf80 0x7fd62806f430 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd634009fd0 tx=0x7fd634009e30 comp rx=0 tx=0).stop 2023-12-05T10:00:26.588 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:26.590+0000 7fd64585c700 1 -- 172.21.15.100:0/3350773326 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd640070570 msgr2=0x7fd64010f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:00:26.588 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:26.590+0000 7fd64585c700 1 --2- 172.21.15.100:0/3350773326 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd640070570 0x7fd64010f800 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd63000b790 tx=0x7fd630009250 comp rx=0 tx=0).stop 2023-12-05T10:00:26.588 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:26.590+0000 7fd64585c700 1 -- 172.21.15.100:0/3350773326 shutdown_connections 2023-12-05T10:00:26.588 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:26.590+0000 7fd64585c700 1 --2- 172.21.15.100:0/3350773326 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fd62806cf80 0x7fd62806f430 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:26.588 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:26.590+0000 7fd64585c700 1 --2- 172.21.15.100:0/3350773326 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd640070570 0x7fd64010f800 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:26.588 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:26.590+0000 7fd64585c700 1 --2- 172.21.15.100:0/3350773326 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd640071bc0 0x7fd64010fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:26.588 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:26.590+0000 7fd64585c700 1 -- 172.21.15.100:0/3350773326 >> 172.21.15.100:0/3350773326 conn(0x7fd6400f82d0 msgr2=0x7fd640102a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:00:26.589 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:26.590+0000 7fd64585c700 1 -- 172.21.15.100:0/3350773326 shutdown_connections 2023-12-05T10:00:26.589 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:26.590+0000 7fd64585c700 1 -- 172.21.15.100:0/3350773326 wait complete. 2023-12-05T10:00:26.632 INFO:journalctl@ceph.osd.0.smithi100.stdout:Dec 05 10:00:26 smithi100 systemd[1]: Starting Ceph osd.0 for 5b035ce6-9353-11ee-95a2-87774f69a715... 2023-12-05T10:00:26.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:26 smithi100 ceph-mon[187528]: from='client.? 172.21.15.100:0/666593626' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-05T10:00:26.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:26 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:00:26.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:26 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T10:00:26.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:26 smithi100 ceph-mon[187528]: from='client.34202 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T10:00:26.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:26 smithi100 ceph-mon[187528]: from='client.? 172.21.15.100:0/3350773326' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-05T10:00:27.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:26 smithi150 ceph-mon[171606]: from='client.? 172.21.15.100:0/666593626' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-05T10:00:27.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:26 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:00:27.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:26 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T10:00:27.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:26 smithi150 ceph-mon[171606]: from='client.34202 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T10:00:27.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:26 smithi150 ceph-mon[171606]: from='client.? 172.21.15.100:0/3350773326' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-05T10:00:27.895 INFO:journalctl@ceph.osd.0.smithi100.stdout:Dec 05 10:00:27 smithi100 bash[197413]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-05T10:00:27.895 INFO:journalctl@ceph.osd.0.smithi100.stdout:Dec 05 10:00:27 smithi100 bash[197413]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2023-12-05T10:00:27.895 INFO:journalctl@ceph.osd.0.smithi100.stdout:Dec 05 10:00:27 smithi100 bash[197413]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2023-12-05T10:00:27.896 INFO:journalctl@ceph.osd.0.smithi100.stdout:Dec 05 10:00:27 smithi100 bash[197413]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2023-12-05T10:00:27.896 INFO:journalctl@ceph.osd.0.smithi100.stdout:Dec 05 10:00:27 smithi100 bash[197413]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2023-12-05T10:00:27.896 INFO:journalctl@ceph.osd.0.smithi100.stdout:Dec 05 10:00:27 smithi100 bash[197413]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-05T10:00:27.896 INFO:journalctl@ceph.osd.0.smithi100.stdout:Dec 05 10:00:27 smithi100 bash[197413]: --> ceph-volume raw activate successful for osd ID: 0 2023-12-05T10:00:28.291 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:28 smithi100 ceph-mon[187528]: pgmap v43: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 44/216 objects degraded (20.370%) 2023-12-05T10:00:28.291 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:28 smithi100 ceph-mon[187528]: Health check failed: Degraded data redundancy: 44/216 objects degraded (20.370%), 17 pgs degraded (PG_DEGRADED) 2023-12-05T10:00:28.345 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:28 smithi150 ceph-mon[171606]: pgmap v43: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 44/216 objects degraded (20.370%) 2023-12-05T10:00:28.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:28 smithi150 ceph-mon[171606]: Health check failed: Degraded data redundancy: 44/216 objects degraded (20.370%), 17 pgs degraded (PG_DEGRADED) 2023-12-05T10:00:28.645 INFO:journalctl@ceph.osd.0.smithi100.stdout:Dec 05 10:00:28 smithi100 ceph-osd[197703]: -- 172.21.15.100:0/3507158248 <== mon.0 v2:172.21.15.100:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5624cd1491e0 con 0x5624cd118c00 2023-12-05T10:00:28.645 INFO:journalctl@ceph.osd.0.smithi100.stdout:Dec 05 10:00:28 smithi100 bash[197665]: a29add095f14ce2d05cf487647b610ad78781ee4e622ad68bb911d7e21f3fc49 2023-12-05T10:00:28.646 INFO:journalctl@ceph.osd.0.smithi100.stdout:Dec 05 10:00:28 smithi100 systemd[1]: Started Ceph osd.0 for 5b035ce6-9353-11ee-95a2-87774f69a715. 2023-12-05T10:00:29.145 INFO:journalctl@ceph.osd.0.smithi100.stdout:Dec 05 10:00:28 smithi100 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-0[197680]: 2023-12-05T10:00:28.815+0000 7f30c27fa640 -1 Falling back to public interface 2023-12-05T10:00:29.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:29 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:00:29.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:29 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:00:29.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:29 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T10:00:29.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:29 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:00:29.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:29 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:00:29.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:29 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T10:00:30.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:30 smithi100 ceph-mon[187528]: pgmap v44: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 44/216 objects degraded (20.370%) 2023-12-05T10:00:30.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:30 smithi150 ceph-mon[171606]: pgmap v44: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 44/216 objects degraded (20.370%) 2023-12-05T10:00:32.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:32 smithi100 ceph-mon[187528]: pgmap v45: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 44/216 objects degraded (20.370%) 2023-12-05T10:00:32.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:32 smithi150 ceph-mon[171606]: pgmap v45: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 44/216 objects degraded (20.370%) 2023-12-05T10:00:34.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:33 smithi150 ceph-mon[171606]: pgmap v46: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 44/216 objects degraded (20.370%) 2023-12-05T10:00:34.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:33 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:00:34.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:33 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:00:34.395 INFO:journalctl@ceph.osd.0.smithi100.stdout:Dec 05 10:00:33 smithi100 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-0[197680]: 2023-12-05T10:00:33.912+0000 7f30c27fa640 -1 osd.0 0 read_superblock omap replica is missing. 2023-12-05T10:00:34.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:33 smithi100 ceph-mon[187528]: pgmap v46: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 44/216 objects degraded (20.370%) 2023-12-05T10:00:34.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:33 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:00:34.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:33 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:00:34.895 INFO:journalctl@ceph.osd.0.smithi100.stdout:Dec 05 10:00:34 smithi100 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-0[197680]: 2023-12-05T10:00:34.521+0000 7f30c27fa640 -1 osd.0 51 log_to_monitors true 2023-12-05T10:00:35.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:35 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:00:35.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:35 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:00:35.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:35 smithi150 ceph-mon[171606]: from='osd.0 [v2:172.21.15.100:6802/4132114326,v1:172.21.15.100:6803/4132114326]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-12-05T10:00:35.645 INFO:journalctl@ceph.osd.0.smithi100.stdout:Dec 05 10:00:35 smithi100 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-0[197680]: 2023-12-05T10:00:35.344+0000 7f30b1466700 -1 osd.0 51 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-05T10:00:35.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:35 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:00:35.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:35 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:00:35.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:35 smithi100 ceph-mon[187528]: from='osd.0 [v2:172.21.15.100:6802/4132114326,v1:172.21.15.100:6803/4132114326]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-12-05T10:00:36.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:36 smithi150 ceph-mon[171606]: pgmap v47: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 44/216 objects degraded (20.370%) 2023-12-05T10:00:36.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:36 smithi150 ceph-mon[171606]: from='osd.0 [v2:172.21.15.100:6802/4132114326,v1:172.21.15.100:6803/4132114326]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-12-05T10:00:36.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:36 smithi150 ceph-mon[171606]: failed to encode map e54 with expected crc 2023-12-05T10:00:36.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:36 smithi150 ceph-mon[171606]: osdmap e54: 6 total, 5 up, 6 in 2023-12-05T10:00:36.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:36 smithi150 ceph-mon[171606]: from='osd.0 [v2:172.21.15.100:6802/4132114326,v1:172.21.15.100:6803/4132114326]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2023-12-05T10:00:36.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:36 smithi100 ceph-mon[187528]: pgmap v47: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 44/216 objects degraded (20.370%) 2023-12-05T10:00:36.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:36 smithi100 ceph-mon[187528]: from='osd.0 [v2:172.21.15.100:6802/4132114326,v1:172.21.15.100:6803/4132114326]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-12-05T10:00:36.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:36 smithi100 ceph-mon[187528]: failed to encode map e54 with expected crc 2023-12-05T10:00:36.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:36 smithi100 ceph-mon[187528]: osdmap e54: 6 total, 5 up, 6 in 2023-12-05T10:00:36.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:36 smithi100 ceph-mon[187528]: from='osd.0 [v2:172.21.15.100:6802/4132114326,v1:172.21.15.100:6803/4132114326]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2023-12-05T10:00:37.539 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:37 smithi100 ceph-mon[187528]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-05T10:00:37.539 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:37 smithi100 ceph-mon[187528]: failed to encode map e54 with expected crc 2023-12-05T10:00:37.539 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:37 smithi100 ceph-mon[187528]: osd.0 [v2:172.21.15.100:6802/4132114326,v1:172.21.15.100:6803/4132114326] boot 2023-12-05T10:00:37.539 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:37 smithi100 ceph-mon[187528]: osdmap e55: 6 total, 6 up, 6 in 2023-12-05T10:00:37.539 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:37 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-05T10:00:37.539 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:37 smithi100 ceph-mon[187528]: osdmap e56: 6 total, 6 up, 6 in 2023-12-05T10:00:37.595 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:37 smithi150 ceph-mon[171606]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-05T10:00:37.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:37 smithi150 ceph-mon[171606]: failed to encode map e54 with expected crc 2023-12-05T10:00:37.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:37 smithi150 ceph-mon[171606]: osd.0 [v2:172.21.15.100:6802/4132114326,v1:172.21.15.100:6803/4132114326] boot 2023-12-05T10:00:37.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:37 smithi150 ceph-mon[171606]: osdmap e55: 6 total, 6 up, 6 in 2023-12-05T10:00:37.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:37 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-05T10:00:37.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:37 smithi150 ceph-mon[171606]: osdmap e56: 6 total, 6 up, 6 in 2023-12-05T10:00:38.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:38 smithi150 ceph-mon[171606]: pgmap v50: 65 pgs: 25 peering, 2 active+undersized+degraded, 7 active+undersized, 31 active+clean; 195 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 6/216 objects degraded (2.778%) 2023-12-05T10:00:38.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:38 smithi150 ceph-mon[171606]: failed to encode map e56 with expected crc 2023-12-05T10:00:38.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:38 smithi150 ceph-mon[171606]: failed to encode map e56 with expected crc 2023-12-05T10:00:38.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:38 smithi150 ceph-mon[171606]: failed to encode map e56 with expected crc 2023-12-05T10:00:38.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:38 smithi150 ceph-mon[171606]: failed to encode map e56 with expected crc 2023-12-05T10:00:38.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:38 smithi150 ceph-mon[171606]: failed to encode map e56 with expected crc 2023-12-05T10:00:38.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:38 smithi150 ceph-mon[171606]: failed to encode map e56 with expected crc 2023-12-05T10:00:38.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:38 smithi150 ceph-mon[171606]: failed to encode map e56 with expected crc 2023-12-05T10:00:38.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:38 smithi150 ceph-mon[171606]: Health check update: Degraded data redundancy: 6/216 objects degraded (2.778%), 2 pgs degraded (PG_DEGRADED) 2023-12-05T10:00:38.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:38 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:00:38.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:38 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:00:38.597 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:38 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T10:00:38.597 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:38 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T10:00:38.597 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:38 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:00:38.597 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:38 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T10:00:38.597 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:38 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T10:00:38.597 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:38 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T10:00:38.597 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:38 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T10:00:38.597 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:38 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-05T10:00:38.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:38 smithi100 ceph-mon[187528]: pgmap v50: 65 pgs: 25 peering, 2 active+undersized+degraded, 7 active+undersized, 31 active+clean; 195 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 6/216 objects degraded (2.778%) 2023-12-05T10:00:38.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:38 smithi100 ceph-mon[187528]: failed to encode map e56 with expected crc 2023-12-05T10:00:38.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:38 smithi100 ceph-mon[187528]: failed to encode map e56 with expected crc 2023-12-05T10:00:38.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:38 smithi100 ceph-mon[187528]: failed to encode map e56 with expected crc 2023-12-05T10:00:38.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:38 smithi100 ceph-mon[187528]: failed to encode map e56 with expected crc 2023-12-05T10:00:38.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:38 smithi100 ceph-mon[187528]: failed to encode map e56 with expected crc 2023-12-05T10:00:38.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:38 smithi100 ceph-mon[187528]: failed to encode map e56 with expected crc 2023-12-05T10:00:38.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:38 smithi100 ceph-mon[187528]: failed to encode map e56 with expected crc 2023-12-05T10:00:38.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:38 smithi100 ceph-mon[187528]: Health check update: Degraded data redundancy: 6/216 objects degraded (2.778%), 2 pgs degraded (PG_DEGRADED) 2023-12-05T10:00:38.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:38 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:00:38.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:38 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:00:38.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:38 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T10:00:38.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:38 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T10:00:38.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:38 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:00:38.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:38 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T10:00:38.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:38 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T10:00:38.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:38 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T10:00:38.647 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:38 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T10:00:38.647 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:38 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-05T10:00:39.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:39 smithi100 ceph-mon[187528]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-05T10:00:39.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:39 smithi100 ceph-mon[187528]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2023-12-05T10:00:39.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:39 smithi150 ceph-mon[171606]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-05T10:00:39.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:39 smithi150 ceph-mon[171606]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2023-12-05T10:00:40.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:40 smithi100 ceph-mon[187528]: pgmap v52: 65 pgs: 25 peering, 2 active+undersized+degraded, 7 active+undersized, 31 active+clean; 195 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 6/216 objects degraded (2.778%) 2023-12-05T10:00:40.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:40 smithi150 ceph-mon[171606]: pgmap v52: 65 pgs: 25 peering, 2 active+undersized+degraded, 7 active+undersized, 31 active+clean; 195 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 6/216 objects degraded (2.778%) 2023-12-05T10:00:42.099 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:41 smithi150 ceph-mon[171606]: pgmap v53: 65 pgs: 25 peering, 40 active+clean; 195 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2023-12-05T10:00:42.099 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:41 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:00:42.099 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:41 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T10:00:42.099 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:41 smithi150 ceph-mon[171606]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/216 objects degraded (2.778%), 2 pgs degraded) 2023-12-05T10:00:42.099 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:41 smithi150 ceph-mon[171606]: Cluster is now healthy 2023-12-05T10:00:42.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:41 smithi100 ceph-mon[187528]: pgmap v53: 65 pgs: 25 peering, 40 active+clean; 195 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2023-12-05T10:00:42.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:41 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:00:42.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:41 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T10:00:42.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:41 smithi100 ceph-mon[187528]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/216 objects degraded (2.778%), 2 pgs degraded) 2023-12-05T10:00:42.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:41 smithi100 ceph-mon[187528]: Cluster is now healthy 2023-12-05T10:00:44.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:44 smithi150 ceph-mon[171606]: pgmap v54: 65 pgs: 65 active+clean; 195 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 419 B/s wr, 0 op/s 2023-12-05T10:00:44.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:44 smithi150 ceph-mon[171606]: mgrmap e39: smithi100.ehmuhg(active, since 92s), standbys: smithi150.zkskag 2023-12-05T10:00:44.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:44 smithi100 ceph-mon[187528]: pgmap v54: 65 pgs: 65 active+clean; 195 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 419 B/s wr, 0 op/s 2023-12-05T10:00:44.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:44 smithi100 ceph-mon[187528]: mgrmap e39: smithi100.ehmuhg(active, since 92s), standbys: smithi150.zkskag 2023-12-05T10:00:46.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:46 smithi150 ceph-mon[171606]: pgmap v55: 65 pgs: 65 active+clean; 195 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 369 B/s wr, 0 op/s 2023-12-05T10:00:46.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:46 smithi100 ceph-mon[187528]: pgmap v55: 65 pgs: 65 active+clean; 195 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 369 B/s wr, 0 op/s 2023-12-05T10:00:48.345 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:48 smithi150 ceph-mon[171606]: pgmap v56: 65 pgs: 65 active+clean; 195 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 307 B/s wr, 0 op/s 2023-12-05T10:00:48.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:48 smithi100 ceph-mon[187528]: pgmap v56: 65 pgs: 65 active+clean; 195 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 307 B/s wr, 0 op/s 2023-12-05T10:00:50.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:50 smithi150 ceph-mon[171606]: pgmap v57: 65 pgs: 65 active+clean; 195 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 271 B/s wr, 0 op/s 2023-12-05T10:00:50.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:50 smithi100 ceph-mon[187528]: pgmap v57: 65 pgs: 65 active+clean; 195 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 271 B/s wr, 0 op/s 2023-12-05T10:00:52.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:51 smithi150 ceph-mon[171606]: pgmap v58: 65 pgs: 65 active+clean; 195 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-05T10:00:52.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:51 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:00:52.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:51 smithi100 ceph-mon[187528]: pgmap v58: 65 pgs: 65 active+clean; 195 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-05T10:00:52.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:51 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:00:53.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:53 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-05T10:00:53.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:53 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-05T10:00:54.345 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:54 smithi150 ceph-mon[171606]: pgmap v59: 65 pgs: 65 active+clean; 195 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-05T10:00:54.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:54 smithi150 ceph-mon[171606]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-05T10:00:54.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:54 smithi150 ceph-mon[171606]: Upgrade: osd.1 is safe to restart 2023-12-05T10:00:54.397 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:54 smithi100 ceph-mon[187528]: pgmap v59: 65 pgs: 65 active+clean; 195 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-05T10:00:54.398 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:54 smithi100 ceph-mon[187528]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-05T10:00:54.398 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:54 smithi100 ceph-mon[187528]: Upgrade: osd.1 is safe to restart 2023-12-05T10:00:55.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:55 smithi100 ceph-mon[187528]: Upgrade: Updating osd.1 2023-12-05T10:00:55.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:55 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:00:55.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:55 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-05T10:00:55.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:55 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T10:00:55.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:55 smithi100 ceph-mon[187528]: Deploying daemon osd.1 on smithi100 2023-12-05T10:00:55.595 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:55 smithi150 ceph-mon[171606]: Upgrade: Updating osd.1 2023-12-05T10:00:55.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:55 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:00:55.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:55 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-05T10:00:55.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:55 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T10:00:55.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:55 smithi150 ceph-mon[171606]: Deploying daemon osd.1 on smithi100 2023-12-05T10:00:56.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:56 smithi100 ceph-mon[187528]: pgmap v60: 65 pgs: 65 active+clean; 195 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2023-12-05T10:00:56.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:56 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:00:56.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:56 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T10:00:56.595 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:56 smithi150 ceph-mon[171606]: pgmap v60: 65 pgs: 65 active+clean; 195 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2023-12-05T10:00:56.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:56 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:00:56.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:56 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T10:00:56.733 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:56.735+0000 7f2746ead700 1 -- 172.21.15.100:0/3458571416 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27400fcbf0 msgr2=0x7f27400fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:00:56.734 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:56.735+0000 7f2746ead700 1 --2- 172.21.15.100:0/3458571416 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27400fcbf0 0x7f27400fd000 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2734004940 tx=0x7f2734009e30 comp rx=0 tx=0).stop 2023-12-05T10:00:56.734 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:56.735+0000 7f2746ead700 1 -- 172.21.15.100:0/3458571416 shutdown_connections 2023-12-05T10:00:56.734 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:56.735+0000 7f2746ead700 1 --2- 172.21.15.100:0/3458571416 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27400fde00 0x7f27400fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:56.734 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:56.735+0000 7f2746ead700 1 --2- 172.21.15.100:0/3458571416 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27400fcbf0 0x7f27400fd000 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:56.734 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:56.735+0000 7f2746ead700 1 -- 172.21.15.100:0/3458571416 >> 172.21.15.100:0/3458571416 conn(0x7f27400f82d0 msgr2=0x7f27400fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:00:56.734 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:56.735+0000 7f2746ead700 1 -- 172.21.15.100:0/3458571416 shutdown_connections 2023-12-05T10:00:56.734 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:56.735+0000 7f2746ead700 1 -- 172.21.15.100:0/3458571416 wait complete. 2023-12-05T10:00:56.734 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:56.736+0000 7f2746ead700 1 Processor -- start 2023-12-05T10:00:56.734 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:56.736+0000 7f2746ead700 1 -- start start 2023-12-05T10:00:56.734 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:56.736+0000 7f2746ead700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27400fcbf0 0x7f274010f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:00:56.734 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:56.736+0000 7f2746ead700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27400fde00 0x7f274010fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:00:56.734 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:56.736+0000 7f2746ead700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2740110280 con 0x7f27400fde00 2023-12-05T10:00:56.735 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:56.736+0000 7f2746ead700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2740110b20 con 0x7f27400fcbf0 2023-12-05T10:00:56.736 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:56.736+0000 7f273ffff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27400fde00 0x7f274010fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:00:56.736 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:56.736+0000 7f273ffff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27400fde00 0x7f274010fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50804/0 (socket says 172.21.15.100:50804) 2023-12-05T10:00:56.736 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:56.736+0000 7f273ffff700 1 -- 172.21.15.100:0/115853374 learned_addr learned my addr 172.21.15.100:0/115853374 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T10:00:56.736 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:56.737+0000 7f2744c49700 1 --2- 172.21.15.100:0/115853374 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27400fcbf0 0x7f274010f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:00:56.736 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:56.737+0000 7f273ffff700 1 -- 172.21.15.100:0/115853374 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27400fcbf0 msgr2=0x7f274010f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:00:56.736 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:56.737+0000 7f273ffff700 1 --2- 172.21.15.100:0/115853374 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27400fcbf0 0x7f274010f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:56.736 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:56.737+0000 7f273ffff700 1 -- 172.21.15.100:0/115853374 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2734005040 con 0x7f27400fde00 2023-12-05T10:00:56.736 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:56.737+0000 7f273ffff700 1 --2- 172.21.15.100:0/115853374 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27400fde00 0x7f274010fc80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f272c002a50 tx=0x7f272c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:00:56.736 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:56.737+0000 7f273d7fa700 1 -- 172.21.15.100:0/115853374 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f272c007cc0 con 0x7f27400fde00 2023-12-05T10:00:56.736 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:56.737+0000 7f273d7fa700 1 -- 172.21.15.100:0/115853374 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f272c00f040 con 0x7f27400fde00 2023-12-05T10:00:56.736 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:56.737+0000 7f2746ead700 1 -- 172.21.15.100:0/115853374 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2740110e00 con 0x7f27400fde00 2023-12-05T10:00:56.736 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:56.737+0000 7f273d7fa700 1 -- 172.21.15.100:0/115853374 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f272c00d9c0 con 0x7f27400fde00 2023-12-05T10:00:56.736 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:56.737+0000 7f2746ead700 1 -- 172.21.15.100:0/115853374 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2740111340 con 0x7f27400fde00 2023-12-05T10:00:56.737 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:56.739+0000 7f2746ead700 1 -- 172.21.15.100:0/115853374 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2740101ea0 con 0x7f27400fde00 2023-12-05T10:00:56.737 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:56.740+0000 7f273d7fa700 1 -- 172.21.15.100:0/115853374 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f272c00db20 con 0x7f27400fde00 2023-12-05T10:00:56.738 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:56.741+0000 7f273d7fa700 1 --2- 172.21.15.100:0/115853374 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f273006ce70 0x7f273006f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:00:56.739 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:56.741+0000 7f273d7fa700 1 -- 172.21.15.100:0/115853374 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f272c08bff0 con 0x7f27400fde00 2023-12-05T10:00:56.740 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:56.741+0000 7f2744c49700 1 --2- 172.21.15.100:0/115853374 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f273006ce70 0x7f273006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:00:56.740 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:56.742+0000 7f2744c49700 1 --2- 172.21.15.100:0/115853374 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f273006ce70 0x7f273006f320 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f273400b7d0 tx=0x7f2734009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:00:56.743 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:56.746+0000 7f273d7fa700 1 -- 172.21.15.100:0/115853374 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f272c059900 con 0x7f27400fde00 2023-12-05T10:00:56.987 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:56.989+0000 7f2746ead700 1 -- 172.21.15.100:0/115853374 --> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f27401115b0 con 0x7f273006ce70 2023-12-05T10:00:56.988 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:56.991+0000 7f273d7fa700 1 -- 172.21.15.100:0/115853374 <== mgr.34104 v2:172.21.15.100:6800/3489431924 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f27401115b0 con 0x7f273006ce70 2023-12-05T10:00:56.991 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:56.993+0000 7f2746ead700 1 -- 172.21.15.100:0/115853374 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f273006ce70 msgr2=0x7f273006f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:00:56.991 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:56.993+0000 7f2746ead700 1 --2- 172.21.15.100:0/115853374 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f273006ce70 0x7f273006f320 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f273400b7d0 tx=0x7f2734009e30 comp rx=0 tx=0).stop 2023-12-05T10:00:56.991 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:56.993+0000 7f2746ead700 1 -- 172.21.15.100:0/115853374 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27400fde00 msgr2=0x7f274010fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:00:56.991 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:56.993+0000 7f2746ead700 1 --2- 172.21.15.100:0/115853374 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27400fde00 0x7f274010fc80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f272c002a50 tx=0x7f272c0046b0 comp rx=0 tx=0).stop 2023-12-05T10:00:56.991 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:56.993+0000 7f2746ead700 1 -- 172.21.15.100:0/115853374 shutdown_connections 2023-12-05T10:00:56.991 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:56.993+0000 7f2746ead700 1 --2- 172.21.15.100:0/115853374 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f273006ce70 0x7f273006f320 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:56.992 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:56.993+0000 7f2746ead700 1 --2- 172.21.15.100:0/115853374 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27400fcbf0 0x7f274010f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:56.992 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:56.993+0000 7f2746ead700 1 --2- 172.21.15.100:0/115853374 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27400fde00 0x7f274010fc80 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:56.992 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:56.993+0000 7f2746ead700 1 -- 172.21.15.100:0/115853374 >> 172.21.15.100:0/115853374 conn(0x7f27400f82d0 msgr2=0x7f27400ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:00:56.992 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:56.994+0000 7f2746ead700 1 -- 172.21.15.100:0/115853374 shutdown_connections 2023-12-05T10:00:56.992 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:56.994+0000 7f2746ead700 1 -- 172.21.15.100:0/115853374 wait complete. 2023-12-05T10:00:57.006 INFO:teuthology.orchestra.run.smithi100.stdout:true 2023-12-05T10:00:57.135 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.137+0000 7fcba896d700 1 -- 172.21.15.100:0/723023361 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcba40fde00 msgr2=0x7fcba40fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:00:57.135 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.137+0000 7fcba896d700 1 --2- 172.21.15.100:0/723023361 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcba40fde00 0x7fcba40fe250 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcb98004940 tx=0x7fcb98009e30 comp rx=0 tx=0).stop 2023-12-05T10:00:57.135 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.137+0000 7fcba896d700 1 -- 172.21.15.100:0/723023361 shutdown_connections 2023-12-05T10:00:57.135 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.137+0000 7fcba896d700 1 --2- 172.21.15.100:0/723023361 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcba40fde00 0x7fcba40fe250 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:57.136 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.137+0000 7fcba896d700 1 --2- 172.21.15.100:0/723023361 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcba40fcbf0 0x7fcba40fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:57.136 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.137+0000 7fcba896d700 1 -- 172.21.15.100:0/723023361 >> 172.21.15.100:0/723023361 conn(0x7fcba40f82d0 msgr2=0x7fcba40fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:00:57.136 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.137+0000 7fcba896d700 1 -- 172.21.15.100:0/723023361 shutdown_connections 2023-12-05T10:00:57.136 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.137+0000 7fcba896d700 1 -- 172.21.15.100:0/723023361 wait complete. 2023-12-05T10:00:57.137 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.138+0000 7fcba896d700 1 Processor -- start 2023-12-05T10:00:57.137 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.138+0000 7fcba896d700 1 -- start start 2023-12-05T10:00:57.137 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.139+0000 7fcba896d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcba40fcbf0 0x7fcba4071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:00:57.137 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.139+0000 7fcba896d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcba40fde00 0x7fcba406ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:00:57.137 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.139+0000 7fcba896d700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcba4070590 con 0x7fcba40fde00 2023-12-05T10:00:57.137 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.139+0000 7fcba896d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcba4070700 con 0x7fcba40fcbf0 2023-12-05T10:00:57.137 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.139+0000 7fcba1d9b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcba40fde00 0x7fcba406ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:00:57.137 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.139+0000 7fcba1d9b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcba40fde00 0x7fcba406ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50828/0 (socket says 172.21.15.100:50828) 2023-12-05T10:00:57.138 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.139+0000 7fcba1d9b700 1 -- 172.21.15.100:0/282888403 learned_addr learned my addr 172.21.15.100:0/282888403 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T10:00:57.138 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.139+0000 7fcba259c700 1 --2- 172.21.15.100:0/282888403 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcba40fcbf0 0x7fcba4071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:00:57.138 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.139+0000 7fcba1d9b700 1 -- 172.21.15.100:0/282888403 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcba40fcbf0 msgr2=0x7fcba4071b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:00:57.138 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.139+0000 7fcba1d9b700 1 --2- 172.21.15.100:0/282888403 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcba40fcbf0 0x7fcba4071b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:57.138 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.139+0000 7fcba1d9b700 1 -- 172.21.15.100:0/282888403 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb98005040 con 0x7fcba40fde00 2023-12-05T10:00:57.138 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.139+0000 7fcba259c700 1 --2- 172.21.15.100:0/282888403 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcba40fcbf0 0x7fcba4071b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-05T10:00:57.138 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.140+0000 7fcba1d9b700 1 --2- 172.21.15.100:0/282888403 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcba40fde00 0x7fcba406ff90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcb9800b3b0 tx=0x7fcb98009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:00:57.138 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.140+0000 7fcb92ffd700 1 -- 172.21.15.100:0/282888403 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb9800e040 con 0x7fcba40fde00 2023-12-05T10:00:57.139 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.140+0000 7fcb92ffd700 1 -- 172.21.15.100:0/282888403 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcb9800bcd0 con 0x7fcba40fde00 2023-12-05T10:00:57.139 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.140+0000 7fcba896d700 1 -- 172.21.15.100:0/282888403 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcba4070980 con 0x7fcba40fde00 2023-12-05T10:00:57.139 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.140+0000 7fcb92ffd700 1 -- 172.21.15.100:0/282888403 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb9801c630 con 0x7fcba40fde00 2023-12-05T10:00:57.139 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.140+0000 7fcba896d700 1 -- 172.21.15.100:0/282888403 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcba41155b0 con 0x7fcba40fde00 2023-12-05T10:00:57.139 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.141+0000 7fcba896d700 1 -- 172.21.15.100:0/282888403 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcba404bb80 con 0x7fcba40fde00 2023-12-05T10:00:57.139 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.142+0000 7fcb92ffd700 1 -- 172.21.15.100:0/282888403 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fcb98013420 con 0x7fcba40fde00 2023-12-05T10:00:57.141 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.143+0000 7fcb92ffd700 1 --2- 172.21.15.100:0/282888403 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fcb8c06ce70 0x7fcb8c06f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:00:57.141 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.143+0000 7fcb92ffd700 1 -- 172.21.15.100:0/282888403 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fcb9808d890 con 0x7fcba40fde00 2023-12-05T10:00:57.141 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.144+0000 7fcba259c700 1 --2- 172.21.15.100:0/282888403 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fcb8c06ce70 0x7fcb8c06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:00:57.142 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.144+0000 7fcba259c700 1 --2- 172.21.15.100:0/282888403 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fcb8c06ce70 0x7fcb8c06f320 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fcb94009fd0 tx=0x7fcb94009f00 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:00:57.145 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.148+0000 7fcb92ffd700 1 -- 172.21.15.100:0/282888403 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fcb9805b100 con 0x7fcba40fde00 2023-12-05T10:00:57.374 INFO:journalctl@ceph.osd.1.smithi100.stdout:Dec 05 10:00:57 smithi100 systemd[1]: Stopping Ceph osd.1 for 5b035ce6-9353-11ee-95a2-87774f69a715... 2023-12-05T10:00:57.384 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.387+0000 7fcba896d700 1 -- 172.21.15.100:0/282888403 --> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcba4102770 con 0x7fcb8c06ce70 2023-12-05T10:00:57.385 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.388+0000 7fcb92ffd700 1 -- 172.21.15.100:0/282888403 <== mgr.34104 v2:172.21.15.100:6800/3489431924 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fcba4102770 con 0x7fcb8c06ce70 2023-12-05T10:00:57.388 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.390+0000 7fcba896d700 1 -- 172.21.15.100:0/282888403 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fcb8c06ce70 msgr2=0x7fcb8c06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:00:57.388 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.390+0000 7fcba896d700 1 --2- 172.21.15.100:0/282888403 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fcb8c06ce70 0x7fcb8c06f320 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fcb94009fd0 tx=0x7fcb94009f00 comp rx=0 tx=0).stop 2023-12-05T10:00:57.388 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.390+0000 7fcba896d700 1 -- 172.21.15.100:0/282888403 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcba40fde00 msgr2=0x7fcba406ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:00:57.388 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.390+0000 7fcba896d700 1 --2- 172.21.15.100:0/282888403 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcba40fde00 0x7fcba406ff90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcb9800b3b0 tx=0x7fcb98009e30 comp rx=0 tx=0).stop 2023-12-05T10:00:57.388 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.390+0000 7fcba896d700 1 -- 172.21.15.100:0/282888403 shutdown_connections 2023-12-05T10:00:57.388 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.390+0000 7fcba896d700 1 --2- 172.21.15.100:0/282888403 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fcb8c06ce70 0x7fcb8c06f320 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:57.388 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.390+0000 7fcba896d700 1 --2- 172.21.15.100:0/282888403 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcba40fcbf0 0x7fcba4071b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:57.388 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.390+0000 7fcba896d700 1 --2- 172.21.15.100:0/282888403 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcba40fde00 0x7fcba406ff90 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:57.388 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.390+0000 7fcba896d700 1 -- 172.21.15.100:0/282888403 >> 172.21.15.100:0/282888403 conn(0x7fcba40f82d0 msgr2=0x7fcba4101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:00:57.389 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.390+0000 7fcba896d700 1 -- 172.21.15.100:0/282888403 shutdown_connections 2023-12-05T10:00:57.389 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.390+0000 7fcba896d700 1 -- 172.21.15.100:0/282888403 wait complete. 2023-12-05T10:00:57.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.525+0000 7fbe1bc94700 1 -- 172.21.15.100:0/3397160804 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe14071bc0 msgr2=0x7fbe14070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:00:57.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.525+0000 7fbe1bc94700 1 --2- 172.21.15.100:0/3397160804 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe14071bc0 0x7fbe14070030 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbe10004940 tx=0x7fbe10009e30 comp rx=0 tx=0).stop 2023-12-05T10:00:57.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.525+0000 7fbe1bc94700 1 -- 172.21.15.100:0/3397160804 shutdown_connections 2023-12-05T10:00:57.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.525+0000 7fbe1bc94700 1 --2- 172.21.15.100:0/3397160804 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe14070570 0x7fbe140709c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:57.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.525+0000 7fbe1bc94700 1 --2- 172.21.15.100:0/3397160804 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe14071bc0 0x7fbe14070030 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:57.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.525+0000 7fbe1bc94700 1 -- 172.21.15.100:0/3397160804 >> 172.21.15.100:0/3397160804 conn(0x7fbe140f82d0 msgr2=0x7fbe140fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:00:57.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.525+0000 7fbe1bc94700 1 -- 172.21.15.100:0/3397160804 shutdown_connections 2023-12-05T10:00:57.523 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.525+0000 7fbe1bc94700 1 -- 172.21.15.100:0/3397160804 wait complete. 2023-12-05T10:00:57.524 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.526+0000 7fbe1bc94700 1 Processor -- start 2023-12-05T10:00:57.524 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.526+0000 7fbe1bc94700 1 -- start start 2023-12-05T10:00:57.525 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.526+0000 7fbe1bc94700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe14070570 0x7fbe1410f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:00:57.525 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.526+0000 7fbe1bc94700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe14071bc0 0x7fbe1410fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:00:57.525 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.527+0000 7fbe1bc94700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe14110420 con 0x7fbe14071bc0 2023-12-05T10:00:57.525 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.527+0000 7fbe1bc94700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe14110cc0 con 0x7fbe14070570 2023-12-05T10:00:57.525 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.527+0000 7fbe1922f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe14071bc0 0x7fbe1410fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:00:57.525 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.527+0000 7fbe1922f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe14071bc0 0x7fbe1410fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50846/0 (socket says 172.21.15.100:50846) 2023-12-05T10:00:57.525 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.527+0000 7fbe1922f700 1 -- 172.21.15.100:0/3886764046 learned_addr learned my addr 172.21.15.100:0/3886764046 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T10:00:57.525 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.527+0000 7fbe19a30700 1 --2- 172.21.15.100:0/3886764046 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe14070570 0x7fbe1410f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:00:57.525 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.527+0000 7fbe1922f700 1 -- 172.21.15.100:0/3886764046 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe14070570 msgr2=0x7fbe1410f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:00:57.525 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.527+0000 7fbe1922f700 1 --2- 172.21.15.100:0/3886764046 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe14070570 0x7fbe1410f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:57.525 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.527+0000 7fbe1922f700 1 -- 172.21.15.100:0/3886764046 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe10005040 con 0x7fbe14071bc0 2023-12-05T10:00:57.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.528+0000 7fbe1922f700 1 --2- 172.21.15.100:0/3886764046 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe14071bc0 0x7fbe1410fe20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbe04002a50 tx=0x7fbe040046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:00:57.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.528+0000 7fbe0a7fc700 1 -- 172.21.15.100:0/3886764046 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe04007cc0 con 0x7fbe14071bc0 2023-12-05T10:00:57.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.528+0000 7fbe0a7fc700 1 -- 172.21.15.100:0/3886764046 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbe0400f040 con 0x7fbe14071bc0 2023-12-05T10:00:57.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.528+0000 7fbe1bc94700 1 -- 172.21.15.100:0/3886764046 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe14110fa0 con 0x7fbe14071bc0 2023-12-05T10:00:57.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.528+0000 7fbe0a7fc700 1 -- 172.21.15.100:0/3886764046 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe0400d9c0 con 0x7fbe14071bc0 2023-12-05T10:00:57.526 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.528+0000 7fbe1bc94700 1 -- 172.21.15.100:0/3886764046 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe141114e0 con 0x7fbe14071bc0 2023-12-05T10:00:57.527 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.529+0000 7fbe1bc94700 1 -- 172.21.15.100:0/3886764046 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe141096f0 con 0x7fbe14071bc0 2023-12-05T10:00:57.527 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.530+0000 7fbe0a7fc700 1 -- 172.21.15.100:0/3886764046 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fbe0400db20 con 0x7fbe14071bc0 2023-12-05T10:00:57.528 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.531+0000 7fbe0a7fc700 1 --2- 172.21.15.100:0/3886764046 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fbe0006ce70 0x7fbe0006f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:00:57.529 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.531+0000 7fbe0a7fc700 1 -- 172.21.15.100:0/3886764046 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fbe0408bff0 con 0x7fbe14071bc0 2023-12-05T10:00:57.529 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.531+0000 7fbe19a30700 1 --2- 172.21.15.100:0/3886764046 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fbe0006ce70 0x7fbe0006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:00:57.529 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.532+0000 7fbe19a30700 1 --2- 172.21.15.100:0/3886764046 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fbe0006ce70 0x7fbe0006f320 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbe10009fd0 tx=0x7fbe10009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:00:57.533 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.535+0000 7fbe0a7fc700 1 -- 172.21.15.100:0/3886764046 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fbe04059900 con 0x7fbe14071bc0 2023-12-05T10:00:57.645 INFO:journalctl@ceph.osd.1.smithi100.stdout:Dec 05 10:00:57 smithi100 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-1[139483]: 2023-12-05T10:00:57.375+0000 7f4b394e5700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-05T10:00:57.645 INFO:journalctl@ceph.osd.1.smithi100.stdout:Dec 05 10:00:57 smithi100 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-1[139483]: 2023-12-05T10:00:57.375+0000 7f4b394e5700 -1 osd.1 56 *** Got signal Terminated *** 2023-12-05T10:00:57.645 INFO:journalctl@ceph.osd.1.smithi100.stdout:Dec 05 10:00:57 smithi100 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-1[139483]: 2023-12-05T10:00:57.375+0000 7f4b394e5700 -1 osd.1 56 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-05T10:00:57.741 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.743+0000 7fbe1bc94700 1 -- 172.21.15.100:0/3886764046 --> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fbe14111750 con 0x7fbe0006ce70 2023-12-05T10:00:57.751 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.753+0000 7fbe0a7fc700 1 -- 172.21.15.100:0/3886764046 <== mgr.34104 v2:172.21.15.100:6800/3489431924 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7fbe14111750 con 0x7fbe0006ce70 2023-12-05T10:00:57.751 INFO:teuthology.orchestra.run.smithi100.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-05T10:00:57.751 INFO:teuthology.orchestra.run.smithi100.stdout:alertmanager.smithi100 smithi100 *:9093,9094 running (3m) 24s ago 11m 16.0M - 0.25.0 c8568f914cd2 f443e6a4242b 2023-12-05T10:00:57.751 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi100 smithi100 running (53s) 24s ago 11m 7856k - 19.0.0-11-g3fe8d441 56dea28e5206 fb8e6b844fba 2023-12-05T10:00:57.751 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi150 smithi150 running (49s) 46s ago 10m 7847k - 19.0.0-11-g3fe8d441 56dea28e5206 a035052de6cf 2023-12-05T10:00:57.751 INFO:teuthology.orchestra.run.smithi100.stdout:grafana.smithi100 smithi100 *:3000 running (3m) 24s ago 10m 79.9M - 9.4.7 2c41d148cca3 d666da9c4e4d 2023-12-05T10:00:57.751 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.akmstb smithi100 running (6m) 24s ago 6m 10.5G - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 6ce55c42c55b 2023-12-05T10:00:57.751 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.sqplhn smithi100 running (6m) 24s ago 6m 15.5M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc c2682d65f0c9 2023-12-05T10:00:57.751 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi150.fcnhsv smithi150 running (6m) 46s ago 6m 15.1M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 1a259762235d 2023-12-05T10:00:57.752 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi150.pcbpxm smithi150 running (6m) 46s ago 6m 15.2M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 27f730f8b9f9 2023-12-05T10:00:57.752 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi100.ehmuhg smithi100 *:8443,9283,8765 running (3m) 24s ago 12m 513M - 19.0.0-11-g3fe8d441 56dea28e5206 ebe3dfbb0356 2023-12-05T10:00:57.752 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi150.zkskag smithi150 *:8443,9283,8765 running (2m) 46s ago 10m 451M - 19.0.0-11-g3fe8d441 56dea28e5206 a2b40e2421f2 2023-12-05T10:00:57.752 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi100 smithi100 running (2m) 24s ago 12m 60.6M 2048M 19.0.0-11-g3fe8d441 56dea28e5206 21003fd7eaf4 2023-12-05T10:00:57.752 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi150 smithi150 running (86s) 46s ago 10m 35.5M 2048M 19.0.0-11-g3fe8d441 56dea28e5206 010f2f658fca 2023-12-05T10:00:57.752 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi100 smithi100 *:9100 running (3m) 24s ago 11m 8358k - 1.5.0 0da6a335fe13 a2653da0d840 2023-12-05T10:00:57.752 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi150 smithi150 *:9100 running (3m) 46s ago 10m 8170k - 1.5.0 0da6a335fe13 67523645e73b 2023-12-05T10:00:57.752 INFO:teuthology.orchestra.run.smithi100.stdout:osd.0 smithi100 running (29s) 24s ago 9m 12.5M 1618M 19.0.0-11-g3fe8d441 56dea28e5206 a29add095f14 2023-12-05T10:00:57.752 INFO:teuthology.orchestra.run.smithi100.stdout:osd.1 smithi100 running (9m) 24s ago 9m 1026M 1618M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 0500895cdfc2 2023-12-05T10:00:57.752 INFO:teuthology.orchestra.run.smithi100.stdout:osd.2 smithi100 running (8m) 24s ago 8m 815M 1618M 17.2.7-109-g1fd3ca3c e139fc5fd9fc f145372c8ccc 2023-12-05T10:00:57.752 INFO:teuthology.orchestra.run.smithi100.stdout:osd.3 smithi150 running (8m) 46s ago 8m 1168M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 78137d463d29 2023-12-05T10:00:57.752 INFO:teuthology.orchestra.run.smithi100.stdout:osd.4 smithi150 running (7m) 46s ago 7m 848M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc dfef9accd162 2023-12-05T10:00:57.752 INFO:teuthology.orchestra.run.smithi100.stdout:osd.5 smithi150 running (7m) 46s ago 7m 994M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc d9720b1eae0c 2023-12-05T10:00:57.752 INFO:teuthology.orchestra.run.smithi100.stdout:prometheus.smithi100 smithi100 *:9095 running (2m) 24s ago 10m 49.1M - 2.43.0 a07b618ecd1d 8ade75deb316 2023-12-05T10:00:57.753 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.755+0000 7fbe1bc94700 1 -- 172.21.15.100:0/3886764046 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fbe0006ce70 msgr2=0x7fbe0006f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:00:57.753 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.755+0000 7fbe1bc94700 1 --2- 172.21.15.100:0/3886764046 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fbe0006ce70 0x7fbe0006f320 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbe10009fd0 tx=0x7fbe10009e30 comp rx=0 tx=0).stop 2023-12-05T10:00:57.753 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.755+0000 7fbe1bc94700 1 -- 172.21.15.100:0/3886764046 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe14071bc0 msgr2=0x7fbe1410fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:00:57.753 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.755+0000 7fbe1bc94700 1 --2- 172.21.15.100:0/3886764046 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe14071bc0 0x7fbe1410fe20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbe04002a50 tx=0x7fbe040046b0 comp rx=0 tx=0).stop 2023-12-05T10:00:57.754 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.756+0000 7fbe1bc94700 1 -- 172.21.15.100:0/3886764046 shutdown_connections 2023-12-05T10:00:57.754 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.756+0000 7fbe1bc94700 1 --2- 172.21.15.100:0/3886764046 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fbe0006ce70 0x7fbe0006f320 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:57.754 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.756+0000 7fbe1bc94700 1 --2- 172.21.15.100:0/3886764046 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe14070570 0x7fbe1410f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:57.754 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.756+0000 7fbe1bc94700 1 --2- 172.21.15.100:0/3886764046 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe14071bc0 0x7fbe1410fe20 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:57.754 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.756+0000 7fbe1bc94700 1 -- 172.21.15.100:0/3886764046 >> 172.21.15.100:0/3886764046 conn(0x7fbe140f82d0 msgr2=0x7fbe14103310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:00:57.754 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.756+0000 7fbe1bc94700 1 -- 172.21.15.100:0/3886764046 shutdown_connections 2023-12-05T10:00:57.754 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.756+0000 7fbe1bc94700 1 -- 172.21.15.100:0/3886764046 wait complete. 2023-12-05T10:00:57.887 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.889+0000 7f1d1de93700 1 -- 172.21.15.100:0/2518691161 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d180fca50 msgr2=0x7f1d180fce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:00:57.887 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.889+0000 7f1d1de93700 1 --2- 172.21.15.100:0/2518691161 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d180fca50 0x7f1d180fce60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c004940 tx=0x7f1d0c009e30 comp rx=0 tx=0).stop 2023-12-05T10:00:57.887 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.889+0000 7f1d1de93700 1 -- 172.21.15.100:0/2518691161 shutdown_connections 2023-12-05T10:00:57.887 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.889+0000 7f1d1de93700 1 --2- 172.21.15.100:0/2518691161 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1d180fdc60 0x7f1d180fe0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:57.887 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.889+0000 7f1d1de93700 1 --2- 172.21.15.100:0/2518691161 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d180fca50 0x7f1d180fce60 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:57.887 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.889+0000 7f1d1de93700 1 -- 172.21.15.100:0/2518691161 >> 172.21.15.100:0/2518691161 conn(0x7f1d180f80f0 msgr2=0x7f1d180fa540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:00:57.887 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.889+0000 7f1d1de93700 1 -- 172.21.15.100:0/2518691161 shutdown_connections 2023-12-05T10:00:57.887 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.889+0000 7f1d1de93700 1 -- 172.21.15.100:0/2518691161 wait complete. 2023-12-05T10:00:57.888 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.890+0000 7f1d1de93700 1 Processor -- start 2023-12-05T10:00:57.889 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.890+0000 7f1d1de93700 1 -- start start 2023-12-05T10:00:57.889 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.890+0000 7f1d1de93700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1d180fca50 0x7f1d1810f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:00:57.889 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.891+0000 7f1d1de93700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d180fdc60 0x7f1d1810fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:00:57.889 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.891+0000 7f1d1de93700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d18110020 con 0x7f1d180fdc60 2023-12-05T10:00:57.889 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.891+0000 7f1d1de93700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d181108c0 con 0x7f1d180fca50 2023-12-05T10:00:57.889 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.891+0000 7f1d17fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d180fdc60 0x7f1d1810fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:00:57.889 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.891+0000 7f1d17fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d180fdc60 0x7f1d1810fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50866/0 (socket says 172.21.15.100:50866) 2023-12-05T10:00:57.889 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.891+0000 7f1d17fff700 1 -- 172.21.15.100:0/3315318985 learned_addr learned my addr 172.21.15.100:0/3315318985 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T10:00:57.889 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.891+0000 7f1d1ce91700 1 --2- 172.21.15.100:0/3315318985 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1d180fca50 0x7f1d1810f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:00:57.889 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.891+0000 7f1d17fff700 1 -- 172.21.15.100:0/3315318985 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1d180fca50 msgr2=0x7f1d1810f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:00:57.889 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.891+0000 7f1d17fff700 1 --2- 172.21.15.100:0/3315318985 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1d180fca50 0x7f1d1810f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:57.889 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.891+0000 7f1d17fff700 1 -- 172.21.15.100:0/3315318985 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d0c005040 con 0x7f1d180fdc60 2023-12-05T10:00:57.890 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.891+0000 7f1d17fff700 1 --2- 172.21.15.100:0/3315318985 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d180fdc60 0x7f1d1810fa20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1d0400eb40 tx=0x7f1d0400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:00:57.890 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.892+0000 7f1d157fa700 1 -- 172.21.15.100:0/3315318985 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d04007cc0 con 0x7f1d180fdc60 2023-12-05T10:00:57.890 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.892+0000 7f1d157fa700 1 -- 172.21.15.100:0/3315318985 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1d0400f040 con 0x7f1d180fdc60 2023-12-05T10:00:57.890 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.892+0000 7f1d1de93700 1 -- 172.21.15.100:0/3315318985 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d18110b40 con 0x7f1d180fdc60 2023-12-05T10:00:57.890 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.892+0000 7f1d157fa700 1 -- 172.21.15.100:0/3315318985 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d0400c990 con 0x7f1d180fdc60 2023-12-05T10:00:57.890 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.892+0000 7f1d1de93700 1 -- 172.21.15.100:0/3315318985 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d18111080 con 0x7f1d180fdc60 2023-12-05T10:00:57.891 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.893+0000 7f1d1de93700 1 -- 172.21.15.100:0/3315318985 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d18101d00 con 0x7f1d180fdc60 2023-12-05T10:00:57.891 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.894+0000 7f1d157fa700 1 -- 172.21.15.100:0/3315318985 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f1d0400cc00 con 0x7f1d180fdc60 2023-12-05T10:00:57.892 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.895+0000 7f1d157fa700 1 --2- 172.21.15.100:0/3315318985 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f1d0806ce70 0x7f1d0806f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:00:57.892 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.895+0000 7f1d157fa700 1 -- 172.21.15.100:0/3315318985 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f1d0408bfd0 con 0x7f1d180fdc60 2023-12-05T10:00:57.893 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.895+0000 7f1d1ce91700 1 --2- 172.21.15.100:0/3315318985 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f1d0806ce70 0x7f1d0806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:00:57.893 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.896+0000 7f1d1ce91700 1 --2- 172.21.15.100:0/3315318985 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f1d0806ce70 0x7f1d0806f320 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c013680 tx=0x7f1d0c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:00:57.896 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:57.899+0000 7f1d157fa700 1 -- 172.21.15.100:0/3315318985 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f1d040bf2f0 con 0x7f1d180fdc60 2023-12-05T10:00:58.180 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.183+0000 7f1d1de93700 1 -- 172.21.15.100:0/3315318985 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1d1804bb80 con 0x7f1d180fdc60 2023-12-05T10:00:58.181 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.183+0000 7f1d157fa700 1 -- 172.21.15.100:0/3315318985 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+827 (secure 0 0 0) 0x7f1d040598f0 con 0x7f1d180fdc60 2023-12-05T10:00:58.181 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2023-12-05T10:00:58.181 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": { 2023-12-05T10:00:58.181 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 2 2023-12-05T10:00:58.181 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-12-05T10:00:58.181 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": { 2023-12-05T10:00:58.181 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 2 2023-12-05T10:00:58.181 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-12-05T10:00:58.182 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": { 2023-12-05T10:00:58.182 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 5, 2023-12-05T10:00:58.182 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 1 2023-12-05T10:00:58.182 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-12-05T10:00:58.182 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": { 2023-12-05T10:00:58.182 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 4 2023-12-05T10:00:58.182 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-12-05T10:00:58.182 INFO:teuthology.orchestra.run.smithi100.stdout: "overall": { 2023-12-05T10:00:58.182 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 9, 2023-12-05T10:00:58.182 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 5 2023-12-05T10:00:58.182 INFO:teuthology.orchestra.run.smithi100.stdout: } 2023-12-05T10:00:58.182 INFO:teuthology.orchestra.run.smithi100.stdout:} 2023-12-05T10:00:58.183 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.186+0000 7f1d1de93700 1 -- 172.21.15.100:0/3315318985 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f1d0806ce70 msgr2=0x7f1d0806f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:00:58.184 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.186+0000 7f1d1de93700 1 --2- 172.21.15.100:0/3315318985 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f1d0806ce70 0x7f1d0806f320 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c013680 tx=0x7f1d0c009e30 comp rx=0 tx=0).stop 2023-12-05T10:00:58.184 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.186+0000 7f1d1de93700 1 -- 172.21.15.100:0/3315318985 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d180fdc60 msgr2=0x7f1d1810fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:00:58.184 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.186+0000 7f1d1de93700 1 --2- 172.21.15.100:0/3315318985 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d180fdc60 0x7f1d1810fa20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1d0400eb40 tx=0x7f1d0400b040 comp rx=0 tx=0).stop 2023-12-05T10:00:58.184 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.186+0000 7f1d1de93700 1 -- 172.21.15.100:0/3315318985 shutdown_connections 2023-12-05T10:00:58.184 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.186+0000 7f1d1de93700 1 --2- 172.21.15.100:0/3315318985 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f1d0806ce70 0x7f1d0806f320 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:58.184 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.186+0000 7f1d1de93700 1 --2- 172.21.15.100:0/3315318985 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1d180fca50 0x7f1d1810f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:58.184 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.186+0000 7f1d1de93700 1 --2- 172.21.15.100:0/3315318985 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d180fdc60 0x7f1d1810fa20 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:58.184 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.186+0000 7f1d1de93700 1 -- 172.21.15.100:0/3315318985 >> 172.21.15.100:0/3315318985 conn(0x7f1d180f80f0 msgr2=0x7f1d180fee80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:00:58.184 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.186+0000 7f1d1de93700 1 -- 172.21.15.100:0/3315318985 shutdown_connections 2023-12-05T10:00:58.184 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.186+0000 7f1d1de93700 1 -- 172.21.15.100:0/3315318985 wait complete. 2023-12-05T10:00:58.325 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.327+0000 7f45ca9bd700 1 -- 172.21.15.100:0/3718087243 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45c40fcbf0 msgr2=0x7f45c40fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:00:58.325 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.327+0000 7f45ca9bd700 1 --2- 172.21.15.100:0/3718087243 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45c40fcbf0 0x7f45c40fd000 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f45b4004940 tx=0x7f45b4009e30 comp rx=0 tx=0).stop 2023-12-05T10:00:58.326 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.327+0000 7f45ca9bd700 1 -- 172.21.15.100:0/3718087243 shutdown_connections 2023-12-05T10:00:58.326 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.327+0000 7f45ca9bd700 1 --2- 172.21.15.100:0/3718087243 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45c40fde00 0x7f45c40fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:58.326 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.327+0000 7f45ca9bd700 1 --2- 172.21.15.100:0/3718087243 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45c40fcbf0 0x7f45c40fd000 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:58.326 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.327+0000 7f45ca9bd700 1 -- 172.21.15.100:0/3718087243 >> 172.21.15.100:0/3718087243 conn(0x7f45c40f82d0 msgr2=0x7f45c40fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:00:58.326 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.328+0000 7f45ca9bd700 1 -- 172.21.15.100:0/3718087243 shutdown_connections 2023-12-05T10:00:58.326 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.328+0000 7f45ca9bd700 1 -- 172.21.15.100:0/3718087243 wait complete. 2023-12-05T10:00:58.327 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.328+0000 7f45ca9bd700 1 Processor -- start 2023-12-05T10:00:58.327 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.329+0000 7f45ca9bd700 1 -- start start 2023-12-05T10:00:58.327 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.329+0000 7f45ca9bd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45c40fcbf0 0x7f45c410f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:00:58.327 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.329+0000 7f45ca9bd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45c40fde00 0x7f45c410fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:00:58.327 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.329+0000 7f45ca9bd700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c41102a0 con 0x7f45c40fcbf0 2023-12-05T10:00:58.327 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.329+0000 7f45ca9bd700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c4110b40 con 0x7f45c40fde00 2023-12-05T10:00:58.327 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.329+0000 7f45c3fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45c40fcbf0 0x7f45c410f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:00:58.327 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.329+0000 7f45c3fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45c40fcbf0 0x7f45c410f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50876/0 (socket says 172.21.15.100:50876) 2023-12-05T10:00:58.328 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.329+0000 7f45c3fff700 1 -- 172.21.15.100:0/3636210752 learned_addr learned my addr 172.21.15.100:0/3636210752 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T10:00:58.328 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.330+0000 7f45c37fe700 1 --2- 172.21.15.100:0/3636210752 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45c40fde00 0x7f45c410fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:00:58.328 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.330+0000 7f45c3fff700 1 -- 172.21.15.100:0/3636210752 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45c40fde00 msgr2=0x7f45c410fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:00:58.328 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.330+0000 7f45c3fff700 1 --2- 172.21.15.100:0/3636210752 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45c40fde00 0x7f45c410fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:58.328 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.330+0000 7f45c3fff700 1 -- 172.21.15.100:0/3636210752 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45b4005040 con 0x7f45c40fcbf0 2023-12-05T10:00:58.328 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.330+0000 7f45c3fff700 1 --2- 172.21.15.100:0/3636210752 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45c40fcbf0 0x7f45c410f760 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f45b4009360 tx=0x7f45b4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:00:58.328 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.330+0000 7f45c0ff9700 1 -- 172.21.15.100:0/3636210752 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45b400e040 con 0x7f45c40fcbf0 2023-12-05T10:00:58.329 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.330+0000 7f45c0ff9700 1 -- 172.21.15.100:0/3636210752 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f45b4004290 con 0x7f45c40fcbf0 2023-12-05T10:00:58.329 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.330+0000 7f45ca9bd700 1 -- 172.21.15.100:0/3636210752 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45c4110dc0 con 0x7f45c40fcbf0 2023-12-05T10:00:58.329 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.330+0000 7f45c0ff9700 1 -- 172.21.15.100:0/3636210752 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45b401c630 con 0x7f45c40fcbf0 2023-12-05T10:00:58.329 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.330+0000 7f45ca9bd700 1 -- 172.21.15.100:0/3636210752 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45c4111300 con 0x7f45c40fcbf0 2023-12-05T10:00:58.329 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.331+0000 7f45ca9bd700 1 -- 172.21.15.100:0/3636210752 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45c4101ea0 con 0x7f45c40fcbf0 2023-12-05T10:00:58.330 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.332+0000 7f45c0ff9700 1 -- 172.21.15.100:0/3636210752 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f45b4013960 con 0x7f45c40fcbf0 2023-12-05T10:00:58.331 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.334+0000 7f45c0ff9700 1 --2- 172.21.15.100:0/3636210752 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f45ac06ce70 0x7f45ac06f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:00:58.331 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.334+0000 7f45c0ff9700 1 -- 172.21.15.100:0/3636210752 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f45b408d6e0 con 0x7f45c40fcbf0 2023-12-05T10:00:58.331 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.334+0000 7f45c37fe700 1 --2- 172.21.15.100:0/3636210752 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f45ac06ce70 0x7f45ac06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:00:58.332 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.334+0000 7f45c37fe700 1 --2- 172.21.15.100:0/3636210752 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f45ac06ce70 0x7f45ac06f320 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f45b8004990 tx=0x7f45b8009ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:00:58.335 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.338+0000 7f45c0ff9700 1 -- 172.21.15.100:0/3636210752 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f45b405b050 con 0x7f45c40fcbf0 2023-12-05T10:00:58.581 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.584+0000 7f45ca9bd700 1 -- 172.21.15.100:0/3636210752 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f45c4111630 con 0x7f45c40fcbf0 2023-12-05T10:00:58.582 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.584+0000 7f45c0ff9700 1 -- 172.21.15.100:0/3636210752 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1852 (secure 0 0 0) 0x7f45b405abe0 con 0x7f45c40fcbf0 2023-12-05T10:00:58.582 INFO:teuthology.orchestra.run.smithi100.stdout:e13 2023-12-05T10:00:58.582 INFO:teuthology.orchestra.run.smithi100.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-05T10:00:58.582 INFO:teuthology.orchestra.run.smithi100.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T10:00:58.582 INFO:teuthology.orchestra.run.smithi100.stdout:legacy client fscid: 1 2023-12-05T10:00:58.582 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T10:00:58.582 INFO:teuthology.orchestra.run.smithi100.stdout:Filesystem 'cephfs' (1) 2023-12-05T10:00:58.582 INFO:teuthology.orchestra.run.smithi100.stdout:fs_name cephfs 2023-12-05T10:00:58.582 INFO:teuthology.orchestra.run.smithi100.stdout:epoch 13 2023-12-05T10:00:58.583 INFO:teuthology.orchestra.run.smithi100.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-05T10:00:58.583 INFO:teuthology.orchestra.run.smithi100.stdout:created 2023-12-05T09:54:30.515778+0000 2023-12-05T10:00:58.583 INFO:teuthology.orchestra.run.smithi100.stdout:modified 2023-12-05T09:54:46.403009+0000 2023-12-05T10:00:58.583 INFO:teuthology.orchestra.run.smithi100.stdout:tableserver 0 2023-12-05T10:00:58.583 INFO:teuthology.orchestra.run.smithi100.stdout:root 0 2023-12-05T10:00:58.583 INFO:teuthology.orchestra.run.smithi100.stdout:session_timeout 60 2023-12-05T10:00:58.583 INFO:teuthology.orchestra.run.smithi100.stdout:session_autoclose 300 2023-12-05T10:00:58.583 INFO:teuthology.orchestra.run.smithi100.stdout:max_file_size 1099511627776 2023-12-05T10:00:58.583 INFO:teuthology.orchestra.run.smithi100.stdout:max_xattr_size 65536 2023-12-05T10:00:58.583 INFO:teuthology.orchestra.run.smithi100.stdout:required_client_features {} 2023-12-05T10:00:58.583 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure 0 2023-12-05T10:00:58.583 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure_osd_epoch 46 2023-12-05T10:00:58.583 INFO:teuthology.orchestra.run.smithi100.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T10:00:58.583 INFO:teuthology.orchestra.run.smithi100.stdout:max_mds 1 2023-12-05T10:00:58.584 INFO:teuthology.orchestra.run.smithi100.stdout:in 0 2023-12-05T10:00:58.584 INFO:teuthology.orchestra.run.smithi100.stdout:up {0=14490} 2023-12-05T10:00:58.584 INFO:teuthology.orchestra.run.smithi100.stdout:failed 2023-12-05T10:00:58.584 INFO:teuthology.orchestra.run.smithi100.stdout:damaged 2023-12-05T10:00:58.584 INFO:teuthology.orchestra.run.smithi100.stdout:stopped 2023-12-05T10:00:58.584 INFO:teuthology.orchestra.run.smithi100.stdout:data_pools [3] 2023-12-05T10:00:58.584 INFO:teuthology.orchestra.run.smithi100.stdout:metadata_pool 2 2023-12-05T10:00:58.584 INFO:teuthology.orchestra.run.smithi100.stdout:inline_data disabled 2023-12-05T10:00:58.584 INFO:teuthology.orchestra.run.smithi100.stdout:balancer 2023-12-05T10:00:58.584 INFO:teuthology.orchestra.run.smithi100.stdout:bal_rank_mask -1 2023-12-05T10:00:58.584 INFO:teuthology.orchestra.run.smithi100.stdout:standby_count_wanted 1 2023-12-05T10:00:58.584 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi100.akmstb{0:14490} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.100:6828/627555128,v1:172.21.15.100:6829/627555128] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T10:00:58.584 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T10:00:58.584 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T10:00:58.584 INFO:teuthology.orchestra.run.smithi100.stdout:Standby daemons: 2023-12-05T10:00:58.585 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T10:00:58.585 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi150.pcbpxm{-1:14486} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.150:6824/3645854543,v1:172.21.15.150:6825/3645854543] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T10:00:58.585 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi150.fcnhsv{-1:14498} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.150:6826/3249949736,v1:172.21.15.150:6827/3249949736] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T10:00:58.585 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi100.sqplhn{-1:14506} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.100:6826/2472212864,v1:172.21.15.100:6827/2472212864] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T10:00:58.585 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.586+0000 7f45ca9bd700 1 -- 172.21.15.100:0/3636210752 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f45ac06ce70 msgr2=0x7f45ac06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:00:58.586 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.586+0000 7f45ca9bd700 1 --2- 172.21.15.100:0/3636210752 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f45ac06ce70 0x7f45ac06f320 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f45b8004990 tx=0x7f45b8009ee0 comp rx=0 tx=0).stop 2023-12-05T10:00:58.586 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.586+0000 7f45ca9bd700 1 -- 172.21.15.100:0/3636210752 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45c40fcbf0 msgr2=0x7f45c410f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:00:58.586 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.586+0000 7f45ca9bd700 1 --2- 172.21.15.100:0/3636210752 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45c40fcbf0 0x7f45c410f760 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f45b4009360 tx=0x7f45b4009e30 comp rx=0 tx=0).stop 2023-12-05T10:00:58.586 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.586+0000 7f45ca9bd700 1 -- 172.21.15.100:0/3636210752 shutdown_connections 2023-12-05T10:00:58.586 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.586+0000 7f45ca9bd700 1 --2- 172.21.15.100:0/3636210752 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f45ac06ce70 0x7f45ac06f320 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:58.586 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.586+0000 7f45ca9bd700 1 --2- 172.21.15.100:0/3636210752 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45c40fcbf0 0x7f45c410f760 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:58.586 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.586+0000 7f45ca9bd700 1 --2- 172.21.15.100:0/3636210752 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45c40fde00 0x7f45c410fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:58.586 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.586+0000 7f45ca9bd700 1 -- 172.21.15.100:0/3636210752 >> 172.21.15.100:0/3636210752 conn(0x7f45c40f82d0 msgr2=0x7f45c40ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:00:58.586 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.587+0000 7f45ca9bd700 1 -- 172.21.15.100:0/3636210752 shutdown_connections 2023-12-05T10:00:58.586 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.587+0000 7f45ca9bd700 1 -- 172.21.15.100:0/3636210752 wait complete. 2023-12-05T10:00:58.586 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 13 2023-12-05T10:00:58.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:58 smithi150 ceph-mon[171606]: pgmap v61: 65 pgs: 65 active+clean; 195 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2023-12-05T10:00:58.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:58 smithi150 ceph-mon[171606]: from='client.34214 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T10:00:58.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:58 smithi150 ceph-mon[171606]: osd.1 marked itself down and dead 2023-12-05T10:00:58.597 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:58 smithi150 ceph-mon[171606]: from='client.34218 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T10:00:58.597 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:58 smithi150 ceph-mon[171606]: from='client.? 172.21.15.100:0/3315318985' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T10:00:58.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:58 smithi100 ceph-mon[187528]: pgmap v61: 65 pgs: 65 active+clean; 195 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2023-12-05T10:00:58.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:58 smithi100 ceph-mon[187528]: from='client.34214 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T10:00:58.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:58 smithi100 ceph-mon[187528]: osd.1 marked itself down and dead 2023-12-05T10:00:58.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:58 smithi100 ceph-mon[187528]: from='client.34218 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T10:00:58.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:58 smithi100 ceph-mon[187528]: from='client.? 172.21.15.100:0/3315318985' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T10:00:58.722 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.724+0000 7f07dc19c700 1 -- 172.21.15.100:0/2392227620 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07d4100050 msgr2=0x7f07d4102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:00:58.722 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.724+0000 7f07dc19c700 1 --2- 172.21.15.100:0/2392227620 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07d4100050 0x7f07d4102430 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f07c4004940 tx=0x7f07c4009e30 comp rx=0 tx=0).stop 2023-12-05T10:00:58.723 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.724+0000 7f07dc19c700 1 -- 172.21.15.100:0/2392227620 shutdown_connections 2023-12-05T10:00:58.723 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.724+0000 7f07dc19c700 1 --2- 172.21.15.100:0/2392227620 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07d4100050 0x7f07d4102430 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:58.723 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.724+0000 7f07dc19c700 1 --2- 172.21.15.100:0/2392227620 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f07d40fd730 0x7f07d40ffb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:58.723 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.724+0000 7f07dc19c700 1 -- 172.21.15.100:0/2392227620 >> 172.21.15.100:0/2392227620 conn(0x7f07d40f71d0 msgr2=0x7f07d40f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:00:58.723 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.725+0000 7f07dc19c700 1 -- 172.21.15.100:0/2392227620 shutdown_connections 2023-12-05T10:00:58.723 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.725+0000 7f07dc19c700 1 -- 172.21.15.100:0/2392227620 wait complete. 2023-12-05T10:00:58.724 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.726+0000 7f07dc19c700 1 Processor -- start 2023-12-05T10:00:58.724 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.726+0000 7f07dc19c700 1 -- start start 2023-12-05T10:00:58.725 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.726+0000 7f07dc19c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f07d40fd730 0x7f07d40fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:00:58.725 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.726+0000 7f07dc19c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07d4100050 0x7f07d40fb640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:00:58.725 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.726+0000 7f07dc19c700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07d40fbc40 con 0x7f07d4100050 2023-12-05T10:00:58.725 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.726+0000 7f07dc19c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07d40fbdb0 con 0x7f07d40fd730 2023-12-05T10:00:58.725 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.727+0000 7f07d9737700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07d4100050 0x7f07d40fb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:00:58.725 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.727+0000 7f07d9737700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07d4100050 0x7f07d40fb640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50884/0 (socket says 172.21.15.100:50884) 2023-12-05T10:00:58.725 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.727+0000 7f07d9737700 1 -- 172.21.15.100:0/2710766396 learned_addr learned my addr 172.21.15.100:0/2710766396 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T10:00:58.725 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.727+0000 7f07d9f38700 1 --2- 172.21.15.100:0/2710766396 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f07d40fd730 0x7f07d40fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:00:58.725 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.727+0000 7f07d9737700 1 -- 172.21.15.100:0/2710766396 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f07d40fd730 msgr2=0x7f07d40fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:00:58.725 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.727+0000 7f07d9737700 1 --2- 172.21.15.100:0/2710766396 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f07d40fd730 0x7f07d40fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:58.725 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.727+0000 7f07d9737700 1 -- 172.21.15.100:0/2710766396 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07c4005040 con 0x7f07d4100050 2023-12-05T10:00:58.725 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.727+0000 7f07d9737700 1 --2- 172.21.15.100:0/2710766396 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07d4100050 0x7f07d40fb640 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f07c400b3b0 tx=0x7f07c4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:00:58.726 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.727+0000 7f07ca7fc700 1 -- 172.21.15.100:0/2710766396 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07c400e040 con 0x7f07d4100050 2023-12-05T10:00:58.726 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.727+0000 7f07ca7fc700 1 -- 172.21.15.100:0/2710766396 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f07c400bc50 con 0x7f07d4100050 2023-12-05T10:00:58.726 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.727+0000 7f07ca7fc700 1 -- 172.21.15.100:0/2710766396 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07c401c630 con 0x7f07d4100050 2023-12-05T10:00:58.726 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.727+0000 7f07dc19c700 1 -- 172.21.15.100:0/2710766396 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07d40fc030 con 0x7f07d4100050 2023-12-05T10:00:58.726 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.728+0000 7f07dc19c700 1 -- 172.21.15.100:0/2710766396 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07d4115550 con 0x7f07d4100050 2023-12-05T10:00:58.726 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.729+0000 7f07dc19c700 1 -- 172.21.15.100:0/2710766396 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07d41075c0 con 0x7f07d4100050 2023-12-05T10:00:58.728 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.730+0000 7f07ca7fc700 1 -- 172.21.15.100:0/2710766396 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f07c4013420 con 0x7f07d4100050 2023-12-05T10:00:58.728 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.731+0000 7f07ca7fc700 1 --2- 172.21.15.100:0/2710766396 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f07c006ce70 0x7f07c006f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:00:58.728 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.731+0000 7f07ca7fc700 1 -- 172.21.15.100:0/2710766396 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f07c408d750 con 0x7f07d4100050 2023-12-05T10:00:58.728 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.731+0000 7f07d9f38700 1 --2- 172.21.15.100:0/2710766396 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f07c006ce70 0x7f07c006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:00:58.729 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.731+0000 7f07d9f38700 1 --2- 172.21.15.100:0/2710766396 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f07c006ce70 0x7f07c006f320 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f07d40fcf50 tx=0x7f07d000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:00:58.732 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.735+0000 7f07ca7fc700 1 -- 172.21.15.100:0/2710766396 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f07c405b0c0 con 0x7f07d4100050 2023-12-05T10:00:58.980 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.982+0000 7f07dc19c700 1 -- 172.21.15.100:0/2710766396 --> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f07d402b1f0 con 0x7f07c006ce70 2023-12-05T10:00:58.981 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.983+0000 7f07ca7fc700 1 -- 172.21.15.100:0/2710766396 <== mgr.34104 v2:172.21.15.100:6800/3489431924 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f07d402b1f0 con 0x7f07c006ce70 2023-12-05T10:00:58.981 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2023-12-05T10:00:58.981 INFO:teuthology.orchestra.run.smithi100.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ff918c95653912ae4c171d8d1db5f5eabc756f85ff7e3ce78f13f9c521198459", 2023-12-05T10:00:58.981 INFO:teuthology.orchestra.run.smithi100.stdout: "in_progress": true, 2023-12-05T10:00:58.981 INFO:teuthology.orchestra.run.smithi100.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-05T10:00:58.981 INFO:teuthology.orchestra.run.smithi100.stdout: "services_complete": [ 2023-12-05T10:00:58.981 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr", 2023-12-05T10:00:58.981 INFO:teuthology.orchestra.run.smithi100.stdout: "crash", 2023-12-05T10:00:58.982 INFO:teuthology.orchestra.run.smithi100.stdout: "mon" 2023-12-05T10:00:58.982 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2023-12-05T10:00:58.982 INFO:teuthology.orchestra.run.smithi100.stdout: "progress": "7/21 daemons upgraded", 2023-12-05T10:00:58.982 INFO:teuthology.orchestra.run.smithi100.stdout: "message": "Currently upgrading osd daemons", 2023-12-05T10:00:58.982 INFO:teuthology.orchestra.run.smithi100.stdout: "is_paused": false 2023-12-05T10:00:58.982 INFO:teuthology.orchestra.run.smithi100.stdout:} 2023-12-05T10:00:58.983 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.986+0000 7f07dc19c700 1 -- 172.21.15.100:0/2710766396 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f07c006ce70 msgr2=0x7f07c006f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:00:58.984 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.986+0000 7f07dc19c700 1 --2- 172.21.15.100:0/2710766396 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f07c006ce70 0x7f07c006f320 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f07d40fcf50 tx=0x7f07d000b040 comp rx=0 tx=0).stop 2023-12-05T10:00:58.984 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.986+0000 7f07dc19c700 1 -- 172.21.15.100:0/2710766396 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07d4100050 msgr2=0x7f07d40fb640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:00:58.984 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.986+0000 7f07dc19c700 1 --2- 172.21.15.100:0/2710766396 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07d4100050 0x7f07d40fb640 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f07c400b3b0 tx=0x7f07c4009e30 comp rx=0 tx=0).stop 2023-12-05T10:00:58.984 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.986+0000 7f07dc19c700 1 -- 172.21.15.100:0/2710766396 shutdown_connections 2023-12-05T10:00:58.984 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.986+0000 7f07dc19c700 1 --2- 172.21.15.100:0/2710766396 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f07c006ce70 0x7f07c006f320 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:58.984 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.986+0000 7f07dc19c700 1 --2- 172.21.15.100:0/2710766396 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f07d40fd730 0x7f07d40fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:58.984 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.986+0000 7f07dc19c700 1 --2- 172.21.15.100:0/2710766396 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07d4100050 0x7f07d40fb640 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:58.984 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.986+0000 7f07dc19c700 1 -- 172.21.15.100:0/2710766396 >> 172.21.15.100:0/2710766396 conn(0x7f07d40f71d0 msgr2=0x7f07d40f95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:00:58.984 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.986+0000 7f07dc19c700 1 -- 172.21.15.100:0/2710766396 shutdown_connections 2023-12-05T10:00:58.984 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:58.986+0000 7f07dc19c700 1 -- 172.21.15.100:0/2710766396 wait complete. 2023-12-05T10:00:59.131 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:59.133+0000 7f3b3f3ce700 1 -- 172.21.15.100:0/935865833 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b38071bc0 msgr2=0x7f3b38070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:00:59.131 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:59.133+0000 7f3b3f3ce700 1 --2- 172.21.15.100:0/935865833 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b38071bc0 0x7f3b38070030 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3b34004940 tx=0x7f3b34009e30 comp rx=0 tx=0).stop 2023-12-05T10:00:59.131 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:59.133+0000 7f3b3f3ce700 1 -- 172.21.15.100:0/935865833 shutdown_connections 2023-12-05T10:00:59.131 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:59.133+0000 7f3b3f3ce700 1 --2- 172.21.15.100:0/935865833 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b38070570 0x7f3b380709c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:59.131 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:59.133+0000 7f3b3f3ce700 1 --2- 172.21.15.100:0/935865833 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b38071bc0 0x7f3b38070030 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:59.131 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:59.133+0000 7f3b3f3ce700 1 -- 172.21.15.100:0/935865833 >> 172.21.15.100:0/935865833 conn(0x7f3b380f82d0 msgr2=0x7f3b380fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:00:59.132 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:59.133+0000 7f3b3f3ce700 1 -- 172.21.15.100:0/935865833 shutdown_connections 2023-12-05T10:00:59.132 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:59.133+0000 7f3b3f3ce700 1 -- 172.21.15.100:0/935865833 wait complete. 2023-12-05T10:00:59.132 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:59.134+0000 7f3b3f3ce700 1 Processor -- start 2023-12-05T10:00:59.132 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:59.134+0000 7f3b3f3ce700 1 -- start start 2023-12-05T10:00:59.132 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:59.135+0000 7f3b3f3ce700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b38070570 0x7f3b3810f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:00:59.132 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:59.135+0000 7f3b3f3ce700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b38071bc0 0x7f3b3810fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:00:59.133 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:59.135+0000 7f3b3f3ce700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b38110420 con 0x7f3b38070570 2023-12-05T10:00:59.133 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:59.135+0000 7f3b3f3ce700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b38110cc0 con 0x7f3b38071bc0 2023-12-05T10:00:59.133 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:59.135+0000 7f3b3d16a700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b38070570 0x7f3b3810f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:00:59.133 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:59.135+0000 7f3b3d16a700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b38070570 0x7f3b3810f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50906/0 (socket says 172.21.15.100:50906) 2023-12-05T10:00:59.133 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:59.135+0000 7f3b3d16a700 1 -- 172.21.15.100:0/2379790141 learned_addr learned my addr 172.21.15.100:0/2379790141 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T10:00:59.133 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:59.135+0000 7f3b3c969700 1 --2- 172.21.15.100:0/2379790141 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b38071bc0 0x7f3b3810fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:00:59.134 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:59.136+0000 7f3b3d16a700 1 -- 172.21.15.100:0/2379790141 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b38071bc0 msgr2=0x7f3b3810fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:00:59.134 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:59.136+0000 7f3b3d16a700 1 --2- 172.21.15.100:0/2379790141 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b38071bc0 0x7f3b3810fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:59.134 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:59.136+0000 7f3b3d16a700 1 -- 172.21.15.100:0/2379790141 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b34005040 con 0x7f3b38070570 2023-12-05T10:00:59.134 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:59.136+0000 7f3b3d16a700 1 --2- 172.21.15.100:0/2379790141 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b38070570 0x7f3b3810f8e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3b3400b3b0 tx=0x7f3b34009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:00:59.134 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:59.136+0000 7f3b2dffb700 1 -- 172.21.15.100:0/2379790141 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b3400e040 con 0x7f3b38070570 2023-12-05T10:00:59.134 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:59.136+0000 7f3b2dffb700 1 -- 172.21.15.100:0/2379790141 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3b3400bbf0 con 0x7f3b38070570 2023-12-05T10:00:59.134 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:59.136+0000 7f3b3f3ce700 1 -- 172.21.15.100:0/2379790141 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b38110f40 con 0x7f3b38070570 2023-12-05T10:00:59.134 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:59.136+0000 7f3b2dffb700 1 -- 172.21.15.100:0/2379790141 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b3401c3f0 con 0x7f3b38070570 2023-12-05T10:00:59.135 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:59.136+0000 7f3b3f3ce700 1 -- 172.21.15.100:0/2379790141 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b38111480 con 0x7f3b38070570 2023-12-05T10:00:59.135 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:59.138+0000 7f3b3f3ce700 1 -- 172.21.15.100:0/2379790141 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b381096f0 con 0x7f3b38070570 2023-12-05T10:00:59.135 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:59.138+0000 7f3b2dffb700 1 -- 172.21.15.100:0/2379790141 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f3b34013420 con 0x7f3b38070570 2023-12-05T10:00:59.137 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:59.139+0000 7f3b2dffb700 1 --2- 172.21.15.100:0/2379790141 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f3b2406ce70 0x7f3b2406f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:00:59.137 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:59.139+0000 7f3b2dffb700 1 -- 172.21.15.100:0/2379790141 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f3b3408d730 con 0x7f3b38070570 2023-12-05T10:00:59.137 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:59.139+0000 7f3b3c969700 1 --2- 172.21.15.100:0/2379790141 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f3b2406ce70 0x7f3b2406f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:00:59.137 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:59.140+0000 7f3b3c969700 1 --2- 172.21.15.100:0/2379790141 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f3b2406ce70 0x7f3b2406f320 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3b28004f40 tx=0x7f3b2800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:00:59.141 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:59.144+0000 7f3b2dffb700 1 -- 172.21.15.100:0/2379790141 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f3b3405b020 con 0x7f3b38070570 2023-12-05T10:00:59.395 INFO:journalctl@ceph.osd.1.smithi100.stdout:Dec 05 10:00:59 smithi100 bash[203546]: ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-1 2023-12-05T10:00:59.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:59 smithi100 ceph-mon[187528]: from='client.34222 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T10:00:59.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:59 smithi100 ceph-mon[187528]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-05T10:00:59.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:59 smithi100 ceph-mon[187528]: osdmap e57: 6 total, 5 up, 6 in 2023-12-05T10:00:59.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:59 smithi100 ceph-mon[187528]: failed to encode map e57 with expected crc 2023-12-05T10:00:59.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:59 smithi100 ceph-mon[187528]: failed to encode map e57 with expected crc 2023-12-05T10:00:59.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:59 smithi100 ceph-mon[187528]: failed to encode map e57 with expected crc 2023-12-05T10:00:59.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:00:59 smithi100 ceph-mon[187528]: from='client.? 172.21.15.100:0/3636210752' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-05T10:00:59.473 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:59.475+0000 7f3b3f3ce700 1 -- 172.21.15.100:0/2379790141 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f3b381110d0 con 0x7f3b38070570 2023-12-05T10:00:59.473 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:59.475+0000 7f3b2dffb700 1 -- 172.21.15.100:0/2379790141 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+100 (secure 0 0 0) 0x7f3b381110d0 con 0x7f3b38070570 2023-12-05T10:00:59.473 INFO:teuthology.orchestra.run.smithi100.stdout:HEALTH_WARN 1 osds down 2023-12-05T10:00:59.473 INFO:teuthology.orchestra.run.smithi100.stdout:[WRN] OSD_DOWN: 1 osds down 2023-12-05T10:00:59.473 INFO:teuthology.orchestra.run.smithi100.stdout: osd.1 (root=default,host=smithi100) is down 2023-12-05T10:00:59.475 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:59.478+0000 7f3b3f3ce700 1 -- 172.21.15.100:0/2379790141 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f3b2406ce70 msgr2=0x7f3b2406f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:00:59.475 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:59.478+0000 7f3b3f3ce700 1 --2- 172.21.15.100:0/2379790141 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f3b2406ce70 0x7f3b2406f320 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3b28004f40 tx=0x7f3b2800b040 comp rx=0 tx=0).stop 2023-12-05T10:00:59.476 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:59.478+0000 7f3b3f3ce700 1 -- 172.21.15.100:0/2379790141 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b38070570 msgr2=0x7f3b3810f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:00:59.476 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:59.478+0000 7f3b3f3ce700 1 --2- 172.21.15.100:0/2379790141 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b38070570 0x7f3b3810f8e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3b3400b3b0 tx=0x7f3b34009e30 comp rx=0 tx=0).stop 2023-12-05T10:00:59.476 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:59.478+0000 7f3b3f3ce700 1 -- 172.21.15.100:0/2379790141 shutdown_connections 2023-12-05T10:00:59.476 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:59.478+0000 7f3b3f3ce700 1 --2- 172.21.15.100:0/2379790141 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f3b2406ce70 0x7f3b2406f320 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:59.476 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:59.478+0000 7f3b3f3ce700 1 --2- 172.21.15.100:0/2379790141 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b38070570 0x7f3b3810f8e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:59.476 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:59.478+0000 7f3b3f3ce700 1 --2- 172.21.15.100:0/2379790141 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b38071bc0 0x7f3b3810fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:00:59.476 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:59.478+0000 7f3b3f3ce700 1 -- 172.21.15.100:0/2379790141 >> 172.21.15.100:0/2379790141 conn(0x7f3b380f82d0 msgr2=0x7f3b38103310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:00:59.476 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:59.478+0000 7f3b3f3ce700 1 -- 172.21.15.100:0/2379790141 shutdown_connections 2023-12-05T10:00:59.476 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:00:59.478+0000 7f3b3f3ce700 1 -- 172.21.15.100:0/2379790141 wait complete. 2023-12-05T10:00:59.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:59 smithi150 ceph-mon[171606]: from='client.34222 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T10:00:59.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:59 smithi150 ceph-mon[171606]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-05T10:00:59.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:59 smithi150 ceph-mon[171606]: osdmap e57: 6 total, 5 up, 6 in 2023-12-05T10:00:59.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:59 smithi150 ceph-mon[171606]: failed to encode map e57 with expected crc 2023-12-05T10:00:59.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:59 smithi150 ceph-mon[171606]: failed to encode map e57 with expected crc 2023-12-05T10:00:59.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:59 smithi150 ceph-mon[171606]: failed to encode map e57 with expected crc 2023-12-05T10:00:59.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:00:59 smithi150 ceph-mon[171606]: from='client.? 172.21.15.100:0/3636210752' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-05T10:01:00.449 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:00 smithi100 ceph-mon[187528]: failed to encode map e57 with expected crc 2023-12-05T10:01:00.450 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:00 smithi100 ceph-mon[187528]: pgmap v63: 65 pgs: 12 stale+active+clean, 53 active+clean; 195 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2023-12-05T10:01:00.450 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:00 smithi100 ceph-mon[187528]: from='client.34234 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T10:01:00.450 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:00 smithi100 ceph-mon[187528]: failed to encode map e58 with expected crc 2023-12-05T10:01:00.450 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:00 smithi100 ceph-mon[187528]: osdmap e58: 6 total, 5 up, 6 in 2023-12-05T10:01:00.450 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:00 smithi100 ceph-mon[187528]: failed to encode map e58 with expected crc 2023-12-05T10:01:00.450 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:00 smithi100 ceph-mon[187528]: failed to encode map e58 with expected crc 2023-12-05T10:01:00.450 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:00 smithi100 ceph-mon[187528]: failed to encode map e58 with expected crc 2023-12-05T10:01:00.450 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:00 smithi100 ceph-mon[187528]: from='client.? 172.21.15.100:0/2379790141' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-05T10:01:00.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:00 smithi150 ceph-mon[171606]: failed to encode map e57 with expected crc 2023-12-05T10:01:00.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:00 smithi150 ceph-mon[171606]: pgmap v63: 65 pgs: 12 stale+active+clean, 53 active+clean; 195 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2023-12-05T10:01:00.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:00 smithi150 ceph-mon[171606]: from='client.34234 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T10:01:00.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:00 smithi150 ceph-mon[171606]: failed to encode map e58 with expected crc 2023-12-05T10:01:00.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:00 smithi150 ceph-mon[171606]: osdmap e58: 6 total, 5 up, 6 in 2023-12-05T10:01:00.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:00 smithi150 ceph-mon[171606]: failed to encode map e58 with expected crc 2023-12-05T10:01:00.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:00 smithi150 ceph-mon[171606]: failed to encode map e58 with expected crc 2023-12-05T10:01:00.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:00 smithi150 ceph-mon[171606]: failed to encode map e58 with expected crc 2023-12-05T10:01:00.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:00 smithi150 ceph-mon[171606]: from='client.? 172.21.15.100:0/2379790141' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-05T10:01:00.895 INFO:journalctl@ceph.osd.1.smithi100.stdout:Dec 05 10:01:00 smithi100 systemd[1]: ceph-5b035ce6-9353-11ee-95a2-87774f69a715@osd.1.service: Succeeded. 2023-12-05T10:01:00.895 INFO:journalctl@ceph.osd.1.smithi100.stdout:Dec 05 10:01:00 smithi100 systemd[1]: Stopped Ceph osd.1 for 5b035ce6-9353-11ee-95a2-87774f69a715. 2023-12-05T10:01:01.352 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:01 smithi100 ceph-mon[187528]: failed to encode map e58 with expected crc 2023-12-05T10:01:01.352 INFO:journalctl@ceph.osd.1.smithi100.stdout:Dec 05 10:01:00 smithi100 systemd[1]: Starting Ceph osd.1 for 5b035ce6-9353-11ee-95a2-87774f69a715... 2023-12-05T10:01:01.595 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:01 smithi150 ceph-mon[171606]: failed to encode map e58 with expected crc 2023-12-05T10:01:02.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:02 smithi150 ceph-mon[171606]: pgmap v65: 65 pgs: 2 active+undersized+degraded, 9 stale+active+clean, 3 active+undersized, 51 active+clean; 195 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2/216 objects degraded (0.926%) 2023-12-05T10:01:02.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:02 smithi150 ceph-mon[171606]: Health check failed: Degraded data redundancy: 2/216 objects degraded (0.926%), 2 pgs degraded (PG_DEGRADED) 2023-12-05T10:01:02.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:02 smithi100 ceph-mon[187528]: pgmap v65: 65 pgs: 2 active+undersized+degraded, 9 stale+active+clean, 3 active+undersized, 51 active+clean; 195 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2/216 objects degraded (0.926%) 2023-12-05T10:01:02.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:02 smithi100 ceph-mon[187528]: Health check failed: Degraded data redundancy: 2/216 objects degraded (0.926%), 2 pgs degraded (PG_DEGRADED) 2023-12-05T10:01:02.645 INFO:journalctl@ceph.osd.1.smithi100.stdout:Dec 05 10:01:02 smithi100 bash[203934]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-05T10:01:02.646 INFO:journalctl@ceph.osd.1.smithi100.stdout:Dec 05 10:01:02 smithi100 bash[203934]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2023-12-05T10:01:02.646 INFO:journalctl@ceph.osd.1.smithi100.stdout:Dec 05 10:01:02 smithi100 bash[203934]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2023-12-05T10:01:02.646 INFO:journalctl@ceph.osd.1.smithi100.stdout:Dec 05 10:01:02 smithi100 bash[203934]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2023-12-05T10:01:02.646 INFO:journalctl@ceph.osd.1.smithi100.stdout:Dec 05 10:01:02 smithi100 bash[203934]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2023-12-05T10:01:02.646 INFO:journalctl@ceph.osd.1.smithi100.stdout:Dec 05 10:01:02 smithi100 bash[203934]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-05T10:01:02.646 INFO:journalctl@ceph.osd.1.smithi100.stdout:Dec 05 10:01:02 smithi100 bash[203934]: --> ceph-volume raw activate successful for osd ID: 1 2023-12-05T10:01:03.395 INFO:journalctl@ceph.osd.1.smithi100.stdout:Dec 05 10:01:03 smithi100 bash[204218]: 2de00a9dc686063500a18090e624ac4d2bdd07e33571c6b758b4ae5bea1befca 2023-12-05T10:01:03.395 INFO:journalctl@ceph.osd.1.smithi100.stdout:Dec 05 10:01:03 smithi100 systemd[1]: Started Ceph osd.1 for 5b035ce6-9353-11ee-95a2-87774f69a715. 2023-12-05T10:01:03.396 INFO:journalctl@ceph.osd.1.smithi100.stdout:Dec 05 10:01:03 smithi100 ceph-osd[204255]: -- 172.21.15.100:0/3182342545 <== mon.0 v2:172.21.15.100:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55786e44f1e0 con 0x55786e41ec00 2023-12-05T10:01:03.895 INFO:journalctl@ceph.osd.1.smithi100.stdout:Dec 05 10:01:03 smithi100 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-1[204232]: 2023-12-05T10:01:03.539+0000 7f0853858640 -1 Falling back to public interface 2023-12-05T10:01:04.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:04 smithi150 ceph-mon[171606]: pgmap v66: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 195 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 32/216 objects degraded (14.815%) 2023-12-05T10:01:04.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:04 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:01:04.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:04 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:01:04.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:04 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T10:01:04.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:04 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:01:04.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:04 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:01:04.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:04 smithi100 ceph-mon[187528]: pgmap v66: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 195 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 32/216 objects degraded (14.815%) 2023-12-05T10:01:04.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:04 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:01:04.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:04 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:01:04.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:04 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T10:01:04.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:04 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:01:04.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:04 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:01:06.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:06 smithi100 ceph-mon[187528]: pgmap v67: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 195 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 32/216 objects degraded (14.815%) 2023-12-05T10:01:06.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:06 smithi150 ceph-mon[171606]: pgmap v67: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 195 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 32/216 objects degraded (14.815%) 2023-12-05T10:01:07.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:07 smithi100 ceph-mon[187528]: Health check update: Degraded data redundancy: 32/216 objects degraded (14.815%), 13 pgs degraded (PG_DEGRADED) 2023-12-05T10:01:07.595 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:07 smithi150 ceph-mon[171606]: Health check update: Degraded data redundancy: 32/216 objects degraded (14.815%), 13 pgs degraded (PG_DEGRADED) 2023-12-05T10:01:08.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:08 smithi150 ceph-mon[171606]: pgmap v68: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 195 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 32/216 objects degraded (14.815%) 2023-12-05T10:01:08.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:08 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:01:08.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:08 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:01:08.895 INFO:journalctl@ceph.osd.1.smithi100.stdout:Dec 05 10:01:08 smithi100 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-1[204232]: 2023-12-05T10:01:08.715+0000 7f0853858640 -1 osd.1 0 read_superblock omap replica is missing. 2023-12-05T10:01:08.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:08 smithi100 ceph-mon[187528]: pgmap v68: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 195 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 32/216 objects degraded (14.815%) 2023-12-05T10:01:08.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:08 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:01:08.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:08 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:01:09.683 INFO:journalctl@ceph.osd.1.smithi100.stdout:Dec 05 10:01:09 smithi100 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-1[204232]: 2023-12-05T10:01:09.415+0000 7f0853858640 -1 osd.1 56 log_to_monitors true 2023-12-05T10:01:10.139 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:09 smithi100 ceph-mon[187528]: pgmap v69: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 195 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 32/216 objects degraded (14.815%) 2023-12-05T10:01:10.140 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:09 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:01:10.140 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:09 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:01:10.140 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:09 smithi100 ceph-mon[187528]: from='osd.1 [v2:172.21.15.100:6810/726756154,v1:172.21.15.100:6811/726756154]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-05T10:01:10.140 INFO:journalctl@ceph.osd.1.smithi100.stdout:Dec 05 10:01:09 smithi100 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-1[204232]: 2023-12-05T10:01:09.936+0000 7f08424c4700 -1 osd.1 56 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-05T10:01:10.345 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:09 smithi150 ceph-mon[171606]: pgmap v69: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 195 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 32/216 objects degraded (14.815%) 2023-12-05T10:01:10.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:09 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:01:10.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:09 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:01:10.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:09 smithi150 ceph-mon[171606]: from='osd.1 [v2:172.21.15.100:6810/726756154,v1:172.21.15.100:6811/726756154]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-05T10:01:11.345 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:10 smithi150 ceph-mon[171606]: from='osd.1 [v2:172.21.15.100:6810/726756154,v1:172.21.15.100:6811/726756154]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-12-05T10:01:11.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:10 smithi150 ceph-mon[171606]: osdmap e59: 6 total, 5 up, 6 in 2023-12-05T10:01:11.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:10 smithi150 ceph-mon[171606]: from='osd.1 [v2:172.21.15.100:6810/726756154,v1:172.21.15.100:6811/726756154]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2023-12-05T10:01:11.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:10 smithi150 ceph-mon[171606]: failed to encode map e59 with expected crc 2023-12-05T10:01:11.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:10 smithi150 ceph-mon[171606]: failed to encode map e59 with expected crc 2023-12-05T10:01:11.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:10 smithi150 ceph-mon[171606]: failed to encode map e59 with expected crc 2023-12-05T10:01:11.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:10 smithi150 ceph-mon[171606]: failed to encode map e59 with expected crc 2023-12-05T10:01:11.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:10 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:01:11.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:10 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T10:01:11.397 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:10 smithi100 ceph-mon[187528]: from='osd.1 [v2:172.21.15.100:6810/726756154,v1:172.21.15.100:6811/726756154]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-12-05T10:01:11.397 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:10 smithi100 ceph-mon[187528]: osdmap e59: 6 total, 5 up, 6 in 2023-12-05T10:01:11.397 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:10 smithi100 ceph-mon[187528]: from='osd.1 [v2:172.21.15.100:6810/726756154,v1:172.21.15.100:6811/726756154]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2023-12-05T10:01:11.397 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:10 smithi100 ceph-mon[187528]: failed to encode map e59 with expected crc 2023-12-05T10:01:11.397 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:10 smithi100 ceph-mon[187528]: failed to encode map e59 with expected crc 2023-12-05T10:01:11.397 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:10 smithi100 ceph-mon[187528]: failed to encode map e59 with expected crc 2023-12-05T10:01:11.397 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:10 smithi100 ceph-mon[187528]: failed to encode map e59 with expected crc 2023-12-05T10:01:11.398 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:10 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:01:11.398 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:10 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T10:01:12.130 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:11 smithi100 ceph-mon[187528]: pgmap v71: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 195 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 32/216 objects degraded (14.815%) 2023-12-05T10:01:12.130 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:11 smithi100 ceph-mon[187528]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-05T10:01:12.130 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:11 smithi100 ceph-mon[187528]: failed to encode map e60 with expected crc 2023-12-05T10:01:12.130 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:11 smithi100 ceph-mon[187528]: osd.1 [v2:172.21.15.100:6810/726756154,v1:172.21.15.100:6811/726756154] boot 2023-12-05T10:01:12.130 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:11 smithi100 ceph-mon[187528]: osdmap e60: 6 total, 6 up, 6 in 2023-12-05T10:01:12.130 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:11 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-05T10:01:12.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:11 smithi150 ceph-mon[171606]: pgmap v71: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 195 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 32/216 objects degraded (14.815%) 2023-12-05T10:01:12.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:11 smithi150 ceph-mon[171606]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-05T10:01:12.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:11 smithi150 ceph-mon[171606]: failed to encode map e60 with expected crc 2023-12-05T10:01:12.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:11 smithi150 ceph-mon[171606]: osd.1 [v2:172.21.15.100:6810/726756154,v1:172.21.15.100:6811/726756154] boot 2023-12-05T10:01:12.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:11 smithi150 ceph-mon[171606]: osdmap e60: 6 total, 6 up, 6 in 2023-12-05T10:01:12.347 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:11 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-05T10:01:13.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:12 smithi150 ceph-mon[171606]: osdmap e61: 6 total, 6 up, 6 in 2023-12-05T10:01:13.347 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:12 smithi150 ceph-mon[171606]: failed to encode map e61 with expected crc 2023-12-05T10:01:13.347 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:12 smithi150 ceph-mon[171606]: failed to encode map e61 with expected crc 2023-12-05T10:01:13.347 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:12 smithi150 ceph-mon[171606]: failed to encode map e61 with expected crc 2023-12-05T10:01:13.347 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:12 smithi150 ceph-mon[171606]: failed to encode map e61 with expected crc 2023-12-05T10:01:13.347 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:12 smithi150 ceph-mon[171606]: failed to encode map e61 with expected crc 2023-12-05T10:01:13.347 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:12 smithi150 ceph-mon[171606]: failed to encode map e61 with expected crc 2023-12-05T10:01:13.348 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:12 smithi150 ceph-mon[171606]: failed to encode map e61 with expected crc 2023-12-05T10:01:13.348 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:12 smithi150 ceph-mon[171606]: failed to encode map e61 with expected crc 2023-12-05T10:01:13.348 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:12 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:01:13.348 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:12 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:01:13.348 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:12 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T10:01:13.348 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:12 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T10:01:13.349 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:12 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:01:13.349 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:12 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T10:01:13.349 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:12 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T10:01:13.349 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:12 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T10:01:13.349 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:12 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T10:01:13.349 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:12 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-05T10:01:13.350 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:12 smithi150 ceph-mon[171606]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-05T10:01:13.350 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:12 smithi150 ceph-mon[171606]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2023-12-05T10:01:13.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:12 smithi100 ceph-mon[187528]: osdmap e61: 6 total, 6 up, 6 in 2023-12-05T10:01:13.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:12 smithi100 ceph-mon[187528]: failed to encode map e61 with expected crc 2023-12-05T10:01:13.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:12 smithi100 ceph-mon[187528]: failed to encode map e61 with expected crc 2023-12-05T10:01:13.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:12 smithi100 ceph-mon[187528]: failed to encode map e61 with expected crc 2023-12-05T10:01:13.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:12 smithi100 ceph-mon[187528]: failed to encode map e61 with expected crc 2023-12-05T10:01:13.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:12 smithi100 ceph-mon[187528]: failed to encode map e61 with expected crc 2023-12-05T10:01:13.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:12 smithi100 ceph-mon[187528]: failed to encode map e61 with expected crc 2023-12-05T10:01:13.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:12 smithi100 ceph-mon[187528]: failed to encode map e61 with expected crc 2023-12-05T10:01:13.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:12 smithi100 ceph-mon[187528]: failed to encode map e61 with expected crc 2023-12-05T10:01:13.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:12 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:01:13.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:12 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:01:13.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:12 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T10:01:13.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:12 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T10:01:13.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:12 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:01:13.397 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:12 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T10:01:13.397 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:12 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T10:01:13.397 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:12 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T10:01:13.397 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:12 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T10:01:13.397 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:12 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-05T10:01:13.397 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:12 smithi100 ceph-mon[187528]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-05T10:01:13.397 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:12 smithi100 ceph-mon[187528]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2023-12-05T10:01:14.345 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:13 smithi150 ceph-mon[171606]: pgmap v74: 65 pgs: 20 peering, 7 active+undersized+degraded, 7 active+undersized, 31 active+clean; 195 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 16/216 objects degraded (7.407%) 2023-12-05T10:01:14.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:13 smithi150 ceph-mon[171606]: Health check update: Degraded data redundancy: 16/216 objects degraded (7.407%), 7 pgs degraded (PG_DEGRADED) 2023-12-05T10:01:14.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:13 smithi100 ceph-mon[187528]: pgmap v74: 65 pgs: 20 peering, 7 active+undersized+degraded, 7 active+undersized, 31 active+clean; 195 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 16/216 objects degraded (7.407%) 2023-12-05T10:01:14.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:13 smithi100 ceph-mon[187528]: Health check update: Degraded data redundancy: 16/216 objects degraded (7.407%), 7 pgs degraded (PG_DEGRADED) 2023-12-05T10:01:16.347 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:15 smithi150 ceph-mon[171606]: pgmap v75: 65 pgs: 20 peering, 7 active+undersized+degraded, 7 active+undersized, 31 active+clean; 195 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 16/216 objects degraded (7.407%) 2023-12-05T10:01:16.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:15 smithi100 ceph-mon[187528]: pgmap v75: 65 pgs: 20 peering, 7 active+undersized+degraded, 7 active+undersized, 31 active+clean; 195 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 16/216 objects degraded (7.407%) 2023-12-05T10:01:17.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:16 smithi150 ceph-mon[171606]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 16/216 objects degraded (7.407%), 7 pgs degraded) 2023-12-05T10:01:17.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:16 smithi150 ceph-mon[171606]: Cluster is now healthy 2023-12-05T10:01:17.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:16 smithi100 ceph-mon[187528]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 16/216 objects degraded (7.407%), 7 pgs degraded) 2023-12-05T10:01:17.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:16 smithi100 ceph-mon[187528]: Cluster is now healthy 2023-12-05T10:01:18.345 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:18 smithi150 ceph-mon[171606]: pgmap v76: 65 pgs: 65 active+clean; 195 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-05T10:01:18.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:18 smithi100 ceph-mon[187528]: pgmap v76: 65 pgs: 65 active+clean; 195 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-05T10:01:20.345 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:20 smithi150 ceph-mon[171606]: pgmap v77: 65 pgs: 65 active+clean; 195 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-05T10:01:20.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:20 smithi100 ceph-mon[187528]: pgmap v77: 65 pgs: 65 active+clean; 195 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-05T10:01:22.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:22 smithi150 ceph-mon[171606]: pgmap v78: 65 pgs: 65 active+clean; 195 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-05T10:01:22.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:22 smithi100 ceph-mon[187528]: pgmap v78: 65 pgs: 65 active+clean; 195 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-05T10:01:24.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:24 smithi150 ceph-mon[171606]: pgmap v79: 65 pgs: 65 active+clean; 195 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-05T10:01:24.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:24 smithi100 ceph-mon[187528]: pgmap v79: 65 pgs: 65 active+clean; 195 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-05T10:01:26.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:26 smithi150 ceph-mon[171606]: pgmap v80: 65 pgs: 65 active+clean; 195 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-05T10:01:26.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:26 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:01:26.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:26 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T10:01:26.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:26 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:01:26.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:26 smithi100 ceph-mon[187528]: pgmap v80: 65 pgs: 65 active+clean; 195 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-05T10:01:26.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:26 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:01:26.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:26 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T10:01:26.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:26 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:01:28.345 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:28 smithi150 ceph-mon[171606]: pgmap v81: 65 pgs: 65 active+clean; 195 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-05T10:01:28.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:28 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-05T10:01:28.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:28 smithi150 ceph-mon[171606]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-05T10:01:28.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:28 smithi150 ceph-mon[171606]: Upgrade: osd.2 is safe to restart 2023-12-05T10:01:28.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:28 smithi100 ceph-mon[187528]: pgmap v81: 65 pgs: 65 active+clean; 195 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-05T10:01:28.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:28 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-05T10:01:28.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:28 smithi100 ceph-mon[187528]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-05T10:01:28.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:28 smithi100 ceph-mon[187528]: Upgrade: osd.2 is safe to restart 2023-12-05T10:01:29.623 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:29.625+0000 7f5bf8f45700 1 -- 172.21.15.100:0/3238913427 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5bf40fde00 msgr2=0x7f5bf40fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:01:29.623 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:29.625+0000 7f5bf8f45700 1 --2- 172.21.15.100:0/3238913427 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5bf40fde00 0x7f5bf40fe250 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5be8004940 tx=0x7f5be8009e30 comp rx=0 tx=0).stop 2023-12-05T10:01:29.623 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:29.625+0000 7f5bf8f45700 1 -- 172.21.15.100:0/3238913427 shutdown_connections 2023-12-05T10:01:29.623 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:29.625+0000 7f5bf8f45700 1 --2- 172.21.15.100:0/3238913427 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5bf40fde00 0x7f5bf40fe250 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:01:29.623 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:29.625+0000 7f5bf8f45700 1 --2- 172.21.15.100:0/3238913427 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5bf40fcbf0 0x7f5bf40fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:01:29.623 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:29.625+0000 7f5bf8f45700 1 -- 172.21.15.100:0/3238913427 >> 172.21.15.100:0/3238913427 conn(0x7f5bf40f82d0 msgr2=0x7f5bf40fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:01:29.624 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:29.625+0000 7f5bf8f45700 1 -- 172.21.15.100:0/3238913427 shutdown_connections 2023-12-05T10:01:29.624 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:29.625+0000 7f5bf8f45700 1 -- 172.21.15.100:0/3238913427 wait complete. 2023-12-05T10:01:29.624 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:29.626+0000 7f5bf8f45700 1 Processor -- start 2023-12-05T10:01:29.625 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:29.626+0000 7f5bf8f45700 1 -- start start 2023-12-05T10:01:29.625 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:29.627+0000 7f5bf8f45700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5bf40fcbf0 0x7f5bf4071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:01:29.625 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:29.627+0000 7f5bf8f45700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5bf40fde00 0x7f5bf406ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:01:29.625 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:29.627+0000 7f5bf8f45700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf4070590 con 0x7f5bf40fde00 2023-12-05T10:01:29.625 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:29.627+0000 7f5bf8f45700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf4070700 con 0x7f5bf40fcbf0 2023-12-05T10:01:29.625 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:29.627+0000 7f5bf1d9b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5bf40fde00 0x7f5bf406ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:01:29.625 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:29.627+0000 7f5bf1d9b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5bf40fde00 0x7f5bf406ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43024/0 (socket says 172.21.15.100:43024) 2023-12-05T10:01:29.625 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:29.627+0000 7f5bf1d9b700 1 -- 172.21.15.100:0/30281702 learned_addr learned my addr 172.21.15.100:0/30281702 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T10:01:29.625 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:29.627+0000 7f5bf1d9b700 1 -- 172.21.15.100:0/30281702 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5bf40fcbf0 msgr2=0x7f5bf4071b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:01:29.625 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:29.627+0000 7f5bf1d9b700 1 --2- 172.21.15.100:0/30281702 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5bf40fcbf0 0x7f5bf4071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:01:29.625 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:29.627+0000 7f5bf1d9b700 1 -- 172.21.15.100:0/30281702 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5be8005040 con 0x7f5bf40fde00 2023-12-05T10:01:29.626 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:29.627+0000 7f5bf1d9b700 1 --2- 172.21.15.100:0/30281702 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5bf40fde00 0x7f5bf406ff90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5be800b3b0 tx=0x7f5be8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:01:29.626 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:29.628+0000 7f5be2ffd700 1 -- 172.21.15.100:0/30281702 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5be800e040 con 0x7f5bf40fde00 2023-12-05T10:01:29.626 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:29.628+0000 7f5be2ffd700 1 -- 172.21.15.100:0/30281702 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5be800bcd0 con 0x7f5bf40fde00 2023-12-05T10:01:29.626 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:29.628+0000 7f5be2ffd700 1 -- 172.21.15.100:0/30281702 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5be801c630 con 0x7f5bf40fde00 2023-12-05T10:01:29.626 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:29.628+0000 7f5bf8f45700 1 -- 172.21.15.100:0/30281702 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bf4070980 con 0x7f5bf40fde00 2023-12-05T10:01:29.626 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:29.628+0000 7f5bf8f45700 1 -- 172.21.15.100:0/30281702 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bf41155b0 con 0x7f5bf40fde00 2023-12-05T10:01:29.627 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:29.629+0000 7f5bf8f45700 1 -- 172.21.15.100:0/30281702 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bf404bb80 con 0x7f5bf40fde00 2023-12-05T10:01:29.627 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:29.630+0000 7f5be2ffd700 1 -- 172.21.15.100:0/30281702 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f5be8013420 con 0x7f5bf40fde00 2023-12-05T10:01:29.628 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:29.631+0000 7f5be2ffd700 1 --2- 172.21.15.100:0/30281702 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f5bdc06ce70 0x7f5bdc06f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:01:29.629 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:29.631+0000 7f5be2ffd700 1 -- 172.21.15.100:0/30281702 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f5be808d7f0 con 0x7f5bf40fde00 2023-12-05T10:01:29.629 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:29.631+0000 7f5bf259c700 1 --2- 172.21.15.100:0/30281702 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f5bdc06ce70 0x7f5bdc06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:01:29.629 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:29.632+0000 7f5bf259c700 1 --2- 172.21.15.100:0/30281702 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f5bdc06ce70 0x7f5bdc06f320 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5bf40718a0 tx=0x7f5be4009ce0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:01:29.633 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:29.636+0000 7f5be2ffd700 1 -- 172.21.15.100:0/30281702 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f5be805b190 con 0x7f5bf40fde00 2023-12-05T10:01:29.864 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:29.867+0000 7f5bf8f45700 1 -- 172.21.15.100:0/30281702 --> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5bf4115800 con 0x7f5bdc06ce70 2023-12-05T10:01:29.865 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:29.868+0000 7f5be2ffd700 1 -- 172.21.15.100:0/30281702 <== mgr.34104 v2:172.21.15.100:6800/3489431924 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f5bf4115800 con 0x7f5bdc06ce70 2023-12-05T10:01:29.868 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:29.870+0000 7f5bf8f45700 1 -- 172.21.15.100:0/30281702 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f5bdc06ce70 msgr2=0x7f5bdc06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:01:29.868 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:29.870+0000 7f5bf8f45700 1 --2- 172.21.15.100:0/30281702 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f5bdc06ce70 0x7f5bdc06f320 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5bf40718a0 tx=0x7f5be4009ce0 comp rx=0 tx=0).stop 2023-12-05T10:01:29.868 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:29.870+0000 7f5bf8f45700 1 -- 172.21.15.100:0/30281702 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5bf40fde00 msgr2=0x7f5bf406ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:01:29.868 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:29.870+0000 7f5bf8f45700 1 --2- 172.21.15.100:0/30281702 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5bf40fde00 0x7f5bf406ff90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5be800b3b0 tx=0x7f5be8009e30 comp rx=0 tx=0).stop 2023-12-05T10:01:29.868 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:29.870+0000 7f5bf8f45700 1 -- 172.21.15.100:0/30281702 shutdown_connections 2023-12-05T10:01:29.868 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:29.870+0000 7f5bf8f45700 1 --2- 172.21.15.100:0/30281702 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f5bdc06ce70 0x7f5bdc06f320 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:01:29.868 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:29.870+0000 7f5bf8f45700 1 --2- 172.21.15.100:0/30281702 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5bf40fcbf0 0x7f5bf4071b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:01:29.868 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:29.870+0000 7f5bf8f45700 1 --2- 172.21.15.100:0/30281702 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5bf40fde00 0x7f5bf406ff90 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:01:29.868 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:29.870+0000 7f5bf8f45700 1 -- 172.21.15.100:0/30281702 >> 172.21.15.100:0/30281702 conn(0x7f5bf40f82d0 msgr2=0x7f5bf4101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:01:29.869 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:29.871+0000 7f5bf8f45700 1 -- 172.21.15.100:0/30281702 shutdown_connections 2023-12-05T10:01:29.869 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:29.871+0000 7f5bf8f45700 1 -- 172.21.15.100:0/30281702 wait complete. 2023-12-05T10:01:29.883 INFO:teuthology.orchestra.run.smithi100.stdout:true 2023-12-05T10:01:30.009 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.011+0000 7f3baf17d700 1 -- 172.21.15.100:0/3765923613 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ba80fcbf0 msgr2=0x7f3ba80fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:01:30.009 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.011+0000 7f3baf17d700 1 --2- 172.21.15.100:0/3765923613 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ba80fcbf0 0x7f3ba80fd000 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c004940 tx=0x7f3b9c009e30 comp rx=0 tx=0).stop 2023-12-05T10:01:30.009 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.011+0000 7f3baf17d700 1 -- 172.21.15.100:0/3765923613 shutdown_connections 2023-12-05T10:01:30.009 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.011+0000 7f3baf17d700 1 --2- 172.21.15.100:0/3765923613 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ba80fde00 0x7f3ba80fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:01:30.009 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.011+0000 7f3baf17d700 1 --2- 172.21.15.100:0/3765923613 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ba80fcbf0 0x7f3ba80fd000 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:01:30.010 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.011+0000 7f3baf17d700 1 -- 172.21.15.100:0/3765923613 >> 172.21.15.100:0/3765923613 conn(0x7f3ba80f82d0 msgr2=0x7f3ba80fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:01:30.010 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.011+0000 7f3baf17d700 1 -- 172.21.15.100:0/3765923613 shutdown_connections 2023-12-05T10:01:30.010 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.012+0000 7f3baf17d700 1 -- 172.21.15.100:0/3765923613 wait complete. 2023-12-05T10:01:30.011 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.012+0000 7f3baf17d700 1 Processor -- start 2023-12-05T10:01:30.011 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.012+0000 7f3baf17d700 1 -- start start 2023-12-05T10:01:30.011 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.013+0000 7f3baf17d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ba80fcbf0 0x7f3ba810f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:01:30.011 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.013+0000 7f3baf17d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ba80fde00 0x7f3ba810fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:01:30.011 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.013+0000 7f3baf17d700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba81102a0 con 0x7f3ba80fde00 2023-12-05T10:01:30.011 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.013+0000 7f3baf17d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba8110b40 con 0x7f3ba80fcbf0 2023-12-05T10:01:30.011 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.013+0000 7f3ba7fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ba80fde00 0x7f3ba810fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:01:30.011 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.013+0000 7f3ba7fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ba80fde00 0x7f3ba810fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51770/0 (socket says 172.21.15.100:51770) 2023-12-05T10:01:30.011 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.013+0000 7f3ba7fff700 1 -- 172.21.15.100:0/10658759 learned_addr learned my addr 172.21.15.100:0/10658759 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T10:01:30.011 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.013+0000 7f3bacf19700 1 --2- 172.21.15.100:0/10658759 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ba80fcbf0 0x7f3ba810f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:01:30.011 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.013+0000 7f3ba7fff700 1 -- 172.21.15.100:0/10658759 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ba80fcbf0 msgr2=0x7f3ba810f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:01:30.012 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.013+0000 7f3ba7fff700 1 --2- 172.21.15.100:0/10658759 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ba80fcbf0 0x7f3ba810f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:01:30.012 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.013+0000 7f3ba7fff700 1 -- 172.21.15.100:0/10658759 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b9c005040 con 0x7f3ba80fde00 2023-12-05T10:01:30.012 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.014+0000 7f3ba7fff700 1 --2- 172.21.15.100:0/10658759 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ba80fde00 0x7f3ba810fca0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3b94002a50 tx=0x7f3b940046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:01:30.012 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.014+0000 7f3ba57fa700 1 -- 172.21.15.100:0/10658759 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b94007cc0 con 0x7f3ba80fde00 2023-12-05T10:01:30.012 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.014+0000 7f3ba57fa700 1 -- 172.21.15.100:0/10658759 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3b9400f040 con 0x7f3ba80fde00 2023-12-05T10:01:30.013 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.014+0000 7f3baf17d700 1 -- 172.21.15.100:0/10658759 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ba8110e20 con 0x7f3ba80fde00 2023-12-05T10:01:30.013 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.014+0000 7f3ba57fa700 1 -- 172.21.15.100:0/10658759 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b9400d9c0 con 0x7f3ba80fde00 2023-12-05T10:01:30.013 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.014+0000 7f3baf17d700 1 -- 172.21.15.100:0/10658759 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ba8111360 con 0x7f3ba80fde00 2023-12-05T10:01:30.013 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.015+0000 7f3baf17d700 1 -- 172.21.15.100:0/10658759 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ba8101ea0 con 0x7f3ba80fde00 2023-12-05T10:01:30.014 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.016+0000 7f3ba57fa700 1 -- 172.21.15.100:0/10658759 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f3b9400db20 con 0x7f3ba80fde00 2023-12-05T10:01:30.015 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.017+0000 7f3ba57fa700 1 --2- 172.21.15.100:0/10658759 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f3b9806ce70 0x7f3b9806f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:01:30.015 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.017+0000 7f3ba57fa700 1 -- 172.21.15.100:0/10658759 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f3b9408c100 con 0x7f3ba80fde00 2023-12-05T10:01:30.015 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.018+0000 7f3bacf19700 1 --2- 172.21.15.100:0/10658759 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f3b9806ce70 0x7f3b9806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:01:30.016 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.018+0000 7f3bacf19700 1 --2- 172.21.15.100:0/10658759 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f3b9806ce70 0x7f3b9806f320 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c00b7d0 tx=0x7f3b9c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:01:30.019 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.022+0000 7f3ba57fa700 1 -- 172.21.15.100:0/10658759 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f3b94059970 con 0x7f3ba80fde00 2023-12-05T10:01:30.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:29 smithi150 ceph-mon[171606]: pgmap v82: 65 pgs: 65 active+clean; 195 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-05T10:01:30.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:29 smithi150 ceph-mon[171606]: Upgrade: Updating osd.2 2023-12-05T10:01:30.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:29 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:01:30.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:29 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-05T10:01:30.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:29 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T10:01:30.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:29 smithi150 ceph-mon[171606]: Deploying daemon osd.2 on smithi100 2023-12-05T10:01:30.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:29 smithi100 ceph-mon[187528]: pgmap v82: 65 pgs: 65 active+clean; 195 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-05T10:01:30.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:29 smithi100 ceph-mon[187528]: Upgrade: Updating osd.2 2023-12-05T10:01:30.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:29 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:01:30.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:29 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-05T10:01:30.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:29 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T10:01:30.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:29 smithi100 ceph-mon[187528]: Deploying daemon osd.2 on smithi100 2023-12-05T10:01:30.281 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.283+0000 7f3baf17d700 1 -- 172.21.15.100:0/10658759 --> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3ba8111690 con 0x7f3b9806ce70 2023-12-05T10:01:30.281 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.284+0000 7f3ba57fa700 1 -- 172.21.15.100:0/10658759 <== mgr.34104 v2:172.21.15.100:6800/3489431924 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f3ba8111690 con 0x7f3b9806ce70 2023-12-05T10:01:30.284 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.286+0000 7f3baf17d700 1 -- 172.21.15.100:0/10658759 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f3b9806ce70 msgr2=0x7f3b9806f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:01:30.284 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.286+0000 7f3baf17d700 1 --2- 172.21.15.100:0/10658759 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f3b9806ce70 0x7f3b9806f320 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c00b7d0 tx=0x7f3b9c009e30 comp rx=0 tx=0).stop 2023-12-05T10:01:30.284 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.286+0000 7f3baf17d700 1 -- 172.21.15.100:0/10658759 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ba80fde00 msgr2=0x7f3ba810fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:01:30.284 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.286+0000 7f3baf17d700 1 --2- 172.21.15.100:0/10658759 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ba80fde00 0x7f3ba810fca0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3b94002a50 tx=0x7f3b940046b0 comp rx=0 tx=0).stop 2023-12-05T10:01:30.285 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.286+0000 7f3baf17d700 1 -- 172.21.15.100:0/10658759 shutdown_connections 2023-12-05T10:01:30.286 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.286+0000 7f3baf17d700 1 --2- 172.21.15.100:0/10658759 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f3b9806ce70 0x7f3b9806f320 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:01:30.286 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.286+0000 7f3baf17d700 1 --2- 172.21.15.100:0/10658759 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ba80fcbf0 0x7f3ba810f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:01:30.286 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.286+0000 7f3baf17d700 1 --2- 172.21.15.100:0/10658759 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ba80fde00 0x7f3ba810fca0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:01:30.286 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.286+0000 7f3baf17d700 1 -- 172.21.15.100:0/10658759 >> 172.21.15.100:0/10658759 conn(0x7f3ba80f82d0 msgr2=0x7f3ba80ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:01:30.286 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.287+0000 7f3baf17d700 1 -- 172.21.15.100:0/10658759 shutdown_connections 2023-12-05T10:01:30.286 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.287+0000 7f3baf17d700 1 -- 172.21.15.100:0/10658759 wait complete. 2023-12-05T10:01:30.428 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.429+0000 7f845d56c700 1 -- 172.21.15.100:0/813744459 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8458070510 msgr2=0x7f8458070980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:01:30.428 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.429+0000 7f845d56c700 1 --2- 172.21.15.100:0/813744459 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8458070510 0x7f8458070980 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f844c004940 tx=0x7f844c009e30 comp rx=0 tx=0).stop 2023-12-05T10:01:30.428 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.430+0000 7f845d56c700 1 -- 172.21.15.100:0/813744459 shutdown_connections 2023-12-05T10:01:30.428 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.430+0000 7f845d56c700 1 --2- 172.21.15.100:0/813744459 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8458070510 0x7f8458070980 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:01:30.428 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.430+0000 7f845d56c700 1 --2- 172.21.15.100:0/813744459 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8458071b60 0x7f845806ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:01:30.428 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.430+0000 7f845d56c700 1 -- 172.21.15.100:0/813744459 >> 172.21.15.100:0/813744459 conn(0x7f84580f82d0 msgr2=0x7f84580fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:01:30.428 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.430+0000 7f845d56c700 1 -- 172.21.15.100:0/813744459 shutdown_connections 2023-12-05T10:01:30.428 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.430+0000 7f845d56c700 1 -- 172.21.15.100:0/813744459 wait complete. 2023-12-05T10:01:30.429 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.431+0000 7f845d56c700 1 Processor -- start 2023-12-05T10:01:30.430 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.432+0000 7f845d56c700 1 -- start start 2023-12-05T10:01:30.430 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.432+0000 7f845d56c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8458070510 0x7f84580fca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:01:30.430 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.432+0000 7f845d56c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8458071b60 0x7f84580fcfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:01:30.430 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.432+0000 7f845d56c700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84580fd600 con 0x7f8458071b60 2023-12-05T10:01:30.430 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.432+0000 7f845d56c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84580fdea0 con 0x7f8458070510 2023-12-05T10:01:30.431 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.433+0000 7f84567fc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8458071b60 0x7f84580fcfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:01:30.431 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.433+0000 7f8456ffd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8458070510 0x7f84580fca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:01:30.431 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.433+0000 7f84567fc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8458071b60 0x7f84580fcfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51788/0 (socket says 172.21.15.100:51788) 2023-12-05T10:01:30.431 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.433+0000 7f84567fc700 1 -- 172.21.15.100:0/395752844 learned_addr learned my addr 172.21.15.100:0/395752844 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T10:01:30.431 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.433+0000 7f8456ffd700 1 -- 172.21.15.100:0/395752844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8458071b60 msgr2=0x7f84580fcfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:01:30.432 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.433+0000 7f8456ffd700 1 --2- 172.21.15.100:0/395752844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8458071b60 0x7f84580fcfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:01:30.432 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.433+0000 7f8456ffd700 1 -- 172.21.15.100:0/395752844 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f844c005040 con 0x7f8458070510 2023-12-05T10:01:30.432 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.433+0000 7f84567fc700 1 --2- 172.21.15.100:0/395752844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8458071b60 0x7f84580fcfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-05T10:01:30.432 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.433+0000 7f8456ffd700 1 --2- 172.21.15.100:0/395752844 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8458070510 0x7f84580fca70 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f8448009fd0 tx=0x7f844800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:01:30.432 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.434+0000 7f843f7fe700 1 -- 172.21.15.100:0/395752844 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8448004e90 con 0x7f8458070510 2023-12-05T10:01:30.432 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.434+0000 7f843f7fe700 1 -- 172.21.15.100:0/395752844 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f844800f040 con 0x7f8458070510 2023-12-05T10:01:30.432 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.434+0000 7f843f7fe700 1 -- 172.21.15.100:0/395752844 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f844800c9b0 con 0x7f8458070510 2023-12-05T10:01:30.432 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.434+0000 7f845d56c700 1 -- 172.21.15.100:0/395752844 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84580fe0c0 con 0x7f8458070510 2023-12-05T10:01:30.432 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.434+0000 7f845d56c700 1 -- 172.21.15.100:0/395752844 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84580fe5b0 con 0x7f8458070510 2023-12-05T10:01:30.432 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.435+0000 7f845d56c700 1 -- 172.21.15.100:0/395752844 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84581096f0 con 0x7f8458070510 2023-12-05T10:01:30.434 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.436+0000 7f843f7fe700 1 -- 172.21.15.100:0/395752844 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f8448007cc0 con 0x7f8458070510 2023-12-05T10:01:30.434 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.437+0000 7f843f7fe700 1 --2- 172.21.15.100:0/395752844 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f844006ce70 0x7f844006f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:01:30.434 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.437+0000 7f843f7fe700 1 -- 172.21.15.100:0/395752844 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f844808bd50 con 0x7f8458070510 2023-12-05T10:01:30.435 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.437+0000 7f84567fc700 1 --2- 172.21.15.100:0/395752844 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f844006ce70 0x7f844006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:01:30.435 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.438+0000 7f84567fc700 1 --2- 172.21.15.100:0/395752844 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f844006ce70 0x7f844006f320 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f844c00b0d0 tx=0x7f844c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:01:30.441 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.443+0000 7f843f7fe700 1 -- 172.21.15.100:0/395752844 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f8448055c60 con 0x7f8458070510 2023-12-05T10:01:30.660 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.662+0000 7f845d56c700 1 -- 172.21.15.100:0/395752844 --> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f845802b150 con 0x7f844006ce70 2023-12-05T10:01:30.670 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.673+0000 7f843f7fe700 1 -- 172.21.15.100:0/395752844 <== mgr.34104 v2:172.21.15.100:6800/3489431924 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f845802b150 con 0x7f844006ce70 2023-12-05T10:01:30.671 INFO:teuthology.orchestra.run.smithi100.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-05T10:01:30.671 INFO:teuthology.orchestra.run.smithi100.stdout:alertmanager.smithi100 smithi100 *:9093,9094 running (4m) 23s ago 11m 16.0M - 0.25.0 c8568f914cd2 f443e6a4242b 2023-12-05T10:01:30.671 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi100 smithi100 running (86s) 23s ago 11m 7856k - 19.0.0-11-g3fe8d441 56dea28e5206 fb8e6b844fba 2023-12-05T10:01:30.671 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi150 smithi150 running (82s) 79s ago 10m 7847k - 19.0.0-11-g3fe8d441 56dea28e5206 a035052de6cf 2023-12-05T10:01:30.671 INFO:teuthology.orchestra.run.smithi100.stdout:grafana.smithi100 smithi100 *:3000 running (4m) 23s ago 11m 80.1M - 9.4.7 2c41d148cca3 d666da9c4e4d 2023-12-05T10:01:30.671 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.akmstb smithi100 running (6m) 23s ago 6m 10.5G - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 6ce55c42c55b 2023-12-05T10:01:30.671 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.sqplhn smithi100 running (6m) 23s ago 6m 15.7M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc c2682d65f0c9 2023-12-05T10:01:30.671 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi150.fcnhsv smithi150 running (6m) 79s ago 6m 15.1M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 1a259762235d 2023-12-05T10:01:30.671 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi150.pcbpxm smithi150 running (6m) 79s ago 6m 15.2M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 27f730f8b9f9 2023-12-05T10:01:30.672 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi100.ehmuhg smithi100 *:8443,9283,8765 running (3m) 23s ago 12m 514M - 19.0.0-11-g3fe8d441 56dea28e5206 ebe3dfbb0356 2023-12-05T10:01:30.672 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi150.zkskag smithi150 *:8443,9283,8765 running (2m) 79s ago 10m 451M - 19.0.0-11-g3fe8d441 56dea28e5206 a2b40e2421f2 2023-12-05T10:01:30.672 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi100 smithi100 running (2m) 23s ago 12m 66.7M 2048M 19.0.0-11-g3fe8d441 56dea28e5206 21003fd7eaf4 2023-12-05T10:01:30.672 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi150 smithi150 running (119s) 79s ago 10m 35.5M 2048M 19.0.0-11-g3fe8d441 56dea28e5206 010f2f658fca 2023-12-05T10:01:30.672 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi100 smithi100 *:9100 running (4m) 23s ago 11m 8493k - 1.5.0 0da6a335fe13 a2653da0d840 2023-12-05T10:01:30.672 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi150 smithi150 *:9100 running (3m) 79s ago 10m 8170k - 1.5.0 0da6a335fe13 67523645e73b 2023-12-05T10:01:30.672 INFO:teuthology.orchestra.run.smithi100.stdout:osd.0 smithi100 running (62s) 23s ago 10m 126M 1618M 19.0.0-11-g3fe8d441 56dea28e5206 a29add095f14 2023-12-05T10:01:30.672 INFO:teuthology.orchestra.run.smithi100.stdout:osd.1 smithi100 running (27s) 23s ago 9m 12.5M 1618M 19.0.0-11-g3fe8d441 56dea28e5206 2de00a9dc686 2023-12-05T10:01:30.672 INFO:teuthology.orchestra.run.smithi100.stdout:osd.2 smithi100 running (9m) 23s ago 9m 820M 1618M 17.2.7-109-g1fd3ca3c e139fc5fd9fc f145372c8ccc 2023-12-05T10:01:30.672 INFO:teuthology.orchestra.run.smithi100.stdout:osd.3 smithi150 running (8m) 79s ago 8m 1168M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 78137d463d29 2023-12-05T10:01:30.673 INFO:teuthology.orchestra.run.smithi100.stdout:osd.4 smithi150 running (8m) 79s ago 8m 848M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc dfef9accd162 2023-12-05T10:01:30.673 INFO:teuthology.orchestra.run.smithi100.stdout:osd.5 smithi150 running (8m) 79s ago 8m 994M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc d9720b1eae0c 2023-12-05T10:01:30.673 INFO:teuthology.orchestra.run.smithi100.stdout:prometheus.smithi100 smithi100 *:9095 running (2m) 23s ago 11m 55.0M - 2.43.0 a07b618ecd1d 8ade75deb316 2023-12-05T10:01:30.674 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.675+0000 7f845d56c700 1 -- 172.21.15.100:0/395752844 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f844006ce70 msgr2=0x7f844006f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:01:30.674 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.675+0000 7f845d56c700 1 --2- 172.21.15.100:0/395752844 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f844006ce70 0x7f844006f320 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f844c00b0d0 tx=0x7f844c009e30 comp rx=0 tx=0).stop 2023-12-05T10:01:30.674 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.675+0000 7f845d56c700 1 -- 172.21.15.100:0/395752844 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8458070510 msgr2=0x7f84580fca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:01:30.674 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.675+0000 7f845d56c700 1 --2- 172.21.15.100:0/395752844 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8458070510 0x7f84580fca70 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f8448009fd0 tx=0x7f844800b040 comp rx=0 tx=0).stop 2023-12-05T10:01:30.674 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.675+0000 7f845d56c700 1 -- 172.21.15.100:0/395752844 shutdown_connections 2023-12-05T10:01:30.674 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.675+0000 7f845d56c700 1 --2- 172.21.15.100:0/395752844 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f844006ce70 0x7f844006f320 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:01:30.674 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.675+0000 7f845d56c700 1 --2- 172.21.15.100:0/395752844 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8458070510 0x7f84580fca70 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:01:30.674 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.675+0000 7f845d56c700 1 --2- 172.21.15.100:0/395752844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8458071b60 0x7f84580fcfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:01:30.674 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.675+0000 7f845d56c700 1 -- 172.21.15.100:0/395752844 >> 172.21.15.100:0/395752844 conn(0x7f84580f82d0 msgr2=0x7f84580fa670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:01:30.674 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.675+0000 7f845d56c700 1 -- 172.21.15.100:0/395752844 shutdown_connections 2023-12-05T10:01:30.674 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.675+0000 7f845d56c700 1 -- 172.21.15.100:0/395752844 wait complete. 2023-12-05T10:01:30.812 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.814+0000 7fc72818f700 1 -- 172.21.15.100:0/1090861833 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7200fcd00 msgr2=0x7fc7200fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:01:30.812 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.814+0000 7fc72818f700 1 --2- 172.21.15.100:0/1090861833 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7200fcd00 0x7fc7200fd150 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc710004940 tx=0x7fc710009e30 comp rx=0 tx=0).stop 2023-12-05T10:01:30.813 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.814+0000 7fc72818f700 1 -- 172.21.15.100:0/1090861833 shutdown_connections 2023-12-05T10:01:30.813 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.814+0000 7fc72818f700 1 --2- 172.21.15.100:0/1090861833 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7200fcd00 0x7fc7200fd150 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:01:30.813 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.814+0000 7fc72818f700 1 --2- 172.21.15.100:0/1090861833 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7200fbaf0 0x7fc7200fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:01:30.813 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.815+0000 7fc72818f700 1 -- 172.21.15.100:0/1090861833 >> 172.21.15.100:0/1090861833 conn(0x7fc7200f7190 msgr2=0x7fc7200f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:01:30.813 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.815+0000 7fc72818f700 1 -- 172.21.15.100:0/1090861833 shutdown_connections 2023-12-05T10:01:30.813 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.815+0000 7fc72818f700 1 -- 172.21.15.100:0/1090861833 wait complete. 2023-12-05T10:01:30.813 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.816+0000 7fc72818f700 1 Processor -- start 2023-12-05T10:01:30.814 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.816+0000 7fc72818f700 1 -- start start 2023-12-05T10:01:30.814 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.816+0000 7fc72818f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7200fbaf0 0x7fc7201125f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:01:30.814 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.816+0000 7fc72818f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7200fcd00 0x7fc720114b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:01:30.814 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.816+0000 7fc72818f700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc720066000 con 0x7fc7200fbaf0 2023-12-05T10:01:30.814 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.816+0000 7fc72818f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc720066140 con 0x7fc7200fcd00 2023-12-05T10:01:30.815 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.816+0000 7fc725f2b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7200fbaf0 0x7fc7201125f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:01:30.815 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.816+0000 7fc725f2b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7200fbaf0 0x7fc7201125f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51798/0 (socket says 172.21.15.100:51798) 2023-12-05T10:01:30.815 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.816+0000 7fc725f2b700 1 -- 172.21.15.100:0/511479728 learned_addr learned my addr 172.21.15.100:0/511479728 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T10:01:30.815 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.817+0000 7fc72572a700 1 --2- 172.21.15.100:0/511479728 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7200fcd00 0x7fc720114b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:01:30.815 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.817+0000 7fc725f2b700 1 -- 172.21.15.100:0/511479728 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7200fcd00 msgr2=0x7fc720114b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:01:30.815 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.817+0000 7fc725f2b700 1 --2- 172.21.15.100:0/511479728 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7200fcd00 0x7fc720114b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:01:30.815 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.817+0000 7fc725f2b700 1 -- 172.21.15.100:0/511479728 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc710005040 con 0x7fc7200fbaf0 2023-12-05T10:01:30.815 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.817+0000 7fc72572a700 1 --2- 172.21.15.100:0/511479728 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7200fcd00 0x7fc720114b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-05T10:01:30.815 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.817+0000 7fc725f2b700 1 --2- 172.21.15.100:0/511479728 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7200fbaf0 0x7fc7201125f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc71c00eb70 tx=0x7fc71c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:01:30.815 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.817+0000 7fc7167fc700 1 -- 172.21.15.100:0/511479728 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc71c007cc0 con 0x7fc7200fbaf0 2023-12-05T10:01:30.815 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.818+0000 7fc7167fc700 1 -- 172.21.15.100:0/511479728 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc71c00f040 con 0x7fc7200fbaf0 2023-12-05T10:01:30.816 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.818+0000 7fc7167fc700 1 -- 172.21.15.100:0/511479728 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc71c00cad0 con 0x7fc7200fbaf0 2023-12-05T10:01:30.816 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.818+0000 7fc72818f700 1 -- 172.21.15.100:0/511479728 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc720115080 con 0x7fc7200fbaf0 2023-12-05T10:01:30.816 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.818+0000 7fc72818f700 1 -- 172.21.15.100:0/511479728 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc720115420 con 0x7fc7200fbaf0 2023-12-05T10:01:30.817 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.819+0000 7fc72818f700 1 -- 172.21.15.100:0/511479728 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc72004bb80 con 0x7fc7200fbaf0 2023-12-05T10:01:30.817 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.820+0000 7fc7167fc700 1 -- 172.21.15.100:0/511479728 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fc71c00cc30 con 0x7fc7200fbaf0 2023-12-05T10:01:30.818 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.821+0000 7fc7167fc700 1 --2- 172.21.15.100:0/511479728 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fc70c06ce70 0x7fc70c06f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:01:30.819 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.821+0000 7fc7167fc700 1 -- 172.21.15.100:0/511479728 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fc71c08bd90 con 0x7fc7200fbaf0 2023-12-05T10:01:30.819 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.821+0000 7fc72572a700 1 --2- 172.21.15.100:0/511479728 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fc70c06ce70 0x7fc70c06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:01:30.819 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.822+0000 7fc72572a700 1 --2- 172.21.15.100:0/511479728 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fc70c06ce70 0x7fc70c06f320 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc7100135e0 tx=0x7fc710009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:01:30.823 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:30.826+0000 7fc7167fc700 1 -- 172.21.15.100:0/511479728 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fc71c055d40 con 0x7fc7200fbaf0 2023-12-05T10:01:31.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:30 smithi150 ceph-mon[171606]: from='client.34246 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T10:01:31.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:30 smithi150 ceph-mon[171606]: from='client.34250 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T10:01:31.097 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:30 smithi100 ceph-mon[187528]: from='client.34246 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T10:01:31.097 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:30 smithi100 ceph-mon[187528]: from='client.34250 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T10:01:31.119 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.122+0000 7fc72818f700 1 -- 172.21.15.100:0/511479728 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc720115600 con 0x7fc7200fbaf0 2023-12-05T10:01:31.120 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.122+0000 7fc7167fc700 1 -- 172.21.15.100:0/511479728 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+827 (secure 0 0 0) 0x7fc71c059360 con 0x7fc7200fbaf0 2023-12-05T10:01:31.120 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2023-12-05T10:01:31.120 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": { 2023-12-05T10:01:31.120 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 2 2023-12-05T10:01:31.120 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-12-05T10:01:31.120 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": { 2023-12-05T10:01:31.120 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 2 2023-12-05T10:01:31.120 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-12-05T10:01:31.121 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": { 2023-12-05T10:01:31.121 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 4, 2023-12-05T10:01:31.121 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 2 2023-12-05T10:01:31.121 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-12-05T10:01:31.121 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": { 2023-12-05T10:01:31.121 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 4 2023-12-05T10:01:31.121 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-12-05T10:01:31.121 INFO:teuthology.orchestra.run.smithi100.stdout: "overall": { 2023-12-05T10:01:31.121 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 8, 2023-12-05T10:01:31.121 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 6 2023-12-05T10:01:31.121 INFO:teuthology.orchestra.run.smithi100.stdout: } 2023-12-05T10:01:31.121 INFO:teuthology.orchestra.run.smithi100.stdout:} 2023-12-05T10:01:31.123 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.125+0000 7fc72818f700 1 -- 172.21.15.100:0/511479728 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fc70c06ce70 msgr2=0x7fc70c06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:01:31.123 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.125+0000 7fc72818f700 1 --2- 172.21.15.100:0/511479728 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fc70c06ce70 0x7fc70c06f320 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc7100135e0 tx=0x7fc710009e30 comp rx=0 tx=0).stop 2023-12-05T10:01:31.123 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.125+0000 7fc72818f700 1 -- 172.21.15.100:0/511479728 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7200fbaf0 msgr2=0x7fc7201125f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:01:31.123 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.125+0000 7fc72818f700 1 --2- 172.21.15.100:0/511479728 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7200fbaf0 0x7fc7201125f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc71c00eb70 tx=0x7fc71c00b040 comp rx=0 tx=0).stop 2023-12-05T10:01:31.123 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.125+0000 7fc72818f700 1 -- 172.21.15.100:0/511479728 shutdown_connections 2023-12-05T10:01:31.123 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.125+0000 7fc72818f700 1 --2- 172.21.15.100:0/511479728 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fc70c06ce70 0x7fc70c06f320 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:01:31.123 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.125+0000 7fc72818f700 1 --2- 172.21.15.100:0/511479728 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7200fbaf0 0x7fc7201125f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:01:31.123 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.125+0000 7fc72818f700 1 --2- 172.21.15.100:0/511479728 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7200fcd00 0x7fc720114b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:01:31.123 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.125+0000 7fc72818f700 1 -- 172.21.15.100:0/511479728 >> 172.21.15.100:0/511479728 conn(0x7fc7200f7190 msgr2=0x7fc7200fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:01:31.123 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.125+0000 7fc72818f700 1 -- 172.21.15.100:0/511479728 shutdown_connections 2023-12-05T10:01:31.123 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.125+0000 7fc72818f700 1 -- 172.21.15.100:0/511479728 wait complete. 2023-12-05T10:01:31.262 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.264+0000 7fc9c8944700 1 -- 172.21.15.100:0/1548559412 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9c4070510 msgr2=0x7fc9c4070980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:01:31.262 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.264+0000 7fc9c8944700 1 --2- 172.21.15.100:0/1548559412 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9c4070510 0x7fc9c4070980 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc9b8004940 tx=0x7fc9b8009e30 comp rx=0 tx=0).stop 2023-12-05T10:01:31.263 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.264+0000 7fc9c8944700 1 -- 172.21.15.100:0/1548559412 shutdown_connections 2023-12-05T10:01:31.263 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.264+0000 7fc9c8944700 1 --2- 172.21.15.100:0/1548559412 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9c4070510 0x7fc9c4070980 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:01:31.263 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.264+0000 7fc9c8944700 1 --2- 172.21.15.100:0/1548559412 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9c4071b60 0x7fc9c406ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:01:31.263 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.264+0000 7fc9c8944700 1 -- 172.21.15.100:0/1548559412 >> 172.21.15.100:0/1548559412 conn(0x7fc9c40f82d0 msgr2=0x7fc9c40fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:01:31.263 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.265+0000 7fc9c8944700 1 -- 172.21.15.100:0/1548559412 shutdown_connections 2023-12-05T10:01:31.263 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.265+0000 7fc9c8944700 1 -- 172.21.15.100:0/1548559412 wait complete. 2023-12-05T10:01:31.264 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.266+0000 7fc9c8944700 1 Processor -- start 2023-12-05T10:01:31.264 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.266+0000 7fc9c8944700 1 -- start start 2023-12-05T10:01:31.264 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.266+0000 7fc9c8944700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9c4070510 0x7fc9c410f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:01:31.264 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.267+0000 7fc9c8944700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9c4071b60 0x7fc9c410fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:01:31.264 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.267+0000 7fc9c8944700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c41102c0 con 0x7fc9c4070510 2023-12-05T10:01:31.265 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.267+0000 7fc9c8944700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c4110b60 con 0x7fc9c4071b60 2023-12-05T10:01:31.265 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.267+0000 7fc9c259c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9c4070510 0x7fc9c410f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:01:31.265 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.267+0000 7fc9c259c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9c4070510 0x7fc9c410f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51816/0 (socket says 172.21.15.100:51816) 2023-12-05T10:01:31.265 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.267+0000 7fc9c259c700 1 -- 172.21.15.100:0/4050922926 learned_addr learned my addr 172.21.15.100:0/4050922926 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T10:01:31.266 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.267+0000 7fc9c259c700 1 -- 172.21.15.100:0/4050922926 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9c4071b60 msgr2=0x7fc9c410fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:01:31.266 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.267+0000 7fc9c259c700 1 --2- 172.21.15.100:0/4050922926 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9c4071b60 0x7fc9c410fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:01:31.266 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.267+0000 7fc9c259c700 1 -- 172.21.15.100:0/4050922926 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9b8005040 con 0x7fc9c4070510 2023-12-05T10:01:31.266 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.267+0000 7fc9c259c700 1 --2- 172.21.15.100:0/4050922926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9c4070510 0x7fc9c410f780 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc9b400c8c0 tx=0x7fc9b40044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:01:31.266 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.268+0000 7fc9b2ffd700 1 -- 172.21.15.100:0/4050922926 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9b400a980 con 0x7fc9c4070510 2023-12-05T10:01:31.266 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.268+0000 7fc9b2ffd700 1 -- 172.21.15.100:0/4050922926 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc9b400ce60 con 0x7fc9c4070510 2023-12-05T10:01:31.266 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.268+0000 7fc9c8944700 1 -- 172.21.15.100:0/4050922926 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9c4110e40 con 0x7fc9c4070510 2023-12-05T10:01:31.266 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.268+0000 7fc9b2ffd700 1 -- 172.21.15.100:0/4050922926 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9b40113a0 con 0x7fc9c4070510 2023-12-05T10:01:31.266 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.268+0000 7fc9c8944700 1 -- 172.21.15.100:0/4050922926 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9c4111380 con 0x7fc9c4070510 2023-12-05T10:01:31.267 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.269+0000 7fc9c8944700 1 -- 172.21.15.100:0/4050922926 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9c41096f0 con 0x7fc9c4070510 2023-12-05T10:01:31.267 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.270+0000 7fc9b2ffd700 1 -- 172.21.15.100:0/4050922926 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fc9b4012400 con 0x7fc9c4070510 2023-12-05T10:01:31.268 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.271+0000 7fc9b2ffd700 1 --2- 172.21.15.100:0/4050922926 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fc9ac06ce60 0x7fc9ac06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:01:31.268 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.271+0000 7fc9b2ffd700 1 -- 172.21.15.100:0/4050922926 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fc9b408c3e0 con 0x7fc9c4070510 2023-12-05T10:01:31.268 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.271+0000 7fc9c1d9b700 1 --2- 172.21.15.100:0/4050922926 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fc9ac06ce60 0x7fc9ac06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:01:31.269 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.271+0000 7fc9c1d9b700 1 --2- 172.21.15.100:0/4050922926 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fc9ac06ce60 0x7fc9ac06f310 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc9b800b3b0 tx=0x7fc9b8009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:01:31.277 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.279+0000 7fc9b2ffd700 1 -- 172.21.15.100:0/4050922926 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fc9b4059d50 con 0x7fc9c4070510 2023-12-05T10:01:31.569 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.571+0000 7fc9c8944700 1 -- 172.21.15.100:0/4050922926 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc9c4111650 con 0x7fc9c4070510 2023-12-05T10:01:31.572 INFO:teuthology.orchestra.run.smithi100.stdout:e13 2023-12-05T10:01:31.572 INFO:teuthology.orchestra.run.smithi100.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-05T10:01:31.572 INFO:teuthology.orchestra.run.smithi100.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T10:01:31.572 INFO:teuthology.orchestra.run.smithi100.stdout:legacy client fscid: 1 2023-12-05T10:01:31.573 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T10:01:31.573 INFO:teuthology.orchestra.run.smithi100.stdout:Filesystem 'cephfs' (1) 2023-12-05T10:01:31.573 INFO:teuthology.orchestra.run.smithi100.stdout:fs_name cephfs 2023-12-05T10:01:31.573 INFO:teuthology.orchestra.run.smithi100.stdout:epoch 13 2023-12-05T10:01:31.573 INFO:teuthology.orchestra.run.smithi100.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-05T10:01:31.573 INFO:teuthology.orchestra.run.smithi100.stdout:created 2023-12-05T09:54:30.515778+0000 2023-12-05T10:01:31.573 INFO:teuthology.orchestra.run.smithi100.stdout:modified 2023-12-05T09:54:46.403009+0000 2023-12-05T10:01:31.573 INFO:teuthology.orchestra.run.smithi100.stdout:tableserver 0 2023-12-05T10:01:31.573 INFO:teuthology.orchestra.run.smithi100.stdout:root 0 2023-12-05T10:01:31.573 INFO:teuthology.orchestra.run.smithi100.stdout:session_timeout 60 2023-12-05T10:01:31.573 INFO:teuthology.orchestra.run.smithi100.stdout:session_autoclose 300 2023-12-05T10:01:31.573 INFO:teuthology.orchestra.run.smithi100.stdout:max_file_size 1099511627776 2023-12-05T10:01:31.573 INFO:teuthology.orchestra.run.smithi100.stdout:max_xattr_size 65536 2023-12-05T10:01:31.573 INFO:teuthology.orchestra.run.smithi100.stdout:required_client_features {} 2023-12-05T10:01:31.574 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure 0 2023-12-05T10:01:31.574 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure_osd_epoch 46 2023-12-05T10:01:31.574 INFO:teuthology.orchestra.run.smithi100.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T10:01:31.574 INFO:teuthology.orchestra.run.smithi100.stdout:max_mds 1 2023-12-05T10:01:31.574 INFO:teuthology.orchestra.run.smithi100.stdout:in 0 2023-12-05T10:01:31.574 INFO:teuthology.orchestra.run.smithi100.stdout:up {0=14490} 2023-12-05T10:01:31.574 INFO:teuthology.orchestra.run.smithi100.stdout:failed 2023-12-05T10:01:31.574 INFO:teuthology.orchestra.run.smithi100.stdout:damaged 2023-12-05T10:01:31.574 INFO:teuthology.orchestra.run.smithi100.stdout:stopped 2023-12-05T10:01:31.574 INFO:teuthology.orchestra.run.smithi100.stdout:data_pools [3] 2023-12-05T10:01:31.574 INFO:teuthology.orchestra.run.smithi100.stdout:metadata_pool 2 2023-12-05T10:01:31.574 INFO:teuthology.orchestra.run.smithi100.stdout:inline_data disabled 2023-12-05T10:01:31.574 INFO:teuthology.orchestra.run.smithi100.stdout:balancer 2023-12-05T10:01:31.575 INFO:teuthology.orchestra.run.smithi100.stdout:bal_rank_mask -1 2023-12-05T10:01:31.575 INFO:teuthology.orchestra.run.smithi100.stdout:standby_count_wanted 1 2023-12-05T10:01:31.575 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi100.akmstb{0:14490} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.100:6828/627555128,v1:172.21.15.100:6829/627555128] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T10:01:31.575 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T10:01:31.575 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T10:01:31.575 INFO:teuthology.orchestra.run.smithi100.stdout:Standby daemons: 2023-12-05T10:01:31.575 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T10:01:31.575 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi150.pcbpxm{-1:14486} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.150:6824/3645854543,v1:172.21.15.150:6825/3645854543] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T10:01:31.575 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi150.fcnhsv{-1:14498} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.150:6826/3249949736,v1:172.21.15.150:6827/3249949736] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T10:01:31.575 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi100.sqplhn{-1:14506} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.100:6826/2472212864,v1:172.21.15.100:6827/2472212864] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T10:01:31.576 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.574+0000 7fc9b2ffd700 1 -- 172.21.15.100:0/4050922926 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1852 (secure 0 0 0) 0x7fc9b40598e0 con 0x7fc9c4070510 2023-12-05T10:01:31.576 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.577+0000 7fc9c8944700 1 -- 172.21.15.100:0/4050922926 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fc9ac06ce60 msgr2=0x7fc9ac06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:01:31.576 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.577+0000 7fc9c8944700 1 --2- 172.21.15.100:0/4050922926 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fc9ac06ce60 0x7fc9ac06f310 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc9b800b3b0 tx=0x7fc9b8009e30 comp rx=0 tx=0).stop 2023-12-05T10:01:31.576 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.577+0000 7fc9c8944700 1 -- 172.21.15.100:0/4050922926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9c4070510 msgr2=0x7fc9c410f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:01:31.576 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.577+0000 7fc9c8944700 1 --2- 172.21.15.100:0/4050922926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9c4070510 0x7fc9c410f780 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc9b400c8c0 tx=0x7fc9b40044c0 comp rx=0 tx=0).stop 2023-12-05T10:01:31.576 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.577+0000 7fc9c8944700 1 -- 172.21.15.100:0/4050922926 shutdown_connections 2023-12-05T10:01:31.576 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.577+0000 7fc9c8944700 1 --2- 172.21.15.100:0/4050922926 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fc9ac06ce60 0x7fc9ac06f310 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:01:31.576 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.577+0000 7fc9c8944700 1 --2- 172.21.15.100:0/4050922926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9c4070510 0x7fc9c410f780 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:01:31.577 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.577+0000 7fc9c8944700 1 --2- 172.21.15.100:0/4050922926 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9c4071b60 0x7fc9c410fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:01:31.577 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.577+0000 7fc9c8944700 1 -- 172.21.15.100:0/4050922926 >> 172.21.15.100:0/4050922926 conn(0x7fc9c40f82d0 msgr2=0x7fc9c40fa670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:01:31.577 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.578+0000 7fc9c8944700 1 -- 172.21.15.100:0/4050922926 shutdown_connections 2023-12-05T10:01:31.577 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.579+0000 7fc9c8944700 1 -- 172.21.15.100:0/4050922926 wait complete. 2023-12-05T10:01:31.581 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 13 2023-12-05T10:01:31.723 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.726+0000 7fc6f6cd7700 1 -- 172.21.15.100:0/806219824 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6f00fdc10 msgr2=0x7fc6f00fe060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:01:31.723 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.726+0000 7fc6f6cd7700 1 --2- 172.21.15.100:0/806219824 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6f00fdc10 0x7fc6f00fe060 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0004940 tx=0x7fc6e0009e30 comp rx=0 tx=0).stop 2023-12-05T10:01:31.724 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.726+0000 7fc6f6cd7700 1 -- 172.21.15.100:0/806219824 shutdown_connections 2023-12-05T10:01:31.724 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.726+0000 7fc6f6cd7700 1 --2- 172.21.15.100:0/806219824 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6f00fdc10 0x7fc6f00fe060 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:01:31.724 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.726+0000 7fc6f6cd7700 1 --2- 172.21.15.100:0/806219824 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6f00fca00 0x7fc6f00fce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:01:31.724 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.726+0000 7fc6f6cd7700 1 -- 172.21.15.100:0/806219824 >> 172.21.15.100:0/806219824 conn(0x7fc6f00f80e0 msgr2=0x7fc6f00fa4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:01:31.724 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.726+0000 7fc6f6cd7700 1 -- 172.21.15.100:0/806219824 shutdown_connections 2023-12-05T10:01:31.724 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.726+0000 7fc6f6cd7700 1 -- 172.21.15.100:0/806219824 wait complete. 2023-12-05T10:01:31.725 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.727+0000 7fc6f6cd7700 1 Processor -- start 2023-12-05T10:01:31.725 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.727+0000 7fc6f6cd7700 1 -- start start 2023-12-05T10:01:31.725 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.727+0000 7fc6f6cd7700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6f00fca00 0x7fc6f010f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:01:31.725 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.727+0000 7fc6f6cd7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6f00fdc10 0x7fc6f010fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:01:31.725 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.727+0000 7fc6f6cd7700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f01100f0 con 0x7fc6f00fca00 2023-12-05T10:01:31.725 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.727+0000 7fc6f6cd7700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f0110930 con 0x7fc6f00fdc10 2023-12-05T10:01:31.725 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.727+0000 7fc6f5cd5700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6f00fca00 0x7fc6f010f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:01:31.725 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.727+0000 7fc6f5cd5700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6f00fca00 0x7fc6f010f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51824/0 (socket says 172.21.15.100:51824) 2023-12-05T10:01:31.725 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.727+0000 7fc6f5cd5700 1 -- 172.21.15.100:0/3121219734 learned_addr learned my addr 172.21.15.100:0/3121219734 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T10:01:31.725 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.727+0000 7fc6f54d4700 1 --2- 172.21.15.100:0/3121219734 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6f00fdc10 0x7fc6f010fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:01:31.726 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.728+0000 7fc6f5cd5700 1 -- 172.21.15.100:0/3121219734 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6f00fdc10 msgr2=0x7fc6f010fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:01:31.726 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.728+0000 7fc6f5cd5700 1 --2- 172.21.15.100:0/3121219734 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6f00fdc10 0x7fc6f010fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:01:31.727 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.728+0000 7fc6f5cd5700 1 -- 172.21.15.100:0/3121219734 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e0005040 con 0x7fc6f00fca00 2023-12-05T10:01:31.727 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.728+0000 7fc6f5cd5700 1 --2- 172.21.15.100:0/3121219734 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6f00fca00 0x7fc6f010f520 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec00b790 tx=0x7fc6ec009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:01:31.727 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.728+0000 7fc6e67fc700 1 -- 172.21.15.100:0/3121219734 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6ec00f6f0 con 0x7fc6f00fca00 2023-12-05T10:01:31.727 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.728+0000 7fc6e67fc700 1 -- 172.21.15.100:0/3121219734 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc6ec00fd00 con 0x7fc6f00fca00 2023-12-05T10:01:31.727 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.728+0000 7fc6f6cd7700 1 -- 172.21.15.100:0/3121219734 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6f0110c10 con 0x7fc6f00fca00 2023-12-05T10:01:31.727 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.728+0000 7fc6e67fc700 1 -- 172.21.15.100:0/3121219734 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6ec011e90 con 0x7fc6f00fca00 2023-12-05T10:01:31.727 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.728+0000 7fc6f6cd7700 1 -- 172.21.15.100:0/3121219734 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6f01111d0 con 0x7fc6f00fca00 2023-12-05T10:01:31.727 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.729+0000 7fc6f6cd7700 1 -- 172.21.15.100:0/3121219734 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6f0101cb0 con 0x7fc6f00fca00 2023-12-05T10:01:31.728 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.731+0000 7fc6e67fc700 1 -- 172.21.15.100:0/3121219734 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fc6ec00f850 con 0x7fc6f00fca00 2023-12-05T10:01:31.730 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.731+0000 7fc6e67fc700 1 --2- 172.21.15.100:0/3121219734 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fc6dc06ce70 0x7fc6dc06f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:01:31.730 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.732+0000 7fc6e67fc700 1 -- 172.21.15.100:0/3121219734 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fc6ec08c1a0 con 0x7fc6f00fca00 2023-12-05T10:01:31.730 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.732+0000 7fc6f54d4700 1 --2- 172.21.15.100:0/3121219734 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fc6dc06ce70 0x7fc6dc06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:01:31.730 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.732+0000 7fc6f54d4700 1 --2- 172.21.15.100:0/3121219734 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fc6dc06ce70 0x7fc6dc06f320 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc6e00043d0 tx=0x7fc6e0009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:01:31.733 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.736+0000 7fc6e67fc700 1 -- 172.21.15.100:0/3121219734 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fc6ec059b40 con 0x7fc6f00fca00 2023-12-05T10:01:31.984 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.986+0000 7fc6f6cd7700 1 -- 172.21.15.100:0/3121219734 --> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc6f01114c0 con 0x7fc6dc06ce70 2023-12-05T10:01:31.985 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.987+0000 7fc6e67fc700 1 -- 172.21.15.100:0/3121219734 <== mgr.34104 v2:172.21.15.100:6800/3489431924 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fc6f01114c0 con 0x7fc6dc06ce70 2023-12-05T10:01:31.985 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2023-12-05T10:01:31.985 INFO:teuthology.orchestra.run.smithi100.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ff918c95653912ae4c171d8d1db5f5eabc756f85ff7e3ce78f13f9c521198459", 2023-12-05T10:01:31.985 INFO:teuthology.orchestra.run.smithi100.stdout: "in_progress": true, 2023-12-05T10:01:31.985 INFO:teuthology.orchestra.run.smithi100.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-05T10:01:31.985 INFO:teuthology.orchestra.run.smithi100.stdout: "services_complete": [ 2023-12-05T10:01:31.986 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr", 2023-12-05T10:01:31.986 INFO:teuthology.orchestra.run.smithi100.stdout: "crash", 2023-12-05T10:01:31.986 INFO:teuthology.orchestra.run.smithi100.stdout: "mon" 2023-12-05T10:01:31.986 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2023-12-05T10:01:31.986 INFO:teuthology.orchestra.run.smithi100.stdout: "progress": "8/21 daemons upgraded", 2023-12-05T10:01:31.986 INFO:teuthology.orchestra.run.smithi100.stdout: "message": "Currently upgrading osd daemons", 2023-12-05T10:01:31.986 INFO:teuthology.orchestra.run.smithi100.stdout: "is_paused": false 2023-12-05T10:01:31.986 INFO:teuthology.orchestra.run.smithi100.stdout:} 2023-12-05T10:01:31.988 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.990+0000 7fc6f6cd7700 1 -- 172.21.15.100:0/3121219734 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fc6dc06ce70 msgr2=0x7fc6dc06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:01:31.988 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.990+0000 7fc6f6cd7700 1 --2- 172.21.15.100:0/3121219734 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fc6dc06ce70 0x7fc6dc06f320 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc6e00043d0 tx=0x7fc6e0009e30 comp rx=0 tx=0).stop 2023-12-05T10:01:31.988 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.990+0000 7fc6f6cd7700 1 -- 172.21.15.100:0/3121219734 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6f00fca00 msgr2=0x7fc6f010f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:01:31.988 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.990+0000 7fc6f6cd7700 1 --2- 172.21.15.100:0/3121219734 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6f00fca00 0x7fc6f010f520 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec00b790 tx=0x7fc6ec009220 comp rx=0 tx=0).stop 2023-12-05T10:01:31.988 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.990+0000 7fc6f6cd7700 1 -- 172.21.15.100:0/3121219734 shutdown_connections 2023-12-05T10:01:31.988 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.990+0000 7fc6f6cd7700 1 --2- 172.21.15.100:0/3121219734 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fc6dc06ce70 0x7fc6dc06f320 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:01:31.988 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.990+0000 7fc6f6cd7700 1 --2- 172.21.15.100:0/3121219734 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6f00fca00 0x7fc6f010f520 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:01:31.988 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.990+0000 7fc6f6cd7700 1 --2- 172.21.15.100:0/3121219734 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6f00fdc10 0x7fc6f010fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:01:31.988 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.990+0000 7fc6f6cd7700 1 -- 172.21.15.100:0/3121219734 >> 172.21.15.100:0/3121219734 conn(0x7fc6f00f80e0 msgr2=0x7fc6f00fee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:01:31.988 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.990+0000 7fc6f6cd7700 1 -- 172.21.15.100:0/3121219734 shutdown_connections 2023-12-05T10:01:31.988 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:31.990+0000 7fc6f6cd7700 1 -- 172.21.15.100:0/3121219734 wait complete. 2023-12-05T10:01:32.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:31 smithi150 ceph-mon[171606]: pgmap v83: 65 pgs: 65 active+clean; 195 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-05T10:01:32.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:31 smithi150 ceph-mon[171606]: from='client.44191 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T10:01:32.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:31 smithi150 ceph-mon[171606]: from='client.? 172.21.15.100:0/511479728' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T10:01:32.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:31 smithi150 ceph-mon[171606]: from='client.? 172.21.15.100:0/4050922926' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-05T10:01:32.139 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:32.141+0000 7f785d893700 1 -- 172.21.15.100:0/707285725 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78580fcbf0 msgr2=0x7f78580fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:01:32.139 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:32.141+0000 7f785d893700 1 --2- 172.21.15.100:0/707285725 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78580fcbf0 0x7f78580fd000 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7848004940 tx=0x7f7848009e30 comp rx=0 tx=0).stop 2023-12-05T10:01:32.139 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:32.141+0000 7f785d893700 1 -- 172.21.15.100:0/707285725 shutdown_connections 2023-12-05T10:01:32.139 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:32.141+0000 7f785d893700 1 --2- 172.21.15.100:0/707285725 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78580fde00 0x7f78580fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:01:32.139 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:32.141+0000 7f785d893700 1 --2- 172.21.15.100:0/707285725 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78580fcbf0 0x7f78580fd000 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:01:32.139 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:32.141+0000 7f785d893700 1 -- 172.21.15.100:0/707285725 >> 172.21.15.100:0/707285725 conn(0x7f78580f82d0 msgr2=0x7f78580fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:01:32.139 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:32.141+0000 7f785d893700 1 -- 172.21.15.100:0/707285725 shutdown_connections 2023-12-05T10:01:32.139 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:32.141+0000 7f785d893700 1 -- 172.21.15.100:0/707285725 wait complete. 2023-12-05T10:01:32.141 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:32.142+0000 7f785d893700 1 Processor -- start 2023-12-05T10:01:32.141 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:32.142+0000 7f785d893700 1 -- start start 2023-12-05T10:01:32.141 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:32.142+0000 7f785d893700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78580fcbf0 0x7f785810f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:01:32.141 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:32.142+0000 7f785d893700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78580fde00 0x7f785810fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:01:32.141 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:32.142+0000 7f785d893700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78581102a0 con 0x7f78580fcbf0 2023-12-05T10:01:32.141 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:32.142+0000 7f785d893700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7858110b40 con 0x7f78580fde00 2023-12-05T10:01:32.141 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:32.142+0000 7f7856ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78580fcbf0 0x7f785810f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:01:32.141 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:32.142+0000 7f7856ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78580fcbf0 0x7f785810f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51844/0 (socket says 172.21.15.100:51844) 2023-12-05T10:01:32.141 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:32.142+0000 7f7856ffd700 1 -- 172.21.15.100:0/3315925544 learned_addr learned my addr 172.21.15.100:0/3315925544 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T10:01:32.141 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:32.142+0000 7f78567fc700 1 --2- 172.21.15.100:0/3315925544 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78580fde00 0x7f785810fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:01:32.142 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:32.143+0000 7f7856ffd700 1 -- 172.21.15.100:0/3315925544 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78580fde00 msgr2=0x7f785810fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:01:32.142 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:32.143+0000 7f7856ffd700 1 --2- 172.21.15.100:0/3315925544 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78580fde00 0x7f785810fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:01:32.142 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:32.143+0000 7f7856ffd700 1 -- 172.21.15.100:0/3315925544 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7848005040 con 0x7f78580fcbf0 2023-12-05T10:01:32.142 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:32.143+0000 7f7856ffd700 1 --2- 172.21.15.100:0/3315925544 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78580fcbf0 0x7f785810f760 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7848000c00 tx=0x7f7848009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:01:32.142 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:32.143+0000 7f783f7fe700 1 -- 172.21.15.100:0/3315925544 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f784800e040 con 0x7f78580fcbf0 2023-12-05T10:01:32.142 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:32.143+0000 7f783f7fe700 1 -- 172.21.15.100:0/3315925544 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7848013420 con 0x7f78580fcbf0 2023-12-05T10:01:32.142 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:32.143+0000 7f783f7fe700 1 -- 172.21.15.100:0/3315925544 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f784801c630 con 0x7f78580fcbf0 2023-12-05T10:01:32.142 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:32.143+0000 7f785d893700 1 -- 172.21.15.100:0/3315925544 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7858110dc0 con 0x7f78580fcbf0 2023-12-05T10:01:32.142 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:32.143+0000 7f785d893700 1 -- 172.21.15.100:0/3315925544 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7858111300 con 0x7f78580fcbf0 2023-12-05T10:01:32.143 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:32.144+0000 7f785d893700 1 -- 172.21.15.100:0/3315925544 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7858101ea0 con 0x7f78580fcbf0 2023-12-05T10:01:32.143 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:32.146+0000 7f783f7fe700 1 -- 172.21.15.100:0/3315925544 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f7848013590 con 0x7f78580fcbf0 2023-12-05T10:01:32.144 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:32.146+0000 7f783f7fe700 1 --2- 172.21.15.100:0/3315925544 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f784006ce70 0x7f784006f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:01:32.144 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:32.147+0000 7f783f7fe700 1 -- 172.21.15.100:0/3315925544 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f784808d630 con 0x7f78580fcbf0 2023-12-05T10:01:32.144 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:32.147+0000 7f78567fc700 1 --2- 172.21.15.100:0/3315925544 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f784006ce70 0x7f784006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:01:32.145 INFO:journalctl@ceph.osd.2.smithi100.stdout:Dec 05 10:01:31 smithi100 systemd[1]: Stopping Ceph osd.2 for 5b035ce6-9353-11ee-95a2-87774f69a715... 2023-12-05T10:01:32.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:31 smithi100 ceph-mon[187528]: pgmap v83: 65 pgs: 65 active+clean; 195 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-05T10:01:32.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:31 smithi100 ceph-mon[187528]: from='client.44191 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T10:01:32.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:31 smithi100 ceph-mon[187528]: from='client.? 172.21.15.100:0/511479728' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T10:01:32.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:31 smithi100 ceph-mon[187528]: from='client.? 172.21.15.100:0/4050922926' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-05T10:01:32.146 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:32.148+0000 7f78567fc700 1 --2- 172.21.15.100:0/3315925544 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f784006ce70 0x7f784006f320 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f784c004f40 tx=0x7f784c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:01:32.149 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:32.152+0000 7f783f7fe700 1 -- 172.21.15.100:0/3315925544 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f784805afa0 con 0x7f78580fcbf0 2023-12-05T10:01:32.430 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:32.433+0000 7f785d893700 1 -- 172.21.15.100:0/3315925544 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f785802b180 con 0x7f78580fcbf0 2023-12-05T10:01:32.431 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:32.433+0000 7f783f7fe700 1 -- 172.21.15.100:0/3315925544 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f7848013840 con 0x7f78580fcbf0 2023-12-05T10:01:32.431 INFO:teuthology.orchestra.run.smithi100.stdout:HEALTH_OK 2023-12-05T10:01:32.433 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:32.436+0000 7f785d893700 1 -- 172.21.15.100:0/3315925544 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f784006ce70 msgr2=0x7f784006f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:01:32.434 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:32.436+0000 7f785d893700 1 --2- 172.21.15.100:0/3315925544 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f784006ce70 0x7f784006f320 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f784c004f40 tx=0x7f784c00b040 comp rx=0 tx=0).stop 2023-12-05T10:01:32.434 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:32.436+0000 7f785d893700 1 -- 172.21.15.100:0/3315925544 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78580fcbf0 msgr2=0x7f785810f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:01:32.434 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:32.436+0000 7f785d893700 1 --2- 172.21.15.100:0/3315925544 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78580fcbf0 0x7f785810f760 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7848000c00 tx=0x7f7848009e30 comp rx=0 tx=0).stop 2023-12-05T10:01:32.434 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:32.436+0000 7f785d893700 1 -- 172.21.15.100:0/3315925544 shutdown_connections 2023-12-05T10:01:32.434 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:32.436+0000 7f785d893700 1 --2- 172.21.15.100:0/3315925544 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f784006ce70 0x7f784006f320 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:01:32.434 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:32.436+0000 7f785d893700 1 --2- 172.21.15.100:0/3315925544 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78580fcbf0 0x7f785810f760 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:01:32.434 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:32.436+0000 7f785d893700 1 --2- 172.21.15.100:0/3315925544 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78580fde00 0x7f785810fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:01:32.434 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:32.436+0000 7f785d893700 1 -- 172.21.15.100:0/3315925544 >> 172.21.15.100:0/3315925544 conn(0x7f78580f82d0 msgr2=0x7f78580ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:01:32.434 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:32.436+0000 7f785d893700 1 -- 172.21.15.100:0/3315925544 shutdown_connections 2023-12-05T10:01:32.434 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:01:32.436+0000 7f785d893700 1 -- 172.21.15.100:0/3315925544 wait complete. 2023-12-05T10:01:32.645 INFO:journalctl@ceph.osd.2.smithi100.stdout:Dec 05 10:01:32 smithi100 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-2[148987]: 2023-12-05T10:01:32.147+0000 7fc594e71700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-05T10:01:32.645 INFO:journalctl@ceph.osd.2.smithi100.stdout:Dec 05 10:01:32 smithi100 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-2[148987]: 2023-12-05T10:01:32.147+0000 7fc594e71700 -1 osd.2 61 *** Got signal Terminated *** 2023-12-05T10:01:32.645 INFO:journalctl@ceph.osd.2.smithi100.stdout:Dec 05 10:01:32 smithi100 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-2[148987]: 2023-12-05T10:01:32.147+0000 7fc594e71700 -1 osd.2 61 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-05T10:01:33.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:33 smithi150 ceph-mon[171606]: from='client.34266 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T10:01:33.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:33 smithi150 ceph-mon[171606]: osd.2 marked itself down and dead 2023-12-05T10:01:33.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:33 smithi150 ceph-mon[171606]: from='client.? 172.21.15.100:0/3315925544' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-05T10:01:33.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:33 smithi100 ceph-mon[187528]: from='client.34266 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T10:01:33.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:33 smithi100 ceph-mon[187528]: osd.2 marked itself down and dead 2023-12-05T10:01:33.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:33 smithi100 ceph-mon[187528]: from='client.? 172.21.15.100:0/3315925544' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-05T10:01:34.027 INFO:journalctl@ceph.osd.2.smithi100.stdout:Dec 05 10:01:33 smithi100 bash[210326]: ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-2 2023-12-05T10:01:34.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:34 smithi150 ceph-mon[171606]: pgmap v84: 65 pgs: 65 active+clean; 195 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-05T10:01:34.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:34 smithi150 ceph-mon[171606]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-05T10:01:34.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:34 smithi150 ceph-mon[171606]: osdmap e62: 6 total, 5 up, 6 in 2023-12-05T10:01:34.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:34 smithi150 ceph-mon[171606]: failed to encode map e62 with expected crc 2023-12-05T10:01:34.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:34 smithi150 ceph-mon[171606]: failed to encode map e62 with expected crc 2023-12-05T10:01:34.347 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:34 smithi150 ceph-mon[171606]: failed to encode map e62 with expected crc 2023-12-05T10:01:34.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:34 smithi100 ceph-mon[187528]: pgmap v84: 65 pgs: 65 active+clean; 195 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-05T10:01:34.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:34 smithi100 ceph-mon[187528]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-05T10:01:34.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:34 smithi100 ceph-mon[187528]: osdmap e62: 6 total, 5 up, 6 in 2023-12-05T10:01:34.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:34 smithi100 ceph-mon[187528]: failed to encode map e62 with expected crc 2023-12-05T10:01:34.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:34 smithi100 ceph-mon[187528]: failed to encode map e62 with expected crc 2023-12-05T10:01:34.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:34 smithi100 ceph-mon[187528]: failed to encode map e62 with expected crc 2023-12-05T10:01:35.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:35 smithi150 ceph-mon[171606]: osdmap e63: 6 total, 5 up, 6 in 2023-12-05T10:01:35.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:35 smithi150 ceph-mon[171606]: failed to encode map e63 with expected crc 2023-12-05T10:01:35.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:35 smithi150 ceph-mon[171606]: failed to encode map e63 with expected crc 2023-12-05T10:01:35.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:35 smithi150 ceph-mon[171606]: failed to encode map e63 with expected crc 2023-12-05T10:01:35.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:35 smithi150 ceph-mon[171606]: failed to encode map e63 with expected crc 2023-12-05T10:01:35.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:35 smithi150 ceph-mon[171606]: failed to encode map e63 with expected crc 2023-12-05T10:01:35.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:35 smithi150 ceph-mon[171606]: failed to encode map e63 with expected crc 2023-12-05T10:01:35.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:35 smithi150 ceph-mon[171606]: failed to encode map e63 with expected crc 2023-12-05T10:01:35.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:35 smithi100 ceph-mon[187528]: osdmap e63: 6 total, 5 up, 6 in 2023-12-05T10:01:35.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:35 smithi100 ceph-mon[187528]: failed to encode map e63 with expected crc 2023-12-05T10:01:35.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:35 smithi100 ceph-mon[187528]: failed to encode map e63 with expected crc 2023-12-05T10:01:35.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:35 smithi100 ceph-mon[187528]: failed to encode map e63 with expected crc 2023-12-05T10:01:35.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:35 smithi100 ceph-mon[187528]: failed to encode map e63 with expected crc 2023-12-05T10:01:35.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:35 smithi100 ceph-mon[187528]: failed to encode map e63 with expected crc 2023-12-05T10:01:35.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:35 smithi100 ceph-mon[187528]: failed to encode map e63 with expected crc 2023-12-05T10:01:35.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:35 smithi100 ceph-mon[187528]: failed to encode map e63 with expected crc 2023-12-05T10:01:35.855 INFO:journalctl@ceph.osd.2.smithi100.stdout:Dec 05 10:01:35 smithi100 systemd[1]: ceph-5b035ce6-9353-11ee-95a2-87774f69a715@osd.2.service: Succeeded. 2023-12-05T10:01:35.855 INFO:journalctl@ceph.osd.2.smithi100.stdout:Dec 05 10:01:35 smithi100 systemd[1]: Stopped Ceph osd.2 for 5b035ce6-9353-11ee-95a2-87774f69a715. 2023-12-05T10:01:36.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:36 smithi100 ceph-mon[187528]: pgmap v87: 65 pgs: 9 stale+active+clean, 56 active+clean; 195 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-05T10:01:36.145 INFO:journalctl@ceph.osd.2.smithi100.stdout:Dec 05 10:01:35 smithi100 systemd[1]: Starting Ceph osd.2 for 5b035ce6-9353-11ee-95a2-87774f69a715... 2023-12-05T10:01:36.345 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:36 smithi150 ceph-mon[171606]: pgmap v87: 65 pgs: 9 stale+active+clean, 56 active+clean; 195 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-05T10:01:37.396 INFO:journalctl@ceph.osd.2.smithi100.stdout:Dec 05 10:01:37 smithi100 bash[210624]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-05T10:01:37.396 INFO:journalctl@ceph.osd.2.smithi100.stdout:Dec 05 10:01:37 smithi100 bash[210624]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2023-12-05T10:01:37.396 INFO:journalctl@ceph.osd.2.smithi100.stdout:Dec 05 10:01:37 smithi100 bash[210624]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2023-12-05T10:01:37.396 INFO:journalctl@ceph.osd.2.smithi100.stdout:Dec 05 10:01:37 smithi100 bash[210624]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2023-12-05T10:01:37.396 INFO:journalctl@ceph.osd.2.smithi100.stdout:Dec 05 10:01:37 smithi100 bash[210624]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2023-12-05T10:01:37.396 INFO:journalctl@ceph.osd.2.smithi100.stdout:Dec 05 10:01:37 smithi100 bash[210624]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-05T10:01:37.397 INFO:journalctl@ceph.osd.2.smithi100.stdout:Dec 05 10:01:37 smithi100 bash[210624]: --> ceph-volume raw activate successful for osd ID: 2 2023-12-05T10:01:38.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:38 smithi100 ceph-mon[187528]: pgmap v88: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 195 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 31/216 objects degraded (14.352%) 2023-12-05T10:01:38.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:38 smithi100 ceph-mon[187528]: Health check failed: Degraded data redundancy: 31/216 objects degraded (14.352%), 11 pgs degraded (PG_DEGRADED) 2023-12-05T10:01:38.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:38 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:01:38.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:38 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:01:38.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:38 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T10:01:38.146 INFO:journalctl@ceph.osd.2.smithi100.stdout:Dec 05 10:01:37 smithi100 bash[210879]: fb6adf680449db0f113099ca871969f688f1e82e28a951df1e15185eaca46c8f 2023-12-05T10:01:38.146 INFO:journalctl@ceph.osd.2.smithi100.stdout:Dec 05 10:01:37 smithi100 ceph-osd[210917]: -- 172.21.15.100:0/2218639856 <== mon.0 v2:172.21.15.100:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55a9ba5d91e0 con 0x55a9ba5a8c00 2023-12-05T10:01:38.146 INFO:journalctl@ceph.osd.2.smithi100.stdout:Dec 05 10:01:37 smithi100 systemd[1]: Started Ceph osd.2 for 5b035ce6-9353-11ee-95a2-87774f69a715. 2023-12-05T10:01:38.345 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:38 smithi150 ceph-mon[171606]: pgmap v88: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 195 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 31/216 objects degraded (14.352%) 2023-12-05T10:01:38.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:38 smithi150 ceph-mon[171606]: Health check failed: Degraded data redundancy: 31/216 objects degraded (14.352%), 11 pgs degraded (PG_DEGRADED) 2023-12-05T10:01:38.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:38 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:01:38.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:38 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:01:38.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:38 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T10:01:38.645 INFO:journalctl@ceph.osd.2.smithi100.stdout:Dec 05 10:01:38 smithi100 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-2[210894]: 2023-12-05T10:01:38.396+0000 7fce2d7f3640 -1 Falling back to public interface 2023-12-05T10:01:40.345 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:40 smithi150 ceph-mon[171606]: pgmap v89: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 195 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 31/216 objects degraded (14.352%) 2023-12-05T10:01:40.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:40 smithi100 ceph-mon[187528]: pgmap v89: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 195 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 31/216 objects degraded (14.352%) 2023-12-05T10:01:42.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:41 smithi150 ceph-mon[171606]: pgmap v90: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 195 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 31/216 objects degraded (14.352%) 2023-12-05T10:01:42.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:41 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:01:42.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:41 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T10:01:42.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:41 smithi100 ceph-mon[187528]: pgmap v90: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 195 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 31/216 objects degraded (14.352%) 2023-12-05T10:01:42.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:41 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:01:42.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:41 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T10:01:43.395 INFO:journalctl@ceph.osd.2.smithi100.stdout:Dec 05 10:01:42 smithi100 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-2[210894]: 2023-12-05T10:01:42.944+0000 7fce2d7f3640 -1 osd.2 0 read_superblock omap replica is missing. 2023-12-05T10:01:43.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:43 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:01:43.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:43 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:01:43.897 INFO:journalctl@ceph.osd.2.smithi100.stdout:Dec 05 10:01:43 smithi100 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-2[210894]: 2023-12-05T10:01:43.474+0000 7fce2d7f3640 -1 osd.2 61 log_to_monitors true 2023-12-05T10:01:43.897 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:43 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:01:43.897 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:43 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:01:44.799 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:44 smithi100 ceph-mon[187528]: pgmap v91: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 195 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 31/216 objects degraded (14.352%) 2023-12-05T10:01:44.799 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:44 smithi100 ceph-mon[187528]: from='osd.2 [v2:172.21.15.100:6818/4210799164,v1:172.21.15.100:6819/4210799164]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-05T10:01:44.800 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:44 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:01:44.800 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:44 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:01:44.800 INFO:journalctl@ceph.osd.2.smithi100.stdout:Dec 05 10:01:44 smithi100 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-2[210894]: 2023-12-05T10:01:44.492+0000 7fce1ec64700 -1 osd.2 61 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-05T10:01:44.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:44 smithi150 ceph-mon[171606]: pgmap v91: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 195 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 31/216 objects degraded (14.352%) 2023-12-05T10:01:44.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:44 smithi150 ceph-mon[171606]: from='osd.2 [v2:172.21.15.100:6818/4210799164,v1:172.21.15.100:6819/4210799164]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-05T10:01:44.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:44 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:01:44.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:44 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:01:45.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:45 smithi100 ceph-mon[187528]: from='osd.2 [v2:172.21.15.100:6818/4210799164,v1:172.21.15.100:6819/4210799164]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-12-05T10:01:45.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:45 smithi100 ceph-mon[187528]: osdmap e64: 6 total, 5 up, 6 in 2023-12-05T10:01:45.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:45 smithi100 ceph-mon[187528]: from='osd.2 [v2:172.21.15.100:6818/4210799164,v1:172.21.15.100:6819/4210799164]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2023-12-05T10:01:45.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:45 smithi100 ceph-mon[187528]: failed to encode map e64 with expected crc 2023-12-05T10:01:45.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:45 smithi150 ceph-mon[171606]: from='osd.2 [v2:172.21.15.100:6818/4210799164,v1:172.21.15.100:6819/4210799164]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-12-05T10:01:45.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:45 smithi150 ceph-mon[171606]: osdmap e64: 6 total, 5 up, 6 in 2023-12-05T10:01:45.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:45 smithi150 ceph-mon[171606]: from='osd.2 [v2:172.21.15.100:6818/4210799164,v1:172.21.15.100:6819/4210799164]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2023-12-05T10:01:45.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:45 smithi150 ceph-mon[171606]: failed to encode map e64 with expected crc 2023-12-05T10:01:46.774 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:46 smithi100 ceph-mon[187528]: pgmap v93: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 195 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 31/216 objects degraded (14.352%) 2023-12-05T10:01:46.775 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:46 smithi100 ceph-mon[187528]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-05T10:01:46.775 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:46 smithi100 ceph-mon[187528]: osd.2 [v2:172.21.15.100:6818/4210799164,v1:172.21.15.100:6819/4210799164] boot 2023-12-05T10:01:46.775 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:46 smithi100 ceph-mon[187528]: osdmap e65: 6 total, 6 up, 6 in 2023-12-05T10:01:46.775 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:46 smithi100 ceph-mon[187528]: failed to encode map e65 with expected crc 2023-12-05T10:01:46.775 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:46 smithi100 ceph-mon[187528]: failed to encode map e64 with expected crc 2023-12-05T10:01:46.775 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:46 smithi100 ceph-mon[187528]: failed to encode map e64 with expected crc 2023-12-05T10:01:46.775 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:46 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-05T10:01:46.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:46 smithi150 ceph-mon[171606]: pgmap v93: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 195 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 31/216 objects degraded (14.352%) 2023-12-05T10:01:46.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:46 smithi150 ceph-mon[171606]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-05T10:01:46.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:46 smithi150 ceph-mon[171606]: osd.2 [v2:172.21.15.100:6818/4210799164,v1:172.21.15.100:6819/4210799164] boot 2023-12-05T10:01:46.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:46 smithi150 ceph-mon[171606]: osdmap e65: 6 total, 6 up, 6 in 2023-12-05T10:01:46.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:46 smithi150 ceph-mon[171606]: failed to encode map e65 with expected crc 2023-12-05T10:01:46.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:46 smithi150 ceph-mon[171606]: failed to encode map e64 with expected crc 2023-12-05T10:01:46.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:46 smithi150 ceph-mon[171606]: failed to encode map e64 with expected crc 2023-12-05T10:01:46.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:46 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-05T10:01:47.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:47 smithi100 ceph-mon[187528]: failed to encode map e66 with expected crc 2023-12-05T10:01:47.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:47 smithi100 ceph-mon[187528]: osdmap e66: 6 total, 6 up, 6 in 2023-12-05T10:01:47.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:47 smithi100 ceph-mon[187528]: failed to encode map e66 with expected crc 2023-12-05T10:01:47.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:47 smithi100 ceph-mon[187528]: failed to encode map e66 with expected crc 2023-12-05T10:01:47.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:47 smithi100 ceph-mon[187528]: failed to encode map e66 with expected crc 2023-12-05T10:01:47.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:47 smithi100 ceph-mon[187528]: failed to encode map e66 with expected crc 2023-12-05T10:01:47.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:47 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:01:47.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:47 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:01:47.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:47 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T10:01:47.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:47 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T10:01:47.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:47 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:01:47.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:47 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T10:01:47.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:47 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T10:01:47.647 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:47 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T10:01:47.647 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:47 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T10:01:47.647 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:47 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-05T10:01:47.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:47 smithi150 ceph-mon[171606]: failed to encode map e66 with expected crc 2023-12-05T10:01:47.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:47 smithi150 ceph-mon[171606]: osdmap e66: 6 total, 6 up, 6 in 2023-12-05T10:01:47.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:47 smithi150 ceph-mon[171606]: failed to encode map e66 with expected crc 2023-12-05T10:01:47.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:47 smithi150 ceph-mon[171606]: failed to encode map e66 with expected crc 2023-12-05T10:01:47.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:47 smithi150 ceph-mon[171606]: failed to encode map e66 with expected crc 2023-12-05T10:01:47.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:47 smithi150 ceph-mon[171606]: failed to encode map e66 with expected crc 2023-12-05T10:01:47.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:47 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:01:47.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:47 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:01:47.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:47 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T10:01:47.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:47 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T10:01:47.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:47 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:01:47.847 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:47 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T10:01:47.847 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:47 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T10:01:47.847 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:47 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T10:01:47.847 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:47 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T10:01:47.847 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:47 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-05T10:01:48.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:48 smithi150 ceph-mon[171606]: pgmap v96: 65 pgs: 7 active+undersized+degraded, 10 active+undersized, 48 active+clean; 195 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 23/216 objects degraded (10.648%) 2023-12-05T10:01:48.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:48 smithi150 ceph-mon[171606]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-05T10:01:48.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:48 smithi150 ceph-mon[171606]: Upgrade: unsafe to stop osd(s) at this time (6 PGs are or would become offline) 2023-12-05T10:01:48.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:48 smithi150 ceph-mon[171606]: Health check update: Degraded data redundancy: 23/216 objects degraded (10.648%), 7 pgs degraded (PG_DEGRADED) 2023-12-05T10:01:48.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:48 smithi100 ceph-mon[187528]: pgmap v96: 65 pgs: 7 active+undersized+degraded, 10 active+undersized, 48 active+clean; 195 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 23/216 objects degraded (10.648%) 2023-12-05T10:01:48.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:48 smithi100 ceph-mon[187528]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-05T10:01:48.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:48 smithi100 ceph-mon[187528]: Upgrade: unsafe to stop osd(s) at this time (6 PGs are or would become offline) 2023-12-05T10:01:48.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:48 smithi100 ceph-mon[187528]: Health check update: Degraded data redundancy: 23/216 objects degraded (10.648%), 7 pgs degraded (PG_DEGRADED) 2023-12-05T10:01:50.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:50 smithi150 ceph-mon[171606]: pgmap v97: 65 pgs: 7 active+undersized+degraded, 10 active+undersized, 48 active+clean; 195 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 23/216 objects degraded (10.648%) 2023-12-05T10:01:50.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:50 smithi100 ceph-mon[187528]: pgmap v97: 65 pgs: 7 active+undersized+degraded, 10 active+undersized, 48 active+clean; 195 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 23/216 objects degraded (10.648%) 2023-12-05T10:01:51.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:51 smithi150 ceph-mon[171606]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 23/216 objects degraded (10.648%), 7 pgs degraded) 2023-12-05T10:01:51.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:51 smithi150 ceph-mon[171606]: Cluster is now healthy 2023-12-05T10:01:51.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:51 smithi100 ceph-mon[187528]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 23/216 objects degraded (10.648%), 7 pgs degraded) 2023-12-05T10:01:51.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:51 smithi100 ceph-mon[187528]: Cluster is now healthy 2023-12-05T10:01:52.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:52 smithi150 ceph-mon[171606]: pgmap v98: 65 pgs: 65 active+clean; 195 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2023-12-05T10:01:52.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:52 smithi100 ceph-mon[187528]: pgmap v98: 65 pgs: 65 active+clean; 195 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2023-12-05T10:01:54.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:54 smithi150 ceph-mon[171606]: pgmap v99: 65 pgs: 65 active+clean; 195 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2023-12-05T10:01:54.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:54 smithi100 ceph-mon[187528]: pgmap v99: 65 pgs: 65 active+clean; 195 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2023-12-05T10:01:56.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:56 smithi150 ceph-mon[171606]: pgmap v100: 65 pgs: 65 active+clean; 195 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2023-12-05T10:01:56.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:56 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:01:56.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:56 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T10:01:56.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:56 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:01:56.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:56 smithi100 ceph-mon[187528]: pgmap v100: 65 pgs: 65 active+clean; 195 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2023-12-05T10:01:56.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:56 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:01:56.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:56 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T10:01:56.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:56 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:01:58.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:01:58 smithi150 ceph-mon[171606]: pgmap v101: 65 pgs: 65 active+clean; 195 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2023-12-05T10:01:58.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:01:58 smithi100 ceph-mon[187528]: pgmap v101: 65 pgs: 65 active+clean; 195 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2023-12-05T10:02:00.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:00 smithi150 ceph-mon[171606]: pgmap v102: 65 pgs: 65 active+clean; 195 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2023-12-05T10:02:00.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:00 smithi100 ceph-mon[187528]: pgmap v102: 65 pgs: 65 active+clean; 195 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2023-12-05T10:02:02.592 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.594+0000 7f462e0c8700 1 -- 172.21.15.100:0/447536930 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46280fde00 msgr2=0x7f46280fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:02:02.592 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.594+0000 7f462e0c8700 1 --2- 172.21.15.100:0/447536930 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46280fde00 0x7f46280fe250 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f461c004940 tx=0x7f461c009e30 comp rx=0 tx=0).stop 2023-12-05T10:02:02.592 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.594+0000 7f462e0c8700 1 -- 172.21.15.100:0/447536930 shutdown_connections 2023-12-05T10:02:02.592 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.594+0000 7f462e0c8700 1 --2- 172.21.15.100:0/447536930 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46280fde00 0x7f46280fe250 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:02.592 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.594+0000 7f462e0c8700 1 --2- 172.21.15.100:0/447536930 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46280fcbf0 0x7f46280fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:02.592 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.594+0000 7f462e0c8700 1 -- 172.21.15.100:0/447536930 >> 172.21.15.100:0/447536930 conn(0x7f46280f82d0 msgr2=0x7f46280fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:02:02.592 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.594+0000 7f462e0c8700 1 -- 172.21.15.100:0/447536930 shutdown_connections 2023-12-05T10:02:02.592 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.594+0000 7f462e0c8700 1 -- 172.21.15.100:0/447536930 wait complete. 2023-12-05T10:02:02.594 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.595+0000 7f462e0c8700 1 Processor -- start 2023-12-05T10:02:02.594 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.595+0000 7f462e0c8700 1 -- start start 2023-12-05T10:02:02.594 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.595+0000 7f462e0c8700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46280fcbf0 0x7f462810f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:02:02.594 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.595+0000 7f462e0c8700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46280fde00 0x7f462810fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:02:02.594 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.595+0000 7f462e0c8700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4628110310 con 0x7f46280fde00 2023-12-05T10:02:02.594 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.595+0000 7f462e0c8700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4628110b60 con 0x7f46280fcbf0 2023-12-05T10:02:02.594 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.595+0000 7f4626ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46280fde00 0x7f462810fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:02:02.595 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.596+0000 7f4626ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46280fde00 0x7f462810fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43628/0 (socket says 172.21.15.100:43628) 2023-12-05T10:02:02.595 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.596+0000 7f46277fe700 1 --2- 172.21.15.100:0/4075040881 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46280fcbf0 0x7f462810f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:02:02.595 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.596+0000 7f4626ffd700 1 -- 172.21.15.100:0/4075040881 learned_addr learned my addr 172.21.15.100:0/4075040881 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T10:02:02.595 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.596+0000 7f4626ffd700 1 -- 172.21.15.100:0/4075040881 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46280fcbf0 msgr2=0x7f462810f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:02:02.595 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.596+0000 7f4626ffd700 1 --2- 172.21.15.100:0/4075040881 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46280fcbf0 0x7f462810f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:02.595 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.596+0000 7f4626ffd700 1 -- 172.21.15.100:0/4075040881 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f461c005040 con 0x7f46280fde00 2023-12-05T10:02:02.595 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.596+0000 7f46277fe700 1 --2- 172.21.15.100:0/4075040881 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46280fcbf0 0x7f462810f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-05T10:02:02.595 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.596+0000 7f4626ffd700 1 --2- 172.21.15.100:0/4075040881 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46280fde00 0x7f462810fd10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f461c00b3b0 tx=0x7f461c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:02:02.595 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.597+0000 7f460ffff700 1 -- 172.21.15.100:0/4075040881 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f461c00e040 con 0x7f46280fde00 2023-12-05T10:02:02.595 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.597+0000 7f460ffff700 1 -- 172.21.15.100:0/4075040881 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f461c00bc50 con 0x7f46280fde00 2023-12-05T10:02:02.595 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.597+0000 7f460ffff700 1 -- 172.21.15.100:0/4075040881 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f461c01c630 con 0x7f46280fde00 2023-12-05T10:02:02.595 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.597+0000 7f462e0c8700 1 -- 172.21.15.100:0/4075040881 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4628110de0 con 0x7f46280fde00 2023-12-05T10:02:02.595 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.597+0000 7f462e0c8700 1 -- 172.21.15.100:0/4075040881 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4628111320 con 0x7f46280fde00 2023-12-05T10:02:02.596 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.598+0000 7f462e0c8700 1 -- 172.21.15.100:0/4075040881 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4628101ea0 con 0x7f46280fde00 2023-12-05T10:02:02.596 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.599+0000 7f460ffff700 1 -- 172.21.15.100:0/4075040881 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f461c013420 con 0x7f46280fde00 2023-12-05T10:02:02.598 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.600+0000 7f460ffff700 1 --2- 172.21.15.100:0/4075040881 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f461006ce70 0x7f461006f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:02:02.598 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.600+0000 7f460ffff700 1 -- 172.21.15.100:0/4075040881 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f461c08d650 con 0x7f46280fde00 2023-12-05T10:02:02.598 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.601+0000 7f46277fe700 1 --2- 172.21.15.100:0/4075040881 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f461006ce70 0x7f461006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:02:02.598 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.601+0000 7f46277fe700 1 --2- 172.21.15.100:0/4075040881 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f461006ce70 0x7f461006f320 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f46280fdc60 tx=0x7f461800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:02:02.603 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.605+0000 7f460ffff700 1 -- 172.21.15.100:0/4075040881 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f461c05b080 con 0x7f46280fde00 2023-12-05T10:02:02.824 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.826+0000 7f462e0c8700 1 -- 172.21.15.100:0/4075040881 --> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f462802b150 con 0x7f461006ce70 2023-12-05T10:02:02.825 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.828+0000 7f460ffff700 1 -- 172.21.15.100:0/4075040881 <== mgr.34104 v2:172.21.15.100:6800/3489431924 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f462802b150 con 0x7f461006ce70 2023-12-05T10:02:02.828 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.830+0000 7f462e0c8700 1 -- 172.21.15.100:0/4075040881 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f461006ce70 msgr2=0x7f461006f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:02:02.828 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.830+0000 7f462e0c8700 1 --2- 172.21.15.100:0/4075040881 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f461006ce70 0x7f461006f320 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f46280fdc60 tx=0x7f461800b040 comp rx=0 tx=0).stop 2023-12-05T10:02:02.828 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.830+0000 7f462e0c8700 1 -- 172.21.15.100:0/4075040881 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46280fde00 msgr2=0x7f462810fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:02:02.828 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.830+0000 7f462e0c8700 1 --2- 172.21.15.100:0/4075040881 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46280fde00 0x7f462810fd10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f461c00b3b0 tx=0x7f461c009e30 comp rx=0 tx=0).stop 2023-12-05T10:02:02.828 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.830+0000 7f462e0c8700 1 -- 172.21.15.100:0/4075040881 shutdown_connections 2023-12-05T10:02:02.828 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.830+0000 7f462e0c8700 1 --2- 172.21.15.100:0/4075040881 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f461006ce70 0x7f461006f320 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:02.828 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.830+0000 7f462e0c8700 1 --2- 172.21.15.100:0/4075040881 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46280fcbf0 0x7f462810f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:02.828 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.830+0000 7f462e0c8700 1 --2- 172.21.15.100:0/4075040881 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46280fde00 0x7f462810fd10 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:02.828 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.830+0000 7f462e0c8700 1 -- 172.21.15.100:0/4075040881 >> 172.21.15.100:0/4075040881 conn(0x7f46280f82d0 msgr2=0x7f46280ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:02:02.828 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.830+0000 7f462e0c8700 1 -- 172.21.15.100:0/4075040881 shutdown_connections 2023-12-05T10:02:02.828 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.830+0000 7f462e0c8700 1 -- 172.21.15.100:0/4075040881 wait complete. 2023-12-05T10:02:02.844 INFO:teuthology.orchestra.run.smithi100.stdout:true 2023-12-05T10:02:02.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:02 smithi150 ceph-mon[171606]: pgmap v103: 65 pgs: 65 active+clean; 195 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2023-12-05T10:02:02.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:02 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-05T10:02:02.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:02 smithi100 ceph-mon[187528]: pgmap v103: 65 pgs: 65 active+clean; 195 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2023-12-05T10:02:02.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:02 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-05T10:02:02.966 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.967+0000 7f262f0a8700 1 -- 172.21.15.100:0/3642255114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26280fdc10 msgr2=0x7f26280fe060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:02:02.966 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.967+0000 7f262f0a8700 1 --2- 172.21.15.100:0/3642255114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26280fdc10 0x7f26280fe060 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2618004940 tx=0x7f2618009e30 comp rx=0 tx=0).stop 2023-12-05T10:02:02.966 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.968+0000 7f262f0a8700 1 -- 172.21.15.100:0/3642255114 shutdown_connections 2023-12-05T10:02:02.966 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.968+0000 7f262f0a8700 1 --2- 172.21.15.100:0/3642255114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26280fdc10 0x7f26280fe060 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:02.967 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.968+0000 7f262f0a8700 1 --2- 172.21.15.100:0/3642255114 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26280fca00 0x7f26280fce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:02.967 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.968+0000 7f262f0a8700 1 -- 172.21.15.100:0/3642255114 >> 172.21.15.100:0/3642255114 conn(0x7f26280f80e0 msgr2=0x7f26280fa4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:02:02.967 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.968+0000 7f262f0a8700 1 -- 172.21.15.100:0/3642255114 shutdown_connections 2023-12-05T10:02:02.967 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.968+0000 7f262f0a8700 1 -- 172.21.15.100:0/3642255114 wait complete. 2023-12-05T10:02:02.968 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.969+0000 7f262f0a8700 1 Processor -- start 2023-12-05T10:02:02.968 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.969+0000 7f262f0a8700 1 -- start start 2023-12-05T10:02:02.968 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.969+0000 7f262f0a8700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26280fca00 0x7f262810f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:02:02.968 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.969+0000 7f262f0a8700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26280fdc10 0x7f262810fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:02:02.968 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.969+0000 7f262f0a8700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2628110040 con 0x7f26280fca00 2023-12-05T10:02:02.969 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.969+0000 7f262f0a8700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26281108e0 con 0x7f26280fdc10 2023-12-05T10:02:02.969 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.969+0000 7f262e0a6700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26280fca00 0x7f262810f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:02:02.969 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.969+0000 7f262e0a6700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26280fca00 0x7f262810f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43658/0 (socket says 172.21.15.100:43658) 2023-12-05T10:02:02.969 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.969+0000 7f262e0a6700 1 -- 172.21.15.100:0/1377052893 learned_addr learned my addr 172.21.15.100:0/1377052893 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T10:02:02.969 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.969+0000 7f262d8a5700 1 --2- 172.21.15.100:0/1377052893 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26280fdc10 0x7f262810fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:02:02.969 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.970+0000 7f262e0a6700 1 -- 172.21.15.100:0/1377052893 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26280fdc10 msgr2=0x7f262810fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:02:02.969 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.970+0000 7f262e0a6700 1 --2- 172.21.15.100:0/1377052893 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26280fdc10 0x7f262810fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:02.969 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.970+0000 7f262e0a6700 1 -- 172.21.15.100:0/1377052893 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2618005040 con 0x7f26280fca00 2023-12-05T10:02:02.969 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.970+0000 7f262e0a6700 1 --2- 172.21.15.100:0/1377052893 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26280fca00 0x7f262810f500 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2624002a80 tx=0x7f2624004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:02:02.969 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.970+0000 7f261effd700 1 -- 172.21.15.100:0/1377052893 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2624007cc0 con 0x7f26280fca00 2023-12-05T10:02:02.969 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.970+0000 7f261effd700 1 -- 172.21.15.100:0/1377052893 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f262400f040 con 0x7f26280fca00 2023-12-05T10:02:02.969 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.970+0000 7f262f0a8700 1 -- 172.21.15.100:0/1377052893 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2628110bc0 con 0x7f26280fca00 2023-12-05T10:02:02.969 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.970+0000 7f261effd700 1 -- 172.21.15.100:0/1377052893 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f262400d9c0 con 0x7f26280fca00 2023-12-05T10:02:02.969 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.970+0000 7f262f0a8700 1 -- 172.21.15.100:0/1377052893 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2628111100 con 0x7f26280fca00 2023-12-05T10:02:02.970 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.971+0000 7f262f0a8700 1 -- 172.21.15.100:0/1377052893 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2628101cb0 con 0x7f26280fca00 2023-12-05T10:02:02.970 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.972+0000 7f261effd700 1 -- 172.21.15.100:0/1377052893 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f262400db20 con 0x7f26280fca00 2023-12-05T10:02:02.971 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.973+0000 7f261effd700 1 --2- 172.21.15.100:0/1377052893 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f261406ce70 0x7f261406f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:02:02.971 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.973+0000 7f261effd700 1 -- 172.21.15.100:0/1377052893 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f262408c0d0 con 0x7f26280fca00 2023-12-05T10:02:02.971 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.973+0000 7f262d8a5700 1 --2- 172.21.15.100:0/1377052893 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f261406ce70 0x7f261406f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:02:02.971 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.974+0000 7f262d8a5700 1 --2- 172.21.15.100:0/1377052893 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f261406ce70 0x7f261406f320 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f26180043d0 tx=0x7f2618009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:02:02.975 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:02.978+0000 7f261effd700 1 -- 172.21.15.100:0/1377052893 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f2624059940 con 0x7f26280fca00 2023-12-05T10:02:03.191 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.194+0000 7f262f0a8700 1 -- 172.21.15.100:0/1377052893 --> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2628111490 con 0x7f261406ce70 2023-12-05T10:02:03.192 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.195+0000 7f261effd700 1 -- 172.21.15.100:0/1377052893 <== mgr.34104 v2:172.21.15.100:6800/3489431924 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f2628111490 con 0x7f261406ce70 2023-12-05T10:02:03.195 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.197+0000 7f262f0a8700 1 -- 172.21.15.100:0/1377052893 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f261406ce70 msgr2=0x7f261406f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:02:03.195 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.197+0000 7f262f0a8700 1 --2- 172.21.15.100:0/1377052893 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f261406ce70 0x7f261406f320 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f26180043d0 tx=0x7f2618009e30 comp rx=0 tx=0).stop 2023-12-05T10:02:03.195 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.197+0000 7f262f0a8700 1 -- 172.21.15.100:0/1377052893 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26280fca00 msgr2=0x7f262810f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:02:03.195 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.197+0000 7f262f0a8700 1 --2- 172.21.15.100:0/1377052893 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26280fca00 0x7f262810f500 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2624002a80 tx=0x7f2624004600 comp rx=0 tx=0).stop 2023-12-05T10:02:03.195 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.197+0000 7f262f0a8700 1 -- 172.21.15.100:0/1377052893 shutdown_connections 2023-12-05T10:02:03.195 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.197+0000 7f262f0a8700 1 --2- 172.21.15.100:0/1377052893 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f261406ce70 0x7f261406f320 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:03.195 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.197+0000 7f262f0a8700 1 --2- 172.21.15.100:0/1377052893 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26280fca00 0x7f262810f500 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:03.196 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.197+0000 7f262f0a8700 1 --2- 172.21.15.100:0/1377052893 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26280fdc10 0x7f262810fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:03.196 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.197+0000 7f262f0a8700 1 -- 172.21.15.100:0/1377052893 >> 172.21.15.100:0/1377052893 conn(0x7f26280f80e0 msgr2=0x7f26280fee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:02:03.196 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.198+0000 7f262f0a8700 1 -- 172.21.15.100:0/1377052893 shutdown_connections 2023-12-05T10:02:03.196 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.198+0000 7f262f0a8700 1 -- 172.21.15.100:0/1377052893 wait complete. 2023-12-05T10:02:03.330 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.332+0000 7f252fa2b700 1 -- 172.21.15.100:0/563150396 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25280fcbf0 msgr2=0x7f25280fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:02:03.330 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.332+0000 7f252fa2b700 1 --2- 172.21.15.100:0/563150396 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25280fcbf0 0x7f25280fd000 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2524004940 tx=0x7f2524009e30 comp rx=0 tx=0).stop 2023-12-05T10:02:03.330 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.332+0000 7f252fa2b700 1 -- 172.21.15.100:0/563150396 shutdown_connections 2023-12-05T10:02:03.330 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.332+0000 7f252fa2b700 1 --2- 172.21.15.100:0/563150396 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25280fde00 0x7f25280fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:03.330 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.332+0000 7f252fa2b700 1 --2- 172.21.15.100:0/563150396 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25280fcbf0 0x7f25280fd000 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:03.330 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.332+0000 7f252fa2b700 1 -- 172.21.15.100:0/563150396 >> 172.21.15.100:0/563150396 conn(0x7f25280f82d0 msgr2=0x7f25280fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:02:03.331 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.332+0000 7f252fa2b700 1 -- 172.21.15.100:0/563150396 shutdown_connections 2023-12-05T10:02:03.331 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.332+0000 7f252fa2b700 1 -- 172.21.15.100:0/563150396 wait complete. 2023-12-05T10:02:03.332 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.333+0000 7f252fa2b700 1 Processor -- start 2023-12-05T10:02:03.332 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.333+0000 7f252fa2b700 1 -- start start 2023-12-05T10:02:03.332 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.333+0000 7f252fa2b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25280fcbf0 0x7f2528071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:02:03.332 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.333+0000 7f252fa2b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25280fde00 0x7f252806ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:02:03.333 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.333+0000 7f252fa2b700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2528070590 con 0x7f25280fcbf0 2023-12-05T10:02:03.333 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.333+0000 7f252fa2b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2528070700 con 0x7f25280fde00 2023-12-05T10:02:03.333 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.334+0000 7f252d7c7700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25280fcbf0 0x7f2528071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:02:03.333 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.334+0000 7f252d7c7700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25280fcbf0 0x7f2528071b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43678/0 (socket says 172.21.15.100:43678) 2023-12-05T10:02:03.333 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.334+0000 7f252d7c7700 1 -- 172.21.15.100:0/1365400042 learned_addr learned my addr 172.21.15.100:0/1365400042 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T10:02:03.333 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.334+0000 7f252cfc6700 1 --2- 172.21.15.100:0/1365400042 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25280fde00 0x7f252806ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:02:03.333 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.334+0000 7f252d7c7700 1 -- 172.21.15.100:0/1365400042 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25280fde00 msgr2=0x7f252806ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:02:03.334 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.334+0000 7f252d7c7700 1 --2- 172.21.15.100:0/1365400042 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25280fde00 0x7f252806ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:03.334 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.334+0000 7f252d7c7700 1 -- 172.21.15.100:0/1365400042 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2524005040 con 0x7f25280fcbf0 2023-12-05T10:02:03.334 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.334+0000 7f252d7c7700 1 --2- 172.21.15.100:0/1365400042 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25280fcbf0 0x7f2528071b10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2524000c00 tx=0x7f2524009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:02:03.334 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.335+0000 7f251dffb700 1 -- 172.21.15.100:0/1365400042 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f252400e040 con 0x7f25280fcbf0 2023-12-05T10:02:03.334 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.335+0000 7f251dffb700 1 -- 172.21.15.100:0/1365400042 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2524013420 con 0x7f25280fcbf0 2023-12-05T10:02:03.334 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.335+0000 7f252fa2b700 1 -- 172.21.15.100:0/1365400042 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2528070980 con 0x7f25280fcbf0 2023-12-05T10:02:03.334 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.335+0000 7f251dffb700 1 -- 172.21.15.100:0/1365400042 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f252401c630 con 0x7f25280fcbf0 2023-12-05T10:02:03.334 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.335+0000 7f252fa2b700 1 -- 172.21.15.100:0/1365400042 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2528115590 con 0x7f25280fcbf0 2023-12-05T10:02:03.335 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.336+0000 7f252fa2b700 1 -- 172.21.15.100:0/1365400042 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f252804bb80 con 0x7f25280fcbf0 2023-12-05T10:02:03.335 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.337+0000 7f251dffb700 1 -- 172.21.15.100:0/1365400042 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f2524013590 con 0x7f25280fcbf0 2023-12-05T10:02:03.336 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.337+0000 7f251dffb700 1 --2- 172.21.15.100:0/1365400042 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f251406ce70 0x7f251406f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:02:03.336 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.338+0000 7f251dffb700 1 -- 172.21.15.100:0/1365400042 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f252408d690 con 0x7f25280fcbf0 2023-12-05T10:02:03.336 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.338+0000 7f252cfc6700 1 --2- 172.21.15.100:0/1365400042 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f251406ce70 0x7f251406f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:02:03.336 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.338+0000 7f252cfc6700 1 --2- 172.21.15.100:0/1365400042 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f251406ce70 0x7f251406f320 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2518004f40 tx=0x7f251800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:02:03.339 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.342+0000 7f251dffb700 1 -- 172.21.15.100:0/1365400042 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f252405af80 con 0x7f25280fcbf0 2023-12-05T10:02:03.544 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.546+0000 7f252fa2b700 1 -- 172.21.15.100:0/1365400042 --> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2528102750 con 0x7f251406ce70 2023-12-05T10:02:03.554 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.556+0000 7f251dffb700 1 -- 172.21.15.100:0/1365400042 <== mgr.34104 v2:172.21.15.100:6800/3489431924 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f2528102750 con 0x7f251406ce70 2023-12-05T10:02:03.555 INFO:teuthology.orchestra.run.smithi100.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-05T10:02:03.555 INFO:teuthology.orchestra.run.smithi100.stdout:alertmanager.smithi100 smithi100 *:9093,9094 running (4m) 21s ago 12m 14.7M - 0.25.0 c8568f914cd2 f443e6a4242b 2023-12-05T10:02:03.555 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi100 smithi100 running (119s) 21s ago 12m 7843k - 19.0.0-11-g3fe8d441 56dea28e5206 fb8e6b844fba 2023-12-05T10:02:03.555 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi150 smithi150 running (115s) 112s ago 11m 7847k - 19.0.0-11-g3fe8d441 56dea28e5206 a035052de6cf 2023-12-05T10:02:03.555 INFO:teuthology.orchestra.run.smithi100.stdout:grafana.smithi100 smithi100 *:3000 running (4m) 21s ago 11m 80.1M - 9.4.7 2c41d148cca3 d666da9c4e4d 2023-12-05T10:02:03.555 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.akmstb smithi100 running (7m) 21s ago 7m 10.5G - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 6ce55c42c55b 2023-12-05T10:02:03.555 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.sqplhn smithi100 running (7m) 21s ago 7m 15.9M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc c2682d65f0c9 2023-12-05T10:02:03.555 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi150.fcnhsv smithi150 running (7m) 112s ago 7m 15.1M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 1a259762235d 2023-12-05T10:02:03.555 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi150.pcbpxm smithi150 running (7m) 112s ago 7m 15.2M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 27f730f8b9f9 2023-12-05T10:02:03.555 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi100.ehmuhg smithi100 *:8443,9283,8765 running (4m) 21s ago 13m 516M - 19.0.0-11-g3fe8d441 56dea28e5206 ebe3dfbb0356 2023-12-05T10:02:03.555 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi150.zkskag smithi150 *:8443,9283,8765 running (3m) 112s ago 11m 451M - 19.0.0-11-g3fe8d441 56dea28e5206 a2b40e2421f2 2023-12-05T10:02:03.555 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi100 smithi100 running (3m) 21s ago 13m 70.8M 2048M 19.0.0-11-g3fe8d441 56dea28e5206 21003fd7eaf4 2023-12-05T10:02:03.556 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi150 smithi150 running (2m) 112s ago 11m 35.5M 2048M 19.0.0-11-g3fe8d441 56dea28e5206 010f2f658fca 2023-12-05T10:02:03.556 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi100 smithi100 *:9100 running (4m) 21s ago 12m 8288k - 1.5.0 0da6a335fe13 a2653da0d840 2023-12-05T10:02:03.556 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi150 smithi150 *:9100 running (4m) 112s ago 11m 8170k - 1.5.0 0da6a335fe13 67523645e73b 2023-12-05T10:02:03.556 INFO:teuthology.orchestra.run.smithi100.stdout:osd.0 smithi100 running (95s) 21s ago 10m 133M 1618M 19.0.0-11-g3fe8d441 56dea28e5206 a29add095f14 2023-12-05T10:02:03.556 INFO:teuthology.orchestra.run.smithi100.stdout:osd.1 smithi100 running (60s) 21s ago 10m 135M 1618M 19.0.0-11-g3fe8d441 56dea28e5206 2de00a9dc686 2023-12-05T10:02:03.556 INFO:teuthology.orchestra.run.smithi100.stdout:osd.2 smithi100 running (25s) 21s ago 9m 12.6M 1618M 19.0.0-11-g3fe8d441 56dea28e5206 fb6adf680449 2023-12-05T10:02:03.556 INFO:teuthology.orchestra.run.smithi100.stdout:osd.3 smithi150 running (9m) 112s ago 9m 1168M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 78137d463d29 2023-12-05T10:02:03.556 INFO:teuthology.orchestra.run.smithi100.stdout:osd.4 smithi150 running (8m) 112s ago 8m 848M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc dfef9accd162 2023-12-05T10:02:03.556 INFO:teuthology.orchestra.run.smithi100.stdout:osd.5 smithi150 running (8m) 112s ago 8m 994M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc d9720b1eae0c 2023-12-05T10:02:03.556 INFO:teuthology.orchestra.run.smithi100.stdout:prometheus.smithi100 smithi100 *:9095 running (3m) 21s ago 11m 59.7M - 2.43.0 a07b618ecd1d 8ade75deb316 2023-12-05T10:02:03.557 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.559+0000 7f252fa2b700 1 -- 172.21.15.100:0/1365400042 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f251406ce70 msgr2=0x7f251406f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:02:03.557 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.559+0000 7f252fa2b700 1 --2- 172.21.15.100:0/1365400042 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f251406ce70 0x7f251406f320 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2518004f40 tx=0x7f251800b040 comp rx=0 tx=0).stop 2023-12-05T10:02:03.557 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.559+0000 7f252fa2b700 1 -- 172.21.15.100:0/1365400042 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25280fcbf0 msgr2=0x7f2528071b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:02:03.557 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.559+0000 7f252fa2b700 1 --2- 172.21.15.100:0/1365400042 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25280fcbf0 0x7f2528071b10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2524000c00 tx=0x7f2524009e30 comp rx=0 tx=0).stop 2023-12-05T10:02:03.557 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.559+0000 7f252fa2b700 1 -- 172.21.15.100:0/1365400042 shutdown_connections 2023-12-05T10:02:03.557 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.559+0000 7f252fa2b700 1 --2- 172.21.15.100:0/1365400042 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f251406ce70 0x7f251406f320 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:03.557 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.559+0000 7f252fa2b700 1 --2- 172.21.15.100:0/1365400042 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25280fcbf0 0x7f2528071b10 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:03.557 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.559+0000 7f252fa2b700 1 --2- 172.21.15.100:0/1365400042 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25280fde00 0x7f252806ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:03.558 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.559+0000 7f252fa2b700 1 -- 172.21.15.100:0/1365400042 >> 172.21.15.100:0/1365400042 conn(0x7f25280f82d0 msgr2=0x7f2528101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:02:03.558 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.559+0000 7f252fa2b700 1 -- 172.21.15.100:0/1365400042 shutdown_connections 2023-12-05T10:02:03.558 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.559+0000 7f252fa2b700 1 -- 172.21.15.100:0/1365400042 wait complete. 2023-12-05T10:02:03.693 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.695+0000 7fc315484700 1 -- 172.21.15.100:0/3116748663 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3100fcbf0 msgr2=0x7fc3100fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:02:03.694 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.695+0000 7fc315484700 1 --2- 172.21.15.100:0/3116748663 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3100fcbf0 0x7fc3100fd000 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc300004940 tx=0x7fc300009e30 comp rx=0 tx=0).stop 2023-12-05T10:02:03.694 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.696+0000 7fc315484700 1 -- 172.21.15.100:0/3116748663 shutdown_connections 2023-12-05T10:02:03.694 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.696+0000 7fc315484700 1 --2- 172.21.15.100:0/3116748663 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3100fde00 0x7fc3100fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:03.694 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.696+0000 7fc315484700 1 --2- 172.21.15.100:0/3116748663 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3100fcbf0 0x7fc3100fd000 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:03.694 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.696+0000 7fc315484700 1 -- 172.21.15.100:0/3116748663 >> 172.21.15.100:0/3116748663 conn(0x7fc3100f82d0 msgr2=0x7fc3100fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:02:03.694 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.696+0000 7fc315484700 1 -- 172.21.15.100:0/3116748663 shutdown_connections 2023-12-05T10:02:03.694 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.696+0000 7fc315484700 1 -- 172.21.15.100:0/3116748663 wait complete. 2023-12-05T10:02:03.695 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.696+0000 7fc315484700 1 Processor -- start 2023-12-05T10:02:03.695 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.697+0000 7fc315484700 1 -- start start 2023-12-05T10:02:03.695 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.697+0000 7fc315484700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3100fcbf0 0x7fc31010d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:02:03.695 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.697+0000 7fc315484700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3100fde00 0x7fc31010da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:02:03.695 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.697+0000 7fc315484700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc31010e010 con 0x7fc3100fcbf0 2023-12-05T10:02:03.695 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.697+0000 7fc315484700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc31010e8b0 con 0x7fc3100fde00 2023-12-05T10:02:03.696 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.697+0000 7fc30effd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3100fcbf0 0x7fc31010d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:02:03.696 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.697+0000 7fc30effd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3100fcbf0 0x7fc31010d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43682/0 (socket says 172.21.15.100:43682) 2023-12-05T10:02:03.696 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.697+0000 7fc30effd700 1 -- 172.21.15.100:0/420570487 learned_addr learned my addr 172.21.15.100:0/420570487 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T10:02:03.696 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.697+0000 7fc30e7fc700 1 --2- 172.21.15.100:0/420570487 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3100fde00 0x7fc31010da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:02:03.696 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.698+0000 7fc30effd700 1 -- 172.21.15.100:0/420570487 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3100fde00 msgr2=0x7fc31010da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:02:03.696 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.698+0000 7fc30effd700 1 --2- 172.21.15.100:0/420570487 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3100fde00 0x7fc31010da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:03.696 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.698+0000 7fc30effd700 1 -- 172.21.15.100:0/420570487 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc300005040 con 0x7fc3100fcbf0 2023-12-05T10:02:03.696 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.698+0000 7fc30effd700 1 --2- 172.21.15.100:0/420570487 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3100fcbf0 0x7fc31010d4d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc300008f80 tx=0x7fc300009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:02:03.697 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.698+0000 7fc2f77fe700 1 -- 172.21.15.100:0/420570487 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc300021070 con 0x7fc3100fcbf0 2023-12-05T10:02:03.697 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.698+0000 7fc315484700 1 -- 172.21.15.100:0/420570487 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc31010eb30 con 0x7fc3100fcbf0 2023-12-05T10:02:03.697 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.698+0000 7fc2f77fe700 1 -- 172.21.15.100:0/420570487 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc30001c400 con 0x7fc3100fcbf0 2023-12-05T10:02:03.697 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.698+0000 7fc2f77fe700 1 -- 172.21.15.100:0/420570487 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc30000e070 con 0x7fc3100fcbf0 2023-12-05T10:02:03.697 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.698+0000 7fc315484700 1 -- 172.21.15.100:0/420570487 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc31010f010 con 0x7fc3100fcbf0 2023-12-05T10:02:03.697 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.699+0000 7fc315484700 1 -- 172.21.15.100:0/420570487 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc31004bb80 con 0x7fc3100fcbf0 2023-12-05T10:02:03.698 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.700+0000 7fc2f77fe700 1 -- 172.21.15.100:0/420570487 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fc30001c950 con 0x7fc3100fcbf0 2023-12-05T10:02:03.699 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.701+0000 7fc2f77fe700 1 --2- 172.21.15.100:0/420570487 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fc2f806ce70 0x7fc2f806f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:02:03.699 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.701+0000 7fc2f77fe700 1 -- 172.21.15.100:0/420570487 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fc30008d4f0 con 0x7fc3100fcbf0 2023-12-05T10:02:03.699 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.701+0000 7fc30e7fc700 1 --2- 172.21.15.100:0/420570487 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fc2f806ce70 0x7fc2f806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:02:03.699 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.702+0000 7fc30e7fc700 1 --2- 172.21.15.100:0/420570487 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fc2f806ce70 0x7fc2f806f320 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc304009b80 tx=0x7fc30400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:02:03.703 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.706+0000 7fc2f77fe700 1 -- 172.21.15.100:0/420570487 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fc30005ae80 con 0x7fc3100fcbf0 2023-12-05T10:02:03.845 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:03 smithi150 ceph-mon[171606]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-05T10:02:03.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:03 smithi150 ceph-mon[171606]: Upgrade: osd.3 is safe to restart 2023-12-05T10:02:03.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:03 smithi100 ceph-mon[187528]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-05T10:02:03.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:03 smithi100 ceph-mon[187528]: Upgrade: osd.3 is safe to restart 2023-12-05T10:02:03.986 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.989+0000 7fc315484700 1 -- 172.21.15.100:0/420570487 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc31010f3f0 con 0x7fc3100fcbf0 2023-12-05T10:02:03.987 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.989+0000 7fc2f77fe700 1 -- 172.21.15.100:0/420570487 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+827 (secure 0 0 0) 0x7fc30005aa10 con 0x7fc3100fcbf0 2023-12-05T10:02:03.987 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2023-12-05T10:02:03.987 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": { 2023-12-05T10:02:03.987 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 2 2023-12-05T10:02:03.987 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-12-05T10:02:03.987 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": { 2023-12-05T10:02:03.987 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 2 2023-12-05T10:02:03.987 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-12-05T10:02:03.988 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": { 2023-12-05T10:02:03.988 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 3, 2023-12-05T10:02:03.988 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 3 2023-12-05T10:02:03.988 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-12-05T10:02:03.988 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": { 2023-12-05T10:02:03.988 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 4 2023-12-05T10:02:03.988 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-12-05T10:02:03.988 INFO:teuthology.orchestra.run.smithi100.stdout: "overall": { 2023-12-05T10:02:03.988 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 7, 2023-12-05T10:02:03.988 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 7 2023-12-05T10:02:03.988 INFO:teuthology.orchestra.run.smithi100.stdout: } 2023-12-05T10:02:03.988 INFO:teuthology.orchestra.run.smithi100.stdout:} 2023-12-05T10:02:03.989 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.992+0000 7fc315484700 1 -- 172.21.15.100:0/420570487 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fc2f806ce70 msgr2=0x7fc2f806f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:02:03.990 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.992+0000 7fc315484700 1 --2- 172.21.15.100:0/420570487 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fc2f806ce70 0x7fc2f806f320 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc304009b80 tx=0x7fc30400b040 comp rx=0 tx=0).stop 2023-12-05T10:02:03.990 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.992+0000 7fc315484700 1 -- 172.21.15.100:0/420570487 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3100fcbf0 msgr2=0x7fc31010d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:02:03.990 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.992+0000 7fc315484700 1 --2- 172.21.15.100:0/420570487 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3100fcbf0 0x7fc31010d4d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc300008f80 tx=0x7fc300009e30 comp rx=0 tx=0).stop 2023-12-05T10:02:03.990 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.992+0000 7fc315484700 1 -- 172.21.15.100:0/420570487 shutdown_connections 2023-12-05T10:02:03.990 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.992+0000 7fc315484700 1 --2- 172.21.15.100:0/420570487 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fc2f806ce70 0x7fc2f806f320 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:03.990 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.992+0000 7fc315484700 1 --2- 172.21.15.100:0/420570487 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3100fcbf0 0x7fc31010d4d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:03.990 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.992+0000 7fc315484700 1 --2- 172.21.15.100:0/420570487 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3100fde00 0x7fc31010da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:03.990 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.992+0000 7fc315484700 1 -- 172.21.15.100:0/420570487 >> 172.21.15.100:0/420570487 conn(0x7fc3100f82d0 msgr2=0x7fc310101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:02:03.990 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.992+0000 7fc315484700 1 -- 172.21.15.100:0/420570487 shutdown_connections 2023-12-05T10:02:03.990 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:03.992+0000 7fc315484700 1 -- 172.21.15.100:0/420570487 wait complete. 2023-12-05T10:02:04.125 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.126+0000 7fed82998700 1 -- 172.21.15.100:0/1965743428 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed7c0fcbf0 msgr2=0x7fed7c0fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:02:04.125 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.126+0000 7fed82998700 1 --2- 172.21.15.100:0/1965743428 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed7c0fcbf0 0x7fed7c0fd000 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fed6c004940 tx=0x7fed6c009e30 comp rx=0 tx=0).stop 2023-12-05T10:02:04.125 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.126+0000 7fed82998700 1 -- 172.21.15.100:0/1965743428 shutdown_connections 2023-12-05T10:02:04.125 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.126+0000 7fed82998700 1 --2- 172.21.15.100:0/1965743428 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fed7c0fde00 0x7fed7c0fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:04.125 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.126+0000 7fed82998700 1 --2- 172.21.15.100:0/1965743428 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed7c0fcbf0 0x7fed7c0fd000 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:04.125 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.126+0000 7fed82998700 1 -- 172.21.15.100:0/1965743428 >> 172.21.15.100:0/1965743428 conn(0x7fed7c0f82d0 msgr2=0x7fed7c0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:02:04.125 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.126+0000 7fed82998700 1 -- 172.21.15.100:0/1965743428 shutdown_connections 2023-12-05T10:02:04.125 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.126+0000 7fed82998700 1 -- 172.21.15.100:0/1965743428 wait complete. 2023-12-05T10:02:04.126 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.127+0000 7fed82998700 1 Processor -- start 2023-12-05T10:02:04.126 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.127+0000 7fed82998700 1 -- start start 2023-12-05T10:02:04.127 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.128+0000 7fed82998700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fed7c0fcbf0 0x7fed7c071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:02:04.127 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.128+0000 7fed82998700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed7c0fde00 0x7fed7c06ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:02:04.127 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.128+0000 7fed82998700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed7c070590 con 0x7fed7c0fde00 2023-12-05T10:02:04.127 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.128+0000 7fed82998700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed7c070700 con 0x7fed7c0fcbf0 2023-12-05T10:02:04.127 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.128+0000 7fed7b7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed7c0fde00 0x7fed7c06ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:02:04.127 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.128+0000 7fed7b7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed7c0fde00 0x7fed7c06ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43702/0 (socket says 172.21.15.100:43702) 2023-12-05T10:02:04.127 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.128+0000 7fed7b7fe700 1 -- 172.21.15.100:0/3625456178 learned_addr learned my addr 172.21.15.100:0/3625456178 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T10:02:04.128 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.128+0000 7fed7bfff700 1 --2- 172.21.15.100:0/3625456178 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fed7c0fcbf0 0x7fed7c071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:02:04.128 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.128+0000 7fed7b7fe700 1 -- 172.21.15.100:0/3625456178 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fed7c0fcbf0 msgr2=0x7fed7c071b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:02:04.128 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.128+0000 7fed7b7fe700 1 --2- 172.21.15.100:0/3625456178 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fed7c0fcbf0 0x7fed7c071b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:04.128 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.128+0000 7fed7b7fe700 1 -- 172.21.15.100:0/3625456178 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed6c005040 con 0x7fed7c0fde00 2023-12-05T10:02:04.128 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.129+0000 7fed7b7fe700 1 --2- 172.21.15.100:0/3625456178 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed7c0fde00 0x7fed7c06ff90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fed70002a50 tx=0x7fed700046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:02:04.128 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.129+0000 7fed78ff9700 1 -- 172.21.15.100:0/3625456178 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed70007cc0 con 0x7fed7c0fde00 2023-12-05T10:02:04.128 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.129+0000 7fed78ff9700 1 -- 172.21.15.100:0/3625456178 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fed7000f040 con 0x7fed7c0fde00 2023-12-05T10:02:04.128 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.129+0000 7fed82998700 1 -- 172.21.15.100:0/3625456178 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed7c0709e0 con 0x7fed7c0fde00 2023-12-05T10:02:04.128 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.129+0000 7fed78ff9700 1 -- 172.21.15.100:0/3625456178 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed7000d9c0 con 0x7fed7c0fde00 2023-12-05T10:02:04.128 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.129+0000 7fed82998700 1 -- 172.21.15.100:0/3625456178 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed7c1155c0 con 0x7fed7c0fde00 2023-12-05T10:02:04.129 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.130+0000 7fed82998700 1 -- 172.21.15.100:0/3625456178 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed7c1075f0 con 0x7fed7c0fde00 2023-12-05T10:02:04.129 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.131+0000 7fed78ff9700 1 -- 172.21.15.100:0/3625456178 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fed7000db60 con 0x7fed7c0fde00 2023-12-05T10:02:04.130 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.132+0000 7fed78ff9700 1 --2- 172.21.15.100:0/3625456178 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fed6406ce70 0x7fed6406f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:02:04.130 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.132+0000 7fed78ff9700 1 -- 172.21.15.100:0/3625456178 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fed7008ba40 con 0x7fed7c0fde00 2023-12-05T10:02:04.130 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.133+0000 7fed7bfff700 1 --2- 172.21.15.100:0/3625456178 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fed6406ce70 0x7fed6406f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:02:04.130 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.133+0000 7fed7bfff700 1 --2- 172.21.15.100:0/3625456178 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fed6406ce70 0x7fed6406f320 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fed7c0718a0 tx=0x7fed6c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:02:04.133 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.136+0000 7fed78ff9700 1 -- 172.21.15.100:0/3625456178 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fed700592b0 con 0x7fed7c0fde00 2023-12-05T10:02:04.374 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.376+0000 7fed82998700 1 -- 172.21.15.100:0/3625456178 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fed7c02b0e0 con 0x7fed7c0fde00 2023-12-05T10:02:04.374 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.376+0000 7fed78ff9700 1 -- 172.21.15.100:0/3625456178 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1852 (secure 0 0 0) 0x7fed70058e40 con 0x7fed7c0fde00 2023-12-05T10:02:04.374 INFO:teuthology.orchestra.run.smithi100.stdout:e13 2023-12-05T10:02:04.374 INFO:teuthology.orchestra.run.smithi100.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-05T10:02:04.374 INFO:teuthology.orchestra.run.smithi100.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T10:02:04.374 INFO:teuthology.orchestra.run.smithi100.stdout:legacy client fscid: 1 2023-12-05T10:02:04.374 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T10:02:04.374 INFO:teuthology.orchestra.run.smithi100.stdout:Filesystem 'cephfs' (1) 2023-12-05T10:02:04.374 INFO:teuthology.orchestra.run.smithi100.stdout:fs_name cephfs 2023-12-05T10:02:04.375 INFO:teuthology.orchestra.run.smithi100.stdout:epoch 13 2023-12-05T10:02:04.375 INFO:teuthology.orchestra.run.smithi100.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-05T10:02:04.375 INFO:teuthology.orchestra.run.smithi100.stdout:created 2023-12-05T09:54:30.515778+0000 2023-12-05T10:02:04.375 INFO:teuthology.orchestra.run.smithi100.stdout:modified 2023-12-05T09:54:46.403009+0000 2023-12-05T10:02:04.375 INFO:teuthology.orchestra.run.smithi100.stdout:tableserver 0 2023-12-05T10:02:04.375 INFO:teuthology.orchestra.run.smithi100.stdout:root 0 2023-12-05T10:02:04.375 INFO:teuthology.orchestra.run.smithi100.stdout:session_timeout 60 2023-12-05T10:02:04.375 INFO:teuthology.orchestra.run.smithi100.stdout:session_autoclose 300 2023-12-05T10:02:04.375 INFO:teuthology.orchestra.run.smithi100.stdout:max_file_size 1099511627776 2023-12-05T10:02:04.375 INFO:teuthology.orchestra.run.smithi100.stdout:max_xattr_size 65536 2023-12-05T10:02:04.375 INFO:teuthology.orchestra.run.smithi100.stdout:required_client_features {} 2023-12-05T10:02:04.375 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure 0 2023-12-05T10:02:04.375 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure_osd_epoch 46 2023-12-05T10:02:04.375 INFO:teuthology.orchestra.run.smithi100.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T10:02:04.375 INFO:teuthology.orchestra.run.smithi100.stdout:max_mds 1 2023-12-05T10:02:04.376 INFO:teuthology.orchestra.run.smithi100.stdout:in 0 2023-12-05T10:02:04.376 INFO:teuthology.orchestra.run.smithi100.stdout:up {0=14490} 2023-12-05T10:02:04.376 INFO:teuthology.orchestra.run.smithi100.stdout:failed 2023-12-05T10:02:04.376 INFO:teuthology.orchestra.run.smithi100.stdout:damaged 2023-12-05T10:02:04.376 INFO:teuthology.orchestra.run.smithi100.stdout:stopped 2023-12-05T10:02:04.376 INFO:teuthology.orchestra.run.smithi100.stdout:data_pools [3] 2023-12-05T10:02:04.376 INFO:teuthology.orchestra.run.smithi100.stdout:metadata_pool 2 2023-12-05T10:02:04.376 INFO:teuthology.orchestra.run.smithi100.stdout:inline_data disabled 2023-12-05T10:02:04.376 INFO:teuthology.orchestra.run.smithi100.stdout:balancer 2023-12-05T10:02:04.376 INFO:teuthology.orchestra.run.smithi100.stdout:bal_rank_mask -1 2023-12-05T10:02:04.376 INFO:teuthology.orchestra.run.smithi100.stdout:standby_count_wanted 1 2023-12-05T10:02:04.376 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi100.akmstb{0:14490} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.100:6828/627555128,v1:172.21.15.100:6829/627555128] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T10:02:04.376 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T10:02:04.376 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T10:02:04.377 INFO:teuthology.orchestra.run.smithi100.stdout:Standby daemons: 2023-12-05T10:02:04.377 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T10:02:04.377 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi150.pcbpxm{-1:14486} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.150:6824/3645854543,v1:172.21.15.150:6825/3645854543] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T10:02:04.377 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi150.fcnhsv{-1:14498} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.150:6826/3249949736,v1:172.21.15.150:6827/3249949736] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T10:02:04.377 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi100.sqplhn{-1:14506} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.100:6826/2472212864,v1:172.21.15.100:6827/2472212864] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T10:02:04.377 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.378+0000 7fed82998700 1 -- 172.21.15.100:0/3625456178 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fed6406ce70 msgr2=0x7fed6406f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:02:04.378 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.378+0000 7fed82998700 1 --2- 172.21.15.100:0/3625456178 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fed6406ce70 0x7fed6406f320 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fed7c0718a0 tx=0x7fed6c009e30 comp rx=0 tx=0).stop 2023-12-05T10:02:04.378 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.379+0000 7fed82998700 1 -- 172.21.15.100:0/3625456178 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed7c0fde00 msgr2=0x7fed7c06ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:02:04.378 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.379+0000 7fed82998700 1 --2- 172.21.15.100:0/3625456178 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed7c0fde00 0x7fed7c06ff90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fed70002a50 tx=0x7fed700046b0 comp rx=0 tx=0).stop 2023-12-05T10:02:04.378 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.379+0000 7fed82998700 1 -- 172.21.15.100:0/3625456178 shutdown_connections 2023-12-05T10:02:04.378 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.379+0000 7fed82998700 1 --2- 172.21.15.100:0/3625456178 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fed6406ce70 0x7fed6406f320 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:04.378 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.379+0000 7fed82998700 1 --2- 172.21.15.100:0/3625456178 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fed7c0fcbf0 0x7fed7c071b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:04.378 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.379+0000 7fed82998700 1 --2- 172.21.15.100:0/3625456178 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed7c0fde00 0x7fed7c06ff90 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:04.378 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.379+0000 7fed82998700 1 -- 172.21.15.100:0/3625456178 >> 172.21.15.100:0/3625456178 conn(0x7fed7c0f82d0 msgr2=0x7fed7c0fa5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:02:04.378 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.379+0000 7fed82998700 1 -- 172.21.15.100:0/3625456178 shutdown_connections 2023-12-05T10:02:04.378 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.379+0000 7fed82998700 1 -- 172.21.15.100:0/3625456178 wait complete. 2023-12-05T10:02:04.378 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 13 2023-12-05T10:02:04.512 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.514+0000 7f9f115e0700 1 -- 172.21.15.100:0/1254826519 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f0c0fcbf0 msgr2=0x7f9f0c0fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:02:04.513 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.514+0000 7f9f115e0700 1 --2- 172.21.15.100:0/1254826519 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f0c0fcbf0 0x7f9f0c0fd000 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9efc004940 tx=0x7f9efc009e30 comp rx=0 tx=0).stop 2023-12-05T10:02:04.513 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.515+0000 7f9f115e0700 1 -- 172.21.15.100:0/1254826519 shutdown_connections 2023-12-05T10:02:04.513 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.515+0000 7f9f115e0700 1 --2- 172.21.15.100:0/1254826519 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f0c0fde00 0x7f9f0c0fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:04.513 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.515+0000 7f9f115e0700 1 --2- 172.21.15.100:0/1254826519 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f0c0fcbf0 0x7f9f0c0fd000 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:04.513 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.515+0000 7f9f115e0700 1 -- 172.21.15.100:0/1254826519 >> 172.21.15.100:0/1254826519 conn(0x7f9f0c0f82d0 msgr2=0x7f9f0c0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:02:04.513 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.515+0000 7f9f115e0700 1 -- 172.21.15.100:0/1254826519 shutdown_connections 2023-12-05T10:02:04.513 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.515+0000 7f9f115e0700 1 -- 172.21.15.100:0/1254826519 wait complete. 2023-12-05T10:02:04.515 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.515+0000 7f9f115e0700 1 Processor -- start 2023-12-05T10:02:04.515 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.516+0000 7f9f115e0700 1 -- start start 2023-12-05T10:02:04.515 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.516+0000 7f9f115e0700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f0c0fcbf0 0x7f9f0c10d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:02:04.515 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.516+0000 7f9f115e0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f0c0fde00 0x7f9f0c10daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:02:04.515 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.516+0000 7f9f115e0700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0c10e0a0 con 0x7f9f0c0fcbf0 2023-12-05T10:02:04.515 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.516+0000 7f9f115e0700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0c10e940 con 0x7f9f0c0fde00 2023-12-05T10:02:04.515 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.516+0000 7f9f0affd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f0c0fcbf0 0x7f9f0c10d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:02:04.516 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.516+0000 7f9f0affd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f0c0fcbf0 0x7f9f0c10d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43730/0 (socket says 172.21.15.100:43730) 2023-12-05T10:02:04.516 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.516+0000 7f9f0affd700 1 -- 172.21.15.100:0/2359481646 learned_addr learned my addr 172.21.15.100:0/2359481646 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T10:02:04.516 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.516+0000 7f9f0a7fc700 1 --2- 172.21.15.100:0/2359481646 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f0c0fde00 0x7f9f0c10daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:02:04.516 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.517+0000 7f9f0affd700 1 -- 172.21.15.100:0/2359481646 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f0c0fde00 msgr2=0x7f9f0c10daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:02:04.516 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.517+0000 7f9f0affd700 1 --2- 172.21.15.100:0/2359481646 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f0c0fde00 0x7f9f0c10daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:04.516 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.517+0000 7f9f0affd700 1 -- 172.21.15.100:0/2359481646 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9efc005040 con 0x7f9f0c0fcbf0 2023-12-05T10:02:04.516 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.517+0000 7f9f0affd700 1 --2- 172.21.15.100:0/2359481646 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f0c0fcbf0 0x7f9f0c10d560 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9efc000c00 tx=0x7f9efc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:02:04.516 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.517+0000 7f9ef37fe700 1 -- 172.21.15.100:0/2359481646 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9efc00e040 con 0x7f9f0c0fcbf0 2023-12-05T10:02:04.516 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.517+0000 7f9ef37fe700 1 -- 172.21.15.100:0/2359481646 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9efc013420 con 0x7f9f0c0fcbf0 2023-12-05T10:02:04.516 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.517+0000 7f9f115e0700 1 -- 172.21.15.100:0/2359481646 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f0c10ebc0 con 0x7f9f0c0fcbf0 2023-12-05T10:02:04.517 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.517+0000 7f9ef37fe700 1 -- 172.21.15.100:0/2359481646 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9efc01c630 con 0x7f9f0c0fcbf0 2023-12-05T10:02:04.517 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.517+0000 7f9f115e0700 1 -- 172.21.15.100:0/2359481646 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f0c10f100 con 0x7f9f0c0fcbf0 2023-12-05T10:02:04.517 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.518+0000 7f9f115e0700 1 -- 172.21.15.100:0/2359481646 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f0c04bb80 con 0x7f9f0c0fcbf0 2023-12-05T10:02:04.517 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.519+0000 7f9ef37fe700 1 -- 172.21.15.100:0/2359481646 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f9efc013590 con 0x7f9f0c0fcbf0 2023-12-05T10:02:04.519 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.521+0000 7f9ef37fe700 1 --2- 172.21.15.100:0/2359481646 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f9ef406ce70 0x7f9ef406f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:02:04.519 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.521+0000 7f9ef37fe700 1 -- 172.21.15.100:0/2359481646 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f9efc08d630 con 0x7f9f0c0fcbf0 2023-12-05T10:02:04.519 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.521+0000 7f9f0a7fc700 1 --2- 172.21.15.100:0/2359481646 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f9ef406ce70 0x7f9ef406f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:02:04.520 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.521+0000 7f9f0a7fc700 1 --2- 172.21.15.100:0/2359481646 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f9ef406ce70 0x7f9ef406f320 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9f000041d0 tx=0x7f9f000043c0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:02:04.522 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.525+0000 7f9ef37fe700 1 -- 172.21.15.100:0/2359481646 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f9efc05afa0 con 0x7f9f0c0fcbf0 2023-12-05T10:02:04.740 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.742+0000 7f9f115e0700 1 -- 172.21.15.100:0/2359481646 --> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9f0c10f570 con 0x7f9ef406ce70 2023-12-05T10:02:04.741 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.744+0000 7f9ef37fe700 1 -- 172.21.15.100:0/2359481646 <== mgr.34104 v2:172.21.15.100:6800/3489431924 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f9f0c10f570 con 0x7f9ef406ce70 2023-12-05T10:02:04.741 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2023-12-05T10:02:04.741 INFO:teuthology.orchestra.run.smithi100.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ff918c95653912ae4c171d8d1db5f5eabc756f85ff7e3ce78f13f9c521198459", 2023-12-05T10:02:04.741 INFO:teuthology.orchestra.run.smithi100.stdout: "in_progress": true, 2023-12-05T10:02:04.741 INFO:teuthology.orchestra.run.smithi100.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-05T10:02:04.741 INFO:teuthology.orchestra.run.smithi100.stdout: "services_complete": [ 2023-12-05T10:02:04.742 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr", 2023-12-05T10:02:04.742 INFO:teuthology.orchestra.run.smithi100.stdout: "crash", 2023-12-05T10:02:04.742 INFO:teuthology.orchestra.run.smithi100.stdout: "mon" 2023-12-05T10:02:04.742 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2023-12-05T10:02:04.742 INFO:teuthology.orchestra.run.smithi100.stdout: "progress": "9/21 daemons upgraded", 2023-12-05T10:02:04.742 INFO:teuthology.orchestra.run.smithi100.stdout: "message": "Currently upgrading osd daemons", 2023-12-05T10:02:04.742 INFO:teuthology.orchestra.run.smithi100.stdout: "is_paused": false 2023-12-05T10:02:04.742 INFO:teuthology.orchestra.run.smithi100.stdout:} 2023-12-05T10:02:04.744 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.746+0000 7f9f115e0700 1 -- 172.21.15.100:0/2359481646 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f9ef406ce70 msgr2=0x7f9ef406f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:02:04.744 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.746+0000 7f9f115e0700 1 --2- 172.21.15.100:0/2359481646 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f9ef406ce70 0x7f9ef406f320 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9f000041d0 tx=0x7f9f000043c0 comp rx=0 tx=0).stop 2023-12-05T10:02:04.744 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.746+0000 7f9f115e0700 1 -- 172.21.15.100:0/2359481646 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f0c0fcbf0 msgr2=0x7f9f0c10d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:02:04.744 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.746+0000 7f9f115e0700 1 --2- 172.21.15.100:0/2359481646 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f0c0fcbf0 0x7f9f0c10d560 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9efc000c00 tx=0x7f9efc009e30 comp rx=0 tx=0).stop 2023-12-05T10:02:04.744 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.746+0000 7f9f115e0700 1 -- 172.21.15.100:0/2359481646 shutdown_connections 2023-12-05T10:02:04.744 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.746+0000 7f9f115e0700 1 --2- 172.21.15.100:0/2359481646 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f9ef406ce70 0x7f9ef406f320 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:04.744 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.746+0000 7f9f115e0700 1 --2- 172.21.15.100:0/2359481646 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f0c0fcbf0 0x7f9f0c10d560 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:04.744 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.746+0000 7f9f115e0700 1 --2- 172.21.15.100:0/2359481646 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f0c0fde00 0x7f9f0c10daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:04.744 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.746+0000 7f9f115e0700 1 -- 172.21.15.100:0/2359481646 >> 172.21.15.100:0/2359481646 conn(0x7f9f0c0f82d0 msgr2=0x7f9f0c101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:02:04.744 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.746+0000 7f9f115e0700 1 -- 172.21.15.100:0/2359481646 shutdown_connections 2023-12-05T10:02:04.744 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.746+0000 7f9f115e0700 1 -- 172.21.15.100:0/2359481646 wait complete. 2023-12-05T10:02:04.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:04 smithi150 ceph-mon[171606]: pgmap v104: 65 pgs: 65 active+clean; 195 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2023-12-05T10:02:04.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:04 smithi150 ceph-mon[171606]: from='client.34278 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T10:02:04.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:04 smithi150 ceph-mon[171606]: from='client.34282 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T10:02:04.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:04 smithi150 ceph-mon[171606]: from='client.34286 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T10:02:04.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:04 smithi150 ceph-mon[171606]: Upgrade: Updating osd.3 2023-12-05T10:02:04.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:04 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:02:04.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:04 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-05T10:02:04.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:04 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T10:02:04.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:04 smithi150 ceph-mon[171606]: Deploying daemon osd.3 on smithi150 2023-12-05T10:02:04.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:04 smithi150 ceph-mon[171606]: from='client.? 172.21.15.100:0/420570487' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T10:02:04.847 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:04 smithi150 ceph-mon[171606]: from='client.? 172.21.15.100:0/3625456178' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-05T10:02:04.878 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.881+0000 7f629ae22700 1 -- 172.21.15.100:0/222534203 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f62940fff70 msgr2=0x7f62941003e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:02:04.879 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.881+0000 7f629ae22700 1 --2- 172.21.15.100:0/222534203 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f62940fff70 0x7f62941003e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6280004940 tx=0x7f6280009e30 comp rx=0 tx=0).stop 2023-12-05T10:02:04.879 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.881+0000 7f629ae22700 1 -- 172.21.15.100:0/222534203 shutdown_connections 2023-12-05T10:02:04.879 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.881+0000 7f629ae22700 1 --2- 172.21.15.100:0/222534203 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f62940fff70 0x7f62941003e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:04.879 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.881+0000 7f629ae22700 1 --2- 172.21.15.100:0/222534203 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f62940fee00 0x7f62940ff210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:04.879 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.881+0000 7f629ae22700 1 -- 172.21.15.100:0/222534203 >> 172.21.15.100:0/222534203 conn(0x7f62940fa5d0 msgr2=0x7f62940fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:02:04.879 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.881+0000 7f629ae22700 1 -- 172.21.15.100:0/222534203 shutdown_connections 2023-12-05T10:02:04.879 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.881+0000 7f629ae22700 1 -- 172.21.15.100:0/222534203 wait complete. 2023-12-05T10:02:04.880 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.882+0000 7f629ae22700 1 Processor -- start 2023-12-05T10:02:04.880 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.882+0000 7f629ae22700 1 -- start start 2023-12-05T10:02:04.880 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.882+0000 7f629ae22700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f62940fee00 0x7f629410f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:02:04.881 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.882+0000 7f629ae22700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f62940fff70 0x7f629410fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:02:04.881 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.882+0000 7f629ae22700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6294110230 con 0x7f62940fee00 2023-12-05T10:02:04.881 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.882+0000 7f629ae22700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6294110ad0 con 0x7f62940fff70 2023-12-05T10:02:04.881 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.883+0000 7f6293fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f62940fff70 0x7f629410fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:02:04.881 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.883+0000 7f6298bbe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f62940fee00 0x7f629410f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:02:04.881 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.883+0000 7f6293fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f62940fff70 0x7f629410fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.100:43864/0 (socket says 172.21.15.100:43864) 2023-12-05T10:02:04.881 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.883+0000 7f6293fff700 1 -- 172.21.15.100:0/2913667224 learned_addr learned my addr 172.21.15.100:0/2913667224 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T10:02:04.881 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.883+0000 7f6298bbe700 1 -- 172.21.15.100:0/2913667224 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f62940fff70 msgr2=0x7f629410fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:02:04.881 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.883+0000 7f6298bbe700 1 --2- 172.21.15.100:0/2913667224 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f62940fff70 0x7f629410fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:04.881 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.883+0000 7f6298bbe700 1 -- 172.21.15.100:0/2913667224 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6280005040 con 0x7f62940fee00 2023-12-05T10:02:04.881 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.883+0000 7f6298bbe700 1 --2- 172.21.15.100:0/2913667224 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f62940fee00 0x7f629410f6f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6288009fd0 tx=0x7f628800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:02:04.882 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.883+0000 7f62917fa700 1 -- 172.21.15.100:0/2913667224 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6288004e90 con 0x7f62940fee00 2023-12-05T10:02:04.882 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.883+0000 7f62917fa700 1 -- 172.21.15.100:0/2913667224 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f628800f040 con 0x7f62940fee00 2023-12-05T10:02:04.882 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.883+0000 7f62917fa700 1 -- 172.21.15.100:0/2913667224 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f628800c9b0 con 0x7f62940fee00 2023-12-05T10:02:04.882 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.883+0000 7f629ae22700 1 -- 172.21.15.100:0/2913667224 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6294110d50 con 0x7f62940fee00 2023-12-05T10:02:04.882 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.884+0000 7f629ae22700 1 -- 172.21.15.100:0/2913667224 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6294111290 con 0x7f62940fee00 2023-12-05T10:02:04.882 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.885+0000 7f629ae22700 1 -- 172.21.15.100:0/2913667224 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f629404bb80 con 0x7f62940fee00 2023-12-05T10:02:04.883 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.886+0000 7f62917fa700 1 -- 172.21.15.100:0/2913667224 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f6288007cc0 con 0x7f62940fee00 2023-12-05T10:02:04.884 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.886+0000 7f62917fa700 1 --2- 172.21.15.100:0/2913667224 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f628406ce70 0x7f628406f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:02:04.884 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.887+0000 7f62917fa700 1 -- 172.21.15.100:0/2913667224 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f628808bd90 con 0x7f62940fee00 2023-12-05T10:02:04.884 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.887+0000 7f6293fff700 1 --2- 172.21.15.100:0/2913667224 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f628406ce70 0x7f628406f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:02:04.884 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.887+0000 7f6293fff700 1 --2- 172.21.15.100:0/2913667224 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f628406ce70 0x7f628406f320 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f628000b0d0 tx=0x7f6280009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:02:04.888 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:04.891+0000 7f62917fa700 1 -- 172.21.15.100:0/2913667224 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f6288059730 con 0x7f62940fee00 2023-12-05T10:02:04.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:04 smithi100 ceph-mon[187528]: pgmap v104: 65 pgs: 65 active+clean; 195 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2023-12-05T10:02:04.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:04 smithi100 ceph-mon[187528]: from='client.34278 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T10:02:04.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:04 smithi100 ceph-mon[187528]: from='client.34282 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T10:02:04.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:04 smithi100 ceph-mon[187528]: from='client.34286 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T10:02:04.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:04 smithi100 ceph-mon[187528]: Upgrade: Updating osd.3 2023-12-05T10:02:04.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:04 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:02:04.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:04 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-05T10:02:04.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:04 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T10:02:04.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:04 smithi100 ceph-mon[187528]: Deploying daemon osd.3 on smithi150 2023-12-05T10:02:04.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:04 smithi100 ceph-mon[187528]: from='client.? 172.21.15.100:0/420570487' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T10:02:04.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:04 smithi100 ceph-mon[187528]: from='client.? 172.21.15.100:0/3625456178' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-05T10:02:05.166 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:05.169+0000 7f629ae22700 1 -- 172.21.15.100:0/2913667224 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f6294111950 con 0x7f62940fee00 2023-12-05T10:02:05.167 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:05.169+0000 7f62917fa700 1 -- 172.21.15.100:0/2913667224 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f62880592c0 con 0x7f62940fee00 2023-12-05T10:02:05.167 INFO:teuthology.orchestra.run.smithi100.stdout:HEALTH_OK 2023-12-05T10:02:05.169 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:05.171+0000 7f629ae22700 1 -- 172.21.15.100:0/2913667224 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f628406ce70 msgr2=0x7f628406f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:02:05.169 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:05.171+0000 7f629ae22700 1 --2- 172.21.15.100:0/2913667224 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f628406ce70 0x7f628406f320 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f628000b0d0 tx=0x7f6280009e30 comp rx=0 tx=0).stop 2023-12-05T10:02:05.169 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:05.171+0000 7f629ae22700 1 -- 172.21.15.100:0/2913667224 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f62940fee00 msgr2=0x7f629410f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:02:05.169 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:05.171+0000 7f629ae22700 1 --2- 172.21.15.100:0/2913667224 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f62940fee00 0x7f629410f6f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6288009fd0 tx=0x7f628800b040 comp rx=0 tx=0).stop 2023-12-05T10:02:05.170 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:05.172+0000 7f629ae22700 1 -- 172.21.15.100:0/2913667224 shutdown_connections 2023-12-05T10:02:05.170 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:05.172+0000 7f629ae22700 1 --2- 172.21.15.100:0/2913667224 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f628406ce70 0x7f628406f320 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:05.170 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:05.172+0000 7f629ae22700 1 --2- 172.21.15.100:0/2913667224 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f62940fee00 0x7f629410f6f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:05.170 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:05.172+0000 7f629ae22700 1 --2- 172.21.15.100:0/2913667224 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f62940fff70 0x7f629410fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:05.170 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:05.172+0000 7f629ae22700 1 -- 172.21.15.100:0/2913667224 >> 172.21.15.100:0/2913667224 conn(0x7f62940fa5d0 msgr2=0x7f6294103230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:02:05.170 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:05.172+0000 7f629ae22700 1 -- 172.21.15.100:0/2913667224 shutdown_connections 2023-12-05T10:02:05.170 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:05.172+0000 7f629ae22700 1 -- 172.21.15.100:0/2913667224 wait complete. 2023-12-05T10:02:05.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:05 smithi150 ceph-mon[171606]: from='client.? 172.21.15.100:0/2913667224' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-05T10:02:05.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:05 smithi100 ceph-mon[187528]: from='client.? 172.21.15.100:0/2913667224' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-05T10:02:06.596 INFO:journalctl@ceph.osd.3.smithi150.stdout:Dec 05 10:02:06 smithi150 systemd[1]: Stopping Ceph osd.3 for 5b035ce6-9353-11ee-95a2-87774f69a715... 2023-12-05T10:02:06.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:06 smithi100 ceph-mon[187528]: pgmap v105: 65 pgs: 65 active+clean; 195 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2023-12-05T10:02:06.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:06 smithi100 ceph-mon[187528]: from='client.34298 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T10:02:07.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:06 smithi150 ceph-mon[171606]: pgmap v105: 65 pgs: 65 active+clean; 195 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2023-12-05T10:02:07.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:06 smithi150 ceph-mon[171606]: from='client.34298 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T10:02:07.096 INFO:journalctl@ceph.osd.3.smithi150.stdout:Dec 05 10:02:06 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-3[122418]: 2023-12-05T10:02:06.674+0000 7f454eab3700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-05T10:02:07.096 INFO:journalctl@ceph.osd.3.smithi150.stdout:Dec 05 10:02:06 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-3[122418]: 2023-12-05T10:02:06.674+0000 7f454eab3700 -1 osd.3 66 *** Got signal Terminated *** 2023-12-05T10:02:07.096 INFO:journalctl@ceph.osd.3.smithi150.stdout:Dec 05 10:02:06 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-3[122418]: 2023-12-05T10:02:06.674+0000 7f454eab3700 -1 osd.3 66 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-05T10:02:07.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:07 smithi100 ceph-mon[187528]: pgmap v106: 65 pgs: 65 active+clean; 195 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2023-12-05T10:02:07.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:07 smithi100 ceph-mon[187528]: osd.3 marked itself down and dead 2023-12-05T10:02:08.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:07 smithi150 ceph-mon[171606]: pgmap v106: 65 pgs: 65 active+clean; 195 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2023-12-05T10:02:08.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:07 smithi150 ceph-mon[171606]: osd.3 marked itself down and dead 2023-12-05T10:02:08.595 INFO:journalctl@ceph.osd.3.smithi150.stdout:Dec 05 10:02:08 smithi150 bash[183122]: ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-3 2023-12-05T10:02:08.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:08 smithi100 ceph-mon[187528]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-05T10:02:08.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:08 smithi100 ceph-mon[187528]: failed to encode map e67 with expected crc 2023-12-05T10:02:08.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:08 smithi100 ceph-mon[187528]: osdmap e67: 6 total, 5 up, 6 in 2023-12-05T10:02:09.070 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:08 smithi150 ceph-mon[171606]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-05T10:02:09.070 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:08 smithi150 ceph-mon[171606]: failed to encode map e67 with expected crc 2023-12-05T10:02:09.070 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:08 smithi150 ceph-mon[171606]: osdmap e67: 6 total, 5 up, 6 in 2023-12-05T10:02:09.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:09 smithi150 ceph-mon[171606]: osdmap e68: 6 total, 5 up, 6 in 2023-12-05T10:02:09.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:09 smithi150 ceph-mon[171606]: failed to encode map e68 with expected crc 2023-12-05T10:02:09.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:09 smithi150 ceph-mon[171606]: failed to encode map e68 with expected crc 2023-12-05T10:02:09.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:09 smithi150 ceph-mon[171606]: failed to encode map e68 with expected crc 2023-12-05T10:02:09.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:09 smithi150 ceph-mon[171606]: failed to encode map e68 with expected crc 2023-12-05T10:02:09.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:09 smithi150 ceph-mon[171606]: pgmap v109: 65 pgs: 16 stale+active+clean, 49 active+clean; 195 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2023-12-05T10:02:10.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:09 smithi100 ceph-mon[187528]: osdmap e68: 6 total, 5 up, 6 in 2023-12-05T10:02:10.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:09 smithi100 ceph-mon[187528]: failed to encode map e68 with expected crc 2023-12-05T10:02:10.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:09 smithi100 ceph-mon[187528]: failed to encode map e68 with expected crc 2023-12-05T10:02:10.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:09 smithi100 ceph-mon[187528]: failed to encode map e68 with expected crc 2023-12-05T10:02:10.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:09 smithi100 ceph-mon[187528]: failed to encode map e68 with expected crc 2023-12-05T10:02:10.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:09 smithi100 ceph-mon[187528]: pgmap v109: 65 pgs: 16 stale+active+clean, 49 active+clean; 195 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2023-12-05T10:02:10.168 INFO:journalctl@ceph.osd.3.smithi150.stdout:Dec 05 10:02:09 smithi150 systemd[1]: ceph-5b035ce6-9353-11ee-95a2-87774f69a715@osd.3.service: Succeeded. 2023-12-05T10:02:10.169 INFO:journalctl@ceph.osd.3.smithi150.stdout:Dec 05 10:02:09 smithi150 systemd[1]: Stopped Ceph osd.3 for 5b035ce6-9353-11ee-95a2-87774f69a715. 2023-12-05T10:02:10.535 INFO:journalctl@ceph.osd.3.smithi150.stdout:Dec 05 10:02:10 smithi150 systemd[1]: Starting Ceph osd.3 for 5b035ce6-9353-11ee-95a2-87774f69a715... 2023-12-05T10:02:10.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:10 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [0, 3]}]: dispatch 2023-12-05T10:02:10.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:10 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.19", "id": [0, 3]}]: dispatch 2023-12-05T10:02:10.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:10 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [0, 3]}]: dispatch 2023-12-05T10:02:10.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:10 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.d", "id": [4, 5]}]: dispatch 2023-12-05T10:02:10.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:10 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 3]}]: dispatch 2023-12-05T10:02:10.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:10 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [1, 3]}]: dispatch 2023-12-05T10:02:10.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:10 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1c", "id": [1, 0]}]: dispatch 2023-12-05T10:02:10.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:10 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [0, 3]}]: dispatch 2023-12-05T10:02:10.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:10 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.19", "id": [0, 3]}]: dispatch 2023-12-05T10:02:10.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:10 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [0, 3]}]: dispatch 2023-12-05T10:02:10.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:10 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.d", "id": [4, 5]}]: dispatch 2023-12-05T10:02:10.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:10 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 3]}]: dispatch 2023-12-05T10:02:10.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:10 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [1, 3]}]: dispatch 2023-12-05T10:02:10.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:10 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1c", "id": [1, 0]}]: dispatch 2023-12-05T10:02:11.596 INFO:journalctl@ceph.osd.3.smithi150.stdout:Dec 05 10:02:11 smithi150 bash[183389]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-12-05T10:02:11.596 INFO:journalctl@ceph.osd.3.smithi150.stdout:Dec 05 10:02:11 smithi150 bash[183389]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2023-12-05T10:02:11.596 INFO:journalctl@ceph.osd.3.smithi150.stdout:Dec 05 10:02:11 smithi150 bash[183389]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2023-12-05T10:02:11.596 INFO:journalctl@ceph.osd.3.smithi150.stdout:Dec 05 10:02:11 smithi150 bash[183389]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2023-12-05T10:02:11.596 INFO:journalctl@ceph.osd.3.smithi150.stdout:Dec 05 10:02:11 smithi150 bash[183389]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2023-12-05T10:02:11.596 INFO:journalctl@ceph.osd.3.smithi150.stdout:Dec 05 10:02:11 smithi150 bash[183389]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-12-05T10:02:11.596 INFO:journalctl@ceph.osd.3.smithi150.stdout:Dec 05 10:02:11 smithi150 bash[183389]: --> ceph-volume raw activate successful for osd ID: 3 2023-12-05T10:02:12.088 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:11 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [0, 3]}]': finished 2023-12-05T10:02:12.088 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:11 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.19", "id": [0, 3]}]': finished 2023-12-05T10:02:12.088 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:11 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [0, 3]}]': finished 2023-12-05T10:02:12.089 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:11 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.d", "id": [4, 5]}]': finished 2023-12-05T10:02:12.089 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:11 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 3]}]': finished 2023-12-05T10:02:12.089 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:11 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [1, 3]}]': finished 2023-12-05T10:02:12.089 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:11 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1c", "id": [1, 0]}]': finished 2023-12-05T10:02:12.089 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:11 smithi150 ceph-mon[171606]: osdmap e69: 6 total, 5 up, 6 in 2023-12-05T10:02:12.089 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:11 smithi150 ceph-mon[171606]: pgmap v111: 65 pgs: 10 active+undersized+degraded, 10 stale+active+clean, 10 active+undersized, 35 active+clean; 195 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 25/216 objects degraded (11.574%) 2023-12-05T10:02:12.089 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:11 smithi150 ceph-mon[171606]: failed to encode map e69 with expected crc 2023-12-05T10:02:12.089 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:11 smithi150 ceph-mon[171606]: failed to encode map e69 with expected crc 2023-12-05T10:02:12.089 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:11 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:02:12.089 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:11 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T10:02:12.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:11 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [0, 3]}]': finished 2023-12-05T10:02:12.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:11 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.19", "id": [0, 3]}]': finished 2023-12-05T10:02:12.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:11 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [0, 3]}]': finished 2023-12-05T10:02:12.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:11 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.d", "id": [4, 5]}]': finished 2023-12-05T10:02:12.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:11 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 3]}]': finished 2023-12-05T10:02:12.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:11 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [1, 3]}]': finished 2023-12-05T10:02:12.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:11 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1c", "id": [1, 0]}]': finished 2023-12-05T10:02:12.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:11 smithi100 ceph-mon[187528]: osdmap e69: 6 total, 5 up, 6 in 2023-12-05T10:02:12.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:11 smithi100 ceph-mon[187528]: pgmap v111: 65 pgs: 10 active+undersized+degraded, 10 stale+active+clean, 10 active+undersized, 35 active+clean; 195 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 25/216 objects degraded (11.574%) 2023-12-05T10:02:12.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:11 smithi100 ceph-mon[187528]: failed to encode map e69 with expected crc 2023-12-05T10:02:12.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:11 smithi100 ceph-mon[187528]: failed to encode map e69 with expected crc 2023-12-05T10:02:12.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:11 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:02:12.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:11 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T10:02:12.596 INFO:journalctl@ceph.osd.3.smithi150.stdout:Dec 05 10:02:12 smithi150 ceph-osd[183699]: -- 172.21.15.150:0/3767653864 <== mon.1 v2:172.21.15.150:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x555703ecf1e0 con 0x555703e9ec00 2023-12-05T10:02:12.596 INFO:journalctl@ceph.osd.3.smithi150.stdout:Dec 05 10:02:12 smithi150 bash[183661]: 08545df235d87c21e358cec94edf79380405c4df790ae47bdd1a4484ae476142 2023-12-05T10:02:12.596 INFO:journalctl@ceph.osd.3.smithi150.stdout:Dec 05 10:02:12 smithi150 systemd[1]: Started Ceph osd.3 for 5b035ce6-9353-11ee-95a2-87774f69a715. 2023-12-05T10:02:13.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:12 smithi150 ceph-mon[171606]: Health check failed: Degraded data redundancy: 25/216 objects degraded (11.574%), 10 pgs degraded (PG_DEGRADED) 2023-12-05T10:02:13.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:12 smithi150 ceph-mon[171606]: failed to encode map e70 with expected crc 2023-12-05T10:02:13.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:12 smithi150 ceph-mon[171606]: osdmap e70: 6 total, 5 up, 6 in 2023-12-05T10:02:13.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:12 smithi150 ceph-mon[171606]: failed to encode map e70 with expected crc 2023-12-05T10:02:13.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:12 smithi150 ceph-mon[171606]: failed to encode map e70 with expected crc 2023-12-05T10:02:13.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:12 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:02:13.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:12 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:02:13.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:12 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T10:02:13.096 INFO:journalctl@ceph.osd.3.smithi150.stdout:Dec 05 10:02:12 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-3[183676]: 2023-12-05T10:02:12.692+0000 7fdb67311640 -1 Falling back to public interface 2023-12-05T10:02:13.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:12 smithi100 ceph-mon[187528]: Health check failed: Degraded data redundancy: 25/216 objects degraded (11.574%), 10 pgs degraded (PG_DEGRADED) 2023-12-05T10:02:13.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:12 smithi100 ceph-mon[187528]: failed to encode map e70 with expected crc 2023-12-05T10:02:13.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:12 smithi100 ceph-mon[187528]: osdmap e70: 6 total, 5 up, 6 in 2023-12-05T10:02:13.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:12 smithi100 ceph-mon[187528]: failed to encode map e70 with expected crc 2023-12-05T10:02:13.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:12 smithi100 ceph-mon[187528]: failed to encode map e70 with expected crc 2023-12-05T10:02:13.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:12 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:02:13.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:12 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:02:13.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:12 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T10:02:14.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:13 smithi150 ceph-mon[171606]: pgmap v113: 65 pgs: 4 peering, 17 active+undersized+degraded, 21 active+undersized, 23 active+clean; 195 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 46/216 objects degraded (21.296%) 2023-12-05T10:02:14.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:13 smithi150 ceph-mon[171606]: failed to encode map e71 with expected crc 2023-12-05T10:02:14.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:13 smithi150 ceph-mon[171606]: osdmap e71: 6 total, 5 up, 6 in 2023-12-05T10:02:14.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:13 smithi150 ceph-mon[171606]: failed to encode map e71 with expected crc 2023-12-05T10:02:14.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:13 smithi150 ceph-mon[171606]: failed to encode map e71 with expected crc 2023-12-05T10:02:14.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:13 smithi150 ceph-mon[171606]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2023-12-05T10:02:14.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:13 smithi100 ceph-mon[187528]: pgmap v113: 65 pgs: 4 peering, 17 active+undersized+degraded, 21 active+undersized, 23 active+clean; 195 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 46/216 objects degraded (21.296%) 2023-12-05T10:02:14.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:13 smithi100 ceph-mon[187528]: failed to encode map e71 with expected crc 2023-12-05T10:02:14.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:13 smithi100 ceph-mon[187528]: osdmap e71: 6 total, 5 up, 6 in 2023-12-05T10:02:14.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:13 smithi100 ceph-mon[187528]: failed to encode map e71 with expected crc 2023-12-05T10:02:14.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:13 smithi100 ceph-mon[187528]: failed to encode map e71 with expected crc 2023-12-05T10:02:14.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:13 smithi100 ceph-mon[187528]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2023-12-05T10:02:16.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:15 smithi150 ceph-mon[171606]: pgmap v115: 65 pgs: 1 active+recovering+undersized+remapped, 4 peering, 17 active+undersized+degraded, 20 active+undersized, 23 active+clean; 195 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 46/216 objects degraded (21.296%); 0 B/s, 31 objects/s recovering 2023-12-05T10:02:16.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:15 smithi150 ceph-mon[171606]: failed to encode map e72 with expected crc 2023-12-05T10:02:16.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:15 smithi150 ceph-mon[171606]: osdmap e72: 6 total, 5 up, 6 in 2023-12-05T10:02:16.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:15 smithi150 ceph-mon[171606]: failed to encode map e72 with expected crc 2023-12-05T10:02:16.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:15 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:02:16.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:15 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:02:16.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:15 smithi100 ceph-mon[187528]: pgmap v115: 65 pgs: 1 active+recovering+undersized+remapped, 4 peering, 17 active+undersized+degraded, 20 active+undersized, 23 active+clean; 195 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 46/216 objects degraded (21.296%); 0 B/s, 31 objects/s recovering 2023-12-05T10:02:16.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:15 smithi100 ceph-mon[187528]: failed to encode map e72 with expected crc 2023-12-05T10:02:16.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:15 smithi100 ceph-mon[187528]: osdmap e72: 6 total, 5 up, 6 in 2023-12-05T10:02:16.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:15 smithi100 ceph-mon[187528]: failed to encode map e72 with expected crc 2023-12-05T10:02:16.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:15 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:02:16.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:15 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:02:17.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:16 smithi150 ceph-mon[171606]: osdmap e73: 6 total, 5 up, 6 in 2023-12-05T10:02:17.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:16 smithi150 ceph-mon[171606]: failed to encode map e73 with expected crc 2023-12-05T10:02:17.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:16 smithi150 ceph-mon[171606]: failed to encode map e73 with expected crc 2023-12-05T10:02:17.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:16 smithi150 ceph-mon[171606]: failed to encode map e73 with expected crc 2023-12-05T10:02:17.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:16 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:02:17.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:16 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:02:17.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:16 smithi100 ceph-mon[187528]: osdmap e73: 6 total, 5 up, 6 in 2023-12-05T10:02:17.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:16 smithi100 ceph-mon[187528]: failed to encode map e73 with expected crc 2023-12-05T10:02:17.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:16 smithi100 ceph-mon[187528]: failed to encode map e73 with expected crc 2023-12-05T10:02:17.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:16 smithi100 ceph-mon[187528]: failed to encode map e73 with expected crc 2023-12-05T10:02:17.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:16 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:02:17.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:16 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:02:17.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:17 smithi150 ceph-mon[171606]: pgmap v118: 65 pgs: 5 active+clean+remapped, 1 active+recovering+undersized+remapped, 17 active+undersized+degraded, 20 active+undersized, 22 active+clean; 195 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 46/216 objects degraded (21.296%); 2/216 objects misplaced (0.926%); 0 B/s, 181 objects/s recovering 2023-12-05T10:02:17.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:17 smithi150 ceph-mon[171606]: failed to encode map e74 with expected crc 2023-12-05T10:02:17.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:17 smithi150 ceph-mon[171606]: osdmap e74: 6 total, 5 up, 6 in 2023-12-05T10:02:17.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:17 smithi150 ceph-mon[171606]: failed to encode map e74 with expected crc 2023-12-05T10:02:17.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:17 smithi150 ceph-mon[171606]: Health check update: Degraded data redundancy: 46/216 objects degraded (21.296%), 17 pgs degraded (PG_DEGRADED) 2023-12-05T10:02:17.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:17 smithi150 ceph-mon[171606]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2023-12-05T10:02:18.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:17 smithi100 ceph-mon[187528]: pgmap v118: 65 pgs: 5 active+clean+remapped, 1 active+recovering+undersized+remapped, 17 active+undersized+degraded, 20 active+undersized, 22 active+clean; 195 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 46/216 objects degraded (21.296%); 2/216 objects misplaced (0.926%); 0 B/s, 181 objects/s recovering 2023-12-05T10:02:18.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:17 smithi100 ceph-mon[187528]: failed to encode map e74 with expected crc 2023-12-05T10:02:18.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:17 smithi100 ceph-mon[187528]: osdmap e74: 6 total, 5 up, 6 in 2023-12-05T10:02:18.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:17 smithi100 ceph-mon[187528]: failed to encode map e74 with expected crc 2023-12-05T10:02:18.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:17 smithi100 ceph-mon[187528]: Health check update: Degraded data redundancy: 46/216 objects degraded (21.296%), 17 pgs degraded (PG_DEGRADED) 2023-12-05T10:02:18.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:17 smithi100 ceph-mon[187528]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2023-12-05T10:02:18.346 INFO:journalctl@ceph.osd.3.smithi150.stdout:Dec 05 10:02:18 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-3[183676]: 2023-12-05T10:02:18.212+0000 7fdb67311640 -1 osd.3 0 read_superblock omap replica is missing. 2023-12-05T10:02:19.346 INFO:journalctl@ceph.osd.3.smithi150.stdout:Dec 05 10:02:18 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-3[183676]: 2023-12-05T10:02:18.894+0000 7fdb67311640 -1 osd.3 66 log_to_monitors true 2023-12-05T10:02:20.096 INFO:journalctl@ceph.osd.3.smithi150.stdout:Dec 05 10:02:19 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-3[183676]: 2023-12-05T10:02:19.720+0000 7fdb5677e700 -1 osd.3 66 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-05T10:02:20.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:19 smithi150 ceph-mon[171606]: pgmap v120: 65 pgs: 5 active+clean+remapped, 1 active+recovering+undersized+remapped, 17 active+undersized+degraded, 20 active+undersized, 22 active+clean; 195 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 46/216 objects degraded (21.296%); 2/216 objects misplaced (0.926%); 0 B/s, 151 objects/s recovering 2023-12-05T10:02:20.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:19 smithi150 ceph-mon[171606]: from='osd.3 [v2:172.21.15.150:6800/1106863242,v1:172.21.15.150:6801/1106863242]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-05T10:02:20.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:19 smithi150 ceph-mon[171606]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-05T10:02:20.132 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:19 smithi100 ceph-mon[187528]: pgmap v120: 65 pgs: 5 active+clean+remapped, 1 active+recovering+undersized+remapped, 17 active+undersized+degraded, 20 active+undersized, 22 active+clean; 195 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 46/216 objects degraded (21.296%); 2/216 objects misplaced (0.926%); 0 B/s, 151 objects/s recovering 2023-12-05T10:02:20.133 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:19 smithi100 ceph-mon[187528]: from='osd.3 [v2:172.21.15.150:6800/1106863242,v1:172.21.15.150:6801/1106863242]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-05T10:02:20.133 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:19 smithi100 ceph-mon[187528]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-05T10:02:21.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:20 smithi150 ceph-mon[171606]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-12-05T10:02:21.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:20 smithi150 ceph-mon[171606]: failed to encode map e75 with expected crc 2023-12-05T10:02:21.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:20 smithi150 ceph-mon[171606]: osdmap e75: 6 total, 5 up, 6 in 2023-12-05T10:02:21.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:20 smithi150 ceph-mon[171606]: from='osd.3 [v2:172.21.15.150:6800/1106863242,v1:172.21.15.150:6801/1106863242]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2023-12-05T10:02:21.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:20 smithi150 ceph-mon[171606]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2023-12-05T10:02:21.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:20 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:02:21.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:20 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:02:21.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:20 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T10:02:21.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:20 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T10:02:21.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:20 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:02:21.097 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:20 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T10:02:21.097 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:20 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T10:02:21.097 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:20 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T10:02:21.097 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:20 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T10:02:21.097 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:20 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-05T10:02:21.097 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:20 smithi150 ceph-mon[171606]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-05T10:02:21.097 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:20 smithi150 ceph-mon[171606]: Upgrade: unsafe to stop osd(s) at this time (17 PGs are or would become offline) 2023-12-05T10:02:21.097 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:20 smithi100 ceph-mon[187528]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-12-05T10:02:21.097 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:20 smithi100 ceph-mon[187528]: failed to encode map e75 with expected crc 2023-12-05T10:02:21.097 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:20 smithi100 ceph-mon[187528]: osdmap e75: 6 total, 5 up, 6 in 2023-12-05T10:02:21.097 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:20 smithi100 ceph-mon[187528]: from='osd.3 [v2:172.21.15.150:6800/1106863242,v1:172.21.15.150:6801/1106863242]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2023-12-05T10:02:21.098 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:20 smithi100 ceph-mon[187528]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2023-12-05T10:02:21.098 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:20 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:02:21.098 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:20 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:02:21.098 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:20 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T10:02:21.098 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:20 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T10:02:21.098 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:20 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:02:21.098 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:20 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T10:02:21.098 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:20 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T10:02:21.098 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:20 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T10:02:21.098 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:20 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T10:02:21.098 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:20 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-05T10:02:21.098 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:20 smithi100 ceph-mon[187528]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-05T10:02:21.098 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:20 smithi100 ceph-mon[187528]: Upgrade: unsafe to stop osd(s) at this time (17 PGs are or would become offline) 2023-12-05T10:02:22.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:21 smithi150 ceph-mon[171606]: pgmap v122: 65 pgs: 6 active+clean+remapped, 17 active+undersized+degraded, 20 active+undersized, 22 active+clean; 195 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 46/216 objects degraded (21.296%); 2/216 objects misplaced (0.926%); 0 B/s, 205 objects/s recovering 2023-12-05T10:02:22.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:21 smithi150 ceph-mon[171606]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-05T10:02:22.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:21 smithi150 ceph-mon[171606]: osd.3 [v2:172.21.15.150:6800/1106863242,v1:172.21.15.150:6801/1106863242] boot 2023-12-05T10:02:22.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:21 smithi150 ceph-mon[171606]: osdmap e76: 6 total, 6 up, 6 in 2023-12-05T10:02:22.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:21 smithi150 ceph-mon[171606]: failed to encode map e76 with expected crc 2023-12-05T10:02:22.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:21 smithi150 ceph-mon[171606]: failed to encode map e76 with expected crc 2023-12-05T10:02:22.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:21 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-05T10:02:22.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:21 smithi150 ceph-mon[171606]: osdmap e77: 6 total, 6 up, 6 in 2023-12-05T10:02:22.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:21 smithi100 ceph-mon[187528]: pgmap v122: 65 pgs: 6 active+clean+remapped, 17 active+undersized+degraded, 20 active+undersized, 22 active+clean; 195 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 46/216 objects degraded (21.296%); 2/216 objects misplaced (0.926%); 0 B/s, 205 objects/s recovering 2023-12-05T10:02:22.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:21 smithi100 ceph-mon[187528]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-05T10:02:22.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:21 smithi100 ceph-mon[187528]: osd.3 [v2:172.21.15.150:6800/1106863242,v1:172.21.15.150:6801/1106863242] boot 2023-12-05T10:02:22.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:21 smithi100 ceph-mon[187528]: osdmap e76: 6 total, 6 up, 6 in 2023-12-05T10:02:22.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:21 smithi100 ceph-mon[187528]: failed to encode map e76 with expected crc 2023-12-05T10:02:22.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:21 smithi100 ceph-mon[187528]: failed to encode map e76 with expected crc 2023-12-05T10:02:22.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:21 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-05T10:02:22.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:21 smithi100 ceph-mon[187528]: osdmap e77: 6 total, 6 up, 6 in 2023-12-05T10:02:23.345 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:23 smithi150 ceph-mon[171606]: failed to encode map e77 with expected crc 2023-12-05T10:02:23.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:23 smithi150 ceph-mon[171606]: failed to encode map e77 with expected crc 2023-12-05T10:02:23.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:23 smithi150 ceph-mon[171606]: failed to encode map e77 with expected crc 2023-12-05T10:02:23.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:23 smithi150 ceph-mon[171606]: failed to encode map e77 with expected crc 2023-12-05T10:02:23.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:23 smithi150 ceph-mon[171606]: failed to encode map e77 with expected crc 2023-12-05T10:02:23.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:23 smithi150 ceph-mon[171606]: failed to encode map e77 with expected crc 2023-12-05T10:02:23.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:23 smithi150 ceph-mon[171606]: failed to encode map e77 with expected crc 2023-12-05T10:02:23.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:23 smithi150 ceph-mon[171606]: osdmap e78: 6 total, 6 up, 6 in 2023-12-05T10:02:23.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:23 smithi100 ceph-mon[187528]: failed to encode map e77 with expected crc 2023-12-05T10:02:23.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:23 smithi100 ceph-mon[187528]: failed to encode map e77 with expected crc 2023-12-05T10:02:23.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:23 smithi100 ceph-mon[187528]: failed to encode map e77 with expected crc 2023-12-05T10:02:23.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:23 smithi100 ceph-mon[187528]: failed to encode map e77 with expected crc 2023-12-05T10:02:23.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:23 smithi100 ceph-mon[187528]: failed to encode map e77 with expected crc 2023-12-05T10:02:23.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:23 smithi100 ceph-mon[187528]: failed to encode map e77 with expected crc 2023-12-05T10:02:23.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:23 smithi100 ceph-mon[187528]: failed to encode map e77 with expected crc 2023-12-05T10:02:23.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:23 smithi100 ceph-mon[187528]: osdmap e78: 6 total, 6 up, 6 in 2023-12-05T10:02:24.345 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:24 smithi150 ceph-mon[171606]: pgmap v125: 65 pgs: 3 remapped+peering, 3 active+clean+remapped, 8 peering, 15 active+undersized+degraded, 14 active+undersized, 22 active+clean; 195 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 40/216 objects degraded (18.519%); 2/216 objects misplaced (0.926%); 0 B/s, 86 objects/s recovering 2023-12-05T10:02:24.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:24 smithi150 ceph-mon[171606]: failed to encode map e78 with expected crc 2023-12-05T10:02:24.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:24 smithi150 ceph-mon[171606]: failed to encode map e78 with expected crc 2023-12-05T10:02:24.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:24 smithi150 ceph-mon[171606]: failed to encode map e78 with expected crc 2023-12-05T10:02:24.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:24 smithi150 ceph-mon[171606]: failed to encode map e78 with expected crc 2023-12-05T10:02:24.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:24 smithi150 ceph-mon[171606]: Health check update: Degraded data redundancy: 40/216 objects degraded (18.519%), 15 pgs degraded (PG_DEGRADED) 2023-12-05T10:02:24.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:24 smithi150 ceph-mon[171606]: osdmap e79: 6 total, 6 up, 6 in 2023-12-05T10:02:24.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:24 smithi100 ceph-mon[187528]: pgmap v125: 65 pgs: 3 remapped+peering, 3 active+clean+remapped, 8 peering, 15 active+undersized+degraded, 14 active+undersized, 22 active+clean; 195 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 40/216 objects degraded (18.519%); 2/216 objects misplaced (0.926%); 0 B/s, 86 objects/s recovering 2023-12-05T10:02:24.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:24 smithi100 ceph-mon[187528]: failed to encode map e78 with expected crc 2023-12-05T10:02:24.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:24 smithi100 ceph-mon[187528]: failed to encode map e78 with expected crc 2023-12-05T10:02:24.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:24 smithi100 ceph-mon[187528]: failed to encode map e78 with expected crc 2023-12-05T10:02:24.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:24 smithi100 ceph-mon[187528]: failed to encode map e78 with expected crc 2023-12-05T10:02:24.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:24 smithi100 ceph-mon[187528]: Health check update: Degraded data redundancy: 40/216 objects degraded (18.519%), 15 pgs degraded (PG_DEGRADED) 2023-12-05T10:02:24.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:24 smithi100 ceph-mon[187528]: osdmap e79: 6 total, 6 up, 6 in 2023-12-05T10:02:25.345 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:25 smithi150 ceph-mon[171606]: failed to encode map e79 with expected crc 2023-12-05T10:02:25.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:25 smithi150 ceph-mon[171606]: failed to encode map e79 with expected crc 2023-12-05T10:02:25.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:25 smithi150 ceph-mon[171606]: failed to encode map e79 with expected crc 2023-12-05T10:02:25.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:25 smithi150 ceph-mon[171606]: failed to encode map e79 with expected crc 2023-12-05T10:02:25.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:25 smithi150 ceph-mon[171606]: osdmap e80: 6 total, 6 up, 6 in 2023-12-05T10:02:25.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:25 smithi100 ceph-mon[187528]: failed to encode map e79 with expected crc 2023-12-05T10:02:25.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:25 smithi100 ceph-mon[187528]: failed to encode map e79 with expected crc 2023-12-05T10:02:25.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:25 smithi100 ceph-mon[187528]: failed to encode map e79 with expected crc 2023-12-05T10:02:25.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:25 smithi100 ceph-mon[187528]: failed to encode map e79 with expected crc 2023-12-05T10:02:25.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:25 smithi100 ceph-mon[187528]: osdmap e80: 6 total, 6 up, 6 in 2023-12-05T10:02:26.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:26 smithi150 ceph-mon[171606]: pgmap v128: 65 pgs: 3 remapped+peering, 3 active+clean+remapped, 8 peering, 13 active+undersized+degraded, 13 active+undersized, 25 active+clean; 195 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 36/216 objects degraded (16.667%); 2/216 objects misplaced (0.926%) 2023-12-05T10:02:26.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:26 smithi150 ceph-mon[171606]: failed to encode map e80 with expected crc 2023-12-05T10:02:26.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:26 smithi150 ceph-mon[171606]: failed to encode map e80 with expected crc 2023-12-05T10:02:26.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:26 smithi150 ceph-mon[171606]: failed to encode map e80 with expected crc 2023-12-05T10:02:26.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:26 smithi150 ceph-mon[171606]: osdmap e81: 6 total, 6 up, 6 in 2023-12-05T10:02:26.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:26 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:02:26.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:26 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T10:02:26.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:26 smithi100 ceph-mon[187528]: pgmap v128: 65 pgs: 3 remapped+peering, 3 active+clean+remapped, 8 peering, 13 active+undersized+degraded, 13 active+undersized, 25 active+clean; 195 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 36/216 objects degraded (16.667%); 2/216 objects misplaced (0.926%) 2023-12-05T10:02:26.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:26 smithi100 ceph-mon[187528]: failed to encode map e80 with expected crc 2023-12-05T10:02:26.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:26 smithi100 ceph-mon[187528]: failed to encode map e80 with expected crc 2023-12-05T10:02:26.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:26 smithi100 ceph-mon[187528]: failed to encode map e80 with expected crc 2023-12-05T10:02:26.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:26 smithi100 ceph-mon[187528]: osdmap e81: 6 total, 6 up, 6 in 2023-12-05T10:02:26.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:26 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:02:26.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:26 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T10:02:27.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:27 smithi150 ceph-mon[171606]: failed to encode map e81 with expected crc 2023-12-05T10:02:27.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:27 smithi150 ceph-mon[171606]: failed to encode map e81 with expected crc 2023-12-05T10:02:27.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:27 smithi150 ceph-mon[171606]: osdmap e82: 6 total, 6 up, 6 in 2023-12-05T10:02:27.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:27 smithi100 ceph-mon[187528]: failed to encode map e81 with expected crc 2023-12-05T10:02:27.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:27 smithi100 ceph-mon[187528]: failed to encode map e81 with expected crc 2023-12-05T10:02:27.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:27 smithi100 ceph-mon[187528]: osdmap e82: 6 total, 6 up, 6 in 2023-12-05T10:02:28.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:28 smithi150 ceph-mon[171606]: pgmap v131: 65 pgs: 2 peering, 63 active+clean; 195 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s, 366 objects/s recovering 2023-12-05T10:02:28.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:28 smithi150 ceph-mon[171606]: failed to encode map e82 with expected crc 2023-12-05T10:02:28.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:28 smithi150 ceph-mon[171606]: failed to encode map e82 with expected crc 2023-12-05T10:02:28.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:28 smithi150 ceph-mon[171606]: failed to encode map e82 with expected crc 2023-12-05T10:02:28.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:28 smithi150 ceph-mon[171606]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2023-12-05T10:02:28.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:28 smithi150 ceph-mon[171606]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 36/216 objects degraded (16.667%), 13 pgs degraded) 2023-12-05T10:02:28.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:28 smithi150 ceph-mon[171606]: failed to encode map e82 with expected crc 2023-12-05T10:02:28.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:28 smithi100 ceph-mon[187528]: pgmap v131: 65 pgs: 2 peering, 63 active+clean; 195 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s, 366 objects/s recovering 2023-12-05T10:02:28.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:28 smithi100 ceph-mon[187528]: failed to encode map e82 with expected crc 2023-12-05T10:02:28.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:28 smithi100 ceph-mon[187528]: failed to encode map e82 with expected crc 2023-12-05T10:02:28.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:28 smithi100 ceph-mon[187528]: failed to encode map e82 with expected crc 2023-12-05T10:02:28.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:28 smithi100 ceph-mon[187528]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2023-12-05T10:02:28.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:28 smithi100 ceph-mon[187528]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 36/216 objects degraded (16.667%), 13 pgs degraded) 2023-12-05T10:02:28.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:28 smithi100 ceph-mon[187528]: failed to encode map e82 with expected crc 2023-12-05T10:02:30.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:30 smithi150 ceph-mon[171606]: pgmap v133: 65 pgs: 2 peering, 63 active+clean; 195 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s, 296 objects/s recovering 2023-12-05T10:02:30.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:30 smithi100 ceph-mon[187528]: pgmap v133: 65 pgs: 2 peering, 63 active+clean; 195 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s, 296 objects/s recovering 2023-12-05T10:02:31.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:31 smithi100 ceph-mon[187528]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2023-12-05T10:02:31.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:31 smithi100 ceph-mon[187528]: Cluster is now healthy 2023-12-05T10:02:31.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:31 smithi150 ceph-mon[171606]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2023-12-05T10:02:31.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:31 smithi150 ceph-mon[171606]: Cluster is now healthy 2023-12-05T10:02:32.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:32 smithi100 ceph-mon[187528]: pgmap v134: 65 pgs: 1 peering, 64 active+clean; 195 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s, 244 objects/s recovering 2023-12-05T10:02:32.595 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:32 smithi150 ceph-mon[171606]: pgmap v134: 65 pgs: 1 peering, 64 active+clean; 195 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s, 244 objects/s recovering 2023-12-05T10:02:34.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:34 smithi100 ceph-mon[187528]: pgmap v135: 65 pgs: 65 active+clean; 195 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s, 184 objects/s recovering 2023-12-05T10:02:34.595 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:34 smithi150 ceph-mon[171606]: pgmap v135: 65 pgs: 65 active+clean; 195 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s, 184 objects/s recovering 2023-12-05T10:02:35.322 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.324+0000 7f594a259700 1 -- 172.21.15.100:0/3356325860 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59440ffd70 msgr2=0x7f59441021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:02:35.323 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.324+0000 7f594a259700 1 --2- 172.21.15.100:0/3356325860 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59440ffd70 0x7f59441021d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5938004940 tx=0x7f5938009e30 comp rx=0 tx=0).stop 2023-12-05T10:02:35.323 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.324+0000 7f594a259700 1 -- 172.21.15.100:0/3356325860 shutdown_connections 2023-12-05T10:02:35.323 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.324+0000 7f594a259700 1 --2- 172.21.15.100:0/3356325860 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59440ffd70 0x7f59441021d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:35.323 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.324+0000 7f594a259700 1 --2- 172.21.15.100:0/3356325860 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5944066090 0x7f59440ff7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:35.323 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.324+0000 7f594a259700 1 -- 172.21.15.100:0/3356325860 >> 172.21.15.100:0/3356325860 conn(0x7f59440f7190 msgr2=0x7f59440f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:02:35.323 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.325+0000 7f594a259700 1 -- 172.21.15.100:0/3356325860 shutdown_connections 2023-12-05T10:02:35.323 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.325+0000 7f594a259700 1 -- 172.21.15.100:0/3356325860 wait complete. 2023-12-05T10:02:35.324 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.326+0000 7f594a259700 1 Processor -- start 2023-12-05T10:02:35.324 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.326+0000 7f594a259700 1 -- start start 2023-12-05T10:02:35.324 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.326+0000 7f594a259700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5944066090 0x7f594410d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:02:35.324 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.326+0000 7f594a259700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f59440ffd70 0x7f594410da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:02:35.325 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.326+0000 7f594a259700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f594410e020 con 0x7f5944066090 2023-12-05T10:02:35.325 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.326+0000 7f594a259700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f594410e8c0 con 0x7f59440ffd70 2023-12-05T10:02:35.325 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.326+0000 7f59437fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5944066090 0x7f594410d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:02:35.325 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.326+0000 7f59437fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5944066090 0x7f594410d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52688/0 (socket says 172.21.15.100:52688) 2023-12-05T10:02:35.325 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.326+0000 7f59437fe700 1 -- 172.21.15.100:0/1127779906 learned_addr learned my addr 172.21.15.100:0/1127779906 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T10:02:35.325 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.326+0000 7f5942ffd700 1 --2- 172.21.15.100:0/1127779906 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f59440ffd70 0x7f594410da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:02:35.325 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.327+0000 7f59437fe700 1 -- 172.21.15.100:0/1127779906 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f59440ffd70 msgr2=0x7f594410da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:02:35.325 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.327+0000 7f59437fe700 1 --2- 172.21.15.100:0/1127779906 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f59440ffd70 0x7f594410da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:35.325 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.327+0000 7f59437fe700 1 -- 172.21.15.100:0/1127779906 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5938005040 con 0x7f5944066090 2023-12-05T10:02:35.325 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.327+0000 7f5942ffd700 1 --2- 172.21.15.100:0/1127779906 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f59440ffd70 0x7f594410da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-05T10:02:35.325 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.327+0000 7f59437fe700 1 --2- 172.21.15.100:0/1127779906 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5944066090 0x7f594410d4e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f593400eb40 tx=0x7f593400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:02:35.326 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.327+0000 7f592bfff700 1 -- 172.21.15.100:0/1127779906 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5934007cc0 con 0x7f5944066090 2023-12-05T10:02:35.326 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.327+0000 7f592bfff700 1 -- 172.21.15.100:0/1127779906 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f593400f040 con 0x7f5944066090 2023-12-05T10:02:35.326 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.327+0000 7f594a259700 1 -- 172.21.15.100:0/1127779906 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f594410eb40 con 0x7f5944066090 2023-12-05T10:02:35.326 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.327+0000 7f592bfff700 1 -- 172.21.15.100:0/1127779906 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f593400c990 con 0x7f5944066090 2023-12-05T10:02:35.326 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.327+0000 7f594a259700 1 -- 172.21.15.100:0/1127779906 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f594410f080 con 0x7f5944066090 2023-12-05T10:02:35.326 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.329+0000 7f594a259700 1 -- 172.21.15.100:0/1127779906 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f594404bb80 con 0x7f5944066090 2023-12-05T10:02:35.327 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.330+0000 7f592bfff700 1 -- 172.21.15.100:0/1127779906 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f593400caf0 con 0x7f5944066090 2023-12-05T10:02:35.329 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.331+0000 7f592bfff700 1 --2- 172.21.15.100:0/1127779906 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f592c06ce70 0x7f592c06f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:02:35.329 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.331+0000 7f592bfff700 1 -- 172.21.15.100:0/1127779906 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6703+0+0 (secure 0 0 0) 0x7f593408bfb0 con 0x7f5944066090 2023-12-05T10:02:35.329 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.331+0000 7f5942ffd700 1 --2- 172.21.15.100:0/1127779906 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f592c06ce70 0x7f592c06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:02:35.329 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.332+0000 7f5942ffd700 1 --2- 172.21.15.100:0/1127779906 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f592c06ce70 0x7f592c06f320 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5938013680 tx=0x7f5938009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:02:35.333 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.336+0000 7f592bfff700 1 -- 172.21.15.100:0/1127779906 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f59340bf2f0 con 0x7f5944066090 2023-12-05T10:02:35.550 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.553+0000 7f594a259700 1 -- 172.21.15.100:0/1127779906 --> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f594410f4f0 con 0x7f592c06ce70 2023-12-05T10:02:35.552 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.554+0000 7f592bfff700 1 -- 172.21.15.100:0/1127779906 <== mgr.34104 v2:172.21.15.100:6800/3489431924 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f594410f4f0 con 0x7f592c06ce70 2023-12-05T10:02:35.554 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.556+0000 7f594a259700 1 -- 172.21.15.100:0/1127779906 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f592c06ce70 msgr2=0x7f592c06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:02:35.554 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.556+0000 7f594a259700 1 --2- 172.21.15.100:0/1127779906 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f592c06ce70 0x7f592c06f320 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5938013680 tx=0x7f5938009e30 comp rx=0 tx=0).stop 2023-12-05T10:02:35.555 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.556+0000 7f594a259700 1 -- 172.21.15.100:0/1127779906 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5944066090 msgr2=0x7f594410d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:02:35.555 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.556+0000 7f594a259700 1 --2- 172.21.15.100:0/1127779906 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5944066090 0x7f594410d4e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f593400eb40 tx=0x7f593400b040 comp rx=0 tx=0).stop 2023-12-05T10:02:35.555 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.557+0000 7f594a259700 1 -- 172.21.15.100:0/1127779906 shutdown_connections 2023-12-05T10:02:35.555 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.557+0000 7f594a259700 1 --2- 172.21.15.100:0/1127779906 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f592c06ce70 0x7f592c06f320 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:35.555 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.557+0000 7f594a259700 1 --2- 172.21.15.100:0/1127779906 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5944066090 0x7f594410d4e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:35.555 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.557+0000 7f594a259700 1 --2- 172.21.15.100:0/1127779906 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f59440ffd70 0x7f594410da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:35.555 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.557+0000 7f594a259700 1 -- 172.21.15.100:0/1127779906 >> 172.21.15.100:0/1127779906 conn(0x7f59440f7190 msgr2=0x7f59440f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:02:35.555 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.557+0000 7f594a259700 1 -- 172.21.15.100:0/1127779906 shutdown_connections 2023-12-05T10:02:35.555 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.557+0000 7f594a259700 1 -- 172.21.15.100:0/1127779906 wait complete. 2023-12-05T10:02:35.569 INFO:teuthology.orchestra.run.smithi100.stdout:true 2023-12-05T10:02:35.690 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.692+0000 7fad57673700 1 -- 172.21.15.100:0/2007721459 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad500fcbf0 msgr2=0x7fad500fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:02:35.690 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.692+0000 7fad57673700 1 --2- 172.21.15.100:0/2007721459 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad500fcbf0 0x7fad500fd000 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fad4c004940 tx=0x7fad4c009e30 comp rx=0 tx=0).stop 2023-12-05T10:02:35.690 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.692+0000 7fad57673700 1 -- 172.21.15.100:0/2007721459 shutdown_connections 2023-12-05T10:02:35.690 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.692+0000 7fad57673700 1 --2- 172.21.15.100:0/2007721459 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad500fde00 0x7fad500fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:35.691 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.692+0000 7fad57673700 1 --2- 172.21.15.100:0/2007721459 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad500fcbf0 0x7fad500fd000 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:35.691 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.692+0000 7fad57673700 1 -- 172.21.15.100:0/2007721459 >> 172.21.15.100:0/2007721459 conn(0x7fad500f82d0 msgr2=0x7fad500fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:02:35.691 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.692+0000 7fad57673700 1 -- 172.21.15.100:0/2007721459 shutdown_connections 2023-12-05T10:02:35.691 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.692+0000 7fad57673700 1 -- 172.21.15.100:0/2007721459 wait complete. 2023-12-05T10:02:35.692 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.693+0000 7fad57673700 1 Processor -- start 2023-12-05T10:02:35.692 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.693+0000 7fad57673700 1 -- start start 2023-12-05T10:02:35.692 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.694+0000 7fad57673700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad500fcbf0 0x7fad5010d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:02:35.692 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.694+0000 7fad57673700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad500fde00 0x7fad5010daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:02:35.692 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.694+0000 7fad57673700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad5010e0a0 con 0x7fad500fde00 2023-12-05T10:02:35.692 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.694+0000 7fad57673700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad5010e940 con 0x7fad500fcbf0 2023-12-05T10:02:35.692 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.694+0000 7fad54c0e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad500fde00 0x7fad5010daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:02:35.692 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.694+0000 7fad54c0e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad500fde00 0x7fad5010daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52716/0 (socket says 172.21.15.100:52716) 2023-12-05T10:02:35.692 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.694+0000 7fad54c0e700 1 -- 172.21.15.100:0/750597016 learned_addr learned my addr 172.21.15.100:0/750597016 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T10:02:35.692 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.694+0000 7fad5540f700 1 --2- 172.21.15.100:0/750597016 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad500fcbf0 0x7fad5010d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:02:35.693 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.694+0000 7fad54c0e700 1 -- 172.21.15.100:0/750597016 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad500fcbf0 msgr2=0x7fad5010d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:02:35.693 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.694+0000 7fad54c0e700 1 --2- 172.21.15.100:0/750597016 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad500fcbf0 0x7fad5010d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:35.693 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.694+0000 7fad54c0e700 1 -- 172.21.15.100:0/750597016 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad4c005040 con 0x7fad500fde00 2023-12-05T10:02:35.693 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.695+0000 7fad54c0e700 1 --2- 172.21.15.100:0/750597016 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad500fde00 0x7fad5010daa0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fad40002a50 tx=0x7fad400046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:02:35.693 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.695+0000 7fad45ffb700 1 -- 172.21.15.100:0/750597016 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad40007cc0 con 0x7fad500fde00 2023-12-05T10:02:35.694 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.695+0000 7fad45ffb700 1 -- 172.21.15.100:0/750597016 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fad4000f040 con 0x7fad500fde00 2023-12-05T10:02:35.694 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.695+0000 7fad57673700 1 -- 172.21.15.100:0/750597016 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad5010ec20 con 0x7fad500fde00 2023-12-05T10:02:35.694 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.695+0000 7fad45ffb700 1 -- 172.21.15.100:0/750597016 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad4000d9c0 con 0x7fad500fde00 2023-12-05T10:02:35.694 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.695+0000 7fad57673700 1 -- 172.21.15.100:0/750597016 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad5010f160 con 0x7fad500fde00 2023-12-05T10:02:35.694 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.696+0000 7fad57673700 1 -- 172.21.15.100:0/750597016 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad5004bb80 con 0x7fad500fde00 2023-12-05T10:02:35.694 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.697+0000 7fad45ffb700 1 -- 172.21.15.100:0/750597016 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fad4000db20 con 0x7fad500fde00 2023-12-05T10:02:35.695 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.698+0000 7fad45ffb700 1 --2- 172.21.15.100:0/750597016 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fad3c06ce60 0x7fad3c06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:02:35.695 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.698+0000 7fad45ffb700 1 -- 172.21.15.100:0/750597016 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6703+0+0 (secure 0 0 0) 0x7fad4008c1c0 con 0x7fad500fde00 2023-12-05T10:02:35.695 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.698+0000 7fad5540f700 1 --2- 172.21.15.100:0/750597016 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fad3c06ce60 0x7fad3c06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:02:35.696 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.698+0000 7fad5540f700 1 --2- 172.21.15.100:0/750597016 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fad3c06ce60 0x7fad3c06f310 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fad4c004890 tx=0x7fad4c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:02:35.700 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.702+0000 7fad45ffb700 1 -- 172.21.15.100:0/750597016 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fad40059970 con 0x7fad500fde00 2023-12-05T10:02:35.918 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.921+0000 7fad57673700 1 -- 172.21.15.100:0/750597016 --> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fad5010f5b0 con 0x7fad3c06ce60 2023-12-05T10:02:35.919 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.922+0000 7fad45ffb700 1 -- 172.21.15.100:0/750597016 <== mgr.34104 v2:172.21.15.100:6800/3489431924 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fad5010f5b0 con 0x7fad3c06ce60 2023-12-05T10:02:35.922 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.924+0000 7fad57673700 1 -- 172.21.15.100:0/750597016 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fad3c06ce60 msgr2=0x7fad3c06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:02:35.922 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.924+0000 7fad57673700 1 --2- 172.21.15.100:0/750597016 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fad3c06ce60 0x7fad3c06f310 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fad4c004890 tx=0x7fad4c009e30 comp rx=0 tx=0).stop 2023-12-05T10:02:35.922 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.924+0000 7fad57673700 1 -- 172.21.15.100:0/750597016 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad500fde00 msgr2=0x7fad5010daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:02:35.922 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.924+0000 7fad57673700 1 --2- 172.21.15.100:0/750597016 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad500fde00 0x7fad5010daa0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fad40002a50 tx=0x7fad400046b0 comp rx=0 tx=0).stop 2023-12-05T10:02:35.922 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.924+0000 7fad57673700 1 -- 172.21.15.100:0/750597016 shutdown_connections 2023-12-05T10:02:35.922 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.924+0000 7fad57673700 1 --2- 172.21.15.100:0/750597016 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fad3c06ce60 0x7fad3c06f310 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:35.922 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.924+0000 7fad57673700 1 --2- 172.21.15.100:0/750597016 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad500fcbf0 0x7fad5010d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:35.922 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.924+0000 7fad57673700 1 --2- 172.21.15.100:0/750597016 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad500fde00 0x7fad5010daa0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:35.922 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.924+0000 7fad57673700 1 -- 172.21.15.100:0/750597016 >> 172.21.15.100:0/750597016 conn(0x7fad500f82d0 msgr2=0x7fad50101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:02:35.922 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.924+0000 7fad57673700 1 -- 172.21.15.100:0/750597016 shutdown_connections 2023-12-05T10:02:35.923 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:35.924+0000 7fad57673700 1 -- 172.21.15.100:0/750597016 wait complete. 2023-12-05T10:02:36.056 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.058+0000 7ff4fc7e8700 1 -- 172.21.15.100:0/3231094940 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4f40fcbf0 msgr2=0x7ff4f40fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:02:36.056 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.058+0000 7ff4fc7e8700 1 --2- 172.21.15.100:0/3231094940 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4f40fcbf0 0x7ff4f40fd000 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff4f0004940 tx=0x7ff4f0009e30 comp rx=0 tx=0).stop 2023-12-05T10:02:36.056 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.058+0000 7ff4fc7e8700 1 -- 172.21.15.100:0/3231094940 shutdown_connections 2023-12-05T10:02:36.057 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.058+0000 7ff4fc7e8700 1 --2- 172.21.15.100:0/3231094940 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff4f40fde00 0x7ff4f40fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:36.057 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.058+0000 7ff4fc7e8700 1 --2- 172.21.15.100:0/3231094940 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4f40fcbf0 0x7ff4f40fd000 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:36.057 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.059+0000 7ff4fc7e8700 1 -- 172.21.15.100:0/3231094940 >> 172.21.15.100:0/3231094940 conn(0x7ff4f40f82d0 msgr2=0x7ff4f40fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:02:36.057 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.059+0000 7ff4fc7e8700 1 -- 172.21.15.100:0/3231094940 shutdown_connections 2023-12-05T10:02:36.057 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.059+0000 7ff4fc7e8700 1 -- 172.21.15.100:0/3231094940 wait complete. 2023-12-05T10:02:36.057 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.060+0000 7ff4fc7e8700 1 Processor -- start 2023-12-05T10:02:36.057 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.060+0000 7ff4fc7e8700 1 -- start start 2023-12-05T10:02:36.058 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.060+0000 7ff4fc7e8700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff4f40fcbf0 0x7ff4f410d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:02:36.058 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.060+0000 7ff4fc7e8700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4f40fde00 0x7ff4f410da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:02:36.058 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.061+0000 7ff4fc7e8700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f410e010 con 0x7ff4f40fde00 2023-12-05T10:02:36.058 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.061+0000 7ff4fc7e8700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f410e8b0 con 0x7ff4f40fcbf0 2023-12-05T10:02:36.059 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.061+0000 7ff4f9d83700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4f40fde00 0x7ff4f410da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:02:36.059 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.061+0000 7ff4fa584700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff4f40fcbf0 0x7ff4f410d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:02:36.059 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.061+0000 7ff4f9d83700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4f40fde00 0x7ff4f410da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52734/0 (socket says 172.21.15.100:52734) 2023-12-05T10:02:36.059 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.061+0000 7ff4f9d83700 1 -- 172.21.15.100:0/1294861877 learned_addr learned my addr 172.21.15.100:0/1294861877 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T10:02:36.059 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.061+0000 7ff4fa584700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff4f40fcbf0 0x7ff4f410d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.100:33804/0 (socket says 172.21.15.100:33804) 2023-12-05T10:02:36.059 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.061+0000 7ff4f9d83700 1 -- 172.21.15.100:0/1294861877 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff4f40fcbf0 msgr2=0x7ff4f410d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:02:36.059 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.061+0000 7ff4f9d83700 1 --2- 172.21.15.100:0/1294861877 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff4f40fcbf0 0x7ff4f410d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:36.059 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.061+0000 7ff4f9d83700 1 -- 172.21.15.100:0/1294861877 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f0005040 con 0x7ff4f40fde00 2023-12-05T10:02:36.060 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.061+0000 7ff4f9d83700 1 --2- 172.21.15.100:0/1294861877 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4f40fde00 0x7ff4f410da10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff4e400eb40 tx=0x7ff4e400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:02:36.060 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.062+0000 7ff4eaffd700 1 -- 172.21.15.100:0/1294861877 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4e4007cc0 con 0x7ff4f40fde00 2023-12-05T10:02:36.060 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.062+0000 7ff4eaffd700 1 -- 172.21.15.100:0/1294861877 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff4e400f040 con 0x7ff4f40fde00 2023-12-05T10:02:36.060 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.062+0000 7ff4fc7e8700 1 -- 172.21.15.100:0/1294861877 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4f410eb30 con 0x7ff4f40fde00 2023-12-05T10:02:36.060 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.062+0000 7ff4eaffd700 1 -- 172.21.15.100:0/1294861877 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4e400c990 con 0x7ff4f40fde00 2023-12-05T10:02:36.060 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.062+0000 7ff4fc7e8700 1 -- 172.21.15.100:0/1294861877 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4f410f070 con 0x7ff4f40fde00 2023-12-05T10:02:36.060 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.063+0000 7ff4fc7e8700 1 -- 172.21.15.100:0/1294861877 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4f404bb80 con 0x7ff4f40fde00 2023-12-05T10:02:36.061 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.064+0000 7ff4eaffd700 1 -- 172.21.15.100:0/1294861877 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7ff4e400caf0 con 0x7ff4f40fde00 2023-12-05T10:02:36.062 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.065+0000 7ff4eaffd700 1 --2- 172.21.15.100:0/1294861877 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7ff4e006ce70 0x7ff4e006f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:02:36.062 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.065+0000 7ff4eaffd700 1 -- 172.21.15.100:0/1294861877 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6703+0+0 (secure 0 0 0) 0x7ff4e408bfb0 con 0x7ff4f40fde00 2023-12-05T10:02:36.062 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.065+0000 7ff4fa584700 1 --2- 172.21.15.100:0/1294861877 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7ff4e006ce70 0x7ff4e006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:02:36.063 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.065+0000 7ff4fa584700 1 --2- 172.21.15.100:0/1294861877 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7ff4e006ce70 0x7ff4e006f320 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff4f0013680 tx=0x7ff4f0009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:02:36.066 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.069+0000 7ff4eaffd700 1 -- 172.21.15.100:0/1294861877 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7ff4e40bf2f0 con 0x7ff4f40fde00 2023-12-05T10:02:36.276 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.278+0000 7ff4fc7e8700 1 -- 172.21.15.100:0/1294861877 --> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff4f410f4d0 con 0x7ff4e006ce70 2023-12-05T10:02:36.278 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:36 smithi150 ceph-mon[171606]: pgmap v136: 65 pgs: 65 active+clean; 195 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 154 objects/s recovering 2023-12-05T10:02:36.278 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:36 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-05T10:02:36.278 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:36 smithi150 ceph-mon[171606]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-05T10:02:36.278 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:36 smithi150 ceph-mon[171606]: Upgrade: osd.4 is safe to restart 2023-12-05T10:02:36.278 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:36 smithi150 ceph-mon[171606]: from='client.34308 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T10:02:36.286 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.288+0000 7ff4eaffd700 1 -- 172.21.15.100:0/1294861877 <== mgr.34104 v2:172.21.15.100:6800/3489431924 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7ff4f410f4d0 con 0x7ff4e006ce70 2023-12-05T10:02:36.286 INFO:teuthology.orchestra.run.smithi100.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-05T10:02:36.286 INFO:teuthology.orchestra.run.smithi100.stdout:alertmanager.smithi100 smithi100 *:9093,9094 running (5m) 53s ago 12m 14.7M - 0.25.0 c8568f914cd2 f443e6a4242b 2023-12-05T10:02:36.286 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi100 smithi100 running (2m) 53s ago 12m 7843k - 19.0.0-11-g3fe8d441 56dea28e5206 fb8e6b844fba 2023-12-05T10:02:36.286 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi150 smithi150 running (2m) 21s ago 11m 7847k - 19.0.0-11-g3fe8d441 56dea28e5206 a035052de6cf 2023-12-05T10:02:36.286 INFO:teuthology.orchestra.run.smithi100.stdout:grafana.smithi100 smithi100 *:3000 running (5m) 53s ago 12m 80.1M - 9.4.7 2c41d148cca3 d666da9c4e4d 2023-12-05T10:02:36.286 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.akmstb smithi100 running (7m) 53s ago 7m 10.5G - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 6ce55c42c55b 2023-12-05T10:02:36.286 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.sqplhn smithi100 running (8m) 53s ago 8m 15.9M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc c2682d65f0c9 2023-12-05T10:02:36.286 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi150.fcnhsv smithi150 running (7m) 21s ago 7m 15.7M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 1a259762235d 2023-12-05T10:02:36.286 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi150.pcbpxm smithi150 running (8m) 21s ago 8m 15.7M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 27f730f8b9f9 2023-12-05T10:02:36.287 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi100.ehmuhg smithi100 *:8443,9283,8765 running (4m) 53s ago 13m 516M - 19.0.0-11-g3fe8d441 56dea28e5206 ebe3dfbb0356 2023-12-05T10:02:36.287 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi150.zkskag smithi150 *:8443,9283,8765 running (3m) 21s ago 11m 452M - 19.0.0-11-g3fe8d441 56dea28e5206 a2b40e2421f2 2023-12-05T10:02:36.287 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi100 smithi100 running (3m) 53s ago 14m 70.8M 2048M 19.0.0-11-g3fe8d441 56dea28e5206 21003fd7eaf4 2023-12-05T10:02:36.287 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi150 smithi150 running (3m) 21s ago 11m 48.4M 2048M 19.0.0-11-g3fe8d441 56dea28e5206 010f2f658fca 2023-12-05T10:02:36.287 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi100 smithi100 *:9100 running (5m) 53s ago 12m 8288k - 1.5.0 0da6a335fe13 a2653da0d840 2023-12-05T10:02:36.287 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi150 smithi150 *:9100 running (4m) 21s ago 11m 8262k - 1.5.0 0da6a335fe13 67523645e73b 2023-12-05T10:02:36.287 INFO:teuthology.orchestra.run.smithi100.stdout:osd.0 smithi100 running (2m) 53s ago 11m 133M 1618M 19.0.0-11-g3fe8d441 56dea28e5206 a29add095f14 2023-12-05T10:02:36.287 INFO:teuthology.orchestra.run.smithi100.stdout:osd.1 smithi100 running (93s) 53s ago 10m 135M 1618M 19.0.0-11-g3fe8d441 56dea28e5206 2de00a9dc686 2023-12-05T10:02:36.287 INFO:teuthology.orchestra.run.smithi100.stdout:osd.2 smithi100 running (58s) 53s ago 10m 12.6M 1618M 19.0.0-11-g3fe8d441 56dea28e5206 fb6adf680449 2023-12-05T10:02:36.287 INFO:teuthology.orchestra.run.smithi100.stdout:osd.3 smithi150 running (24s) 21s ago 9m 12.6M 2642M 19.0.0-11-g3fe8d441 56dea28e5206 08545df235d8 2023-12-05T10:02:36.287 INFO:teuthology.orchestra.run.smithi100.stdout:osd.4 smithi150 running (9m) 21s ago 9m 872M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc dfef9accd162 2023-12-05T10:02:36.287 INFO:teuthology.orchestra.run.smithi100.stdout:osd.5 smithi150 running (9m) 21s ago 9m 1065M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc d9720b1eae0c 2023-12-05T10:02:36.287 INFO:teuthology.orchestra.run.smithi100.stdout:prometheus.smithi100 smithi100 *:9095 running (4m) 53s ago 12m 59.7M - 2.43.0 a07b618ecd1d 8ade75deb316 2023-12-05T10:02:36.288 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.290+0000 7ff4fc7e8700 1 -- 172.21.15.100:0/1294861877 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7ff4e006ce70 msgr2=0x7ff4e006f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:02:36.288 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.290+0000 7ff4fc7e8700 1 --2- 172.21.15.100:0/1294861877 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7ff4e006ce70 0x7ff4e006f320 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff4f0013680 tx=0x7ff4f0009e30 comp rx=0 tx=0).stop 2023-12-05T10:02:36.288 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.290+0000 7ff4fc7e8700 1 -- 172.21.15.100:0/1294861877 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4f40fde00 msgr2=0x7ff4f410da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:02:36.288 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.290+0000 7ff4fc7e8700 1 --2- 172.21.15.100:0/1294861877 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4f40fde00 0x7ff4f410da10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff4e400eb40 tx=0x7ff4e400b040 comp rx=0 tx=0).stop 2023-12-05T10:02:36.288 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.291+0000 7ff4fc7e8700 1 -- 172.21.15.100:0/1294861877 shutdown_connections 2023-12-05T10:02:36.289 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.291+0000 7ff4fc7e8700 1 --2- 172.21.15.100:0/1294861877 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7ff4e006ce70 0x7ff4e006f320 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:36.289 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.291+0000 7ff4fc7e8700 1 --2- 172.21.15.100:0/1294861877 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff4f40fcbf0 0x7ff4f410d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:36.289 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.291+0000 7ff4fc7e8700 1 --2- 172.21.15.100:0/1294861877 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4f40fde00 0x7ff4f410da10 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:36.289 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.291+0000 7ff4fc7e8700 1 -- 172.21.15.100:0/1294861877 >> 172.21.15.100:0/1294861877 conn(0x7ff4f40f82d0 msgr2=0x7ff4f4101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:02:36.289 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.291+0000 7ff4fc7e8700 1 -- 172.21.15.100:0/1294861877 shutdown_connections 2023-12-05T10:02:36.289 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.291+0000 7ff4fc7e8700 1 -- 172.21.15.100:0/1294861877 wait complete. 2023-12-05T10:02:36.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:36 smithi100 ceph-mon[187528]: pgmap v136: 65 pgs: 65 active+clean; 195 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 154 objects/s recovering 2023-12-05T10:02:36.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:36 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-05T10:02:36.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:36 smithi100 ceph-mon[187528]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-05T10:02:36.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:36 smithi100 ceph-mon[187528]: Upgrade: osd.4 is safe to restart 2023-12-05T10:02:36.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:36 smithi100 ceph-mon[187528]: from='client.34308 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T10:02:36.422 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.424+0000 7f2f26081700 1 -- 172.21.15.100:0/304338319 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f20071bc0 msgr2=0x7f2f20070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:02:36.423 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.424+0000 7f2f26081700 1 --2- 172.21.15.100:0/304338319 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f20071bc0 0x7f2f20070030 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2f10004940 tx=0x7f2f10009e30 comp rx=0 tx=0).stop 2023-12-05T10:02:36.423 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.425+0000 7f2f26081700 1 -- 172.21.15.100:0/304338319 shutdown_connections 2023-12-05T10:02:36.423 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.425+0000 7f2f26081700 1 --2- 172.21.15.100:0/304338319 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f20070570 0x7f2f200709c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:36.423 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.425+0000 7f2f26081700 1 --2- 172.21.15.100:0/304338319 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f20071bc0 0x7f2f20070030 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:36.423 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.425+0000 7f2f26081700 1 -- 172.21.15.100:0/304338319 >> 172.21.15.100:0/304338319 conn(0x7f2f200f82d0 msgr2=0x7f2f200fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:02:36.423 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.425+0000 7f2f26081700 1 -- 172.21.15.100:0/304338319 shutdown_connections 2023-12-05T10:02:36.423 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.425+0000 7f2f26081700 1 -- 172.21.15.100:0/304338319 wait complete. 2023-12-05T10:02:36.425 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.425+0000 7f2f26081700 1 Processor -- start 2023-12-05T10:02:36.425 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.426+0000 7f2f26081700 1 -- start start 2023-12-05T10:02:36.425 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.426+0000 7f2f26081700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f20070570 0x7f2f2010f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:02:36.425 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.426+0000 7f2f26081700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f20071bc0 0x7f2f2010fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:02:36.425 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.426+0000 7f2f26081700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f20110420 con 0x7f2f20070570 2023-12-05T10:02:36.425 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.426+0000 7f2f26081700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f20110cc0 con 0x7f2f20071bc0 2023-12-05T10:02:36.425 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.426+0000 7f2f1f7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f20070570 0x7f2f2010f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:02:36.425 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.426+0000 7f2f1f7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f20070570 0x7f2f2010f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52752/0 (socket says 172.21.15.100:52752) 2023-12-05T10:02:36.425 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.426+0000 7f2f1f7fe700 1 -- 172.21.15.100:0/2208121249 learned_addr learned my addr 172.21.15.100:0/2208121249 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T10:02:36.425 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.426+0000 7f2f1effd700 1 --2- 172.21.15.100:0/2208121249 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f20071bc0 0x7f2f2010fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:02:36.425 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.427+0000 7f2f1f7fe700 1 -- 172.21.15.100:0/2208121249 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f20071bc0 msgr2=0x7f2f2010fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:02:36.426 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.427+0000 7f2f1f7fe700 1 --2- 172.21.15.100:0/2208121249 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f20071bc0 0x7f2f2010fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:36.426 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.427+0000 7f2f1f7fe700 1 -- 172.21.15.100:0/2208121249 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f10005040 con 0x7f2f20070570 2023-12-05T10:02:36.426 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.427+0000 7f2f1f7fe700 1 --2- 172.21.15.100:0/2208121249 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f20070570 0x7f2f2010f8e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2f1000b3b0 tx=0x7f2f10009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:02:36.426 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.427+0000 7f2f07fff700 1 -- 172.21.15.100:0/2208121249 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f1000e040 con 0x7f2f20070570 2023-12-05T10:02:36.426 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.427+0000 7f2f07fff700 1 -- 172.21.15.100:0/2208121249 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2f1000bbf0 con 0x7f2f20070570 2023-12-05T10:02:36.426 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.427+0000 7f2f26081700 1 -- 172.21.15.100:0/2208121249 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f20110f40 con 0x7f2f20070570 2023-12-05T10:02:36.426 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.427+0000 7f2f07fff700 1 -- 172.21.15.100:0/2208121249 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f1001c3f0 con 0x7f2f20070570 2023-12-05T10:02:36.426 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.427+0000 7f2f26081700 1 -- 172.21.15.100:0/2208121249 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f20111480 con 0x7f2f20070570 2023-12-05T10:02:36.426 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.428+0000 7f2f26081700 1 -- 172.21.15.100:0/2208121249 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f201096f0 con 0x7f2f20070570 2023-12-05T10:02:36.427 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.429+0000 7f2f07fff700 1 -- 172.21.15.100:0/2208121249 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f2f1000bd60 con 0x7f2f20070570 2023-12-05T10:02:36.428 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.430+0000 7f2f07fff700 1 --2- 172.21.15.100:0/2208121249 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f2f0806ce70 0x7f2f0806f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:02:36.428 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.430+0000 7f2f07fff700 1 -- 172.21.15.100:0/2208121249 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6703+0+0 (secure 0 0 0) 0x7f2f1008d660 con 0x7f2f20070570 2023-12-05T10:02:36.428 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.431+0000 7f2f1effd700 1 --2- 172.21.15.100:0/2208121249 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f2f0806ce70 0x7f2f0806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:02:36.428 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.431+0000 7f2f1effd700 1 --2- 172.21.15.100:0/2208121249 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f2f0806ce70 0x7f2f0806f320 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2f14004f40 tx=0x7f2f1400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:02:36.432 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.435+0000 7f2f07fff700 1 -- 172.21.15.100:0/2208121249 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f2f1005afd0 con 0x7f2f20070570 2023-12-05T10:02:36.721 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.723+0000 7f2f26081700 1 -- 172.21.15.100:0/2208121249 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2f20109110 con 0x7f2f20070570 2023-12-05T10:02:36.721 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.724+0000 7f2f07fff700 1 -- 172.21.15.100:0/2208121249 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+827 (secure 0 0 0) 0x7f2f1005ab60 con 0x7f2f20070570 2023-12-05T10:02:36.722 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2023-12-05T10:02:36.722 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": { 2023-12-05T10:02:36.722 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 2 2023-12-05T10:02:36.722 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-12-05T10:02:36.722 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": { 2023-12-05T10:02:36.722 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 2 2023-12-05T10:02:36.722 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-12-05T10:02:36.722 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": { 2023-12-05T10:02:36.722 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 2, 2023-12-05T10:02:36.722 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 4 2023-12-05T10:02:36.722 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-12-05T10:02:36.722 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": { 2023-12-05T10:02:36.723 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 4 2023-12-05T10:02:36.723 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-12-05T10:02:36.723 INFO:teuthology.orchestra.run.smithi100.stdout: "overall": { 2023-12-05T10:02:36.723 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 6, 2023-12-05T10:02:36.723 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 8 2023-12-05T10:02:36.723 INFO:teuthology.orchestra.run.smithi100.stdout: } 2023-12-05T10:02:36.723 INFO:teuthology.orchestra.run.smithi100.stdout:} 2023-12-05T10:02:36.724 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.726+0000 7f2f26081700 1 -- 172.21.15.100:0/2208121249 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f2f0806ce70 msgr2=0x7f2f0806f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:02:36.724 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.726+0000 7f2f26081700 1 --2- 172.21.15.100:0/2208121249 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f2f0806ce70 0x7f2f0806f320 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2f14004f40 tx=0x7f2f1400b040 comp rx=0 tx=0).stop 2023-12-05T10:02:36.724 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.726+0000 7f2f26081700 1 -- 172.21.15.100:0/2208121249 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f20070570 msgr2=0x7f2f2010f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:02:36.724 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.726+0000 7f2f26081700 1 --2- 172.21.15.100:0/2208121249 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f20070570 0x7f2f2010f8e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2f1000b3b0 tx=0x7f2f10009e30 comp rx=0 tx=0).stop 2023-12-05T10:02:36.724 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.726+0000 7f2f26081700 1 -- 172.21.15.100:0/2208121249 shutdown_connections 2023-12-05T10:02:36.724 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.726+0000 7f2f26081700 1 --2- 172.21.15.100:0/2208121249 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f2f0806ce70 0x7f2f0806f320 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:36.724 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.726+0000 7f2f26081700 1 --2- 172.21.15.100:0/2208121249 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f20070570 0x7f2f2010f8e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:36.725 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.726+0000 7f2f26081700 1 --2- 172.21.15.100:0/2208121249 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f20071bc0 0x7f2f2010fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:36.725 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.726+0000 7f2f26081700 1 -- 172.21.15.100:0/2208121249 >> 172.21.15.100:0/2208121249 conn(0x7f2f200f82d0 msgr2=0x7f2f20103310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:02:36.725 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.726+0000 7f2f26081700 1 -- 172.21.15.100:0/2208121249 shutdown_connections 2023-12-05T10:02:36.725 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.726+0000 7f2f26081700 1 -- 172.21.15.100:0/2208121249 wait complete. 2023-12-05T10:02:36.863 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.864+0000 7fd077d0a700 1 -- 172.21.15.100:0/1996060357 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd070071bc0 msgr2=0x7fd070070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:02:36.863 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.864+0000 7fd077d0a700 1 --2- 172.21.15.100:0/1996060357 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd070071bc0 0x7fd070070030 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd06c004940 tx=0x7fd06c009e30 comp rx=0 tx=0).stop 2023-12-05T10:02:36.863 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.865+0000 7fd077d0a700 1 -- 172.21.15.100:0/1996060357 shutdown_connections 2023-12-05T10:02:36.863 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.865+0000 7fd077d0a700 1 --2- 172.21.15.100:0/1996060357 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd070070570 0x7fd0700709c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:36.863 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.865+0000 7fd077d0a700 1 --2- 172.21.15.100:0/1996060357 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd070071bc0 0x7fd070070030 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:36.863 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.865+0000 7fd077d0a700 1 -- 172.21.15.100:0/1996060357 >> 172.21.15.100:0/1996060357 conn(0x7fd0700f82d0 msgr2=0x7fd0700fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:02:36.863 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.865+0000 7fd077d0a700 1 -- 172.21.15.100:0/1996060357 shutdown_connections 2023-12-05T10:02:36.863 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.865+0000 7fd077d0a700 1 -- 172.21.15.100:0/1996060357 wait complete. 2023-12-05T10:02:36.864 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.866+0000 7fd077d0a700 1 Processor -- start 2023-12-05T10:02:36.864 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.866+0000 7fd077d0a700 1 -- start start 2023-12-05T10:02:36.864 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.866+0000 7fd077d0a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd070070570 0x7fd07010f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:02:36.864 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.867+0000 7fd077d0a700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd070071bc0 0x7fd07010fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:02:36.864 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.867+0000 7fd077d0a700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd070110420 con 0x7fd070071bc0 2023-12-05T10:02:36.864 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.867+0000 7fd077d0a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd070110cc0 con 0x7fd070070570 2023-12-05T10:02:36.865 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.867+0000 7fd075aa6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd070070570 0x7fd07010f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:02:36.865 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.867+0000 7fd0752a5700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd070071bc0 0x7fd07010fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:02:36.865 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.867+0000 7fd075aa6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd070070570 0x7fd07010f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.100:33852/0 (socket says 172.21.15.100:33852) 2023-12-05T10:02:36.865 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.867+0000 7fd075aa6700 1 -- 172.21.15.100:0/2958089135 learned_addr learned my addr 172.21.15.100:0/2958089135 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T10:02:36.865 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.867+0000 7fd075aa6700 1 -- 172.21.15.100:0/2958089135 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd070071bc0 msgr2=0x7fd07010fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:02:36.865 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.867+0000 7fd075aa6700 1 --2- 172.21.15.100:0/2958089135 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd070071bc0 0x7fd07010fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:36.865 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.867+0000 7fd075aa6700 1 -- 172.21.15.100:0/2958089135 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd06c005040 con 0x7fd070070570 2023-12-05T10:02:36.865 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.867+0000 7fd0752a5700 1 --2- 172.21.15.100:0/2958089135 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd070071bc0 0x7fd07010fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-05T10:02:36.865 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.868+0000 7fd075aa6700 1 --2- 172.21.15.100:0/2958089135 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd070070570 0x7fd07010f8e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd06c004890 tx=0x7fd06c009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:02:36.866 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.868+0000 7fd0667fc700 1 -- 172.21.15.100:0/2958089135 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd06c021070 con 0x7fd070070570 2023-12-05T10:02:36.866 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.868+0000 7fd077d0a700 1 -- 172.21.15.100:0/2958089135 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd070110f40 con 0x7fd070070570 2023-12-05T10:02:36.866 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.868+0000 7fd0667fc700 1 -- 172.21.15.100:0/2958089135 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd06c004290 con 0x7fd070070570 2023-12-05T10:02:36.866 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.868+0000 7fd0667fc700 1 -- 172.21.15.100:0/2958089135 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd06c00e070 con 0x7fd070070570 2023-12-05T10:02:36.866 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.868+0000 7fd077d0a700 1 -- 172.21.15.100:0/2958089135 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd070111420 con 0x7fd070070570 2023-12-05T10:02:36.867 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.869+0000 7fd077d0a700 1 -- 172.21.15.100:0/2958089135 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0701096f0 con 0x7fd070070570 2023-12-05T10:02:36.867 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.870+0000 7fd0667fc700 1 -- 172.21.15.100:0/2958089135 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fd06c01c690 con 0x7fd070070570 2023-12-05T10:02:36.868 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.871+0000 7fd0667fc700 1 --2- 172.21.15.100:0/2958089135 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fd05c06ce70 0x7fd05c06f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:02:36.868 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.871+0000 7fd0667fc700 1 -- 172.21.15.100:0/2958089135 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6703+0+0 (secure 0 0 0) 0x7fd06c08d5e0 con 0x7fd070070570 2023-12-05T10:02:36.869 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.871+0000 7fd0752a5700 1 --2- 172.21.15.100:0/2958089135 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fd05c06ce70 0x7fd05c06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:02:36.869 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.872+0000 7fd0752a5700 1 --2- 172.21.15.100:0/2958089135 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fd05c06ce70 0x7fd05c06f320 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd060009b80 tx=0x7fd06000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:02:36.873 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:36.876+0000 7fd0667fc700 1 -- 172.21.15.100:0/2958089135 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fd06c05ae90 con 0x7fd070070570 2023-12-05T10:02:37.112 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.115+0000 7fd077d0a700 1 -- 172.21.15.100:0/2958089135 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd07004bb80 con 0x7fd070070570 2023-12-05T10:02:37.113 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.115+0000 7fd0667fc700 1 -- 172.21.15.100:0/2958089135 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1852 (secure 0 0 0) 0x7fd06c05aa20 con 0x7fd070070570 2023-12-05T10:02:37.113 INFO:teuthology.orchestra.run.smithi100.stdout:e13 2023-12-05T10:02:37.113 INFO:teuthology.orchestra.run.smithi100.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-05T10:02:37.113 INFO:teuthology.orchestra.run.smithi100.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T10:02:37.113 INFO:teuthology.orchestra.run.smithi100.stdout:legacy client fscid: 1 2023-12-05T10:02:37.113 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T10:02:37.113 INFO:teuthology.orchestra.run.smithi100.stdout:Filesystem 'cephfs' (1) 2023-12-05T10:02:37.113 INFO:teuthology.orchestra.run.smithi100.stdout:fs_name cephfs 2023-12-05T10:02:37.113 INFO:teuthology.orchestra.run.smithi100.stdout:epoch 13 2023-12-05T10:02:37.114 INFO:teuthology.orchestra.run.smithi100.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-05T10:02:37.114 INFO:teuthology.orchestra.run.smithi100.stdout:created 2023-12-05T09:54:30.515778+0000 2023-12-05T10:02:37.114 INFO:teuthology.orchestra.run.smithi100.stdout:modified 2023-12-05T09:54:46.403009+0000 2023-12-05T10:02:37.114 INFO:teuthology.orchestra.run.smithi100.stdout:tableserver 0 2023-12-05T10:02:37.114 INFO:teuthology.orchestra.run.smithi100.stdout:root 0 2023-12-05T10:02:37.114 INFO:teuthology.orchestra.run.smithi100.stdout:session_timeout 60 2023-12-05T10:02:37.114 INFO:teuthology.orchestra.run.smithi100.stdout:session_autoclose 300 2023-12-05T10:02:37.114 INFO:teuthology.orchestra.run.smithi100.stdout:max_file_size 1099511627776 2023-12-05T10:02:37.114 INFO:teuthology.orchestra.run.smithi100.stdout:max_xattr_size 65536 2023-12-05T10:02:37.114 INFO:teuthology.orchestra.run.smithi100.stdout:required_client_features {} 2023-12-05T10:02:37.114 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure 0 2023-12-05T10:02:37.114 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure_osd_epoch 46 2023-12-05T10:02:37.114 INFO:teuthology.orchestra.run.smithi100.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T10:02:37.114 INFO:teuthology.orchestra.run.smithi100.stdout:max_mds 1 2023-12-05T10:02:37.114 INFO:teuthology.orchestra.run.smithi100.stdout:in 0 2023-12-05T10:02:37.115 INFO:teuthology.orchestra.run.smithi100.stdout:up {0=14490} 2023-12-05T10:02:37.115 INFO:teuthology.orchestra.run.smithi100.stdout:failed 2023-12-05T10:02:37.115 INFO:teuthology.orchestra.run.smithi100.stdout:damaged 2023-12-05T10:02:37.115 INFO:teuthology.orchestra.run.smithi100.stdout:stopped 2023-12-05T10:02:37.115 INFO:teuthology.orchestra.run.smithi100.stdout:data_pools [3] 2023-12-05T10:02:37.115 INFO:teuthology.orchestra.run.smithi100.stdout:metadata_pool 2 2023-12-05T10:02:37.115 INFO:teuthology.orchestra.run.smithi100.stdout:inline_data disabled 2023-12-05T10:02:37.115 INFO:teuthology.orchestra.run.smithi100.stdout:balancer 2023-12-05T10:02:37.115 INFO:teuthology.orchestra.run.smithi100.stdout:bal_rank_mask -1 2023-12-05T10:02:37.115 INFO:teuthology.orchestra.run.smithi100.stdout:standby_count_wanted 1 2023-12-05T10:02:37.115 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi100.akmstb{0:14490} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.100:6828/627555128,v1:172.21.15.100:6829/627555128] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T10:02:37.115 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T10:02:37.115 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T10:02:37.115 INFO:teuthology.orchestra.run.smithi100.stdout:Standby daemons: 2023-12-05T10:02:37.115 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T10:02:37.115 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi150.pcbpxm{-1:14486} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.150:6824/3645854543,v1:172.21.15.150:6825/3645854543] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T10:02:37.116 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi150.fcnhsv{-1:14498} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.150:6826/3249949736,v1:172.21.15.150:6827/3249949736] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T10:02:37.116 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi100.sqplhn{-1:14506} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.100:6826/2472212864,v1:172.21.15.100:6827/2472212864] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T10:02:37.116 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.118+0000 7fd077d0a700 1 -- 172.21.15.100:0/2958089135 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fd05c06ce70 msgr2=0x7fd05c06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:02:37.116 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.118+0000 7fd077d0a700 1 --2- 172.21.15.100:0/2958089135 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fd05c06ce70 0x7fd05c06f320 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd060009b80 tx=0x7fd06000b040 comp rx=0 tx=0).stop 2023-12-05T10:02:37.116 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.118+0000 7fd077d0a700 1 -- 172.21.15.100:0/2958089135 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd070070570 msgr2=0x7fd07010f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:02:37.117 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.118+0000 7fd077d0a700 1 --2- 172.21.15.100:0/2958089135 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd070070570 0x7fd07010f8e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd06c004890 tx=0x7fd06c009e30 comp rx=0 tx=0).stop 2023-12-05T10:02:37.117 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.118+0000 7fd077d0a700 1 -- 172.21.15.100:0/2958089135 shutdown_connections 2023-12-05T10:02:37.117 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.118+0000 7fd077d0a700 1 --2- 172.21.15.100:0/2958089135 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fd05c06ce70 0x7fd05c06f320 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:37.117 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.118+0000 7fd077d0a700 1 --2- 172.21.15.100:0/2958089135 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd070070570 0x7fd07010f8e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:37.117 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.118+0000 7fd077d0a700 1 --2- 172.21.15.100:0/2958089135 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd070071bc0 0x7fd07010fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:37.117 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.118+0000 7fd077d0a700 1 -- 172.21.15.100:0/2958089135 >> 172.21.15.100:0/2958089135 conn(0x7fd0700f82d0 msgr2=0x7fd070103310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:02:37.117 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.118+0000 7fd077d0a700 1 -- 172.21.15.100:0/2958089135 shutdown_connections 2023-12-05T10:02:37.117 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.118+0000 7fd077d0a700 1 -- 172.21.15.100:0/2958089135 wait complete. 2023-12-05T10:02:37.117 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 13 2023-12-05T10:02:37.251 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.253+0000 7fa9df114700 1 -- 172.21.15.100:0/525585023 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9d80fcbf0 msgr2=0x7fa9d80fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:02:37.251 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.253+0000 7fa9df114700 1 --2- 172.21.15.100:0/525585023 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9d80fcbf0 0x7fa9d80fd000 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc004940 tx=0x7fa9cc009e30 comp rx=0 tx=0).stop 2023-12-05T10:02:37.251 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.253+0000 7fa9df114700 1 -- 172.21.15.100:0/525585023 shutdown_connections 2023-12-05T10:02:37.251 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.253+0000 7fa9df114700 1 --2- 172.21.15.100:0/525585023 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9d80fde00 0x7fa9d80fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:37.251 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.253+0000 7fa9df114700 1 --2- 172.21.15.100:0/525585023 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9d80fcbf0 0x7fa9d80fd000 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:37.251 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.253+0000 7fa9df114700 1 -- 172.21.15.100:0/525585023 >> 172.21.15.100:0/525585023 conn(0x7fa9d80f82d0 msgr2=0x7fa9d80fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:02:37.252 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.253+0000 7fa9df114700 1 -- 172.21.15.100:0/525585023 shutdown_connections 2023-12-05T10:02:37.252 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.253+0000 7fa9df114700 1 -- 172.21.15.100:0/525585023 wait complete. 2023-12-05T10:02:37.253 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.254+0000 7fa9df114700 1 Processor -- start 2023-12-05T10:02:37.253 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.254+0000 7fa9df114700 1 -- start start 2023-12-05T10:02:37.253 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.254+0000 7fa9df114700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9d80fcbf0 0x7fa9d810f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:02:37.253 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.255+0000 7fa9df114700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9d80fde00 0x7fa9d810fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:02:37.253 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.255+0000 7fa9df114700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d8110280 con 0x7fa9d80fcbf0 2023-12-05T10:02:37.253 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.255+0000 7fa9df114700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d8110b20 con 0x7fa9d80fde00 2023-12-05T10:02:37.253 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.255+0000 7fa9dceb0700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9d80fcbf0 0x7fa9d810f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:02:37.253 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.255+0000 7fa9dceb0700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9d80fcbf0 0x7fa9d810f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52776/0 (socket says 172.21.15.100:52776) 2023-12-05T10:02:37.253 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.255+0000 7fa9dceb0700 1 -- 172.21.15.100:0/3960713729 learned_addr learned my addr 172.21.15.100:0/3960713729 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T10:02:37.253 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.255+0000 7fa9d7fff700 1 --2- 172.21.15.100:0/3960713729 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9d80fde00 0x7fa9d810fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:02:37.253 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.255+0000 7fa9dceb0700 1 -- 172.21.15.100:0/3960713729 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9d80fde00 msgr2=0x7fa9d810fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:02:37.253 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.255+0000 7fa9dceb0700 1 --2- 172.21.15.100:0/3960713729 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9d80fde00 0x7fa9d810fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:37.253 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.255+0000 7fa9dceb0700 1 -- 172.21.15.100:0/3960713729 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9cc005040 con 0x7fa9d80fcbf0 2023-12-05T10:02:37.254 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.255+0000 7fa9d7fff700 1 --2- 172.21.15.100:0/3960713729 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9d80fde00 0x7fa9d810fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-05T10:02:37.254 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.255+0000 7fa9dceb0700 1 --2- 172.21.15.100:0/3960713729 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9d80fcbf0 0x7fa9d810f740 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc000c00 tx=0x7fa9cc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:02:37.254 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.256+0000 7fa9d57fa700 1 -- 172.21.15.100:0/3960713729 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9cc00e040 con 0x7fa9d80fcbf0 2023-12-05T10:02:37.254 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.256+0000 7fa9d57fa700 1 -- 172.21.15.100:0/3960713729 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa9cc009af0 con 0x7fa9d80fcbf0 2023-12-05T10:02:37.254 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.256+0000 7fa9d57fa700 1 -- 172.21.15.100:0/3960713729 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9cc01c630 con 0x7fa9d80fcbf0 2023-12-05T10:02:37.254 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.256+0000 7fa9df114700 1 -- 172.21.15.100:0/3960713729 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9d8110da0 con 0x7fa9d80fcbf0 2023-12-05T10:02:37.254 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.256+0000 7fa9df114700 1 -- 172.21.15.100:0/3960713729 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9d81112e0 con 0x7fa9d80fcbf0 2023-12-05T10:02:37.255 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.257+0000 7fa9df114700 1 -- 172.21.15.100:0/3960713729 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9d8101ea0 con 0x7fa9d80fcbf0 2023-12-05T10:02:37.255 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.258+0000 7fa9d57fa700 1 -- 172.21.15.100:0/3960713729 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fa9cc00bcd0 con 0x7fa9d80fcbf0 2023-12-05T10:02:37.256 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.259+0000 7fa9d57fa700 1 --2- 172.21.15.100:0/3960713729 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fa9c806ce60 0x7fa9c806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:02:37.256 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.259+0000 7fa9d57fa700 1 -- 172.21.15.100:0/3960713729 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6703+0+0 (secure 0 0 0) 0x7fa9cc08d7f0 con 0x7fa9d80fcbf0 2023-12-05T10:02:37.257 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.259+0000 7fa9d7fff700 1 --2- 172.21.15.100:0/3960713729 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fa9c806ce60 0x7fa9c806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:02:37.257 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.260+0000 7fa9d7fff700 1 --2- 172.21.15.100:0/3960713729 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fa9c806ce60 0x7fa9c806f310 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa9c4007fd0 tx=0x7fa9c4009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:02:37.261 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.264+0000 7fa9d57fa700 1 -- 172.21.15.100:0/3960713729 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fa9cc05b150 con 0x7fa9d80fcbf0 2023-12-05T10:02:37.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:37 smithi100 ceph-mon[187528]: from='client.34312 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T10:02:37.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:37 smithi100 ceph-mon[187528]: from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T10:02:37.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:37 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:02:37.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:37 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-05T10:02:37.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:37 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T10:02:37.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:37 smithi100 ceph-mon[187528]: from='client.? 172.21.15.100:0/2208121249' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T10:02:37.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:37 smithi100 ceph-mon[187528]: from='client.? 172.21.15.100:0/2958089135' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-05T10:02:37.396 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:37 smithi150 ceph-mon[171606]: from='client.34312 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T10:02:37.396 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:37 smithi150 ceph-mon[171606]: from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T10:02:37.396 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:37 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:02:37.396 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:37 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-05T10:02:37.396 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:37 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T10:02:37.396 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:37 smithi150 ceph-mon[171606]: from='client.? 172.21.15.100:0/2208121249' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T10:02:37.396 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:37 smithi150 ceph-mon[171606]: from='client.? 172.21.15.100:0/2958089135' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-05T10:02:37.481 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.483+0000 7fa9df114700 1 -- 172.21.15.100:0/3960713729 --> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa9d8111550 con 0x7fa9c806ce60 2023-12-05T10:02:37.482 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.484+0000 7fa9d57fa700 1 -- 172.21.15.100:0/3960713729 <== mgr.34104 v2:172.21.15.100:6800/3489431924 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fa9d8111550 con 0x7fa9c806ce60 2023-12-05T10:02:37.482 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2023-12-05T10:02:37.482 INFO:teuthology.orchestra.run.smithi100.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ff918c95653912ae4c171d8d1db5f5eabc756f85ff7e3ce78f13f9c521198459", 2023-12-05T10:02:37.482 INFO:teuthology.orchestra.run.smithi100.stdout: "in_progress": true, 2023-12-05T10:02:37.482 INFO:teuthology.orchestra.run.smithi100.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-05T10:02:37.482 INFO:teuthology.orchestra.run.smithi100.stdout: "services_complete": [ 2023-12-05T10:02:37.482 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr", 2023-12-05T10:02:37.483 INFO:teuthology.orchestra.run.smithi100.stdout: "crash", 2023-12-05T10:02:37.483 INFO:teuthology.orchestra.run.smithi100.stdout: "mon" 2023-12-05T10:02:37.483 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2023-12-05T10:02:37.483 INFO:teuthology.orchestra.run.smithi100.stdout: "progress": "10/21 daemons upgraded", 2023-12-05T10:02:37.483 INFO:teuthology.orchestra.run.smithi100.stdout: "message": "Currently upgrading osd daemons", 2023-12-05T10:02:37.483 INFO:teuthology.orchestra.run.smithi100.stdout: "is_paused": false 2023-12-05T10:02:37.483 INFO:teuthology.orchestra.run.smithi100.stdout:} 2023-12-05T10:02:37.484 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.487+0000 7fa9df114700 1 -- 172.21.15.100:0/3960713729 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fa9c806ce60 msgr2=0x7fa9c806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:02:37.484 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.487+0000 7fa9df114700 1 --2- 172.21.15.100:0/3960713729 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fa9c806ce60 0x7fa9c806f310 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa9c4007fd0 tx=0x7fa9c4009040 comp rx=0 tx=0).stop 2023-12-05T10:02:37.485 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.487+0000 7fa9df114700 1 -- 172.21.15.100:0/3960713729 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9d80fcbf0 msgr2=0x7fa9d810f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:02:37.485 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.487+0000 7fa9df114700 1 --2- 172.21.15.100:0/3960713729 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9d80fcbf0 0x7fa9d810f740 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc000c00 tx=0x7fa9cc009e30 comp rx=0 tx=0).stop 2023-12-05T10:02:37.485 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.487+0000 7fa9df114700 1 -- 172.21.15.100:0/3960713729 shutdown_connections 2023-12-05T10:02:37.485 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.487+0000 7fa9df114700 1 --2- 172.21.15.100:0/3960713729 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fa9c806ce60 0x7fa9c806f310 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:37.485 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.487+0000 7fa9df114700 1 --2- 172.21.15.100:0/3960713729 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9d80fcbf0 0x7fa9d810f740 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:37.485 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.487+0000 7fa9df114700 1 --2- 172.21.15.100:0/3960713729 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9d80fde00 0x7fa9d810fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:37.485 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.487+0000 7fa9df114700 1 -- 172.21.15.100:0/3960713729 >> 172.21.15.100:0/3960713729 conn(0x7fa9d80f82d0 msgr2=0x7fa9d80ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:02:37.485 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.487+0000 7fa9df114700 1 -- 172.21.15.100:0/3960713729 shutdown_connections 2023-12-05T10:02:37.485 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.487+0000 7fa9df114700 1 -- 172.21.15.100:0/3960713729 wait complete. 2023-12-05T10:02:37.619 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.621+0000 7f77a6671700 1 -- 172.21.15.100:0/3174529027 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77a00fde00 msgr2=0x7f77a00fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:02:37.619 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.621+0000 7f77a6671700 1 --2- 172.21.15.100:0/3174529027 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77a00fde00 0x7f77a00fe250 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7794004940 tx=0x7f7794009e30 comp rx=0 tx=0).stop 2023-12-05T10:02:37.619 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.621+0000 7f77a6671700 1 -- 172.21.15.100:0/3174529027 shutdown_connections 2023-12-05T10:02:37.619 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.621+0000 7f77a6671700 1 --2- 172.21.15.100:0/3174529027 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77a00fde00 0x7f77a00fe250 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:37.619 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.621+0000 7f77a6671700 1 --2- 172.21.15.100:0/3174529027 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77a00fcbf0 0x7f77a00fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:37.619 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.621+0000 7f77a6671700 1 -- 172.21.15.100:0/3174529027 >> 172.21.15.100:0/3174529027 conn(0x7f77a00f82d0 msgr2=0x7f77a00fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:02:37.619 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.621+0000 7f77a6671700 1 -- 172.21.15.100:0/3174529027 shutdown_connections 2023-12-05T10:02:37.619 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.621+0000 7f77a6671700 1 -- 172.21.15.100:0/3174529027 wait complete. 2023-12-05T10:02:37.621 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.622+0000 7f77a6671700 1 Processor -- start 2023-12-05T10:02:37.621 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.622+0000 7f77a6671700 1 -- start start 2023-12-05T10:02:37.621 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.622+0000 7f77a6671700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77a00fcbf0 0x7f77a010f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:02:37.621 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.622+0000 7f77a6671700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77a00fde00 0x7f77a010fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:02:37.621 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.623+0000 7f77a6671700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a0110230 con 0x7f77a00fde00 2023-12-05T10:02:37.621 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.623+0000 7f77a6671700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a0110ad0 con 0x7f77a00fcbf0 2023-12-05T10:02:37.621 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.623+0000 7f779f7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77a00fde00 0x7f77a010fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:02:37.621 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.623+0000 7f779f7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77a00fde00 0x7f77a010fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52790/0 (socket says 172.21.15.100:52790) 2023-12-05T10:02:37.621 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.623+0000 7f779f7fe700 1 -- 172.21.15.100:0/470251158 learned_addr learned my addr 172.21.15.100:0/470251158 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T10:02:37.621 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.623+0000 7f779ffff700 1 --2- 172.21.15.100:0/470251158 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77a00fcbf0 0x7f77a010f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:02:37.621 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.623+0000 7f779f7fe700 1 -- 172.21.15.100:0/470251158 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77a00fcbf0 msgr2=0x7f77a010f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:02:37.621 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.623+0000 7f779f7fe700 1 --2- 172.21.15.100:0/470251158 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77a00fcbf0 0x7f77a010f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:37.621 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.623+0000 7f779f7fe700 1 -- 172.21.15.100:0/470251158 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7794005040 con 0x7f77a00fde00 2023-12-05T10:02:37.621 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.623+0000 7f779f7fe700 1 --2- 172.21.15.100:0/470251158 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77a00fde00 0x7f77a010fc30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7794008f90 tx=0x7f7794009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:02:37.622 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.624+0000 7f779cff9700 1 -- 172.21.15.100:0/470251158 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7794021070 con 0x7f77a00fde00 2023-12-05T10:02:37.622 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.624+0000 7f779cff9700 1 -- 172.21.15.100:0/470251158 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f779401c400 con 0x7f77a00fde00 2023-12-05T10:02:37.622 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.624+0000 7f77a6671700 1 -- 172.21.15.100:0/470251158 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77a0110d50 con 0x7f77a00fde00 2023-12-05T10:02:37.622 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.624+0000 7f779cff9700 1 -- 172.21.15.100:0/470251158 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f779400e030 con 0x7f77a00fde00 2023-12-05T10:02:37.623 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.624+0000 7f77a6671700 1 -- 172.21.15.100:0/470251158 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77a0111290 con 0x7f77a00fde00 2023-12-05T10:02:37.623 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.625+0000 7f77a6671700 1 -- 172.21.15.100:0/470251158 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77a0101ea0 con 0x7f77a00fde00 2023-12-05T10:02:37.623 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.626+0000 7f779cff9700 1 -- 172.21.15.100:0/470251158 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f779401ca00 con 0x7f77a00fde00 2023-12-05T10:02:37.624 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.627+0000 7f779cff9700 1 --2- 172.21.15.100:0/470251158 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f778806ce70 0x7f778806f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:02:37.625 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.627+0000 7f779cff9700 1 -- 172.21.15.100:0/470251158 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6703+0+0 (secure 0 0 0) 0x7f779408d5b0 con 0x7f77a00fde00 2023-12-05T10:02:37.625 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.627+0000 7f779ffff700 1 --2- 172.21.15.100:0/470251158 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f778806ce70 0x7f778806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:02:37.625 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.628+0000 7f779ffff700 1 --2- 172.21.15.100:0/470251158 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f778806ce70 0x7f778806f320 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7790009b80 tx=0x7f779000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:02:37.628 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.631+0000 7f779cff9700 1 -- 172.21.15.100:0/470251158 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f779405ae60 con 0x7f77a00fde00 2023-12-05T10:02:37.913 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.916+0000 7f77a6671700 1 -- 172.21.15.100:0/470251158 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f77a01018c0 con 0x7f77a00fde00 2023-12-05T10:02:37.913 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.916+0000 7f779cff9700 1 -- 172.21.15.100:0/470251158 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f779405a9f0 con 0x7f77a00fde00 2023-12-05T10:02:37.913 INFO:teuthology.orchestra.run.smithi100.stdout:HEALTH_OK 2023-12-05T10:02:37.915 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.919+0000 7f77a6671700 1 -- 172.21.15.100:0/470251158 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f778806ce70 msgr2=0x7f778806f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:02:37.916 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.919+0000 7f77a6671700 1 --2- 172.21.15.100:0/470251158 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f778806ce70 0x7f778806f320 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7790009b80 tx=0x7f779000b040 comp rx=0 tx=0).stop 2023-12-05T10:02:37.916 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.919+0000 7f77a6671700 1 -- 172.21.15.100:0/470251158 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77a00fde00 msgr2=0x7f77a010fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:02:37.916 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.919+0000 7f77a6671700 1 --2- 172.21.15.100:0/470251158 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77a00fde00 0x7f77a010fc30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7794008f90 tx=0x7f7794009e30 comp rx=0 tx=0).stop 2023-12-05T10:02:37.916 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.919+0000 7f77a6671700 1 -- 172.21.15.100:0/470251158 shutdown_connections 2023-12-05T10:02:37.916 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.919+0000 7f77a6671700 1 --2- 172.21.15.100:0/470251158 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f778806ce70 0x7f778806f320 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:37.916 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.919+0000 7f77a6671700 1 --2- 172.21.15.100:0/470251158 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77a00fcbf0 0x7f77a010f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:37.916 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.919+0000 7f77a6671700 1 --2- 172.21.15.100:0/470251158 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77a00fde00 0x7f77a010fc30 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:02:37.916 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.919+0000 7f77a6671700 1 -- 172.21.15.100:0/470251158 >> 172.21.15.100:0/470251158 conn(0x7f77a00f82d0 msgr2=0x7f77a00ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:02:37.916 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.919+0000 7f77a6671700 1 -- 172.21.15.100:0/470251158 shutdown_connections 2023-12-05T10:02:37.916 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:02:37.919+0000 7f77a6671700 1 -- 172.21.15.100:0/470251158 wait complete. 2023-12-05T10:02:38.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:38 smithi100 ceph-mon[187528]: Upgrade: Updating osd.4 2023-12-05T10:02:38.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:38 smithi100 ceph-mon[187528]: pgmap v137: 65 pgs: 65 active+clean; 195 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-05T10:02:38.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:38 smithi100 ceph-mon[187528]: Deploying daemon osd.4 on smithi150 2023-12-05T10:02:38.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:38 smithi100 ceph-mon[187528]: from='client.34328 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T10:02:38.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:38 smithi100 ceph-mon[187528]: from='client.? 172.21.15.100:0/470251158' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-05T10:02:38.544 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:38 smithi150 ceph-mon[171606]: Upgrade: Updating osd.4 2023-12-05T10:02:38.544 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:38 smithi150 ceph-mon[171606]: pgmap v137: 65 pgs: 65 active+clean; 195 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-05T10:02:38.544 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:38 smithi150 ceph-mon[171606]: Deploying daemon osd.4 on smithi150 2023-12-05T10:02:38.544 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:38 smithi150 ceph-mon[171606]: from='client.34328 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T10:02:38.544 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:38 smithi150 ceph-mon[171606]: from='client.? 172.21.15.100:0/470251158' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-05T10:02:39.596 INFO:journalctl@ceph.osd.4.smithi150.stdout:Dec 05 10:02:39 smithi150 systemd[1]: Stopping Ceph osd.4 for 5b035ce6-9353-11ee-95a2-87774f69a715... 2023-12-05T10:02:40.096 INFO:journalctl@ceph.osd.4.smithi150.stdout:Dec 05 10:02:39 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-4[130375]: 2023-12-05T10:02:39.743+0000 7f88aac16700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-05T10:02:40.096 INFO:journalctl@ceph.osd.4.smithi150.stdout:Dec 05 10:02:39 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-4[130375]: 2023-12-05T10:02:39.743+0000 7f88aac16700 -1 osd.4 82 *** Got signal Terminated *** 2023-12-05T10:02:40.096 INFO:journalctl@ceph.osd.4.smithi150.stdout:Dec 05 10:02:39 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-4[130375]: 2023-12-05T10:02:39.743+0000 7f88aac16700 -1 osd.4 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-05T10:02:40.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:40 smithi100 ceph-mon[187528]: pgmap v138: 65 pgs: 65 active+clean; 195 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-05T10:02:40.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:40 smithi100 ceph-mon[187528]: osd.4 marked itself down and dead 2023-12-05T10:02:40.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:40 smithi150 ceph-mon[171606]: pgmap v138: 65 pgs: 65 active+clean; 195 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-05T10:02:40.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:40 smithi150 ceph-mon[171606]: osd.4 marked itself down and dead 2023-12-05T10:02:41.095 INFO:journalctl@ceph.osd.4.smithi150.stdout:Dec 05 10:02:40 smithi150 bash[189093]: ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-4 2023-12-05T10:02:41.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:41 smithi100 ceph-mon[187528]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-05T10:02:41.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:41 smithi100 ceph-mon[187528]: osdmap e83: 6 total, 5 up, 6 in 2023-12-05T10:02:41.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:41 smithi100 ceph-mon[187528]: failed to encode map e83 with expected crc 2023-12-05T10:02:41.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:41 smithi100 ceph-mon[187528]: failed to encode map e83 with expected crc 2023-12-05T10:02:41.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:41 smithi100 ceph-mon[187528]: failed to encode map e83 with expected crc 2023-12-05T10:02:41.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:41 smithi100 ceph-mon[187528]: failed to encode map e83 with expected crc 2023-12-05T10:02:41.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:41 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:02:41.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:41 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T10:02:41.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:41 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:02:41.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:41 smithi100 ceph-mon[187528]: osdmap e84: 6 total, 5 up, 6 in 2023-12-05T10:02:41.537 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:41 smithi150 ceph-mon[171606]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-05T10:02:41.537 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:41 smithi150 ceph-mon[171606]: osdmap e83: 6 total, 5 up, 6 in 2023-12-05T10:02:41.537 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:41 smithi150 ceph-mon[171606]: failed to encode map e83 with expected crc 2023-12-05T10:02:41.537 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:41 smithi150 ceph-mon[171606]: failed to encode map e83 with expected crc 2023-12-05T10:02:41.537 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:41 smithi150 ceph-mon[171606]: failed to encode map e83 with expected crc 2023-12-05T10:02:41.537 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:41 smithi150 ceph-mon[171606]: failed to encode map e83 with expected crc 2023-12-05T10:02:41.537 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:41 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:02:41.537 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:41 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T10:02:41.537 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:41 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:02:41.537 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:41 smithi150 ceph-mon[171606]: osdmap e84: 6 total, 5 up, 6 in 2023-12-05T10:02:42.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:42 smithi150 ceph-mon[171606]: pgmap v140: 65 pgs: 7 peering, 4 stale+active+clean, 54 active+clean; 195 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-05T10:02:42.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:42 smithi150 ceph-mon[171606]: failed to encode map e84 with expected crc 2023-12-05T10:02:42.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:42 smithi150 ceph-mon[171606]: failed to encode map e84 with expected crc 2023-12-05T10:02:42.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:42 smithi150 ceph-mon[171606]: failed to encode map e84 with expected crc 2023-12-05T10:02:42.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:42 smithi150 ceph-mon[171606]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2023-12-05T10:02:42.347 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:42 smithi150 ceph-mon[171606]: failed to encode map e84 with expected crc 2023-12-05T10:02:42.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:42 smithi100 ceph-mon[187528]: pgmap v140: 65 pgs: 7 peering, 4 stale+active+clean, 54 active+clean; 195 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-05T10:02:42.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:42 smithi100 ceph-mon[187528]: failed to encode map e84 with expected crc 2023-12-05T10:02:42.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:42 smithi100 ceph-mon[187528]: failed to encode map e84 with expected crc 2023-12-05T10:02:42.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:42 smithi100 ceph-mon[187528]: failed to encode map e84 with expected crc 2023-12-05T10:02:42.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:42 smithi100 ceph-mon[187528]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2023-12-05T10:02:42.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:42 smithi100 ceph-mon[187528]: failed to encode map e84 with expected crc 2023-12-05T10:02:42.647 INFO:journalctl@ceph.osd.4.smithi150.stdout:Dec 05 10:02:42 smithi150 systemd[1]: ceph-5b035ce6-9353-11ee-95a2-87774f69a715@osd.4.service: Succeeded. 2023-12-05T10:02:42.647 INFO:journalctl@ceph.osd.4.smithi150.stdout:Dec 05 10:02:42 smithi150 systemd[1]: Stopped Ceph osd.4 for 5b035ce6-9353-11ee-95a2-87774f69a715. 2023-12-05T10:02:43.034 INFO:journalctl@ceph.osd.4.smithi150.stdout:Dec 05 10:02:42 smithi150 systemd[1]: Starting Ceph osd.4 for 5b035ce6-9353-11ee-95a2-87774f69a715... 2023-12-05T10:02:43.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:43 smithi150 ceph-mon[171606]: Health check failed: Degraded data redundancy: 4/216 objects degraded (1.852%), 2 pgs degraded (PG_DEGRADED) 2023-12-05T10:02:43.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:43 smithi100 ceph-mon[187528]: Health check failed: Degraded data redundancy: 4/216 objects degraded (1.852%), 2 pgs degraded (PG_DEGRADED) 2023-12-05T10:02:44.211 INFO:journalctl@ceph.osd.4.smithi150.stdout:Dec 05 10:02:43 smithi150 bash[189363]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-12-05T10:02:44.211 INFO:journalctl@ceph.osd.4.smithi150.stdout:Dec 05 10:02:43 smithi150 bash[189363]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2023-12-05T10:02:44.211 INFO:journalctl@ceph.osd.4.smithi150.stdout:Dec 05 10:02:43 smithi150 bash[189363]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2023-12-05T10:02:44.211 INFO:journalctl@ceph.osd.4.smithi150.stdout:Dec 05 10:02:43 smithi150 bash[189363]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2023-12-05T10:02:44.211 INFO:journalctl@ceph.osd.4.smithi150.stdout:Dec 05 10:02:43 smithi150 bash[189363]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2023-12-05T10:02:44.211 INFO:journalctl@ceph.osd.4.smithi150.stdout:Dec 05 10:02:43 smithi150 bash[189363]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-12-05T10:02:44.211 INFO:journalctl@ceph.osd.4.smithi150.stdout:Dec 05 10:02:43 smithi150 bash[189363]: --> ceph-volume raw activate successful for osd ID: 4 2023-12-05T10:02:44.592 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:44 smithi150 ceph-mon[171606]: pgmap v142: 65 pgs: 2 active+undersized+degraded, 7 peering, 3 stale+active+clean, 2 active+undersized, 51 active+clean; 195 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 4/216 objects degraded (1.852%) 2023-12-05T10:02:44.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:44 smithi100 ceph-mon[187528]: pgmap v142: 65 pgs: 2 active+undersized+degraded, 7 peering, 3 stale+active+clean, 2 active+undersized, 51 active+clean; 195 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 4/216 objects degraded (1.852%) 2023-12-05T10:02:45.095 INFO:journalctl@ceph.osd.4.smithi150.stdout:Dec 05 10:02:44 smithi150 bash[189614]: bcabd80780a8da2bb3d92f823f2042dcd05a03ed6f1893c748f345b5db66b051 2023-12-05T10:02:45.096 INFO:journalctl@ceph.osd.4.smithi150.stdout:Dec 05 10:02:44 smithi150 systemd[1]: Started Ceph osd.4 for 5b035ce6-9353-11ee-95a2-87774f69a715. 2023-12-05T10:02:45.096 INFO:journalctl@ceph.osd.4.smithi150.stdout:Dec 05 10:02:44 smithi150 ceph-osd[189652]: -- 172.21.15.150:0/4037218659 <== mon.1 v2:172.21.15.150:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55e1c20f91e0 con 0x55e1c20c9000 2023-12-05T10:02:45.595 INFO:journalctl@ceph.osd.4.smithi150.stdout:Dec 05 10:02:45 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-4[189629]: 2023-12-05T10:02:45.231+0000 7f54fd5e1640 -1 Falling back to public interface 2023-12-05T10:02:46.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:45 smithi150 ceph-mon[171606]: pgmap v143: 65 pgs: 2 active+undersized+degraded, 7 peering, 2 stale+active+clean, 4 active+undersized, 50 active+clean; 195 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 4/216 objects degraded (1.852%) 2023-12-05T10:02:46.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:45 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:02:46.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:45 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:02:46.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:45 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T10:02:46.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:45 smithi100 ceph-mon[187528]: pgmap v143: 65 pgs: 2 active+undersized+degraded, 7 peering, 2 stale+active+clean, 4 active+undersized, 50 active+clean; 195 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 4/216 objects degraded (1.852%) 2023-12-05T10:02:46.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:45 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:02:46.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:45 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:02:46.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:45 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T10:02:47.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:46 smithi150 ceph-mon[171606]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2023-12-05T10:02:47.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:46 smithi100 ceph-mon[187528]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2023-12-05T10:02:48.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:48 smithi150 ceph-mon[171606]: pgmap v144: 65 pgs: 14 active+undersized+degraded, 18 active+undersized, 33 active+clean; 195 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 34/216 objects degraded (15.741%) 2023-12-05T10:02:48.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:48 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:02:48.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:48 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:02:48.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:48 smithi100 ceph-mon[187528]: pgmap v144: 65 pgs: 14 active+undersized+degraded, 18 active+undersized, 33 active+clean; 195 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 34/216 objects degraded (15.741%) 2023-12-05T10:02:48.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:48 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:02:48.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:48 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:02:50.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:49 smithi150 ceph-mon[171606]: pgmap v145: 65 pgs: 14 active+undersized+degraded, 18 active+undersized, 33 active+clean; 195 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 34/216 objects degraded (15.741%) 2023-12-05T10:02:50.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:49 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:02:50.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:49 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:02:50.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:49 smithi100 ceph-mon[187528]: pgmap v145: 65 pgs: 14 active+undersized+degraded, 18 active+undersized, 33 active+clean; 195 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 34/216 objects degraded (15.741%) 2023-12-05T10:02:50.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:49 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:02:50.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:49 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:02:50.846 INFO:journalctl@ceph.osd.4.smithi150.stdout:Dec 05 10:02:50 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-4[189629]: 2023-12-05T10:02:50.494+0000 7f54fd5e1640 -1 osd.4 0 read_superblock omap replica is missing. 2023-12-05T10:02:51.596 INFO:journalctl@ceph.osd.4.smithi150.stdout:Dec 05 10:02:51 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-4[189629]: 2023-12-05T10:02:51.137+0000 7f54fd5e1640 -1 osd.4 82 log_to_monitors true 2023-12-05T10:02:52.066 INFO:journalctl@ceph.osd.4.smithi150.stdout:Dec 05 10:02:51 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-4[189629]: 2023-12-05T10:02:51.968+0000 7f54ee251700 -1 osd.4 82 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-05T10:02:52.066 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:51 smithi150 ceph-mon[171606]: pgmap v146: 65 pgs: 14 active+undersized+degraded, 18 active+undersized, 33 active+clean; 195 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 34/216 objects degraded (15.741%) 2023-12-05T10:02:52.066 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:51 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:02:52.066 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:51 smithi150 ceph-mon[171606]: from='osd.4 [v2:172.21.15.150:6808/1252141235,v1:172.21.15.150:6809/1252141235]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-05T10:02:52.067 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:51 smithi150 ceph-mon[171606]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-05T10:02:52.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:51 smithi100 ceph-mon[187528]: pgmap v146: 65 pgs: 14 active+undersized+degraded, 18 active+undersized, 33 active+clean; 195 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 34/216 objects degraded (15.741%) 2023-12-05T10:02:52.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:51 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:02:52.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:51 smithi100 ceph-mon[187528]: from='osd.4 [v2:172.21.15.150:6808/1252141235,v1:172.21.15.150:6809/1252141235]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-05T10:02:52.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:51 smithi100 ceph-mon[187528]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-05T10:02:53.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:52 smithi150 ceph-mon[171606]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-12-05T10:02:53.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:52 smithi150 ceph-mon[171606]: osdmap e85: 6 total, 5 up, 6 in 2023-12-05T10:02:53.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:52 smithi150 ceph-mon[171606]: from='osd.4 [v2:172.21.15.150:6808/1252141235,v1:172.21.15.150:6809/1252141235]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2023-12-05T10:02:53.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:52 smithi150 ceph-mon[171606]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2023-12-05T10:02:53.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:52 smithi150 ceph-mon[171606]: Health check update: Degraded data redundancy: 34/216 objects degraded (15.741%), 14 pgs degraded (PG_DEGRADED) 2023-12-05T10:02:53.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:52 smithi150 ceph-mon[171606]: failed to encode map e85 with expected crc 2023-12-05T10:02:53.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:52 smithi150 ceph-mon[171606]: failed to encode map e85 with expected crc 2023-12-05T10:02:53.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:52 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:02:53.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:52 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:02:53.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:52 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T10:02:53.347 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:52 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T10:02:53.347 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:52 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:02:53.347 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:52 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T10:02:53.347 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:52 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T10:02:53.347 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:52 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T10:02:53.347 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:52 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T10:02:53.347 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:52 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-05T10:02:53.347 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:52 smithi150 ceph-mon[171606]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-05T10:02:53.347 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:52 smithi150 ceph-mon[171606]: Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2023-12-05T10:02:53.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:52 smithi100 ceph-mon[187528]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-12-05T10:02:53.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:52 smithi100 ceph-mon[187528]: osdmap e85: 6 total, 5 up, 6 in 2023-12-05T10:02:53.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:52 smithi100 ceph-mon[187528]: from='osd.4 [v2:172.21.15.150:6808/1252141235,v1:172.21.15.150:6809/1252141235]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2023-12-05T10:02:53.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:52 smithi100 ceph-mon[187528]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2023-12-05T10:02:53.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:52 smithi100 ceph-mon[187528]: Health check update: Degraded data redundancy: 34/216 objects degraded (15.741%), 14 pgs degraded (PG_DEGRADED) 2023-12-05T10:02:53.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:52 smithi100 ceph-mon[187528]: failed to encode map e85 with expected crc 2023-12-05T10:02:53.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:52 smithi100 ceph-mon[187528]: failed to encode map e85 with expected crc 2023-12-05T10:02:53.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:52 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:02:53.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:52 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:02:53.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:52 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T10:02:53.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:52 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T10:02:53.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:52 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:02:53.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:52 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T10:02:53.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:52 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T10:02:53.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:52 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T10:02:53.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:52 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T10:02:53.397 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:52 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-05T10:02:53.397 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:52 smithi100 ceph-mon[187528]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-05T10:02:53.397 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:52 smithi100 ceph-mon[187528]: Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2023-12-05T10:02:54.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:53 smithi150 ceph-mon[171606]: pgmap v148: 65 pgs: 14 active+undersized+degraded, 18 active+undersized, 33 active+clean; 195 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 34/216 objects degraded (15.741%) 2023-12-05T10:02:54.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:53 smithi150 ceph-mon[171606]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-05T10:02:54.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:53 smithi150 ceph-mon[171606]: failed to encode map e86 with expected crc 2023-12-05T10:02:54.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:53 smithi150 ceph-mon[171606]: osd.4 [v2:172.21.15.150:6808/1252141235,v1:172.21.15.150:6809/1252141235] boot 2023-12-05T10:02:54.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:53 smithi150 ceph-mon[171606]: osdmap e86: 6 total, 6 up, 6 in 2023-12-05T10:02:54.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:53 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-05T10:02:54.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:53 smithi100 ceph-mon[187528]: pgmap v148: 65 pgs: 14 active+undersized+degraded, 18 active+undersized, 33 active+clean; 195 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 34/216 objects degraded (15.741%) 2023-12-05T10:02:54.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:53 smithi100 ceph-mon[187528]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-05T10:02:54.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:53 smithi100 ceph-mon[187528]: failed to encode map e86 with expected crc 2023-12-05T10:02:54.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:53 smithi100 ceph-mon[187528]: osd.4 [v2:172.21.15.150:6808/1252141235,v1:172.21.15.150:6809/1252141235] boot 2023-12-05T10:02:54.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:53 smithi100 ceph-mon[187528]: osdmap e86: 6 total, 6 up, 6 in 2023-12-05T10:02:54.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:53 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-05T10:02:55.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:54 smithi150 ceph-mon[171606]: failed to encode map e87 with expected crc 2023-12-05T10:02:55.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:54 smithi150 ceph-mon[171606]: osdmap e87: 6 total, 6 up, 6 in 2023-12-05T10:02:55.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:54 smithi150 ceph-mon[171606]: failed to encode map e87 with expected crc 2023-12-05T10:02:55.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:54 smithi100 ceph-mon[187528]: failed to encode map e87 with expected crc 2023-12-05T10:02:55.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:54 smithi100 ceph-mon[187528]: osdmap e87: 6 total, 6 up, 6 in 2023-12-05T10:02:55.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:54 smithi100 ceph-mon[187528]: failed to encode map e87 with expected crc 2023-12-05T10:02:56.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:55 smithi150 ceph-mon[171606]: pgmap v151: 65 pgs: 14 active+undersized+degraded, 17 active+undersized, 34 active+clean; 195 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 34/216 objects degraded (15.741%) 2023-12-05T10:02:56.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:55 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:02:56.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:55 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T10:02:56.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:55 smithi100 ceph-mon[187528]: pgmap v151: 65 pgs: 14 active+undersized+degraded, 17 active+undersized, 34 active+clean; 195 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 34/216 objects degraded (15.741%) 2023-12-05T10:02:56.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:55 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:02:56.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:55 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T10:02:58.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:57 smithi150 ceph-mon[171606]: pgmap v152: 65 pgs: 2 active+undersized+degraded, 4 active+undersized, 59 active+clean; 195 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 3/216 objects degraded (1.389%) 2023-12-05T10:02:58.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:57 smithi150 ceph-mon[171606]: Health check update: Degraded data redundancy: 3/216 objects degraded (1.389%), 2 pgs degraded (PG_DEGRADED) 2023-12-05T10:02:58.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:57 smithi100 ceph-mon[187528]: pgmap v152: 65 pgs: 2 active+undersized+degraded, 4 active+undersized, 59 active+clean; 195 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 3/216 objects degraded (1.389%) 2023-12-05T10:02:58.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:57 smithi100 ceph-mon[187528]: Health check update: Degraded data redundancy: 3/216 objects degraded (1.389%), 2 pgs degraded (PG_DEGRADED) 2023-12-05T10:02:59.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:59 smithi150 ceph-mon[171606]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 3/216 objects degraded (1.389%), 2 pgs degraded) 2023-12-05T10:02:59.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:02:59 smithi150 ceph-mon[171606]: Cluster is now healthy 2023-12-05T10:02:59.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:59 smithi100 ceph-mon[187528]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 3/216 objects degraded (1.389%), 2 pgs degraded) 2023-12-05T10:02:59.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:02:59 smithi100 ceph-mon[187528]: Cluster is now healthy 2023-12-05T10:03:00.345 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:00 smithi150 ceph-mon[171606]: pgmap v153: 65 pgs: 65 active+clean; 195 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2023-12-05T10:03:00.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:00 smithi100 ceph-mon[187528]: pgmap v153: 65 pgs: 65 active+clean; 195 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2023-12-05T10:03:02.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:02 smithi150 ceph-mon[171606]: pgmap v154: 65 pgs: 65 active+clean; 195 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2023-12-05T10:03:02.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:02 smithi100 ceph-mon[187528]: pgmap v154: 65 pgs: 65 active+clean; 195 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2023-12-05T10:03:04.345 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:04 smithi150 ceph-mon[171606]: pgmap v155: 65 pgs: 65 active+clean; 195 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2023-12-05T10:03:04.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:04 smithi100 ceph-mon[187528]: pgmap v155: 65 pgs: 65 active+clean; 195 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2023-12-05T10:03:06.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:06 smithi150 ceph-mon[171606]: pgmap v156: 65 pgs: 65 active+clean; 195 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2023-12-05T10:03:06.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:06 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:03:06.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:06 smithi100 ceph-mon[187528]: pgmap v156: 65 pgs: 65 active+clean; 195 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2023-12-05T10:03:06.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:06 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:03:08.066 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.068+0000 7f64fdbf5700 1 -- 172.21.15.100:0/1207220811 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64f8070570 msgr2=0x7f64f80709c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:03:08.066 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.068+0000 7f64fdbf5700 1 --2- 172.21.15.100:0/1207220811 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64f8070570 0x7f64f80709c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f64ec004940 tx=0x7f64ec009e30 comp rx=0 tx=0).stop 2023-12-05T10:03:08.066 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.068+0000 7f64fdbf5700 1 -- 172.21.15.100:0/1207220811 shutdown_connections 2023-12-05T10:03:08.066 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.068+0000 7f64fdbf5700 1 --2- 172.21.15.100:0/1207220811 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64f8070570 0x7f64f80709c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:08.066 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.068+0000 7f64fdbf5700 1 --2- 172.21.15.100:0/1207220811 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f64f8071bc0 0x7f64f8070030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:08.066 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.068+0000 7f64fdbf5700 1 -- 172.21.15.100:0/1207220811 >> 172.21.15.100:0/1207220811 conn(0x7f64f80f82d0 msgr2=0x7f64f80fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:03:08.066 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.068+0000 7f64fdbf5700 1 -- 172.21.15.100:0/1207220811 shutdown_connections 2023-12-05T10:03:08.066 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.068+0000 7f64fdbf5700 1 -- 172.21.15.100:0/1207220811 wait complete. 2023-12-05T10:03:08.068 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.069+0000 7f64fdbf5700 1 Processor -- start 2023-12-05T10:03:08.068 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.069+0000 7f64fdbf5700 1 -- start start 2023-12-05T10:03:08.068 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.069+0000 7f64fdbf5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f64f8070570 0x7f64f810f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:03:08.068 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.069+0000 7f64fdbf5700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64f8071bc0 0x7f64f810fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:03:08.068 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.069+0000 7f64fdbf5700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64f81103a0 con 0x7f64f8071bc0 2023-12-05T10:03:08.068 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.069+0000 7f64fdbf5700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64f8110c40 con 0x7f64f8070570 2023-12-05T10:03:08.068 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.070+0000 7f64f6ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64f8071bc0 0x7f64f810fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:03:08.068 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.070+0000 7f64f77fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f64f8070570 0x7f64f810f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:03:08.068 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.070+0000 7f64f77fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f64f8070570 0x7f64f810f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.100:44350/0 (socket says 172.21.15.100:44350) 2023-12-05T10:03:08.068 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.070+0000 7f64f77fe700 1 -- 172.21.15.100:0/1285272921 learned_addr learned my addr 172.21.15.100:0/1285272921 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T10:03:08.068 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.070+0000 7f64f6ffd700 1 -- 172.21.15.100:0/1285272921 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f64f8070570 msgr2=0x7f64f810f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:03:08.068 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.070+0000 7f64f6ffd700 1 --2- 172.21.15.100:0/1285272921 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f64f8070570 0x7f64f810f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:08.068 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.070+0000 7f64f6ffd700 1 -- 172.21.15.100:0/1285272921 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64ec005040 con 0x7f64f8071bc0 2023-12-05T10:03:08.069 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.070+0000 7f64f6ffd700 1 --2- 172.21.15.100:0/1285272921 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64f8071bc0 0x7f64f810fda0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f64ec004940 tx=0x7f64ec009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:03:08.069 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.071+0000 7f64dffff700 1 -- 172.21.15.100:0/1285272921 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64ec021070 con 0x7f64f8071bc0 2023-12-05T10:03:08.069 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.071+0000 7f64dffff700 1 -- 172.21.15.100:0/1285272921 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f64ec01c400 con 0x7f64f8071bc0 2023-12-05T10:03:08.069 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.071+0000 7f64fdbf5700 1 -- 172.21.15.100:0/1285272921 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64f8110ec0 con 0x7f64f8071bc0 2023-12-05T10:03:08.069 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.071+0000 7f64dffff700 1 -- 172.21.15.100:0/1285272921 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64ec00e070 con 0x7f64f8071bc0 2023-12-05T10:03:08.070 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.071+0000 7f64fdbf5700 1 -- 172.21.15.100:0/1285272921 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64f81113a0 con 0x7f64f8071bc0 2023-12-05T10:03:08.070 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.072+0000 7f64fdbf5700 1 -- 172.21.15.100:0/1285272921 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64f81096f0 con 0x7f64f8071bc0 2023-12-05T10:03:08.070 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.073+0000 7f64dffff700 1 -- 172.21.15.100:0/1285272921 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f64ec01c990 con 0x7f64f8071bc0 2023-12-05T10:03:08.071 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.074+0000 7f64dffff700 1 --2- 172.21.15.100:0/1285272921 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f64e006ce70 0x7f64e006f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:03:08.071 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.074+0000 7f64dffff700 1 -- 172.21.15.100:0/1285272921 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6703+0+0 (secure 0 0 0) 0x7f64ec08d450 con 0x7f64f8071bc0 2023-12-05T10:03:08.071 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.074+0000 7f64f77fe700 1 --2- 172.21.15.100:0/1285272921 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f64e006ce70 0x7f64e006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:03:08.072 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.074+0000 7f64f77fe700 1 --2- 172.21.15.100:0/1285272921 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f64e006ce70 0x7f64e006f320 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f64e8008fd0 tx=0x7f64e800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:03:08.076 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.079+0000 7f64dffff700 1 -- 172.21.15.100:0/1285272921 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f64ec05ad00 con 0x7f64f8071bc0 2023-12-05T10:03:08.293 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.296+0000 7f64fdbf5700 1 -- 172.21.15.100:0/1285272921 --> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f64f8107890 con 0x7f64e006ce70 2023-12-05T10:03:08.294 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.297+0000 7f64dffff700 1 -- 172.21.15.100:0/1285272921 <== mgr.34104 v2:172.21.15.100:6800/3489431924 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f64f8107890 con 0x7f64e006ce70 2023-12-05T10:03:08.297 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.299+0000 7f64fdbf5700 1 -- 172.21.15.100:0/1285272921 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f64e006ce70 msgr2=0x7f64e006f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:03:08.297 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.299+0000 7f64fdbf5700 1 --2- 172.21.15.100:0/1285272921 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f64e006ce70 0x7f64e006f320 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f64e8008fd0 tx=0x7f64e800b040 comp rx=0 tx=0).stop 2023-12-05T10:03:08.297 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.299+0000 7f64fdbf5700 1 -- 172.21.15.100:0/1285272921 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64f8071bc0 msgr2=0x7f64f810fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:03:08.297 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.299+0000 7f64fdbf5700 1 --2- 172.21.15.100:0/1285272921 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64f8071bc0 0x7f64f810fda0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f64ec004940 tx=0x7f64ec009e30 comp rx=0 tx=0).stop 2023-12-05T10:03:08.298 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.299+0000 7f64fdbf5700 1 -- 172.21.15.100:0/1285272921 shutdown_connections 2023-12-05T10:03:08.298 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.300+0000 7f64fdbf5700 1 --2- 172.21.15.100:0/1285272921 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f64e006ce70 0x7f64e006f320 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:08.298 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.300+0000 7f64fdbf5700 1 --2- 172.21.15.100:0/1285272921 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f64f8070570 0x7f64f810f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:08.298 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.300+0000 7f64fdbf5700 1 --2- 172.21.15.100:0/1285272921 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64f8071bc0 0x7f64f810fda0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:08.298 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.300+0000 7f64fdbf5700 1 -- 172.21.15.100:0/1285272921 >> 172.21.15.100:0/1285272921 conn(0x7f64f80f82d0 msgr2=0x7f64f8103310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:03:08.298 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.300+0000 7f64fdbf5700 1 -- 172.21.15.100:0/1285272921 shutdown_connections 2023-12-05T10:03:08.298 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.300+0000 7f64fdbf5700 1 -- 172.21.15.100:0/1285272921 wait complete. 2023-12-05T10:03:08.312 INFO:teuthology.orchestra.run.smithi100.stdout:true 2023-12-05T10:03:08.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:08 smithi150 ceph-mon[171606]: pgmap v157: 65 pgs: 65 active+clean; 195 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2023-12-05T10:03:08.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:08 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-05T10:03:08.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:08 smithi150 ceph-mon[171606]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-05T10:03:08.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:08 smithi150 ceph-mon[171606]: Upgrade: osd.5 is safe to restart 2023-12-05T10:03:08.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:08 smithi100 ceph-mon[187528]: pgmap v157: 65 pgs: 65 active+clean; 195 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2023-12-05T10:03:08.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:08 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-05T10:03:08.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:08 smithi100 ceph-mon[187528]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-05T10:03:08.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:08 smithi100 ceph-mon[187528]: Upgrade: osd.5 is safe to restart 2023-12-05T10:03:08.433 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.435+0000 7f52b3404700 1 -- 172.21.15.100:0/3448138896 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52ac0fcbf0 msgr2=0x7f52ac0fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:03:08.433 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.435+0000 7f52b3404700 1 --2- 172.21.15.100:0/3448138896 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52ac0fcbf0 0x7f52ac0fd000 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f52a8004940 tx=0x7f52a8009e30 comp rx=0 tx=0).stop 2023-12-05T10:03:08.433 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.435+0000 7f52b3404700 1 -- 172.21.15.100:0/3448138896 shutdown_connections 2023-12-05T10:03:08.433 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.435+0000 7f52b3404700 1 --2- 172.21.15.100:0/3448138896 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52ac0fde00 0x7f52ac0fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:08.433 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.435+0000 7f52b3404700 1 --2- 172.21.15.100:0/3448138896 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52ac0fcbf0 0x7f52ac0fd000 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:08.433 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.435+0000 7f52b3404700 1 -- 172.21.15.100:0/3448138896 >> 172.21.15.100:0/3448138896 conn(0x7f52ac0f82d0 msgr2=0x7f52ac0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:03:08.433 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.435+0000 7f52b3404700 1 -- 172.21.15.100:0/3448138896 shutdown_connections 2023-12-05T10:03:08.433 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.435+0000 7f52b3404700 1 -- 172.21.15.100:0/3448138896 wait complete. 2023-12-05T10:03:08.434 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.436+0000 7f52b3404700 1 Processor -- start 2023-12-05T10:03:08.434 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.436+0000 7f52b3404700 1 -- start start 2023-12-05T10:03:08.434 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.436+0000 7f52b3404700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52ac0fcbf0 0x7f52ac10f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:03:08.435 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.436+0000 7f52b3404700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52ac0fde00 0x7f52ac10fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:03:08.435 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.436+0000 7f52b3404700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52ac1102a0 con 0x7f52ac0fde00 2023-12-05T10:03:08.435 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.436+0000 7f52b3404700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52ac110b40 con 0x7f52ac0fcbf0 2023-12-05T10:03:08.435 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.437+0000 7f52b099f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52ac0fde00 0x7f52ac10fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:03:08.435 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.437+0000 7f52b099f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52ac0fde00 0x7f52ac10fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38622/0 (socket says 172.21.15.100:38622) 2023-12-05T10:03:08.435 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.437+0000 7f52b099f700 1 -- 172.21.15.100:0/2043704865 learned_addr learned my addr 172.21.15.100:0/2043704865 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T10:03:08.435 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.437+0000 7f52b11a0700 1 --2- 172.21.15.100:0/2043704865 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52ac0fcbf0 0x7f52ac10f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:03:08.435 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.437+0000 7f52b099f700 1 -- 172.21.15.100:0/2043704865 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52ac0fcbf0 msgr2=0x7f52ac10f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:03:08.435 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.437+0000 7f52b099f700 1 --2- 172.21.15.100:0/2043704865 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52ac0fcbf0 0x7f52ac10f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:08.435 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.437+0000 7f52b099f700 1 -- 172.21.15.100:0/2043704865 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52a8005040 con 0x7f52ac0fde00 2023-12-05T10:03:08.436 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.437+0000 7f52b099f700 1 --2- 172.21.15.100:0/2043704865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52ac0fde00 0x7f52ac10fca0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f529c002a50 tx=0x7f529c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:03:08.436 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.438+0000 7f52a1ffb700 1 -- 172.21.15.100:0/2043704865 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f529c007cc0 con 0x7f52ac0fde00 2023-12-05T10:03:08.436 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.438+0000 7f52a1ffb700 1 -- 172.21.15.100:0/2043704865 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f529c00f040 con 0x7f52ac0fde00 2023-12-05T10:03:08.436 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.438+0000 7f52a1ffb700 1 -- 172.21.15.100:0/2043704865 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f529c00d9c0 con 0x7f52ac0fde00 2023-12-05T10:03:08.437 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.438+0000 7f52b3404700 1 -- 172.21.15.100:0/2043704865 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52ac110e20 con 0x7f52ac0fde00 2023-12-05T10:03:08.437 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.438+0000 7f52b3404700 1 -- 172.21.15.100:0/2043704865 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52ac111310 con 0x7f52ac0fde00 2023-12-05T10:03:08.437 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.439+0000 7f52b3404700 1 -- 172.21.15.100:0/2043704865 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52ac101ea0 con 0x7f52ac0fde00 2023-12-05T10:03:08.437 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.440+0000 7f52a1ffb700 1 -- 172.21.15.100:0/2043704865 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f529c00db20 con 0x7f52ac0fde00 2023-12-05T10:03:08.438 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.441+0000 7f52a1ffb700 1 --2- 172.21.15.100:0/2043704865 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f529806ce60 0x7f529806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:03:08.438 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.441+0000 7f52a1ffb700 1 -- 172.21.15.100:0/2043704865 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6703+0+0 (secure 0 0 0) 0x7f529c08c120 con 0x7f52ac0fde00 2023-12-05T10:03:08.438 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.441+0000 7f52b11a0700 1 --2- 172.21.15.100:0/2043704865 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f529806ce60 0x7f529806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:03:08.439 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.441+0000 7f52b11a0700 1 --2- 172.21.15.100:0/2043704865 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f529806ce60 0x7f529806f310 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f52a8004890 tx=0x7f52a8009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:03:08.442 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.445+0000 7f52a1ffb700 1 -- 172.21.15.100:0/2043704865 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f529c059970 con 0x7f52ac0fde00 2023-12-05T10:03:08.661 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.663+0000 7f52b3404700 1 -- 172.21.15.100:0/2043704865 --> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f52ac1115f0 con 0x7f529806ce60 2023-12-05T10:03:08.662 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.665+0000 7f52a1ffb700 1 -- 172.21.15.100:0/2043704865 <== mgr.34104 v2:172.21.15.100:6800/3489431924 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f52ac1115f0 con 0x7f529806ce60 2023-12-05T10:03:08.665 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.667+0000 7f52b3404700 1 -- 172.21.15.100:0/2043704865 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f529806ce60 msgr2=0x7f529806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:03:08.665 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.667+0000 7f52b3404700 1 --2- 172.21.15.100:0/2043704865 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f529806ce60 0x7f529806f310 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f52a8004890 tx=0x7f52a8009e30 comp rx=0 tx=0).stop 2023-12-05T10:03:08.665 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.667+0000 7f52b3404700 1 -- 172.21.15.100:0/2043704865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52ac0fde00 msgr2=0x7f52ac10fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:03:08.665 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.667+0000 7f52b3404700 1 --2- 172.21.15.100:0/2043704865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52ac0fde00 0x7f52ac10fca0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f529c002a50 tx=0x7f529c0046b0 comp rx=0 tx=0).stop 2023-12-05T10:03:08.665 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.667+0000 7f52b3404700 1 -- 172.21.15.100:0/2043704865 shutdown_connections 2023-12-05T10:03:08.665 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.667+0000 7f52b3404700 1 --2- 172.21.15.100:0/2043704865 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f529806ce60 0x7f529806f310 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:08.665 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.667+0000 7f52b3404700 1 --2- 172.21.15.100:0/2043704865 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52ac0fcbf0 0x7f52ac10f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:08.665 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.667+0000 7f52b3404700 1 --2- 172.21.15.100:0/2043704865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52ac0fde00 0x7f52ac10fca0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:08.666 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.667+0000 7f52b3404700 1 -- 172.21.15.100:0/2043704865 >> 172.21.15.100:0/2043704865 conn(0x7f52ac0f82d0 msgr2=0x7f52ac0ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:03:08.666 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.668+0000 7f52b3404700 1 -- 172.21.15.100:0/2043704865 shutdown_connections 2023-12-05T10:03:08.666 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.668+0000 7f52b3404700 1 -- 172.21.15.100:0/2043704865 wait complete. 2023-12-05T10:03:08.802 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.804+0000 7f4854cf2700 1 -- 172.21.15.100:0/1827014636 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48500fcbf0 msgr2=0x7f48500fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:03:08.802 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.804+0000 7f4854cf2700 1 --2- 172.21.15.100:0/1827014636 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48500fcbf0 0x7f48500fd000 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4840004940 tx=0x7f4840009e30 comp rx=0 tx=0).stop 2023-12-05T10:03:08.802 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.804+0000 7f4854cf2700 1 -- 172.21.15.100:0/1827014636 shutdown_connections 2023-12-05T10:03:08.802 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.804+0000 7f4854cf2700 1 --2- 172.21.15.100:0/1827014636 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48500fde00 0x7f48500fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:08.802 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.804+0000 7f4854cf2700 1 --2- 172.21.15.100:0/1827014636 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48500fcbf0 0x7f48500fd000 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:08.802 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.804+0000 7f4854cf2700 1 -- 172.21.15.100:0/1827014636 >> 172.21.15.100:0/1827014636 conn(0x7f48500f82d0 msgr2=0x7f48500fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:03:08.803 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.804+0000 7f4854cf2700 1 -- 172.21.15.100:0/1827014636 shutdown_connections 2023-12-05T10:03:08.803 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.804+0000 7f4854cf2700 1 -- 172.21.15.100:0/1827014636 wait complete. 2023-12-05T10:03:08.804 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.805+0000 7f4854cf2700 1 Processor -- start 2023-12-05T10:03:08.804 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.805+0000 7f4854cf2700 1 -- start start 2023-12-05T10:03:08.804 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.805+0000 7f4854cf2700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48500fcbf0 0x7f485010d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:03:08.804 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.805+0000 7f4854cf2700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48500fde00 0x7f485010daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:03:08.805 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.805+0000 7f4854cf2700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f485010e0a0 con 0x7f48500fde00 2023-12-05T10:03:08.805 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.805+0000 7f4854cf2700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f485010e940 con 0x7f48500fcbf0 2023-12-05T10:03:08.805 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.805+0000 7f484dd9b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48500fde00 0x7f485010daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:03:08.805 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.805+0000 7f484dd9b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48500fde00 0x7f485010daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38638/0 (socket says 172.21.15.100:38638) 2023-12-05T10:03:08.805 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.805+0000 7f484dd9b700 1 -- 172.21.15.100:0/4057398608 learned_addr learned my addr 172.21.15.100:0/4057398608 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T10:03:08.805 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.806+0000 7f484e59c700 1 --2- 172.21.15.100:0/4057398608 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48500fcbf0 0x7f485010d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:03:08.805 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.806+0000 7f484dd9b700 1 -- 172.21.15.100:0/4057398608 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48500fcbf0 msgr2=0x7f485010d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:03:08.805 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.806+0000 7f484dd9b700 1 --2- 172.21.15.100:0/4057398608 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48500fcbf0 0x7f485010d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:08.805 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.806+0000 7f484dd9b700 1 -- 172.21.15.100:0/4057398608 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4840005040 con 0x7f48500fde00 2023-12-05T10:03:08.805 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.806+0000 7f484dd9b700 1 --2- 172.21.15.100:0/4057398608 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48500fde00 0x7f485010daa0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4844002a50 tx=0x7f48440046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:03:08.806 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.806+0000 7f483effd700 1 -- 172.21.15.100:0/4057398608 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4844007cc0 con 0x7f48500fde00 2023-12-05T10:03:08.806 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.806+0000 7f483effd700 1 -- 172.21.15.100:0/4057398608 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f484400f040 con 0x7f48500fde00 2023-12-05T10:03:08.806 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.806+0000 7f4854cf2700 1 -- 172.21.15.100:0/4057398608 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f485010ec20 con 0x7f48500fde00 2023-12-05T10:03:08.806 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.806+0000 7f483effd700 1 -- 172.21.15.100:0/4057398608 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f484400d9c0 con 0x7f48500fde00 2023-12-05T10:03:08.806 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.807+0000 7f4854cf2700 1 -- 172.21.15.100:0/4057398608 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f485010f160 con 0x7f48500fde00 2023-12-05T10:03:08.806 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.807+0000 7f4854cf2700 1 -- 172.21.15.100:0/4057398608 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f485004bb80 con 0x7f48500fde00 2023-12-05T10:03:08.807 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.808+0000 7f483effd700 1 -- 172.21.15.100:0/4057398608 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f484400db20 con 0x7f48500fde00 2023-12-05T10:03:08.807 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.810+0000 7f483effd700 1 --2- 172.21.15.100:0/4057398608 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f483806ce70 0x7f483806f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:03:08.807 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.810+0000 7f483effd700 1 -- 172.21.15.100:0/4057398608 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6703+0+0 (secure 0 0 0) 0x7f484408c0d0 con 0x7f48500fde00 2023-12-05T10:03:08.808 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.810+0000 7f484e59c700 1 --2- 172.21.15.100:0/4057398608 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f483806ce70 0x7f483806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:03:08.808 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.811+0000 7f484e59c700 1 --2- 172.21.15.100:0/4057398608 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f483806ce70 0x7f483806f320 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f484000b7d0 tx=0x7f4840009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:03:08.812 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:08.814+0000 7f483effd700 1 -- 172.21.15.100:0/4057398608 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f4844059900 con 0x7f48500fde00 2023-12-05T10:03:09.024 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.026+0000 7f4854cf2700 1 -- 172.21.15.100:0/4057398608 --> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f485010f600 con 0x7f483806ce70 2023-12-05T10:03:09.034 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.036+0000 7f483effd700 1 -- 172.21.15.100:0/4057398608 <== mgr.34104 v2:172.21.15.100:6800/3489431924 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f485010f600 con 0x7f483806ce70 2023-12-05T10:03:09.034 INFO:teuthology.orchestra.run.smithi100.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-05T10:03:09.034 INFO:teuthology.orchestra.run.smithi100.stdout:alertmanager.smithi100 smithi100 *:9093,9094 running (5m) 86s ago 13m 14.7M - 0.25.0 c8568f914cd2 f443e6a4242b 2023-12-05T10:03:09.034 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi100 smithi100 running (3m) 86s ago 13m 7843k - 19.0.0-11-g3fe8d441 56dea28e5206 fb8e6b844fba 2023-12-05T10:03:09.034 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi150 smithi150 running (3m) 21s ago 12m 7847k - 19.0.0-11-g3fe8d441 56dea28e5206 a035052de6cf 2023-12-05T10:03:09.035 INFO:teuthology.orchestra.run.smithi100.stdout:grafana.smithi100 smithi100 *:3000 running (5m) 86s ago 12m 80.1M - 9.4.7 2c41d148cca3 d666da9c4e4d 2023-12-05T10:03:09.035 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.akmstb smithi100 running (8m) 86s ago 8m 10.5G - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 6ce55c42c55b 2023-12-05T10:03:09.035 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.sqplhn smithi100 running (8m) 86s ago 8m 15.9M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc c2682d65f0c9 2023-12-05T10:03:09.035 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi150.fcnhsv smithi150 running (8m) 21s ago 8m 15.8M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 1a259762235d 2023-12-05T10:03:09.035 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi150.pcbpxm smithi150 running (8m) 21s ago 8m 15.9M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 27f730f8b9f9 2023-12-05T10:03:09.035 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi100.ehmuhg smithi100 *:8443,9283,8765 running (5m) 86s ago 14m 516M - 19.0.0-11-g3fe8d441 56dea28e5206 ebe3dfbb0356 2023-12-05T10:03:09.035 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi150.zkskag smithi150 *:8443,9283,8765 running (4m) 21s ago 12m 453M - 19.0.0-11-g3fe8d441 56dea28e5206 a2b40e2421f2 2023-12-05T10:03:09.035 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi100 smithi100 running (4m) 86s ago 14m 70.8M 2048M 19.0.0-11-g3fe8d441 56dea28e5206 21003fd7eaf4 2023-12-05T10:03:09.035 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi150 smithi150 running (3m) 21s ago 12m 51.8M 2048M 19.0.0-11-g3fe8d441 56dea28e5206 010f2f658fca 2023-12-05T10:03:09.035 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi100 smithi100 *:9100 running (5m) 86s ago 13m 8288k - 1.5.0 0da6a335fe13 a2653da0d840 2023-12-05T10:03:09.036 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi150 smithi150 *:9100 running (5m) 21s ago 12m 8548k - 1.5.0 0da6a335fe13 67523645e73b 2023-12-05T10:03:09.036 INFO:teuthology.orchestra.run.smithi100.stdout:osd.0 smithi100 running (2m) 86s ago 11m 133M 1618M 19.0.0-11-g3fe8d441 56dea28e5206 a29add095f14 2023-12-05T10:03:09.036 INFO:teuthology.orchestra.run.smithi100.stdout:osd.1 smithi100 running (2m) 86s ago 11m 135M 1618M 19.0.0-11-g3fe8d441 56dea28e5206 2de00a9dc686 2023-12-05T10:03:09.036 INFO:teuthology.orchestra.run.smithi100.stdout:osd.2 smithi100 running (91s) 86s ago 10m 12.6M 1618M 19.0.0-11-g3fe8d441 56dea28e5206 fb6adf680449 2023-12-05T10:03:09.036 INFO:teuthology.orchestra.run.smithi100.stdout:osd.3 smithi150 running (57s) 21s ago 10m 191M 2642M 19.0.0-11-g3fe8d441 56dea28e5206 08545df235d8 2023-12-05T10:03:09.036 INFO:teuthology.orchestra.run.smithi100.stdout:osd.4 smithi150 running (24s) 21s ago 10m 12.6M 2642M 19.0.0-11-g3fe8d441 56dea28e5206 bcabd80780a8 2023-12-05T10:03:09.036 INFO:teuthology.orchestra.run.smithi100.stdout:osd.5 smithi150 running (9m) 21s ago 9m 1283M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc d9720b1eae0c 2023-12-05T10:03:09.036 INFO:teuthology.orchestra.run.smithi100.stdout:prometheus.smithi100 smithi100 *:9095 running (4m) 86s ago 12m 59.7M - 2.43.0 a07b618ecd1d 8ade75deb316 2023-12-05T10:03:09.037 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.039+0000 7f4854cf2700 1 -- 172.21.15.100:0/4057398608 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f483806ce70 msgr2=0x7f483806f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:03:09.037 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.039+0000 7f4854cf2700 1 --2- 172.21.15.100:0/4057398608 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f483806ce70 0x7f483806f320 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f484000b7d0 tx=0x7f4840009e30 comp rx=0 tx=0).stop 2023-12-05T10:03:09.037 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.039+0000 7f4854cf2700 1 -- 172.21.15.100:0/4057398608 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48500fde00 msgr2=0x7f485010daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:03:09.037 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.039+0000 7f4854cf2700 1 --2- 172.21.15.100:0/4057398608 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48500fde00 0x7f485010daa0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4844002a50 tx=0x7f48440046b0 comp rx=0 tx=0).stop 2023-12-05T10:03:09.037 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.039+0000 7f4854cf2700 1 -- 172.21.15.100:0/4057398608 shutdown_connections 2023-12-05T10:03:09.037 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.039+0000 7f4854cf2700 1 --2- 172.21.15.100:0/4057398608 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f483806ce70 0x7f483806f320 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:09.038 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.039+0000 7f4854cf2700 1 --2- 172.21.15.100:0/4057398608 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48500fcbf0 0x7f485010d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:09.038 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.039+0000 7f4854cf2700 1 --2- 172.21.15.100:0/4057398608 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48500fde00 0x7f485010daa0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:09.038 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.039+0000 7f4854cf2700 1 -- 172.21.15.100:0/4057398608 >> 172.21.15.100:0/4057398608 conn(0x7f48500f82d0 msgr2=0x7f4850101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:03:09.038 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.039+0000 7f4854cf2700 1 -- 172.21.15.100:0/4057398608 shutdown_connections 2023-12-05T10:03:09.038 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.039+0000 7f4854cf2700 1 -- 172.21.15.100:0/4057398608 wait complete. 2023-12-05T10:03:09.171 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.173+0000 7f4182fc9700 1 -- 172.21.15.100:0/2649334836 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f417c0ffb70 msgr2=0x7f417c101fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:03:09.171 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.173+0000 7f4182fc9700 1 --2- 172.21.15.100:0/2649334836 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f417c0ffb70 0x7f417c101fd0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f416c004880 tx=0x7f416c009e30 comp rx=0 tx=0).stop 2023-12-05T10:03:09.171 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.173+0000 7f4182fc9700 1 -- 172.21.15.100:0/2649334836 shutdown_connections 2023-12-05T10:03:09.171 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.173+0000 7f4182fc9700 1 --2- 172.21.15.100:0/2649334836 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f417c0ffb70 0x7f417c101fd0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:09.172 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.173+0000 7f4182fc9700 1 --2- 172.21.15.100:0/2649334836 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f417c066090 0x7f417c0ff5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:09.172 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.173+0000 7f4182fc9700 1 -- 172.21.15.100:0/2649334836 >> 172.21.15.100:0/2649334836 conn(0x7f417c0f6f70 msgr2=0x7f417c0f93e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:03:09.172 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.173+0000 7f4182fc9700 1 -- 172.21.15.100:0/2649334836 shutdown_connections 2023-12-05T10:03:09.172 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.173+0000 7f4182fc9700 1 -- 172.21.15.100:0/2649334836 wait complete. 2023-12-05T10:03:09.173 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.174+0000 7f4182fc9700 1 Processor -- start 2023-12-05T10:03:09.173 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.174+0000 7f4182fc9700 1 -- start start 2023-12-05T10:03:09.173 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.174+0000 7f4182fc9700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f417c066090 0x7f417c10f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:03:09.173 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.174+0000 7f4182fc9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f417c0ffb70 0x7f417c10fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:03:09.174 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.174+0000 7f4182fc9700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f417c110000 con 0x7f417c066090 2023-12-05T10:03:09.174 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.174+0000 7f4182fc9700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f417c110850 con 0x7f417c0ffb70 2023-12-05T10:03:09.174 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.175+0000 7f4181fc7700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f417c066090 0x7f417c10f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:03:09.174 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.175+0000 7f41817c6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f417c0ffb70 0x7f417c10fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:03:09.174 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.175+0000 7f4181fc7700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f417c066090 0x7f417c10f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38656/0 (socket says 172.21.15.100:38656) 2023-12-05T10:03:09.174 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.175+0000 7f4181fc7700 1 -- 172.21.15.100:0/100173620 learned_addr learned my addr 172.21.15.100:0/100173620 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T10:03:09.174 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.175+0000 7f4181fc7700 1 -- 172.21.15.100:0/100173620 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f417c0ffb70 msgr2=0x7f417c10fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:03:09.174 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.175+0000 7f4181fc7700 1 --2- 172.21.15.100:0/100173620 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f417c0ffb70 0x7f417c10fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:09.174 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.175+0000 7f4181fc7700 1 -- 172.21.15.100:0/100173620 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4178005040 con 0x7f417c066090 2023-12-05T10:03:09.174 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.175+0000 7f4181fc7700 1 --2- 172.21.15.100:0/100173620 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f417c066090 0x7f417c10f4c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f41780096b0 tx=0x7f4178009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:03:09.174 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.176+0000 7f41727fc700 1 -- 172.21.15.100:0/100173620 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4178017070 con 0x7f417c066090 2023-12-05T10:03:09.174 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.176+0000 7f41727fc700 1 -- 172.21.15.100:0/100173620 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f417800f040 con 0x7f417c066090 2023-12-05T10:03:09.175 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.176+0000 7f41727fc700 1 -- 172.21.15.100:0/100173620 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4178013b30 con 0x7f417c066090 2023-12-05T10:03:09.175 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.176+0000 7f4182fc9700 1 -- 172.21.15.100:0/100173620 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f416c005040 con 0x7f417c066090 2023-12-05T10:03:09.176 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.176+0000 7f4182fc9700 1 -- 172.21.15.100:0/100173620 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f417c110e80 con 0x7f417c066090 2023-12-05T10:03:09.176 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.177+0000 7f4182fc9700 1 -- 172.21.15.100:0/100173620 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f417c04bb80 con 0x7f417c066090 2023-12-05T10:03:09.176 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.178+0000 7f41727fc700 1 -- 172.21.15.100:0/100173620 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f417800e840 con 0x7f417c066090 2023-12-05T10:03:09.176 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.178+0000 7f41727fc700 1 --2- 172.21.15.100:0/100173620 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f416806ce70 0x7f416806f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:03:09.176 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.179+0000 7f41727fc700 1 -- 172.21.15.100:0/100173620 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6703+0+0 (secure 0 0 0) 0x7f417808c250 con 0x7f417c066090 2023-12-05T10:03:09.177 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.179+0000 7f41817c6700 1 --2- 172.21.15.100:0/100173620 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f416806ce70 0x7f416806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:03:09.177 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.179+0000 7f41817c6700 1 --2- 172.21.15.100:0/100173620 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f416806ce70 0x7f416806f320 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f416c0135d0 tx=0x7f416c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:03:09.180 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.183+0000 7f41727fc700 1 -- 172.21.15.100:0/100173620 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f4178059a80 con 0x7f417c066090 2023-12-05T10:03:09.345 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:09 smithi150 ceph-mon[171606]: from='client.34340 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T10:03:09.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:09 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:03:09.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:09 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-05T10:03:09.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:09 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T10:03:09.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:09 smithi100 ceph-mon[187528]: from='client.34340 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T10:03:09.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:09 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:03:09.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:09 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-05T10:03:09.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:09 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T10:03:09.460 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.462+0000 7f4182fc9700 1 -- 172.21.15.100:0/100173620 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f417c1114d0 con 0x7f417c066090 2023-12-05T10:03:09.460 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.463+0000 7f41727fc700 1 -- 172.21.15.100:0/100173620 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+827 (secure 0 0 0) 0x7f4178059610 con 0x7f417c066090 2023-12-05T10:03:09.460 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2023-12-05T10:03:09.460 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": { 2023-12-05T10:03:09.460 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 2 2023-12-05T10:03:09.461 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-12-05T10:03:09.461 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": { 2023-12-05T10:03:09.461 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 2 2023-12-05T10:03:09.461 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-12-05T10:03:09.461 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": { 2023-12-05T10:03:09.461 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 1, 2023-12-05T10:03:09.461 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 5 2023-12-05T10:03:09.461 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-12-05T10:03:09.461 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": { 2023-12-05T10:03:09.461 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 4 2023-12-05T10:03:09.461 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-12-05T10:03:09.461 INFO:teuthology.orchestra.run.smithi100.stdout: "overall": { 2023-12-05T10:03:09.462 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 5, 2023-12-05T10:03:09.462 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 9 2023-12-05T10:03:09.462 INFO:teuthology.orchestra.run.smithi100.stdout: } 2023-12-05T10:03:09.462 INFO:teuthology.orchestra.run.smithi100.stdout:} 2023-12-05T10:03:09.463 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.465+0000 7f4182fc9700 1 -- 172.21.15.100:0/100173620 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f416806ce70 msgr2=0x7f416806f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:03:09.463 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.465+0000 7f4182fc9700 1 --2- 172.21.15.100:0/100173620 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f416806ce70 0x7f416806f320 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f416c0135d0 tx=0x7f416c009e30 comp rx=0 tx=0).stop 2023-12-05T10:03:09.463 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.465+0000 7f4182fc9700 1 -- 172.21.15.100:0/100173620 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f417c066090 msgr2=0x7f417c10f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:03:09.463 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.465+0000 7f4182fc9700 1 --2- 172.21.15.100:0/100173620 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f417c066090 0x7f417c10f4c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f41780096b0 tx=0x7f4178009e30 comp rx=0 tx=0).stop 2023-12-05T10:03:09.463 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.465+0000 7f4182fc9700 1 -- 172.21.15.100:0/100173620 shutdown_connections 2023-12-05T10:03:09.463 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.465+0000 7f4182fc9700 1 --2- 172.21.15.100:0/100173620 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f416806ce70 0x7f416806f320 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:09.463 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.465+0000 7f4182fc9700 1 --2- 172.21.15.100:0/100173620 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f417c066090 0x7f417c10f4c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:09.463 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.465+0000 7f4182fc9700 1 --2- 172.21.15.100:0/100173620 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f417c0ffb70 0x7f417c10fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:09.463 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.465+0000 7f4182fc9700 1 -- 172.21.15.100:0/100173620 >> 172.21.15.100:0/100173620 conn(0x7f417c0f6f70 msgr2=0x7f417c0fb360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:03:09.463 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.465+0000 7f4182fc9700 1 -- 172.21.15.100:0/100173620 shutdown_connections 2023-12-05T10:03:09.463 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.465+0000 7f4182fc9700 1 -- 172.21.15.100:0/100173620 wait complete. 2023-12-05T10:03:09.597 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.599+0000 7f0bdc3c1700 1 -- 172.21.15.100:0/113974462 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0bd40fde00 msgr2=0x7f0bd40fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:03:09.597 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.599+0000 7f0bdc3c1700 1 --2- 172.21.15.100:0/113974462 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0bd40fde00 0x7f0bd40fe250 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0bc4004940 tx=0x7f0bc4009e30 comp rx=0 tx=0).stop 2023-12-05T10:03:09.597 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.599+0000 7f0bdc3c1700 1 -- 172.21.15.100:0/113974462 shutdown_connections 2023-12-05T10:03:09.598 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.599+0000 7f0bdc3c1700 1 --2- 172.21.15.100:0/113974462 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0bd40fde00 0x7f0bd40fe250 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:09.598 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.599+0000 7f0bdc3c1700 1 --2- 172.21.15.100:0/113974462 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0bd40fcbf0 0x7f0bd40fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:09.598 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.600+0000 7f0bdc3c1700 1 -- 172.21.15.100:0/113974462 >> 172.21.15.100:0/113974462 conn(0x7f0bd40f82d0 msgr2=0x7f0bd40fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:03:09.598 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.600+0000 7f0bdc3c1700 1 -- 172.21.15.100:0/113974462 shutdown_connections 2023-12-05T10:03:09.598 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.600+0000 7f0bdc3c1700 1 -- 172.21.15.100:0/113974462 wait complete. 2023-12-05T10:03:09.599 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.600+0000 7f0bdc3c1700 1 Processor -- start 2023-12-05T10:03:09.599 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.601+0000 7f0bdc3c1700 1 -- start start 2023-12-05T10:03:09.599 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.601+0000 7f0bdc3c1700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0bd40fcbf0 0x7f0bd4071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:03:09.599 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.601+0000 7f0bdc3c1700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0bd40fde00 0x7f0bd406ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:03:09.599 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.601+0000 7f0bdc3c1700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd4070590 con 0x7f0bd40fcbf0 2023-12-05T10:03:09.599 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.601+0000 7f0bdc3c1700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd4070700 con 0x7f0bd40fde00 2023-12-05T10:03:09.599 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.601+0000 7f0bda15d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0bd40fcbf0 0x7f0bd4071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:03:09.599 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.601+0000 7f0bda15d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0bd40fcbf0 0x7f0bd4071b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38668/0 (socket says 172.21.15.100:38668) 2023-12-05T10:03:09.599 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.601+0000 7f0bda15d700 1 -- 172.21.15.100:0/2847370593 learned_addr learned my addr 172.21.15.100:0/2847370593 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T10:03:09.600 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.601+0000 7f0bd995c700 1 --2- 172.21.15.100:0/2847370593 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0bd40fde00 0x7f0bd406ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:03:09.600 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.601+0000 7f0bda15d700 1 -- 172.21.15.100:0/2847370593 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0bd40fde00 msgr2=0x7f0bd406ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:03:09.600 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.601+0000 7f0bda15d700 1 --2- 172.21.15.100:0/2847370593 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0bd40fde00 0x7f0bd406ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:09.600 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.602+0000 7f0bda15d700 1 -- 172.21.15.100:0/2847370593 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc4005040 con 0x7f0bd40fcbf0 2023-12-05T10:03:09.601 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.602+0000 7f0bda15d700 1 --2- 172.21.15.100:0/2847370593 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0bd40fcbf0 0x7f0bd4071b10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0bd0002a80 tx=0x7f0bd0004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:03:09.601 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.602+0000 7f0bcaffd700 1 -- 172.21.15.100:0/2847370593 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0bd0007cc0 con 0x7f0bd40fcbf0 2023-12-05T10:03:09.601 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.602+0000 7f0bcaffd700 1 -- 172.21.15.100:0/2847370593 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0bd000f040 con 0x7f0bd40fcbf0 2023-12-05T10:03:09.601 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.602+0000 7f0bcaffd700 1 -- 172.21.15.100:0/2847370593 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0bd000d9c0 con 0x7f0bd40fcbf0 2023-12-05T10:03:09.601 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.602+0000 7f0bdc3c1700 1 -- 172.21.15.100:0/2847370593 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bd40709e0 con 0x7f0bd40fcbf0 2023-12-05T10:03:09.601 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.602+0000 7f0bdc3c1700 1 -- 172.21.15.100:0/2847370593 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bd41155b0 con 0x7f0bd40fcbf0 2023-12-05T10:03:09.601 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.603+0000 7f0bdc3c1700 1 -- 172.21.15.100:0/2847370593 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bd404bb80 con 0x7f0bd40fcbf0 2023-12-05T10:03:09.601 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.604+0000 7f0bcaffd700 1 -- 172.21.15.100:0/2847370593 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f0bd000db20 con 0x7f0bd40fcbf0 2023-12-05T10:03:09.603 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.605+0000 7f0bcaffd700 1 --2- 172.21.15.100:0/2847370593 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f0bc006ce60 0x7f0bc006f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:03:09.603 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.605+0000 7f0bcaffd700 1 -- 172.21.15.100:0/2847370593 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6703+0+0 (secure 0 0 0) 0x7f0bd008c190 con 0x7f0bd40fcbf0 2023-12-05T10:03:09.603 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.605+0000 7f0bd995c700 1 --2- 172.21.15.100:0/2847370593 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f0bc006ce60 0x7f0bc006f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:03:09.603 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.606+0000 7f0bd995c700 1 --2- 172.21.15.100:0/2847370593 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f0bc006ce60 0x7f0bc006f310 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0bc4004890 tx=0x7f0bc4009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:03:09.607 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.609+0000 7f0bcaffd700 1 -- 172.21.15.100:0/2847370593 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f0bd0059940 con 0x7f0bd40fcbf0 2023-12-05T10:03:09.855 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.857+0000 7f0bdc3c1700 1 -- 172.21.15.100:0/2847370593 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0bd4115990 con 0x7f0bd40fcbf0 2023-12-05T10:03:09.856 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.858+0000 7f0bcaffd700 1 -- 172.21.15.100:0/2847370593 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1852 (secure 0 0 0) 0x7f0bd00594d0 con 0x7f0bd40fcbf0 2023-12-05T10:03:09.856 INFO:teuthology.orchestra.run.smithi100.stdout:e13 2023-12-05T10:03:09.856 INFO:teuthology.orchestra.run.smithi100.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-05T10:03:09.856 INFO:teuthology.orchestra.run.smithi100.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T10:03:09.856 INFO:teuthology.orchestra.run.smithi100.stdout:legacy client fscid: 1 2023-12-05T10:03:09.856 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T10:03:09.856 INFO:teuthology.orchestra.run.smithi100.stdout:Filesystem 'cephfs' (1) 2023-12-05T10:03:09.856 INFO:teuthology.orchestra.run.smithi100.stdout:fs_name cephfs 2023-12-05T10:03:09.856 INFO:teuthology.orchestra.run.smithi100.stdout:epoch 13 2023-12-05T10:03:09.856 INFO:teuthology.orchestra.run.smithi100.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-05T10:03:09.856 INFO:teuthology.orchestra.run.smithi100.stdout:created 2023-12-05T09:54:30.515778+0000 2023-12-05T10:03:09.857 INFO:teuthology.orchestra.run.smithi100.stdout:modified 2023-12-05T09:54:46.403009+0000 2023-12-05T10:03:09.857 INFO:teuthology.orchestra.run.smithi100.stdout:tableserver 0 2023-12-05T10:03:09.857 INFO:teuthology.orchestra.run.smithi100.stdout:root 0 2023-12-05T10:03:09.857 INFO:teuthology.orchestra.run.smithi100.stdout:session_timeout 60 2023-12-05T10:03:09.857 INFO:teuthology.orchestra.run.smithi100.stdout:session_autoclose 300 2023-12-05T10:03:09.857 INFO:teuthology.orchestra.run.smithi100.stdout:max_file_size 1099511627776 2023-12-05T10:03:09.857 INFO:teuthology.orchestra.run.smithi100.stdout:max_xattr_size 65536 2023-12-05T10:03:09.857 INFO:teuthology.orchestra.run.smithi100.stdout:required_client_features {} 2023-12-05T10:03:09.857 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure 0 2023-12-05T10:03:09.857 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure_osd_epoch 46 2023-12-05T10:03:09.857 INFO:teuthology.orchestra.run.smithi100.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T10:03:09.857 INFO:teuthology.orchestra.run.smithi100.stdout:max_mds 1 2023-12-05T10:03:09.857 INFO:teuthology.orchestra.run.smithi100.stdout:in 0 2023-12-05T10:03:09.857 INFO:teuthology.orchestra.run.smithi100.stdout:up {0=14490} 2023-12-05T10:03:09.857 INFO:teuthology.orchestra.run.smithi100.stdout:failed 2023-12-05T10:03:09.858 INFO:teuthology.orchestra.run.smithi100.stdout:damaged 2023-12-05T10:03:09.858 INFO:teuthology.orchestra.run.smithi100.stdout:stopped 2023-12-05T10:03:09.858 INFO:teuthology.orchestra.run.smithi100.stdout:data_pools [3] 2023-12-05T10:03:09.858 INFO:teuthology.orchestra.run.smithi100.stdout:metadata_pool 2 2023-12-05T10:03:09.858 INFO:teuthology.orchestra.run.smithi100.stdout:inline_data disabled 2023-12-05T10:03:09.858 INFO:teuthology.orchestra.run.smithi100.stdout:balancer 2023-12-05T10:03:09.858 INFO:teuthology.orchestra.run.smithi100.stdout:bal_rank_mask -1 2023-12-05T10:03:09.858 INFO:teuthology.orchestra.run.smithi100.stdout:standby_count_wanted 1 2023-12-05T10:03:09.858 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi100.akmstb{0:14490} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.100:6828/627555128,v1:172.21.15.100:6829/627555128] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T10:03:09.858 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T10:03:09.858 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T10:03:09.858 INFO:teuthology.orchestra.run.smithi100.stdout:Standby daemons: 2023-12-05T10:03:09.858 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T10:03:09.858 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi150.pcbpxm{-1:14486} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.150:6824/3645854543,v1:172.21.15.150:6825/3645854543] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T10:03:09.858 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi150.fcnhsv{-1:14498} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.150:6826/3249949736,v1:172.21.15.150:6827/3249949736] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T10:03:09.859 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi100.sqplhn{-1:14506} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.100:6826/2472212864,v1:172.21.15.100:6827/2472212864] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T10:03:09.859 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.860+0000 7f0bdc3c1700 1 -- 172.21.15.100:0/2847370593 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f0bc006ce60 msgr2=0x7f0bc006f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:03:09.859 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.860+0000 7f0bdc3c1700 1 --2- 172.21.15.100:0/2847370593 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f0bc006ce60 0x7f0bc006f310 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0bc4004890 tx=0x7f0bc4009e30 comp rx=0 tx=0).stop 2023-12-05T10:03:09.860 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.860+0000 7f0bdc3c1700 1 -- 172.21.15.100:0/2847370593 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0bd40fcbf0 msgr2=0x7f0bd4071b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:03:09.860 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.860+0000 7f0bdc3c1700 1 --2- 172.21.15.100:0/2847370593 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0bd40fcbf0 0x7f0bd4071b10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0bd0002a80 tx=0x7f0bd0004600 comp rx=0 tx=0).stop 2023-12-05T10:03:09.860 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.860+0000 7f0bdc3c1700 1 -- 172.21.15.100:0/2847370593 shutdown_connections 2023-12-05T10:03:09.860 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.860+0000 7f0bdc3c1700 1 --2- 172.21.15.100:0/2847370593 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f0bc006ce60 0x7f0bc006f310 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:09.860 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.860+0000 7f0bdc3c1700 1 --2- 172.21.15.100:0/2847370593 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0bd40fcbf0 0x7f0bd4071b10 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:09.860 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.860+0000 7f0bdc3c1700 1 --2- 172.21.15.100:0/2847370593 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0bd40fde00 0x7f0bd406ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:09.860 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.860+0000 7f0bdc3c1700 1 -- 172.21.15.100:0/2847370593 >> 172.21.15.100:0/2847370593 conn(0x7f0bd40f82d0 msgr2=0x7f0bd4101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:03:09.860 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.860+0000 7f0bdc3c1700 1 -- 172.21.15.100:0/2847370593 shutdown_connections 2023-12-05T10:03:09.860 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.861+0000 7f0bdc3c1700 1 -- 172.21.15.100:0/2847370593 wait complete. 2023-12-05T10:03:09.860 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 13 2023-12-05T10:03:09.996 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.998+0000 7f46835f0700 1 -- 172.21.15.100:0/3899023289 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f467c0fcbf0 msgr2=0x7f467c0fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:03:09.996 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.998+0000 7f46835f0700 1 --2- 172.21.15.100:0/3899023289 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f467c0fcbf0 0x7f467c0fd000 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4678004940 tx=0x7f4678009e30 comp rx=0 tx=0).stop 2023-12-05T10:03:09.996 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.998+0000 7f46835f0700 1 -- 172.21.15.100:0/3899023289 shutdown_connections 2023-12-05T10:03:09.996 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.998+0000 7f46835f0700 1 --2- 172.21.15.100:0/3899023289 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f467c0fde00 0x7f467c0fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:09.996 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.998+0000 7f46835f0700 1 --2- 172.21.15.100:0/3899023289 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f467c0fcbf0 0x7f467c0fd000 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:09.996 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.998+0000 7f46835f0700 1 -- 172.21.15.100:0/3899023289 >> 172.21.15.100:0/3899023289 conn(0x7f467c0f82d0 msgr2=0x7f467c0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:03:09.996 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.998+0000 7f46835f0700 1 -- 172.21.15.100:0/3899023289 shutdown_connections 2023-12-05T10:03:09.996 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.998+0000 7f46835f0700 1 -- 172.21.15.100:0/3899023289 wait complete. 2023-12-05T10:03:09.998 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.999+0000 7f46835f0700 1 Processor -- start 2023-12-05T10:03:09.998 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.999+0000 7f46835f0700 1 -- start start 2023-12-05T10:03:09.998 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.999+0000 7f46835f0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f467c0fcbf0 0x7f467c10f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:03:09.998 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.999+0000 7f46835f0700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f467c0fde00 0x7f467c10fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:03:09.998 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.999+0000 7f46835f0700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467c110200 con 0x7f467c0fde00 2023-12-05T10:03:09.998 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.999+0000 7f46835f0700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467c110aa0 con 0x7f467c0fcbf0 2023-12-05T10:03:09.998 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.999+0000 7f4680b8b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f467c0fde00 0x7f467c10fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:03:09.998 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.999+0000 7f468138c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f467c0fcbf0 0x7f467c10f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:03:09.998 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.999+0000 7f4680b8b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f467c0fde00 0x7f467c10fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48420/0 (socket says 172.21.15.100:48420) 2023-12-05T10:03:09.998 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:09.999+0000 7f4680b8b700 1 -- 172.21.15.100:0/2569900826 learned_addr learned my addr 172.21.15.100:0/2569900826 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T10:03:09.998 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.000+0000 7f4680b8b700 1 -- 172.21.15.100:0/2569900826 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f467c0fcbf0 msgr2=0x7f467c10f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:03:09.998 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.000+0000 7f4680b8b700 1 --2- 172.21.15.100:0/2569900826 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f467c0fcbf0 0x7f467c10f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:09.999 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.000+0000 7f4680b8b700 1 -- 172.21.15.100:0/2569900826 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4678005040 con 0x7f467c0fde00 2023-12-05T10:03:09.999 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.000+0000 7f4680b8b700 1 --2- 172.21.15.100:0/2569900826 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f467c0fde00 0x7f467c10fc00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f466c00eb40 tx=0x7f466c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:03:09.999 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.000+0000 7f4671ffb700 1 -- 172.21.15.100:0/2569900826 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f466c007cc0 con 0x7f467c0fde00 2023-12-05T10:03:09.999 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.000+0000 7f4671ffb700 1 -- 172.21.15.100:0/2569900826 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f466c00f040 con 0x7f467c0fde00 2023-12-05T10:03:09.999 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.000+0000 7f46835f0700 1 -- 172.21.15.100:0/2569900826 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f467c110d20 con 0x7f467c0fde00 2023-12-05T10:03:09.999 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.000+0000 7f4671ffb700 1 -- 172.21.15.100:0/2569900826 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f466c00c990 con 0x7f467c0fde00 2023-12-05T10:03:09.999 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.000+0000 7f46835f0700 1 -- 172.21.15.100:0/2569900826 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f467c111260 con 0x7f467c0fde00 2023-12-05T10:03:09.999 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.002+0000 7f46835f0700 1 -- 172.21.15.100:0/2569900826 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f467c101ea0 con 0x7f467c0fde00 2023-12-05T10:03:10.000 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.003+0000 7f4671ffb700 1 -- 172.21.15.100:0/2569900826 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f466c00cc00 con 0x7f467c0fde00 2023-12-05T10:03:10.001 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.003+0000 7f4671ffb700 1 --2- 172.21.15.100:0/2569900826 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f466806ce70 0x7f466806f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:03:10.001 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.004+0000 7f4671ffb700 1 -- 172.21.15.100:0/2569900826 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6703+0+0 (secure 0 0 0) 0x7f466c08bff0 con 0x7f467c0fde00 2023-12-05T10:03:10.001 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.004+0000 7f468138c700 1 --2- 172.21.15.100:0/2569900826 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f466806ce70 0x7f466806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:03:10.002 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.004+0000 7f468138c700 1 --2- 172.21.15.100:0/2569900826 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f466806ce70 0x7f466806f320 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f467800b0d0 tx=0x7f4678009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:03:10.005 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.008+0000 7f4671ffb700 1 -- 172.21.15.100:0/2569900826 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f466c0598f0 con 0x7f467c0fde00 2023-12-05T10:03:10.230 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.233+0000 7f46835f0700 1 -- 172.21.15.100:0/2569900826 --> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f467c111480 con 0x7f466806ce70 2023-12-05T10:03:10.231 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.234+0000 7f4671ffb700 1 -- 172.21.15.100:0/2569900826 <== mgr.34104 v2:172.21.15.100:6800/3489431924 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f467c111480 con 0x7f466806ce70 2023-12-05T10:03:10.232 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2023-12-05T10:03:10.232 INFO:teuthology.orchestra.run.smithi100.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ff918c95653912ae4c171d8d1db5f5eabc756f85ff7e3ce78f13f9c521198459", 2023-12-05T10:03:10.232 INFO:teuthology.orchestra.run.smithi100.stdout: "in_progress": true, 2023-12-05T10:03:10.232 INFO:teuthology.orchestra.run.smithi100.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-05T10:03:10.232 INFO:teuthology.orchestra.run.smithi100.stdout: "services_complete": [ 2023-12-05T10:03:10.232 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr", 2023-12-05T10:03:10.232 INFO:teuthology.orchestra.run.smithi100.stdout: "crash", 2023-12-05T10:03:10.232 INFO:teuthology.orchestra.run.smithi100.stdout: "mon" 2023-12-05T10:03:10.232 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2023-12-05T10:03:10.232 INFO:teuthology.orchestra.run.smithi100.stdout: "progress": "11/21 daemons upgraded", 2023-12-05T10:03:10.232 INFO:teuthology.orchestra.run.smithi100.stdout: "message": "Currently upgrading osd daemons", 2023-12-05T10:03:10.232 INFO:teuthology.orchestra.run.smithi100.stdout: "is_paused": false 2023-12-05T10:03:10.233 INFO:teuthology.orchestra.run.smithi100.stdout:} 2023-12-05T10:03:10.234 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.236+0000 7f46835f0700 1 -- 172.21.15.100:0/2569900826 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f466806ce70 msgr2=0x7f466806f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:03:10.234 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.236+0000 7f46835f0700 1 --2- 172.21.15.100:0/2569900826 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f466806ce70 0x7f466806f320 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f467800b0d0 tx=0x7f4678009e30 comp rx=0 tx=0).stop 2023-12-05T10:03:10.234 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.236+0000 7f46835f0700 1 -- 172.21.15.100:0/2569900826 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f467c0fde00 msgr2=0x7f467c10fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:03:10.234 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.236+0000 7f46835f0700 1 --2- 172.21.15.100:0/2569900826 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f467c0fde00 0x7f467c10fc00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f466c00eb40 tx=0x7f466c00b040 comp rx=0 tx=0).stop 2023-12-05T10:03:10.234 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.236+0000 7f46835f0700 1 -- 172.21.15.100:0/2569900826 shutdown_connections 2023-12-05T10:03:10.234 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.236+0000 7f46835f0700 1 --2- 172.21.15.100:0/2569900826 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f466806ce70 0x7f466806f320 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:10.234 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.236+0000 7f46835f0700 1 --2- 172.21.15.100:0/2569900826 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f467c0fcbf0 0x7f467c10f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:10.234 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.236+0000 7f46835f0700 1 --2- 172.21.15.100:0/2569900826 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f467c0fde00 0x7f467c10fc00 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:10.234 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.236+0000 7f46835f0700 1 -- 172.21.15.100:0/2569900826 >> 172.21.15.100:0/2569900826 conn(0x7f467c0f82d0 msgr2=0x7f467c0ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:03:10.235 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.236+0000 7f46835f0700 1 -- 172.21.15.100:0/2569900826 shutdown_connections 2023-12-05T10:03:10.235 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.236+0000 7f46835f0700 1 -- 172.21.15.100:0/2569900826 wait complete. 2023-12-05T10:03:10.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:10 smithi150 ceph-mon[171606]: from='client.34344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T10:03:10.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:10 smithi150 ceph-mon[171606]: pgmap v158: 65 pgs: 65 active+clean; 195 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2023-12-05T10:03:10.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:10 smithi150 ceph-mon[171606]: Upgrade: Updating osd.5 2023-12-05T10:03:10.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:10 smithi150 ceph-mon[171606]: Deploying daemon osd.5 on smithi150 2023-12-05T10:03:10.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:10 smithi150 ceph-mon[171606]: from='client.34348 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T10:03:10.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:10 smithi150 ceph-mon[171606]: from='client.? 172.21.15.100:0/100173620' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T10:03:10.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:10 smithi150 ceph-mon[171606]: from='client.? 172.21.15.100:0/2847370593' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-05T10:03:10.369 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.371+0000 7fb5f4809700 1 -- 172.21.15.100:0/2508246663 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5f00fc9f0 msgr2=0x7fb5f00fce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:03:10.369 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.371+0000 7fb5f4809700 1 --2- 172.21.15.100:0/2508246663 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5f00fc9f0 0x7fb5f00fce00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0004940 tx=0x7fb5e0009e30 comp rx=0 tx=0).stop 2023-12-05T10:03:10.369 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.371+0000 7fb5f4809700 1 -- 172.21.15.100:0/2508246663 shutdown_connections 2023-12-05T10:03:10.369 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.371+0000 7fb5f4809700 1 --2- 172.21.15.100:0/2508246663 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb5f00fdc00 0x7fb5f00fe050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:10.369 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.371+0000 7fb5f4809700 1 --2- 172.21.15.100:0/2508246663 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5f00fc9f0 0x7fb5f00fce00 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:10.369 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.371+0000 7fb5f4809700 1 -- 172.21.15.100:0/2508246663 >> 172.21.15.100:0/2508246663 conn(0x7fb5f00f8090 msgr2=0x7fb5f00fa4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:03:10.370 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.371+0000 7fb5f4809700 1 -- 172.21.15.100:0/2508246663 shutdown_connections 2023-12-05T10:03:10.370 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.371+0000 7fb5f4809700 1 -- 172.21.15.100:0/2508246663 wait complete. 2023-12-05T10:03:10.371 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.372+0000 7fb5f4809700 1 Processor -- start 2023-12-05T10:03:10.371 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.372+0000 7fb5f4809700 1 -- start start 2023-12-05T10:03:10.371 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.372+0000 7fb5f4809700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb5f00fc9f0 0x7fb5f010f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:03:10.371 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.372+0000 7fb5f4809700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5f00fdc00 0x7fb5f010f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:03:10.371 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.372+0000 7fb5f4809700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f010ffb0 con 0x7fb5f00fdc00 2023-12-05T10:03:10.372 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.372+0000 7fb5f4809700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f0110850 con 0x7fb5f00fc9f0 2023-12-05T10:03:10.372 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.373+0000 7fb5ee59c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5f00fdc00 0x7fb5f010f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:03:10.372 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.373+0000 7fb5ee59c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5f00fdc00 0x7fb5f010f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48446/0 (socket says 172.21.15.100:48446) 2023-12-05T10:03:10.372 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.373+0000 7fb5ee59c700 1 -- 172.21.15.100:0/777941892 learned_addr learned my addr 172.21.15.100:0/777941892 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T10:03:10.372 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.373+0000 7fb5eed9d700 1 --2- 172.21.15.100:0/777941892 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb5f00fc9f0 0x7fb5f010f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:03:10.372 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.373+0000 7fb5ee59c700 1 -- 172.21.15.100:0/777941892 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb5f00fc9f0 msgr2=0x7fb5f010f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:03:10.372 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.373+0000 7fb5ee59c700 1 --2- 172.21.15.100:0/777941892 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb5f00fc9f0 0x7fb5f010f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:10.372 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.373+0000 7fb5ee59c700 1 -- 172.21.15.100:0/777941892 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5e0005040 con 0x7fb5f00fdc00 2023-12-05T10:03:10.372 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.373+0000 7fb5eed9d700 1 --2- 172.21.15.100:0/777941892 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb5f00fc9f0 0x7fb5f010f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-05T10:03:10.372 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.373+0000 7fb5ee59c700 1 --2- 172.21.15.100:0/777941892 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5f00fdc00 0x7fb5f010f9b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb5e4002a80 tx=0x7fb5e40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:03:10.372 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.373+0000 7fb5d77fe700 1 -- 172.21.15.100:0/777941892 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5e4007cc0 con 0x7fb5f00fdc00 2023-12-05T10:03:10.372 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.373+0000 7fb5d77fe700 1 -- 172.21.15.100:0/777941892 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb5e400f040 con 0x7fb5f00fdc00 2023-12-05T10:03:10.372 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.374+0000 7fb5f4809700 1 -- 172.21.15.100:0/777941892 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5f0110b30 con 0x7fb5f00fdc00 2023-12-05T10:03:10.372 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.374+0000 7fb5d77fe700 1 -- 172.21.15.100:0/777941892 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5e4009640 con 0x7fb5f00fdc00 2023-12-05T10:03:10.372 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.374+0000 7fb5f4809700 1 -- 172.21.15.100:0/777941892 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5f0111070 con 0x7fb5f00fdc00 2023-12-05T10:03:10.373 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.375+0000 7fb5f4809700 1 -- 172.21.15.100:0/777941892 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5f0101ca0 con 0x7fb5f00fdc00 2023-12-05T10:03:10.373 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.376+0000 7fb5d77fe700 1 -- 172.21.15.100:0/777941892 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fb5e40097a0 con 0x7fb5f00fdc00 2023-12-05T10:03:10.374 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.377+0000 7fb5d77fe700 1 --2- 172.21.15.100:0/777941892 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fb5d806ce70 0x7fb5d806f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:03:10.374 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.377+0000 7fb5d77fe700 1 -- 172.21.15.100:0/777941892 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6703+0+0 (secure 0 0 0) 0x7fb5e408bc70 con 0x7fb5f00fdc00 2023-12-05T10:03:10.374 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.377+0000 7fb5eed9d700 1 --2- 172.21.15.100:0/777941892 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fb5d806ce70 0x7fb5d806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:03:10.375 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.377+0000 7fb5eed9d700 1 --2- 172.21.15.100:0/777941892 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fb5d806ce70 0x7fb5d806f320 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0004f90 tx=0x7fb5e0009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:03:10.378 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.381+0000 7fb5d77fe700 1 -- 172.21.15.100:0/777941892 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fb5e4092080 con 0x7fb5f00fdc00 2023-12-05T10:03:10.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:10 smithi100 ceph-mon[187528]: from='client.34344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T10:03:10.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:10 smithi100 ceph-mon[187528]: pgmap v158: 65 pgs: 65 active+clean; 195 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2023-12-05T10:03:10.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:10 smithi100 ceph-mon[187528]: Upgrade: Updating osd.5 2023-12-05T10:03:10.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:10 smithi100 ceph-mon[187528]: Deploying daemon osd.5 on smithi150 2023-12-05T10:03:10.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:10 smithi100 ceph-mon[187528]: from='client.34348 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T10:03:10.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:10 smithi100 ceph-mon[187528]: from='client.? 172.21.15.100:0/100173620' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T10:03:10.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:10 smithi100 ceph-mon[187528]: from='client.? 172.21.15.100:0/2847370593' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-05T10:03:10.657 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.659+0000 7fb5f4809700 1 -- 172.21.15.100:0/777941892 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fb5f0105390 con 0x7fb5f00fdc00 2023-12-05T10:03:10.657 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.659+0000 7fb5d77fe700 1 -- 172.21.15.100:0/777941892 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fb5e4059420 con 0x7fb5f00fdc00 2023-12-05T10:03:10.657 INFO:teuthology.orchestra.run.smithi100.stdout:HEALTH_OK 2023-12-05T10:03:10.659 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.661+0000 7fb5f4809700 1 -- 172.21.15.100:0/777941892 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fb5d806ce70 msgr2=0x7fb5d806f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:03:10.659 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.661+0000 7fb5f4809700 1 --2- 172.21.15.100:0/777941892 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fb5d806ce70 0x7fb5d806f320 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0004f90 tx=0x7fb5e0009e30 comp rx=0 tx=0).stop 2023-12-05T10:03:10.660 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.661+0000 7fb5f4809700 1 -- 172.21.15.100:0/777941892 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5f00fdc00 msgr2=0x7fb5f010f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:03:10.660 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.661+0000 7fb5f4809700 1 --2- 172.21.15.100:0/777941892 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5f00fdc00 0x7fb5f010f9b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb5e4002a80 tx=0x7fb5e40046b0 comp rx=0 tx=0).stop 2023-12-05T10:03:10.660 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.662+0000 7fb5f4809700 1 -- 172.21.15.100:0/777941892 shutdown_connections 2023-12-05T10:03:10.660 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.662+0000 7fb5f4809700 1 --2- 172.21.15.100:0/777941892 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fb5d806ce70 0x7fb5d806f320 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:10.660 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.662+0000 7fb5f4809700 1 --2- 172.21.15.100:0/777941892 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb5f00fc9f0 0x7fb5f010f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:10.660 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.662+0000 7fb5f4809700 1 --2- 172.21.15.100:0/777941892 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5f00fdc00 0x7fb5f010f9b0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:10.660 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.662+0000 7fb5f4809700 1 -- 172.21.15.100:0/777941892 >> 172.21.15.100:0/777941892 conn(0x7fb5f00f8090 msgr2=0x7fb5f00fee20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:03:10.660 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.662+0000 7fb5f4809700 1 -- 172.21.15.100:0/777941892 shutdown_connections 2023-12-05T10:03:10.660 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:10.662+0000 7fb5f4809700 1 -- 172.21.15.100:0/777941892 wait complete. 2023-12-05T10:03:11.255 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:11 smithi150 ceph-mon[171606]: from='client.34360 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T10:03:11.255 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:11 smithi150 ceph-mon[171606]: from='client.? 172.21.15.100:0/777941892' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-05T10:03:11.255 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:11 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd rm-pg-upmap-items", "format": "json", "pgid": "2.4"}]: dispatch 2023-12-05T10:03:11.255 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:11 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:03:11.255 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:11 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T10:03:11.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:11 smithi100 ceph-mon[187528]: from='client.34360 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T10:03:11.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:11 smithi100 ceph-mon[187528]: from='client.? 172.21.15.100:0/777941892' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-05T10:03:11.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:11 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd rm-pg-upmap-items", "format": "json", "pgid": "2.4"}]: dispatch 2023-12-05T10:03:11.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:11 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:03:11.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:11 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T10:03:12.130 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:12 smithi150 ceph-mon[171606]: pgmap v159: 65 pgs: 65 active+clean; 195 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2023-12-05T10:03:12.131 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:12 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd='[{"prefix": "osd rm-pg-upmap-items", "format": "json", "pgid": "2.4"}]': finished 2023-12-05T10:03:12.131 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:12 smithi150 ceph-mon[171606]: osdmap e88: 6 total, 6 up, 6 in 2023-12-05T10:03:12.131 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:12 smithi150 ceph-mon[171606]: osdmap e89: 6 total, 6 up, 6 in 2023-12-05T10:03:12.131 INFO:journalctl@ceph.osd.5.smithi150.stdout:Dec 05 10:03:11 smithi150 systemd[1]: Stopping Ceph osd.5 for 5b035ce6-9353-11ee-95a2-87774f69a715... 2023-12-05T10:03:12.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:12 smithi100 ceph-mon[187528]: pgmap v159: 65 pgs: 65 active+clean; 195 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2023-12-05T10:03:12.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:12 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd='[{"prefix": "osd rm-pg-upmap-items", "format": "json", "pgid": "2.4"}]': finished 2023-12-05T10:03:12.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:12 smithi100 ceph-mon[187528]: osdmap e88: 6 total, 6 up, 6 in 2023-12-05T10:03:12.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:12 smithi100 ceph-mon[187528]: osdmap e89: 6 total, 6 up, 6 in 2023-12-05T10:03:12.595 INFO:journalctl@ceph.osd.5.smithi150.stdout:Dec 05 10:03:12 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-5[138231]: 2023-12-05T10:03:12.132+0000 7fa9b949b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-05T10:03:12.596 INFO:journalctl@ceph.osd.5.smithi150.stdout:Dec 05 10:03:12 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-5[138231]: 2023-12-05T10:03:12.132+0000 7fa9b949b700 -1 osd.5 89 *** Got signal Terminated *** 2023-12-05T10:03:12.596 INFO:journalctl@ceph.osd.5.smithi150.stdout:Dec 05 10:03:12 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-5[138231]: 2023-12-05T10:03:12.132+0000 7fa9b949b700 -1 osd.5 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-05T10:03:13.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:13 smithi150 ceph-mon[171606]: failed to encode map e88 with expected crc 2023-12-05T10:03:13.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:13 smithi150 ceph-mon[171606]: failed to encode map e89 with expected crc 2023-12-05T10:03:13.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:13 smithi150 ceph-mon[171606]: osd.5 marked itself down and dead 2023-12-05T10:03:13.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:13 smithi150 ceph-mon[171606]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-05T10:03:13.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:13 smithi150 ceph-mon[171606]: osdmap e90: 6 total, 5 up, 6 in 2023-12-05T10:03:13.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:13 smithi100 ceph-mon[187528]: failed to encode map e88 with expected crc 2023-12-05T10:03:13.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:13 smithi100 ceph-mon[187528]: failed to encode map e89 with expected crc 2023-12-05T10:03:13.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:13 smithi100 ceph-mon[187528]: osd.5 marked itself down and dead 2023-12-05T10:03:13.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:13 smithi100 ceph-mon[187528]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-05T10:03:13.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:13 smithi100 ceph-mon[187528]: osdmap e90: 6 total, 5 up, 6 in 2023-12-05T10:03:14.085 INFO:journalctl@ceph.osd.5.smithi150.stdout:Dec 05 10:03:13 smithi150 bash[195065]: ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-5 2023-12-05T10:03:14.345 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:14 smithi150 ceph-mon[171606]: pgmap v162: 65 pgs: 65 active+clean; 195 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2023-12-05T10:03:14.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:14 smithi150 ceph-mon[171606]: osdmap e91: 6 total, 5 up, 6 in 2023-12-05T10:03:14.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:14 smithi100 ceph-mon[187528]: pgmap v162: 65 pgs: 65 active+clean; 195 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2023-12-05T10:03:14.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:14 smithi100 ceph-mon[187528]: osdmap e91: 6 total, 5 up, 6 in 2023-12-05T10:03:15.561 INFO:journalctl@ceph.osd.5.smithi150.stdout:Dec 05 10:03:15 smithi150 systemd[1]: ceph-5b035ce6-9353-11ee-95a2-87774f69a715@osd.5.service: Succeeded. 2023-12-05T10:03:15.561 INFO:journalctl@ceph.osd.5.smithi150.stdout:Dec 05 10:03:15 smithi150 systemd[1]: Stopped Ceph osd.5 for 5b035ce6-9353-11ee-95a2-87774f69a715. 2023-12-05T10:03:15.845 INFO:journalctl@ceph.osd.5.smithi150.stdout:Dec 05 10:03:15 smithi150 systemd[1]: Starting Ceph osd.5 for 5b035ce6-9353-11ee-95a2-87774f69a715... 2023-12-05T10:03:16.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:16 smithi150 ceph-mon[171606]: pgmap v165: 65 pgs: 2 active+undersized+degraded, 10 stale+active+clean, 3 active+undersized, 50 active+clean; 195 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 5/216 objects degraded (2.315%) 2023-12-05T10:03:16.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:16 smithi150 ceph-mon[171606]: osdmap e92: 6 total, 5 up, 6 in 2023-12-05T10:03:16.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:16 smithi150 ceph-mon[171606]: Health check failed: Degraded data redundancy: 5/216 objects degraded (2.315%), 2 pgs degraded (PG_DEGRADED) 2023-12-05T10:03:16.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:16 smithi100 ceph-mon[187528]: pgmap v165: 65 pgs: 2 active+undersized+degraded, 10 stale+active+clean, 3 active+undersized, 50 active+clean; 195 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 5/216 objects degraded (2.315%) 2023-12-05T10:03:16.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:16 smithi100 ceph-mon[187528]: osdmap e92: 6 total, 5 up, 6 in 2023-12-05T10:03:16.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:16 smithi100 ceph-mon[187528]: Health check failed: Degraded data redundancy: 5/216 objects degraded (2.315%), 2 pgs degraded (PG_DEGRADED) 2023-12-05T10:03:17.096 INFO:journalctl@ceph.osd.5.smithi150.stdout:Dec 05 10:03:16 smithi150 bash[195337]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-12-05T10:03:17.096 INFO:journalctl@ceph.osd.5.smithi150.stdout:Dec 05 10:03:16 smithi150 bash[195337]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2023-12-05T10:03:17.096 INFO:journalctl@ceph.osd.5.smithi150.stdout:Dec 05 10:03:16 smithi150 bash[195337]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2023-12-05T10:03:17.096 INFO:journalctl@ceph.osd.5.smithi150.stdout:Dec 05 10:03:16 smithi150 bash[195337]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2023-12-05T10:03:17.096 INFO:journalctl@ceph.osd.5.smithi150.stdout:Dec 05 10:03:16 smithi150 bash[195337]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2023-12-05T10:03:17.096 INFO:journalctl@ceph.osd.5.smithi150.stdout:Dec 05 10:03:16 smithi150 bash[195337]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-12-05T10:03:17.097 INFO:journalctl@ceph.osd.5.smithi150.stdout:Dec 05 10:03:16 smithi150 bash[195337]: --> ceph-volume raw activate successful for osd ID: 5 2023-12-05T10:03:18.067 INFO:journalctl@ceph.osd.5.smithi150.stdout:Dec 05 10:03:17 smithi150 ceph-osd[195621]: -- 172.21.15.150:0/2422582398 <== mon.1 v2:172.21.15.150:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x563a4b1411e0 con 0x563a4b111000 2023-12-05T10:03:18.067 INFO:journalctl@ceph.osd.5.smithi150.stdout:Dec 05 10:03:17 smithi150 bash[195583]: f474c41b4d38ff47dcd1bf32833c79d4a13c87970ca1637633a1f412de5abded 2023-12-05T10:03:18.068 INFO:journalctl@ceph.osd.5.smithi150.stdout:Dec 05 10:03:17 smithi150 systemd[1]: Started Ceph osd.5 for 5b035ce6-9353-11ee-95a2-87774f69a715. 2023-12-05T10:03:18.345 INFO:journalctl@ceph.osd.5.smithi150.stdout:Dec 05 10:03:18 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-5[195598]: 2023-12-05T10:03:18.127+0000 7f416c77d640 -1 Falling back to public interface 2023-12-05T10:03:18.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:18 smithi150 ceph-mon[171606]: pgmap v167: 65 pgs: 1 peering, 9 active+undersized+degraded, 3 stale+active+clean, 14 active+undersized, 38 active+clean; 195 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 23/216 objects degraded (10.648%); 884 KiB/s, 0 objects/s recovering 2023-12-05T10:03:18.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:18 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:03:18.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:18 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:03:18.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:18 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T10:03:18.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:18 smithi100 ceph-mon[187528]: pgmap v167: 65 pgs: 1 peering, 9 active+undersized+degraded, 3 stale+active+clean, 14 active+undersized, 38 active+clean; 195 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 23/216 objects degraded (10.648%); 884 KiB/s, 0 objects/s recovering 2023-12-05T10:03:18.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:18 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:03:18.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:18 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:03:18.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:18 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T10:03:20.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:20 smithi150 ceph-mon[171606]: pgmap v168: 65 pgs: 1 peering, 12 active+undersized+degraded, 17 active+undersized, 35 active+clean; 195 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 29/216 objects degraded (13.426%); 682 KiB/s, 0 objects/s recovering 2023-12-05T10:03:20.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:20 smithi100 ceph-mon[187528]: pgmap v168: 65 pgs: 1 peering, 12 active+undersized+degraded, 17 active+undersized, 35 active+clean; 195 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 29/216 objects degraded (13.426%); 682 KiB/s, 0 objects/s recovering 2023-12-05T10:03:22.095 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:21 smithi150 ceph-mon[171606]: pgmap v169: 65 pgs: 12 active+undersized+degraded, 17 active+undersized, 36 active+clean; 195 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 29/216 objects degraded (13.426%); 537 KiB/s, 0 objects/s recovering 2023-12-05T10:03:22.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:21 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:03:22.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:21 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:03:22.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:21 smithi100 ceph-mon[187528]: pgmap v169: 65 pgs: 12 active+undersized+degraded, 17 active+undersized, 36 active+clean; 195 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 29/216 objects degraded (13.426%); 537 KiB/s, 0 objects/s recovering 2023-12-05T10:03:22.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:21 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:03:22.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:21 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:03:23.002 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:22 smithi150 ceph-mon[171606]: Health check update: Degraded data redundancy: 29/216 objects degraded (13.426%), 12 pgs degraded (PG_DEGRADED) 2023-12-05T10:03:23.002 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:22 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:03:23.002 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:22 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:03:23.003 INFO:journalctl@ceph.osd.5.smithi150.stdout:Dec 05 10:03:22 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-5[195598]: 2023-12-05T10:03:22.713+0000 7f416c77d640 -1 osd.5 0 read_superblock omap replica is missing. 2023-12-05T10:03:23.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:22 smithi100 ceph-mon[187528]: Health check update: Degraded data redundancy: 29/216 objects degraded (13.426%), 12 pgs degraded (PG_DEGRADED) 2023-12-05T10:03:23.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:22 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:03:23.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:22 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:03:23.595 INFO:journalctl@ceph.osd.5.smithi150.stdout:Dec 05 10:03:23 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-5[195598]: 2023-12-05T10:03:23.342+0000 7f416c77d640 -1 osd.5 89 log_to_monitors true 2023-12-05T10:03:24.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:24 smithi150 ceph-mon[171606]: pgmap v170: 65 pgs: 12 active+undersized+degraded, 17 active+undersized, 36 active+clean; 195 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 29/216 objects degraded (13.426%); 475 KiB/s, 0 objects/s recovering 2023-12-05T10:03:24.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:24 smithi150 ceph-mon[171606]: from='osd.5 [v2:172.21.15.150:6816/730066362,v1:172.21.15.150:6817/730066362]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-05T10:03:24.597 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:24 smithi150 ceph-mon[171606]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-05T10:03:24.597 INFO:journalctl@ceph.osd.5.smithi150.stdout:Dec 05 10:03:24 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-5[195598]: 2023-12-05T10:03:24.181+0000 7f415b3e9700 -1 osd.5 89 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-05T10:03:24.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:24 smithi100 ceph-mon[187528]: pgmap v170: 65 pgs: 12 active+undersized+degraded, 17 active+undersized, 36 active+clean; 195 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 29/216 objects degraded (13.426%); 475 KiB/s, 0 objects/s recovering 2023-12-05T10:03:24.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:24 smithi100 ceph-mon[187528]: from='osd.5 [v2:172.21.15.150:6816/730066362,v1:172.21.15.150:6817/730066362]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-05T10:03:24.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:24 smithi100 ceph-mon[187528]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-05T10:03:25.437 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:25 smithi150 ceph-mon[171606]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-12-05T10:03:25.437 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:25 smithi150 ceph-mon[171606]: osdmap e93: 6 total, 5 up, 6 in 2023-12-05T10:03:25.437 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:25 smithi150 ceph-mon[171606]: from='osd.5 [v2:172.21.15.150:6816/730066362,v1:172.21.15.150:6817/730066362]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2023-12-05T10:03:25.437 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:25 smithi150 ceph-mon[171606]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2023-12-05T10:03:25.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:25 smithi100 ceph-mon[187528]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-12-05T10:03:25.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:25 smithi100 ceph-mon[187528]: osdmap e93: 6 total, 5 up, 6 in 2023-12-05T10:03:25.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:25 smithi100 ceph-mon[187528]: from='osd.5 [v2:172.21.15.150:6816/730066362,v1:172.21.15.150:6817/730066362]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2023-12-05T10:03:25.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:25 smithi100 ceph-mon[187528]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2023-12-05T10:03:26.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:26 smithi150 ceph-mon[171606]: pgmap v172: 65 pgs: 12 active+undersized+degraded, 17 active+undersized, 36 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 29/216 objects degraded (13.426%) 2023-12-05T10:03:26.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:26 smithi150 ceph-mon[171606]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-05T10:03:26.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:26 smithi150 ceph-mon[171606]: osd.5 [v2:172.21.15.150:6816/730066362,v1:172.21.15.150:6817/730066362] boot 2023-12-05T10:03:26.597 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:26 smithi150 ceph-mon[171606]: osdmap e94: 6 total, 6 up, 6 in 2023-12-05T10:03:26.597 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:26 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-05T10:03:26.597 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:26 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:03:26.597 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:26 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:03:26.597 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:26 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T10:03:26.597 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:26 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T10:03:26.597 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:26 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:03:26.597 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:26 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:03:26.597 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:26 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T10:03:26.597 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:26 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T10:03:26.597 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:26 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T10:03:26.597 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:26 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T10:03:26.597 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:26 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T10:03:26.598 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:26 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T10:03:26.598 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:26 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:03:26.598 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:26 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2023-12-05T10:03:26.598 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:26 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2023-12-05T10:03:26.598 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:26 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2023-12-05T10:03:26.598 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:26 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2023-12-05T10:03:26.598 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:26 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2023-12-05T10:03:26.598 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:26 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2023-12-05T10:03:26.598 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:26 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2023-12-05T10:03:26.598 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:26 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2023-12-05T10:03:26.598 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:26 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2023-12-05T10:03:26.598 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:26 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:03:26.598 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:26 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2023-12-05T10:03:26.598 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:26 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2023-12-05T10:03:26.599 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:26 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2023-12-05T10:03:26.599 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:26 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd require-osd-release", "release": "unknown"}]: dispatch 2023-12-05T10:03:26.599 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:26 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:03:26.599 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:26 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T10:03:26.599 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:26 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T10:03:26.599 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:26 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T10:03:26.599 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:26 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:03:26.599 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:26 smithi150 ceph-mon[171606]: osdmap e95: 6 total, 6 up, 6 in 2023-12-05T10:03:26.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:26 smithi100 ceph-mon[187528]: pgmap v172: 65 pgs: 12 active+undersized+degraded, 17 active+undersized, 36 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 29/216 objects degraded (13.426%) 2023-12-05T10:03:26.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:26 smithi100 ceph-mon[187528]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-05T10:03:26.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:26 smithi100 ceph-mon[187528]: osd.5 [v2:172.21.15.150:6816/730066362,v1:172.21.15.150:6817/730066362] boot 2023-12-05T10:03:26.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:26 smithi100 ceph-mon[187528]: osdmap e94: 6 total, 6 up, 6 in 2023-12-05T10:03:26.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:26 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-05T10:03:26.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:26 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:03:26.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:26 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:03:26.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:26 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T10:03:26.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:26 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T10:03:26.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:26 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:03:26.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:26 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:03:26.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:26 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T10:03:26.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:26 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T10:03:26.647 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:26 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T10:03:26.647 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:26 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T10:03:26.647 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:26 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T10:03:26.647 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:26 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T10:03:26.647 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:26 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:03:26.647 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:26 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2023-12-05T10:03:26.647 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:26 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2023-12-05T10:03:26.647 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:26 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2023-12-05T10:03:26.647 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:26 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2023-12-05T10:03:26.647 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:26 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2023-12-05T10:03:26.647 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:26 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2023-12-05T10:03:26.647 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:26 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2023-12-05T10:03:26.647 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:26 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2023-12-05T10:03:26.647 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:26 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2023-12-05T10:03:26.647 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:26 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:03:26.647 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:26 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2023-12-05T10:03:26.647 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:26 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2023-12-05T10:03:26.648 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:26 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2023-12-05T10:03:26.648 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:26 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd require-osd-release", "release": "unknown"}]: dispatch 2023-12-05T10:03:26.648 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:26 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:03:26.648 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:26 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T10:03:26.648 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:26 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T10:03:26.648 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:26 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T10:03:26.648 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:26 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:03:26.648 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:26 smithi100 ceph-mon[187528]: osdmap e95: 6 total, 6 up, 6 in 2023-12-05T10:03:27.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:26 smithi100 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-mon-smithi100[187505]: 2023-12-05T10:03:26.831+0000 7f3d51dd8700 -1 log_channel(cluster) log [ERR] : Health check failed: Upgrade: failed due to an unexpected exception (UPGRADE_EXCEPTION) 2023-12-05T10:03:27.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:27 smithi150 ceph-mon[171606]: Upgrade: Setting container_image for all osd 2023-12-05T10:03:27.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:27 smithi150 ceph-mon[171606]: Upgrade: Setting require_osd_release to 19 unknown 2023-12-05T10:03:27.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:27 smithi150 ceph-mon[171606]: Upgrade: Paused due to UPGRADE_EXCEPTION: Upgrade: failed due to an unexpected exception 2023-12-05T10:03:27.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:27 smithi150 ceph-mon[171606]: pgmap v174: 65 pgs: 1 peering, 12 active+undersized+degraded, 16 active+undersized, 36 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 29/216 objects degraded (13.426%) 2023-12-05T10:03:27.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:27 smithi150 ceph-mon[171606]: Health check failed: Upgrade: failed due to an unexpected exception (UPGRADE_EXCEPTION) 2023-12-05T10:03:27.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:27 smithi100 ceph-mon[187528]: Upgrade: Setting container_image for all osd 2023-12-05T10:03:27.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:27 smithi100 ceph-mon[187528]: Upgrade: Setting require_osd_release to 19 unknown 2023-12-05T10:03:27.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:27 smithi100 ceph-mon[187528]: Upgrade: Paused due to UPGRADE_EXCEPTION: Upgrade: failed due to an unexpected exception 2023-12-05T10:03:27.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:27 smithi100 ceph-mon[187528]: pgmap v174: 65 pgs: 1 peering, 12 active+undersized+degraded, 16 active+undersized, 36 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 29/216 objects degraded (13.426%) 2023-12-05T10:03:27.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:27 smithi100 ceph-mon[187528]: Health check failed: Upgrade: failed due to an unexpected exception (UPGRADE_EXCEPTION) 2023-12-05T10:03:28.595 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:28 smithi150 ceph-mon[171606]: Health check update: Degraded data redundancy: 26/216 objects degraded (12.037%), 10 pgs degraded (PG_DEGRADED) 2023-12-05T10:03:28.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:28 smithi100 ceph-mon[187528]: Health check update: Degraded data redundancy: 26/216 objects degraded (12.037%), 10 pgs degraded (PG_DEGRADED) 2023-12-05T10:03:29.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:29 smithi150 ceph-mon[171606]: pgmap v176: 65 pgs: 1 peering, 10 active+undersized+degraded, 15 active+undersized, 39 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 26/216 objects degraded (12.037%) 2023-12-05T10:03:29.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:29 smithi100 ceph-mon[187528]: pgmap v176: 65 pgs: 1 peering, 10 active+undersized+degraded, 15 active+undersized, 39 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 26/216 objects degraded (12.037%) 2023-12-05T10:03:31.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:31 smithi100 ceph-mon[187528]: pgmap v177: 65 pgs: 1 peering, 1 active+undersized+degraded, 1 active+undersized, 62 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 1/216 objects degraded (0.463%) 2023-12-05T10:03:31.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:31 smithi150 ceph-mon[171606]: pgmap v177: 65 pgs: 1 peering, 1 active+undersized+degraded, 1 active+undersized, 62 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 1/216 objects degraded (0.463%) 2023-12-05T10:03:33.345 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:33 smithi150 ceph-mon[171606]: pgmap v178: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:03:33.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:33 smithi150 ceph-mon[171606]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/216 objects degraded (0.463%), 1 pg degraded) 2023-12-05T10:03:33.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:33 smithi100 ceph-mon[187528]: pgmap v178: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:03:33.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:33 smithi100 ceph-mon[187528]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/216 objects degraded (0.463%), 1 pg degraded) 2023-12-05T10:03:35.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:35 smithi150 ceph-mon[171606]: pgmap v179: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:03:35.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:35 smithi100 ceph-mon[187528]: pgmap v179: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:03:37.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:36 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:03:37.096 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:36 smithi150 ceph-mon[171606]: pgmap v180: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:03:37.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:36 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:03:37.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:36 smithi100 ceph-mon[187528]: pgmap v180: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:03:39.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:39 smithi150 ceph-mon[171606]: pgmap v181: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:03:39.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:39 smithi100 ceph-mon[187528]: pgmap v181: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:03:40.814 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:40.815+0000 7fe1fedda700 1 -- 172.21.15.100:0/2674159741 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1f8071bc0 msgr2=0x7fe1f8070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:03:40.814 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:40.815+0000 7fe1fedda700 1 --2- 172.21.15.100:0/2674159741 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1f8071bc0 0x7fe1f8070030 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec004940 tx=0x7fe1ec009e30 comp rx=0 tx=0).stop 2023-12-05T10:03:40.814 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:40.816+0000 7fe1fedda700 1 -- 172.21.15.100:0/2674159741 shutdown_connections 2023-12-05T10:03:40.814 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:40.816+0000 7fe1fedda700 1 --2- 172.21.15.100:0/2674159741 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1f8070570 0x7fe1f80709c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:40.814 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:40.816+0000 7fe1fedda700 1 --2- 172.21.15.100:0/2674159741 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1f8071bc0 0x7fe1f8070030 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:40.814 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:40.816+0000 7fe1fedda700 1 -- 172.21.15.100:0/2674159741 >> 172.21.15.100:0/2674159741 conn(0x7fe1f80f82d0 msgr2=0x7fe1f80fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:03:40.814 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:40.816+0000 7fe1fedda700 1 -- 172.21.15.100:0/2674159741 shutdown_connections 2023-12-05T10:03:40.814 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:40.816+0000 7fe1fedda700 1 -- 172.21.15.100:0/2674159741 wait complete. 2023-12-05T10:03:40.816 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:40.817+0000 7fe1fedda700 1 Processor -- start 2023-12-05T10:03:40.816 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:40.817+0000 7fe1fedda700 1 -- start start 2023-12-05T10:03:40.816 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:40.817+0000 7fe1fedda700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1f8070570 0x7fe1f810f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:03:40.816 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:40.817+0000 7fe1fedda700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1f8071bc0 0x7fe1f810fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:03:40.816 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:40.817+0000 7fe1fedda700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f8110420 con 0x7fe1f8070570 2023-12-05T10:03:40.816 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:40.817+0000 7fe1fedda700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f8110cc0 con 0x7fe1f8071bc0 2023-12-05T10:03:40.816 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:40.818+0000 7fe1fcb76700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1f8070570 0x7fe1f810f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:03:40.816 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:40.818+0000 7fe1fcb76700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1f8070570 0x7fe1f810f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36198/0 (socket says 172.21.15.100:36198) 2023-12-05T10:03:40.816 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:40.818+0000 7fe1fcb76700 1 -- 172.21.15.100:0/4283632141 learned_addr learned my addr 172.21.15.100:0/4283632141 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T10:03:40.816 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:40.818+0000 7fe1f7fff700 1 --2- 172.21.15.100:0/4283632141 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1f8071bc0 0x7fe1f810fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:03:40.816 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:40.818+0000 7fe1fcb76700 1 -- 172.21.15.100:0/4283632141 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1f8071bc0 msgr2=0x7fe1f810fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:03:40.816 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:40.818+0000 7fe1fcb76700 1 --2- 172.21.15.100:0/4283632141 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1f8071bc0 0x7fe1f810fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:40.817 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:40.818+0000 7fe1fcb76700 1 -- 172.21.15.100:0/4283632141 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1ec005040 con 0x7fe1f8070570 2023-12-05T10:03:40.817 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:40.818+0000 7fe1f7fff700 1 --2- 172.21.15.100:0/4283632141 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1f8071bc0 0x7fe1f810fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-05T10:03:40.817 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:40.818+0000 7fe1fcb76700 1 --2- 172.21.15.100:0/4283632141 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1f8070570 0x7fe1f810f8e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec009fd0 tx=0x7fe1ec009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:03:40.817 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:40.818+0000 7fe1f57fa700 1 -- 172.21.15.100:0/4283632141 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1ec00e040 con 0x7fe1f8070570 2023-12-05T10:03:40.817 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:40.819+0000 7fe1f57fa700 1 -- 172.21.15.100:0/4283632141 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe1ec004290 con 0x7fe1f8070570 2023-12-05T10:03:40.818 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:40.819+0000 7fe1f57fa700 1 -- 172.21.15.100:0/4283632141 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1ec01c630 con 0x7fe1f8070570 2023-12-05T10:03:40.818 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:40.819+0000 7fe1fedda700 1 -- 172.21.15.100:0/4283632141 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1f8110f40 con 0x7fe1f8070570 2023-12-05T10:03:40.818 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:40.819+0000 7fe1fedda700 1 -- 172.21.15.100:0/4283632141 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1f8111480 con 0x7fe1f8070570 2023-12-05T10:03:40.818 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:40.820+0000 7fe1fedda700 1 -- 172.21.15.100:0/4283632141 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1f81096f0 con 0x7fe1f8070570 2023-12-05T10:03:40.818 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:40.821+0000 7fe1f57fa700 1 -- 172.21.15.100:0/4283632141 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fe1ec00bc70 con 0x7fe1f8070570 2023-12-05T10:03:40.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:40.822+0000 7fe1f57fa700 1 --2- 172.21.15.100:0/4283632141 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fe1e806ce70 0x7fe1e806f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:03:40.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:40.822+0000 7fe1f57fa700 1 -- 172.21.15.100:0/4283632141 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6674+0+0 (secure 0 0 0) 0x7fe1ec08d8a0 con 0x7fe1f8070570 2023-12-05T10:03:40.820 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:40.823+0000 7fe1f7fff700 1 --2- 172.21.15.100:0/4283632141 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fe1e806ce70 0x7fe1e806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:03:40.821 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:40.823+0000 7fe1f7fff700 1 --2- 172.21.15.100:0/4283632141 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fe1e806ce70 0x7fe1e806f320 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe1e4009fd0 tx=0x7fe1e4009ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:03:40.825 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:40.827+0000 7fe1f57fa700 1 -- 172.21.15.100:0/4283632141 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fe1ec05b160 con 0x7fe1f8070570 2023-12-05T10:03:41.044 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:41.047+0000 7fe1fedda700 1 -- 172.21.15.100:0/4283632141 --> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe1f81116f0 con 0x7fe1e806ce70 2023-12-05T10:03:41.045 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:41.048+0000 7fe1f57fa700 1 -- 172.21.15.100:0/4283632141 <== mgr.34104 v2:172.21.15.100:6800/3489431924 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+456 (secure 0 0 0) 0x7fe1f81116f0 con 0x7fe1e806ce70 2023-12-05T10:03:41.048 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:41.050+0000 7fe1fedda700 1 -- 172.21.15.100:0/4283632141 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fe1e806ce70 msgr2=0x7fe1e806f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:03:41.048 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:41.050+0000 7fe1fedda700 1 --2- 172.21.15.100:0/4283632141 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fe1e806ce70 0x7fe1e806f320 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe1e4009fd0 tx=0x7fe1e4009ee0 comp rx=0 tx=0).stop 2023-12-05T10:03:41.048 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:41.050+0000 7fe1fedda700 1 -- 172.21.15.100:0/4283632141 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1f8070570 msgr2=0x7fe1f810f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:03:41.048 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:41.050+0000 7fe1fedda700 1 --2- 172.21.15.100:0/4283632141 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1f8070570 0x7fe1f810f8e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec009fd0 tx=0x7fe1ec009e30 comp rx=0 tx=0).stop 2023-12-05T10:03:41.049 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:41.051+0000 7fe1fedda700 1 -- 172.21.15.100:0/4283632141 shutdown_connections 2023-12-05T10:03:41.049 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:41.051+0000 7fe1fedda700 1 --2- 172.21.15.100:0/4283632141 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fe1e806ce70 0x7fe1e806f320 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:41.049 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:41.051+0000 7fe1fedda700 1 --2- 172.21.15.100:0/4283632141 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1f8070570 0x7fe1f810f8e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:41.049 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:41.051+0000 7fe1fedda700 1 --2- 172.21.15.100:0/4283632141 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1f8071bc0 0x7fe1f810fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:41.049 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:41.051+0000 7fe1fedda700 1 -- 172.21.15.100:0/4283632141 >> 172.21.15.100:0/4283632141 conn(0x7fe1f80f82d0 msgr2=0x7fe1f8103310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:03:41.049 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:41.051+0000 7fe1fedda700 1 -- 172.21.15.100:0/4283632141 shutdown_connections 2023-12-05T10:03:41.049 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:41.051+0000 7fe1fedda700 1 -- 172.21.15.100:0/4283632141 wait complete. 2023-12-05T10:03:41.063 INFO:teuthology.orchestra.run.smithi100.stdout:true 2023-12-05T10:03:41.185 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:41.187+0000 7fd81f005700 1 -- 172.21.15.100:0/3922631477 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd818071bc0 msgr2=0x7fd818070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:03:41.185 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:41.187+0000 7fd81f005700 1 --2- 172.21.15.100:0/3922631477 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd818071bc0 0x7fd818070030 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd80c004940 tx=0x7fd80c009e30 comp rx=0 tx=0).stop 2023-12-05T10:03:41.185 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:41.188+0000 7fd81f005700 1 -- 172.21.15.100:0/3922631477 shutdown_connections 2023-12-05T10:03:41.186 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:41.188+0000 7fd81f005700 1 --2- 172.21.15.100:0/3922631477 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd818070570 0x7fd8180709c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:41.186 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:41.188+0000 7fd81f005700 1 --2- 172.21.15.100:0/3922631477 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd818071bc0 0x7fd818070030 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:41.186 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:41.188+0000 7fd81f005700 1 -- 172.21.15.100:0/3922631477 >> 172.21.15.100:0/3922631477 conn(0x7fd8180f82d0 msgr2=0x7fd8180fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:03:41.186 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:41.188+0000 7fd81f005700 1 -- 172.21.15.100:0/3922631477 shutdown_connections 2023-12-05T10:03:41.186 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:41.188+0000 7fd81f005700 1 -- 172.21.15.100:0/3922631477 wait complete. 2023-12-05T10:03:41.187 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:41.188+0000 7fd81f005700 1 Processor -- start 2023-12-05T10:03:41.187 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:41.189+0000 7fd81f005700 1 -- start start 2023-12-05T10:03:41.187 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:41.189+0000 7fd81f005700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd818070570 0x7fd81810f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:03:41.187 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:41.189+0000 7fd81f005700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd818071bc0 0x7fd81810fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:03:41.187 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:41.189+0000 7fd81f005700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd818110420 con 0x7fd818071bc0 2023-12-05T10:03:41.187 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:41.189+0000 7fd81f005700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd818110cc0 con 0x7fd818070570 2023-12-05T10:03:41.187 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:41.189+0000 7fd817fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd818071bc0 0x7fd81810fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:03:41.187 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:41.189+0000 7fd817fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd818071bc0 0x7fd81810fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36210/0 (socket says 172.21.15.100:36210) 2023-12-05T10:03:41.188 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:41.189+0000 7fd817fff700 1 -- 172.21.15.100:0/4265163437 learned_addr learned my addr 172.21.15.100:0/4265163437 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T10:03:41.188 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:41.189+0000 7fd81cda1700 1 --2- 172.21.15.100:0/4265163437 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd818070570 0x7fd81810f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:03:41.188 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:41.190+0000 7fd817fff700 1 -- 172.21.15.100:0/4265163437 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd818070570 msgr2=0x7fd81810f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:03:41.188 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:41.190+0000 7fd817fff700 1 --2- 172.21.15.100:0/4265163437 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd818070570 0x7fd81810f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:41.188 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:41.190+0000 7fd817fff700 1 -- 172.21.15.100:0/4265163437 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd80c005040 con 0x7fd818071bc0 2023-12-05T10:03:41.188 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:41.190+0000 7fd817fff700 1 --2- 172.21.15.100:0/4265163437 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd818071bc0 0x7fd81810fe20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd804002a50 tx=0x7fd8040046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:03:41.189 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:41.190+0000 7fd8157fa700 1 -- 172.21.15.100:0/4265163437 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd804007cc0 con 0x7fd818071bc0 2023-12-05T10:03:41.189 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:41.190+0000 7fd8157fa700 1 -- 172.21.15.100:0/4265163437 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd80400f040 con 0x7fd818071bc0 2023-12-05T10:03:41.189 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:41.190+0000 7fd8157fa700 1 -- 172.21.15.100:0/4265163437 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd80400d9c0 con 0x7fd818071bc0 2023-12-05T10:03:41.189 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:41.190+0000 7fd81f005700 1 -- 172.21.15.100:0/4265163437 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd818110fa0 con 0x7fd818071bc0 2023-12-05T10:03:41.189 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:41.190+0000 7fd81f005700 1 -- 172.21.15.100:0/4265163437 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8181114e0 con 0x7fd818071bc0 2023-12-05T10:03:41.189 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:41.191+0000 7fd81f005700 1 -- 172.21.15.100:0/4265163437 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8181096f0 con 0x7fd818071bc0 2023-12-05T10:03:41.190 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:41.192+0000 7fd8157fa700 1 -- 172.21.15.100:0/4265163437 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fd80400db20 con 0x7fd818071bc0 2023-12-05T10:03:41.190 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:41.193+0000 7fd8157fa700 1 --2- 172.21.15.100:0/4265163437 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fd80806ce60 0x7fd80806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:03:41.190 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:41.193+0000 7fd8157fa700 1 -- 172.21.15.100:0/4265163437 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6674+0+0 (secure 0 0 0) 0x7fd80408c0c0 con 0x7fd818071bc0 2023-12-05T10:03:41.191 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:41.193+0000 7fd81cda1700 1 --2- 172.21.15.100:0/4265163437 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fd80806ce60 0x7fd80806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:03:41.191 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:41.194+0000 7fd81cda1700 1 --2- 172.21.15.100:0/4265163437 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fd80806ce60 0x7fd80806f310 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd80c004560 tx=0x7fd80c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:03:41.195 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:41.198+0000 7fd8157fa700 1 -- 172.21.15.100:0/4265163437 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fd804059900 con 0x7fd818071bc0 2023-12-05T10:03:41.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:41 smithi150 ceph-mon[171606]: pgmap v182: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:03:41.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:41 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:03:41.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:41 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T10:03:41.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:41 smithi100 ceph-mon[187528]: pgmap v182: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:03:41.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:41 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:03:41.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:41 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T10:03:41.415 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:41.417+0000 7fd81f005700 1 -- 172.21.15.100:0/4265163437 --> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd818111750 con 0x7fd80806ce60 2023-12-05T10:03:41.416 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:41.418+0000 7fd8157fa700 1 -- 172.21.15.100:0/4265163437 <== mgr.34104 v2:172.21.15.100:6800/3489431924 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+456 (secure 0 0 0) 0x7fd818111750 con 0x7fd80806ce60 2023-12-05T10:03:41.418 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:41.421+0000 7fd81f005700 1 -- 172.21.15.100:0/4265163437 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fd80806ce60 msgr2=0x7fd80806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:03:41.419 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:41.421+0000 7fd81f005700 1 --2- 172.21.15.100:0/4265163437 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fd80806ce60 0x7fd80806f310 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd80c004560 tx=0x7fd80c009e30 comp rx=0 tx=0).stop 2023-12-05T10:03:41.419 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:41.421+0000 7fd81f005700 1 -- 172.21.15.100:0/4265163437 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd818071bc0 msgr2=0x7fd81810fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:03:41.419 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:41.421+0000 7fd81f005700 1 --2- 172.21.15.100:0/4265163437 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd818071bc0 0x7fd81810fe20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd804002a50 tx=0x7fd8040046b0 comp rx=0 tx=0).stop 2023-12-05T10:03:41.419 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:41.421+0000 7fd81f005700 1 -- 172.21.15.100:0/4265163437 shutdown_connections 2023-12-05T10:03:41.419 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:41.421+0000 7fd81f005700 1 --2- 172.21.15.100:0/4265163437 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fd80806ce60 0x7fd80806f310 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:41.419 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:41.421+0000 7fd81f005700 1 --2- 172.21.15.100:0/4265163437 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd818070570 0x7fd81810f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:41.419 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:41.421+0000 7fd81f005700 1 --2- 172.21.15.100:0/4265163437 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd818071bc0 0x7fd81810fe20 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:41.419 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:41.421+0000 7fd81f005700 1 -- 172.21.15.100:0/4265163437 >> 172.21.15.100:0/4265163437 conn(0x7fd8180f82d0 msgr2=0x7fd818103310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:03:41.419 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:41.421+0000 7fd81f005700 1 -- 172.21.15.100:0/4265163437 shutdown_connections 2023-12-05T10:03:41.419 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:41.421+0000 7fd81f005700 1 -- 172.21.15.100:0/4265163437 wait complete. 2023-12-05T10:03:41.433 INFO:teuthology.orchestra.run.smithi100.stdout:"Error: UPGRADE_EXCEPTION: Upgrade: failed due to an unexpected exception" 2023-12-05T10:03:41.862 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -e sha1=3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 -- bash -c 'ceph orch ps' 2023-12-05T10:03:42.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:42 smithi100 ceph-mon[187528]: from='client.34372 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T10:03:42.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:42 smithi100 ceph-mon[187528]: from='client.34376 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T10:03:42.297 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi100/config 2023-12-05T10:03:42.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:42 smithi150 ceph-mon[171606]: from='client.34372 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T10:03:42.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:42 smithi150 ceph-mon[171606]: from='client.34376 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T10:03:43.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:43 smithi150 ceph-mon[171606]: pgmap v183: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:03:43.358 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:43 smithi100 ceph-mon[187528]: pgmap v183: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:03:43.554 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:43.556+0000 7fbee6dcd700 1 -- 172.21.15.100:0/3763882395 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbee01035a0 msgr2=0x7fbee00fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:03:43.555 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:43.556+0000 7fbee6dcd700 1 --2- 172.21.15.100:0/3763882395 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbee01035a0 0x7fbee00fcc10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbecc004940 tx=0x7fbecc009e30 comp rx=0 tx=0).stop 2023-12-05T10:03:43.555 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:43.557+0000 7fbee6dcd700 1 -- 172.21.15.100:0/3763882395 shutdown_connections 2023-12-05T10:03:43.555 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:43.557+0000 7fbee6dcd700 1 --2- 172.21.15.100:0/3763882395 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbee01035a0 0x7fbee00fcc10 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:43.555 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:43.557+0000 7fbee6dcd700 1 --2- 172.21.15.100:0/3763882395 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbee0102c00 0x7fbee0102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:43.555 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:43.557+0000 7fbee6dcd700 1 -- 172.21.15.100:0/3763882395 >> 172.21.15.100:0/3763882395 conn(0x7fbee00f8790 msgr2=0x7fbee00faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:03:43.555 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:43.557+0000 7fbee6dcd700 1 -- 172.21.15.100:0/3763882395 shutdown_connections 2023-12-05T10:03:43.555 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:43.557+0000 7fbee6dcd700 1 -- 172.21.15.100:0/3763882395 wait complete. 2023-12-05T10:03:43.556 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:43.558+0000 7fbee6dcd700 1 Processor -- start 2023-12-05T10:03:43.556 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:43.558+0000 7fbee6dcd700 1 -- start start 2023-12-05T10:03:43.556 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:43.558+0000 7fbee6dcd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbee0102c00 0x7fbee0115830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:03:43.556 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:43.558+0000 7fbee6dcd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbee01035a0 0x7fbee0115d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:03:43.556 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:43.558+0000 7fbee6dcd700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbee01163c0 con 0x7fbee01035a0 2023-12-05T10:03:43.557 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:43.558+0000 7fbee6dcd700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbee010f6f0 con 0x7fbee0102c00 2023-12-05T10:03:43.557 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:43.558+0000 7fbedffff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbee01035a0 0x7fbee0115d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:03:43.557 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:43.559+0000 7fbee4b69700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbee0102c00 0x7fbee0115830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:03:43.557 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:43.559+0000 7fbedffff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbee01035a0 0x7fbee0115d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36232/0 (socket says 172.21.15.100:36232) 2023-12-05T10:03:43.557 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:43.559+0000 7fbedffff700 1 -- 172.21.15.100:0/1574848001 learned_addr learned my addr 172.21.15.100:0/1574848001 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T10:03:43.557 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:43.559+0000 7fbedffff700 1 -- 172.21.15.100:0/1574848001 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbee0102c00 msgr2=0x7fbee0115830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:03:43.557 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:43.559+0000 7fbedffff700 1 --2- 172.21.15.100:0/1574848001 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbee0102c00 0x7fbee0115830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:43.557 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:43.559+0000 7fbedffff700 1 -- 172.21.15.100:0/1574848001 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbecc005040 con 0x7fbee01035a0 2023-12-05T10:03:43.558 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:43.559+0000 7fbedffff700 1 --2- 172.21.15.100:0/1574848001 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbee01035a0 0x7fbee0115d70 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbecc000c00 tx=0x7fbecc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:03:43.558 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:43.559+0000 7fbedd7fa700 1 -- 172.21.15.100:0/1574848001 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbecc00e040 con 0x7fbee01035a0 2023-12-05T10:03:43.558 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:43.559+0000 7fbedd7fa700 1 -- 172.21.15.100:0/1574848001 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbecc004290 con 0x7fbee01035a0 2023-12-05T10:03:43.558 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:43.559+0000 7fbee6dcd700 1 -- 172.21.15.100:0/1574848001 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbee010f970 con 0x7fbee01035a0 2023-12-05T10:03:43.558 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:43.559+0000 7fbedd7fa700 1 -- 172.21.15.100:0/1574848001 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbecc01c3f0 con 0x7fbee01035a0 2023-12-05T10:03:43.558 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:43.560+0000 7fbee6dcd700 1 -- 172.21.15.100:0/1574848001 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbee010feb0 con 0x7fbee01035a0 2023-12-05T10:03:43.558 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:43.561+0000 7fbee6dcd700 1 -- 172.21.15.100:0/1574848001 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbee00fc390 con 0x7fbee01035a0 2023-12-05T10:03:43.559 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:43.562+0000 7fbedd7fa700 1 -- 172.21.15.100:0/1574848001 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fbecc00bb80 con 0x7fbee01035a0 2023-12-05T10:03:43.560 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:43.562+0000 7fbedd7fa700 1 --2- 172.21.15.100:0/1574848001 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fbed006ce70 0x7fbed006f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:03:43.560 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:43.563+0000 7fbedd7fa700 1 -- 172.21.15.100:0/1574848001 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6674+0+0 (secure 0 0 0) 0x7fbecc08d5f0 con 0x7fbee01035a0 2023-12-05T10:03:43.560 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:43.563+0000 7fbee4b69700 1 --2- 172.21.15.100:0/1574848001 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fbed006ce70 0x7fbed006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:03:43.561 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:43.563+0000 7fbee4b69700 1 --2- 172.21.15.100:0/1574848001 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fbed006ce70 0x7fbed006f320 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbed4004f40 tx=0x7fbed400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:03:43.564 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:43.567+0000 7fbedd7fa700 1 -- 172.21.15.100:0/1574848001 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fbecc05af60 con 0x7fbee01035a0 2023-12-05T10:03:43.774 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:43.777+0000 7fbee6dcd700 1 -- 172.21.15.100:0/1574848001 --> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fbee004bb80 con 0x7fbed006ce70 2023-12-05T10:03:43.784 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:43.787+0000 7fbedd7fa700 1 -- 172.21.15.100:0/1574848001 <== mgr.34104 v2:172.21.15.100:6800/3489431924 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7fbee004bb80 con 0x7fbed006ce70 2023-12-05T10:03:43.784 INFO:teuthology.orchestra.run.smithi100.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-05T10:03:43.785 INFO:teuthology.orchestra.run.smithi100.stdout:alertmanager.smithi100 smithi100 *:9093,9094 running (6m) 2m ago 13m 14.7M - 0.25.0 c8568f914cd2 f443e6a4242b 2023-12-05T10:03:43.785 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi100 smithi100 running (3m) 2m ago 14m 7843k - 19.0.0-11-g3fe8d441 56dea28e5206 fb8e6b844fba 2023-12-05T10:03:43.785 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi150 smithi150 running (3m) 22s ago 13m 7847k - 19.0.0-11-g3fe8d441 56dea28e5206 a035052de6cf 2023-12-05T10:03:43.785 INFO:teuthology.orchestra.run.smithi100.stdout:grafana.smithi100 smithi100 *:3000 running (6m) 2m ago 13m 80.1M - 9.4.7 2c41d148cca3 d666da9c4e4d 2023-12-05T10:03:43.785 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.akmstb smithi100 running (9m) 2m ago 9m 10.5G - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 6ce55c42c55b 2023-12-05T10:03:43.785 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.sqplhn smithi100 running (9m) 2m ago 9m 15.9M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc c2682d65f0c9 2023-12-05T10:03:43.785 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi150.fcnhsv smithi150 running (9m) 22s ago 9m 16.0M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 1a259762235d 2023-12-05T10:03:43.785 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi150.pcbpxm smithi150 running (9m) 22s ago 9m 16.0M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 27f730f8b9f9 2023-12-05T10:03:43.785 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi100.ehmuhg smithi100 *:8443,9283,8765 running (5m) 2m ago 15m 516M - 19.0.0-11-g3fe8d441 56dea28e5206 ebe3dfbb0356 2023-12-05T10:03:43.785 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi150.zkskag smithi150 *:8443,9283,8765 running (5m) 22s ago 12m 453M - 19.0.0-11-g3fe8d441 56dea28e5206 a2b40e2421f2 2023-12-05T10:03:43.785 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi100 smithi100 running (4m) 2m ago 15m 70.8M 2048M 19.0.0-11-g3fe8d441 56dea28e5206 21003fd7eaf4 2023-12-05T10:03:43.785 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi150 smithi150 running (4m) 22s ago 12m 51.5M 2048M 19.0.0-11-g3fe8d441 56dea28e5206 010f2f658fca 2023-12-05T10:03:43.785 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi100 smithi100 *:9100 running (6m) 2m ago 13m 8288k - 1.5.0 0da6a335fe13 a2653da0d840 2023-12-05T10:03:43.785 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi150 smithi150 *:9100 running (6m) 22s ago 12m 8346k - 1.5.0 0da6a335fe13 67523645e73b 2023-12-05T10:03:43.786 INFO:teuthology.orchestra.run.smithi100.stdout:osd.0 smithi100 running (3m) 2m ago 12m 133M 1618M 19.0.0-11-g3fe8d441 56dea28e5206 a29add095f14 2023-12-05T10:03:43.786 INFO:teuthology.orchestra.run.smithi100.stdout:osd.1 smithi100 running (2m) 2m ago 11m 135M 1618M 19.0.0-11-g3fe8d441 56dea28e5206 2de00a9dc686 2023-12-05T10:03:43.786 INFO:teuthology.orchestra.run.smithi100.stdout:osd.2 smithi100 running (2m) 2m ago 11m 12.6M 1618M 19.0.0-11-g3fe8d441 56dea28e5206 fb6adf680449 2023-12-05T10:03:43.786 INFO:teuthology.orchestra.run.smithi100.stdout:osd.3 smithi150 running (91s) 22s ago 11m 203M 2642M 19.0.0-11-g3fe8d441 56dea28e5206 08545df235d8 2023-12-05T10:03:43.786 INFO:teuthology.orchestra.run.smithi100.stdout:osd.4 smithi150 running (59s) 22s ago 10m 129M 2642M 19.0.0-11-g3fe8d441 56dea28e5206 bcabd80780a8 2023-12-05T10:03:43.786 INFO:teuthology.orchestra.run.smithi100.stdout:osd.5 smithi150 running (26s) 22s ago 10m 12.6M 2642M 19.0.0-11-g3fe8d441 56dea28e5206 f474c41b4d38 2023-12-05T10:03:43.786 INFO:teuthology.orchestra.run.smithi100.stdout:prometheus.smithi100 smithi100 *:9095 running (5m) 2m ago 13m 59.7M - 2.43.0 a07b618ecd1d 8ade75deb316 2023-12-05T10:03:43.787 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:43.789+0000 7fbee6dcd700 1 -- 172.21.15.100:0/1574848001 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fbed006ce70 msgr2=0x7fbed006f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:03:43.787 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:43.789+0000 7fbee6dcd700 1 --2- 172.21.15.100:0/1574848001 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fbed006ce70 0x7fbed006f320 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbed4004f40 tx=0x7fbed400b040 comp rx=0 tx=0).stop 2023-12-05T10:03:43.787 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:43.789+0000 7fbee6dcd700 1 -- 172.21.15.100:0/1574848001 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbee01035a0 msgr2=0x7fbee0115d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:03:43.787 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:43.789+0000 7fbee6dcd700 1 --2- 172.21.15.100:0/1574848001 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbee01035a0 0x7fbee0115d70 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbecc000c00 tx=0x7fbecc009e30 comp rx=0 tx=0).stop 2023-12-05T10:03:43.787 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:43.789+0000 7fbee6dcd700 1 -- 172.21.15.100:0/1574848001 shutdown_connections 2023-12-05T10:03:43.787 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:43.789+0000 7fbee6dcd700 1 --2- 172.21.15.100:0/1574848001 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fbed006ce70 0x7fbed006f320 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:43.787 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:43.789+0000 7fbee6dcd700 1 --2- 172.21.15.100:0/1574848001 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbee0102c00 0x7fbee0115830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:43.787 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:43.789+0000 7fbee6dcd700 1 --2- 172.21.15.100:0/1574848001 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbee01035a0 0x7fbee0115d70 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:43.787 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:43.789+0000 7fbee6dcd700 1 -- 172.21.15.100:0/1574848001 >> 172.21.15.100:0/1574848001 conn(0x7fbee00f8790 msgr2=0x7fbee00fa1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:03:43.787 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:43.789+0000 7fbee6dcd700 1 -- 172.21.15.100:0/1574848001 shutdown_connections 2023-12-05T10:03:43.787 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:43.789+0000 7fbee6dcd700 1 -- 172.21.15.100:0/1574848001 wait complete. 2023-12-05T10:03:44.188 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -e sha1=3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 -- bash -c 'ceph orch upgrade status' 2023-12-05T10:03:44.616 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi100/config 2023-12-05T10:03:45.345 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:45 smithi150 ceph-mon[171606]: from='client.34380 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T10:03:45.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:45 smithi150 ceph-mon[171606]: pgmap v184: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:03:45.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:45 smithi100 ceph-mon[187528]: from='client.34380 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T10:03:45.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:45 smithi100 ceph-mon[187528]: pgmap v184: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:03:45.830 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:45.831+0000 7f78acc3b700 1 -- 172.21.15.100:0/2332997366 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78a80fca30 msgr2=0x7f78a80fcea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:03:45.830 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:45.831+0000 7f78acc3b700 1 --2- 172.21.15.100:0/2332997366 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78a80fca30 0x7f78a80fcea0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f789c004940 tx=0x7f789c009e30 comp rx=0 tx=0).stop 2023-12-05T10:03:45.830 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:45.831+0000 7f78acc3b700 1 -- 172.21.15.100:0/2332997366 shutdown_connections 2023-12-05T10:03:45.830 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:45.831+0000 7f78acc3b700 1 --2- 172.21.15.100:0/2332997366 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78a80fca30 0x7f78a80fcea0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:45.830 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:45.831+0000 7f78acc3b700 1 --2- 172.21.15.100:0/2332997366 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78a8102a70 0x7f78a8102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:45.830 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:45.831+0000 7f78acc3b700 1 -- 172.21.15.100:0/2332997366 >> 172.21.15.100:0/2332997366 conn(0x7f78a80f8590 msgr2=0x7f78a80fa9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:03:45.830 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:45.831+0000 7f78acc3b700 1 -- 172.21.15.100:0/2332997366 shutdown_connections 2023-12-05T10:03:45.830 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:45.831+0000 7f78acc3b700 1 -- 172.21.15.100:0/2332997366 wait complete. 2023-12-05T10:03:45.830 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:45.832+0000 7f78acc3b700 1 Processor -- start 2023-12-05T10:03:45.830 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:45.832+0000 7f78acc3b700 1 -- start start 2023-12-05T10:03:45.831 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:45.833+0000 7f78acc3b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78a80fca30 0x7f78a8115630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:03:45.832 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:45.833+0000 7f78acc3b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78a8102a70 0x7f78a8115bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:03:45.832 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:45.833+0000 7f78acc3b700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a8116200 con 0x7f78a80fca30 2023-12-05T10:03:45.832 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:45.833+0000 7f78acc3b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a810f4f0 con 0x7f78a8102a70 2023-12-05T10:03:45.832 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:45.833+0000 7f78a77fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78a80fca30 0x7f78a8115630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:03:45.832 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:45.833+0000 7f78a77fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78a80fca30 0x7f78a8115630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36240/0 (socket says 172.21.15.100:36240) 2023-12-05T10:03:45.832 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:45.833+0000 7f78a77fe700 1 -- 172.21.15.100:0/1813156502 learned_addr learned my addr 172.21.15.100:0/1813156502 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T10:03:45.832 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:45.833+0000 7f78a77fe700 1 -- 172.21.15.100:0/1813156502 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78a8102a70 msgr2=0x7f78a8115bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:03:45.832 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:45.833+0000 7f78a77fe700 1 --2- 172.21.15.100:0/1813156502 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78a8102a70 0x7f78a8115bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:45.832 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:45.833+0000 7f78a77fe700 1 -- 172.21.15.100:0/1813156502 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f789c005040 con 0x7f78a80fca30 2023-12-05T10:03:45.832 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:45.833+0000 7f78a77fe700 1 --2- 172.21.15.100:0/1813156502 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78a80fca30 0x7f78a8115630 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7898002a50 tx=0x7f78980046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:03:45.832 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:45.834+0000 7f788ffff700 1 -- 172.21.15.100:0/1813156502 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7898007cc0 con 0x7f78a80fca30 2023-12-05T10:03:45.832 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:45.834+0000 7f788ffff700 1 -- 172.21.15.100:0/1813156502 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f789800f040 con 0x7f78a80fca30 2023-12-05T10:03:45.832 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:45.834+0000 7f788ffff700 1 -- 172.21.15.100:0/1813156502 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7898009540 con 0x7f78a80fca30 2023-12-05T10:03:45.832 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:45.834+0000 7f78acc3b700 1 -- 172.21.15.100:0/1813156502 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78a810f780 con 0x7f78a80fca30 2023-12-05T10:03:45.833 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:45.834+0000 7f78acc3b700 1 -- 172.21.15.100:0/1813156502 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78a810fcc0 con 0x7f78a80fca30 2023-12-05T10:03:45.833 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:45.835+0000 7f78acc3b700 1 -- 172.21.15.100:0/1813156502 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78a805f270 con 0x7f78a80fca30 2023-12-05T10:03:45.833 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:45.836+0000 7f788ffff700 1 -- 172.21.15.100:0/1813156502 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f78980096a0 con 0x7f78a80fca30 2023-12-05T10:03:45.834 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:45.837+0000 7f788ffff700 1 --2- 172.21.15.100:0/1813156502 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f789006ce70 0x7f789006f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:03:45.834 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:45.837+0000 7f788ffff700 1 -- 172.21.15.100:0/1813156502 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6674+0+0 (secure 0 0 0) 0x7f789808be80 con 0x7f78a80fca30 2023-12-05T10:03:45.835 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:45.837+0000 7f78a6ffd700 1 --2- 172.21.15.100:0/1813156502 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f789006ce70 0x7f789006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:03:45.835 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:45.838+0000 7f78a6ffd700 1 --2- 172.21.15.100:0/1813156502 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f789006ce70 0x7f789006f320 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f789c004f90 tx=0x7f789c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:03:45.839 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:45.842+0000 7f788ffff700 1 -- 172.21.15.100:0/1813156502 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f7898059760 con 0x7f78a80fca30 2023-12-05T10:03:46.054 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:46.056+0000 7f78acc3b700 1 -- 172.21.15.100:0/1813156502 --> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f78a810ff30 con 0x7f789006ce70 2023-12-05T10:03:46.055 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:46.058+0000 7f788ffff700 1 -- 172.21.15.100:0/1813156502 <== mgr.34104 v2:172.21.15.100:6800/3489431924 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+456 (secure 0 0 0) 0x7f78a810ff30 con 0x7f789006ce70 2023-12-05T10:03:46.055 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2023-12-05T10:03:46.056 INFO:teuthology.orchestra.run.smithi100.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ff918c95653912ae4c171d8d1db5f5eabc756f85ff7e3ce78f13f9c521198459", 2023-12-05T10:03:46.056 INFO:teuthology.orchestra.run.smithi100.stdout: "in_progress": true, 2023-12-05T10:03:46.056 INFO:teuthology.orchestra.run.smithi100.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-05T10:03:46.056 INFO:teuthology.orchestra.run.smithi100.stdout: "services_complete": [ 2023-12-05T10:03:46.056 INFO:teuthology.orchestra.run.smithi100.stdout: "osd", 2023-12-05T10:03:46.056 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr", 2023-12-05T10:03:46.056 INFO:teuthology.orchestra.run.smithi100.stdout: "crash", 2023-12-05T10:03:46.056 INFO:teuthology.orchestra.run.smithi100.stdout: "mon" 2023-12-05T10:03:46.056 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2023-12-05T10:03:46.056 INFO:teuthology.orchestra.run.smithi100.stdout: "progress": "12/21 daemons upgraded", 2023-12-05T10:03:46.056 INFO:teuthology.orchestra.run.smithi100.stdout: "message": "Error: UPGRADE_EXCEPTION: Upgrade: failed due to an unexpected exception", 2023-12-05T10:03:46.056 INFO:teuthology.orchestra.run.smithi100.stdout: "is_paused": true 2023-12-05T10:03:46.056 INFO:teuthology.orchestra.run.smithi100.stdout:} 2023-12-05T10:03:46.058 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:46.060+0000 7f78acc3b700 1 -- 172.21.15.100:0/1813156502 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f789006ce70 msgr2=0x7f789006f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:03:46.058 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:46.060+0000 7f78acc3b700 1 --2- 172.21.15.100:0/1813156502 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f789006ce70 0x7f789006f320 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f789c004f90 tx=0x7f789c009e30 comp rx=0 tx=0).stop 2023-12-05T10:03:46.058 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:46.060+0000 7f78acc3b700 1 -- 172.21.15.100:0/1813156502 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78a80fca30 msgr2=0x7f78a8115630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:03:46.058 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:46.060+0000 7f78acc3b700 1 --2- 172.21.15.100:0/1813156502 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78a80fca30 0x7f78a8115630 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7898002a50 tx=0x7f78980046b0 comp rx=0 tx=0).stop 2023-12-05T10:03:46.059 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:46.060+0000 7f78acc3b700 1 -- 172.21.15.100:0/1813156502 shutdown_connections 2023-12-05T10:03:46.059 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:46.060+0000 7f78acc3b700 1 --2- 172.21.15.100:0/1813156502 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f789006ce70 0x7f789006f320 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:46.059 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:46.060+0000 7f78acc3b700 1 --2- 172.21.15.100:0/1813156502 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78a80fca30 0x7f78a8115630 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:46.059 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:46.060+0000 7f78acc3b700 1 --2- 172.21.15.100:0/1813156502 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78a8102a70 0x7f78a8115bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:46.059 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:46.060+0000 7f78acc3b700 1 -- 172.21.15.100:0/1813156502 >> 172.21.15.100:0/1813156502 conn(0x7f78a80f8590 msgr2=0x7f78a80f9f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:03:46.059 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:46.060+0000 7f78acc3b700 1 -- 172.21.15.100:0/1813156502 shutdown_connections 2023-12-05T10:03:46.059 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:46.061+0000 7f78acc3b700 1 -- 172.21.15.100:0/1813156502 wait complete. 2023-12-05T10:03:46.432 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -e sha1=3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 -- bash -c 'ceph health detail' 2023-12-05T10:03:46.863 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi100/config 2023-12-05T10:03:47.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:47 smithi150 ceph-mon[171606]: pgmap v185: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:03:47.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:47 smithi150 ceph-mon[171606]: from='client.34384 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T10:03:47.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:47 smithi100 ceph-mon[187528]: pgmap v185: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:03:47.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:47 smithi100 ceph-mon[187528]: from='client.34384 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T10:03:48.152 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:48.155+0000 7f1ba8949700 1 -- 172.21.15.100:0/1446568150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ba41035a0 msgr2=0x7f1ba40fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:03:48.153 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:48.155+0000 7f1ba8949700 1 --2- 172.21.15.100:0/1446568150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ba41035a0 0x7f1ba40fcc10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1b98004940 tx=0x7f1b98009e30 comp rx=0 tx=0).stop 2023-12-05T10:03:48.153 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:48.155+0000 7f1ba8949700 1 -- 172.21.15.100:0/1446568150 shutdown_connections 2023-12-05T10:03:48.153 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:48.155+0000 7f1ba8949700 1 --2- 172.21.15.100:0/1446568150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ba41035a0 0x7f1ba40fcc10 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:48.153 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:48.155+0000 7f1ba8949700 1 --2- 172.21.15.100:0/1446568150 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ba4102c00 0x7f1ba4102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:48.153 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:48.155+0000 7f1ba8949700 1 -- 172.21.15.100:0/1446568150 >> 172.21.15.100:0/1446568150 conn(0x7f1ba40f8790 msgr2=0x7f1ba40faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:03:48.153 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:48.155+0000 7f1ba8949700 1 -- 172.21.15.100:0/1446568150 shutdown_connections 2023-12-05T10:03:48.153 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:48.155+0000 7f1ba8949700 1 -- 172.21.15.100:0/1446568150 wait complete. 2023-12-05T10:03:48.155 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:48.156+0000 7f1ba8949700 1 Processor -- start 2023-12-05T10:03:48.155 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:48.156+0000 7f1ba8949700 1 -- start start 2023-12-05T10:03:48.155 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:48.156+0000 7f1ba8949700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ba4102c00 0x7f1ba4115830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:03:48.155 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:48.156+0000 7f1ba8949700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ba41035a0 0x7f1ba4115d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:03:48.155 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:48.156+0000 7f1ba8949700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba41163c0 con 0x7f1ba41035a0 2023-12-05T10:03:48.155 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:48.156+0000 7f1ba8949700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba410f6f0 con 0x7f1ba4102c00 2023-12-05T10:03:48.155 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:48.156+0000 7f1ba1d9b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ba41035a0 0x7f1ba4115d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:03:48.155 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:48.156+0000 7f1ba1d9b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ba41035a0 0x7f1ba4115d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36254/0 (socket says 172.21.15.100:36254) 2023-12-05T10:03:48.155 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:48.156+0000 7f1ba1d9b700 1 -- 172.21.15.100:0/1125692078 learned_addr learned my addr 172.21.15.100:0/1125692078 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T10:03:48.156 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:48.157+0000 7f1ba259c700 1 --2- 172.21.15.100:0/1125692078 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ba4102c00 0x7f1ba4115830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:03:48.156 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:48.157+0000 7f1ba1d9b700 1 -- 172.21.15.100:0/1125692078 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ba4102c00 msgr2=0x7f1ba4115830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:03:48.156 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:48.157+0000 7f1ba1d9b700 1 --2- 172.21.15.100:0/1125692078 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ba4102c00 0x7f1ba4115830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:48.156 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:48.157+0000 7f1ba1d9b700 1 -- 172.21.15.100:0/1125692078 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b98005040 con 0x7f1ba41035a0 2023-12-05T10:03:48.156 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:48.157+0000 7f1ba1d9b700 1 --2- 172.21.15.100:0/1125692078 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ba41035a0 0x7f1ba4115d70 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1b98009180 tx=0x7f1b98009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:03:48.156 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:48.157+0000 7f1b92ffd700 1 -- 172.21.15.100:0/1125692078 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b9800e040 con 0x7f1ba41035a0 2023-12-05T10:03:48.156 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:48.157+0000 7f1b92ffd700 1 -- 172.21.15.100:0/1125692078 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1b98004290 con 0x7f1ba41035a0 2023-12-05T10:03:48.156 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:48.157+0000 7f1b92ffd700 1 -- 172.21.15.100:0/1125692078 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b9801c3f0 con 0x7f1ba41035a0 2023-12-05T10:03:48.156 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:48.157+0000 7f1ba8949700 1 -- 172.21.15.100:0/1125692078 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ba410f970 con 0x7f1ba41035a0 2023-12-05T10:03:48.157 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:48.158+0000 7f1ba8949700 1 -- 172.21.15.100:0/1125692078 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ba410feb0 con 0x7f1ba41035a0 2023-12-05T10:03:48.157 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:48.159+0000 7f1ba8949700 1 -- 172.21.15.100:0/1125692078 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ba40fc390 con 0x7f1ba41035a0 2023-12-05T10:03:48.157 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:48.159+0000 7f1b92ffd700 1 -- 172.21.15.100:0/1125692078 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f1b98013770 con 0x7f1ba41035a0 2023-12-05T10:03:48.158 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:48.160+0000 7f1b92ffd700 1 --2- 172.21.15.100:0/1125692078 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f1b8c06ce70 0x7f1b8c06f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:03:48.158 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:48.160+0000 7f1b92ffd700 1 -- 172.21.15.100:0/1125692078 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6674+0+0 (secure 0 0 0) 0x7f1b9808d730 con 0x7f1ba41035a0 2023-12-05T10:03:48.158 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:48.161+0000 7f1ba259c700 1 --2- 172.21.15.100:0/1125692078 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f1b8c06ce70 0x7f1b8c06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:03:48.159 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:48.161+0000 7f1ba259c700 1 --2- 172.21.15.100:0/1125692078 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f1b8c06ce70 0x7f1b8c06f320 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1b94004f40 tx=0x7f1b9400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:03:48.163 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:48.165+0000 7f1b92ffd700 1 -- 172.21.15.100:0/1125692078 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f1b9805b020 con 0x7f1ba41035a0 2023-12-05T10:03:48.441 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:48.443+0000 7f1ba8949700 1 -- 172.21.15.100:0/1125692078 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f1ba404bb80 con 0x7f1ba41035a0 2023-12-05T10:03:48.442 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:48.444+0000 7f1b92ffd700 1 -- 172.21.15.100:0/1125692078 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+261 (secure 0 0 0) 0x7f1b98055e60 con 0x7f1ba41035a0 2023-12-05T10:03:48.442 INFO:teuthology.orchestra.run.smithi100.stdout:HEALTH_ERR Upgrade: failed due to an unexpected exception 2023-12-05T10:03:48.442 INFO:teuthology.orchestra.run.smithi100.stdout:[ERR] UPGRADE_EXCEPTION: Upgrade: failed due to an unexpected exception 2023-12-05T10:03:48.442 INFO:teuthology.orchestra.run.smithi100.stdout: Unexpected exception occurred during upgrade process: osd require-osd-release failed: unrecognized release unknown retval: -22 2023-12-05T10:03:48.444 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:48.446+0000 7f1ba8949700 1 -- 172.21.15.100:0/1125692078 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f1b8c06ce70 msgr2=0x7f1b8c06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:03:48.444 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:48.446+0000 7f1ba8949700 1 --2- 172.21.15.100:0/1125692078 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f1b8c06ce70 0x7f1b8c06f320 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1b94004f40 tx=0x7f1b9400b040 comp rx=0 tx=0).stop 2023-12-05T10:03:48.444 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:48.446+0000 7f1ba8949700 1 -- 172.21.15.100:0/1125692078 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ba41035a0 msgr2=0x7f1ba4115d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:03:48.444 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:48.446+0000 7f1ba8949700 1 --2- 172.21.15.100:0/1125692078 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ba41035a0 0x7f1ba4115d70 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1b98009180 tx=0x7f1b98009e30 comp rx=0 tx=0).stop 2023-12-05T10:03:48.444 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:48.446+0000 7f1ba8949700 1 -- 172.21.15.100:0/1125692078 shutdown_connections 2023-12-05T10:03:48.444 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:48.446+0000 7f1ba8949700 1 --2- 172.21.15.100:0/1125692078 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f1b8c06ce70 0x7f1b8c06f320 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:48.444 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:48.446+0000 7f1ba8949700 1 --2- 172.21.15.100:0/1125692078 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ba4102c00 0x7f1ba4115830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:48.444 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:48.446+0000 7f1ba8949700 1 --2- 172.21.15.100:0/1125692078 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ba41035a0 0x7f1ba4115d70 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:48.444 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:48.446+0000 7f1ba8949700 1 -- 172.21.15.100:0/1125692078 >> 172.21.15.100:0/1125692078 conn(0x7f1ba40f8790 msgr2=0x7f1ba40fa1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:03:48.444 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:48.446+0000 7f1ba8949700 1 -- 172.21.15.100:0/1125692078 shutdown_connections 2023-12-05T10:03:48.444 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:48.446+0000 7f1ba8949700 1 -- 172.21.15.100:0/1125692078 wait complete. 2023-12-05T10:03:48.889 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -e sha1=3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 -- bash -c 'ceph versions' 2023-12-05T10:03:49.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:49 smithi100 ceph-mon[187528]: pgmap v186: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:03:49.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:49 smithi100 ceph-mon[187528]: from='client.? 172.21.15.100:0/1125692078' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-05T10:03:49.316 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi100/config 2023-12-05T10:03:49.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:49 smithi150 ceph-mon[171606]: pgmap v186: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:03:49.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:49 smithi150 ceph-mon[171606]: from='client.? 172.21.15.100:0/1125692078' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-05T10:03:50.584 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:50.586+0000 7fa2b8130700 1 -- 172.21.15.100:0/910903861 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2b0102c00 msgr2=0x7fa2b0102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:03:50.585 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:50.586+0000 7fa2b8130700 1 --2- 172.21.15.100:0/910903861 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2b0102c00 0x7fa2b0102fd0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac004940 tx=0x7fa2ac009e30 comp rx=0 tx=0).stop 2023-12-05T10:03:50.585 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:50.586+0000 7fa2b8130700 1 -- 172.21.15.100:0/910903861 shutdown_connections 2023-12-05T10:03:50.585 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:50.586+0000 7fa2b8130700 1 --2- 172.21.15.100:0/910903861 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2b01035a0 0x7fa2b00fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:50.585 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:50.586+0000 7fa2b8130700 1 --2- 172.21.15.100:0/910903861 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2b0102c00 0x7fa2b0102fd0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:50.585 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:50.586+0000 7fa2b8130700 1 -- 172.21.15.100:0/910903861 >> 172.21.15.100:0/910903861 conn(0x7fa2b00f8790 msgr2=0x7fa2b00faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:03:50.585 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:50.587+0000 7fa2b8130700 1 -- 172.21.15.100:0/910903861 shutdown_connections 2023-12-05T10:03:50.585 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:50.587+0000 7fa2b8130700 1 -- 172.21.15.100:0/910903861 wait complete. 2023-12-05T10:03:50.585 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:50.588+0000 7fa2b8130700 1 Processor -- start 2023-12-05T10:03:50.586 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:50.588+0000 7fa2b8130700 1 -- start start 2023-12-05T10:03:50.587 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:50.588+0000 7fa2b8130700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2b0102c00 0x7fa2b006ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:03:50.587 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:50.588+0000 7fa2b8130700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2b01035a0 0x7fa2b0070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:03:50.587 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:50.588+0000 7fa2b8130700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b0070a80 con 0x7fa2b0102c00 2023-12-05T10:03:50.587 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:50.588+0000 7fa2b8130700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b0070bf0 con 0x7fa2b01035a0 2023-12-05T10:03:50.587 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:50.589+0000 7fa2b5ecc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2b0102c00 0x7fa2b006ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:03:50.587 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:50.589+0000 7fa2b5ecc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2b0102c00 0x7fa2b006ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37038/0 (socket says 172.21.15.100:37038) 2023-12-05T10:03:50.588 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:50.589+0000 7fa2b5ecc700 1 -- 172.21.15.100:0/1720414115 learned_addr learned my addr 172.21.15.100:0/1720414115 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T10:03:50.588 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:50.589+0000 7fa2b56cb700 1 --2- 172.21.15.100:0/1720414115 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2b01035a0 0x7fa2b0070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:03:50.588 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:50.589+0000 7fa2b5ecc700 1 -- 172.21.15.100:0/1720414115 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2b01035a0 msgr2=0x7fa2b0070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:03:50.588 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:50.589+0000 7fa2b5ecc700 1 --2- 172.21.15.100:0/1720414115 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2b01035a0 0x7fa2b0070480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:50.588 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:50.589+0000 7fa2b5ecc700 1 -- 172.21.15.100:0/1720414115 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2ac005040 con 0x7fa2b0102c00 2023-12-05T10:03:50.588 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:50.589+0000 7fa2b56cb700 1 --2- 172.21.15.100:0/1720414115 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2b01035a0 0x7fa2b0070480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-05T10:03:50.588 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:50.589+0000 7fa2b5ecc700 1 --2- 172.21.15.100:0/1720414115 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2b0102c00 0x7fa2b006ff40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac009fd0 tx=0x7fa2ac009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:03:50.588 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:50.589+0000 7fa2a67fc700 1 -- 172.21.15.100:0/1720414115 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2ac00e040 con 0x7fa2b0102c00 2023-12-05T10:03:50.588 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:50.590+0000 7fa2a67fc700 1 -- 172.21.15.100:0/1720414115 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa2ac00bc50 con 0x7fa2b0102c00 2023-12-05T10:03:50.589 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:50.590+0000 7fa2b8130700 1 -- 172.21.15.100:0/1720414115 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2b0119850 con 0x7fa2b0102c00 2023-12-05T10:03:50.589 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:50.590+0000 7fa2a67fc700 1 -- 172.21.15.100:0/1720414115 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2ac013ea0 con 0x7fa2b0102c00 2023-12-05T10:03:50.589 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:50.590+0000 7fa2b8130700 1 -- 172.21.15.100:0/1720414115 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2b0119cb0 con 0x7fa2b0102c00 2023-12-05T10:03:50.589 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:50.591+0000 7fa2b8130700 1 -- 172.21.15.100:0/1720414115 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2b00fff10 con 0x7fa2b0102c00 2023-12-05T10:03:50.589 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:50.592+0000 7fa2a67fc700 1 -- 172.21.15.100:0/1720414115 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fa2ac013420 con 0x7fa2b0102c00 2023-12-05T10:03:50.591 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:50.593+0000 7fa2a67fc700 1 --2- 172.21.15.100:0/1720414115 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fa29c06ce70 0x7fa29c06f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:03:50.591 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:50.593+0000 7fa2a67fc700 1 -- 172.21.15.100:0/1720414115 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6674+0+0 (secure 0 0 0) 0x7fa2ac08d960 con 0x7fa2b0102c00 2023-12-05T10:03:50.591 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:50.593+0000 7fa2b56cb700 1 --2- 172.21.15.100:0/1720414115 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fa29c06ce70 0x7fa29c06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:03:50.591 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:50.593+0000 7fa2b56cb700 1 --2- 172.21.15.100:0/1720414115 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fa29c06ce70 0x7fa29c06f320 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa2a0009fd0 tx=0x7fa2a000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:03:50.594 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:50.597+0000 7fa2a67fc700 1 -- 172.21.15.100:0/1720414115 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fa2ac057710 con 0x7fa2b0102c00 2023-12-05T10:03:50.879 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:50.881+0000 7fa2b8130700 1 -- 172.21.15.100:0/1720414115 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa2b0071680 con 0x7fa2b0102c00 2023-12-05T10:03:50.879 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:50.881+0000 7fa2a67fc700 1 -- 172.21.15.100:0/1720414115 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+721 (secure 0 0 0) 0x7fa2ac05ad30 con 0x7fa2b0102c00 2023-12-05T10:03:50.879 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2023-12-05T10:03:50.879 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": { 2023-12-05T10:03:50.880 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 2 2023-12-05T10:03:50.880 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-12-05T10:03:50.880 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": { 2023-12-05T10:03:50.880 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 2 2023-12-05T10:03:50.880 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-12-05T10:03:50.880 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": { 2023-12-05T10:03:50.880 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 6 2023-12-05T10:03:50.880 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-12-05T10:03:50.880 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": { 2023-12-05T10:03:50.880 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 4 2023-12-05T10:03:50.880 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-12-05T10:03:50.880 INFO:teuthology.orchestra.run.smithi100.stdout: "overall": { 2023-12-05T10:03:50.880 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 4, 2023-12-05T10:03:50.880 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 10 2023-12-05T10:03:50.880 INFO:teuthology.orchestra.run.smithi100.stdout: } 2023-12-05T10:03:50.881 INFO:teuthology.orchestra.run.smithi100.stdout:} 2023-12-05T10:03:50.882 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:50.884+0000 7fa2b8130700 1 -- 172.21.15.100:0/1720414115 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fa29c06ce70 msgr2=0x7fa29c06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:03:50.882 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:50.884+0000 7fa2b8130700 1 --2- 172.21.15.100:0/1720414115 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fa29c06ce70 0x7fa29c06f320 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa2a0009fd0 tx=0x7fa2a000b040 comp rx=0 tx=0).stop 2023-12-05T10:03:50.882 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:50.884+0000 7fa2b8130700 1 -- 172.21.15.100:0/1720414115 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2b0102c00 msgr2=0x7fa2b006ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:03:50.882 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:50.884+0000 7fa2b8130700 1 --2- 172.21.15.100:0/1720414115 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2b0102c00 0x7fa2b006ff40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac009fd0 tx=0x7fa2ac009e30 comp rx=0 tx=0).stop 2023-12-05T10:03:50.882 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:50.884+0000 7fa2b8130700 1 -- 172.21.15.100:0/1720414115 shutdown_connections 2023-12-05T10:03:50.882 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:50.884+0000 7fa2b8130700 1 --2- 172.21.15.100:0/1720414115 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fa29c06ce70 0x7fa29c06f320 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:50.882 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:50.884+0000 7fa2b8130700 1 --2- 172.21.15.100:0/1720414115 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2b0102c00 0x7fa2b006ff40 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:50.882 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:50.884+0000 7fa2b8130700 1 --2- 172.21.15.100:0/1720414115 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2b01035a0 0x7fa2b0070480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:03:50.882 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:50.884+0000 7fa2b8130700 1 -- 172.21.15.100:0/1720414115 >> 172.21.15.100:0/1720414115 conn(0x7fa2b00f8790 msgr2=0x7fa2b00fa2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:03:50.882 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:50.884+0000 7fa2b8130700 1 -- 172.21.15.100:0/1720414115 shutdown_connections 2023-12-05T10:03:50.882 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:03:50.884+0000 7fa2b8130700 1 -- 172.21.15.100:0/1720414115 wait complete. 2023-12-05T10:03:51.228 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:51 smithi100 ceph-mon[187528]: pgmap v187: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:03:51.229 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:51 smithi100 ceph-mon[187528]: from='client.? 172.21.15.100:0/1720414115' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T10:03:51.256 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -e sha1=3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2023-12-05T10:03:51.345 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:51 smithi150 ceph-mon[171606]: pgmap v187: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:03:51.346 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:51 smithi150 ceph-mon[171606]: from='client.? 172.21.15.100:0/1720414115' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T10:03:51.685 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi100/config 2023-12-05T10:03:52.767 INFO:teuthology.orchestra.run.smithi100.stdout:wait for servicemap items w/ changing names to refresh 2023-12-05T10:03:53.224 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:53 smithi100 ceph-mon[187528]: pgmap v188: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:03:53.227 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -e sha1=3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 -- bash -c 'sleep 60' 2023-12-05T10:03:53.345 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:53 smithi150 ceph-mon[171606]: pgmap v188: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:03:53.655 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi100/config 2023-12-05T10:03:55.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:55 smithi100 ceph-mon[187528]: pgmap v189: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:03:55.595 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:55 smithi150 ceph-mon[171606]: pgmap v189: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:03:56.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:56 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T10:03:56.595 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:56 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T10:03:57.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:57 smithi100 ceph-mon[187528]: pgmap v190: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:03:57.595 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:57 smithi150 ceph-mon[171606]: pgmap v190: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:03:59.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:03:59 smithi100 ceph-mon[187528]: pgmap v191: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:03:59.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:03:59 smithi150 ceph-mon[171606]: pgmap v191: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:04:01.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:04:01 smithi100 ceph-mon[187528]: pgmap v192: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:04:01.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:04:01 smithi150 ceph-mon[171606]: pgmap v192: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:04:03.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:04:03 smithi100 ceph-mon[187528]: pgmap v193: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:04:03.595 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:04:03 smithi150 ceph-mon[171606]: pgmap v193: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:04:05.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:04:05 smithi100 ceph-mon[187528]: pgmap v194: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:04:05.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:04:05 smithi150 ceph-mon[171606]: pgmap v194: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:04:07.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:04:07 smithi100 ceph-mon[187528]: pgmap v195: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:04:07.595 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:04:07 smithi150 ceph-mon[171606]: pgmap v195: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:04:09.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:04:09 smithi100 ceph-mon[187528]: pgmap v196: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:04:09.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:04:09 smithi150 ceph-mon[171606]: pgmap v196: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:04:11.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:04:11 smithi100 ceph-mon[187528]: pgmap v197: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:04:11.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:04:11 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T10:04:11.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:04:11 smithi150 ceph-mon[171606]: pgmap v197: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:04:11.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:04:11 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T10:04:13.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:04:13 smithi100 ceph-mon[187528]: pgmap v198: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:04:13.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:04:13 smithi150 ceph-mon[171606]: pgmap v198: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:04:15.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:04:15 smithi100 ceph-mon[187528]: pgmap v199: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:04:15.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:04:15 smithi150 ceph-mon[171606]: pgmap v199: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:04:17.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:04:17 smithi100 ceph-mon[187528]: pgmap v200: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:04:17.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:04:17 smithi150 ceph-mon[171606]: pgmap v200: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:04:19.595 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:04:19 smithi150 ceph-mon[171606]: pgmap v201: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:04:19.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:04:19 smithi100 ceph-mon[187528]: pgmap v201: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:04:21.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:04:21 smithi100 ceph-mon[187528]: pgmap v202: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:04:21.595 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:04:21 smithi150 ceph-mon[171606]: pgmap v202: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:04:23.595 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:04:23 smithi150 ceph-mon[171606]: pgmap v203: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:04:23.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:04:23 smithi100 ceph-mon[187528]: pgmap v203: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:04:25.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:04:25 smithi150 ceph-mon[171606]: pgmap v204: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:04:25.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:04:25 smithi100 ceph-mon[187528]: pgmap v204: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:04:26.595 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:04:26 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T10:04:26.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:04:26 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T10:04:26.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:04:26 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T10:04:26.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:04:26 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T10:04:27.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:04:27 smithi150 ceph-mon[171606]: pgmap v205: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:04:27.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:04:27 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T10:04:27.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:04:27 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T10:04:27.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:04:27 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:04:27.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:04:27 smithi100 ceph-mon[187528]: pgmap v205: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:04:27.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:04:27 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T10:04:27.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:04:27 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T10:04:27.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:04:27 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' 2023-12-05T10:04:29.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:04:29 smithi150 ceph-mon[171606]: pgmap v206: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:04:29.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:04:29 smithi100 ceph-mon[187528]: pgmap v206: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:04:31.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:04:31 smithi100 ceph-mon[187528]: pgmap v207: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:04:31.595 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:04:31 smithi150 ceph-mon[171606]: pgmap v207: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:04:33.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:04:33 smithi150 ceph-mon[171606]: pgmap v208: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:04:33.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:04:33 smithi100 ceph-mon[187528]: pgmap v208: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:04:35.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:04:35 smithi150 ceph-mon[171606]: pgmap v209: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:04:35.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:04:35 smithi100 ceph-mon[187528]: pgmap v209: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:04:37.595 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:04:37 smithi150 ceph-mon[171606]: pgmap v210: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:04:37.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:04:37 smithi100 ceph-mon[187528]: pgmap v210: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:04:39.595 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:04:39 smithi150 ceph-mon[171606]: pgmap v211: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:04:39.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:04:39 smithi100 ceph-mon[187528]: pgmap v211: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:04:41.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:04:41 smithi100 ceph-mon[187528]: pgmap v212: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:04:41.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:04:41 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T10:04:41.595 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:04:41 smithi150 ceph-mon[171606]: pgmap v212: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:04:41.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:04:41 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T10:04:43.595 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:04:43 smithi150 ceph-mon[171606]: pgmap v213: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:04:43.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:04:43 smithi100 ceph-mon[187528]: pgmap v213: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:04:45.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:04:45 smithi150 ceph-mon[171606]: pgmap v214: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:04:45.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:04:45 smithi100 ceph-mon[187528]: pgmap v214: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:04:47.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:04:47 smithi150 ceph-mon[171606]: pgmap v215: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:04:47.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:04:47 smithi100 ceph-mon[187528]: pgmap v215: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:04:49.595 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:04:49 smithi150 ceph-mon[171606]: pgmap v216: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:04:49.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:04:49 smithi100 ceph-mon[187528]: pgmap v216: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:04:51.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:04:51 smithi100 ceph-mon[187528]: pgmap v217: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:04:51.595 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:04:51 smithi150 ceph-mon[171606]: pgmap v217: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:04:53.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:04:53 smithi150 ceph-mon[171606]: pgmap v218: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:04:53.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:04:53 smithi100 ceph-mon[187528]: pgmap v218: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:04:55.137 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -e sha1=3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 -- bash -c 'ceph orch ps' 2023-12-05T10:04:55.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:04:55 smithi100 ceph-mon[187528]: pgmap v219: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:04:55.567 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi100/config 2023-12-05T10:04:55.595 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:04:55 smithi150 ceph-mon[171606]: pgmap v219: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:04:56.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:04:56 smithi100 ceph-mon[187528]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T10:04:56.595 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:04:56 smithi150 ceph-mon[171606]: from='mgr.34104 172.21.15.100:0/1750966550' entity='mgr.smithi100.ehmuhg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T10:04:56.758 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:56.760+0000 7fc52bdb3700 1 -- 172.21.15.100:0/1332500134 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5241035a0 msgr2=0x7fc5240fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:04:56.758 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:56.760+0000 7fc52bdb3700 1 --2- 172.21.15.100:0/1332500134 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5241035a0 0x7fc5240fcc10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc514004940 tx=0x7fc514009e30 comp rx=0 tx=0).stop 2023-12-05T10:04:56.758 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:56.760+0000 7fc52bdb3700 1 -- 172.21.15.100:0/1332500134 shutdown_connections 2023-12-05T10:04:56.758 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:56.760+0000 7fc52bdb3700 1 --2- 172.21.15.100:0/1332500134 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5241035a0 0x7fc5240fcc10 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:04:56.759 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:56.760+0000 7fc52bdb3700 1 --2- 172.21.15.100:0/1332500134 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc524102c00 0x7fc524102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:04:56.759 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:56.760+0000 7fc52bdb3700 1 -- 172.21.15.100:0/1332500134 >> 172.21.15.100:0/1332500134 conn(0x7fc5240f8790 msgr2=0x7fc5240faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:04:56.759 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:56.760+0000 7fc52bdb3700 1 -- 172.21.15.100:0/1332500134 shutdown_connections 2023-12-05T10:04:56.759 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:56.760+0000 7fc52bdb3700 1 -- 172.21.15.100:0/1332500134 wait complete. 2023-12-05T10:04:56.760 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:56.761+0000 7fc52bdb3700 1 Processor -- start 2023-12-05T10:04:56.760 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:56.761+0000 7fc52bdb3700 1 -- start start 2023-12-05T10:04:56.760 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:56.762+0000 7fc52bdb3700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc524102c00 0x7fc524113680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:04:56.761 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:56.762+0000 7fc52bdb3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5241035a0 0x7fc524113bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:04:56.761 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:56.762+0000 7fc52bdb3700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc524114210 con 0x7fc524102c00 2023-12-05T10:04:56.761 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:56.762+0000 7fc52bdb3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc52410d500 con 0x7fc5241035a0 2023-12-05T10:04:56.761 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:56.762+0000 7fc529b4f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc524102c00 0x7fc524113680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:04:56.761 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:56.762+0000 7fc529b4f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc524102c00 0x7fc524113680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39226/0 (socket says 172.21.15.100:39226) 2023-12-05T10:04:56.761 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:56.762+0000 7fc529b4f700 1 -- 172.21.15.100:0/3671677491 learned_addr learned my addr 172.21.15.100:0/3671677491 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T10:04:56.761 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:56.762+0000 7fc52934e700 1 --2- 172.21.15.100:0/3671677491 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5241035a0 0x7fc524113bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:04:56.761 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:56.762+0000 7fc529b4f700 1 -- 172.21.15.100:0/3671677491 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5241035a0 msgr2=0x7fc524113bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:04:56.761 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:56.762+0000 7fc529b4f700 1 --2- 172.21.15.100:0/3671677491 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5241035a0 0x7fc524113bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:04:56.761 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:56.762+0000 7fc529b4f700 1 -- 172.21.15.100:0/3671677491 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc514005040 con 0x7fc524102c00 2023-12-05T10:04:56.761 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:56.763+0000 7fc529b4f700 1 --2- 172.21.15.100:0/3671677491 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc524102c00 0x7fc524113680 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc520002a50 tx=0x7fc5200046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:04:56.761 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:56.763+0000 7fc51a7fc700 1 -- 172.21.15.100:0/3671677491 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc520007cc0 con 0x7fc524102c00 2023-12-05T10:04:56.761 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:56.763+0000 7fc51a7fc700 1 -- 172.21.15.100:0/3671677491 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc52000f040 con 0x7fc524102c00 2023-12-05T10:04:56.761 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:56.763+0000 7fc51a7fc700 1 -- 172.21.15.100:0/3671677491 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc52000d9c0 con 0x7fc524102c00 2023-12-05T10:04:56.762 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:56.763+0000 7fc52bdb3700 1 -- 172.21.15.100:0/3671677491 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc52410d7e0 con 0x7fc524102c00 2023-12-05T10:04:56.762 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:56.763+0000 7fc52bdb3700 1 -- 172.21.15.100:0/3671677491 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc52410dd20 con 0x7fc524102c00 2023-12-05T10:04:56.762 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:56.764+0000 7fc52bdb3700 1 -- 172.21.15.100:0/3671677491 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc524113330 con 0x7fc524102c00 2023-12-05T10:04:56.763 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:56.765+0000 7fc51a7fc700 1 -- 172.21.15.100:0/3671677491 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fc52000db20 con 0x7fc524102c00 2023-12-05T10:04:56.764 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:56.766+0000 7fc51a7fc700 1 --2- 172.21.15.100:0/3671677491 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fc51006ce70 0x7fc51006f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:04:56.764 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:56.766+0000 7fc51a7fc700 1 -- 172.21.15.100:0/3671677491 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6674+0+0 (secure 0 0 0) 0x7fc52008c1b0 con 0x7fc524102c00 2023-12-05T10:04:56.764 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:56.767+0000 7fc52934e700 1 --2- 172.21.15.100:0/3671677491 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fc51006ce70 0x7fc51006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:04:56.764 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:56.767+0000 7fc52934e700 1 --2- 172.21.15.100:0/3671677491 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fc51006ce70 0x7fc51006f320 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc52410eee0 tx=0x7fc514009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:04:56.768 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:56.771+0000 7fc51a7fc700 1 -- 172.21.15.100:0/3671677491 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fc520059970 con 0x7fc524102c00 2023-12-05T10:04:56.978 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:56.981+0000 7fc52bdb3700 1 -- 172.21.15.100:0/3671677491 --> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc52410ec20 con 0x7fc51006ce70 2023-12-05T10:04:56.989 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:56.991+0000 7fc51a7fc700 1 -- 172.21.15.100:0/3671677491 <== mgr.34104 v2:172.21.15.100:6800/3489431924 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7fc52410ec20 con 0x7fc51006ce70 2023-12-05T10:04:56.989 INFO:teuthology.orchestra.run.smithi100.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-05T10:04:56.989 INFO:teuthology.orchestra.run.smithi100.stdout:alertmanager.smithi100 smithi100 *:9093,9094 running (7m) 3m ago 15m 14.7M - 0.25.0 c8568f914cd2 f443e6a4242b 2023-12-05T10:04:56.989 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi100 smithi100 running (4m) 3m ago 15m 7843k - 19.0.0-11-g3fe8d441 56dea28e5206 fb8e6b844fba 2023-12-05T10:04:56.989 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi150 smithi150 running (4m) 96s ago 14m 7847k - 19.0.0-11-g3fe8d441 56dea28e5206 a035052de6cf 2023-12-05T10:04:56.989 INFO:teuthology.orchestra.run.smithi100.stdout:grafana.smithi100 smithi100 *:3000 running (7m) 3m ago 14m 80.1M - 9.4.7 2c41d148cca3 d666da9c4e4d 2023-12-05T10:04:56.989 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.akmstb smithi100 running (10m) 3m ago 10m 10.5G - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 6ce55c42c55b 2023-12-05T10:04:56.989 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.sqplhn smithi100 running (10m) 3m ago 10m 15.9M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc c2682d65f0c9 2023-12-05T10:04:56.989 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi150.fcnhsv smithi150 running (10m) 96s ago 10m 16.0M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 1a259762235d 2023-12-05T10:04:56.989 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi150.pcbpxm smithi150 running (10m) 96s ago 10m 16.0M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 27f730f8b9f9 2023-12-05T10:04:56.990 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi100.ehmuhg smithi100 *:8443,9283,8765 running (7m) 3m ago 16m 516M - 19.0.0-11-g3fe8d441 56dea28e5206 ebe3dfbb0356 2023-12-05T10:04:56.990 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi150.zkskag smithi150 *:8443,9283,8765 running (6m) 96s ago 14m 453M - 19.0.0-11-g3fe8d441 56dea28e5206 a2b40e2421f2 2023-12-05T10:04:56.990 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi100 smithi100 running (6m) 3m ago 16m 70.8M 2048M 19.0.0-11-g3fe8d441 56dea28e5206 21003fd7eaf4 2023-12-05T10:04:56.990 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi150 smithi150 running (5m) 96s ago 14m 51.5M 2048M 19.0.0-11-g3fe8d441 56dea28e5206 010f2f658fca 2023-12-05T10:04:56.990 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi100 smithi100 *:9100 running (7m) 3m ago 15m 8288k - 1.5.0 0da6a335fe13 a2653da0d840 2023-12-05T10:04:56.990 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi150 smithi150 *:9100 running (7m) 96s ago 14m 8346k - 1.5.0 0da6a335fe13 67523645e73b 2023-12-05T10:04:56.990 INFO:teuthology.orchestra.run.smithi100.stdout:osd.0 smithi100 running (4m) 3m ago 13m 133M 1618M 19.0.0-11-g3fe8d441 56dea28e5206 a29add095f14 2023-12-05T10:04:56.990 INFO:teuthology.orchestra.run.smithi100.stdout:osd.1 smithi100 running (3m) 3m ago 13m 135M 1618M 19.0.0-11-g3fe8d441 56dea28e5206 2de00a9dc686 2023-12-05T10:04:56.990 INFO:teuthology.orchestra.run.smithi100.stdout:osd.2 smithi100 running (3m) 3m ago 12m 12.6M 1618M 19.0.0-11-g3fe8d441 56dea28e5206 fb6adf680449 2023-12-05T10:04:56.990 INFO:teuthology.orchestra.run.smithi100.stdout:osd.3 smithi150 running (2m) 96s ago 12m 203M 2642M 19.0.0-11-g3fe8d441 56dea28e5206 08545df235d8 2023-12-05T10:04:56.990 INFO:teuthology.orchestra.run.smithi100.stdout:osd.4 smithi150 running (2m) 96s ago 11m 129M 2642M 19.0.0-11-g3fe8d441 56dea28e5206 bcabd80780a8 2023-12-05T10:04:56.990 INFO:teuthology.orchestra.run.smithi100.stdout:osd.5 smithi150 running (99s) 96s ago 11m 12.6M 2642M 19.0.0-11-g3fe8d441 56dea28e5206 f474c41b4d38 2023-12-05T10:04:56.990 INFO:teuthology.orchestra.run.smithi100.stdout:prometheus.smithi100 smithi100 *:9095 running (6m) 3m ago 14m 59.7M - 2.43.0 a07b618ecd1d 8ade75deb316 2023-12-05T10:04:56.991 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:56.993+0000 7fc52bdb3700 1 -- 172.21.15.100:0/3671677491 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fc51006ce70 msgr2=0x7fc51006f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:04:56.991 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:56.993+0000 7fc52bdb3700 1 --2- 172.21.15.100:0/3671677491 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fc51006ce70 0x7fc51006f320 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc52410eee0 tx=0x7fc514009e30 comp rx=0 tx=0).stop 2023-12-05T10:04:56.991 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:56.993+0000 7fc52bdb3700 1 -- 172.21.15.100:0/3671677491 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc524102c00 msgr2=0x7fc524113680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:04:56.991 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:56.993+0000 7fc52bdb3700 1 --2- 172.21.15.100:0/3671677491 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc524102c00 0x7fc524113680 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc520002a50 tx=0x7fc5200046b0 comp rx=0 tx=0).stop 2023-12-05T10:04:56.991 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:56.993+0000 7fc52bdb3700 1 -- 172.21.15.100:0/3671677491 shutdown_connections 2023-12-05T10:04:56.991 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:56.993+0000 7fc52bdb3700 1 --2- 172.21.15.100:0/3671677491 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fc51006ce70 0x7fc51006f320 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:04:56.991 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:56.993+0000 7fc52bdb3700 1 --2- 172.21.15.100:0/3671677491 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc524102c00 0x7fc524113680 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:04:56.992 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:56.993+0000 7fc52bdb3700 1 --2- 172.21.15.100:0/3671677491 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5241035a0 0x7fc524113bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:04:56.992 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:56.993+0000 7fc52bdb3700 1 -- 172.21.15.100:0/3671677491 >> 172.21.15.100:0/3671677491 conn(0x7fc5240f8790 msgr2=0x7fc5240fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:04:56.992 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:56.994+0000 7fc52bdb3700 1 -- 172.21.15.100:0/3671677491 shutdown_connections 2023-12-05T10:04:56.992 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:56.994+0000 7fc52bdb3700 1 -- 172.21.15.100:0/3671677491 wait complete. 2023-12-05T10:04:57.360 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:04:57 smithi100 ceph-mon[187528]: pgmap v220: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:04:57.384 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -e sha1=3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 -- bash -c 'ceph versions' 2023-12-05T10:04:57.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:04:57 smithi150 ceph-mon[171606]: pgmap v220: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:04:57.807 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi100/config 2023-12-05T10:04:58.501 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:04:58 smithi100 ceph-mon[187528]: from='client.34396 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T10:04:58.595 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:04:58 smithi150 ceph-mon[171606]: from='client.34396 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T10:04:59.047 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:59.049+0000 7f4c2e10e700 1 -- 172.21.15.100:0/3705663686 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c28102c20 msgr2=0x7f4c28102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:04:59.048 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:59.049+0000 7f4c2e10e700 1 --2- 172.21.15.100:0/3705663686 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c28102c20 0x7f4c28102ff0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4c18004940 tx=0x7f4c18009e30 comp rx=0 tx=0).stop 2023-12-05T10:04:59.048 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:59.050+0000 7f4c2e10e700 1 -- 172.21.15.100:0/3705663686 shutdown_connections 2023-12-05T10:04:59.048 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:59.050+0000 7f4c2e10e700 1 --2- 172.21.15.100:0/3705663686 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c28065390 0x7f4c28065800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:04:59.048 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:59.050+0000 7f4c2e10e700 1 --2- 172.21.15.100:0/3705663686 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c28102c20 0x7f4c28102ff0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:04:59.048 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:59.050+0000 7f4c2e10e700 1 -- 172.21.15.100:0/3705663686 >> 172.21.15.100:0/3705663686 conn(0x7f4c280719b0 msgr2=0x7f4c28071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:04:59.048 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:59.050+0000 7f4c2e10e700 1 -- 172.21.15.100:0/3705663686 shutdown_connections 2023-12-05T10:04:59.048 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:59.050+0000 7f4c2e10e700 1 -- 172.21.15.100:0/3705663686 wait complete. 2023-12-05T10:04:59.050 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:59.050+0000 7f4c2e10e700 1 Processor -- start 2023-12-05T10:04:59.050 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:59.051+0000 7f4c2e10e700 1 -- start start 2023-12-05T10:04:59.050 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:59.051+0000 7f4c2e10e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c28065390 0x7f4c280fbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:04:59.050 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:59.051+0000 7f4c2e10e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c28102c20 0x7f4c280fc130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:04:59.050 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:59.051+0000 7f4c2e10e700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c280fc7c0 con 0x7f4c28065390 2023-12-05T10:04:59.050 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:59.051+0000 7f4c2e10e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c280fc930 con 0x7f4c28102c20 2023-12-05T10:04:59.050 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:59.051+0000 7f4c277fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c28065390 0x7f4c280fbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:04:59.050 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:59.051+0000 7f4c277fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c28065390 0x7f4c280fbbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39236/0 (socket says 172.21.15.100:39236) 2023-12-05T10:04:59.050 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:59.051+0000 7f4c277fe700 1 -- 172.21.15.100:0/1950723651 learned_addr learned my addr 172.21.15.100:0/1950723651 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T10:04:59.050 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:59.051+0000 7f4c26ffd700 1 --2- 172.21.15.100:0/1950723651 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c28102c20 0x7f4c280fc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:04:59.050 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:59.052+0000 7f4c277fe700 1 -- 172.21.15.100:0/1950723651 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c28102c20 msgr2=0x7f4c280fc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:04:59.050 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:59.052+0000 7f4c277fe700 1 --2- 172.21.15.100:0/1950723651 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c28102c20 0x7f4c280fc130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:04:59.051 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:59.052+0000 7f4c277fe700 1 -- 172.21.15.100:0/1950723651 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c18005040 con 0x7f4c28065390 2023-12-05T10:04:59.051 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:59.052+0000 7f4c277fe700 1 --2- 172.21.15.100:0/1950723651 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c28065390 0x7f4c280fbbf0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4c18009180 tx=0x7f4c18009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:04:59.051 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:59.052+0000 7f4c0ffff700 1 -- 172.21.15.100:0/1950723651 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c1800e040 con 0x7f4c28065390 2023-12-05T10:04:59.051 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:59.052+0000 7f4c0ffff700 1 -- 172.21.15.100:0/1950723651 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4c18013420 con 0x7f4c28065390 2023-12-05T10:04:59.051 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:59.052+0000 7f4c2e10e700 1 -- 172.21.15.100:0/1950723651 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c281198c0 con 0x7f4c28065390 2023-12-05T10:04:59.051 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:59.052+0000 7f4c0ffff700 1 -- 172.21.15.100:0/1950723651 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c1801c630 con 0x7f4c28065390 2023-12-05T10:04:59.051 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:59.052+0000 7f4c2e10e700 1 -- 172.21.15.100:0/1950723651 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c28119db0 con 0x7f4c28065390 2023-12-05T10:04:59.051 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:59.053+0000 7f4c2e10e700 1 -- 172.21.15.100:0/1950723651 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c280fff40 con 0x7f4c28065390 2023-12-05T10:04:59.052 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:59.055+0000 7f4c0ffff700 1 -- 172.21.15.100:0/1950723651 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f4c180139e0 con 0x7f4c28065390 2023-12-05T10:04:59.053 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:59.055+0000 7f4c0ffff700 1 --2- 172.21.15.100:0/1950723651 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f4c1006ce60 0x7f4c1006f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:04:59.053 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:59.056+0000 7f4c0ffff700 1 -- 172.21.15.100:0/1950723651 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6674+0+0 (secure 0 0 0) 0x7f4c1808d730 con 0x7f4c28065390 2023-12-05T10:04:59.053 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:59.056+0000 7f4c26ffd700 1 --2- 172.21.15.100:0/1950723651 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f4c1006ce60 0x7f4c1006f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:04:59.054 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:59.056+0000 7f4c26ffd700 1 --2- 172.21.15.100:0/1950723651 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f4c1006ce60 0x7f4c1006f310 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c006fd0 tx=0x7f4c1c008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:04:59.058 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:59.060+0000 7f4c0ffff700 1 -- 172.21.15.100:0/1950723651 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f4c18057560 con 0x7f4c28065390 2023-12-05T10:04:59.338 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:59.340+0000 7f4c2e10e700 1 -- 172.21.15.100:0/1950723651 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4c280734d0 con 0x7f4c28065390 2023-12-05T10:04:59.338 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:59.341+0000 7f4c0ffff700 1 -- 172.21.15.100:0/1950723651 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+721 (secure 0 0 0) 0x7f4c1805ab80 con 0x7f4c28065390 2023-12-05T10:04:59.338 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2023-12-05T10:04:59.339 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": { 2023-12-05T10:04:59.339 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 2 2023-12-05T10:04:59.339 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-12-05T10:04:59.339 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": { 2023-12-05T10:04:59.339 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 2 2023-12-05T10:04:59.339 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-12-05T10:04:59.339 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": { 2023-12-05T10:04:59.339 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 6 2023-12-05T10:04:59.339 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-12-05T10:04:59.339 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": { 2023-12-05T10:04:59.339 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 4 2023-12-05T10:04:59.339 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-12-05T10:04:59.339 INFO:teuthology.orchestra.run.smithi100.stdout: "overall": { 2023-12-05T10:04:59.340 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 4, 2023-12-05T10:04:59.340 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 10 2023-12-05T10:04:59.340 INFO:teuthology.orchestra.run.smithi100.stdout: } 2023-12-05T10:04:59.340 INFO:teuthology.orchestra.run.smithi100.stdout:} 2023-12-05T10:04:59.340 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:59.343+0000 7f4c2e10e700 1 -- 172.21.15.100:0/1950723651 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f4c1006ce60 msgr2=0x7f4c1006f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:04:59.340 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:59.343+0000 7f4c2e10e700 1 --2- 172.21.15.100:0/1950723651 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f4c1006ce60 0x7f4c1006f310 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c006fd0 tx=0x7f4c1c008040 comp rx=0 tx=0).stop 2023-12-05T10:04:59.340 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:59.343+0000 7f4c2e10e700 1 -- 172.21.15.100:0/1950723651 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c28065390 msgr2=0x7f4c280fbbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:04:59.341 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:59.343+0000 7f4c2e10e700 1 --2- 172.21.15.100:0/1950723651 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c28065390 0x7f4c280fbbf0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4c18009180 tx=0x7f4c18009e30 comp rx=0 tx=0).stop 2023-12-05T10:04:59.341 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:59.343+0000 7f4c2e10e700 1 -- 172.21.15.100:0/1950723651 shutdown_connections 2023-12-05T10:04:59.341 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:59.343+0000 7f4c2e10e700 1 --2- 172.21.15.100:0/1950723651 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f4c1006ce60 0x7f4c1006f310 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:04:59.341 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:59.343+0000 7f4c2e10e700 1 --2- 172.21.15.100:0/1950723651 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c28065390 0x7f4c280fbbf0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:04:59.341 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:59.343+0000 7f4c2e10e700 1 --2- 172.21.15.100:0/1950723651 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c28102c20 0x7f4c280fc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:04:59.341 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:59.343+0000 7f4c2e10e700 1 -- 172.21.15.100:0/1950723651 >> 172.21.15.100:0/1950723651 conn(0x7f4c280719b0 msgr2=0x7f4c280faaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:04:59.342 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:59.343+0000 7f4c2e10e700 1 -- 172.21.15.100:0/1950723651 shutdown_connections 2023-12-05T10:04:59.342 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:04:59.343+0000 7f4c2e10e700 1 -- 172.21.15.100:0/1950723651 wait complete. 2023-12-05T10:04:59.526 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:04:59 smithi100 ceph-mon[187528]: pgmap v221: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:04:59.595 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:04:59 smithi150 ceph-mon[171606]: pgmap v221: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:04:59.774 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -e sha1=3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2023-12-05T10:05:00.202 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/mon.smithi100/config 2023-12-05T10:05:00.504 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:05:00 smithi100 ceph-mon[187528]: from='client.? 172.21.15.100:0/1950723651' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T10:05:00.595 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:05:00 smithi150 ceph-mon[171606]: from='client.? 172.21.15.100:0/1950723651' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T10:05:01.466 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:01.468+0000 7f0819773700 1 -- 172.21.15.100:0/3595803456 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0814102c00 msgr2=0x7f0814102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:05:01.466 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:01.468+0000 7f0819773700 1 --2- 172.21.15.100:0/3595803456 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0814102c00 0x7f0814102fd0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0804004940 tx=0x7f0804009e30 comp rx=0 tx=0).stop 2023-12-05T10:05:01.466 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:01.468+0000 7f0819773700 1 -- 172.21.15.100:0/3595803456 shutdown_connections 2023-12-05T10:05:01.466 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:01.468+0000 7f0819773700 1 --2- 172.21.15.100:0/3595803456 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f08141035a0 0x7f08140fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:05:01.466 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:01.468+0000 7f0819773700 1 --2- 172.21.15.100:0/3595803456 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0814102c00 0x7f0814102fd0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:05:01.466 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:01.468+0000 7f0819773700 1 -- 172.21.15.100:0/3595803456 >> 172.21.15.100:0/3595803456 conn(0x7f08140f8790 msgr2=0x7f08140faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:05:01.467 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:01.468+0000 7f0819773700 1 -- 172.21.15.100:0/3595803456 shutdown_connections 2023-12-05T10:05:01.467 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:01.468+0000 7f0819773700 1 -- 172.21.15.100:0/3595803456 wait complete. 2023-12-05T10:05:01.467 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:01.469+0000 7f0819773700 1 Processor -- start 2023-12-05T10:05:01.467 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:01.469+0000 7f0819773700 1 -- start start 2023-12-05T10:05:01.468 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:01.469+0000 7f0819773700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0814102c00 0x7f0814115840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:05:01.468 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:01.469+0000 7f0819773700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f08141035a0 0x7f0814115d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:05:01.468 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:01.469+0000 7f0819773700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08141163d0 con 0x7f0814102c00 2023-12-05T10:05:01.468 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:01.469+0000 7f0819773700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f081410f700 con 0x7f08141035a0 2023-12-05T10:05:01.468 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:01.469+0000 7f0812ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0814102c00 0x7f0814115840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:05:01.468 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:01.469+0000 7f0812ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0814102c00 0x7f0814115840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60508/0 (socket says 172.21.15.100:60508) 2023-12-05T10:05:01.468 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:01.470+0000 7f0812ffd700 1 -- 172.21.15.100:0/1260173800 learned_addr learned my addr 172.21.15.100:0/1260173800 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T10:05:01.469 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:01.470+0000 7f08127fc700 1 --2- 172.21.15.100:0/1260173800 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f08141035a0 0x7f0814115d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:05:01.469 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:01.470+0000 7f0812ffd700 1 -- 172.21.15.100:0/1260173800 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f08141035a0 msgr2=0x7f0814115d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:05:01.469 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:01.470+0000 7f0812ffd700 1 --2- 172.21.15.100:0/1260173800 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f08141035a0 0x7f0814115d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:05:01.469 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:01.470+0000 7f0812ffd700 1 -- 172.21.15.100:0/1260173800 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0804005040 con 0x7f0814102c00 2023-12-05T10:05:01.469 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:01.470+0000 7f0812ffd700 1 --2- 172.21.15.100:0/1260173800 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0814102c00 0x7f0814115840 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0804009fd0 tx=0x7f0804009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:05:01.469 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:01.470+0000 7f07fb7fe700 1 -- 172.21.15.100:0/1260173800 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f080400e040 con 0x7f0814102c00 2023-12-05T10:05:01.469 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:01.470+0000 7f07fb7fe700 1 -- 172.21.15.100:0/1260173800 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f080400bc50 con 0x7f0814102c00 2023-12-05T10:05:01.469 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:01.470+0000 7f07fb7fe700 1 -- 172.21.15.100:0/1260173800 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0804013ea0 con 0x7f0814102c00 2023-12-05T10:05:01.469 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:01.470+0000 7f0819773700 1 -- 172.21.15.100:0/1260173800 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f081410f980 con 0x7f0814102c00 2023-12-05T10:05:01.469 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:01.471+0000 7f0819773700 1 -- 172.21.15.100:0/1260173800 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f081410fec0 con 0x7f0814102c00 2023-12-05T10:05:01.470 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:01.472+0000 7f0819773700 1 -- 172.21.15.100:0/1260173800 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08140fc390 con 0x7f0814102c00 2023-12-05T10:05:01.470 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:01.472+0000 7f07fb7fe700 1 -- 172.21.15.100:0/1260173800 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f0804013420 con 0x7f0814102c00 2023-12-05T10:05:01.471 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:01.473+0000 7f07fb7fe700 1 --2- 172.21.15.100:0/1260173800 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f07fc06ce70 0x7f07fc06f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:05:01.471 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:01.473+0000 7f07fb7fe700 1 -- 172.21.15.100:0/1260173800 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6674+0+0 (secure 0 0 0) 0x7f080408d920 con 0x7f0814102c00 2023-12-05T10:05:01.471 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:01.474+0000 7f08127fc700 1 --2- 172.21.15.100:0/1260173800 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f07fc06ce70 0x7f07fc06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:05:01.471 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:01.474+0000 7f08127fc700 1 --2- 172.21.15.100:0/1260173800 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f07fc06ce70 0x7f07fc06f320 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0808007fd0 tx=0x7f0808009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:05:01.475 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:01.478+0000 7f07fb7fe700 1 -- 172.21.15.100:0/1260173800 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f080405b160 con 0x7f0814102c00 2023-12-05T10:05:01.595 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:05:01 smithi150 ceph-mon[171606]: pgmap v222: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:05:01.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:05:01 smithi100 ceph-mon[187528]: pgmap v222: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:05:01.761 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:01.763+0000 7f0819773700 1 -- 172.21.15.100:0/1260173800 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0814110e20 con 0x7f0814102c00 2023-12-05T10:05:01.761 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:01.764+0000 7f07fb7fe700 1 -- 172.21.15.100:0/1260173800 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+721 (secure 0 0 0) 0x7f080405acf0 con 0x7f0814102c00 2023-12-05T10:05:01.763 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:01.766+0000 7f0819773700 1 -- 172.21.15.100:0/1260173800 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f07fc06ce70 msgr2=0x7f07fc06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:05:01.764 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:01.766+0000 7f0819773700 1 --2- 172.21.15.100:0/1260173800 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f07fc06ce70 0x7f07fc06f320 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0808007fd0 tx=0x7f0808009040 comp rx=0 tx=0).stop 2023-12-05T10:05:01.764 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:01.766+0000 7f0819773700 1 -- 172.21.15.100:0/1260173800 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0814102c00 msgr2=0x7f0814115840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:05:01.764 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:01.766+0000 7f0819773700 1 --2- 172.21.15.100:0/1260173800 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0814102c00 0x7f0814115840 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0804009fd0 tx=0x7f0804009e30 comp rx=0 tx=0).stop 2023-12-05T10:05:01.764 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:01.766+0000 7f0819773700 1 -- 172.21.15.100:0/1260173800 shutdown_connections 2023-12-05T10:05:01.764 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:01.766+0000 7f0819773700 1 --2- 172.21.15.100:0/1260173800 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f07fc06ce70 0x7f07fc06f320 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:05:01.764 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:01.766+0000 7f0819773700 1 --2- 172.21.15.100:0/1260173800 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0814102c00 0x7f0814115840 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:05:01.764 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:01.766+0000 7f0819773700 1 --2- 172.21.15.100:0/1260173800 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f08141035a0 0x7f0814115d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:05:01.764 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:01.766+0000 7f0819773700 1 -- 172.21.15.100:0/1260173800 >> 172.21.15.100:0/1260173800 conn(0x7f08140f8790 msgr2=0x7f08140fa090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:05:01.764 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:01.766+0000 7f0819773700 1 -- 172.21.15.100:0/1260173800 shutdown_connections 2023-12-05T10:05:01.764 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:01.766+0000 7f0819773700 1 -- 172.21.15.100:0/1260173800 wait complete. 2023-12-05T10:05:01.778 INFO:teuthology.orchestra.run.smithi100.stdout:false 2023-12-05T10:05:02.202 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-05T10:05:02.203 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/task/parallel.py", line 56, in task p.spawn(_run_spawned, ctx, confg, taskname) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/task/parallel.py", line 64, in _run_spawned mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/task/sequential.py", line 47, in task mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=confg) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_3fe8d441c2f973bfe963ba4dd30ba8eac9f36227/qa/tasks/cephadm.py", line 1351, in shell _shell(ctx, cluster_name, remote, File "/home/teuthworker/src/git.ceph.com_ceph-c_3fe8d441c2f973bfe963ba4dd30ba8eac9f36227/qa/tasks/cephadm.py", line 40, in _shell return remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi100 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -e sha1=3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' 2023-12-05T10:05:02.274 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=cb33cc8f2fee410e98cb3994e47c99ad Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/task/parallel.py", line 56, in task p.spawn(_run_spawned, ctx, confg, taskname) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/task/parallel.py", line 64, in _run_spawned mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/task/sequential.py", line 47, in task mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=confg) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_3fe8d441c2f973bfe963ba4dd30ba8eac9f36227/qa/tasks/cephadm.py", line 1351, in shell _shell(ctx, cluster_name, remote, File "/home/teuthworker/src/git.ceph.com_ceph-c_3fe8d441c2f973bfe963ba4dd30ba8eac9f36227/qa/tasks/cephadm.py", line 40, in _shell return remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi100 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -e sha1=3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' 2023-12-05T10:05:02.278 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-12-05T10:05:02.292 INFO:tasks.kclient:Unmounting kernel clients... 2023-12-05T10:05:02.292 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-12-05T10:05:02.292 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-05T10:05:02.344 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-12-05T10:05:02.344 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-05T10:05:02.432 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-05T10:05:02.536 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:05:02 smithi100 ceph-mon[187528]: from='client.? 172.21.15.100:0/1260173800' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T10:05:02.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:05:02 smithi150 ceph-mon[171606]: from='client.? 172.21.15.100:0/1260173800' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T10:05:02.669 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:02.670+0000 7fca94dff700 1 -- 172.21.15.100:0/523752824 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca90102af0 msgr2=0x7fca90102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:05:02.669 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:02.670+0000 7fca94dff700 1 --2- 172.21.15.100:0/523752824 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca90102af0 0x7fca90102ec0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fca80004940 tx=0x7fca80009e30 comp rx=0 tx=0).stop 2023-12-05T10:05:02.669 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:02.671+0000 7fca94dff700 1 -- 172.21.15.100:0/523752824 shutdown_connections 2023-12-05T10:05:02.669 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:02.671+0000 7fca94dff700 1 --2- 172.21.15.100:0/523752824 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fca900fcab0 0x7fca900fcf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:05:02.669 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:02.671+0000 7fca94dff700 1 --2- 172.21.15.100:0/523752824 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca90102af0 0x7fca90102ec0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:05:02.669 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:02.671+0000 7fca94dff700 1 -- 172.21.15.100:0/523752824 >> 172.21.15.100:0/523752824 conn(0x7fca900f85f0 msgr2=0x7fca900faa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:05:02.670 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:02.671+0000 7fca94dff700 1 -- 172.21.15.100:0/523752824 shutdown_connections 2023-12-05T10:05:02.670 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:02.671+0000 7fca94dff700 1 -- 172.21.15.100:0/523752824 wait complete. 2023-12-05T10:05:02.670 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:02.671+0000 7fca94dff700 1 Processor -- start 2023-12-05T10:05:02.670 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:02.671+0000 7fca94dff700 1 -- start start 2023-12-05T10:05:02.672 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:02.672+0000 7fca94dff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fca900fcab0 0x7fca90113270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:05:02.672 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:02.672+0000 7fca94dff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca90102af0 0x7fca901137b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:05:02.672 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:02.672+0000 7fca94dff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca90113e00 con 0x7fca90102af0 2023-12-05T10:05:02.672 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:02.672+0000 7fca94dff700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca9010d320 con 0x7fca900fcab0 2023-12-05T10:05:02.672 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:02.672+0000 7fca8dd9b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca90102af0 0x7fca901137b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:05:02.672 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:02.672+0000 7fca8dd9b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca90102af0 0x7fca901137b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60524/0 (socket says 172.21.15.100:60524) 2023-12-05T10:05:02.672 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:02.672+0000 7fca8dd9b700 1 -- 172.21.15.100:0/3759393515 learned_addr learned my addr 172.21.15.100:0/3759393515 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T10:05:02.672 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:02.672+0000 7fca8e59c700 1 --2- 172.21.15.100:0/3759393515 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fca900fcab0 0x7fca90113270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:05:02.673 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:02.672+0000 7fca8dd9b700 1 -- 172.21.15.100:0/3759393515 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fca900fcab0 msgr2=0x7fca90113270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:05:02.673 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:02.672+0000 7fca8dd9b700 1 --2- 172.21.15.100:0/3759393515 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fca900fcab0 0x7fca90113270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:05:02.673 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:02.672+0000 7fca8dd9b700 1 -- 172.21.15.100:0/3759393515 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca80005040 con 0x7fca90102af0 2023-12-05T10:05:02.673 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:02.672+0000 7fca8e59c700 1 --2- 172.21.15.100:0/3759393515 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fca900fcab0 0x7fca90113270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-05T10:05:02.673 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:02.673+0000 7fca8dd9b700 1 --2- 172.21.15.100:0/3759393515 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca90102af0 0x7fca901137b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fca84002a50 tx=0x7fca840046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:05:02.673 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:02.673+0000 7fca7effd700 1 -- 172.21.15.100:0/3759393515 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca84007cc0 con 0x7fca90102af0 2023-12-05T10:05:02.673 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:02.673+0000 7fca7effd700 1 -- 172.21.15.100:0/3759393515 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fca8400f040 con 0x7fca90102af0 2023-12-05T10:05:02.673 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:02.673+0000 7fca94dff700 1 -- 172.21.15.100:0/3759393515 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca9010d600 con 0x7fca90102af0 2023-12-05T10:05:02.673 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:02.673+0000 7fca7effd700 1 -- 172.21.15.100:0/3759393515 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca8400da70 con 0x7fca90102af0 2023-12-05T10:05:02.674 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:02.673+0000 7fca94dff700 1 -- 172.21.15.100:0/3759393515 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca9010dbc0 con 0x7fca90102af0 2023-12-05T10:05:02.674 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:02.674+0000 7fca94dff700 1 -- 172.21.15.100:0/3759393515 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca90104f70 con 0x7fca90102af0 2023-12-05T10:05:02.674 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:02.675+0000 7fca7effd700 1 -- 172.21.15.100:0/3759393515 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fca8400dc10 con 0x7fca90102af0 2023-12-05T10:05:02.675 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:02.676+0000 7fca7effd700 1 --2- 172.21.15.100:0/3759393515 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fca7806ce70 0x7fca7806f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:05:02.675 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:02.676+0000 7fca7effd700 1 -- 172.21.15.100:0/3759393515 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6674+0+0 (secure 0 0 0) 0x7fca8408bba0 con 0x7fca90102af0 2023-12-05T10:05:02.675 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:02.676+0000 7fca8e59c700 1 --2- 172.21.15.100:0/3759393515 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fca7806ce70 0x7fca7806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:05:02.675 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:02.677+0000 7fca8e59c700 1 --2- 172.21.15.100:0/3759393515 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fca7806ce70 0x7fca7806f320 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fca8000b840 tx=0x7fca80009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:05:02.678 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:02.680+0000 7fca7effd700 1 -- 172.21.15.100:0/3759393515 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fca84059360 con 0x7fca90102af0 2023-12-05T10:05:02.881 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:02.884+0000 7fca94dff700 1 -- 172.21.15.100:0/3759393515 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fca9010e850 con 0x7fca90102af0 2023-12-05T10:05:02.882 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:02.885+0000 7fca7effd700 1 -- 172.21.15.100:0/3759393515 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+16891 (secure 0 0 0) 0x7fca84058ef0 con 0x7fca90102af0 2023-12-05T10:05:02.883 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T10:05:02.883 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":95,"fsid":"5b035ce6-9353-11ee-95a2-87774f69a715","created":"2023-12-05T09:48:33.718763+0000","modified":"2023-12-05T10:03:26.158142+0000","last_up_change":"2023-12-05T10:03:25.155854+0000","last_in_change":"2023-12-05T09:53:15.176570+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-05T09:52:26.650134+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2023-12-05T09:54:29.310760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2023-12-05T09:54:29.992340+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9f3faeed-8336-4509-9127-eafa0273ecea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":51,"up_from":55,"up_thru":94,"down_at":52,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":4132114326},{"type":"v1","addr":"172.21.15.100:6803","nonce":4132114326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":4132114326},{"type":"v1","addr":"172.21.15.100:6805","nonce":4132114326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":4132114326},{"type":"v1","addr":"172.21.15.100:6809","nonce":4132114326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":4132114326},{"type":"v1","addr":"172.21.15.100:6807","nonce":4132114326}]},"public_addr":"172.21.15.100:6803/4132114326","cluster_addr":"172.21.15.100:6805/4132114326","heartbeat_back_addr":"172.21.15.100:6809/4132114326","heartbeat_front_addr":"172.21.15.100:6807/4132114326","state":["exists","up"]},{"osd":1,"uuid":"6ca8c1e2-e673-4dc4-b02d-c0805493bcf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":56,"up_from":60,"up_thru":94,"down_at":57,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":726756154},{"type":"v1","addr":"172.21.15.100:6811","nonce":726756154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":726756154},{"type":"v1","addr":"172.21.15.100:6813","nonce":726756154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":726756154},{"type":"v1","addr":"172.21.15.100:6817","nonce":726756154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":726756154},{"type":"v1","addr":"172.21.15.100:6815","nonce":726756154}]},"public_addr":"172.21.15.100:6811/726756154","cluster_addr":"172.21.15.100:6813/726756154","heartbeat_back_addr":"172.21.15.100:6817/726756154","heartbeat_front_addr":"172.21.15.100:6815/726756154","state":["exists","up"]},{"osd":2,"uuid":"59a55cb9-28ae-4485-8cbf-e5f6224bd377","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":61,"up_from":65,"up_thru":94,"down_at":62,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":4210799164},{"type":"v1","addr":"172.21.15.100:6819","nonce":4210799164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":4210799164},{"type":"v1","addr":"172.21.15.100:6821","nonce":4210799164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4210799164},{"type":"v1","addr":"172.21.15.100:6825","nonce":4210799164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":4210799164},{"type":"v1","addr":"172.21.15.100:6823","nonce":4210799164}]},"public_addr":"172.21.15.100:6819/4210799164","cluster_addr":"172.21.15.100:6821/4210799164","heartbeat_back_addr":"172.21.15.100:6825/4210799164","heartbeat_front_addr":"172.21.15.100:6823/4210799164","state":["exists","up"]},{"osd":3,"uuid":"e12b505f-7f0c-4d6f-b039-5aa793f79db0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":26,"last_clean_end":66,"up_from":76,"up_thru":94,"down_at":67,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":1106863242},{"type":"v1","addr":"172.21.15.150:6801","nonce":1106863242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":1106863242},{"type":"v1","addr":"172.21.15.150:6803","nonce":1106863242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":1106863242},{"type":"v1","addr":"172.21.15.150:6807","nonce":1106863242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":1106863242},{"type":"v1","addr":"172.21.15.150:6805","nonce":1106863242}]},"public_addr":"172.21.15.150:6801/1106863242","cluster_addr":"172.21.15.150:6803/1106863242","heartbeat_back_addr":"172.21.15.150:6807/1106863242","heartbeat_front_addr":"172.21.15.150:6805/1106863242","state":["exists","up"]},{"osd":4,"uuid":"33fbbf55-86ba-4e7f-a66b-e958dce72283","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":34,"last_clean_end":82,"up_from":86,"up_thru":94,"down_at":83,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":1252141235},{"type":"v1","addr":"172.21.15.150:6809","nonce":1252141235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":1252141235},{"type":"v1","addr":"172.21.15.150:6811","nonce":1252141235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":1252141235},{"type":"v1","addr":"172.21.15.150:6815","nonce":1252141235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":1252141235},{"type":"v1","addr":"172.21.15.150:6813","nonce":1252141235}]},"public_addr":"172.21.15.150:6809/1252141235","cluster_addr":"172.21.15.150:6811/1252141235","heartbeat_back_addr":"172.21.15.150:6815/1252141235","heartbeat_front_addr":"172.21.15.150:6813/1252141235","state":["exists","up"]},{"osd":5,"uuid":"93b2d10b-0410-4390-9283-b4129c0439d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":39,"last_clean_end":89,"up_from":94,"up_thru":94,"down_at":90,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":730066362},{"type":"v1","addr":"172.21.15.150:6817","nonce":730066362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":730066362},{"type":"v1","addr":"172.21.15.150:6819","nonce":730066362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":730066362},{"type":"v1","addr":"172.21.15.150:6823","nonce":730066362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":730066362},{"type":"v1","addr":"172.21.15.150:6821","nonce":730066362}]},"public_addr":"172.21.15.150:6817/730066362","cluster_addr":"172.21.15.150:6819/730066362","heartbeat_back_addr":"172.21.15.150:6823/730066362","heartbeat_front_addr":"172.21.15.150:6821/730066362","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T09:51:35.123538+0000","dead_epoch":51},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T09:51:59.961993+0000","dead_epoch":56},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T09:52:23.976682+0000","dead_epoch":61},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T09:52:46.493238+0000","dead_epoch":66},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T09:53:09.121783+0000","dead_epoch":82},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T09:53:32.450910+0000","dead_epoch":89}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.19","mappings":[{"from":0,"to":3}]},{"pgid":"2.1b","mappings":[{"from":0,"to":3}]},{"pgid":"3.d","mappings":[{"from":4,"to":5}]},{"pgid":"3.e","mappings":[{"from":4,"to":3}]},{"pgid":"3.10","mappings":[{"from":1,"to":3}]},{"pgid":"3.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:0/1442740471":"2023-12-06T09:59:10.596958+0000","172.21.15.100:0/2319392996":"2023-12-06T09:59:10.596958+0000","172.21.15.100:6800/2397627746":"2023-12-06T09:50:30.059721+0000","172.21.15.150:0/45306857":"2023-12-06T09:58:01.227505+0000","172.21.15.100:0/4197065049":"2023-12-06T09:50:30.059721+0000","172.21.15.150:0/1284624117":"2023-12-06T09:58:01.227505+0000","172.21.15.150:6829/896268868":"2023-12-06T09:58:01.227505+0000","172.21.15.100:0/2992397636":"2023-12-06T09:49:01.007941+0000","172.21.15.100:0/2175139133":"2023-12-06T09:56:31.887692+0000","172.21.15.150:0/3463685537":"2023-12-06T09:58:01.227505+0000","172.21.15.100:0/3456039235":"2023-12-06T09:56:31.887692+0000","172.21.15.100:0/1529397750":"2023-12-06T09:49:28.559106+0000","172.21.15.100:6800/3060005571":"2023-12-06T09:59:10.596958+0000","172.21.15.100:6801/1237547575":"2023-12-06T09:56:31.887692+0000","172.21.15.100:6800/3606837497":"2023-12-06T09:49:01.007941+0000","172.21.15.100:6801/3060005571":"2023-12-06T09:59:10.596958+0000","172.21.15.100:0/556453695":"2023-12-06T09:49:28.559106+0000","172.21.15.100:0/567522562":"2023-12-06T09:49:01.007941+0000","172.21.15.100:0/4217799370":"2023-12-06T09:59:10.596958+0000","172.21.15.100:0/2280374959":"2023-12-06T09:56:31.887692+0000","172.21.15.150:0/2303343881":"2023-12-06T09:58:01.227505+0000","172.21.15.100:6800/1237547575":"2023-12-06T09:56:31.887692+0000","172.21.15.150:0/3272897294":"2023-12-06T09:58:01.227505+0000","172.21.15.100:6801/3606837497":"2023-12-06T09:49:01.007941+0000","172.21.15.100:0/737517101":"2023-12-06T09:50:30.059721+0000","172.21.15.100:0/4027037785":"2023-12-06T09:59:10.596958+0000","172.21.15.150:0/4245341459":"2023-12-06T09:58:01.227505+0000","172.21.15.100:6826/3068237273":"2023-12-06T09:54:43.391103+0000","172.21.15.150:6828/896268868":"2023-12-06T09:58:01.227505+0000","172.21.15.100:0/2400356084":"2023-12-06T09:49:01.007941+0000","172.21.15.100:0/485886590":"2023-12-06T09:56:31.887692+0000","172.21.15.100:0/3942224339":"2023-12-06T09:49:28.559106+0000","172.21.15.100:6827/3068237273":"2023-12-06T09:54:43.391103+0000","172.21.15.100:6800/2647899624":"2023-12-06T09:49:28.559106+0000","172.21.15.100:6801/2647899624":"2023-12-06T09:49:28.559106+0000","172.21.15.100:0/2826914555":"2023-12-06T09:50:30.059721+0000","172.21.15.100:0/1388385571":"2023-12-06T09:59:10.596958+0000","172.21.15.100:6801/2397627746":"2023-12-06T09:50:30.059721+0000","172.21.15.100:0/1927013046":"2023-12-06T09:59:10.596958+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-05T10:05:02.885 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:02.887+0000 7fca94dff700 1 -- 172.21.15.100:0/3759393515 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fca7806ce70 msgr2=0x7fca7806f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:05:02.885 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:02.887+0000 7fca94dff700 1 --2- 172.21.15.100:0/3759393515 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fca7806ce70 0x7fca7806f320 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fca8000b840 tx=0x7fca80009e30 comp rx=0 tx=0).stop 2023-12-05T10:05:02.885 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:02.887+0000 7fca94dff700 1 -- 172.21.15.100:0/3759393515 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca90102af0 msgr2=0x7fca901137b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:05:02.886 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:02.887+0000 7fca94dff700 1 --2- 172.21.15.100:0/3759393515 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca90102af0 0x7fca901137b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fca84002a50 tx=0x7fca840046b0 comp rx=0 tx=0).stop 2023-12-05T10:05:02.886 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:02.887+0000 7fca94dff700 1 -- 172.21.15.100:0/3759393515 shutdown_connections 2023-12-05T10:05:02.886 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:02.887+0000 7fca94dff700 1 --2- 172.21.15.100:0/3759393515 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fca7806ce70 0x7fca7806f320 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:05:02.886 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:02.887+0000 7fca94dff700 1 --2- 172.21.15.100:0/3759393515 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fca900fcab0 0x7fca90113270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:05:02.886 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:02.887+0000 7fca94dff700 1 --2- 172.21.15.100:0/3759393515 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca90102af0 0x7fca901137b0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:05:02.886 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:02.887+0000 7fca94dff700 1 -- 172.21.15.100:0/3759393515 >> 172.21.15.100:0/3759393515 conn(0x7fca900f85f0 msgr2=0x7fca900fa0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:05:02.886 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:02.887+0000 7fca94dff700 1 -- 172.21.15.100:0/3759393515 shutdown_connections 2023-12-05T10:05:02.886 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:02.888+0000 7fca94dff700 1 -- 172.21.15.100:0/3759393515 wait complete. 2023-12-05T10:05:02.904 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-05T09:52:26.650134+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2023-12-05T09:54:29.310760+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2023-12-05T09:54:29.992340+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-05T10:05:02.904 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-05T10:05:03.101 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.103+0000 7fdf613ff700 1 -- 172.21.15.100:0/2403029101 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf5c102b50 msgr2=0x7fdf5c102f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:05:03.101 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.103+0000 7fdf613ff700 1 --2- 172.21.15.100:0/2403029101 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf5c102b50 0x7fdf5c102f20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c004940 tx=0x7fdf4c009e30 comp rx=0 tx=0).stop 2023-12-05T10:05:03.101 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.103+0000 7fdf613ff700 1 -- 172.21.15.100:0/2403029101 shutdown_connections 2023-12-05T10:05:03.102 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.103+0000 7fdf613ff700 1 --2- 172.21.15.100:0/2403029101 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf5c1034f0 0x7fdf5c0fcb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:05:03.102 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.103+0000 7fdf613ff700 1 --2- 172.21.15.100:0/2403029101 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf5c102b50 0x7fdf5c102f20 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:05:03.102 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.103+0000 7fdf613ff700 1 -- 172.21.15.100:0/2403029101 >> 172.21.15.100:0/2403029101 conn(0x7fdf5c0f8700 msgr2=0x7fdf5c0fab10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:05:03.102 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.103+0000 7fdf613ff700 1 -- 172.21.15.100:0/2403029101 shutdown_connections 2023-12-05T10:05:03.102 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.103+0000 7fdf613ff700 1 -- 172.21.15.100:0/2403029101 wait complete. 2023-12-05T10:05:03.104 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.104+0000 7fdf613ff700 1 Processor -- start 2023-12-05T10:05:03.104 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.104+0000 7fdf613ff700 1 -- start start 2023-12-05T10:05:03.104 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.105+0000 7fdf613ff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf5c102b50 0x7fdf5c1132d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:05:03.104 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.105+0000 7fdf613ff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf5c1034f0 0x7fdf5c113810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:05:03.105 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.105+0000 7fdf613ff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf5c113e60 con 0x7fdf5c1034f0 2023-12-05T10:05:03.105 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.105+0000 7fdf613ff700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf5c10d380 con 0x7fdf5c102b50 2023-12-05T10:05:03.105 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.105+0000 7fdf5a7fc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf5c1034f0 0x7fdf5c113810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:05:03.105 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.105+0000 7fdf5a7fc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf5c1034f0 0x7fdf5c113810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60538/0 (socket says 172.21.15.100:60538) 2023-12-05T10:05:03.105 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.105+0000 7fdf5a7fc700 1 -- 172.21.15.100:0/3899634437 learned_addr learned my addr 172.21.15.100:0/3899634437 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T10:05:03.105 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.105+0000 7fdf5affd700 1 --2- 172.21.15.100:0/3899634437 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf5c102b50 0x7fdf5c1132d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:05:03.105 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.105+0000 7fdf5a7fc700 1 -- 172.21.15.100:0/3899634437 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf5c102b50 msgr2=0x7fdf5c1132d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:05:03.105 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.105+0000 7fdf5a7fc700 1 --2- 172.21.15.100:0/3899634437 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf5c102b50 0x7fdf5c1132d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:05:03.105 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.105+0000 7fdf5a7fc700 1 -- 172.21.15.100:0/3899634437 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf4c005040 con 0x7fdf5c1034f0 2023-12-05T10:05:03.106 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.105+0000 7fdf5a7fc700 1 --2- 172.21.15.100:0/3899634437 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf5c1034f0 0x7fdf5c113810 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdf5000eb40 tx=0x7fdf5000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:05:03.106 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.106+0000 7fdf437fe700 1 -- 172.21.15.100:0/3899634437 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf50007cc0 con 0x7fdf5c1034f0 2023-12-05T10:05:03.106 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.106+0000 7fdf613ff700 1 -- 172.21.15.100:0/3899634437 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf5c10d600 con 0x7fdf5c1034f0 2023-12-05T10:05:03.106 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.106+0000 7fdf437fe700 1 -- 172.21.15.100:0/3899634437 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdf5000f040 con 0x7fdf5c1034f0 2023-12-05T10:05:03.106 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.106+0000 7fdf437fe700 1 -- 172.21.15.100:0/3899634437 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf50009510 con 0x7fdf5c1034f0 2023-12-05T10:05:03.106 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.106+0000 7fdf613ff700 1 -- 172.21.15.100:0/3899634437 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf5c10dbc0 con 0x7fdf5c1034f0 2023-12-05T10:05:03.106 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.107+0000 7fdf613ff700 1 -- 172.21.15.100:0/3899634437 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf5c0ffe60 con 0x7fdf5c1034f0 2023-12-05T10:05:03.107 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.108+0000 7fdf437fe700 1 -- 172.21.15.100:0/3899634437 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fdf50009670 con 0x7fdf5c1034f0 2023-12-05T10:05:03.107 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.109+0000 7fdf437fe700 1 --2- 172.21.15.100:0/3899634437 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fdf4406ce70 0x7fdf4406f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:05:03.107 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.109+0000 7fdf437fe700 1 -- 172.21.15.100:0/3899634437 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6674+0+0 (secure 0 0 0) 0x7fdf5008c0f0 con 0x7fdf5c1034f0 2023-12-05T10:05:03.107 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.109+0000 7fdf5affd700 1 --2- 172.21.15.100:0/3899634437 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fdf4406ce70 0x7fdf4406f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:05:03.107 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.109+0000 7fdf5affd700 1 --2- 172.21.15.100:0/3899634437 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fdf4406ce70 0x7fdf4406f320 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c00b0d0 tx=0x7fdf4c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:05:03.110 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.113+0000 7fdf437fe700 1 -- 172.21.15.100:0/3899634437 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fdf500598b0 con 0x7fdf5c1034f0 2023-12-05T10:05:03.312 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.315+0000 7fdf613ff700 1 -- 172.21.15.100:0/3899634437 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdf5c10e8b0 con 0x7fdf5c1034f0 2023-12-05T10:05:03.313 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.315+0000 7fdf437fe700 1 -- 172.21.15.100:0/3899634437 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v95) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdf50059440 con 0x7fdf5c1034f0 2023-12-05T10:05:03.313 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2023-12-05T10:05:03.315 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.317+0000 7fdf613ff700 1 -- 172.21.15.100:0/3899634437 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fdf4406ce70 msgr2=0x7fdf4406f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:05:03.316 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.317+0000 7fdf613ff700 1 --2- 172.21.15.100:0/3899634437 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fdf4406ce70 0x7fdf4406f320 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c00b0d0 tx=0x7fdf4c009e30 comp rx=0 tx=0).stop 2023-12-05T10:05:03.316 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.317+0000 7fdf613ff700 1 -- 172.21.15.100:0/3899634437 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf5c1034f0 msgr2=0x7fdf5c113810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:05:03.316 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.317+0000 7fdf613ff700 1 --2- 172.21.15.100:0/3899634437 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf5c1034f0 0x7fdf5c113810 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdf5000eb40 tx=0x7fdf5000b040 comp rx=0 tx=0).stop 2023-12-05T10:05:03.316 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.318+0000 7fdf613ff700 1 -- 172.21.15.100:0/3899634437 shutdown_connections 2023-12-05T10:05:03.316 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.318+0000 7fdf613ff700 1 --2- 172.21.15.100:0/3899634437 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fdf4406ce70 0x7fdf4406f320 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:05:03.316 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.318+0000 7fdf613ff700 1 --2- 172.21.15.100:0/3899634437 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf5c102b50 0x7fdf5c1132d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:05:03.316 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.318+0000 7fdf613ff700 1 --2- 172.21.15.100:0/3899634437 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf5c1034f0 0x7fdf5c113810 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:05:03.316 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.318+0000 7fdf613ff700 1 -- 172.21.15.100:0/3899634437 >> 172.21.15.100:0/3899634437 conn(0x7fdf5c0f8700 msgr2=0x7fdf5c0fa1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:05:03.317 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.318+0000 7fdf613ff700 1 -- 172.21.15.100:0/3899634437 shutdown_connections 2023-12-05T10:05:03.317 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.318+0000 7fdf613ff700 1 -- 172.21.15.100:0/3899634437 wait complete. 2023-12-05T10:05:03.334 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2023-12-05T10:05:03.533 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.535+0000 7fa87c5ff700 1 -- 172.21.15.100:0/2147882838 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa874070520 msgr2=0x7fa874070990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:05:03.534 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.535+0000 7fa87c5ff700 1 --2- 172.21.15.100:0/2147882838 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa874070520 0x7fa874070990 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa864004970 tx=0x7fa864009e30 comp rx=0 tx=0).stop 2023-12-05T10:05:03.534 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.535+0000 7fa87c5ff700 1 -- 172.21.15.100:0/2147882838 shutdown_connections 2023-12-05T10:05:03.534 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.535+0000 7fa87c5ff700 1 --2- 172.21.15.100:0/2147882838 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa874070520 0x7fa874070990 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:05:03.534 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.535+0000 7fa87c5ff700 1 --2- 172.21.15.100:0/2147882838 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa874071c10 0x7fa87406ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:05:03.534 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.535+0000 7fa87c5ff700 1 -- 172.21.15.100:0/2147882838 >> 172.21.15.100:0/2147882838 conn(0x7fa8740f86d0 msgr2=0x7fa8740faae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:05:03.534 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.535+0000 7fa87c5ff700 1 -- 172.21.15.100:0/2147882838 shutdown_connections 2023-12-05T10:05:03.534 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.536+0000 7fa87c5ff700 1 -- 172.21.15.100:0/2147882838 wait complete. 2023-12-05T10:05:03.536 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.536+0000 7fa87c5ff700 1 Processor -- start 2023-12-05T10:05:03.536 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.536+0000 7fa87c5ff700 1 -- start start 2023-12-05T10:05:03.536 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.537+0000 7fa87c5ff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa874070520 0x7fa874119900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:05:03.536 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.537+0000 7fa87c5ff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa874071c10 0x7fa874119e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:05:03.537 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.537+0000 7fa87c5ff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa87411a490 con 0x7fa874070520 2023-12-05T10:05:03.537 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.537+0000 7fa87c5ff700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa874113a40 con 0x7fa874071c10 2023-12-05T10:05:03.537 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.537+0000 7fa87a39b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa874070520 0x7fa874119900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:05:03.537 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.537+0000 7fa87a39b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa874070520 0x7fa874119900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60554/0 (socket says 172.21.15.100:60554) 2023-12-05T10:05:03.537 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.537+0000 7fa87a39b700 1 -- 172.21.15.100:0/3339197716 learned_addr learned my addr 172.21.15.100:0/3339197716 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T10:05:03.537 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.537+0000 7fa879b9a700 1 --2- 172.21.15.100:0/3339197716 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa874071c10 0x7fa874119e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:05:03.537 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.537+0000 7fa87a39b700 1 -- 172.21.15.100:0/3339197716 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa874071c10 msgr2=0x7fa874119e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:05:03.537 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.537+0000 7fa87a39b700 1 --2- 172.21.15.100:0/3339197716 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa874071c10 0x7fa874119e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:05:03.537 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.537+0000 7fa87a39b700 1 -- 172.21.15.100:0/3339197716 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa864005040 con 0x7fa874070520 2023-12-05T10:05:03.538 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.538+0000 7fa87a39b700 1 --2- 172.21.15.100:0/3339197716 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa874070520 0x7fa874119900 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa870002a50 tx=0x7fa8700046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:05:03.538 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.538+0000 7fa86affd700 1 -- 172.21.15.100:0/3339197716 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa870007cc0 con 0x7fa874070520 2023-12-05T10:05:03.538 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.538+0000 7fa86affd700 1 -- 172.21.15.100:0/3339197716 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa87000f040 con 0x7fa874070520 2023-12-05T10:05:03.538 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.538+0000 7fa87c5ff700 1 -- 172.21.15.100:0/3339197716 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa874113d20 con 0x7fa874070520 2023-12-05T10:05:03.538 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.538+0000 7fa86affd700 1 -- 172.21.15.100:0/3339197716 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa870009540 con 0x7fa874070520 2023-12-05T10:05:03.538 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.538+0000 7fa87c5ff700 1 -- 172.21.15.100:0/3339197716 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa874114230 con 0x7fa874070520 2023-12-05T10:05:03.539 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.539+0000 7fa87c5ff700 1 -- 172.21.15.100:0/3339197716 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8740fdff0 con 0x7fa874070520 2023-12-05T10:05:03.539 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.540+0000 7fa86affd700 1 -- 172.21.15.100:0/3339197716 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fa8700096a0 con 0x7fa874070520 2023-12-05T10:05:03.539 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.541+0000 7fa86affd700 1 --2- 172.21.15.100:0/3339197716 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fa86006ce70 0x7fa86006f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:05:03.539 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.541+0000 7fa86affd700 1 -- 172.21.15.100:0/3339197716 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6674+0+0 (secure 0 0 0) 0x7fa87008c0f0 con 0x7fa874070520 2023-12-05T10:05:03.540 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.541+0000 7fa879b9a700 1 --2- 172.21.15.100:0/3339197716 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fa86006ce70 0x7fa86006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:05:03.540 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.541+0000 7fa879b9a700 1 --2- 172.21.15.100:0/3339197716 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fa86006ce70 0x7fa86006f320 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa874114d70 tx=0x7fa864009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:05:03.542 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.545+0000 7fa86affd700 1 -- 172.21.15.100:0/3339197716 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fa8700599d0 con 0x7fa874070520 2023-12-05T10:05:03.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:05:03 smithi150 ceph-mon[171606]: pgmap v223: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:05:03.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:05:03 smithi150 ceph-mon[171606]: from='client.? 172.21.15.100:0/3759393515' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-05T10:05:03.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:05:03 smithi100 ceph-mon[187528]: pgmap v223: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:05:03.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:05:03 smithi100 ceph-mon[187528]: from='client.? 172.21.15.100:0/3759393515' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-05T10:05:03.740 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.743+0000 7fa87c5ff700 1 -- 172.21.15.100:0/3339197716 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7fa874110120 con 0x7fa874070520 2023-12-05T10:05:03.741 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.743+0000 7fa86affd700 1 -- 172.21.15.100:0/3339197716 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v95) v1 ==== 107+0+11 (secure 0 0 0) 0x7fa870059560 con 0x7fa874070520 2023-12-05T10:05:03.741 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2023-12-05T10:05:03.743 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.746+0000 7fa87c5ff700 1 -- 172.21.15.100:0/3339197716 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fa86006ce70 msgr2=0x7fa86006f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:05:03.743 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.746+0000 7fa87c5ff700 1 --2- 172.21.15.100:0/3339197716 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fa86006ce70 0x7fa86006f320 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa874114d70 tx=0x7fa864009e30 comp rx=0 tx=0).stop 2023-12-05T10:05:03.744 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.746+0000 7fa87c5ff700 1 -- 172.21.15.100:0/3339197716 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa874070520 msgr2=0x7fa874119900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:05:03.744 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.746+0000 7fa87c5ff700 1 --2- 172.21.15.100:0/3339197716 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa874070520 0x7fa874119900 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa870002a50 tx=0x7fa8700046b0 comp rx=0 tx=0).stop 2023-12-05T10:05:03.744 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.746+0000 7fa87c5ff700 1 -- 172.21.15.100:0/3339197716 shutdown_connections 2023-12-05T10:05:03.744 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.746+0000 7fa87c5ff700 1 --2- 172.21.15.100:0/3339197716 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fa86006ce70 0x7fa86006f320 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:05:03.744 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.746+0000 7fa87c5ff700 1 --2- 172.21.15.100:0/3339197716 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa874070520 0x7fa874119900 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:05:03.744 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.746+0000 7fa87c5ff700 1 --2- 172.21.15.100:0/3339197716 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa874071c10 0x7fa874119e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:05:03.744 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.746+0000 7fa87c5ff700 1 -- 172.21.15.100:0/3339197716 >> 172.21.15.100:0/3339197716 conn(0x7fa8740f86d0 msgr2=0x7fa87410b890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:05:03.744 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.746+0000 7fa87c5ff700 1 -- 172.21.15.100:0/3339197716 shutdown_connections 2023-12-05T10:05:03.745 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.746+0000 7fa87c5ff700 1 -- 172.21.15.100:0/3339197716 wait complete. 2023-12-05T10:05:03.762 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2023-12-05T10:05:03.958 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.960+0000 7fd56c7ff700 1 -- 172.21.15.100:0/2644402594 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd564102b40 msgr2=0x7fd564102f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:05:03.958 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.960+0000 7fd56c7ff700 1 --2- 172.21.15.100:0/2644402594 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd564102b40 0x7fd564102f10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd560004940 tx=0x7fd560009e30 comp rx=0 tx=0).stop 2023-12-05T10:05:03.958 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.960+0000 7fd56c7ff700 1 -- 172.21.15.100:0/2644402594 shutdown_connections 2023-12-05T10:05:03.958 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.960+0000 7fd56c7ff700 1 --2- 172.21.15.100:0/2644402594 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5641034e0 0x7fd5640fcb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:05:03.958 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.960+0000 7fd56c7ff700 1 --2- 172.21.15.100:0/2644402594 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd564102b40 0x7fd564102f10 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:05:03.958 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.960+0000 7fd56c7ff700 1 -- 172.21.15.100:0/2644402594 >> 172.21.15.100:0/2644402594 conn(0x7fd5640f86d0 msgr2=0x7fd5640faae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:05:03.959 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.960+0000 7fd56c7ff700 1 -- 172.21.15.100:0/2644402594 shutdown_connections 2023-12-05T10:05:03.959 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.960+0000 7fd56c7ff700 1 -- 172.21.15.100:0/2644402594 wait complete. 2023-12-05T10:05:03.960 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.961+0000 7fd56c7ff700 1 Processor -- start 2023-12-05T10:05:03.960 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.961+0000 7fd56c7ff700 1 -- start start 2023-12-05T10:05:03.960 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.961+0000 7fd56c7ff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd564102b40 0x7fd564115560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:05:03.961 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.961+0000 7fd56c7ff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5641034e0 0x7fd564115aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:05:03.961 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.961+0000 7fd56c7ff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5641160f0 con 0x7fd5641034e0 2023-12-05T10:05:03.961 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.961+0000 7fd56c7ff700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd56410f630 con 0x7fd564102b40 2023-12-05T10:05:03.961 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.961+0000 7fd569d9a700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5641034e0 0x7fd564115aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:05:03.961 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.961+0000 7fd569d9a700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5641034e0 0x7fd564115aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60582/0 (socket says 172.21.15.100:60582) 2023-12-05T10:05:03.961 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.961+0000 7fd569d9a700 1 -- 172.21.15.100:0/3787118310 learned_addr learned my addr 172.21.15.100:0/3787118310 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T10:05:03.961 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.961+0000 7fd56a59b700 1 --2- 172.21.15.100:0/3787118310 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd564102b40 0x7fd564115560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:05:03.961 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.962+0000 7fd569d9a700 1 -- 172.21.15.100:0/3787118310 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd564102b40 msgr2=0x7fd564115560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:05:03.961 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.962+0000 7fd569d9a700 1 --2- 172.21.15.100:0/3787118310 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd564102b40 0x7fd564115560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:05:03.962 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.962+0000 7fd569d9a700 1 -- 172.21.15.100:0/3787118310 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd560005040 con 0x7fd5641034e0 2023-12-05T10:05:03.962 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.962+0000 7fd569d9a700 1 --2- 172.21.15.100:0/3787118310 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5641034e0 0x7fd564115aa0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd55400c890 tx=0x7fd5540044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:05:03.962 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.962+0000 7fd55affd700 1 -- 172.21.15.100:0/3787118310 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd55400a7d0 con 0x7fd5641034e0 2023-12-05T10:05:03.962 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.962+0000 7fd55affd700 1 -- 172.21.15.100:0/3787118310 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd55400ade0 con 0x7fd5641034e0 2023-12-05T10:05:03.962 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.962+0000 7fd56c7ff700 1 -- 172.21.15.100:0/3787118310 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd56410f910 con 0x7fd5641034e0 2023-12-05T10:05:03.962 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.962+0000 7fd55affd700 1 -- 172.21.15.100:0/3787118310 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5540113a0 con 0x7fd5641034e0 2023-12-05T10:05:03.962 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.962+0000 7fd56c7ff700 1 -- 172.21.15.100:0/3787118310 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd56410fed0 con 0x7fd5641034e0 2023-12-05T10:05:03.963 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.963+0000 7fd56c7ff700 1 -- 172.21.15.100:0/3787118310 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd564064730 con 0x7fd5641034e0 2023-12-05T10:05:03.963 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.964+0000 7fd55affd700 1 -- 172.21.15.100:0/3787118310 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fd554012400 con 0x7fd5641034e0 2023-12-05T10:05:03.964 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.966+0000 7fd55affd700 1 --2- 172.21.15.100:0/3787118310 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fd55006ce60 0x7fd55006f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:05:03.964 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.966+0000 7fd55affd700 1 -- 172.21.15.100:0/3787118310 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6674+0+0 (secure 0 0 0) 0x7fd55408c460 con 0x7fd5641034e0 2023-12-05T10:05:03.964 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.967+0000 7fd56a59b700 1 --2- 172.21.15.100:0/3787118310 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fd55006ce60 0x7fd55006f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:05:03.965 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.967+0000 7fd56a59b700 1 --2- 172.21.15.100:0/3787118310 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fd55006ce60 0x7fd55006f310 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd560004f90 tx=0x7fd560009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:05:03.968 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:03.970+0000 7fd55affd700 1 -- 172.21.15.100:0/3787118310 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fd554059d20 con 0x7fd5641034e0 2023-12-05T10:05:04.167 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:04.170+0000 7fd56c7ff700 1 -- 172.21.15.100:0/3787118310 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7fd564110bd0 con 0x7fd5641034e0 2023-12-05T10:05:04.168 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:04.170+0000 7fd55affd700 1 -- 172.21.15.100:0/3787118310 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v95) v1 ==== 107+0+11 (secure 0 0 0) 0x7fd5540598b0 con 0x7fd5641034e0 2023-12-05T10:05:04.168 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2023-12-05T10:05:04.170 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:04.173+0000 7fd56c7ff700 1 -- 172.21.15.100:0/3787118310 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fd55006ce60 msgr2=0x7fd55006f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:05:04.170 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:04.173+0000 7fd56c7ff700 1 --2- 172.21.15.100:0/3787118310 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fd55006ce60 0x7fd55006f310 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd560004f90 tx=0x7fd560009e30 comp rx=0 tx=0).stop 2023-12-05T10:05:04.170 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:04.173+0000 7fd56c7ff700 1 -- 172.21.15.100:0/3787118310 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5641034e0 msgr2=0x7fd564115aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:05:04.171 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:04.173+0000 7fd56c7ff700 1 --2- 172.21.15.100:0/3787118310 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5641034e0 0x7fd564115aa0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd55400c890 tx=0x7fd5540044c0 comp rx=0 tx=0).stop 2023-12-05T10:05:04.171 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:04.173+0000 7fd56c7ff700 1 -- 172.21.15.100:0/3787118310 shutdown_connections 2023-12-05T10:05:04.171 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:04.173+0000 7fd56c7ff700 1 --2- 172.21.15.100:0/3787118310 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fd55006ce60 0x7fd55006f310 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:05:04.171 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:04.173+0000 7fd56c7ff700 1 --2- 172.21.15.100:0/3787118310 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd564102b40 0x7fd564115560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:05:04.171 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:04.173+0000 7fd56c7ff700 1 --2- 172.21.15.100:0/3787118310 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5641034e0 0x7fd564115aa0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:05:04.171 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:04.173+0000 7fd56c7ff700 1 -- 172.21.15.100:0/3787118310 >> 172.21.15.100:0/3787118310 conn(0x7fd5640f86d0 msgr2=0x7fd5640fa0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:05:04.171 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:04.173+0000 7fd56c7ff700 1 -- 172.21.15.100:0/3787118310 shutdown_connections 2023-12-05T10:05:04.171 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:04.173+0000 7fd56c7ff700 1 -- 172.21.15.100:0/3787118310 wait complete. 2023-12-05T10:05:04.188 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-05T10:05:04.387 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:04.387+0000 7f795e9ff700 1 -- 172.21.15.100:0/829501684 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f795806ffe0 msgr2=0x7f79580703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:05:04.388 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:04.387+0000 7f795e9ff700 1 --2- 172.21.15.100:0/829501684 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f795806ffe0 0x7f79580703b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7948004970 tx=0x7f7948009e30 comp rx=0 tx=0).stop 2023-12-05T10:05:04.388 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:04.387+0000 7f795e9ff700 1 -- 172.21.15.100:0/829501684 shutdown_connections 2023-12-05T10:05:04.388 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:04.387+0000 7f795e9ff700 1 --2- 172.21.15.100:0/829501684 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79580708f0 0x7f7958108e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:05:04.388 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:04.387+0000 7f795e9ff700 1 --2- 172.21.15.100:0/829501684 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f795806ffe0 0x7f79580703b0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:05:04.388 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:04.387+0000 7f795e9ff700 1 -- 172.21.15.100:0/829501684 >> 172.21.15.100:0/829501684 conn(0x7f79580f86d0 msgr2=0x7f79580faae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:05:04.388 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:04.387+0000 7f795e9ff700 1 -- 172.21.15.100:0/829501684 shutdown_connections 2023-12-05T10:05:04.389 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:04.387+0000 7f795e9ff700 1 -- 172.21.15.100:0/829501684 wait complete. 2023-12-05T10:05:04.389 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:04.388+0000 7f795e9ff700 1 Processor -- start 2023-12-05T10:05:04.389 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:04.388+0000 7f795e9ff700 1 -- start start 2023-12-05T10:05:04.389 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:04.388+0000 7f795e9ff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f795806ffe0 0x7f7958115520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:05:04.389 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:04.388+0000 7f795e9ff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79580708f0 0x7f7958115a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:05:04.389 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:04.388+0000 7f795e9ff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79581160b0 con 0x7f795806ffe0 2023-12-05T10:05:04.389 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:04.388+0000 7f795e9ff700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f795810f5f0 con 0x7f79580708f0 2023-12-05T10:05:04.390 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:04.388+0000 7f7957fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f795806ffe0 0x7f7958115520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:05:04.390 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:04.389+0000 7f7957fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f795806ffe0 0x7f7958115520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60608/0 (socket says 172.21.15.100:60608) 2023-12-05T10:05:04.390 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:04.389+0000 7f7957fff700 1 -- 172.21.15.100:0/3102120270 learned_addr learned my addr 172.21.15.100:0/3102120270 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T10:05:04.390 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:04.389+0000 7f79577fe700 1 --2- 172.21.15.100:0/3102120270 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79580708f0 0x7f7958115a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:05:04.390 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:04.389+0000 7f7957fff700 1 -- 172.21.15.100:0/3102120270 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79580708f0 msgr2=0x7f7958115a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:05:04.391 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:04.389+0000 7f7957fff700 1 --2- 172.21.15.100:0/3102120270 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79580708f0 0x7f7958115a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:05:04.391 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:04.389+0000 7f7957fff700 1 -- 172.21.15.100:0/3102120270 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7948005040 con 0x7f795806ffe0 2023-12-05T10:05:04.391 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:04.389+0000 7f79577fe700 1 --2- 172.21.15.100:0/3102120270 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79580708f0 0x7f7958115a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-05T10:05:04.391 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:04.389+0000 7f7957fff700 1 --2- 172.21.15.100:0/3102120270 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f795806ffe0 0x7f7958115520 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7948005010 tx=0x7f7948009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:05:04.391 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:04.389+0000 7f7954ff9700 1 -- 172.21.15.100:0/3102120270 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f794800e040 con 0x7f795806ffe0 2023-12-05T10:05:04.392 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:04.389+0000 7f7954ff9700 1 -- 172.21.15.100:0/3102120270 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7948004290 con 0x7f795806ffe0 2023-12-05T10:05:04.392 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:04.389+0000 7f7954ff9700 1 -- 172.21.15.100:0/3102120270 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f794801c3f0 con 0x7f795806ffe0 2023-12-05T10:05:04.392 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:04.389+0000 7f795e9ff700 1 -- 172.21.15.100:0/3102120270 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f795810f870 con 0x7f795806ffe0 2023-12-05T10:05:04.392 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:04.390+0000 7f795e9ff700 1 -- 172.21.15.100:0/3102120270 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f795810fdb0 con 0x7f795806ffe0 2023-12-05T10:05:04.395 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:04.391+0000 7f795e9ff700 1 -- 172.21.15.100:0/3102120270 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7958106510 con 0x7f795806ffe0 2023-12-05T10:05:04.395 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:04.391+0000 7f7954ff9700 1 -- 172.21.15.100:0/3102120270 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f7948013420 con 0x7f795806ffe0 2023-12-05T10:05:04.395 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:04.392+0000 7f7954ff9700 1 --2- 172.21.15.100:0/3102120270 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f794006ce70 0x7f794006f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:05:04.395 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:04.392+0000 7f7954ff9700 1 -- 172.21.15.100:0/3102120270 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6674+0+0 (secure 0 0 0) 0x7f794808d7f0 con 0x7f795806ffe0 2023-12-05T10:05:04.396 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:04.393+0000 7f79577fe700 1 --2- 172.21.15.100:0/3102120270 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f794006ce70 0x7f794006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:05:04.396 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:04.393+0000 7f79577fe700 1 --2- 172.21.15.100:0/3102120270 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f794006ce70 0x7f794006f320 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7958110dc0 tx=0x7f794c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:05:04.396 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:04.396+0000 7f7954ff9700 1 -- 172.21.15.100:0/3102120270 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f794805b0e0 con 0x7f795806ffe0 2023-12-05T10:05:04.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:05:04 smithi150 ceph-mon[171606]: from='client.? 172.21.15.100:0/3899634437' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-05T10:05:04.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:05:04 smithi150 ceph-mon[171606]: from='client.? 172.21.15.100:0/3339197716' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-05T10:05:04.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:05:04 smithi150 ceph-mon[171606]: from='client.? 172.21.15.100:0/3787118310' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-05T10:05:04.611 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:04.614+0000 7f795e9ff700 1 -- 172.21.15.100:0/3102120270 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7958110b00 con 0x7f795806ffe0 2023-12-05T10:05:04.612 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:04.614+0000 7f7954ff9700 1 -- 172.21.15.100:0/3102120270 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 39 entries v95) v1 ==== 81+0+2335 (secure 0 0 0) 0x7f794805ac70 con 0x7f795806ffe0 2023-12-05T10:05:04.612 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/1442740471 2023-12-06T09:59:10.596958+0000 2023-12-05T10:05:04.612 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/2319392996 2023-12-06T09:59:10.596958+0000 2023-12-05T10:05:04.612 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:6800/2397627746 2023-12-06T09:50:30.059721+0000 2023-12-05T10:05:04.612 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.150:0/45306857 2023-12-06T09:58:01.227505+0000 2023-12-05T10:05:04.612 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/4197065049 2023-12-06T09:50:30.059721+0000 2023-12-05T10:05:04.612 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.150:0/1284624117 2023-12-06T09:58:01.227505+0000 2023-12-05T10:05:04.613 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.150:6829/896268868 2023-12-06T09:58:01.227505+0000 2023-12-05T10:05:04.613 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/2992397636 2023-12-06T09:49:01.007941+0000 2023-12-05T10:05:04.613 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/2175139133 2023-12-06T09:56:31.887692+0000 2023-12-05T10:05:04.613 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.150:0/3463685537 2023-12-06T09:58:01.227505+0000 2023-12-05T10:05:04.613 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/3456039235 2023-12-06T09:56:31.887692+0000 2023-12-05T10:05:04.613 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/1529397750 2023-12-06T09:49:28.559106+0000 2023-12-05T10:05:04.613 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:6800/3060005571 2023-12-06T09:59:10.596958+0000 2023-12-05T10:05:04.613 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:6801/1237547575 2023-12-06T09:56:31.887692+0000 2023-12-05T10:05:04.613 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:6800/3606837497 2023-12-06T09:49:01.007941+0000 2023-12-05T10:05:04.614 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:6801/3060005571 2023-12-06T09:59:10.596958+0000 2023-12-05T10:05:04.614 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/556453695 2023-12-06T09:49:28.559106+0000 2023-12-05T10:05:04.614 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/567522562 2023-12-06T09:49:01.007941+0000 2023-12-05T10:05:04.614 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/4217799370 2023-12-06T09:59:10.596958+0000 2023-12-05T10:05:04.614 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/2280374959 2023-12-06T09:56:31.887692+0000 2023-12-05T10:05:04.614 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.150:0/2303343881 2023-12-06T09:58:01.227505+0000 2023-12-05T10:05:04.614 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:6800/1237547575 2023-12-06T09:56:31.887692+0000 2023-12-05T10:05:04.614 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.150:0/3272897294 2023-12-06T09:58:01.227505+0000 2023-12-05T10:05:04.615 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:6801/3606837497 2023-12-06T09:49:01.007941+0000 2023-12-05T10:05:04.615 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/737517101 2023-12-06T09:50:30.059721+0000 2023-12-05T10:05:04.615 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/4027037785 2023-12-06T09:59:10.596958+0000 2023-12-05T10:05:04.615 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.150:0/4245341459 2023-12-06T09:58:01.227505+0000 2023-12-05T10:05:04.615 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:6826/3068237273 2023-12-06T09:54:43.391103+0000 2023-12-05T10:05:04.615 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.150:6828/896268868 2023-12-06T09:58:01.227505+0000 2023-12-05T10:05:04.615 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/2400356084 2023-12-06T09:49:01.007941+0000 2023-12-05T10:05:04.615 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/485886590 2023-12-06T09:56:31.887692+0000 2023-12-05T10:05:04.615 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/3942224339 2023-12-06T09:49:28.559106+0000 2023-12-05T10:05:04.615 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:6827/3068237273 2023-12-06T09:54:43.391103+0000 2023-12-05T10:05:04.616 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:6800/2647899624 2023-12-06T09:49:28.559106+0000 2023-12-05T10:05:04.616 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:6801/2647899624 2023-12-06T09:49:28.559106+0000 2023-12-05T10:05:04.616 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/2826914555 2023-12-06T09:50:30.059721+0000 2023-12-05T10:05:04.616 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/1388385571 2023-12-06T09:59:10.596958+0000 2023-12-05T10:05:04.616 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:6801/2397627746 2023-12-06T09:50:30.059721+0000 2023-12-05T10:05:04.616 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/1927013046 2023-12-06T09:59:10.596958+0000 2023-12-05T10:05:04.617 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:04.616+0000 7f795e9ff700 1 -- 172.21.15.100:0/3102120270 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f794006ce70 msgr2=0x7f794006f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:05:04.617 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:04.616+0000 7f795e9ff700 1 --2- 172.21.15.100:0/3102120270 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f794006ce70 0x7f794006f320 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7958110dc0 tx=0x7f794c00b040 comp rx=0 tx=0).stop 2023-12-05T10:05:04.618 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:04.616+0000 7f795e9ff700 1 -- 172.21.15.100:0/3102120270 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f795806ffe0 msgr2=0x7f7958115520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:05:04.618 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:04.616+0000 7f795e9ff700 1 --2- 172.21.15.100:0/3102120270 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f795806ffe0 0x7f7958115520 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7948005010 tx=0x7f7948009e30 comp rx=0 tx=0).stop 2023-12-05T10:05:04.618 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:04.616+0000 7f795e9ff700 1 -- 172.21.15.100:0/3102120270 shutdown_connections 2023-12-05T10:05:04.618 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:04.616+0000 7f795e9ff700 1 --2- 172.21.15.100:0/3102120270 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f794006ce70 0x7f794006f320 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:05:04.618 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:04.616+0000 7f795e9ff700 1 --2- 172.21.15.100:0/3102120270 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f795806ffe0 0x7f7958115520 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:05:04.618 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:04.616+0000 7f795e9ff700 1 --2- 172.21.15.100:0/3102120270 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79580708f0 0x7f7958115a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:05:04.618 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:04.617+0000 7f795e9ff700 1 -- 172.21.15.100:0/3102120270 >> 172.21.15.100:0/3102120270 conn(0x7f79580f86d0 msgr2=0x7f7958103690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:05:04.618 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:04.617+0000 7f795e9ff700 1 -- 172.21.15.100:0/3102120270 shutdown_connections 2023-12-05T10:05:04.619 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:04.617+0000 7f795e9ff700 1 -- 172.21.15.100:0/3102120270 wait complete. 2023-12-05T10:05:04.619 INFO:teuthology.orchestra.run.smithi100.stderr:listed 39 entries 2023-12-05T10:05:04.630 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:05:04 smithi100 ceph-mon[187528]: from='client.? 172.21.15.100:0/3899634437' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-05T10:05:04.630 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:05:04 smithi100 ceph-mon[187528]: from='client.? 172.21.15.100:0/3339197716' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-05T10:05:04.630 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:05:04 smithi100 ceph-mon[187528]: from='client.? 172.21.15.100:0/3787118310' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-05T10:05:04.632 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-05T10:05:04.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T10:05:04.632 DEBUG:teuthology.orchestra.run.smithi100:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-05T10:05:04.711 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi100.front.sepia.ceph.com 2023-12-05T10:05:04.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T10:05:04.712 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-05T10:05:04.798 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-12-05T10:05:04.799 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-05T10:05:04.900 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-12-05T10:05:04.900 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-05T10:05:04.947 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-05T10:05:05.142 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.144+0000 7f266c3ff700 1 -- 172.21.15.100:0/1536348553 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26640fca90 msgr2=0x7f26640fcf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:05:05.142 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.144+0000 7f266c3ff700 1 --2- 172.21.15.100:0/1536348553 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26640fca90 0x7f26640fcf00 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2654004940 tx=0x7f2654009e30 comp rx=0 tx=0).stop 2023-12-05T10:05:05.142 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.144+0000 7f266c3ff700 1 -- 172.21.15.100:0/1536348553 shutdown_connections 2023-12-05T10:05:05.143 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.144+0000 7f266c3ff700 1 --2- 172.21.15.100:0/1536348553 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26640fca90 0x7f26640fcf00 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:05:05.143 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.144+0000 7f266c3ff700 1 --2- 172.21.15.100:0/1536348553 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2664102ad0 0x7f2664102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:05:05.143 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.144+0000 7f266c3ff700 1 -- 172.21.15.100:0/1536348553 >> 172.21.15.100:0/1536348553 conn(0x7f26640f8630 msgr2=0x7f26640faa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:05:05.143 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.144+0000 7f266c3ff700 1 -- 172.21.15.100:0/1536348553 shutdown_connections 2023-12-05T10:05:05.143 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.144+0000 7f266c3ff700 1 -- 172.21.15.100:0/1536348553 wait complete. 2023-12-05T10:05:05.145 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.145+0000 7f266c3ff700 1 Processor -- start 2023-12-05T10:05:05.145 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.145+0000 7f266c3ff700 1 -- start start 2023-12-05T10:05:05.145 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.145+0000 7f266c3ff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26640fca90 0x7f26641153d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:05:05.145 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.145+0000 7f266c3ff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2664102ad0 0x7f2664115910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:05:05.145 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.145+0000 7f266c3ff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2664115f60 con 0x7f2664102ad0 2023-12-05T10:05:05.146 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.145+0000 7f266c3ff700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f266410f4c0 con 0x7f26640fca90 2023-12-05T10:05:05.146 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.146+0000 7f266999a700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2664102ad0 0x7f2664115910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:05:05.146 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.146+0000 7f266999a700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2664102ad0 0x7f2664115910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60636/0 (socket says 172.21.15.100:60636) 2023-12-05T10:05:05.146 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.146+0000 7f266999a700 1 -- 172.21.15.100:0/1798270303 learned_addr learned my addr 172.21.15.100:0/1798270303 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T10:05:05.146 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.146+0000 7f266a19b700 1 --2- 172.21.15.100:0/1798270303 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26640fca90 0x7f26641153d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:05:05.146 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.146+0000 7f266999a700 1 -- 172.21.15.100:0/1798270303 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26640fca90 msgr2=0x7f26641153d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:05:05.146 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.146+0000 7f266999a700 1 --2- 172.21.15.100:0/1798270303 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26640fca90 0x7f26641153d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:05:05.146 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.146+0000 7f266999a700 1 -- 172.21.15.100:0/1798270303 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2654005040 con 0x7f2664102ad0 2023-12-05T10:05:05.147 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.146+0000 7f266999a700 1 --2- 172.21.15.100:0/1798270303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2664102ad0 0x7f2664115910 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2654009180 tx=0x7f2654009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:05:05.147 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.146+0000 7f265affd700 1 -- 172.21.15.100:0/1798270303 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f265400e040 con 0x7f2664102ad0 2023-12-05T10:05:05.147 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.147+0000 7f266c3ff700 1 -- 172.21.15.100:0/1798270303 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f266410f740 con 0x7f2664102ad0 2023-12-05T10:05:05.147 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.147+0000 7f265affd700 1 -- 172.21.15.100:0/1798270303 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2654004290 con 0x7f2664102ad0 2023-12-05T10:05:05.147 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.147+0000 7f266c3ff700 1 -- 172.21.15.100:0/1798270303 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f266410fd00 con 0x7f2664102ad0 2023-12-05T10:05:05.147 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.147+0000 7f265affd700 1 -- 172.21.15.100:0/1798270303 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2654025400 con 0x7f2664102ad0 2023-12-05T10:05:05.148 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.148+0000 7f266c3ff700 1 -- 172.21.15.100:0/1798270303 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2664063ea0 con 0x7f2664102ad0 2023-12-05T10:05:05.148 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.149+0000 7f265affd700 1 -- 172.21.15.100:0/1798270303 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f2654013420 con 0x7f2664102ad0 2023-12-05T10:05:05.148 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.150+0000 7f265affd700 1 --2- 172.21.15.100:0/1798270303 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f265006ce60 0x7f265006f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:05:05.148 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.150+0000 7f265affd700 1 -- 172.21.15.100:0/1798270303 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6674+0+0 (secure 0 0 0) 0x7f265408d6a0 con 0x7f2664102ad0 2023-12-05T10:05:05.149 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.150+0000 7f266a19b700 1 --2- 172.21.15.100:0/1798270303 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f265006ce60 0x7f265006f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:05:05.149 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.151+0000 7f266a19b700 1 --2- 172.21.15.100:0/1798270303 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f265006ce60 0x7f265006f310 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f26600041d0 tx=0x7f26600043c0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:05:05.152 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.155+0000 7f265affd700 1 -- 172.21.15.100:0/1798270303 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f26540574f0 con 0x7f2664102ad0 2023-12-05T10:05:05.356 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.359+0000 7f266c3ff700 1 -- 172.21.15.100:0/1798270303 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f266410ff70 con 0x7f2664102ad0 2023-12-05T10:05:05.357 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.360+0000 7f265affd700 1 -- 172.21.15.100:0/1798270303 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+16891 (secure 0 0 0) 0x7f265405ab10 con 0x7f2664102ad0 2023-12-05T10:05:05.358 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-05T10:05:05.358 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":95,"fsid":"5b035ce6-9353-11ee-95a2-87774f69a715","created":"2023-12-05T09:48:33.718763+0000","modified":"2023-12-05T10:03:26.158142+0000","last_up_change":"2023-12-05T10:03:25.155854+0000","last_in_change":"2023-12-05T09:53:15.176570+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-05T09:52:26.650134+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2023-12-05T09:54:29.310760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2023-12-05T09:54:29.992340+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9f3faeed-8336-4509-9127-eafa0273ecea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":51,"up_from":55,"up_thru":94,"down_at":52,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":4132114326},{"type":"v1","addr":"172.21.15.100:6803","nonce":4132114326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":4132114326},{"type":"v1","addr":"172.21.15.100:6805","nonce":4132114326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":4132114326},{"type":"v1","addr":"172.21.15.100:6809","nonce":4132114326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":4132114326},{"type":"v1","addr":"172.21.15.100:6807","nonce":4132114326}]},"public_addr":"172.21.15.100:6803/4132114326","cluster_addr":"172.21.15.100:6805/4132114326","heartbeat_back_addr":"172.21.15.100:6809/4132114326","heartbeat_front_addr":"172.21.15.100:6807/4132114326","state":["exists","up"]},{"osd":1,"uuid":"6ca8c1e2-e673-4dc4-b02d-c0805493bcf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":56,"up_from":60,"up_thru":94,"down_at":57,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":726756154},{"type":"v1","addr":"172.21.15.100:6811","nonce":726756154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":726756154},{"type":"v1","addr":"172.21.15.100:6813","nonce":726756154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":726756154},{"type":"v1","addr":"172.21.15.100:6817","nonce":726756154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":726756154},{"type":"v1","addr":"172.21.15.100:6815","nonce":726756154}]},"public_addr":"172.21.15.100:6811/726756154","cluster_addr":"172.21.15.100:6813/726756154","heartbeat_back_addr":"172.21.15.100:6817/726756154","heartbeat_front_addr":"172.21.15.100:6815/726756154","state":["exists","up"]},{"osd":2,"uuid":"59a55cb9-28ae-4485-8cbf-e5f6224bd377","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":61,"up_from":65,"up_thru":94,"down_at":62,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":4210799164},{"type":"v1","addr":"172.21.15.100:6819","nonce":4210799164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":4210799164},{"type":"v1","addr":"172.21.15.100:6821","nonce":4210799164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4210799164},{"type":"v1","addr":"172.21.15.100:6825","nonce":4210799164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":4210799164},{"type":"v1","addr":"172.21.15.100:6823","nonce":4210799164}]},"public_addr":"172.21.15.100:6819/4210799164","cluster_addr":"172.21.15.100:6821/4210799164","heartbeat_back_addr":"172.21.15.100:6825/4210799164","heartbeat_front_addr":"172.21.15.100:6823/4210799164","state":["exists","up"]},{"osd":3,"uuid":"e12b505f-7f0c-4d6f-b039-5aa793f79db0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":26,"last_clean_end":66,"up_from":76,"up_thru":94,"down_at":67,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":1106863242},{"type":"v1","addr":"172.21.15.150:6801","nonce":1106863242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":1106863242},{"type":"v1","addr":"172.21.15.150:6803","nonce":1106863242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":1106863242},{"type":"v1","addr":"172.21.15.150:6807","nonce":1106863242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":1106863242},{"type":"v1","addr":"172.21.15.150:6805","nonce":1106863242}]},"public_addr":"172.21.15.150:6801/1106863242","cluster_addr":"172.21.15.150:6803/1106863242","heartbeat_back_addr":"172.21.15.150:6807/1106863242","heartbeat_front_addr":"172.21.15.150:6805/1106863242","state":["exists","up"]},{"osd":4,"uuid":"33fbbf55-86ba-4e7f-a66b-e958dce72283","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":34,"last_clean_end":82,"up_from":86,"up_thru":94,"down_at":83,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":1252141235},{"type":"v1","addr":"172.21.15.150:6809","nonce":1252141235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":1252141235},{"type":"v1","addr":"172.21.15.150:6811","nonce":1252141235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":1252141235},{"type":"v1","addr":"172.21.15.150:6815","nonce":1252141235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":1252141235},{"type":"v1","addr":"172.21.15.150:6813","nonce":1252141235}]},"public_addr":"172.21.15.150:6809/1252141235","cluster_addr":"172.21.15.150:6811/1252141235","heartbeat_back_addr":"172.21.15.150:6815/1252141235","heartbeat_front_addr":"172.21.15.150:6813/1252141235","state":["exists","up"]},{"osd":5,"uuid":"93b2d10b-0410-4390-9283-b4129c0439d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":39,"last_clean_end":89,"up_from":94,"up_thru":94,"down_at":90,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":730066362},{"type":"v1","addr":"172.21.15.150:6817","nonce":730066362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":730066362},{"type":"v1","addr":"172.21.15.150:6819","nonce":730066362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":730066362},{"type":"v1","addr":"172.21.15.150:6823","nonce":730066362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":730066362},{"type":"v1","addr":"172.21.15.150:6821","nonce":730066362}]},"public_addr":"172.21.15.150:6817/730066362","cluster_addr":"172.21.15.150:6819/730066362","heartbeat_back_addr":"172.21.15.150:6823/730066362","heartbeat_front_addr":"172.21.15.150:6821/730066362","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T09:51:35.123538+0000","dead_epoch":51},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T09:51:59.961993+0000","dead_epoch":56},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T09:52:23.976682+0000","dead_epoch":61},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T09:52:46.493238+0000","dead_epoch":66},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T09:53:09.121783+0000","dead_epoch":82},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T09:53:32.450910+0000","dead_epoch":89}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.19","mappings":[{"from":0,"to":3}]},{"pgid":"2.1b","mappings":[{"from":0,"to":3}]},{"pgid":"3.d","mappings":[{"from":4,"to":5}]},{"pgid":"3.e","mappings":[{"from":4,"to":3}]},{"pgid":"3.10","mappings":[{"from":1,"to":3}]},{"pgid":"3.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:0/1442740471":"2023-12-06T09:59:10.596958+0000","172.21.15.100:0/2319392996":"2023-12-06T09:59:10.596958+0000","172.21.15.100:6800/2397627746":"2023-12-06T09:50:30.059721+0000","172.21.15.150:0/45306857":"2023-12-06T09:58:01.227505+0000","172.21.15.100:0/4197065049":"2023-12-06T09:50:30.059721+0000","172.21.15.150:0/1284624117":"2023-12-06T09:58:01.227505+0000","172.21.15.150:6829/896268868":"2023-12-06T09:58:01.227505+0000","172.21.15.100:0/2992397636":"2023-12-06T09:49:01.007941+0000","172.21.15.100:0/2175139133":"2023-12-06T09:56:31.887692+0000","172.21.15.150:0/3463685537":"2023-12-06T09:58:01.227505+0000","172.21.15.100:0/3456039235":"2023-12-06T09:56:31.887692+0000","172.21.15.100:0/1529397750":"2023-12-06T09:49:28.559106+0000","172.21.15.100:6800/3060005571":"2023-12-06T09:59:10.596958+0000","172.21.15.100:6801/1237547575":"2023-12-06T09:56:31.887692+0000","172.21.15.100:6800/3606837497":"2023-12-06T09:49:01.007941+0000","172.21.15.100:6801/3060005571":"2023-12-06T09:59:10.596958+0000","172.21.15.100:0/556453695":"2023-12-06T09:49:28.559106+0000","172.21.15.100:0/567522562":"2023-12-06T09:49:01.007941+0000","172.21.15.100:0/4217799370":"2023-12-06T09:59:10.596958+0000","172.21.15.100:0/2280374959":"2023-12-06T09:56:31.887692+0000","172.21.15.150:0/2303343881":"2023-12-06T09:58:01.227505+0000","172.21.15.100:6800/1237547575":"2023-12-06T09:56:31.887692+0000","172.21.15.150:0/3272897294":"2023-12-06T09:58:01.227505+0000","172.21.15.100:6801/3606837497":"2023-12-06T09:49:01.007941+0000","172.21.15.100:0/737517101":"2023-12-06T09:50:30.059721+0000","172.21.15.100:0/4027037785":"2023-12-06T09:59:10.596958+0000","172.21.15.150:0/4245341459":"2023-12-06T09:58:01.227505+0000","172.21.15.100:6826/3068237273":"2023-12-06T09:54:43.391103+0000","172.21.15.150:6828/896268868":"2023-12-06T09:58:01.227505+0000","172.21.15.100:0/2400356084":"2023-12-06T09:49:01.007941+0000","172.21.15.100:0/485886590":"2023-12-06T09:56:31.887692+0000","172.21.15.100:0/3942224339":"2023-12-06T09:49:28.559106+0000","172.21.15.100:6827/3068237273":"2023-12-06T09:54:43.391103+0000","172.21.15.100:6800/2647899624":"2023-12-06T09:49:28.559106+0000","172.21.15.100:6801/2647899624":"2023-12-06T09:49:28.559106+0000","172.21.15.100:0/2826914555":"2023-12-06T09:50:30.059721+0000","172.21.15.100:0/1388385571":"2023-12-06T09:59:10.596958+0000","172.21.15.100:6801/2397627746":"2023-12-06T09:50:30.059721+0000","172.21.15.100:0/1927013046":"2023-12-06T09:59:10.596958+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-05T10:05:05.360 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.363+0000 7f266c3ff700 1 -- 172.21.15.100:0/1798270303 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f265006ce60 msgr2=0x7f265006f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:05:05.360 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.363+0000 7f266c3ff700 1 --2- 172.21.15.100:0/1798270303 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f265006ce60 0x7f265006f310 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f26600041d0 tx=0x7f26600043c0 comp rx=0 tx=0).stop 2023-12-05T10:05:05.361 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.363+0000 7f266c3ff700 1 -- 172.21.15.100:0/1798270303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2664102ad0 msgr2=0x7f2664115910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:05:05.361 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.363+0000 7f266c3ff700 1 --2- 172.21.15.100:0/1798270303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2664102ad0 0x7f2664115910 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2654009180 tx=0x7f2654009e30 comp rx=0 tx=0).stop 2023-12-05T10:05:05.361 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.363+0000 7f266c3ff700 1 -- 172.21.15.100:0/1798270303 shutdown_connections 2023-12-05T10:05:05.361 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.363+0000 7f266c3ff700 1 --2- 172.21.15.100:0/1798270303 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f265006ce60 0x7f265006f310 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:05:05.361 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.363+0000 7f266c3ff700 1 --2- 172.21.15.100:0/1798270303 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26640fca90 0x7f26641153d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:05:05.361 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.363+0000 7f266c3ff700 1 --2- 172.21.15.100:0/1798270303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2664102ad0 0x7f2664115910 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:05:05.361 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.363+0000 7f266c3ff700 1 -- 172.21.15.100:0/1798270303 >> 172.21.15.100:0/1798270303 conn(0x7f26640f8630 msgr2=0x7f2664070240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:05:05.361 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.363+0000 7f266c3ff700 1 -- 172.21.15.100:0/1798270303 shutdown_connections 2023-12-05T10:05:05.362 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.363+0000 7f266c3ff700 1 -- 172.21.15.100:0/1798270303 wait complete. 2023-12-05T10:05:05.379 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-05T09:52:26.650134+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2023-12-05T09:54:29.310760+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2023-12-05T09:54:29.992340+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-05T10:05:05.379 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-05T10:05:05.578 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.578+0000 7f1ea47ff700 1 -- 172.21.15.100:0/4094764952 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e9c1034f0 msgr2=0x7f1e9c0fcb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:05:05.578 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.578+0000 7f1ea47ff700 1 --2- 172.21.15.100:0/4094764952 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e9c1034f0 0x7f1e9c0fcb60 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c004940 tx=0x7f1e8c009e30 comp rx=0 tx=0).stop 2023-12-05T10:05:05.578 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.578+0000 7f1ea47ff700 1 -- 172.21.15.100:0/4094764952 shutdown_connections 2023-12-05T10:05:05.578 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.578+0000 7f1ea47ff700 1 --2- 172.21.15.100:0/4094764952 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e9c1034f0 0x7f1e9c0fcb60 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:05:05.579 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.578+0000 7f1ea47ff700 1 --2- 172.21.15.100:0/4094764952 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e9c102b50 0x7f1e9c102f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:05:05.579 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.578+0000 7f1ea47ff700 1 -- 172.21.15.100:0/4094764952 >> 172.21.15.100:0/4094764952 conn(0x7f1e9c0f8700 msgr2=0x7f1e9c0fab10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:05:05.579 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.579+0000 7f1ea47ff700 1 -- 172.21.15.100:0/4094764952 shutdown_connections 2023-12-05T10:05:05.579 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.579+0000 7f1ea47ff700 1 -- 172.21.15.100:0/4094764952 wait complete. 2023-12-05T10:05:05.579 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.579+0000 7f1ea47ff700 1 Processor -- start 2023-12-05T10:05:05.579 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.579+0000 7f1ea47ff700 1 -- start start 2023-12-05T10:05:05.579 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.580+0000 7f1ea47ff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e9c102b50 0x7f1e9c1132c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:05:05.579 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.580+0000 7f1ea47ff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e9c1034f0 0x7f1e9c113800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:05:05.580 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.580+0000 7f1ea47ff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9c113e50 con 0x7f1e9c1034f0 2023-12-05T10:05:05.580 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.580+0000 7f1ea47ff700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9c10d370 con 0x7f1e9c102b50 2023-12-05T10:05:05.580 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.580+0000 7f1ea1d9a700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e9c1034f0 0x7f1e9c113800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:05:05.580 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.580+0000 7f1ea1d9a700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e9c1034f0 0x7f1e9c113800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60662/0 (socket says 172.21.15.100:60662) 2023-12-05T10:05:05.580 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.580+0000 7f1ea1d9a700 1 -- 172.21.15.100:0/296090599 learned_addr learned my addr 172.21.15.100:0/296090599 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T10:05:05.580 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.580+0000 7f1ea259b700 1 --2- 172.21.15.100:0/296090599 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e9c102b50 0x7f1e9c1132c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:05:05.580 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.580+0000 7f1ea1d9a700 1 -- 172.21.15.100:0/296090599 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e9c102b50 msgr2=0x7f1e9c1132c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:05:05.580 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.580+0000 7f1ea1d9a700 1 --2- 172.21.15.100:0/296090599 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e9c102b50 0x7f1e9c1132c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:05:05.580 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.580+0000 7f1ea1d9a700 1 -- 172.21.15.100:0/296090599 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e8c005040 con 0x7f1e9c1034f0 2023-12-05T10:05:05.581 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.581+0000 7f1ea1d9a700 1 --2- 172.21.15.100:0/296090599 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e9c1034f0 0x7f1e9c113800 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c009fd0 tx=0x7f1e8c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:05:05.582 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.581+0000 7f1e92ffd700 1 -- 172.21.15.100:0/296090599 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e8c021070 con 0x7f1e9c1034f0 2023-12-05T10:05:05.582 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.581+0000 7f1e92ffd700 1 -- 172.21.15.100:0/296090599 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1e8c0093b0 con 0x7f1e9c1034f0 2023-12-05T10:05:05.582 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.581+0000 7f1e92ffd700 1 -- 172.21.15.100:0/296090599 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e8c00e070 con 0x7f1e9c1034f0 2023-12-05T10:05:05.582 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.581+0000 7f1ea47ff700 1 -- 172.21.15.100:0/296090599 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e9c10d5f0 con 0x7f1e9c1034f0 2023-12-05T10:05:05.582 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.581+0000 7f1ea47ff700 1 -- 172.21.15.100:0/296090599 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e9c10db50 con 0x7f1e9c1034f0 2023-12-05T10:05:05.582 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.582+0000 7f1ea47ff700 1 -- 172.21.15.100:0/296090599 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e9c105020 con 0x7f1e9c1034f0 2023-12-05T10:05:05.583 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.583+0000 7f1e92ffd700 1 -- 172.21.15.100:0/296090599 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f1e8c013a50 con 0x7f1e9c1034f0 2023-12-05T10:05:05.583 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.584+0000 7f1e92ffd700 1 --2- 172.21.15.100:0/296090599 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f1e8806ce70 0x7f1e8806f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:05:05.583 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.584+0000 7f1e92ffd700 1 -- 172.21.15.100:0/296090599 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6674+0+0 (secure 0 0 0) 0x7f1e8c08d450 con 0x7f1e9c1034f0 2023-12-05T10:05:05.583 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.584+0000 7f1ea259b700 1 --2- 172.21.15.100:0/296090599 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f1e8806ce70 0x7f1e8806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:05:05.583 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.585+0000 7f1ea259b700 1 --2- 172.21.15.100:0/296090599 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f1e8806ce70 0x7f1e8806f320 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1e98009b80 tx=0x7f1e9800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:05:05.586 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.588+0000 7f1e92ffd700 1 -- 172.21.15.100:0/296090599 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f1e8c05add0 con 0x7f1e9c1034f0 2023-12-05T10:05:05.595 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:05:05 smithi150 ceph-mon[171606]: pgmap v224: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:05:05.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:05:05 smithi150 ceph-mon[171606]: from='client.? 172.21.15.100:0/3102120270' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-12-05T10:05:05.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:05:05 smithi100 ceph-mon[187528]: pgmap v224: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:05:05.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:05:05 smithi100 ceph-mon[187528]: from='client.? 172.21.15.100:0/3102120270' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-12-05T10:05:05.787 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.790+0000 7f1ea47ff700 1 -- 172.21.15.100:0/296090599 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1e9c10e8a0 con 0x7f1e9c1034f0 2023-12-05T10:05:05.788 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.790+0000 7f1e92ffd700 1 -- 172.21.15.100:0/296090599 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v95) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1e8c05a960 con 0x7f1e9c1034f0 2023-12-05T10:05:05.788 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2023-12-05T10:05:05.790 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.792+0000 7f1ea47ff700 1 -- 172.21.15.100:0/296090599 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f1e8806ce70 msgr2=0x7f1e8806f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:05:05.791 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.792+0000 7f1ea47ff700 1 --2- 172.21.15.100:0/296090599 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f1e8806ce70 0x7f1e8806f320 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1e98009b80 tx=0x7f1e9800b040 comp rx=0 tx=0).stop 2023-12-05T10:05:05.791 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.792+0000 7f1ea47ff700 1 -- 172.21.15.100:0/296090599 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e9c1034f0 msgr2=0x7f1e9c113800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:05:05.791 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.792+0000 7f1ea47ff700 1 --2- 172.21.15.100:0/296090599 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e9c1034f0 0x7f1e9c113800 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c009fd0 tx=0x7f1e8c009e30 comp rx=0 tx=0).stop 2023-12-05T10:05:05.791 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.793+0000 7f1ea47ff700 1 -- 172.21.15.100:0/296090599 shutdown_connections 2023-12-05T10:05:05.791 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.793+0000 7f1ea47ff700 1 --2- 172.21.15.100:0/296090599 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f1e8806ce70 0x7f1e8806f320 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:05:05.791 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.793+0000 7f1ea47ff700 1 --2- 172.21.15.100:0/296090599 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e9c102b50 0x7f1e9c1132c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:05:05.791 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.793+0000 7f1ea47ff700 1 --2- 172.21.15.100:0/296090599 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e9c1034f0 0x7f1e9c113800 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:05:05.791 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.793+0000 7f1ea47ff700 1 -- 172.21.15.100:0/296090599 >> 172.21.15.100:0/296090599 conn(0x7f1e9c0f8700 msgr2=0x7f1e9c0fa240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:05:05.792 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.793+0000 7f1ea47ff700 1 -- 172.21.15.100:0/296090599 shutdown_connections 2023-12-05T10:05:05.792 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:05.793+0000 7f1ea47ff700 1 -- 172.21.15.100:0/296090599 wait complete. 2023-12-05T10:05:05.809 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2023-12-05T10:05:06.005 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.008+0000 7fc6d6fff700 1 -- 172.21.15.100:0/1476555426 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6d0071c10 msgr2=0x7fc6d006ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:05:06.006 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.008+0000 7fc6d6fff700 1 --2- 172.21.15.100:0/1476555426 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6d0071c10 0x7fc6d006ffe0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc6c4004970 tx=0x7fc6c4009e30 comp rx=0 tx=0).stop 2023-12-05T10:05:06.006 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.008+0000 7fc6d6fff700 1 -- 172.21.15.100:0/1476555426 shutdown_connections 2023-12-05T10:05:06.006 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.008+0000 7fc6d6fff700 1 --2- 172.21.15.100:0/1476555426 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6d0070520 0x7fc6d0070990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:05:06.006 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.008+0000 7fc6d6fff700 1 --2- 172.21.15.100:0/1476555426 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6d0071c10 0x7fc6d006ffe0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:05:06.006 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.008+0000 7fc6d6fff700 1 -- 172.21.15.100:0/1476555426 >> 172.21.15.100:0/1476555426 conn(0x7fc6d00f86d0 msgr2=0x7fc6d00faae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:05:06.006 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.008+0000 7fc6d6fff700 1 -- 172.21.15.100:0/1476555426 shutdown_connections 2023-12-05T10:05:06.006 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.008+0000 7fc6d6fff700 1 -- 172.21.15.100:0/1476555426 wait complete. 2023-12-05T10:05:06.008 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.008+0000 7fc6d6fff700 1 Processor -- start 2023-12-05T10:05:06.008 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.009+0000 7fc6d6fff700 1 -- start start 2023-12-05T10:05:06.008 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.009+0000 7fc6d6fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6d0070520 0x7fc6d0119950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:05:06.009 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.009+0000 7fc6d6fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6d0071c10 0x7fc6d0119e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:05:06.009 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.009+0000 7fc6d6fff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d011a4e0 con 0x7fc6d0070520 2023-12-05T10:05:06.009 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.009+0000 7fc6d6fff700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d0113a20 con 0x7fc6d0071c10 2023-12-05T10:05:06.009 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.009+0000 7fc6d4d9b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6d0070520 0x7fc6d0119950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:05:06.009 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.009+0000 7fc6d4d9b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6d0070520 0x7fc6d0119950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60676/0 (socket says 172.21.15.100:60676) 2023-12-05T10:05:06.009 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.009+0000 7fc6d4d9b700 1 -- 172.21.15.100:0/1583183666 learned_addr learned my addr 172.21.15.100:0/1583183666 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T10:05:06.009 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.009+0000 7fc6cffff700 1 --2- 172.21.15.100:0/1583183666 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6d0071c10 0x7fc6d0119e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:05:06.009 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.010+0000 7fc6d4d9b700 1 -- 172.21.15.100:0/1583183666 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6d0071c10 msgr2=0x7fc6d0119e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:05:06.010 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.010+0000 7fc6d4d9b700 1 --2- 172.21.15.100:0/1583183666 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6d0071c10 0x7fc6d0119e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:05:06.010 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.010+0000 7fc6d4d9b700 1 -- 172.21.15.100:0/1583183666 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c4005040 con 0x7fc6d0070520 2023-12-05T10:05:06.010 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.010+0000 7fc6d4d9b700 1 --2- 172.21.15.100:0/1583183666 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6d0070520 0x7fc6d0119950 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc6c4004f50 tx=0x7fc6c4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:05:06.010 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.010+0000 7fc6cd7fa700 1 -- 172.21.15.100:0/1583183666 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6c400e040 con 0x7fc6d0070520 2023-12-05T10:05:06.010 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.010+0000 7fc6cd7fa700 1 -- 172.21.15.100:0/1583183666 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc6c4013420 con 0x7fc6d0070520 2023-12-05T10:05:06.010 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.010+0000 7fc6d6fff700 1 -- 172.21.15.100:0/1583183666 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6d0113ca0 con 0x7fc6d0070520 2023-12-05T10:05:06.010 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.010+0000 7fc6cd7fa700 1 -- 172.21.15.100:0/1583183666 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6c401c630 con 0x7fc6d0070520 2023-12-05T10:05:06.010 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.010+0000 7fc6d6fff700 1 -- 172.21.15.100:0/1583183666 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6d01141e0 con 0x7fc6d0070520 2023-12-05T10:05:06.011 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.011+0000 7fc6d6fff700 1 -- 172.21.15.100:0/1583183666 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6d00fdff0 con 0x7fc6d0070520 2023-12-05T10:05:06.011 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.012+0000 7fc6cd7fa700 1 -- 172.21.15.100:0/1583183666 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fc6c4013a20 con 0x7fc6d0070520 2023-12-05T10:05:06.011 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.013+0000 7fc6cd7fa700 1 --2- 172.21.15.100:0/1583183666 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fc6c006ce70 0x7fc6c006f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:05:06.012 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.013+0000 7fc6cd7fa700 1 -- 172.21.15.100:0/1583183666 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6674+0+0 (secure 0 0 0) 0x7fc6c408d670 con 0x7fc6d0070520 2023-12-05T10:05:06.012 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.013+0000 7fc6cffff700 1 --2- 172.21.15.100:0/1583183666 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fc6c006ce70 0x7fc6c006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:05:06.012 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.014+0000 7fc6cffff700 1 --2- 172.21.15.100:0/1583183666 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fc6c006ce70 0x7fc6c006f320 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc6d0115180 tx=0x7fc6bc00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:05:06.015 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.017+0000 7fc6cd7fa700 1 -- 172.21.15.100:0/1583183666 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fc6c405aff0 con 0x7fc6d0070520 2023-12-05T10:05:06.219 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.221+0000 7fc6d6fff700 1 -- 172.21.15.100:0/1583183666 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7fc6d0114f30 con 0x7fc6d0070520 2023-12-05T10:05:06.219 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.222+0000 7fc6cd7fa700 1 -- 172.21.15.100:0/1583183666 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v95) v1 ==== 107+0+11 (secure 0 0 0) 0x7fc6c405ab80 con 0x7fc6d0070520 2023-12-05T10:05:06.219 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2023-12-05T10:05:06.222 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.224+0000 7fc6d6fff700 1 -- 172.21.15.100:0/1583183666 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fc6c006ce70 msgr2=0x7fc6c006f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:05:06.222 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.224+0000 7fc6d6fff700 1 --2- 172.21.15.100:0/1583183666 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fc6c006ce70 0x7fc6c006f320 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc6d0115180 tx=0x7fc6bc00b040 comp rx=0 tx=0).stop 2023-12-05T10:05:06.222 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.224+0000 7fc6d6fff700 1 -- 172.21.15.100:0/1583183666 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6d0070520 msgr2=0x7fc6d0119950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:05:06.222 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.224+0000 7fc6d6fff700 1 --2- 172.21.15.100:0/1583183666 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6d0070520 0x7fc6d0119950 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc6c4004f50 tx=0x7fc6c4009e30 comp rx=0 tx=0).stop 2023-12-05T10:05:06.222 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.224+0000 7fc6d6fff700 1 -- 172.21.15.100:0/1583183666 shutdown_connections 2023-12-05T10:05:06.222 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.224+0000 7fc6d6fff700 1 --2- 172.21.15.100:0/1583183666 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fc6c006ce70 0x7fc6c006f320 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:05:06.222 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.224+0000 7fc6d6fff700 1 --2- 172.21.15.100:0/1583183666 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6d0070520 0x7fc6d0119950 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:05:06.222 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.224+0000 7fc6d6fff700 1 --2- 172.21.15.100:0/1583183666 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6d0071c10 0x7fc6d0119e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:05:06.223 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.224+0000 7fc6d6fff700 1 -- 172.21.15.100:0/1583183666 >> 172.21.15.100:0/1583183666 conn(0x7fc6d00f86d0 msgr2=0x7fc6d010b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:05:06.223 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.224+0000 7fc6d6fff700 1 -- 172.21.15.100:0/1583183666 shutdown_connections 2023-12-05T10:05:06.223 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.224+0000 7fc6d6fff700 1 -- 172.21.15.100:0/1583183666 wait complete. 2023-12-05T10:05:06.240 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2023-12-05T10:05:06.436 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.438+0000 7fd2b97ff700 1 -- 172.21.15.100:0/3208829279 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2b41034e0 msgr2=0x7fd2b40fcb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:05:06.436 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.438+0000 7fd2b97ff700 1 --2- 172.21.15.100:0/3208829279 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2b41034e0 0x7fd2b40fcb50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd2a8004940 tx=0x7fd2a8009e30 comp rx=0 tx=0).stop 2023-12-05T10:05:06.436 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.438+0000 7fd2b97ff700 1 -- 172.21.15.100:0/3208829279 shutdown_connections 2023-12-05T10:05:06.437 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.438+0000 7fd2b97ff700 1 --2- 172.21.15.100:0/3208829279 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2b41034e0 0x7fd2b40fcb50 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:05:06.437 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.438+0000 7fd2b97ff700 1 --2- 172.21.15.100:0/3208829279 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2b4102b40 0x7fd2b4102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:05:06.437 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.438+0000 7fd2b97ff700 1 -- 172.21.15.100:0/3208829279 >> 172.21.15.100:0/3208829279 conn(0x7fd2b40f86d0 msgr2=0x7fd2b40faae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:05:06.437 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.438+0000 7fd2b97ff700 1 -- 172.21.15.100:0/3208829279 shutdown_connections 2023-12-05T10:05:06.437 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.438+0000 7fd2b97ff700 1 -- 172.21.15.100:0/3208829279 wait complete. 2023-12-05T10:05:06.439 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.439+0000 7fd2b97ff700 1 Processor -- start 2023-12-05T10:05:06.439 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.439+0000 7fd2b97ff700 1 -- start start 2023-12-05T10:05:06.439 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.439+0000 7fd2b97ff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2b4102b40 0x7fd2b4113360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:05:06.439 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.440+0000 7fd2b97ff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2b41034e0 0x7fd2b41138a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:05:06.439 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.440+0000 7fd2b97ff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b4113ef0 con 0x7fd2b4102b40 2023-12-05T10:05:06.439 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.440+0000 7fd2b97ff700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b410d410 con 0x7fd2b41034e0 2023-12-05T10:05:06.439 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.440+0000 7fd2b2ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2b4102b40 0x7fd2b4113360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:05:06.440 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.440+0000 7fd2b2ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2b4102b40 0x7fd2b4113360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60704/0 (socket says 172.21.15.100:60704) 2023-12-05T10:05:06.440 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.440+0000 7fd2b2ffd700 1 -- 172.21.15.100:0/4114562831 learned_addr learned my addr 172.21.15.100:0/4114562831 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T10:05:06.440 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.440+0000 7fd2b27fc700 1 --2- 172.21.15.100:0/4114562831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2b41034e0 0x7fd2b41138a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:05:06.440 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.440+0000 7fd2b2ffd700 1 -- 172.21.15.100:0/4114562831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2b41034e0 msgr2=0x7fd2b41138a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:05:06.440 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.440+0000 7fd2b2ffd700 1 --2- 172.21.15.100:0/4114562831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2b41034e0 0x7fd2b41138a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:05:06.440 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.440+0000 7fd2b2ffd700 1 -- 172.21.15.100:0/4114562831 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a8005040 con 0x7fd2b4102b40 2023-12-05T10:05:06.440 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.440+0000 7fd2b2ffd700 1 --2- 172.21.15.100:0/4114562831 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2b4102b40 0x7fd2b4113360 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4002a50 tx=0x7fd2a40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:05:06.440 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.441+0000 7fd29b7fe700 1 -- 172.21.15.100:0/4114562831 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2a4007cc0 con 0x7fd2b4102b40 2023-12-05T10:05:06.440 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.441+0000 7fd29b7fe700 1 -- 172.21.15.100:0/4114562831 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd2a400f040 con 0x7fd2b4102b40 2023-12-05T10:05:06.441 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.441+0000 7fd29b7fe700 1 -- 172.21.15.100:0/4114562831 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2a400d9c0 con 0x7fd2b4102b40 2023-12-05T10:05:06.441 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.441+0000 7fd2b97ff700 1 -- 172.21.15.100:0/4114562831 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2b410d6f0 con 0x7fd2b4102b40 2023-12-05T10:05:06.441 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.441+0000 7fd2b97ff700 1 -- 172.21.15.100:0/4114562831 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2b410dcb0 con 0x7fd2b4102b40 2023-12-05T10:05:06.442 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.442+0000 7fd2b97ff700 1 -- 172.21.15.100:0/4114562831 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2b4105010 con 0x7fd2b4102b40 2023-12-05T10:05:06.442 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.443+0000 7fd29b7fe700 1 -- 172.21.15.100:0/4114562831 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fd2a400db20 con 0x7fd2b4102b40 2023-12-05T10:05:06.442 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.444+0000 7fd29b7fe700 1 --2- 172.21.15.100:0/4114562831 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fd29c06ce70 0x7fd29c06f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:05:06.442 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.444+0000 7fd29b7fe700 1 -- 172.21.15.100:0/4114562831 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6674+0+0 (secure 0 0 0) 0x7fd2a408c0c0 con 0x7fd2b4102b40 2023-12-05T10:05:06.442 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.444+0000 7fd2b27fc700 1 --2- 172.21.15.100:0/4114562831 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fd29c06ce70 0x7fd29c06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:05:06.442 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.445+0000 7fd2b27fc700 1 --2- 172.21.15.100:0/4114562831 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fd29c06ce70 0x7fd29c06f320 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd2b410ec00 tx=0x7fd2a8009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:05:06.445 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.448+0000 7fd29b7fe700 1 -- 172.21.15.100:0/4114562831 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fd2a4059900 con 0x7fd2b4102b40 2023-12-05T10:05:06.595 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:05:06 smithi150 ceph-mon[171606]: from='client.? 172.21.15.100:0/1798270303' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-05T10:05:06.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:05:06 smithi150 ceph-mon[171606]: from='client.? 172.21.15.100:0/296090599' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-05T10:05:06.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:05:06 smithi150 ceph-mon[171606]: from='client.? 172.21.15.100:0/1583183666' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-05T10:05:06.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:05:06 smithi100 ceph-mon[187528]: from='client.? 172.21.15.100:0/1798270303' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-05T10:05:06.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:05:06 smithi100 ceph-mon[187528]: from='client.? 172.21.15.100:0/296090599' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-05T10:05:06.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:05:06 smithi100 ceph-mon[187528]: from='client.? 172.21.15.100:0/1583183666' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-05T10:05:06.649 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.652+0000 7fd2b97ff700 1 -- 172.21.15.100:0/4114562831 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7fd2b4064730 con 0x7fd2b4102b40 2023-12-05T10:05:06.650 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.652+0000 7fd29b7fe700 1 -- 172.21.15.100:0/4114562831 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v95) v1 ==== 107+0+11 (secure 0 0 0) 0x7fd2a4059490 con 0x7fd2b4102b40 2023-12-05T10:05:06.650 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2023-12-05T10:05:06.652 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.655+0000 7fd2b97ff700 1 -- 172.21.15.100:0/4114562831 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fd29c06ce70 msgr2=0x7fd29c06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:05:06.653 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.655+0000 7fd2b97ff700 1 --2- 172.21.15.100:0/4114562831 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fd29c06ce70 0x7fd29c06f320 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd2b410ec00 tx=0x7fd2a8009e30 comp rx=0 tx=0).stop 2023-12-05T10:05:06.653 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.655+0000 7fd2b97ff700 1 -- 172.21.15.100:0/4114562831 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2b4102b40 msgr2=0x7fd2b4113360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:05:06.653 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.655+0000 7fd2b97ff700 1 --2- 172.21.15.100:0/4114562831 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2b4102b40 0x7fd2b4113360 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4002a50 tx=0x7fd2a40046b0 comp rx=0 tx=0).stop 2023-12-05T10:05:06.653 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.655+0000 7fd2b97ff700 1 -- 172.21.15.100:0/4114562831 shutdown_connections 2023-12-05T10:05:06.653 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.655+0000 7fd2b97ff700 1 --2- 172.21.15.100:0/4114562831 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7fd29c06ce70 0x7fd29c06f320 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:05:06.653 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.655+0000 7fd2b97ff700 1 --2- 172.21.15.100:0/4114562831 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2b4102b40 0x7fd2b4113360 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:05:06.653 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.655+0000 7fd2b97ff700 1 --2- 172.21.15.100:0/4114562831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2b41034e0 0x7fd2b41138a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:05:06.653 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.655+0000 7fd2b97ff700 1 -- 172.21.15.100:0/4114562831 >> 172.21.15.100:0/4114562831 conn(0x7fd2b40f86d0 msgr2=0x7fd2b40fa2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:05:06.653 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.655+0000 7fd2b97ff700 1 -- 172.21.15.100:0/4114562831 shutdown_connections 2023-12-05T10:05:06.654 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.655+0000 7fd2b97ff700 1 -- 172.21.15.100:0/4114562831 wait complete. 2023-12-05T10:05:06.673 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-05T10:05:06.869 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.870+0000 7f91525ff700 1 -- 172.21.15.100:0/4249372973 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f914c1034e0 msgr2=0x7f914c0fcb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:05:06.869 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.870+0000 7f91525ff700 1 --2- 172.21.15.100:0/4249372973 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f914c1034e0 0x7f914c0fcb50 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9140004940 tx=0x7f9140009e30 comp rx=0 tx=0).stop 2023-12-05T10:05:06.869 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.871+0000 7f91525ff700 1 -- 172.21.15.100:0/4249372973 shutdown_connections 2023-12-05T10:05:06.869 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.871+0000 7f91525ff700 1 --2- 172.21.15.100:0/4249372973 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f914c1034e0 0x7f914c0fcb50 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:05:06.869 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.871+0000 7f91525ff700 1 --2- 172.21.15.100:0/4249372973 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f914c102b40 0x7f914c102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:05:06.870 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.871+0000 7f91525ff700 1 -- 172.21.15.100:0/4249372973 >> 172.21.15.100:0/4249372973 conn(0x7f914c0f86d0 msgr2=0x7f914c0faae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:05:06.870 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.871+0000 7f91525ff700 1 -- 172.21.15.100:0/4249372973 shutdown_connections 2023-12-05T10:05:06.870 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.871+0000 7f91525ff700 1 -- 172.21.15.100:0/4249372973 wait complete. 2023-12-05T10:05:06.870 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.871+0000 7f91525ff700 1 Processor -- start 2023-12-05T10:05:06.870 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.871+0000 7f91525ff700 1 -- start start 2023-12-05T10:05:06.872 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.872+0000 7f91525ff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f914c102b40 0x7f914c06ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:05:06.872 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.872+0000 7f91525ff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f914c1034e0 0x7f914c070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:05:06.872 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.872+0000 7f91525ff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f914c0709c0 con 0x7f914c102b40 2023-12-05T10:05:06.872 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.872+0000 7f91525ff700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f914c070b00 con 0x7f914c1034e0 2023-12-05T10:05:06.872 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.872+0000 7f914bfff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f914c102b40 0x7f914c06ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:05:06.872 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.872+0000 7f914bfff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f914c102b40 0x7f914c06ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60724/0 (socket says 172.21.15.100:60724) 2023-12-05T10:05:06.872 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.872+0000 7f914bfff700 1 -- 172.21.15.100:0/742360742 learned_addr learned my addr 172.21.15.100:0/742360742 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-05T10:05:06.873 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.872+0000 7f914bfff700 1 -- 172.21.15.100:0/742360742 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f914c1034e0 msgr2=0x7f914c070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:05:06.873 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.872+0000 7f914bfff700 1 --2- 172.21.15.100:0/742360742 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f914c1034e0 0x7f914c070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:05:06.873 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.872+0000 7f914bfff700 1 -- 172.21.15.100:0/742360742 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9140005040 con 0x7f914c102b40 2023-12-05T10:05:06.873 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.873+0000 7f914bfff700 1 --2- 172.21.15.100:0/742360742 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f914c102b40 0x7f914c06ff40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f913c00eb70 tx=0x7f913c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:05:06.873 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.873+0000 7f9148ff9700 1 -- 172.21.15.100:0/742360742 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f913c007cc0 con 0x7f914c102b40 2023-12-05T10:05:06.873 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.873+0000 7f9148ff9700 1 -- 172.21.15.100:0/742360742 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f913c00f040 con 0x7f914c102b40 2023-12-05T10:05:06.873 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.873+0000 7f91525ff700 1 -- 172.21.15.100:0/742360742 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f914c070d80 con 0x7f914c102b40 2023-12-05T10:05:06.874 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.873+0000 7f9148ff9700 1 -- 172.21.15.100:0/742360742 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f913c0095f0 con 0x7f914c102b40 2023-12-05T10:05:06.874 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.873+0000 7f91525ff700 1 -- 172.21.15.100:0/742360742 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f914c119a50 con 0x7f914c102b40 2023-12-05T10:05:06.874 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.874+0000 7f91525ff700 1 -- 172.21.15.100:0/742360742 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f914c064730 con 0x7f914c102b40 2023-12-05T10:05:06.875 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.875+0000 7f9148ff9700 1 -- 172.21.15.100:0/742360742 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 39) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f913c009750 con 0x7f914c102b40 2023-12-05T10:05:06.875 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.876+0000 7f9148ff9700 1 --2- 172.21.15.100:0/742360742 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f913406ce70 0x7f913406f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T10:05:06.875 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.876+0000 7f9148ff9700 1 -- 172.21.15.100:0/742360742 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6674+0+0 (secure 0 0 0) 0x7f913c08bf20 con 0x7f914c102b40 2023-12-05T10:05:06.875 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.876+0000 7f914b7fe700 1 --2- 172.21.15.100:0/742360742 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f913406ce70 0x7f913406f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T10:05:06.875 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.877+0000 7f914b7fe700 1 --2- 172.21.15.100:0/742360742 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f913406ce70 0x7f913406f320 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f914000b0d0 tx=0x7f9140009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T10:05:06.877 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:06.880+0000 7f9148ff9700 1 -- 172.21.15.100:0/742360742 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f913c0bf2f0 con 0x7f914c102b40 2023-12-05T10:05:07.094 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:07.097+0000 7f91525ff700 1 -- 172.21.15.100:0/742360742 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f914c109af0 con 0x7f914c102b40 2023-12-05T10:05:07.095 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:07.097+0000 7f9148ff9700 1 -- 172.21.15.100:0/742360742 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 39 entries v95) v1 ==== 81+0+2335 (secure 0 0 0) 0x7f913c055d70 con 0x7f914c102b40 2023-12-05T10:05:07.095 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/1442740471 2023-12-06T09:59:10.596958+0000 2023-12-05T10:05:07.095 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/2319392996 2023-12-06T09:59:10.596958+0000 2023-12-05T10:05:07.095 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:6800/2397627746 2023-12-06T09:50:30.059721+0000 2023-12-05T10:05:07.096 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.150:0/45306857 2023-12-06T09:58:01.227505+0000 2023-12-05T10:05:07.096 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/4197065049 2023-12-06T09:50:30.059721+0000 2023-12-05T10:05:07.096 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.150:0/1284624117 2023-12-06T09:58:01.227505+0000 2023-12-05T10:05:07.096 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.150:6829/896268868 2023-12-06T09:58:01.227505+0000 2023-12-05T10:05:07.096 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/2992397636 2023-12-06T09:49:01.007941+0000 2023-12-05T10:05:07.096 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/2175139133 2023-12-06T09:56:31.887692+0000 2023-12-05T10:05:07.096 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.150:0/3463685537 2023-12-06T09:58:01.227505+0000 2023-12-05T10:05:07.097 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/3456039235 2023-12-06T09:56:31.887692+0000 2023-12-05T10:05:07.097 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/1529397750 2023-12-06T09:49:28.559106+0000 2023-12-05T10:05:07.097 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:6800/3060005571 2023-12-06T09:59:10.596958+0000 2023-12-05T10:05:07.097 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:6801/1237547575 2023-12-06T09:56:31.887692+0000 2023-12-05T10:05:07.097 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:6800/3606837497 2023-12-06T09:49:01.007941+0000 2023-12-05T10:05:07.097 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:6801/3060005571 2023-12-06T09:59:10.596958+0000 2023-12-05T10:05:07.097 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/556453695 2023-12-06T09:49:28.559106+0000 2023-12-05T10:05:07.097 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/567522562 2023-12-06T09:49:01.007941+0000 2023-12-05T10:05:07.097 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/4217799370 2023-12-06T09:59:10.596958+0000 2023-12-05T10:05:07.098 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/2280374959 2023-12-06T09:56:31.887692+0000 2023-12-05T10:05:07.098 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.150:0/2303343881 2023-12-06T09:58:01.227505+0000 2023-12-05T10:05:07.098 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:6800/1237547575 2023-12-06T09:56:31.887692+0000 2023-12-05T10:05:07.098 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.150:0/3272897294 2023-12-06T09:58:01.227505+0000 2023-12-05T10:05:07.098 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:6801/3606837497 2023-12-06T09:49:01.007941+0000 2023-12-05T10:05:07.098 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/737517101 2023-12-06T09:50:30.059721+0000 2023-12-05T10:05:07.098 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/4027037785 2023-12-06T09:59:10.596958+0000 2023-12-05T10:05:07.098 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.150:0/4245341459 2023-12-06T09:58:01.227505+0000 2023-12-05T10:05:07.099 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:6826/3068237273 2023-12-06T09:54:43.391103+0000 2023-12-05T10:05:07.099 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.150:6828/896268868 2023-12-06T09:58:01.227505+0000 2023-12-05T10:05:07.099 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/2400356084 2023-12-06T09:49:01.007941+0000 2023-12-05T10:05:07.099 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/485886590 2023-12-06T09:56:31.887692+0000 2023-12-05T10:05:07.099 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/3942224339 2023-12-06T09:49:28.559106+0000 2023-12-05T10:05:07.099 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:6827/3068237273 2023-12-06T09:54:43.391103+0000 2023-12-05T10:05:07.099 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:6800/2647899624 2023-12-06T09:49:28.559106+0000 2023-12-05T10:05:07.099 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:6801/2647899624 2023-12-06T09:49:28.559106+0000 2023-12-05T10:05:07.099 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/2826914555 2023-12-06T09:50:30.059721+0000 2023-12-05T10:05:07.100 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/1388385571 2023-12-06T09:59:10.596958+0000 2023-12-05T10:05:07.100 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:6801/2397627746 2023-12-06T09:50:30.059721+0000 2023-12-05T10:05:07.100 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/1927013046 2023-12-06T09:59:10.596958+0000 2023-12-05T10:05:07.101 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:07.099+0000 7f91525ff700 1 -- 172.21.15.100:0/742360742 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f913406ce70 msgr2=0x7f913406f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:05:07.101 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:07.099+0000 7f91525ff700 1 --2- 172.21.15.100:0/742360742 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f913406ce70 0x7f913406f320 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f914000b0d0 tx=0x7f9140009e30 comp rx=0 tx=0).stop 2023-12-05T10:05:07.101 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:07.099+0000 7f91525ff700 1 -- 172.21.15.100:0/742360742 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f914c102b40 msgr2=0x7f914c06ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T10:05:07.101 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:07.099+0000 7f91525ff700 1 --2- 172.21.15.100:0/742360742 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f914c102b40 0x7f914c06ff40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f913c00eb70 tx=0x7f913c00b040 comp rx=0 tx=0).stop 2023-12-05T10:05:07.101 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:07.099+0000 7f91525ff700 1 -- 172.21.15.100:0/742360742 shutdown_connections 2023-12-05T10:05:07.102 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:07.099+0000 7f91525ff700 1 --2- 172.21.15.100:0/742360742 >> [v2:172.21.15.100:6800/3489431924,v1:172.21.15.100:6801/3489431924] conn(0x7f913406ce70 0x7f913406f320 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:05:07.102 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:07.099+0000 7f91525ff700 1 --2- 172.21.15.100:0/742360742 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f914c102b40 0x7f914c06ff40 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:05:07.102 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:07.099+0000 7f91525ff700 1 --2- 172.21.15.100:0/742360742 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f914c1034e0 0x7f914c070480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T10:05:07.102 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:07.099+0000 7f91525ff700 1 -- 172.21.15.100:0/742360742 >> 172.21.15.100:0/742360742 conn(0x7f914c0f86d0 msgr2=0x7f914c0fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T10:05:07.102 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:07.100+0000 7f91525ff700 1 -- 172.21.15.100:0/742360742 shutdown_connections 2023-12-05T10:05:07.102 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-05T10:05:07.100+0000 7f91525ff700 1 -- 172.21.15.100:0/742360742 wait complete. 2023-12-05T10:05:07.103 INFO:teuthology.orchestra.run.smithi100.stderr:listed 39 entries 2023-12-05T10:05:07.115 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-05T10:05:07.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T10:05:07.116 DEBUG:teuthology.orchestra.run.smithi150:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-05T10:05:07.211 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi150.front.sepia.ceph.com 2023-12-05T10:05:07.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T10:05:07.212 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-05T10:05:07.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T10:05:07.287 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2023-12-05T10:05:07.365 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-05T10:05:07.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T10:05:07.366 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-05T10:05:07.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:05:07 smithi100 ceph-mon[187528]: pgmap v225: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:05:07.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:05:07 smithi100 ceph-mon[187528]: from='client.? 172.21.15.100:0/4114562831' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-05T10:05:07.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:05:07 smithi100 ceph-mon[187528]: from='client.? 172.21.15.100:0/742360742' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-12-05T10:05:07.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T10:05:07.439 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link delete ceph-brx 2023-12-05T10:05:07.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T10:05:07.591 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list 2023-12-05T10:05:07.596 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:05:07 smithi150 ceph-mon[171606]: pgmap v225: 65 pgs: 65 active+clean; 195 MiB data, 809 MiB used, 536 GiB / 536 GiB avail 2023-12-05T10:05:07.597 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:05:07 smithi150 ceph-mon[171606]: from='client.? 172.21.15.100:0/4114562831' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-05T10:05:07.597 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:05:07 smithi150 ceph-mon[171606]: from='client.? 172.21.15.100:0/742360742' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-12-05T10:05:07.639 INFO:teuthology.orchestra.run.smithi150.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-05T10:05:07.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T10:05:07.640 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-05T10:05:07.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T10:05:07.716 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link delete ceph-brx 2023-12-05T10:05:07.828 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2023-12-05T10:05:07.844 INFO:tasks.cephadm:Teardown begin 2023-12-05T10:05:07.845 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-05T10:05:07.918 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-05T10:05:07.992 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2023-12-05T10:05:07.992 DEBUG:teuthology.orchestra.run.smithi100:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-12-05T10:05:08.039 DEBUG:teuthology.orchestra.run.smithi150:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-12-05T10:05:08.085 INFO:tasks.cephadm:Stopping all daemons... 2023-12-05T10:05:08.085 INFO:tasks.cephadm.mon.smithi100:Stopping mon.smithi100... 2023-12-05T10:05:08.085 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-5b035ce6-9353-11ee-95a2-87774f69a715@mon.smithi100 2023-12-05T10:05:08.441 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:05:08 smithi100 systemd[1]: Stopping Ceph mon.smithi100 for 5b035ce6-9353-11ee-95a2-87774f69a715... 2023-12-05T10:05:08.713 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:05:08 smithi100 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-mon-smithi100[187505]: 2023-12-05T10:05:08.442+0000 7f3d54dde700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi100 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-05T10:05:08.713 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:05:08 smithi100 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-mon-smithi100[187505]: 2023-12-05T10:05:08.442+0000 7f3d54dde700 -1 mon.smithi100@0(leader) e3 *** Got Signal Terminated *** 2023-12-05T10:05:09.006 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Dec 05 10:05:08 smithi100 bash[219911]: ceph-5b035ce6-9353-11ee-95a2-87774f69a715-mon-smithi100 2023-12-05T10:05:09.035 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b035ce6-9353-11ee-95a2-87774f69a715@mon.smithi100.service' 2023-12-05T10:05:09.130 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-05T10:05:09.130 INFO:tasks.cephadm.mon.smithi100:Stopped mon.smithi100 2023-12-05T10:05:09.130 INFO:tasks.cephadm.mon.smithi150:Stopping mon.smithi150... 2023-12-05T10:05:09.131 DEBUG:teuthology.orchestra.run.smithi150:> sudo systemctl stop ceph-5b035ce6-9353-11ee-95a2-87774f69a715@mon.smithi150 2023-12-05T10:05:09.490 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:05:09 smithi150 systemd[1]: Stopping Ceph mon.smithi150 for 5b035ce6-9353-11ee-95a2-87774f69a715... 2023-12-05T10:05:09.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:05:09 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-mon-smithi150[171583]: 2023-12-05T10:05:09.490+0000 7f7ab45f9700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi150 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-05T10:05:09.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:05:09 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-mon-smithi150[171583]: 2023-12-05T10:05:09.490+0000 7f7ab45f9700 -1 mon.smithi150@1(peon) e3 *** Got Signal Terminated *** 2023-12-05T10:05:09.846 INFO:journalctl@ceph.mon.smithi150.smithi150.stdout:Dec 05 10:05:09 smithi150 bash[201741]: ceph-5b035ce6-9353-11ee-95a2-87774f69a715-mon-smithi150 2023-12-05T10:05:10.070 DEBUG:teuthology.orchestra.run.smithi150:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b035ce6-9353-11ee-95a2-87774f69a715@mon.smithi150.service' 2023-12-05T10:05:10.163 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-05T10:05:10.163 INFO:tasks.cephadm.mon.smithi150:Stopped mon.smithi150 2023-12-05T10:05:10.163 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2023-12-05T10:05:10.163 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-5b035ce6-9353-11ee-95a2-87774f69a715@osd.0 2023-12-05T10:05:10.515 INFO:journalctl@ceph.osd.0.smithi100.stdout:Dec 05 10:05:10 smithi100 systemd[1]: Stopping Ceph osd.0 for 5b035ce6-9353-11ee-95a2-87774f69a715... 2023-12-05T10:05:10.895 INFO:journalctl@ceph.osd.0.smithi100.stdout:Dec 05 10:05:10 smithi100 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-0[197680]: 2023-12-05T10:05:10.518+0000 7f30b8672700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-05T10:05:10.895 INFO:journalctl@ceph.osd.0.smithi100.stdout:Dec 05 10:05:10 smithi100 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-0[197680]: 2023-12-05T10:05:10.518+0000 7f30b8672700 -1 osd.0 95 *** Got signal Terminated *** 2023-12-05T10:05:10.896 INFO:journalctl@ceph.osd.0.smithi100.stdout:Dec 05 10:05:10 smithi100 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-0[197680]: 2023-12-05T10:05:10.518+0000 7f30b8672700 -1 osd.0 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-05T10:05:16.646 INFO:journalctl@ceph.osd.0.smithi100.stdout:Dec 05 10:05:16 smithi100 bash[220066]: ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-0 2023-12-05T10:05:17.809 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b035ce6-9353-11ee-95a2-87774f69a715@osd.0.service' 2023-12-05T10:05:17.901 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-05T10:05:17.901 INFO:tasks.cephadm.osd.0:Stopped osd.0 2023-12-05T10:05:17.902 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2023-12-05T10:05:17.902 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-5b035ce6-9353-11ee-95a2-87774f69a715@osd.1 2023-12-05T10:05:18.146 INFO:journalctl@ceph.osd.1.smithi100.stdout:Dec 05 10:05:17 smithi100 systemd[1]: Stopping Ceph osd.1 for 5b035ce6-9353-11ee-95a2-87774f69a715... 2023-12-05T10:05:18.645 INFO:journalctl@ceph.osd.1.smithi100.stdout:Dec 05 10:05:18 smithi100 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-1[204232]: 2023-12-05T10:05:18.240+0000 7f08496d0700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-05T10:05:18.645 INFO:journalctl@ceph.osd.1.smithi100.stdout:Dec 05 10:05:18 smithi100 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-1[204232]: 2023-12-05T10:05:18.241+0000 7f08496d0700 -1 osd.1 95 *** Got signal Terminated *** 2023-12-05T10:05:18.646 INFO:journalctl@ceph.osd.1.smithi100.stdout:Dec 05 10:05:18 smithi100 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-1[204232]: 2023-12-05T10:05:18.241+0000 7f08496d0700 -1 osd.1 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-05T10:05:24.145 INFO:journalctl@ceph.osd.1.smithi100.stdout:Dec 05 10:05:23 smithi100 bash[220331]: ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-1 2023-12-05T10:05:25.453 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b035ce6-9353-11ee-95a2-87774f69a715@osd.1.service' 2023-12-05T10:05:25.544 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-05T10:05:25.544 INFO:tasks.cephadm.osd.1:Stopped osd.1 2023-12-05T10:05:25.544 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2023-12-05T10:05:25.544 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-5b035ce6-9353-11ee-95a2-87774f69a715@osd.2 2023-12-05T10:05:25.879 INFO:journalctl@ceph.osd.2.smithi100.stdout:Dec 05 10:05:25 smithi100 systemd[1]: Stopping Ceph osd.2 for 5b035ce6-9353-11ee-95a2-87774f69a715... 2023-12-05T10:05:26.145 INFO:journalctl@ceph.osd.2.smithi100.stdout:Dec 05 10:05:25 smithi100 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-2[210894]: 2023-12-05T10:05:25.881+0000 7fce2366b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-05T10:05:26.145 INFO:journalctl@ceph.osd.2.smithi100.stdout:Dec 05 10:05:25 smithi100 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-2[210894]: 2023-12-05T10:05:25.881+0000 7fce2366b700 -1 osd.2 95 *** Got signal Terminated *** 2023-12-05T10:05:26.146 INFO:journalctl@ceph.osd.2.smithi100.stdout:Dec 05 10:05:25 smithi100 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-2[210894]: 2023-12-05T10:05:25.881+0000 7fce2366b700 -1 osd.2 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-05T10:05:31.895 INFO:journalctl@ceph.osd.2.smithi100.stdout:Dec 05 10:05:31 smithi100 bash[220592]: ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-2 2023-12-05T10:05:33.118 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b035ce6-9353-11ee-95a2-87774f69a715@osd.2.service' 2023-12-05T10:05:33.210 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-05T10:05:33.210 INFO:tasks.cephadm.osd.2:Stopped osd.2 2023-12-05T10:05:33.210 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2023-12-05T10:05:33.210 DEBUG:teuthology.orchestra.run.smithi150:> sudo systemctl stop ceph-5b035ce6-9353-11ee-95a2-87774f69a715@osd.3 2023-12-05T10:05:33.561 INFO:journalctl@ceph.osd.3.smithi150.stdout:Dec 05 10:05:33 smithi150 systemd[1]: Stopping Ceph osd.3 for 5b035ce6-9353-11ee-95a2-87774f69a715... 2023-12-05T10:05:33.845 INFO:journalctl@ceph.osd.3.smithi150.stdout:Dec 05 10:05:33 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-3[183676]: 2023-12-05T10:05:33.563+0000 7fdb5d189700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-05T10:05:33.846 INFO:journalctl@ceph.osd.3.smithi150.stdout:Dec 05 10:05:33 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-3[183676]: 2023-12-05T10:05:33.563+0000 7fdb5d189700 -1 osd.3 95 *** Got signal Terminated *** 2023-12-05T10:05:33.846 INFO:journalctl@ceph.osd.3.smithi150.stdout:Dec 05 10:05:33 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-3[183676]: 2023-12-05T10:05:33.563+0000 7fdb5d189700 -1 osd.3 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-05T10:05:36.846 INFO:journalctl@ceph.osd.4.smithi150.stdout:Dec 05 10:05:36 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-4[189629]: 2023-12-05T10:05:36.450+0000 7f54efa54700 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2023-12-05T10:05:12.563908+0000 front 2023-12-05T10:05:12.563848+0000 (oldest deadline 2023-12-05T10:05:36.063736+0000) 2023-12-05T10:05:37.345 INFO:journalctl@ceph.osd.3.smithi150.stdout:Dec 05 10:05:37 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-3[183676]: 2023-12-05T10:05:37.090+0000 7fdb57f81700 -1 osd.3 95 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2023-12-05T10:05:11.525293+0000 front 2023-12-05T10:05:11.525383+0000 (oldest deadline 2023-12-05T10:05:36.825121+0000) 2023-12-05T10:05:37.845 INFO:journalctl@ceph.osd.4.smithi150.stdout:Dec 05 10:05:37 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-4[189629]: 2023-12-05T10:05:37.453+0000 7f54efa54700 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2023-12-05T10:05:12.563908+0000 front 2023-12-05T10:05:12.563848+0000 (oldest deadline 2023-12-05T10:05:36.063736+0000) 2023-12-05T10:05:38.428 INFO:journalctl@ceph.osd.3.smithi150.stdout:Dec 05 10:05:38 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-3[183676]: 2023-12-05T10:05:38.136+0000 7fdb57f81700 -1 osd.3 95 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2023-12-05T10:05:11.525293+0000 front 2023-12-05T10:05:11.525383+0000 (oldest deadline 2023-12-05T10:05:36.825121+0000) 2023-12-05T10:05:38.428 INFO:journalctl@ceph.osd.5.smithi150.stdout:Dec 05 10:05:38 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-5[195598]: 2023-12-05T10:05:38.108+0000 7f415cbec700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2023-12-05T10:05:14.664904+0000 front 2023-12-05T10:05:14.665023+0000 (oldest deadline 2023-12-05T10:05:37.565034+0000) 2023-12-05T10:05:38.845 INFO:journalctl@ceph.osd.4.smithi150.stdout:Dec 05 10:05:38 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-4[189629]: 2023-12-05T10:05:38.431+0000 7f54efa54700 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2023-12-05T10:05:12.563908+0000 front 2023-12-05T10:05:12.563848+0000 (oldest deadline 2023-12-05T10:05:36.063736+0000) 2023-12-05T10:05:39.417 INFO:journalctl@ceph.osd.3.smithi150.stdout:Dec 05 10:05:39 smithi150 bash[201887]: ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-3 2023-12-05T10:05:39.418 INFO:journalctl@ceph.osd.5.smithi150.stdout:Dec 05 10:05:39 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-5[195598]: 2023-12-05T10:05:39.116+0000 7f415cbec700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2023-12-05T10:05:14.664904+0000 front 2023-12-05T10:05:14.665023+0000 (oldest deadline 2023-12-05T10:05:37.565034+0000) 2023-12-05T10:05:39.846 INFO:journalctl@ceph.osd.4.smithi150.stdout:Dec 05 10:05:39 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-4[189629]: 2023-12-05T10:05:39.420+0000 7f54efa54700 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2023-12-05T10:05:12.563908+0000 front 2023-12-05T10:05:12.563848+0000 (oldest deadline 2023-12-05T10:05:36.063736+0000) 2023-12-05T10:05:40.346 INFO:journalctl@ceph.osd.5.smithi150.stdout:Dec 05 10:05:40 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-5[195598]: 2023-12-05T10:05:40.155+0000 7f415cbec700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2023-12-05T10:05:14.664904+0000 front 2023-12-05T10:05:14.665023+0000 (oldest deadline 2023-12-05T10:05:37.565034+0000) 2023-12-05T10:05:40.742 INFO:journalctl@ceph.osd.4.smithi150.stdout:Dec 05 10:05:40 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-4[189629]: 2023-12-05T10:05:40.395+0000 7f54efa54700 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2023-12-05T10:05:12.563908+0000 front 2023-12-05T10:05:12.563848+0000 (oldest deadline 2023-12-05T10:05:36.063736+0000) 2023-12-05T10:05:40.774 DEBUG:teuthology.orchestra.run.smithi150:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b035ce6-9353-11ee-95a2-87774f69a715@osd.3.service' 2023-12-05T10:05:40.865 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-05T10:05:40.866 INFO:tasks.cephadm.osd.3:Stopped osd.3 2023-12-05T10:05:40.866 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2023-12-05T10:05:40.866 DEBUG:teuthology.orchestra.run.smithi150:> sudo systemctl stop ceph-5b035ce6-9353-11ee-95a2-87774f69a715@osd.4 2023-12-05T10:05:41.095 INFO:journalctl@ceph.osd.4.smithi150.stdout:Dec 05 10:05:40 smithi150 systemd[1]: Stopping Ceph osd.4 for 5b035ce6-9353-11ee-95a2-87774f69a715... 2023-12-05T10:05:41.596 INFO:journalctl@ceph.osd.4.smithi150.stdout:Dec 05 10:05:41 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-4[189629]: 2023-12-05T10:05:41.254+0000 7f54f3459700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-05T10:05:41.596 INFO:journalctl@ceph.osd.4.smithi150.stdout:Dec 05 10:05:41 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-4[189629]: 2023-12-05T10:05:41.254+0000 7f54f3459700 -1 osd.4 95 *** Got signal Terminated *** 2023-12-05T10:05:41.596 INFO:journalctl@ceph.osd.4.smithi150.stdout:Dec 05 10:05:41 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-4[189629]: 2023-12-05T10:05:41.254+0000 7f54f3459700 -1 osd.4 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-05T10:05:41.596 INFO:journalctl@ceph.osd.4.smithi150.stdout:Dec 05 10:05:41 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-4[189629]: 2023-12-05T10:05:41.360+0000 7f54efa54700 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2023-12-05T10:05:12.563908+0000 front 2023-12-05T10:05:12.563848+0000 (oldest deadline 2023-12-05T10:05:36.063736+0000) 2023-12-05T10:05:41.596 INFO:journalctl@ceph.osd.5.smithi150.stdout:Dec 05 10:05:41 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-5[195598]: 2023-12-05T10:05:41.181+0000 7f415cbec700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2023-12-05T10:05:14.664904+0000 front 2023-12-05T10:05:14.665023+0000 (oldest deadline 2023-12-05T10:05:37.565034+0000) 2023-12-05T10:05:42.596 INFO:journalctl@ceph.osd.4.smithi150.stdout:Dec 05 10:05:42 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-4[189629]: 2023-12-05T10:05:42.354+0000 7f54efa54700 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2023-12-05T10:05:12.563908+0000 front 2023-12-05T10:05:12.563848+0000 (oldest deadline 2023-12-05T10:05:36.063736+0000) 2023-12-05T10:05:42.596 INFO:journalctl@ceph.osd.5.smithi150.stdout:Dec 05 10:05:42 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-5[195598]: 2023-12-05T10:05:42.218+0000 7f415cbec700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2023-12-05T10:05:14.664904+0000 front 2023-12-05T10:05:14.665023+0000 (oldest deadline 2023-12-05T10:05:37.565034+0000) 2023-12-05T10:05:43.595 INFO:journalctl@ceph.osd.5.smithi150.stdout:Dec 05 10:05:43 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-5[195598]: 2023-12-05T10:05:43.222+0000 7f415cbec700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2023-12-05T10:05:14.664904+0000 front 2023-12-05T10:05:14.665023+0000 (oldest deadline 2023-12-05T10:05:37.565034+0000) 2023-12-05T10:05:43.596 INFO:journalctl@ceph.osd.4.smithi150.stdout:Dec 05 10:05:43 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-4[189629]: 2023-12-05T10:05:43.368+0000 7f54efa54700 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2023-12-05T10:05:12.563908+0000 front 2023-12-05T10:05:12.563848+0000 (oldest deadline 2023-12-05T10:05:36.063736+0000) 2023-12-05T10:05:44.595 INFO:journalctl@ceph.osd.4.smithi150.stdout:Dec 05 10:05:44 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-4[189629]: 2023-12-05T10:05:44.325+0000 7f54efa54700 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2023-12-05T10:05:12.563908+0000 front 2023-12-05T10:05:12.563848+0000 (oldest deadline 2023-12-05T10:05:36.063736+0000) 2023-12-05T10:05:44.596 INFO:journalctl@ceph.osd.5.smithi150.stdout:Dec 05 10:05:44 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-5[195598]: 2023-12-05T10:05:44.226+0000 7f415cbec700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2023-12-05T10:05:14.664904+0000 front 2023-12-05T10:05:14.665023+0000 (oldest deadline 2023-12-05T10:05:37.565034+0000) 2023-12-05T10:05:45.596 INFO:journalctl@ceph.osd.5.smithi150.stdout:Dec 05 10:05:45 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-5[195598]: 2023-12-05T10:05:45.191+0000 7f415cbec700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2023-12-05T10:05:14.664904+0000 front 2023-12-05T10:05:14.665023+0000 (oldest deadline 2023-12-05T10:05:37.565034+0000) 2023-12-05T10:05:45.596 INFO:journalctl@ceph.osd.4.smithi150.stdout:Dec 05 10:05:45 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-4[189629]: 2023-12-05T10:05:45.296+0000 7f54efa54700 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2023-12-05T10:05:12.563908+0000 front 2023-12-05T10:05:12.563848+0000 (oldest deadline 2023-12-05T10:05:36.063736+0000) 2023-12-05T10:05:45.596 INFO:journalctl@ceph.osd.4.smithi150.stdout:Dec 05 10:05:45 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-4[189629]: 2023-12-05T10:05:45.296+0000 7f54efa54700 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.100:6814 osd.1 since back 2023-12-05T10:05:21.765369+0000 front 2023-12-05T10:05:21.765353+0000 (oldest deadline 2023-12-05T10:05:45.265247+0000) 2023-12-05T10:05:46.596 INFO:journalctl@ceph.osd.5.smithi150.stdout:Dec 05 10:05:46 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-5[195598]: 2023-12-05T10:05:46.175+0000 7f415cbec700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2023-12-05T10:05:14.664904+0000 front 2023-12-05T10:05:14.665023+0000 (oldest deadline 2023-12-05T10:05:37.565034+0000) 2023-12-05T10:05:47.096 INFO:journalctl@ceph.osd.4.smithi150.stdout:Dec 05 10:05:46 smithi150 bash[202162]: ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-4 2023-12-05T10:05:47.523 INFO:journalctl@ceph.osd.5.smithi150.stdout:Dec 05 10:05:47 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-5[195598]: 2023-12-05T10:05:47.143+0000 7f415cbec700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2023-12-05T10:05:14.664904+0000 front 2023-12-05T10:05:14.665023+0000 (oldest deadline 2023-12-05T10:05:37.565034+0000) 2023-12-05T10:05:47.524 INFO:journalctl@ceph.osd.5.smithi150.stdout:Dec 05 10:05:47 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-5[195598]: 2023-12-05T10:05:47.143+0000 7f415cbec700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.100:6814 osd.1 since back 2023-12-05T10:05:22.166554+0000 front 2023-12-05T10:05:22.166591+0000 (oldest deadline 2023-12-05T10:05:46.266249+0000) 2023-12-05T10:05:48.346 INFO:journalctl@ceph.osd.5.smithi150.stdout:Dec 05 10:05:48 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-5[195598]: 2023-12-05T10:05:48.120+0000 7f415cbec700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2023-12-05T10:05:14.664904+0000 front 2023-12-05T10:05:14.665023+0000 (oldest deadline 2023-12-05T10:05:37.565034+0000) 2023-12-05T10:05:48.346 INFO:journalctl@ceph.osd.5.smithi150.stdout:Dec 05 10:05:48 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-5[195598]: 2023-12-05T10:05:48.120+0000 7f415cbec700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.100:6814 osd.1 since back 2023-12-05T10:05:22.166554+0000 front 2023-12-05T10:05:22.166591+0000 (oldest deadline 2023-12-05T10:05:46.266249+0000) 2023-12-05T10:05:48.436 DEBUG:teuthology.orchestra.run.smithi150:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b035ce6-9353-11ee-95a2-87774f69a715@osd.4.service' 2023-12-05T10:05:48.526 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-05T10:05:48.526 INFO:tasks.cephadm.osd.4:Stopped osd.4 2023-12-05T10:05:48.527 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2023-12-05T10:05:48.527 DEBUG:teuthology.orchestra.run.smithi150:> sudo systemctl stop ceph-5b035ce6-9353-11ee-95a2-87774f69a715@osd.5 2023-12-05T10:05:48.846 INFO:journalctl@ceph.osd.5.smithi150.stdout:Dec 05 10:05:48 smithi150 systemd[1]: Stopping Ceph osd.5 for 5b035ce6-9353-11ee-95a2-87774f69a715... 2023-12-05T10:05:49.149 INFO:journalctl@ceph.osd.5.smithi150.stdout:Dec 05 10:05:48 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-5[195598]: 2023-12-05T10:05:48.894+0000 7f41625f5700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-05T10:05:49.150 INFO:journalctl@ceph.osd.5.smithi150.stdout:Dec 05 10:05:48 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-5[195598]: 2023-12-05T10:05:48.894+0000 7f41625f5700 -1 osd.5 95 *** Got signal Terminated *** 2023-12-05T10:05:49.150 INFO:journalctl@ceph.osd.5.smithi150.stdout:Dec 05 10:05:48 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-5[195598]: 2023-12-05T10:05:48.894+0000 7f41625f5700 -1 osd.5 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-05T10:05:49.596 INFO:journalctl@ceph.osd.5.smithi150.stdout:Dec 05 10:05:49 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-5[195598]: 2023-12-05T10:05:49.152+0000 7f415cbec700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2023-12-05T10:05:14.664904+0000 front 2023-12-05T10:05:14.665023+0000 (oldest deadline 2023-12-05T10:05:37.565034+0000) 2023-12-05T10:05:49.596 INFO:journalctl@ceph.osd.5.smithi150.stdout:Dec 05 10:05:49 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-5[195598]: 2023-12-05T10:05:49.152+0000 7f415cbec700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.100:6814 osd.1 since back 2023-12-05T10:05:22.166554+0000 front 2023-12-05T10:05:22.166591+0000 (oldest deadline 2023-12-05T10:05:46.266249+0000) 2023-12-05T10:05:50.595 INFO:journalctl@ceph.osd.5.smithi150.stdout:Dec 05 10:05:50 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-5[195598]: 2023-12-05T10:05:50.185+0000 7f415cbec700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2023-12-05T10:05:14.664904+0000 front 2023-12-05T10:05:14.665023+0000 (oldest deadline 2023-12-05T10:05:37.565034+0000) 2023-12-05T10:05:50.596 INFO:journalctl@ceph.osd.5.smithi150.stdout:Dec 05 10:05:50 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-5[195598]: 2023-12-05T10:05:50.185+0000 7f415cbec700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.100:6814 osd.1 since back 2023-12-05T10:05:22.166554+0000 front 2023-12-05T10:05:22.166591+0000 (oldest deadline 2023-12-05T10:05:46.266249+0000) 2023-12-05T10:05:51.596 INFO:journalctl@ceph.osd.5.smithi150.stdout:Dec 05 10:05:51 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-5[195598]: 2023-12-05T10:05:51.205+0000 7f415cbec700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2023-12-05T10:05:14.664904+0000 front 2023-12-05T10:05:14.665023+0000 (oldest deadline 2023-12-05T10:05:37.565034+0000) 2023-12-05T10:05:51.596 INFO:journalctl@ceph.osd.5.smithi150.stdout:Dec 05 10:05:51 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-5[195598]: 2023-12-05T10:05:51.205+0000 7f415cbec700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.100:6814 osd.1 since back 2023-12-05T10:05:22.166554+0000 front 2023-12-05T10:05:22.166591+0000 (oldest deadline 2023-12-05T10:05:46.266249+0000) 2023-12-05T10:05:52.595 INFO:journalctl@ceph.osd.5.smithi150.stdout:Dec 05 10:05:52 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-5[195598]: 2023-12-05T10:05:52.205+0000 7f415cbec700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2023-12-05T10:05:14.664904+0000 front 2023-12-05T10:05:14.665023+0000 (oldest deadline 2023-12-05T10:05:37.565034+0000) 2023-12-05T10:05:52.596 INFO:journalctl@ceph.osd.5.smithi150.stdout:Dec 05 10:05:52 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-5[195598]: 2023-12-05T10:05:52.205+0000 7f415cbec700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.100:6814 osd.1 since back 2023-12-05T10:05:22.166554+0000 front 2023-12-05T10:05:22.166591+0000 (oldest deadline 2023-12-05T10:05:46.266249+0000) 2023-12-05T10:05:52.596 INFO:journalctl@ceph.osd.5.smithi150.stdout:Dec 05 10:05:52 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-5[195598]: 2023-12-05T10:05:52.205+0000 7f415cbec700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.100:6822 osd.2 since back 2023-12-05T10:05:29.767521+0000 front 2023-12-05T10:05:29.767579+0000 (oldest deadline 2023-12-05T10:05:51.467290+0000) 2023-12-05T10:05:53.595 INFO:journalctl@ceph.osd.5.smithi150.stdout:Dec 05 10:05:53 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-5[195598]: 2023-12-05T10:05:53.218+0000 7f415cbec700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2023-12-05T10:05:14.664904+0000 front 2023-12-05T10:05:14.665023+0000 (oldest deadline 2023-12-05T10:05:37.565034+0000) 2023-12-05T10:05:53.596 INFO:journalctl@ceph.osd.5.smithi150.stdout:Dec 05 10:05:53 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-5[195598]: 2023-12-05T10:05:53.218+0000 7f415cbec700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.100:6814 osd.1 since back 2023-12-05T10:05:22.166554+0000 front 2023-12-05T10:05:22.166591+0000 (oldest deadline 2023-12-05T10:05:46.266249+0000) 2023-12-05T10:05:53.596 INFO:journalctl@ceph.osd.5.smithi150.stdout:Dec 05 10:05:53 smithi150 ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-5[195598]: 2023-12-05T10:05:53.218+0000 7f415cbec700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.100:6822 osd.2 since back 2023-12-05T10:05:29.767521+0000 front 2023-12-05T10:05:29.767579+0000 (oldest deadline 2023-12-05T10:05:51.467290+0000) 2023-12-05T10:05:54.846 INFO:journalctl@ceph.osd.5.smithi150.stdout:Dec 05 10:05:54 smithi150 bash[202429]: ceph-5b035ce6-9353-11ee-95a2-87774f69a715-osd-5 2023-12-05T10:05:56.107 DEBUG:teuthology.orchestra.run.smithi150:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b035ce6-9353-11ee-95a2-87774f69a715@osd.5.service' 2023-12-05T10:05:56.196 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-05T10:05:56.196 INFO:tasks.cephadm.osd.5:Stopped osd.5 2023-12-05T10:05:56.197 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 --force --keep-logs 2023-12-05T10:06:13.260 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 --force --keep-logs 2023-12-05T10:06:26.304 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-05T10:06:26.385 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-05T10:06:26.459 INFO:tasks.cephadm:Archiving crash dumps... 2023-12-05T10:06:26.461 DEBUG:teuthology.misc:Transferring archived files from smithi100:/var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/crash to /home/teuthworker/archive/mchangir-2023-12-05_08:35:01-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7477483/remote/smithi100/crash 2023-12-05T10:06:26.462 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar c -f - -C /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/crash -- . 2023-12-05T10:06:26.532 INFO:teuthology.orchestra.run.smithi100.stderr:tar: /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/crash: Cannot open: No such file or directory 2023-12-05T10:06:26.533 INFO:teuthology.orchestra.run.smithi100.stderr:tar: Error is not recoverable: exiting now 2023-12-05T10:06:26.535 DEBUG:teuthology.misc:Transferring archived files from smithi150:/var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/crash to /home/teuthworker/archive/mchangir-2023-12-05_08:35:01-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7477483/remote/smithi150/crash 2023-12-05T10:06:26.536 DEBUG:teuthology.orchestra.run.smithi150:> sudo tar c -f - -C /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/crash -- . 2023-12-05T10:06:26.604 INFO:teuthology.orchestra.run.smithi150.stderr:tar: /var/lib/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/crash: Cannot open: No such file or directory 2023-12-05T10:06:26.604 INFO:teuthology.orchestra.run.smithi150.stderr:tar: Error is not recoverable: exiting now 2023-12-05T10:06:26.607 INFO:tasks.cephadm:Checking cluster log for badness... 2023-12-05T10:06:26.607 DEBUG:teuthology.orchestra.run.smithi100:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-12-05T10:06:26.685 INFO:teuthology.orchestra.run.smithi100.stderr:grep: /var/log/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/ceph.log: No such file or directory 2023-12-05T10:06:26.690 INFO:tasks.cephadm:Compressing logs... 2023-12-05T10:06:26.690 DEBUG:teuthology.orchestra.run.smithi100:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-05T10:06:26.694 DEBUG:teuthology.orchestra.run.smithi150:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-05T10:06:26.759 INFO:teuthology.orchestra.run.smithi100.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2023-12-05T10:06:26.759 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-12-05T10:06:26.760 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/ceph-mgr.smithi100.ehmuhg.log 2023-12-05T10:06:26.760 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/ceph-volume.log 2023-12-05T10:06:26.762 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/ceph-mgr.smithi100.ehmuhg.log: gzip -5 --verbose -- /var/log/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/ceph-osd.2.log 2023-12-05T10:06:26.764 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/ceph-mon.smithi100.log 2023-12-05T10:06:26.764 INFO:teuthology.orchestra.run.smithi150.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-12-05T10:06:26.764 INFO:teuthology.orchestra.run.smithi150.stderr:: No such file or directory 2023-12-05T10:06:26.765 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/ceph-volume.log 2023-12-05T10:06:26.765 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/ceph-osd.0.log 2023-12-05T10:06:26.766 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/ceph-mgr.smithi150.zkskag.log 2023-12-05T10:06:26.767 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/ceph-mon.smithi100.log: gzip -5 --verbose -- /var/log/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/ceph-mds.cephfs.smithi100.sqplhn.log 2023-12-05T10:06:26.767 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/ceph-mon.smithi150.log 2023-12-05T10:06:26.768 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/ceph-mgr.smithi150.zkskag.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2023-12-05T10:06:26.768 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/ceph-osd.3.log 2023-12-05T10:06:26.768 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/ceph-mds.cephfs.smithi100.akmstb.log 2023-12-05T10:06:26.769 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/ceph-mon.smithi150.log: gzip -5 --verbose -- /var/log/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/ceph-mds.cephfs.smithi150.pcbpxm.log 2023-12-05T10:06:26.771 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/ceph-mds.cephfs.smithi150.fcnhsv.log 2023-12-05T10:06:26.772 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/ceph-mds.cephfs.smithi100.sqplhn.log: 91.2% -- replaced with /var/log/ceph/cephadm.log.gz 2023-12-05T10:06:26.773 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/ceph-osd.1.log 2023-12-05T10:06:26.773 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/ceph-mds.cephfs.smithi150.pcbpxm.log: gzip -5 --verbose -- /var/log/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/ceph-osd.4.log 2023-12-05T10:06:26.774 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/ceph-mds.cephfs.smithi100.akmstb.log: 90.6% -- replaced with /var/log/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/ceph-volume.log.gz 2023-12-05T10:06:26.777 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/ceph-mds.cephfs.smithi150.fcnhsv.log: /var/log/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/ceph-osd.5.log 2023-12-05T10:06:26.777 INFO:teuthology.orchestra.run.smithi150.stderr: 94.2% -- replaced with /var/log/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/ceph-mds.cephfs.smithi150.pcbpxm.log.gz 2023-12-05T10:06:26.778 INFO:teuthology.orchestra.run.smithi150.stderr: 94.3% -- replaced with /var/log/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/ceph-mds.cephfs.smithi150.fcnhsv.log.gz 2023-12-05T10:06:26.778 INFO:teuthology.orchestra.run.smithi150.stderr: 90.7% -- replaced with /var/log/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/ceph-volume.log.gz 2023-12-05T10:06:26.781 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/ceph-osd.1.log: 91.6% -- replaced with /var/log/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/ceph-mds.cephfs.smithi100.sqplhn.log.gz 2023-12-05T10:06:26.807 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/ceph-osd.5.log: 88.6% -- replaced with /var/log/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/ceph-mgr.smithi150.zkskag.log.gz 2023-12-05T10:06:26.960 INFO:teuthology.orchestra.run.smithi100.stderr: 88.2% -- replaced with /var/log/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/ceph-mgr.smithi100.ehmuhg.log.gz 2023-12-05T10:06:26.990 INFO:teuthology.orchestra.run.smithi150.stderr: 92.5% -- replaced with /var/log/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/ceph-mon.smithi150.log.gz 2023-12-05T10:06:27.638 INFO:teuthology.orchestra.run.smithi100.stderr: 90.7% -- replaced with /var/log/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/ceph-mon.smithi100.log.gz 2023-12-05T10:06:31.349 INFO:teuthology.orchestra.run.smithi150.stderr: 93.3% -- replaced with /var/log/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/ceph-osd.4.log.gz 2023-12-05T10:06:31.934 INFO:teuthology.orchestra.run.smithi100.stderr: 93.3% -- replaced with /var/log/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/ceph-osd.2.log.gz 2023-12-05T10:06:32.161 INFO:teuthology.orchestra.run.smithi100.stderr: 93.4% -- replaced with /var/log/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/ceph-osd.0.log.gz 2023-12-05T10:06:32.914 INFO:teuthology.orchestra.run.smithi100.stderr: 93.4% -- replaced with /var/log/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/ceph-osd.1.log.gz 2023-12-05T10:06:33.590 INFO:teuthology.orchestra.run.smithi150.stderr: 93.4% -- replaced with /var/log/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/ceph-osd.3.log.gz 2023-12-05T10:06:34.095 INFO:teuthology.orchestra.run.smithi150.stderr: 92.9% -- replaced with /var/log/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/ceph-osd.5.log.gz 2023-12-05T10:06:34.098 INFO:teuthology.orchestra.run.smithi150.stderr: 2023-12-05T10:06:34.098 INFO:teuthology.orchestra.run.smithi150.stderr:real 0m7.359s 2023-12-05T10:06:34.098 INFO:teuthology.orchestra.run.smithi150.stderr:user 0m17.512s 2023-12-05T10:06:34.098 INFO:teuthology.orchestra.run.smithi150.stderr:sys 0m1.556s 2023-12-05T10:07:54.731 INFO:teuthology.orchestra.run.smithi100.stderr: 92.5% -- replaced with /var/log/ceph/5b035ce6-9353-11ee-95a2-87774f69a715/ceph-mds.cephfs.smithi100.akmstb.log.gz 2023-12-05T10:07:54.734 INFO:teuthology.orchestra.run.smithi100.stderr: 2023-12-05T10:07:54.734 INFO:teuthology.orchestra.run.smithi100.stderr:real 1m28.000s 2023-12-05T10:07:54.734 INFO:teuthology.orchestra.run.smithi100.stderr:user 1m37.912s 2023-12-05T10:07:54.734 INFO:teuthology.orchestra.run.smithi100.stderr:sys 0m7.578s 2023-12-05T10:07:54.736 INFO:tasks.cephadm:Archiving logs... 2023-12-05T10:07:54.736 DEBUG:teuthology.misc:Transferring archived files from smithi100:/var/log/ceph to /home/teuthworker/archive/mchangir-2023-12-05_08:35:01-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7477483/remote/smithi100/log 2023-12-05T10:07:54.738 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-05T10:08:10.818 DEBUG:teuthology.misc:Transferring archived files from smithi150:/var/log/ceph to /home/teuthworker/archive/mchangir-2023-12-05_08:35:01-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7477483/remote/smithi150/log 2023-12-05T10:08:10.819 DEBUG:teuthology.orchestra.run.smithi150:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-05T10:08:13.624 INFO:tasks.cephadm:Removing cluster... 2023-12-05T10:08:13.624 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 --force 2023-12-05T10:08:14.742 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 --force 2023-12-05T10:08:15.579 INFO:tasks.cephadm:Removing cephadm ... 2023-12-05T10:08:15.580 DEBUG:teuthology.orchestra.run.smithi100:> rm -rf /home/ubuntu/cephtest/cephadm 2023-12-05T10:08:15.630 DEBUG:teuthology.orchestra.run.smithi150:> rm -rf /home/ubuntu/cephtest/cephadm 2023-12-05T10:08:15.676 INFO:tasks.cephadm:Teardown complete 2023-12-05T10:08:15.677 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-12-05T10:08:15.690 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-12-05T10:08:15.690 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-05T10:08:15.695 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-05T10:08:15.833 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-12-05T10:08:15.844 INFO:teuthology.task.clock:Checking final clock skew... 2023-12-05T10:08:15.844 DEBUG:teuthology.orchestra.run.smithi100:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-05T10:08:15.849 DEBUG:teuthology.orchestra.run.smithi150:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-05T10:08:15.889 INFO:teuthology.orchestra.run.smithi100.stderr:bash: ntpq: command not found 2023-12-05T10:08:15.895 INFO:teuthology.orchestra.run.smithi150.stderr:bash: ntpq: command not found 2023-12-05T10:08:15.897 INFO:teuthology.orchestra.run.smithi100.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-05T10:08:15.897 INFO:teuthology.orchestra.run.smithi100.stdout:=============================================================================== 2023-12-05T10:08:15.897 INFO:teuthology.orchestra.run.smithi100.stdout:^+ hv01.front.sepia.ceph.com 2 7 377 2 +868us[ +868us] +/- 81ms 2023-12-05T10:08:15.897 INFO:teuthology.orchestra.run.smithi100.stdout:^* hv02.front.sepia.ceph.com 3 6 377 6 +399us[ +445us] +/- 64ms 2023-12-05T10:08:15.897 INFO:teuthology.orchestra.run.smithi100.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 5 -2171us[-2171us] +/- 122ms 2023-12-05T10:08:15.897 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-12-05T10:08:15.900 INFO:teuthology.orchestra.run.smithi150.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-05T10:08:15.901 INFO:teuthology.orchestra.run.smithi150.stdout:=============================================================================== 2023-12-05T10:08:15.901 INFO:teuthology.orchestra.run.smithi150.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 4 +859us[ +879us] +/- 81ms 2023-12-05T10:08:15.901 INFO:teuthology.orchestra.run.smithi150.stdout:^* hv02.front.sepia.ceph.com 3 6 377 3 +406us[ +426us] +/- 64ms 2023-12-05T10:08:15.901 INFO:teuthology.orchestra.run.smithi150.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 4 -2156us[-2135us] +/- 122ms 2023-12-05T10:08:15.901 INFO:teuthology.orchestra.run.smithi150.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-12-05T10:08:15.902 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-12-05T10:08:15.915 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-12-05T10:08:15.916 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-12-05T10:08:15.928 DEBUG:teuthology.orchestra.run.smithi100:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-05T10:08:16.109 DEBUG:teuthology.orchestra.run.smithi150:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-05T10:08:16.278 DEBUG:teuthology.orchestra.run.smithi100:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-05T10:08:16.355 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-05T10:08:16.356 DEBUG:teuthology.orchestra.run.smithi150:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-05T10:08:16.434 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-05T10:08:16.435 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-12-05T10:08:16.447 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-12-05T10:08:16.459 INFO:teuthology.task.internal:Duration was 2150.025505 seconds 2023-12-05T10:08:16.460 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-12-05T10:08:16.479 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-12-05T10:08:16.479 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-05T10:08:16.484 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-05T10:08:16.597 INFO:teuthology.orchestra.run.smithi100.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-05T10:08:16.602 INFO:teuthology.orchestra.run.smithi150.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-05T10:08:16.882 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-12-05T10:08:16.886 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi100.front.sepia.ceph.com 2023-12-05T10:08:16.886 DEBUG:teuthology.orchestra.run.smithi100:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-05T10:08:16.949 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi150.front.sepia.ceph.com 2023-12-05T10:08:16.949 DEBUG:teuthology.orchestra.run.smithi150:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-05T10:08:17.012 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-12-05T10:08:17.013 DEBUG:teuthology.orchestra.run.smithi100:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-05T10:08:17.017 DEBUG:teuthology.orchestra.run.smithi150:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-05T10:08:17.117 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-12-05T10:08:17.117 DEBUG:teuthology.orchestra.run.smithi100:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-05T10:08:17.122 DEBUG:teuthology.orchestra.run.smithi150:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-05T10:08:17.291 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-12-05T10:08:17.305 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-12-05T10:08:17.306 DEBUG:teuthology.orchestra.run.smithi100:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-05T10:08:17.376 DEBUG:teuthology.orchestra.run.smithi150:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-05T10:08:17.447 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-12-05T10:08:17.460 DEBUG:teuthology.orchestra.run.smithi100:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-05T10:08:17.465 DEBUG:teuthology.orchestra.run.smithi150:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-05T10:08:17.530 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern = core 2023-12-05T10:08:17.535 INFO:teuthology.orchestra.run.smithi150.stdout:kernel.core_pattern = core 2023-12-05T10:08:17.570 DEBUG:teuthology.orchestra.run.smithi100:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-05T10:08:17.614 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-05T10:08:17.615 DEBUG:teuthology.orchestra.run.smithi150:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-05T10:08:17.660 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-05T10:08:17.660 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-12-05T10:08:17.673 INFO:teuthology.task.internal:Transferring archived files... 2023-12-05T10:08:17.675 DEBUG:teuthology.misc:Transferring archived files from smithi100:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2023-12-05_08:35:01-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7477483/remote/smithi100 2023-12-05T10:08:17.675 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-05T10:08:17.770 DEBUG:teuthology.misc:Transferring archived files from smithi150:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2023-12-05_08:35:01-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7477483/remote/smithi150 2023-12-05T10:08:17.770 DEBUG:teuthology.orchestra.run.smithi150:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-05T10:08:17.854 INFO:teuthology.task.internal:Removing archive directory... 2023-12-05T10:08:17.855 DEBUG:teuthology.orchestra.run.smithi100:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-05T10:08:17.859 DEBUG:teuthology.orchestra.run.smithi150:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-05T10:08:17.909 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-12-05T10:08:17.929 INFO:teuthology.task.internal:Not uploading archives. 2023-12-05T10:08:17.929 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-12-05T10:08:17.944 INFO:teuthology.task.internal:Tidying up after the test... 2023-12-05T10:08:17.944 DEBUG:teuthology.orchestra.run.smithi100:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-05T10:08:17.949 DEBUG:teuthology.orchestra.run.smithi150:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-05T10:08:17.991 INFO:teuthology.orchestra.run.smithi100.stdout: 524293 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 5 10:08 /home/ubuntu/cephtest 2023-12-05T10:08:17.995 INFO:teuthology.orchestra.run.smithi150.stdout: 524293 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 5 10:08 /home/ubuntu/cephtest 2023-12-05T10:08:17.999 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-12-05T10:08:18.015 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-12-05T10:08:18.059 INFO:teuthology.nuke:Checking targets against current locks 2023-12-05T10:08:18.085 DEBUG:teuthology.nuke:shortname: smithi100 2023-12-05T10:08:18.086 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-05T10:08:18.112 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi100.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-12-05_08:35:01-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7477483', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-05 09:20:27.020804', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOnDFLD6mfgkHSo032210axjMA2n2OAfChZh321hYUSWNY79tGAdn+aZA1YR+K8Y1aFzcHWAIgTeElAXgCjKEdE='} 2023-12-05T10:08:18.118 DEBUG:teuthology.nuke:shortname: smithi150 2023-12-05T10:08:18.118 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-05T10:08:18.144 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi150.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-12-05_08:35:01-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7477483', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-05 09:20:27.022175', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHZXMznv4Nn4bcUpUz/yt77hOePWZBTuKw/Z/yGhe1pfD4yshqvLSdGeSsWyXONoYdFJsTxbGIajnCx91yNBmHA='} 2023-12-05T10:08:18.173 INFO:teuthology.orchestra.console.smithi100:Power off 2023-12-05T10:08:18.173 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-05T10:08:18.198 DEBUG:teuthology.orchestra.console.smithi100:power off output: Chassis Power Control: Down/Off 2023-12-05T10:08:18.198 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T10:08:18.215 INFO:teuthology.orchestra.console.smithi150:Power off 2023-12-05T10:08:18.216 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-05T10:08:18.226 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is on 2023-12-05T10:08:18.238 DEBUG:teuthology.orchestra.console.smithi150:power off output: Chassis Power Control: Down/Off 2023-12-05T10:08:18.239 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T10:08:18.263 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is on 2023-12-05T10:08:22.227 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T10:08:22.264 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T10:08:22.339 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is on 2023-12-05T10:08:22.376 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is on 2023-12-05T10:08:26.343 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T10:08:26.376 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T10:08:26.454 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is on 2023-12-05T10:08:26.486 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is on 2023-12-05T10:08:30.458 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T10:08:30.488 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T10:08:30.570 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is off 2023-12-05T10:08:30.600 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is off 2023-12-05T10:08:30.672 INFO:teuthology.orchestra.console.smithi100:Power off completed 2023-12-05T10:08:30.701 INFO:teuthology.orchestra.console.smithi150:Power off completed 2023-12-05T10:08:30.807 INFO:teuthology.run:Summary data: description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 2150.025504589081 failure_reason: 'Command failed on smithi100 with status 1: ''sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b035ce6-9353-11ee-95a2-87774f69a715 -e sha1=3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 -- bash -c \''ceph versions | jq -e \''"\''"\''.overall | length == 1\''"\''"\''\''''' flavor: default host.a-kernel-sha1: 9471594ae3a4c6992c4327df9a789df8f2b6aeae host.b-kernel-sha1: 9471594ae3a4c6992c4327df9a789df8f2b6aeae owner: mchangir sentry_event: https://sentry.ceph.com/organizations/ceph/?query=cb33cc8f2fee410e98cb3994e47c99ad status: fail success: false 2023-12-05T10:08:30.808 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T10:08:30.912 INFO:teuthology.run:FAIL